Write script that can scrape budget/nb of employees from wikipedia pages

€30-250 EUR

Completed

Posted

over 2 years ago

€30-250 EUR

Paid on delivery

The goal of this project is to deliver a python script that can scrape wikipedia pages (input is a csv with links to wikipedia pages to scrape). >>>>>Business requirements The script should scrape the following information (if exists), if the page is not in english, the information should still be scraped >>Mandatory requirements<< - Location or headquarters - budget/revenue - Number of employees >>Optional requirements<< - Number of volunteers - Staff - Subsidaries - Products - Services - Official Language - Director general - Board of directors - Parent organization - Affiliation - All the info in the infobox >>>>>Technical requirements >>Mandatory Technical requirements<< - The script should be written in python - Last step of the scripts, should be pandas dataframe(s) dropping the data to csvs. - Outputs must always have the same numbers of columns (columns migbt be empty) - The script should allow for stopping and restart from lastest completed scrape (via table of content for example). - The script should allow for the usage of proxies - Script should be commented - No selenium >>Important technical requirements<< - Script should used some "stealth" techniques (sleep, user-agent switches, …) - Api scraping is preferred >>Nice to have technical requirements<< - Possibility to do parallel sraping with different proxies >>>>>Deliverables - 1(or more) Python scripts - Csvs containing the data for the scripts scrapped (for verification)

Web Scraping

Data Processing

Python

Project ID: 31071020

About the project

21 proposals

Remote project

Active 3 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@mananraja

hi there, Can we talk more about this project in chat. Can we talk more about this project in chat. Can we talk more about this project in chat.

€70 EUR in 2 days

5.0

(189 reviews)

6.6

21 freelancers are bidding on average €156 EUR for this job

@saubhagyamweb

************************************************ Hello there, I’m a Professional and Expert Python developer. I am interested in doing this job for you. I do have necessary skill set & resources to complete this project. I am ready to start the project asap. Can you please discuss further about the project via chat-box ? Awaiting for your ping! Thank you Virang P. Please note that this is a placeholder proposal, we can be more specific once we get all the requirements and information required to execute the project.

€140 EUR in 7 days

5.0

(20 reviews)

6.4

@fabienbenoit1984

Hello! I'm experienced with python. I offer to spend 10 hours within 1 week. First 2 hours for a consultation. Thanks.

€250 EUR in 7 days

5.0

(9 reviews)

5.2

@mubashirallii

Hello Employer, I have experience in python scraping. I have read your all business and technical requirements. I can deliver you this project with high quality of code, accuracy and reliability. I can implement stealth techniques as well to make it more reliable code. Message to discuss details, deadline and budget of your project. Review my profile to be sure of my work I have done earlier. I agree to the deliverables as well. Looking forward to your response. Thanks,

€160 EUR in 1 day

5.0

(12 reviews)

4.7

@demydkasilov

Hello,how are you? I read your job description carefully and i can do it perfectly. I have much experience for 7+ years in WebScraping Field. I can do your job with php ,crawler,scrapy, BS4, Selenium modules of python. I have no any risk in scraping. I can make the csv , xlsx , mysql , mongodb, postgresql etc as output file. I think this project is for me. I think I can finish it for a short time with perfect result. I can start work immediately. Best Regards.

€140 EUR in 2 days

5.0

(11 reviews)

4.3

@gabrielor

Hi. How are you doing? I'm a computer science student focusing on Python. I've read your project and I have the necessary skills for doing it. But I need some more information to complete your project. Can you contact me?

€45 EUR in 2 days

5.0

(9 reviews)

3.1

@ahsanalif153174

Nice to hear from you. I am a python developer can do scraping for you in minimum time and budget Regards Ahsan Ali

€100 EUR in 3 days

5.0

(4 reviews)

2.5

@eddiedietrich

Hi, I'm an analyst who can help you with this project. For this project: I will use requests_html to scrape the site with some other libraries when neccessary. The script will use Agent/Proxies/IP (if you have extra service attached) rotating, and several other techniques to ensure that it's robust and easy to maintain. I also write code in a very Pythonic way that is friendly and easy to debug. I have also inspected the excel you attached and found out that some pages have similar structures whereas some are different. Thus I will make sure the script will be adapted to the different page type to make sure that it will be able to extract the needed data. Finally, I can deliver this project within 1.5 working week and I will support you with any technical issue anytime after the delivery. Please contact me for further discussion, looking forward to hearing from you soon. Thanks

€200 EUR in 10 days

4.6

(3 reviews)

2.5

@katerynaromaniuk

Hello, William. How are you today? I am a professional Python web scrapping developer so that I can help you perfectly. I can start work right now. Thanks Kateryna

€250 EUR in 3 days

5.0

(1 review)

2.0

@vladyslavusichen

Hello, I’m a senior c# and python dev I can work in your time zone with 40+ fulltime. I've just read your job summary with all happiness and expected mind. Because I can give you satisfaction after finishing this project. I'm not only interested in your project but also eager to do it. Doing this project will help you much because I have much confidence to do it at the highest level on time within your budget. My good English will help us to communicate. In this freelancing site, satisfaction of clients must be the freelancer’ s happiness and pleasure. Right? You want to hire a reliable developer, contact me. Let's discuss more in chat or call.

€140 EUR in 1 day

0.0

(0 reviews)

0.0

@anohinandreydev7

Hi, Thanks for your kind of message. I have read the explanation of your requirements carefully. I am a senior Scrapping developer. I have 5+ years of experience in Python, Web API and Web Scrapping. If you off me this project, I will guarantee the qualification of my result and I will try hard to satisfy your requirements. Best regards.

€80 EUR in 2 days

0.0

(0 reviews)

0.0

@alibenalisid

A python script that can scrape wikipedia pages Hi, I'm an expert in Automation & Scripting and a Web developer. Here is why I'm qualified for this job: - I have a 100% job success score and a 5/5 reviews on Upwork (Freelancing platform) - In your project there are two fields combined web development and Automation, And I'm an expert on both of them. Please reply to this proposal and let's discuss it.

€100 EUR in 7 days

0.0

(0 reviews)

0.0

@keshavaggarwal76

I have experience as a Business Analyst where my job is to make models & from that finally make dashboards with relevant KPIs & graphs. We get data in Excel & upload it on the anaplan software (after some data cleaning in jupyter notebook) to generate insights. Here we have to basically solve SCM problems mainly of Demand Planning & Supply Planning. I have strong fundamentals of Power BI, Anaplan, Python, TensorFlow, SQL, NLTK, Spacy, Pandas library, Numpy, Matplotlib, Seaborn, ML Algorithms, etc. I have the knowledge of ETL process in python, & ETL via Power Query. I have done some projects in ML-like House Price Prediction, Old Car Price Prediction(data of car Dekho), etc. I have worked as a freelancer where I have done a sentiment analysis(Using NLP) of financial reports along with that made a Linkedin scrapper to gather some details about the companies.

€30 EUR in 7 days

0.0

(0 reviews)

0.0

@calebnureda

Hello, My name is Caleb Sawe and I'm a python data scientist. I can build a web scraper for you to obtain the data you require. Kindly contact me @ +254762985779 Thank you.

€140 EUR in 7 days