Find Jobs
Hire Freelancers

Automated Web scraping for data

$10-30 USD

In Progress
Posted over 7 years ago

$10-30 USD

Paid on delivery
I own a skincare company. I'm working on a PR campaign and I'm looking to find out where my top 20 competitors post articles, and identify who the editors or writers at those companies are. How I plan to do this is in two phases: 1. By using SEO software to identify the backlinks for each of these 20 competitor sites. 2. Using some kind of web scraping script to identify the names and email addresses of the people a those companies who wrote the article or are the editors. There will be a lot of results; maybe up to 1000 or more, hence why automated web scraping is required for this. I will require the freelancer to carry out 1 and 2 above. I know the first part is easy as there's lots of software that can automate the backlink tracking. However, I'm not technical enough to know how to do part 2, so please only apply if you are an expert in creating scripts to do part two (you will have to do part 1 as well).
Project ID: 11445095

About the project

9 proposals
Remote project
Active 8 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi, this is Vikas . I love scraping, crawling and getting data from various dom structures. I have 6 yrs of experience in scraping, crawling, processing and mining data. My previous projects include- 1. Automated Crawling of Google for SEO Keywords 2. E-Commerce Crawling. Crawling websites like Amazon, Ebay,Alibaba etc. 3. E-mail list scraping and phone number scraping for targeted users 4. Scraping Data from within Android Apps 5. Dynamic Data crawling through JS Manipulation 6. Automated Form Filling and Scraping 7. Proxy Emulation and Authentication in order to prevent server blocking 8. Mobile apps (IPhone and Android) Site emulation and crawling mobile site specifically 9. Scraping data from Desktop Apps, PDFs etc. 10. Artificial Intelligence to emulate human behaviour while crawling and scraping sites Programming Languages I can use - Python, PHP, NodeJS, Jquery and Rails. Frameworks I have been using - Python Scrapy, Apache Nutch, Selenium, DOM Manipulation using Chrome Extensions, URLLib2, Python Requests, PHP Syphony etc. Data Can be exported to- Excel Files, MySQL, MongoDB, CouchDB, Cassendra, Redis, Docx. File, Amazon s3, HDFS, Oracle, MSSQL etc. I have read your project description and I think I would be the right person to do your project. I will ensure great communication throughout the project with timely updates about the progress of the project. I would like to have a chat with you about the project and discuss more about how I will be approaching this task. Ping me and lets get started. Thanks :)
$35 USD in 3 days
5.0 (1 review)
0.6
0.6
9 freelancers are bidding on average $42 USD for this job
User Avatar
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
$120 USD in 3 days
5.0 (143 reviews)
6.9
6.9
User Avatar
Hi there, I have read the project description & can develop scraping scripts..I have good web scraping reviews for my past projects.. Hope to hear from you..
$30 USD in 1 day
5.0 (89 reviews)
5.9
5.9
User Avatar
hi can you share list of back links?
$30 USD in 2 days
4.8 (51 reviews)
5.0
5.0
User Avatar
I am a skilled freelancer who has a working experience of more then 4 year I have working experience on- Web Research, lead generation, data entry, data mining, lead colletion, All types of scrapping tools like - data toolbar, web hearvy, VWR etc..... I have great experience that would fit best. if hired by you i will deliver work of high standard and provide exceptional contribution in serving your task.
$25 USD in 1 day
5.0 (21 reviews)
4.9
4.9
User Avatar
I got 7+years work experience in Data Collection,Bulk Email Campaign,Excel VBA and Internet Research in IT companies here.I can do create crawler and scrap datas from sites using C++,Python and Perl coding as per your requirements in excel with multiple ip rotations.I have dealt with US,UK and Australia companies President,Directors and Managers for web design and development projects successfully and I have Good Communication with writing skills.I am well versed in Internet,MS Office Applications and Phone Etiquette manners with latest Technologies.I can accept your payment terms.
$50 USD in 1 day
4.4 (4 reviews)
4.1
4.1
User Avatar
I have worked before like this project. Its a easy task for me. So give me the opportunity to work with you. Thank you
$35 USD in 1 day
5.0 (1 review)
0.0
0.0
User Avatar
Hello sir, I am software engineer and I am working in software house as a php developer using framework codeigniter and database MySQL. Development also includes the javascript, Bootstrap, Jquery, Ajax and also worked in android app development and can work in photoshop and illustrator. I am willing to work with you for longterm and will deliver you the accurate result. PM me for further detail. Thanks.
$25 USD in 1 day
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
London, United Kingdom
5.0
79
Payment method verified
Member since Jun 22, 2009

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.