Find Jobs
Hire Freelancers

Develop an API to retrieve information from a range of websites

£20-250 GBP

Closed
Posted over 7 years ago

£20-250 GBP

Paid on delivery
I need a developer who can build an API to retrieve 10-20 data from a range of websites (around 80) which runs on a chronological batch process every hour and stores the data in a data base.
Project ID: 12036046

About the project

18 proposals
Remote project
Active 7 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
18 freelancers are bidding on average £215 GBP for this job
User Avatar
Hi there, just made an software on Python to scrap certain data from the given 5 websites given by the client. i hope i can do this for you too. How many website do you have to scrap data from ?
£200 GBP in 4 days
4.9 (138 reviews)
7.6
7.6
User Avatar
Dear Sir, I'm very much delighted to let you know that i did data scraping with PHP-cURL, PhantomJS, Node.js, Selenium from many sites. I just scraped the data from web site and then wrote the data in mysql database or excel or csv or xml file. I worked on many similar projects, I have big experience in data mining projects. I have written hundreds of web scrapers which scrape millions of pages each day. I'm ready to fulfill your requirement. I can finish this task in short time, with the best quality. I can assure 100% accuracy. Please give me the opportunity to do the work. With Kind Regards, Debdulal Roy Proshanta
£277 GBP in 3 days
4.9 (54 reviews)
6.8
6.8
User Avatar
Hi, this is Anshuman. I have 6 yrs of experience in scraping, crawling, processing and mining data. My previous projects include- [1.] Automated Crawling of Google for SEO Keywords [2.] E-Commerce Crawling. Crawling websites like Amazon, Ebay, Alibaba etc. [3.] E-mail list scraping and phone number scraping for targeted users [4.] Scraping Data from within Android Apps [5.] Dynamic Data crawling through JS Manipulation [6.] Automated Form Filling and Scraping [7.] Proxy Emulation and Authentication in order to prevent server blocking [8.] Mobile Site emulation and crawling mobile site specifically [9.] Scraping data from Desktop Apps, PDFs etc. [10.] Artificial Intelligence to emulate human behaviour while crawling and scraping sites Experience [Programming languages]- Python, PHP, NodeJS, Jquery and Rails. [Frameworks]- Python Scrapy, Apache Nutch, Selenium, DOM Manipulation using Chrome Extensions, URLLib2, Python Requests, PHP Syphony etc. Data can be exported to- Excel Files, MySQL, MongoDB, CouchDB, Cassendra, Redis, Docx. File, Amazon s3, HDFS, Oracle, MSSQL etc. I have read your project description and I am quite confident for it. I will ensure great project experience with timely updates. Would like to discuss about the details of project so please ping me and let’s get started. :)
£300 GBP in 6 days
4.6 (19 reviews)
6.5
6.5
User Avatar
Hi, I can do this for you. Please send a massage in the PMB for details.......Best Regards flashsaiful
£250 GBP in 5 days
4.8 (115 reviews)
6.4
6.4
User Avatar
Hi I'm a Delphi developer and I could build a windows service running in background doing the scraping you need. could you provide few examples of sites to visit? thanks Augusto Pellis
£277 GBP in 10 days
4.9 (19 reviews)
5.9
5.9
User Avatar
Hello, i am very interested to your project. i. i can build an API to retrieve 10-20 data from a range of websites (around 80) which runs on a chronological batch process every hour and stores the data in a data base properly. I am a hard working, motivated worker, who have great webdesign, development and custom web portal making , api setting skills. I know what is required in terms of work and the pressures I have to deal with. I am available to chat by IM, email or Skype. i have own PC First internet I will be able to start immediately and i will complete this job within time. Regards sharmin
£222 GBP in 5 days
5.0 (10 reviews)
4.7
4.7
User Avatar
A proposal has not yet been provided
£200 GBP in 3 days
5.0 (1 review)
3.2
3.2
User Avatar
I can do this project I hope successfully in this work ,I understand and complete in this work right time please contact me as soon as early……….thanks
£100 GBP in 3 days
5.0 (4 reviews)
2.5
2.5
User Avatar
Dear friend, I have recently completed couple of web scraping projects for freelance employers and I can demo you thru skype/teamviewer should you require. 1. Do all the site have common pattern of information that needs to be retrieved? 2. Can I post data to sql server table? 3. How often should the data be scraped? Considering 80 website and unknown amount of data, I guess the frequency should be every 6 hrs? I'm a 14+ years experienced professional developing application for windows and web platform using technologies such as C#, VB.NET, ASP.NET MVC, Sql Server, AngularJS, Angular Strap, Bootstrap, jQuery, etc.., Please ping me a if there is anything you would like to discuss with me. Thanks, Hemant
£555 GBP in 20 days
4.6 (2 reviews)
2.0
2.0
User Avatar
Hello, I can help you with my skills suck us: PHP, MySQL, Linux, Amazon webservices. For the best offer, please tell me the list of site you will scrape and data on that site. thank you!
£222 GBP in 5 days
5.0 (1 review)
0.4
0.4
User Avatar
A proposal has not yet been provided
£111 GBP in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I am experienced Java developer (5 years). I can code in Java, J2EE (Spring, Hibernate). I have designed web scrapper for eCommerce companies. Scrapper will be designed in such a way that, wbesite will not be able to track ip of our scrapper. I can schedule batches so that every specific time, scrapper will fetch data and store in database you want. Let me know, if you are interested in doing this stuffs with me. Thanks. Regards, Ashwin PATIL
£150 GBP in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED KINGDOM
London, United Kingdom
5.0
4
Member since Oct 8, 2016

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.