Website Scraper
$30-250 USD
Paid on delivery
Need to scrape [url removed, login to view] and store various fields to a mongoDB. Specifically, it will have the ability to scrape the RSS feed, link below:
[url removed, login to view]
The RSS feed has numerous categories, example one above, but interested in scraping the below one:
1. BreakingNewsReleasesEnglish
a. [url removed, login to view]
The code needs to have the ability to scrape any category via just a variable change in code via a look-up table. For example, if a user wants to scrape “BreakingNewsReleasesEnglish”, a look-up table needs to match a dynamic user entered variable to the proper RSS feed, in this example:
[url removed, login to view]
And scrape that category. Provide a section in a readme file where this variable resides.
Only scrape articles that are in English, i.e. <language>en</language>
For the link immediately found in the main RSS feed and the link leading to the FULL article, the following MUST be stored to a mongoDB (allow NO duplicates via upsert or other method based on some unique parameter to each article)
Project ID: #5482675
About the project
Awarded to:
Hi .. can do this job quickly .. the specifications are very clear .. . we will in constant communication ...
9 freelancers are bidding on average $163 for this job
Hello, With 99% completion rate, 650+ successfully completed projects, and a 5.00 reputation (maximum possible, 5.0) (Yes, not even 4.99 average rating, can be verified on my profile page !!)... you can never go wro More
i am well experienced with scraping websites , i can easily scrape this one and save in mongodb . .
Dear "aptocap" Hope you are doing well. I have reviewed the project details and would like to offer our services. We have completed many Research/Data collection/Product add/Data mining assignments on freelancer.com More
