Scrape websites using NodeJS and parse5 or cherrio
$8-15 USD / hour
DEVELOPER REQUIRMENTS
Past experience scraping websites with NodeJS and parse5 is required.
Recent experience with AngularJS (for subsequent front-end projects) is preferred.
SAMPLE PROJECT REQUIREMENTS
Step 1: Session cookies from the previous run are saved in cookies.json. You must load these cookies into your new session before scraping.
Step 2: Go to [login to view URL] and get the URLs for each type of facility by clicking on the facility type, then clicking "Consumer Resources" and then clicking "Facility directory (search by city or county)". You should get URLS like
[login to view URL]
[login to view URL]
etc.
*Note: We require each page to be downloaded and saved in an output folder as HTML.
Step 3: Search for all entities of each type and extract data to populate the following CSV files:
facility_type, name, address, city, state, zip, county, phone, fax, administrator_or_contact_name,
Step 4: Save the session cookies to [login to view URL] so that the next execution will run with the same session parameters.
*Note this does not effect the scrape output but does effect server logging on the remote site.
Project ID: #17120927
About the project
8 freelancers are bidding on average $14/hour for this job
Can do your job. Can provide you with node js. I don't have experience with angular js. But know other frontend technic These are my skills set related to Web Scraping and Web crawling Have done scraping in Nodejs, C More
Hey, I have built scrapers with Node.JS and have also worked with JSON, Cookies and CSV. I will do this project for you and would be very interested if I get this opportunity. We can have a Mongoose (MongoDB) Datab More
