Closed

Bulk import urls for autoscrapping to scrapinghub

I have about 10K urls i want to import to scapinghub. They have an api we would use to get this done

[url removed, login to view]

now since i have so many urls we want to organize them in to "jobs" my data set has a state related to each one (a state in the USA so 50) i am imagining that we can import each set of urls to their corresponding state/job.

let me know how long it would take to do this and if you have any questions.

Skills: node.js, Python, Software Architecture, Web Scraping

See more: usa jobs com, ok state jobs, jobs in the usa, how to get job in usa, architecture related jobs, scrapinghub, job scraping software, web scraping usa, import bulk data, software related questions, data scraping usa, import jobs, scraping jobs, import bulk data virtuemart, bulk usa phone numbers, bulk import, api scraping, data scraping jobs, jobs website usa related, import calculator usa, import costs usa, web data scraping jobs, image related questions, calculate import costs usa, health related questions

About the Employer:
( 454 reviews ) Austin, United States

Project ID: #6379540

6 freelancers are bidding on average $189 for this job

SigmaVisual

Dear Client, I can help in your project. We have already experience of working on similar projects. Please see below to get idea of our experience: Amazon/Ebay Bots: [url removed, login to view] More

$210 USD in 5 days
(64 Reviews)
7.1
exansoft

Hello I am interested in your project. Please kindly provide more details related to project requirements ASAP. Thanks

$250 USD in 10 days
(25 Reviews)
5.2
dabing1205

一个有效的提议尚未被提供

$111 USD in 7 days
(15 Reviews)
4.6
satishlogic1

Hi, I am an expert in web scrapping and crawling. I have 5+ years of experience in this field. I have made 500+ scrapping tools before. I am able to scrap data from any website within 10 hours. Please watch a More

$210 USD in 3 days
(7 Reviews)
4.6
ITACEConsultants

Hi there, We understand we need to divide 10 K URLs to 50 different job sets and then upload to scraping site. We will develop using java APIs. We will take 2 days after understanding HTTP APIs provided by Scraping More

$155 USD in 3 days
(5 Reviews)
2.3
Texnomic

Hi Bill, I'm Mohamed Samy, The Developer who created the JSON Paser for you. I'm willing to start this task right now if you are interested. I need to check the API with you to set the final time the bid price.

$200 USD in 2 days
(0 Reviews)
0.0
dcmohan

This seems to be a very straightforward project and I look forward to working on it. I looked briefly at the API specification on scrapinghub.com. It should be trivial to accomplish this task with a shell script if wor More

$155 USD in 3 days
(0 Reviews)
0.0