Scrapy Spider Builder for Crawling Ecommerce Sites
$10-30 USD
Closed
Posted over 5 years ago
$10-30 USD
Paid on delivery
We are currently looking for someone familiar with building scrapy web scrawlers and understands the intricacies of xpath in order to build web crawlers on a regular basis for us.
Please only apply if your familiar with xpath or scrapy.
We pay $30 for each spider and have a working template so if you understand xpath you can fill in the blanks.
Please only apply if you can build scrapy spiders.
I have huge Scrapy experience (hundreds of different spiders) that's why I'm sure you'll be impressed with my work.
I can complete several spiders per day for just $30 per spider and all I need to start is website URL and sample output from you.
Hello, my name is Brendan. I am an expert in web development/design with over 10 years experience in my field.
This is a project that fits within my area of expertise and would love to come on board and work with you.
I am available to start right away.
- 10 years experience in web development
- Expert in web scraping and using the DOM/xpath
- Highly rated and trusted freelancer with 60 completed projects
- Fast communications and over deliver on all projects I work on
Can build a scrapy spider. Very well known xpath and css selector. Can do your job. Have done various Scrapy project for crawling
Have done scraping in Nodejs, CasperJS Phantomjs, python.
Have done testing and automation with selenium also.
Know to deal with database like mongo, mysql, Elasticsearch.
Also know to handle proxy and captcha while scrapping.
Hello, I am the person you are looking for, I am experienced in scrapy, I have programmed many scrapers and automation scripts using python and scrapy, I am very much interested in working with you. Lets chat and discuss more, Waiting!!
Hello, my name is Leandro and i am interested in undertaking this job. I am very advanced in xPath and RegEx and have a lengthy working experience in this kind of thing. Furthermore, i can undertake a larger than normal amount of work if necessary on behalf of the company i work for.
Regards,
Leandro
Hi, I am familiar with both of them, even more, I am pretty happy that u know what technologies really make life easier like scrapy. so lets do it please tell me what should be scraped
Skills in development under SCRUM methodology
Documented code
Phantomjs, selenium
I am a beginner, but I assure you that I will do my best to deliver a well-made product
Hello
I've built a lot of python scrapers using Scrapy framework and Xpath/Regular Expression.
I have a decently sized code base where sales data from hundreds of ecommerce sites needed to be scraped, and collected in a database
Here's an example of some of the sites I have scraped:
• Instagram
• Amazon
• Trulia
• Redfin
• Yelp
• Home Depot
• Bluefly
• Manta
• AngelList
• Yellowpages
• Lots and lots of sporting goods stores
• Lots of county court websites
• Lots of various eCommerce sites
If you hire me, I will do my best and bring you fast and perfect result.
Looking forward to your reply.
Regards,
Bruno
Hello there!
I see that what you guys need is excatly I was doing in my last job. I developed for the company an entire Scrapy platform to collect and store product data from the 14 biggest brazillian online stores, so I guess i can help you out.
Would love to know more about the project, hope to hear from you soon.
Sincerely,
Rodrigo Rosa