Find Jobs
Hire Freelancers

Scrapy + Redis / Cassandra -- Price Monitoring Bot / Crawler / Scraping / Data Mining

$30-250 USD

Closed
Posted over 6 years ago

$30-250 USD

Paid on delivery
Hello, We are looking to utilize Scrapy (Scrapy+Redis or other option) to run on our internal servers to handling data mining for the purposes of price monitoring, alerting and adjustments. We need a freelancer who is skilled with scrapy already building the environment from the ground up (its ok to use templates and such). It needs to have the following functions at minimum: 1) Scrapy running from scaleable server environment 2) Documented method for business users to add websites/fields to be scraped 3) Store Data 4) Data Reporting 5) Anti-Blacklisting (IP Rotation, Proxies, Check [login to view URL], Throttling, Spoofing, Headless Browser) 6) Quality Assurance / Compliance The project must be well documented in a understandable way in case you leave the project at some point. We also need you to stay on board long term to help maintain this environment. We will provide all the infrastructure and associated items. Payment: 50% milestone funded upfront, second 50% funded when working model shown. 100% released once you finish and it is fully functional with all items in scope of this project complete. Any items not specifically mentioned in the original project are not valid. If you bid on this project, your bid is final price for initial project.
Project ID: 15890077

About the project

6 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
6 freelancers are bidding on average $218 USD for this job
User Avatar
Hi sir, This is Lin and I am scraping expert, i have checked all details for your project. can we discuss more info then i can provide example data for you? Please message me then we can discuss more ASAP. Thanks, Lin
$333 USD in 6 days
5.0 (307 reviews)
7.7
7.7
User Avatar
Hi,sir I am very interested in your project, because I have much experience in such projects. Relevant Skills and Experience I have expert and smart technic with web scraping (1000 over projects for scraping), automation and bot(500 over projects for automation and bot), selenium, mobile (android, ios native and others). Proposed Milestones $333 USD - milestone Please contact me, then we can discuss about the details and the price. And I am free in recent days, so I can do my best for your project. Thanks.
$333 USD in 3 days
4.9 (110 reviews)
7.2
7.2
User Avatar
Can do anything on scrapping any site including login and captcha Let us discuss further Waiting.. Amaan Relevant Skills and Experience 10 years history Proposed Milestones $35 USD - milestone let us discuss for fair pricing
$35 USD in 3 days
4.9 (8 reviews)
3.4
3.4
User Avatar
IT engineer, 6 years of experience in web crawling/ web scraping, I have such project ready,I can show you a sample. Please contact me for details: website to scrape, deadlines, price.. Relevant Skills and Experience python, django, cron, database, linux Proposed Milestones $50 USD - a sample of project for approval $150 USD - deliver final project $50 USD - documentation
$250 USD in 30 days
5.0 (1 review)
2.3
2.3
User Avatar
There's not much to say, but I know I'll do a very good job Relevant Skills and Experience python
$200 USD in 10 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of UNITED STATES
Marietta, United States
4.9
84
Payment method verified
Member since Apr 17, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.