Find Jobs
Hire Freelancers

Fix My web scrapper from being blocked

$30-250 USD

Completed
Posted over 5 years ago

$30-250 USD

Paid on delivery
Hello. I have a web scrapper with auto ip rotation that use to work to scrape a website call hayneedle.com....however just recently hayneedle is aggressively blocking request...i have doubled check the proxies and they work....the have changed the proxy setting on my browser and visited the site and i was able to access hayneedle.com....however when i use the same proxy for the software, it is getting blocked....i need someone make the software request work and not get blocked.... Please only bid if you can do it...also i need someone who can work on it right away... Thanks
Project ID: 17720865

About the project

20 proposals
Remote project
Active 6 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi Team, As discussed , made changes in the software. Thanks for new job created. REgards, Sheik Mubarak
$77 USD in 3 days
4.9 (52 reviews)
5.8
5.8
20 freelancers are bidding on average $148 USD for this job
User Avatar
Hi, I'm an expert in web scraping and avoiding being banned while doing that :) I can take a look on your software to determine the problem
$250 USD in 3 days
5.0 (309 reviews)
8.9
8.9
User Avatar
Dear Employer, I will be able to work on it right away but I will write my new code to get the data. You will get the data for sure, will find a way. But it takes more effort to understand someone's code rather than writing afresh. Let me know if its fine with you, will charge that only for new code which you will pay for changes. Thanks and Regards, Ash
$250 USD in 3 days
5.0 (168 reviews)
7.4
7.4
User Avatar
Hi.. How are you? I saw your description carefully your project. Owing to my rich experience in web scrapping , i can say i can do this perfectly. I have many top skills like python, C#, CSS,HTML ,PHP , BOOTSTRAP,JAVASCRIPT,AJAX and so on. If you would like to choos me , i do my best. Thanks. *************^
$155 USD in 3 days
4.9 (117 reviews)
6.9
6.9
User Avatar
I am WebScrapping expert with proxy and bypass captcha. I know the reason why your program is not working now. If you hire me I will do my best and make your program working well. Please send me message and let me work for you. Thanks Shan Bin
$155 USD in 3 days
4.9 (115 reviews)
7.2
7.2
User Avatar
can I help you.
$111 USD in 2 days
4.9 (175 reviews)
6.6
6.6
User Avatar
Hello! My name's Sandeep and I was glad to see that you're looking for help for project Fix My web scrapper from being blocked. I've delivered more than 400 projects in the last 3 years and this makes me very confident with your task.I'd like to have more details before proceeding. This way I'll have the chance to elaborate m bid accordingly. I never ask for payments in front. I will only ask you to release the agreed milestones once the task for each one of them is met and you're happy with it. Feel free to visit my personal page on this platform and get an idea of how satisfied my clients are from my work. Don't hesitate to contact me. I'm looking forward to hearing from you soon.
$250 USD in 4 days
4.9 (72 reviews)
6.6
6.6
User Avatar
Hello. My name is Maciej. I am a Python developer who has a lot of experience in developing web scrapers with bypassing various types of blocks ip included. I am sure i can provide solution to your problem. I am ready to start work right away. Regards Maciej J
$100 USD in 2 days
5.0 (88 reviews)
6.3
6.3
User Avatar
Hello. I have rich experiences in PHP, Software Architecture, Software Testing, Web Scraping. I'm interest to your project. Contact me please. Thanks.............
$140 USD in 3 days
4.8 (109 reviews)
6.1
6.1
User Avatar
Hi, I have experience in web scraping and I can help you. Provide all the details so that I could check and find the issue. As for me. I'm professional web developer with 18 years experience. I have a team of developers and we can perform this work very fast and efficient. I'm very interested in your project. Please, contact me and we'll discuss everything
$155 USD in 3 days
4.9 (27 reviews)
6.0
6.0
User Avatar
Can do your job. Want to look at the code. these are my skills related to web scraping and crawaling Have done scraping in CasperJS Phantomjs, python. Have done testing and automation with selenium also. Know to deal with database like mongo, mysql, Elasticsearch. Also know to handle proxy and captcha while scrapping
$144 USD in 2 days
4.9 (35 reviews)
5.1
5.1
User Avatar
Hi. What browser you use internally? If we talk about windows application, in this cases (when some site aggressively block requests), I use TOR network instead proxies. It faster, and more reliable.
$166 USD in 3 days
5.0 (21 reviews)
4.9
4.9
User Avatar
Hello, sir. I have good experiences with data scraping. I am a newbie in this freelancer, but I have many experiences with crawling and search system using solr, hbase and nutch based hadoop for image search engine. I have good skills with Selenium and HtmlUtil. Let's discuss more detail. Regards
$200 USD in 2 days
4.9 (21 reviews)
4.7
4.7
User Avatar
Hi. I am an expert in VBA, VBScript, Visual Basic, C#, F#, C, C++, ASM, Delphi, Java, iMacros, Flash, ASP, ASP.NET, Access, MySQL, MSSQL, QuickBooks, Oracle. I can create auto scripts to scrape websites, auto click, format txt, csv, xls, xlsx, doc, docx, rtf, json, xml, database files as you request. I can start right now
$100 USD in 3 days
4.7 (23 reviews)
4.5
4.5
User Avatar
Most likely you are being blocked because hayneedle is checking to see if the requests are coming from a real browser. I could fix this for you by converting your program into a program that uses selenium and chrome with your proxies to look exactly like a real browser. This should fix your issue. I will not ask for a fee unless it works properly. Message me with more information and I will get started testing selenium with hayneedle.
$55 USD in 3 days
5.0 (10 reviews)
4.0
4.0
User Avatar
Hello, I am a software developer with over 12 years experience. I have experience working with web scraping projects. On the basis of your problem description, I plan to analyse and fix the following: 1. Study the request and response returned by the browser. The fact that requests succeed from browser but not from program implies that the program request does not appear genuine as that made from the browser. 2. There could be a few possibilities like, cookies set/unset when request sent from browser 3. Your program isn't mimicking a browser and is exposing your program to discovery. Set appropriate user agent so that program appears more authentic. Kindly contact for further discussion. Regards, SW Team
$155 USD in 3 days
4.6 (10 reviews)
3.6
3.6
User Avatar
Dear Prospect Hiring Manager. Thank you for giving me a chance to bid on your project. i am a serious bidder here and i have already worked on a similar project before and can deliver as u have mentioned "I can do this job and give you an efficient job that will be very acceptable and presentable. I and my team work on web development and mobile apps and I can assure you that you will never be disappointed"
$155 USD in 3 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of CANADA
Etobicoke, Canada
5.0
94
Payment method verified
Member since Aug 12, 2013

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.