I have a python script that grabs html data from 7K urls links via an IP rotation service. The script is currently stopping at 6700 links. The script is basically coming across an url that is giving an error and then quitting. I want someone to fix this issue such that, any link that gives error, DO NOT Quit, just skip and move on to the next url...This should be simple for someone who know what they are doing.
11 freelancers are bidding on average $21 for this job
Hi, it's a simple task to do and it can easily be implemented in your current script. The method will work for any link which causes an error as per your demand.
Hi, I have already created a similar solution using rotating proxies, and i know keeping the scraper on is the most important thing. Let me know when i can help with this. Hoping to here back from you. Thanks