Python Web scrape website blocked by CloudFlare - OddsChecker.com

£10-20 GBP

Completed

Posted

over 2 years ago

£10-20 GBP

Paid on delivery

I need a function written in python to get the webpage source for a given URL. Example URL: [login to view URL] Function requirements Take a URL as an input (as exampled above) and return the page source. This function needs to be very quick. I dont really want to have to use Selenium if it can be avoided. Function that used to work: def request_with_beautiful_soup(url: str): try: with [login to view URL](url, headers=headers) as page: soup = BeautifulSoup([login to view URL], '[login to view URL]') [login to view URL](f'success calling url: {url}') return soup except (ChunkedEncodingError, ConnectionError): [login to view URL](0.5) [login to view URL](f'failed calling url with ChunkedEncodingError: {url}') soup = self.request_with_beautiful_soup(url) return soup

Python

Web Scraping

Project ID: 32635351

About the project

8 proposals

Remote project

Active 2 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@HussamF132

I can scrap this website easily with 4 years of python experience I'm more then capable to handle your job perfectly if the website is static we can use bs4 and if it dynamic we can use other packages (not selenium) chat me for more details see this like to see may clients reviews [login to view URL] Thank in advance Husam

£10 GBP in 1 day

5.0

(4 reviews)

2.4

8 freelancers are bidding on average £56 GBP for this job

@datascientist90

I can scrapee this website... cloudflare is not a problem Hello, After reading the project details it looks like a good fit with my expertise. I completed Master's of Data Science and Bachelor's of Computer Science

£300 GBP in 4 days

5.0

(21 reviews)

6.2

@Ragesh77

Hi, use me as a last solution. I haven't seen any updated libraries able to fix cloudfare issue. I have other solution it is not selenium. Lets discuss if you run out of options.

£30 GBP in 1 day

5.0

(27 reviews)

4.9

@DWSol

Hi Do you need classes? Do you need help in your Quiz, Assignment or Exam? If "YES" then you are at right place. DW Solution Online is providing online classes for all grades and subjects with highly qualified Experts. We are also solving your problems, assignments quizzes and FYP. Our trial is always free. If you need any kind of help then contact us. We have the best experts team in Biology, Chemistry, Accounting, Statistics, Mathematics, Software(AutoCAD, Microsoft, Programming) and the Medical and Engineering Field. We're providing a free Online trial class. Our goal is to encourage and motivate students. We're appreciating the ability to maintain skills, discipline and deal with challenging behaviour. We have a full plan to improve your skills. We have the best collection of syllabus books, assignments and quizzes that will help you to improve your classes. We have a record to prepare Our students for the best one in their career. We have flexible timing for you. Feel free to contact us.

£15 GBP in 4 days

4.7

(2 reviews)

2.8

@Ktechz

Hello! I have experience and expertise in Python Development along with Machine Learning and Web Scraping. I can help you write a function to get the webpage source. Kindly initiate chat to analyze my expertise that why you need to hire me for this project and I assure you will not regret for your time. I have expertise to handle your task. I have understood your project and I would like to discuss it further on chat. Looking forward for your response.

£35 GBP in 7 days

0.0

(0 reviews)

0.0

@CyberspaceXLLC

I have over 6 years of experience working as a software engineer. I would need to look at the entire script in order to fix it. Using selenium should not be necessary. Let's chat!

£10 GBP in 1 day