Find Jobs
Hire Freelancers

Optimize Web scraping project

€30-250 EUR

Completed
Posted 4 months ago

€30-250 EUR

Paid on delivery
The objective of this project is to optimize an already functional web scraping program in python for the Betsson betting website, (IMPORTANT NOTE: it has to be betsson Spain), to extract odds from various Spain football competitions: La Liga, Copa del Rey, and the Champions League. The odds to be extracted include the Total Goals market and Both Teams Score, as shown in the attached screenshots. A functional Python program using Selenium is provided and can be executed to analyze the requeriments. The problem lies in excessive RAM consumption (~6GB once the webdrivers are created) and the initial time required for creating the webdrivers. I would consider acceptable a memory consumption of up to ~2GB. The less, the better. Once the webdrivers are created, it takes less than 1 second to retrieve the odds for the mentioned competitions (IMPORTANT: this time should be less than 1s). The program generates a thread for each game, and each thread has its own webdriver to monitor the odds. Selenium was chosen because no API calls were identified on the Betsson website, feel free to use another technology. The program is designed to obtain the odds every x seconds calling the function get_bets, more information in the source code. Important: The code can be adapted or rewritten from scratch, but it must respect the format in which bets are returned. In other words, a list of bets must be returned with the odds information, as seen in the BetOverUnder and BetYesNo classes. Who will get the job? No surprises here; it's whoever finds a better approach to reduce memory consumption by the program, or improves the existing one. Offers will be more highly regarded if, instead of stating 'I know X technologies and have X years of experience in X technology,' they have seen the code of the program, executed it, identified the issues, and believe they know how to address them. If you have any questions, feel free to ask.
Project ID: 37691670

About the project

24 proposals
Remote project
Active 4 mos ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Greetings. I am running and analysing the application already. I will suggest a course of action as soon as I have insight about [login to view URL] and the scripts mode of operation. Contact me to have further discussion. The solution will likely be to find the real source of the information (http request or websocket) and connect to that instead of launching so many webdrivers.
€65 EUR in 2 days
5.0 (14 reviews)
4.4
4.4
24 freelancers are bidding on average €164 EUR for this job
User Avatar
I am experienced in Python and web scraping, and I am confident that I can optimize the existing web scraping program for the Betsson betting website in Spain. My proposal aims to reduce excessive RAM consumption and minimize the time required for creating webdrivers to retrieve odds. I will focus on improving the program's efficiency and performance, ensuring that the odds for specified football competitions are extracted accurately and swiftly.
€250 EUR in 2 days
5.0 (168 reviews)
7.6
7.6
User Avatar
hi, Based on my working experience with similar sites like oddsportal, bet365 etc. in order to speed up the process, we need to focus on backend API calls rather than using Selenium or WebDriver. I am confident to start from scratch, using API calls and basic Python requests library, and provide you the results that you are looking for. I'm interested to discuss more details in chat, and can start right away. Abdul H.
€230 EUR in 2 days
5.0 (334 reviews)
7.4
7.4
User Avatar
Hi, I am Senior Python script developer with 10 years of experience. I can scrape extract odds from various Spain football competitions by python script/bot with your instructions very short time. Can we discuss please? Thanks
€200 EUR in 2 days
4.9 (173 reviews)
7.6
7.6
User Avatar
Hi there. ⭐⭐ I am a full stack Developer ⭐⭐ with experience in HTML, Javascript, Blockchain, AWS, MY SQL, Bot Developement, Web, Machine Learning (ML), PYTHON, Deep Learning and Communications. I have worked with many similar projects as i have a team of enthusiastic developers. We strive to give our best. Please contact to discuss in detail.
€130 EUR in 1 day
5.0 (54 reviews)
5.6
5.6
User Avatar
As a seasoned Python developer with an extensive background in Web Scraping, I am well-positioned to optimize your Betsson web scraper to greatly reduce RAM consumption, enhance the webdriver creation time and optimize the overall performance for the extraction of odds. I understand that this project demands an efficient solution with respect to memory management and timeframe for odds retrieval since any slowness could result in missed bets. I have successfully built high-performance web scrapers using Selenium, and have encountered similar issues before. In those cases, I meticulously streamlined the code, introduced appropriate optimization techniques and made strategic design decisions to significantly cut down RAM usage while maintaining exceptional speed and accuracy in data extraction. Additionally, I can also leverage my knowledge of other scraping technologies like BeautifulSoup, Scrapy, or Requests-HTML to identify if there are other approaches better suited for your project apart from Selenium. My commitment to delivering nothing less than exceptional results drives me to constantly explore better ways of doing things. Thus, I intend to bring that same level of dedication and expertise into righting the RAM over-consumption issue present in your current scraper. My aim is to not only solve this problem but also ensure that it doesn't arise again periodically by creating robust, future-proof codes. Let's optimize!
€140 EUR in 7 days
5.0 (25 reviews)
5.3
5.3
User Avatar
With over five years of experience in web development and Python programming, I am confident in my ability to optimize your web scraping project for Betsson Spain. Drawing on my experience with threading and working with Selenium, I'm well-equipped to tackle the memory consumption and webdriver creation issues that you've highlighted. Aiming to provide efficient solutions, I use the most suitable frameworks and tools for the job and maintain a strong focus on reducing time delays. In this case, I will look to keep the time required for creating the webdrivers within your one-second limit for retrieving odds. Through my prior work in Python projects, I have honed a keen eye for detail, ensuring that specific requirements like returning a list of bets with odds are not just met but executed with precision. My mastery of web scraping techniques also enables me to extract accurate data efficiently - a skill we will heavily rely upon for this project. Moreover, my proactive approach to embracing new technologies gives me an edge in providing innovative solutions. By combining my adeptness at reducing memory usage even in complex programs, programming efficiency, and technical acumen, I believe I can optimize your web scraping program effectively while satisfying vital factors such as less RAM consumption and quick response time. Let's connect and get started; together we can create an improved, seamless experience for Betsson Spain's football betting website!
€140 EUR in 7 days
5.0 (12 reviews)
4.1
4.1
User Avatar
Hello !! I may be a bit of a newbie to this platform, but I've got over 4 years of experience under my belt as a web and app developer, which involved maximizing code and application performance to deliver optimal results. And that's exactly the expertise I bring to the table for your web scraping project. While I specialize in Ruby on Rails, I'm also handy with Python and Web Scraping, which makes me well-suited for this job. In terms of your specific requirements, my experience in optimizing code for better efficiency and reducing memory consumption can play a key role here. I'm confident that by implementing clever design patterns and techniques, we could significantly cut down your program's RAM consumption problem. Additionally, I promise to put in the effort required to tackle the issue related to webdriver creation time. Overall, the skills and experience I have will ensure an ultimately optimized result for your Betsson Spain web scraping project, providing relevant data within the required timeframe. Projects like yours push me as a developer to think outside the box and find novel solutions to existing problems and this one isn't any different! So hit me up when you're ready to transform your ideas into realities! Thanks
€140 EUR in 7 days
4.4 (5 reviews)
4.6
4.6
User Avatar
Hi Mate , Good afternoon! I’ve carefully checked your requirements and really interested in this job. I’m full stack node.js developer working at large-scale apps as a lead developer with U.S. and European teams. I’m offering best quality and highest performance at lowest price. I can complete your project on time and your will experience great satisfaction with me. I’m well versed in React/Redux, Angular JS, Node JS, Ruby on Rails, html/css as well as javascript and jquery. I have rich experienced in BeautifulSoup, Selenium, Python, Selenium Webdriver and Web Scraping. For more information about me, please refer to my portfolios. I am checking your attachment, I'll update you shortly... I’m ready to discuss your project and start immediately. Looking forward to hearing you back and discussing all details.. Have a great time
€30 EUR in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi For checking the job posting - Optimize Web scraping project, I felt that your project was similar to one I had worked on before. I have completed similar projects to ensure I can provide you with satisfactory results. I can start your project right away and you would be interested in discussing the project details. Thank you for taking the time to review our letter. We look forward to hearing from you regarding further steps. Matijia
€100 EUR in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello , I read your job description carefully, I am very interested in your project. As I has rich experiences on those Python, Selenium, Selenium Webdriver, BeautifulSoup and Web Scraping, your project attracts me. Let's discuss in more details. Thanks
€30 EUR in 6 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Dear, This project is nothing to me because I have rich experiences with skills including BeautifulSoup, Web Scraping, Selenium Webdriver, Selenium and Python. Specially I've worked with other clients in similar projects and I can work on your time zone. I'd like you to discuss the requirements in more detail through chat and start right now. Regards, Andrejs
€90 EUR in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello there, I am confident in my ability to assist you with your task, drawing from my previous experience in web scraping showcased on my GitHub account. I propose a meeting to delve into the details, as I am sure we can efficiently complete the task at hand.
€140 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
As an experienced Python developer specializing in web scraping, I'm confident in my ability to significantly optimize your current Betsson scraping project. I understand the key issues that need to be tackled - the high RAM consumption and the lengthy creation process for web drivers. Having worked on similar projects in the past, I can assure you that I'll find a way to drastically reduce these bottlenecks. My experience extends beyond just Python - I'm well-versed in using C# and C++, which will aid me in identifying the root causes of your memory issues more effectively, potentially rewriting any problematic sections as needed. Moreover, my knowledge of Selenium is not just limited to basic usage; over the years, I've developed several strategies to fine-tune performance with Selenium for large-scale scraping projects. This involves thread management, optimizing wait times, and robust error handling. Combining this knowledge with my strong technical communication skills will ensure a streamlined process and meaningful collaboration throughout this project. Together, we can achieve a more efficient program that aptly retrieves the desired odds while blending our efforts seamlessly.
€140 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello! I'm experienced in Python and excited to optimize your Betsson Spain football odds scraper. I'll tackle high RAM usage and slow webdriver creation. My approach ensures a faster, more efficient tool, meeting your <1s requirement. Let's discuss further on Freelancer.com! Best, Haybert
€140 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
As an accomplished developer with extensive experience in Python and web scraping, I am confident in my ability to optimize your Betsson web scraping program. My proficiency in technologies like Selenium and Django, make me the ideal candidate to address your concerns of excessive RAM consumption and slow webdriver creation. I understand that time is of utmost importance for you, as the current wait time significantly impacts results. My skills can ensure a dramatic decrease in this initial waiting period for you, bringing it well under the required 1 second boundary. Moreover, providing flawless data extraction and delivery is at the core of effective web scraping; something I understand intimately. From your project description, it is clear that preserving structure and ensuring seamless integration with existing class formats are crucial. Having worked extensively on similar projects, I can assure you consistent and reliable output in the desired format. So let me optimize your project and provide you with faster results, lower RAM consumption - all alongside maintaining steady visibility into odds across great football competitions!
€140 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
As an experienced freelancer specialized in web scraping, automation, and Python programming, I am confident I am the best fit for your project. Over the years, I have developed an adept skill set incorporating elements like Selenium, BeautifulSoup, and data analysis that specifically aligns with your requirements. What separates me from my competitors is my ability to adapt and optimize existing solutions while keeping the core elements intact. I genuinely comprehend the intricacies you're facing with RAM utilization and long initialization time, which pose justifiably noteworthy challenges to your web scraping project. Rest assured, this is precisely where my expertise shines through. My history of data extraction from websites, crafting custom solutions, and an overall commendable grip on Python equips me better than most to provide effective and efficient resolutions for these issues. Transparency and open communication are key tenets of my work methodology, meaning you can count on regular progress updates and prompt notification of any alterations or potential hurdles. With a customer-centric approach at heart and a complete dedication to meeting deadlines with unwavering quality, I am determined to ensure this project exceeds your expectations. There's no doubt in my mind that I would be an asset to your team in optimizing this web scraping program for the Betsson betting website in Spain. Let's connect soon!
€140 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am a highly skilled Python developer with extensive experience in web scraping using Selenium. Having reviewed the provided program, I recognize the importance of optimizing RAM consumption and reducing the initial time required for creating webdrivers. My approach involves implementing efficient memory management strategies and optimizing webdriver creation to enhance overall performance. I will leverage my expertise in Python, Selenium, and web scraping to streamline the code, ensuring it meets the specified requirements for extracting odds from Betsson Spain for La Liga, Copa del Rey, and the Champions League. My commitment is to deliver a well-optimized program that significantly reduces RAM usage and minimizes the time required for webdriver creation, all while maintaining the desired format for returning odds information. I look forward to the opportunity to contribute my skills to this project and provide a solution that exceeds expectations. If awarded the job, I am confident in my ability to deliver outstanding results.
€140 EUR in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello. I can fulfill your order. This is my first time on this site and I am from another country. I think we will agree on a reasonable price that will be very good for you. please contact)
€140 EUR in 7 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of SPAIN
Ourense, Spain
0.0
0
Payment method verified
Member since Jan 25, 2024

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.