Web Scraping Jobs

I'm currently seeking an adept Python developer capable of crafting a bot designed to circumvent the Cloudflare protection of a specific website (details will be disclosed privately to the chosen freelancer). The bot should reliably bypass the protection consistently, as my attempts have yielded varied results, occasionally succeeding but often encountering 'Failure!' from Cloudflare. Efficiency in handling a large volume of attempts is crucial. If you possess the necessary skills and are up for the challenge, please get in touch. Ideal Candidate: - Proficient in Python, with experience in bot development - Familiar with CloudFlare's security measures and how to bypass them - Experienced in automated testing and website monitoring - Strong problem-solving skills to tac...

I'm looking for a professional to scrape website content for market research purposes. Key Responsibilities: - Scrape content from specific websites Ideal Candidate: - Experience with web scraping tools - Proficient in data extraction and analysis - Able to deliver a detailed data set suitable for market research The project requires a one-time scrape and the data extracted should be relevant and comprehensive for market research purposes.

It is an anime website in WordPress and I need to take the information from other anime websites and have it automatically posted on

As a provider of job-oriented online training, I'm seeking skilled professionals to help provide old leads looking to do Job oriented programs - IT courses - Data Science & Data Analytics - Law courses - Digital marketing courses - Online MBA courses - Many more

I need a script that can bypass security measures on my website which uses Cloudflare. This is not for any malicious intent, but for testing and troubleshooting purposes. Key Points: - The script should be specifically designed for websites - The main purpose is to bypass Cloudflare security measures - I didn't specify the customization level, as I'm open to options that might suit my needs better Ideal Skills: - Familiarity with Cloudflare security measures and how to bypass them - Ability to create a script that can seamlessly integrate with any website - Experience working with security testing tools or scripts Please provide a proposal that outlines your experience in this area and how you plan to approach this particular project.

I am in need of expert help to scrape text data from specified websites. After the data has been collected, the next step is to clean the data, ensuring that it is in the appropriate format for use. The final output should be managed and stored in a Database Management System. The ideal freelancer for this project should have: - Proven experience in web scraping, specifically text data from websites - Advanced skills in data cleaning to ensure the data is usable and well-structured - Capabilities to manage and store the cleaned data into a Database Management System Please provide any relevant examples of previous work in web scraping and data cleaning and provide details about how you plan to carry out this project.

I need a web scraping expert to help me get data from a third-party search site. The project is urgent and needs to be completed ASAP. Key Requirements: - Skilled in web scraping techniques - Proficient with tools for scraping - Able to work under tight deadlines - Excellent communication skills Please note that the specific search site is not mentioned, but the task involves scraping information from it. If you have the experience and can work quickly, please reach out.

For this task, I am specifically seeking a freelancer who is proficient at data entry and familiar with Excel spreadsheets. The project primarily involves numeric data, so accuracy is vital. Key Responsibilities: - Input numeric data into an Excel spreadsheet. - Maintain a minimum 98% accuracy level. Ideal Skills and Experience: - Proficient in Excel. - High attention to detail. - Experienced in numeric data entry. - Proven track record of maintaining high levels of accuracy. Please ensure you have the necessary skills and experience before placing your bid. I look forward to your detailed proposals.

Need to extract data from website: , into an Excel file. Specifically name, discipline (medical practitioner, midwife, nurse, OT, physio, psychologist, podiatrist), location (incl suburb and postcode), initial registration date, registration expiry. There would be at least 100,000 rows of data. Only barrier, is this data is not able to be 'searched' efficiently. Individual names can be looked up. Or disciplines with a select number of names demonstrated...but I can't find a way to show ALL clinicians at once. Looking for a solution which can reliably pull all the names from the database.

I need an expert to set up an automation system in Google Sheets for specific data from the NSE India website. Key Requirements: - Data Source: The data source will be '' - Data to be Integrated: Only the column titled '%CHNG IN OI' should be extracted. - Update Frequency: The automation should update the Google Sheets column once every day. - Data Display Format: The data in the Google Sheets should be displayed in percentage values. - Historical Data: No historical data tracking is required. The focus is solely on current updates from the source website. Ideal Skills: - Proficiency in Google Sheets and automation tools. - Experience with web scraping and data extraction. - Knowledge of data presentation and formatting in Google Sheets. - Ability to create a seamles...

I need an experienced PowerShell developer to create a script that logs me into , downloads today's menu, and displays it on a window. Requirements: - The script should log in to bosch.aramark.cz. - After logging in, it should download today's menu. - The menu should be displayed in a window. - The menu display should be in the format: "Number of menu : Text of menu" with each number on a separate line and menu text following it. - The menu number should be displayed before the text. Ideal Skillset: - Proficient in PowerShell scripting. - Familiarity with web scraping is preferred. - Good understanding of GUI development. - Experience in parsing and displaying structured data is a plus. Please ensure the script is user-friendly and efficient. A clean, simple interfa...

First task is below 1) 1200 Youtube video link of recipes will be provided in google spreadsheet. for e.g each link with be 2) the person need to paste the link at 3) Cut and paste 3 windows record and 1 recipe image screenshot (from youtube) and then upload in a software ( a paid version will be provided) 4) expect to finish 1200 recipes in 60-100 hours. Please quote following if you want to try this project 1) how much for updating 1200 recipes as whole project? 2) How much is per hr rate?

I need 1000 list from USA which will have email phone number address etc and it should be in excel file category bar.

I need a thorough and capable freelancer to assist in data entry tasks. This project revolves around seeking out the contact details of companies provided by me. Key tasks will include: - Google each company name I provide - Gather relevant contact details such as phone numbers, email addresses, and the company's website As I am seeking information from a range of different companies without specific criteria, being detail-oriented and accurate will be crucial. Experience in data cleaning, analysis, and transcription would be advantageous. Understanding and utilization of web scraping techniques would also be beneficial.

I'm in need of a freelancer who can help me with a data-oriented task. The project has two main aspects: - **Data Collection from Customer File**: The task involves searching for specific data (names and contact information, demographic information, purchase history) of customers on a sample customer file. The collected information will then be organized by customer name. - **Website Data Scraping**: In addition, the freelancer will be responsible for scraping data from a website. The main focus here will be customer data who use online payment methods. The specific data we're looking to extract is the 'Payment method'. This information will then be organized by customer name. **Ideal Skills and Experience:** - Strong data collection experience, especially in the co...

I require a professional data scraper, ideally with experience in handling image retrieval. The task will involve sourcing and scraping image data from various undisclosed sources. The type of images to be scraped has not been specified, providing an open spectrum for data collection. However, previous experience dealing with diverse image types is highly beneficial. The deadline for this project has not been outlined, indicating flexibility on the completion date. Ideal Skills: - Expertise in data scraping - Strong experience handling image data - Ability to source from various platforms - Flexibility with time management.

We are looking for a proficient developer who can execute data scraping from a Radic ecommerce site, specifically we require: - Product names - Prices - Descriptions These products are variable with different dropdown options. This data needs to be imported into Woocommerce on a weekly basis. The ideal candidate for this position would have previous experience in similar projects and an understanding of ecommerce platforms, particularly Woocommerce and Radix. A familiarity with scripting languages to automate the scraping and updating process would be a major advantage. The ability to ensure that every weekly update is accurate and timely is a must. If you have the skills and can guarantee a meticulous approach to this task, please place your bid. You will be asked to provide evidence ...

Hi, i need help in scraping an e-commerce website dropdown menu urls using jawa visual scraper. The e-commerce website: then i will be using puppeteer to scrape the menu urls for education propose. Only people with experience in this field will be accepted. Thank you.

This is a Python-based project involving LinkedIn connections parsing using a cookie file. The target is to uncover and analyze mutual connections between my personal friend's list and a CRM file. Important Aspects: - The script needs to efficiently extract the full profile details of LinkedIn connections, including their names, job titles, locations, and industries. The data about any mutual connections between my friends and my existing client database is distinctly relevant. - I also need the parser to generate records of connections between my LinkedIn friends and contacts in my CRM. - I would require the output to be well-organized and easy to navigate. It should be exportable and storable both as a CSV file and an Excel spreadsheet. Ideal Skills and Experience: - Proficiency ...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I need a Data Enrichment (Entry) Specialist to help me with a project. - I have text and categorical data which need to be further extracted from LinkedIn - The data has to be entered into a specific format or template which will be provided - You'll be required to extract data from LinkedIn for 200-400 leads per day Ideal candidates for this project should have: - Ability to maintain high confidentiality of the data - Proven experience with data entry and enrichment, especially text and categorical data - A keen eye for detail and high accuracy in data entry - Familiarity with LinkedIn and data extraction from the platform (Mandatory) - The ability to work with provided templates and formats - Excellent command over the English language - written and spoken Please reach out if yo...

I'm looking for a proficient developer capable of creating a customized web crawler for eBay and AliExpress. The primary function for this crawler will be to accept a list of keywords of any length and return specific data about those products. Here's what I need in detail: • Find top hot selling products at any given time • Crawl eBay and AliExpress for specific product data based on entered keywords. • The data retrieved should include product names, quantities sold and locations of sellers, images, • The crawler should be capable of providing this information for a variable timescale, ranging from 1 to 30 days in the past. • The results should be sortable. Php or python preferably The task would best suit a freelancer with previous experience...

I want someone to scrape me all listings on this website: Please find attaced for data format. Thanks, Abhiram

For this project, I'm targeting an experienced web developer capable of accessing specific data from Facebook. The key expertise required encompasses: Collect Member URLs: Use Facebook Graph API to gather profile URLs of group members. Gather User Reactions: Retrieve reactions on their posts for analysis. Prepare Interaction List: Compile a list prioritizing profiles with more engagement for liking or reacting. Check Profile Lock Status: Skip locked profiles. For unlocked profiles: -Analyze posts for existing reactions. -If liked, mimic the reaction; if not, apply a heart reaction. PS: Create 2 separate buttons (or features) to collect member URLs and to Gather user reactions to their posts. Please, make sure your application resonates with this description and that you have ...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

I am in need of a seasoned web scraping expert to help me with a project involving Scraping a real estate website. The main focus is to extract a variety of data, including data points, numbers, and graphs. I need also advice on where is the best to store my data, to present it later on my wordpress website, I need someone who understands back-end architecture.

We are in search of the next flight to build different scripts in Apify. You must have experience with puppeteers and bypassing captchas and using different IPs. Thank you

I have a collection of PDFs that I need to have data extracted from as well as images saved. The main purpose of this task is to extract the data from the PDFs for further processing, while also saving the images contained within for future use. Key Requirements: - Extracting data: The PDFs contain important data that I need to have extracted and organized. The data should be converted to text and saved in a spreadsheet. - Image saving: The images contained within the PDFs also need to be saved in a usable format. Please note that there are no specific requirements for the extracted text and images other than the data extraction and image saving. Ideal Skills and Experience: - Proficiency in PDF data extraction and image saving - Experience with converting extracted data into a spreadsh...

I want someone to scrape me all listings on this website: Please find attaced for data format. Thanks, Abhiram

I'm looking to build a website that's centered around data scraping. The advanced functionality will allow users to enter any amount of website URLs and have the system effortlessly retrieve extensive information from each site. This particularly includes text content, images, links, along with contact information. Importantly, the website should integrate OCR technology. Key capabilities and features are: - Backend - Simple frontend for testing only - Website Information Retrieval: Capability for data extraction of text content, images, links, and contact information from the targeted pages. - OCR Support: Inclusion of Optical Character Recognition tools for enhanced data extraction. Expertise required for this job: - Proven experience in developing extensive data scraping ...

I need help with simple copying and pasting tasks from online directories. The data needs to be organized by category. The primary task includes: - Copying data from various online directories - Pasting the data into an Excel/CSV file - Organizing the data by categories Ideal skills: - Excellent attention to detail - Proficiency in data entry and Excel/CSV - Understanding of data categorization The task is straightforward and doesn't require any complex skills. I am looking for someone who can deliver accurate results in a timely fashion.

I need an expert in web scraping, either in Python or by utilizing Google Chrome extension, to extract text data from a particular website. Should be delivered within 3 hours. The scraping is a one-time task, not requiring routine updates, and the extracted data needs to be saved in an Excel file (or CSV). This will be hidden behind a login wall - so I suggest that the Python script will go to the website and then wait one minute, where I will manually log in. Ideal Skills and Experiences: - Proficiency in Python for web scraping - Experience with scraping text specifically - Ability to deliver the required output in a CSV format

To give you a brief idea the data you are dealing with is for recipe ingredients and I need nutrition info for all those ingredients from USDA. I'm seeking a Python expert who can give me 100% accurate "mapped" data without duplicates or missing information. YOU WILL BE REQUIRED TO WRITE/SEARCH NEW script to modify my data in Excel sheets - I have 3 Excel files having a total of 50000 rows, These are ingredients from recipes, I need you to do the following tasks - (A) - Assign a new ingredient ID number to all non-duplicate Ingredients. (B) - Replace "Name of ingredients" with the newly assigned number in the whole file (C) - For all ingredients - search, get the FDC ID from USDA Food Central and save this info in a separate file. Outcomes - 1. My Excel files -...

I am in need of a Python script that can extract Amazon's official keywords and search terms, and update this information on a daily basis. This data includes keyword search volume, keyword competition, and top ranking keywords. Key requirements and responsibilities include: - Developing a Python script to extract Amazon's official keywords and search terms - Ensuring the script is capable of updating this data on a daily basis - Retrieving keyword search volume, keyword competition, and top ranking keywords - Aiming for improved product visibility, enhanced product listings, and optimized PPC campaigns The ideal freelancer for this project should have: - Proficiency in Python - Familiarity with web scraping and data extraction - Experience with Amazon's API or web scrapi...

I have an existing Python script that automates data processing tasks. Unfortunately, I'm encountering a runtime error when running it. I need an experienced Python developer who can help me troubleshoot and fix this issue so that the script runs smoothly again. Key Responsibilities: - Identify the source of the runtime error and fix it without impacting the functionality of the script. - Ensure the script can successfully automate the data processing tasks as intended. Ideal Candidate: - Proficient in Python programming with experience in debugging and troubleshooting. - Familiar with automating tasks in Python. - Strong understanding of data processing. Your help is crucial to keep my workflow efficient and error-free. Looking forward to working with a skilled Python developer.

I'm in need of a proficient developer who can build me a data grabber. Ideally, you should have experience in creating software that retrieves specific text data from various websites. The tool should be capable of grabbing data from one page per site, no need for multiple page crawling. Your experience in web scraping and data mining would be advantageous, as well as having: - Profound knowledge in programming languages suitable for web scraping (Python, Java, etc.) - Familiarity with websites structure and HTML - Experience with data extraction tools and software - Proven background in creating custom data grabbers Your role will not only involve the creation of the tool but also ensuring it functions well without crashing or skipping important data. If you can deliver a well-fu...

I have to run this project of web scraper.

I'm in need of a data entry professional who can assist me in entering data manually into spreadsheets. The data will need basic checks for consistency as it's being entered. Ideal Skills and Experience: - Proficiency in data entry - Experience with basic data verification - Proficient in working with spreadsheets

I'm looking to automate a series of web scraping tasks using Puppeteer, and wish to build an API to manage and trigger these tasks. I plan to use AWS Lambda to execute these scripts and API Gateway to provide access to the functions. Key requirements for the project include: - Setting up AWS Lambda to run Puppeteer scripts for web scraping. - Configuring those scripts to automate data gathering and downloading. - Creating an API on API Gateway to manage the tasks, trigger the scripts, and return results. -it should bifurcates any social media links on the website - it should return a json with website text, links, social media texts. The ideal candidate would be a developer with: - Experience in AWS Lambda and API Gateway. - Prior work with Puppeteer for web scraping. - Strong backg...

I'm on the hunt for a skillful coder proficient in web scraping, specifically for Website A. The goal of this project is for obtaining valuable and significant data for analysis, competitive intelligence, and price comparison. While there's no explicit mention of the type of data to be scraped, I anticipate that a capable offering will cater to a variety of needs such as: - Text content - Image content - Metadata Ideal Experience and Skills: - Proven experience with web scraping - High proficiency in handling large data sets - Comfort in navigating Website A - Ability to collect comprehensive data categories Looking forward to a potential collaboration to achieve this goal!

IMPORTANT_ PLEASE BID YOUR FINAL PRICE AND TIMELINE - I DO NOT HAVE TIME TO NEGOTIATE . I am seeking a freelancer with expertise in website data transfer, particularly between WordPress sites. In this project, you will be helping me move recipes – comprised of both text and images – from one website to another. The process of transferring the data should leverage export and import functionality. Despite not having specific recipe categories to be prioritized during this migration, attention to detail is critical to ensure that all recipe information, including text and associated images, is accurately and completely migrated. A deep understanding of WordPress is required for this task, along with skills in data export and import, image handling, and website migration. The s...

Hi, I want somebody to build an alerting solution that will send me an email instantly each time a crypto project creates contracts on more than one of the following chains. With the same contract address. BnB ETH Sol Arb Avax Base Optimism I also want the data to output to a spreadsheet also in real time. In addition I want alerts and emails sent when; 1. liquidity is added to one of the contract addresses that meets the above criteria 2. Liquidity is removed from one of the contract addresses that meets the above criteria. I would like the routine to run regularly.

I immediately need an experienced freelancer to scrape specific numerical data from a website for me and in Json or XML files and should be updated each 500 ms. The project needs to be completed as soon as possible. Key requirements for the job participation are: - Proven experience in JavaScript - A strong understanding and prior experience with data scraping, specifically numeric data. - Availability to start the project right away and ensure its swift completion. These skills will be paramount to successfully get the wanted information quickly and effectively.

I need a talented Python developer with Selenium expertise to create automated scripts for a series of complex web tasks. Key responsibilities: - Writing Python scripts to automate complex web interactions that include conditional logic - Ensuring the scripts are reliable, efficient and scalable Ideal skills and experience: - Proficiency in Python - Solid understanding of Selenium - Experience in developing automated scripts for complex web tasks - Knowledge of best practices for writing efficient and maintainable automation scripts - Good understanding of web technologies and how they interact, including conditional logic The successful candidate will need to demonstrate their ability to deliver high-quality, robust and scalable solutions within tight deadlines.

I'm looking for a proficient developer with expertise in React.js and Node.js to design and implement an innovative web application with a dual focus. The primary functionality should be searching and aggregating information, united with web scraping and text extraction features. The application should: - Incorporate a connection to search APIs: Google, Bing and others. - Generate search parameters primarily based on keywords, plus an additional layer incorporating combination match words such as 'fraud', "charge" etc. - Develop an intelligent AI web scraping feature to extract text and info based on search results. - Consider additional features such as search parameters that can be controlled via data sources, sorting options and language filters. Ideal candida...

I need a software that can provide me with daily updates of opening and clossing odds from a similar site. Ideal Skills & Experience: - Proficient in web scraping - Expertise in data extraction and manipulation - Prior experience with similar odds comparison websites - Strong software development skills - Ability to deliver a detailed project proposal The software should be capable of extracting and presenting the opening and clossing odds from these three specified betting companies in a format that I can load onto my website. Please include a detailed proposal in your application, outlining how you plan to achieve this.

I. Project Description I'm looking for a freelancer to create an automated newsletter system that works with PDF files. This system will: 1. Data Scraping: Extract data from the given PDFs, including information in tables and XBRL format. 2. Keyword Analysis: Analyse the extracted data based on keywords I provide and remove PDFs that don’t meet the criteria. 3. AI Summarisation: Use AI to get summaries of relevant sections identified through keyword analysis after connecting it to an API. 4. Newsletter Generation: Put together a newsletter that includes: Summaries of the data points with references to the original PDF files along with the original table and URL links of the PDF scraped II. Requirements • Experience with PDF processing libraries like PyPDF2 or Apache PDF...

Currently, I'm working with Python Selenium and attempting to create a script that can consistently log in to websites like vfsglobal, such as "", every minute without triggering their IP blocking mechanism (which kicks in after about 5 attempts from the same IP). I've purchased proxies from and integrated them into my script, but unfortunately, they only seem to work for HTTP, not HTTPS. I'm curious about a solution to this problem. Is it feasible to set up a server (like Google Cloud or AWS) that utilizes a unique IP addresse for each request? Any insights you could provide would be greatly appreciated.

I'm in search of a knowledgeable and skilled freelancer who can successfully install the 'Artifism - AI Content & Image Generator SaaS' from Codecanyon on my platform. Key tasks: - Primary task is to effectively customize the content within the script. - You will be required to integrate this script with other platforms. Knowledge and previous experience working with API integrations is crucial. Ideal skills and experience: - Extensive experience with Codecanyon scripts - Proficiency in API integrations - Strong understanding of Python, Flask, or relevant programming languages - Positive track record of altering script contents - You should be able to work independently and provide creative solutions. You'd be an awesome fit if you thrive in fast-paced envi...

We are seeking a skilled web scraping expert to scrape html pages and convert them into a pdf file. The selected candidate will be responsible for creating a web scraper script that can automatically extract and organize data from various websites. The data should be neatly formatted into a pdf document for easy accessibility. The website is in which there are various links - section - 1, section - 2, etc. The text which is present when a link is opened is to be scraped. There may be an odd number as well, like section - 5A. Also, there are pages which will give more links/sections (there are upto 93 pages). When the section is opened, there may be footnotes. The text when the footnote is opened is to be scraped if possible.