Find Jobs
Hire Freelancers

build a tool for scraping data from a given set of urls - using scrapy and/or beautifulsoup

$10-30 USD

Completed
Posted almost 4 years ago

$10-30 USD

Paid on delivery
We need python code for doing the following steps: 1. Read a given xml file that has urls in it 2. visit each url in that file 3. for every visited page extract some data (associated with certain id and class) 4. create a new folder and write the data extracted in 3 above to an html file 5. the html will will also contain some fixed text that we will give you Repeat this process for every url in the xml file
Project ID: 26558754

About the project

22 proposals
Remote project
Active 4 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
I can make a python script for you which can achieve the above tasks you mentioned. I will use beautiful soap to extract data from websites. I have 2+ years of experience in scarping and web automation. I can do your task easily. You can check my Portfolio also. Let me know if you are interested.
$15 USD in 5 days
4.7 (2 reviews)
0.9
0.9
22 freelancers are bidding on average $29 USD for this job
User Avatar
Hi, I have gone through your requirement to scrape lots of websites. I am EXPERT in building scraping tools /scripts. Hence, I can SURELY work on your project. I am having 4 YEARS of EXPERIENCE in developing PHP-PYTHON (Scrapy, Selenium) based web scraper as well as WINDOWS BASED web scraping software through which I have crawled many sites such as Craigslist, Amazon, Yelp and many others. I have also worked on complex site to bypass CAPTCHA with the use of PROXY IP bouncing techniques.. Let's work together :) Have a great day! I am glad to see your WORK HISTORY and positive reviews of other freelancers. I am really excited to work with you and would love to have a long-term business association for any of your data related needs tasks
$20 USD in 3 days
4.8 (103 reviews)
5.8
5.8
User Avatar
I can get the result to you speedily. I have experience using scrapy and im very proficient in Python
$50 USD in 7 days
4.9 (30 reviews)
4.9
4.9
User Avatar
Hello, Probably it is sitemap which contains URLs in XML. It can be extracted from there and visiting each URL, any info can be extracted to save in excel. Best
$80 USD in 7 days
5.0 (23 reviews)
4.4
4.4
User Avatar
Hi there, I see you are looking for someone who can write python code that follows the instructions to read the XML file, visit the URL, extract and write data with the given format. I can help with that and I can start right now I am expert in python and I have a lot of exp in building scraper with BeautifulSoup and this kind of script. I can finish it in one day. Do you have any questions for me?
$20 USD in 3 days
5.0 (6 reviews)
3.0
3.0
User Avatar
Hello, I am a WEB SCRAPING EXPERT I can do this with Beautifulsoup. I have read your project description thoroughly. I am fully capable of completing your project in the given time. I have done similar projects in the past and it will be an easy task for me. I am new on freelancer but I have more than 3 years of experience in Python and Web Scraping. Please discuss the details in chat before awarding the project.
$20 USD in 2 days
5.0 (5 reviews)
2.3
2.3
User Avatar
Hey there, I hope you’re safe and doing great. Ive Done a similar job I can also show a demo. I have been python developer for more than a year I know all the usage of beautifulsoup,scrapy, selenium and all the webscraping and automation tools. I can deliver your task as your requirement. Looking forward to working with you
$30 USD in 3 days
5.0 (2 reviews)
2.1
2.1
User Avatar
Dear customer, I am an expert in data scraping with python. Please see my portfolio and provide me with more detail about what your mind to do. I assure you that I can help you and deliver you fast-best-optimal services in the context. regards
$30 USD in 2 days
4.7 (2 reviews)
1.0
1.0
User Avatar
Hey . I am a Javascript and Python developer with good experience in almost all major frameworks . I am quite experienced in crawling and automation stuffs as well. I believe I can get the task done in a couple of hours. Lets connect to discuss further.
$50 USD in 1 day
5.0 (1 review)
0.6
0.6
User Avatar
1. Mobile Applications To create a fast and smooth app for any platform, we also deliver products with outsourcing app development model. This model gives a reasonable solution to control the budget and other recourses. Our team connects conventional essential technologies and architecture with the unique logic of the app. Combined with a polished design and UI/UX an app becomes the one that reaches goals of our customers and wins the hearts of users. 2. Design Create fluid and mobile-first web designs with attractive graphics and engaging content with our web design company in India, that can connect with and engage your audience at extremely competitive prices. 3. Web Development We provide customized and need-based solutions for E-Commerce Websites, Dynamic or Static Websites, along with round-the-clock support. 4. Omron Interactive Healthcare Experience - UX Design - Mobile First Design - Website Development
$10 USD in 1 day
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi there, I would love to work on your project with the strong skills needed for the project. However I have to clarify few more questions which can be discussed to get scope locked. Please initiate chat to move further.
$20 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have over 10 years of software development experience, I can provide you with a good turn around to implement your requirements and data scrapping
$45 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I have experience in scraping and I have my own web scraping API saas too. I can this project very comfortably. Can you please share the project details to get started.
$30 USD in 7 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hello, I'm interested in this job. I'm a graduate in Computer science engineering and my husband has done PhD. We have immense industrial experience working for companies for these kind of projects which includes C, Python, Flask, Database and frontends. We could deliver the solution with in the agreed time. If you are interested we can discuss more on the details. Best, Sravani
$25 USD in 4 days
0.0 (0 reviews)
0.0
0.0
User Avatar
I am good at Python coding shall do it...................................................................................
$20 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi Employer, I have understood your requirements. I have experience in writing software for scraping data from web using python. My skills are matching quite well with your requirements. Provide me with further details in chat. Junaid.
$25 USD in 3 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hey! I'm a senior data scientist and I am hoping to help you. Thanks.
$25 USD in 2 days
0.0 (0 reviews)
0.0
0.0
User Avatar
Hi. I have experience in Python, bs4, selenium, scrapy. I can do your work accurately. Please provide me with the url and fields you want to scrape so that I can come up with a sample python script so that you can get the confidence about my ability to do this project. Thanks
$15 USD in 2 days
0.0 (0 reviews)
0.0
0.0

About the client

Flag of PAKISTAN
Islamabad, Pakistan
5.0
16
Payment method verified
Member since Jan 12, 2014

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.