Find Jobs
Hire Freelancers

Web scraping using Scrapy on Raspberry Pi -- 2

£10-20 GBP

In Progress
Posted over 2 years ago

£10-20 GBP

Paid on delivery
We would like to setup an automated web scraper to run on several websites and retrieve product name, description, image URLs, and updated prices and put these in a Google sheet. Project questions 1. What technologies should be used to implement the scraper? Scrapy in Python running on a Raspberry Pi, or Zyte 2. What websites will the scraper need to run on? [login to view URL] [login to view URL] [login to view URL] Please note, some of the websites require a login to show prices, I can supply Html files with the pricing information to setup the scraper. 3. How long do you want the scraper to run for? The scraper needs to be run once to gather the content, then run weekly to capture any new products or price or stock level changes
Project ID: 32826698

About the project

2 proposals
Remote project
Active 2 yrs ago

Looking to make some money?

Benefits of bidding on Freelancer

Set your budget and timeframe
Get paid for your work
Outline your proposal
It's free to sign up and bid on jobs
Awarded to:
User Avatar
Hi, I am a very talented software programmer with 13+ years of development experience (5+ years professional work experience). I am a results-oriented professional and possess experience using cutting-edge development tools and technology stacks and have high aptitude for designing and implementing new software. I possess an outstanding ability to pay attention to detail, have professional communication skills, and am productive in both team-based and self-managed projects. I am very dedicated to maintaining up-to-date industry knowledge and IT skills. I have responsive front-end development experience using HTML5, CSS3, JavaScript, jQuery, AngularJS 2, Bootstrap 4, and AJAX. I also have experience requesting and sending data to web servers using JSON and XML. For back-end server-side development, I have developed in PHP (MySQLi OOP with MariaDB), Java/J2EE, C, C++, and .NET(C#). I used XAMPP's Apache web server therefore have experience with MariaDB (MySQL fork) and SQL. I have also used Node.js with a windows shell and the [login to view URL] module using Node.js. Lastly, I have experience with React.js and Redux.js. I developed in Visual Studio Community 2017 for C and C++. I am a quick learner so you can start me on any project with confidence that I will learn any topics/areas quickly and deliver professional software that suits your needs. Please view my past submitted work in my portfolio's Portfolio Items section. Sincerely, Jiwhan Choi
£10 GBP in 1 day
4.9 (11 reviews)
2.9
2.9
2 freelancers are bidding on average £13 GBP for this job
User Avatar
I have 1+ years of experience in Web Scraping/Data mining from web. I can scrap almost any website, extract data and save it in JSON, XML, SQL, Pain Text or any other format you need. There is no limit of fields to be scraped or the number of pages. I mostly use Python script to scrap data but can choose any other programming/scripting language if you want. If you want to scrap any website, let's talk.
£15 GBP in 1 day
5.0 (3 reviews)
1.6
1.6

About the client

Flag of UNITED KINGDOM
Darwen, United Kingdom
5.0
8
Payment method verified
Member since Oct 28, 2010

Client Verification

Thanks! We’ve emailed you a link to claim your free credit.
Something went wrong while sending your email. Please try again.
Registered Users Total Jobs Posted
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Loading preview
Permission granted for Geolocation.
Your login session has expired and you have been logged out. Please log in again.