Scraper / Web data scraping: copy products from www.yourpoetic.com to our own Magento website -- 3
$10-30 AUD
Cancelled
Posted almost 10 years ago
$10-30 AUD
Paid on delivery
Hi all,
REQUIREMENTS:
1) Scrape all product info, images and categories from an external website
2) Download all images (thumbnail and all large images)
3) Allow the use of external links to the same images (so scrape the URLs to the thumbnail and all large images)
4) Use proxies to avoid IP bans
5) Use multi-threading to make the script run fast
6) Import all scraped data to our MySQL database
7) Create an ADMIN feature in Magento where we can run the scraper manually when we want to update the products
The website to be scraped is:
[login to view URL]
The site is small so this should be an easy scraping task.
Do this project well and you can guarantee yourself a continuation of work.
What we have:
1) Dedicated server running Apache
2) CentOS 6.4 will full root, SSH and WHM/cPanel access
3) MySQL database
4) Magento website running CE 1.8.1 with numerous extensions
Who you are:
1> Good feedback on Freelancer (do not bid if you have 0 feedback)
2> Good project completion on Freelancer (must be above 65%)
3> Good scraping, PHP, MySQL and Magento skills
START DATE
The project needs to be started ASAP
DEADLINE
1 week
Please note: If the project or parts of it are not completed in the above timeframes, we reserve the right to remove you from the project and choose another developer. You agree that no money will be paid to you unless the project is fully completed and we are happy with the result. Do not bid if you are not able to focus on this project 100%.
MILESTONE RELEASES
Milestones will be released within 24 hours of successful UAT completion.
Please ask any questions before bidding. If you bid a certain amount, do not try to change it later on.
Good luck!