Crawler

looking for programmer who is able to create a crawler that will crawl few websites with property listings and extract data (several attributes or specifications of entities) and input them into my database. ## Deliverables **Project overview:** 1. Primary purpose is to crawl a specific number of specific real estate sites (i need 3 sites at the moment) for property listings and return the specific listing results to a MySQL database. 2. The crawler will be scheduled to crawl a specified number of major real estate sites for listings once a day. (mainly the 3 sites i want) 3. Each site being crawled will have differing layouts, and so it must be possible to intelligently specify per site the layout and what to search for/return. [login to view URL] crawler must have the ability to compare previous days returned results and current results to identify new listings [recently added] [login to view URL] crawler must run on a Linux server and be capable of being scheduled to automatically run at certain times. [login to view URL] functions must be allowed to enable the addition/removal of sites and to update layout instructions per site.[--optional.] I would provide you with a script which would search on my website for that data from my database. Where users will be able to search my database for Property listings by their specific attributes (basic and advanced search with filters). You are expected to integrate the crawler wit the script and modify the scripts filters to suit the requirements Please reply with specific experience and examples of crawlers/spiders you have developed that meet similar requirements **Budget:** 300-350 USD **Deadline**: 2 weeks A detailed report of the project will be sent to those eligible.