I need a freelancer able to plan, design, develop and implement a software infrastructure to crawl, parse and store data related to internet domain names and web sites. Skype contact mandatory.
Starting from a predefined list of domains/websites we need to acquire information from different online sources in an automated way and store the data in a database. Based on the data acquired we also need to build additional target list of hosts to crawl. Every day we need to check for updates and store the updated information. More details to be discussed during interview.