PART 1 i need to enter a search term for a local buisness. Such as chiropractors NY. Into google.
I need to capture the urls ot the 3 top advertisers on the page and the 8 on the right side.
I need to do this for 50+ categories in over 100 cites.
1 or times a week, eliminate duplicates.
PART 2 If it is possible the program would go to each site and find the fax number and email address if not I will need do this manually.
Windows based. If I need to get a server to run it, no problem.
My goal is to get the email address. and the fax number and the phone number of each of these companies. And to build my contact lists.
I have a lot experience about data collection, crawler and bots. Second part is easier manually. If phone and fax change often, and if websites are same, then make sense build bot.
I can do it for you. (I am a graduate student in physics working on computational projects. I am doing freelance programming for extra money. All sorts of computational projects welcome.)