Automated web browsing / screen scraping

Need to download massive amount of information from a single website. Some dynamic navigation will be required. Very aggressive time schedule. I will provide you with a temporary access to a website. You need to automate the following: 1. Login to website. 2. Click on link "Find {..}" 3. In the form that will appear, find field labeled "Subject". Under the label there will be a link called "Index". Click on that link. 4. Index/menu of different subjects will appear on the left side, next to the form. The index consists of a list of different subjects. The list is long and shown in parts, in alphabetical order, and only subjects with specific first letter are shown at any particular time. To go through the list, you need to navigate. 5. Once you click on the particular subject, it shows in the form on the left. 6. Click Search and a long list appears, shown in 100s, 100 items in a single page. You use a link Next to navigate through pages. 7. On each such page you need to use checkbox to select all records, then click "Export data" to export records into Excel. You need to grab the excel data and append it to a "Master" Excel file. You have to go through all returned pages, one after another. There might be thousands of them. 8. Once you've gone through all pages for the first subject, you need to go back to Search form and choose different subject. And do this all over again. I need data for all subjects. 9. At the end you will have millions of records in your Excel. 10. I want to have this excel as well as code used to generate it. Thanks!