I have a dynamically genertated site map for our message boards at soberrecovery. com/forums/sitemap.html. It needs to be upgraded or replaced. Basically it's a mod-rewrite with some php.
This original script was responsible for getting over 100,000 posts into Google. It takes the php on the fly, parses it to .html and adds the entry to the sitemap.
But it does it all on one page. It has outlived it's usefullness as Google and others will not spider past 100 links now.
I need a program that can parse as well as break the pages while keeping them linked.