link spider downloads
SiteMap For Google
1.9 download... opportunity knocks, in the form of the Google spider. This approach in orders of magnitude quicker than actually spidering the site yourself with a tool like Xenu ... sitemap in a couple of seconds. To speed spidering, and ensure the most important files get spidered ...