Pete Freitag
Blog
Consulting
Products
Contact
Articles about crawlers
2007
Sitemap hint in robots.txt
Pete has written about
crawlers
once.