pf » Tag: crawlers on Pete Freitag's Blog
June 13, 2007
Sitemap hint in robots.txt
Just a quick tip for those of you that are building XML sitemaps for your web sites. You can now add a line to your robots.txt file to include a pointer to your sitemap file, it would look like this:Sitemap: http://www.example.com/sitemap.
Subscribe to my RSS Feed:
RSS
RSS
Pete Freitag is a software engineer, and web developer located in










