pf » Googlebot to Submit Web Forms
April 23, 2008
Googlebot to Submit Web Forms
I saw recently on the Google blog that the Googlebot will start submitting web forms.
Specifically, when we encounter a <FORM> element on a high-quality site, we might choose to do a small number of queries using the form. For text boxes, our computers automatically choose words from the site that has the form; for select menus, check boxes, and radio buttons on the form, we choose from among the values of the HTML.
They also listed some important limitations, which makes this seam much less extreme as it did when I first read about it.
The Googlebot will NOT submit forms that:
- Use
method="post" - Have
passwordfields - "Use terms commonly associated with personal information such as logins, userids, contacts, etc"
- Have a form action that is forbidden in
robots.txt
Related Entries
- GoogleBot Runs AJAX? - December 6, 2006
- Pinging Search Engines when Sitemaps Change - July 18, 2007
- Sitemap hint in robots.txt - June 13, 2007
- Uploading Files Like GMail Attachments - October 6, 2006
- It takes more than just PageRank - December 12, 2005
Trackback Address: 671/20911509C6A6D01AA5BE4A6F48228A6D
Comments
On 04/23/2008 at 7:31:34 AM MDT Ben Nadel wrote:
1
I assume that they will still recommend that you use Google SiteMaps to have your site fully indexed. I wonder what the driving force behind this is. It seems a bit odd to me. After all, isn't most data behind any kind of "Search" form accessible in some other way (drill down through menus and navigation)?
On 04/23/2008 at 8:24:26 AM MDT Pete Freitag wrote:
2
Yes, I find it a bit odd as well.
If your content is in sitemaps google will find it, but probably won't have nearly as much weight as it would if you created a HTML page on your site with links to the deep items (a real sitemap).
My guess is that they will only use this on a small number of sites, perhaps those that are popular but don't appear to have much content.
I think this feature is more for those sites with nonexistent search engine optimization.
On 04/23/2008 at 8:26:01 AM MDT Pete Freitag wrote:
3
Just to clarify, I was talking about XML vs HTML sitemaps in the second paragraph. Both are good to use but if you had to pick just one, I'd go with HTML.
On 05/02/2008 at 10:02:36 AM MDT mrx wrote:
4
Google has been submitting forms both for a long time.. ajax too.
On 05/11/2008 at 11:55:21 AM MDT pimapen wrote:
5
pimapen panjur sineklik aluminyum
- CFSCRIPT Cheatsheet
- 3 New Image Effects for ColdFusion 8
- ColdFusion 8 Update 1 Fixes some Image Processing Quirks
- 10 Most Useful Image Functions in ColdFusion 8
- Speaking at NYC CFUG This Week
- Adobe AIR Tutorial for HTML / JavaScript Developers
- INFORMATION_SCHEMA Support in MySQL, PostgreSQL
- Moving a Subversion Repository to Another Server
Subscribe to my RSS Feed:
RSS
RSS
add to del.icio.us
Pete Freitag is a software engineer, and web developer located in










