Googlebot to Submit Web Forms
April 23, 2008
I saw recently on the Google blog that the Googlebot will start submitting web forms.
Specifically, when we encounter a <FORM> element on a high-quality site, we might choose to do a small number of queries using the form. For text boxes, our computers automatically choose words from the site that has the form; for select menus, check boxes, and radio buttons on the form, we choose from among the values of the HTML.
They also listed some important limitations, which makes this seam much less extreme as it did when I first read about it.
The Googlebot will NOT submit forms that:
- Use
method="post" - Have
passwordfields - "Use terms commonly associated with personal information such as logins, userids, contacts, etc"
- Have a form action that is forbidden in
robots.txt
Tweet
Related Entries
- GoogleBot Runs AJAX? - December 6, 2006
- Pinging Search Engines when Sitemaps Change - July 18, 2007
- Sitemap hint in robots.txt - June 13, 2007
- Uploading Files Like GMail Attachments - October 6, 2006
- It takes more than just PageRank - December 12, 2005
Trackbacks
Trackback Address: 671/20911509C6A6D01AA5BE4A6F48228A6D
Comments
On 04/23/2008 at 9:31:34 AM EDT Ben Nadel wrote:
1
I assume that they will still recommend that you use Google SiteMaps to have your site fully indexed. I wonder what the driving force behind this is. It seems a bit odd to me. After all, isn't most data behind any kind of "Search" form accessible in some other way (drill down through menus and navigation)?
On 04/23/2008 at 10:24:26 AM EDT Pete Freitag wrote:
2
Yes, I find it a bit odd as well.
If your content is in sitemaps google will find it, but probably won't have nearly as much weight as it would if you created a HTML page on your site with links to the deep items (a real sitemap).
My guess is that they will only use this on a small number of sites, perhaps those that are popular but don't appear to have much content.
I think this feature is more for those sites with nonexistent search engine optimization.
On 04/23/2008 at 10:26:01 AM EDT Pete Freitag wrote:
3
Just to clarify, I was talking about XML vs HTML sitemaps in the second paragraph. Both are good to use but if you had to pick just one, I'd go with HTML.
On 05/02/2008 at 12:02:36 PM EDT mrx wrote:
4
Google has been submitting forms both for a long time.. ajax too.
On 05/11/2008 at 1:55:21 PM EDT pimapen wrote:
5
pimapen panjur sineklik aluminyum
On 05/18/2008 at 2:41:21 PM EDT tophotely wrote:
6
It seems a bit odd to me. After all, isn't most data behind any kind of "Search" form accessible in some http://tophotely.com
Post a Comment
Recent Entries
- Nginx redirect www to non www domain
- HashDOS and ColdFusion
- HackMyCF Updated for APSB11-29 Security Hotfix
- Adobe eSeminar on FuseGuard
- Determining Which Cumulative Hotfixes are Installed on ColdFusion
- Adding Two Factor Authentication to ColdFusion Administrator
- ColdFusion Developer Week at Adobe.com
- Bug Loading Scripts for CFFileUpload and CFMediaPlayer


add to del.icio.us


