Sunday, May 31, 2009

More Google Imposters

It appears (unless Google has Google bots in the cloud and on various little networks all over the place which I doubt after looking up these particular IP address networks) that there are some Googlebot impersonators out there. It would seem that this is really an impersonator because not only are these requests not coming from Google networks, they seem to only be interested in a few sites, not all the sites on our server. They are particularly interested in travel and real estate web sites. check your logs...if the IP address for Googlebots are not coming from Google networks - decide if you want them to be hitting your site.

Here are the Google impostor IP addresses:

2 2009 5 12.20.32.67 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 151.84.166.1 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
8 2009 5 209.7.26.158 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
25 2009 5 216.177.164.100 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 216.240.151.50 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
152 2009 4 24.44.206.249 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 65.213.90.26 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
87 2009 4 68.238.131.215 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 4 69.116.160.44 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 69.116.160.44 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 69.70.64.94 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 70.101.224.174 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 71.116.210.34 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
79 2009 4 71.43.155.145 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
2 2009 4 74.169.43.199 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 4 74.243.24.159 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
57 2009 4 74.243.25.64 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
10 2009 5 75.146.149.53 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)
1 2009 5 76.249.223.78 Mozilla/5.0 (compatible; Googlebot/2.1; http://www.google.com/bot.html)