Saturday, January 03, 2009

AISearchBot - Bad Bot

This is what the AISearchBot looks like:

AISearchBot (Email:; If your web site doesn't want to be crawled, please send us a email.)

This is a bad bot because rather than post a page where you can find out how to exclude them from hitting your site in a standard web through robots.txt, they try to get you to send them your email address and by so doing reveal your IP address as well. Hopefully they will fix this and provide standard instructions for robots.txt in the near future.