Thursday, July 12, 2007

RedBot

Here's a new bot:

RedBot/redbot-1.0 (Rediff.com Crawler; redbot at rediff dot com)

Seems to be some India related web site.

Doesn't say how to block it in robots.txt at first glance.