Thursday, July 12, 2007

Bot not obeying the Rules

This bot does not appear to be obeying robots.txt

Unversity of Illinois192.17.0.0 - 192.17.255.255MQBOT/Nutch-0.9-dev (MQBOT Nutch Crawler; http://falcon.cs.uiuc.edu; mqbot@cs.uiuc.edu)