Tuesday, June 23, 2009

Turnitin Bot - Odd behavior

Turnitin bot is requesting pages and types of technology that hasn't existed on one of your sites for years - probably over five years.

First question is - where are they even getting these links?

Second question is - why are they not obeying robots.txt for this site?

Turnitin bot is on this network:

O1.com NETBLK-O1-BLK4 (NET-65-98-128-0-1) -
iParadigms, LLC NETBLK-65-98-224-0 (NET-65-98-224-0-1) -