Monday, June 15, 2009

SuperPages bot traffic

Why is the SuperPages bot

a.) not obeying robots.txt
b.) getting referred from this web site: http://www.clearwatergazette.com
c.) hitting a site that we are not running super pages ads on...

The traffic is coming from:

OrgName: Idearc Media Corp
OrgID: IMC-97
Address: 2200 W Airfield Drive
City: DFW Airport
StateProv: TX
PostalCode: 75261
Country: US

NetRange: 151.138.0.0 - 151.138.255.255