🕸Fergus Duniho wrote on Sat, Jul 1, 2006 12:09 PM UTC:
It was robots. One robot in particular was responsible for almost half of
our bandwidth usage in June, and it has now been banned in a robots.txt
file. As a precaution, Googlebot is being restricted and all other robots
are being completely banned until I can confirm that the robots exclusion
protocol is keeping the ravenous robot away.
