Yeah ... sort of tried to do that. But the owner ... when he found out how much bandwidth Inktomi Slurp robots were actually using, decided he didn't want their spiders on the site at all.

Thats what led to the complete IP bans.

Can't say as I blame him.

I don't know why those robots went nuts on his site. I checked a number of my sites & the sites I host ... and none seem to have this "out of control" spidering going on by Inktomi Slurp. The bandwidth used is right in line with the other major robots/spiders.

Mind you ... IF Inktomi Slurp Yahoo had responded to my initial email about the problem ... I doubt if the owner would have felt this total IP ban would have been necessary. So ... its their own fault if they don't like our solution