Manual IP checks are a must in my opinion, no matter how big your site gets.

It doesn't take many extra resources to do so, since most of your activity isn't going to throw any red flags at you.

If so, you might want to rethink the type of content you contain on your site as the target audience is apparently the wrong crowd to have around, anyway.