One thing I'm wondering about, is how did that site get onto your server if you couldn't SSH to it?

If you have a CP, delete it from there.

If all else fails, run a port scan on all ports and see which one gives you a connection refused (instead of timeout). However, most providers will not like this.