There's a lot of reviews of low-cost private server providers
Just a note that lowendbox only shows VPS offers at $7 and less. Sounds like what you're looking for.
__________________ Hostirian - Saint Louis Data Center and Managed Services Provider (800) 615-9349
Datavault, Colocation, Bare Metal Servers, Cloud Servers & Managed WordPress Solutions
Over 18 years of experience working with small to medium sized businesses.
Depends on your standards and needs.... personally I have bad experiences with sub 10usd VPS's, but as a mail server or small website they might be sufficient. But there might be some perfomrance vps's to be found even in this price range if for example their node isn't loaded with other clients yet and whatnot.