If money is not a problem, then go for a dedicated server, with RAID setup, redundant NICs and PSUs

The VPS is a nice solution, as most of the times the hardware is top-notch so you get some sort of redundancy, but remember the VPS are still sharing the same server, so the disks (I/O) are shared, etc.

Regards,