If you're starting out with a VPS the big consideration IMO to go dedicated is your need for much larger allocations of the CPU, in which case some VPS providers can meet your needs as apposed to "equal share".
I've seen well setup nodes who's VPS have easily outperformed dedicated servers of equal allocations. It's rare, but can be done
