If you don't count the "server in my bedroom" at 14yrs old step(which I don't) than I started with a small dedicated server. Back then that's all you could really do, although now there's VPS and reseller accounts that mite be your best bet at first.
I personally suggest a VPS to start because it's affordable, and youhave total control(even if you don't need it). The most important part about a VPS vs a reseller account IMO is that your resources are dedicated.
█ | | Fiber Elephant | | Virtuozzo & Reseller Hosting
█ | Never oversold, always managed & on the SoftLayer network!
█ | Call us toll free 24/7! | 1-888-92-FIBER