Skill level, expectations, needs, and short term goals
Depending on your experience level, expectations, and software requirements these are just some of the considerations when picking a hosting provider. If you have been in this industry for any length of time you will know what your skills are, and what your needs from the provider are going to be.
First off there are thousands of ISP's, resellers, affiliates etc out there. So finding someone who guarantee's something you are looking for is more than easy to find.
I recommend you start small and build up from there. If you are new to this, I recommend you buy a small account at host gator and play with it, if you are a seasoned professional or just like the idea of having your own server, then I recommend a VPS solution and have fun with it.
There are so many options, one thing that you have to remember is that your DNS is only a few hours away from pointing to another IP address. Or even better a domain is less than 10.00 for a year. So if you are not happy with what you have you can move it somewhere else.
Good luck, make money, and more importantly have fun!