A small checklist I use when choosing a webhost is whether the features they have are ones I need. I also look at space, cost, customer service and response time to my presales questions.
I also look into what other people have said about them and how long they have been in the business. Of course, newer companies are good too but I prefer to go with companies that have been around a bit longer