What are some things on the must-have list for choosing hosting?

I know I need to worry about customer service, cost, and space but what are some other things that are important but not something you may think of when purchasing hosting for the first time?