My starting point is reliability. I find out the uptime, performance of a potential web host through un-biased reviews. I find out the experience of existing clients. I then look at other factors like customer support, hosting features, cpanel of web host, security, price etc.