My biggest thing is back end support and uptime.
Most Hosts these days are running 99.9% uptime so the back end support is my main issue. The other stuff you can generally find out on their landing pages
Review of the Top Rated Web Hosting Providers
Web Hosting Incentives
"Success is the sum of small efforts, repeated day in and day out"