I haven't move my WordPress off dreamhost because it just works :)

Also I don't have to update operating systems or do backups, etc.

Unless you website is serverless, good old shared hosting isn't bad. You have less control, but also less responsibility :)