I moved blog and site to Amazon Elastic Cloud - spent several days on that. Previously I pay around 10 USD per month on Hostgator hosting, but decided to switch to free (tr1.micro, 1st year) Amazon hosting. Basically because it was interesting to try Amazon services and play with virtual machine. It provided to you without any additional services, so you should install everything manually. Also it can be scaled very easily and you pay as much as you spend.
Linux was chosen for virtual machine, after that I installed MySQL, Apache server, ftp and WordPress. Several useful links: WordPress Installation, Ftp.
Hope my readers will receive that post via RSS :)