I have always recommended Digital Ocean to host Ruby on Rails.
Here are Vexxhost pricing as per January 2014
And here is the pricing of Digital Ocean as per same date
I have not tried Vexxhost yet, but heard and read good reviews about. Their servers are currently in Canada only, while Digital Ocean has servers in NY, Amsterdam and Singapore.
So if for some reason you are looking for an alternative to Digital Ocean hosting and don’t want to pay more, Vexxhost seems to be your current best bet.