VPS offers are quite expensive, at least the ones I saw. I don't feel like staking alone will be enough to cover those expenses.
You could always use the VPS for other things, such as node hosting. With proper resource management, you could even stake two or more different currencies in the background simultaneously as well
Correct. It may be expensive if you're only going to run 1 wallet but if the VPS is cheap you might find that you're still in profit via staking since you won't be able to run your laptop or computer 24/7.