VPS may have many benefits, but I have a feeling that quite soon (especially in the case of success of your project, what I wish you) your server might be insufficient for your needs - you may want to add new software, node, SPV/LN server etc. It is more expensive, for sure, but why not look for dedicated server?

One of main question you must ask yourself is "am I an admin"? If not, you really really want someone who will take care of your server, its updates, security etc. If you are just a programmer who wants to host his project, you will face many issues you may be not aware now (besides some weird side-effects of different kinds of virtualization solutions used for VPS).