One of the arguments against proof of stake is that those with the most stake maintain power over the system (much like our current financial system) and therefore is not "truly" decentralised.

Can't this argument also be applied to proof of work? Those with most wealth can accumulate the most mining hardware and therefore have most control over the system?