The 'you own the keys' argument doesn't really hold up imo, after all, you 'own' your creditcard too, still the company manages it and in the end has ultimate control over it.
If you own the keys on your phone, then the server doesn't have them. Ergo, they can't do fractional reserve banking.