You are right. That is why we have to use decentralized wallets. Advantages of decentralized wallets over centralized ones is the security which it posses. The Decentralized wallets does not depend on any third party services. The entire control of the wallet remains in the hands of the users.