Why do not you have two devices, the first contains sensitive data that leads to the loss of your money such as the private key and other sensitive data and another that you can carry what you want as long as there is not a lot of important information on it?
You can use an old computer or use a phone to do this.