Most of the time, I am also troubled by this problem.
So I bought a hardware wallet, so I don't need to deliberately keep my private key, I just need to carry my hardware wallet with me.