You should always create backup of your private key, You can keep copy of private key on a USB drive but be careful, One more way is to print out the key in form of digits or QR code and keep it in a safe place be aware of little humans and animals as well. Famous crypto billionaires, use this method, but they chose more complex way, cutting up key printouts in a few parts and keeping it in separate bank wallets.