Being too paranoid about such things can also be a factor to push yourself or trigger you to have too many transactions and may be a reason to lose some of your coins.
Transactions is also a scary thing to do nowadays. Addresses can be anonymous but it is quite true that it is sometimes hard to confirm if addresses are right every time you transfer. It is quite a burden too.
As an advise to this, Find the safest wallet you can get and avoid transferring too much and do not let let anyone know your most private wallet.