There are all kinds of ways where you can fuck up even if you keep your paper wallet and your house. Let it burn down or whatever, spill some water over it while typing the keyboard. Let your dog eat your paper wallet with 500 BTC on it.
It requires caution no matter where you keep it. One thing is for sure: if you keep paper wallets or hardware wallets at home, never talk about it to anyone. That is the worst you can do.
Agreed, I would argue that even talking about bitcoin is a risk right now, after all with the high price of bitcoin if you were to tell people that you have been in bitcoin for years they may believe that you are holding a lot of bitcoin and then try to find a way to steal your coins when you in fact are only a small holder, so it is better to keep that information a secret so no one gets a clue about the fact you are holding some bitcoin.
Yes even worse you could attract some serious hardcore burglars! If they get to know that you have paper wallets at home and have some idea that you might be holding tens or even hundreds of Bitcoin, good night man. They could be coming for you and they won't be nice to you.