Your security in holding your bitcoin depends on your own risk or on the way you handle it. Basically, bitcoin must be really secure since it involves not just money but currency which for me is a very crucial thing for us.
I agree with you, the security of your Bitcoin is depends on how you manage to keep your privacy against to people around you. You should keep your private key and the password of your wallet; never let others know about it.