That's exactly the question. How much do you trust them? Even if they're "smashing chaps", that doesn't preclude them from making a mistake. Of course, you may make a mistake too so how much do you trust yourself.

The security ultimately resides in access to the private key. If only you have access to it, that's about as secure as it's possible to get.