Memorized private keys, the safest way to own bitcoin.
Encrypted paper wallets, almost as safe.

Paper wallets without encryption could be physicly stolen then claimed.
Bitcoin clients have the possibility of security vulnerabilities and are targeted by bitcoin related malware.
Physical digital wallets are subject to theft just as unencrypted paper wallets are.