You must keep it separately. Don't keep your coin in exchanger except to transaction. Or you can try wallet like MEW (myetherwallet) and etc. But the exchanger or wallet is not always safe there is a virus like trojan spread in internet to steal your personal information or your coin. Or you can try hardware wallet but you say hardware can fail. Yeah indeed no system is safe.