I'm just trying to wrap my head around this, but wouldn't it be the same if you just printed your only private key on paper and kept it in a safe?
Yeah. So basically, just backup your private key!
In fact now that I think about it a bit more, that's exactly how I've been guarding my stash these last three years!