Buying precious metal where you can't physically touch it means you do not really own it. It's like the US government has never taken gold away from the population during unstable economic conditions...
Therefore the problem is to keep your stash where uncle Sam cannot touch it.