There is a risk of doing business with both Bitcoin and Gold, not only Gold, even today, some people will still be scammed just because they want to buy or sell Bitcoin. So because you know the right route doesn't mean others do. Yours is to be sure of your dealers in Gold transactions (big or small).
But at least when you buy something like BTC, you know which one is which, it's a fork or not, a scam or not, per se - it's like saying you are afraid of buying Bitcoin Cash instead of real BTC due to the dealers (the exchanges and such), which is not happening if you are vigillant enough.