Gambling is no scam because you are aware of what you are doing or game you are playing, in as much as there is an agreement by the two individuals or groups before starting the game or bet it is not. But when you say scam ,the person is not aware of your intention .
Gambling is a game of try your luck ,a game of chance if you can win to make more money or valuables for yourself, getting rich quick.
You are right; gambling can only be said to be a scam if the person is gambling and does not know what gambling is in the first place or if the system turns to scam the person by providing an unfair result to the person. Let's use sports betting for instance, where you can place your bet and know the outcome of the game even before you check your bet result in the casino, or eventually the game result doesn't turn out to be the way it's supposed to in the sports event. That's why someone should accuse the system.
People who aim to make money in gambling usually they cannot accept the defeat that happened to them so the conclusion they draw is that gambling or casinos are fraud, and with what you said it also includes because usually people who aim to seek profit in gambling are those who do not really understand what gambling is because gambling is not a means to make money but there are some of them who gamble to seek profit of course this is not true.
It is very unethical to say that casinos are fraud, they must fix their own perceptions not to gamble with the aim of making money, because winning in gambling is not certain to be obtained and if not for luck then they will not get the victory.