That's a pretty general observation, but not entirely wrong. The problem with gambling, though, is that unlike eating or working, activities that have necessary benefits, gambling is mathematically designed to make you lose in the long run. So while moderation may make sense in other settings, in gambling it only serves to delay the inevitable loss. The main scope of gambling is fun, not getting rich
It is worth treating gambling as just a game and not a way to earn money, then everything becomes quite safe for your budget. Gambling is not the only entertainment we spend money on, and if you approach gambling responsibly, then you do not need to replenish your bankroll too often. So if it does not harm your budget, if you do not abuse it, then there is no need to think about quitting gambling forever.