Many people are unconsciously linking gambling with addiction. Not all gamblers are addicts as people make it seem. I gamble occasionally and can go days without gambling. If I want to stop gambling today, it will take me just a decision because I am not addicted. This is as opposed to what @Juicyhome said.
Others who might mostly find it difficult to stop are those who gamble for money and have no other source of income from anyone. They wouldn't want to stop that one thing that gives them hope.
Exactly, this is the same ideology that is still being pushed around by some new gamblers or people who are not even gamblers or managed to bet once or twice. Now when the word “gambling” is mentioned the first thing that comes to mind is “addiction” or “financial ruining” and that is not universally true.
Gambling itself doesn’t make you poor, it is the way you handle it that matters most but people don’t bother about sharing how to gamble properly, they’d rather just go with “if you gamble you’ll be addicted to gambling”, “the moment you start you will never be able to leave again” which are not entirely accurate.