In our hometown, there's a known description if the person starts to become poor and he's a known gambler. People on there will start to blame his misfortune 'because he's a gambler'.
And that makes others aware that they shouldn't gamble too if they don't want to share the same fate. In my personal life, it didn't affected my personal reputation. I think it's still depending on how you handle yourself and the situation.