I always don't care about what people say whether it's comments about my personal life or when I'm gambling because as long as I don't bother other people and don't ask them for money then I will remain indifferent and do whatever activities I like whether it's gambling in front of them, although sometimes gambling is considered bad, but it's me who does it and I also bear the losses while they are just busy making comments which I think are noisy 
That is what it should be. We will mind what we do and we don't mind what others do and that's why we shouldn't let them affect our feelings in whichever we do. If they're too talkative and tells a lot of tales that we don't like, ignore them.
That's the best revenge that you can do to them and react nothing as if you are just doing nothing and actually ignoring them for real. Just think of those folks that don't have anything to do so they comment to you.