It is not there fault actually, it is very hard to talk about what we are not really In to, and at most times people will tend to talk about or maximize talking about gambling in such a negative way based on what they have seen from gamblers that is around them, probably they might have been seeing those that has been over taken by gambling
addiction, yeah that is true just like for instance I have an uncle who sold almost his farm products just because of gambling which has brought issues between him and the wife, definitely those around my area that are not really into gambling will definitely say negative things or have negative feeling towards gambling activities by generalizing the habits of the gambling addict in their closet.
When it comes to the notice of people how gambling is almost affecting you, and probably your well being and in some cases your financial position, they will most likely criticize you and even say negative things about you as much as they acn but then what matters is your ability to not letting any of such becoming a problem and a thing of consideration to you provided you know it's not a problem just yet to you. Furthermore you can make sure you gambling habit doesn't interfere with your family affair so as not to cause issues between you and your family because at that point it's becoming a very irresponsible act and shouldn't be considered as something to encourage.