it's illegal
even though one of your family members is a gambler, but don't play together on one table. because that will destroy your own self-esteem.
Things will be considered illegal if there are laws that were broken. Maybe you are talking here of morality\integrity where in a whole family is gambling in a single table and a chance that non members of the family would be cheated on the game.