I am currently living a joint family too and while there are pros and cons, it's hard to maintain the harmony among everyone.
The difference in opinion as you say matters a lot and especially when your wife has a different opinion compared to others.
It's better to remain spectators instead of taking sides with no judgement, no need to become chaudhary when all the ladies at home gets into action, lugaiyo ki bhasad se dur hi Raho toh aacha hai lol.
Everything depends on individual to individual. I've lived alone and away from home on and off since I was teen (as 15-16 yo) and now in mid 30s living in joint family setting, I am incredibly relaxed. At times, it's chaotic af but it doesn't bother me at all and weirdly i find it very peaceful because I am surrounded with loved ones. Yeah, there's always irritating character in group but overall it's all good.