2. Review the feedback sent by people you're including/excluding. (You've mentioned this a little bit)
This is a good suggestion. Also retalliatory feedback should also be considered, mostly they are just out of spite from those tagged, but digging deeper could give a clearer picture.
Also the presence of a member in the various boards is important, as this means they better understand the state if the forum.