Perhaps this is the kind of thing that the voting system could be used to address.

If some AMs become too controversial then a vote would decide on their removal?

(my guess is AMs that contain controversial information will probably be encrypted anyway)