No, moderators will not remove trust ratings except in extremely rare circumstances. I'm not sure if it has even been done before.