I agree I'm in the same situation as you,these days people with channels just join ICOs channel and start adding members to their own channel and nothing can stop them.
Yes, some members will quit. The reason is that other will stay and can communicate with your brand.