I don't think that changing the email address will automatically make people think that account changes hands (at least it shouldn't) but if there are more changes beside that like a drastic change in posting habits/posting quality, that will certainly make people suspicious. Otherwise, I wouldn't worry much about it.
Of course suspicion will not arise automatically without other supporting evidence
[changes in posting patterns for example]. Usually changing password and changing e-mail at the same time will be identical to accounts that have been sold or changed hands, especially if the account has been inactive for a long time.
If the account is hacked, sold or changed hands then they will not be able to prove the ownership of the account by signing the message from the bitcoin address
[most cases] and they will probably complain that they forgot the wallet password, used exchange wallet, the device used was stolen or damaged and etc. Therefore, if the OP never sign message from a bitcoin address, then he should probably do that too. That's good advice for future account security.