The only downside of segwit addresses is that they do not allow to sign messages. Only Electrum does, and its signature is not recognized by Bitcoin Core.
SegWit DOES support sign message, but there weren't any standard about sign message so Electrum decide to make their own standard.
The only standard that i know is
https://github.com/bitcoin/bitcoin/pull/16440, but it's still on progress.