If you get scared and don't use segwit addresses, then segwit adoption will slow down and eventually we'll go back to where we have started and then they'll be pushing for a block size increase again.
I dont use segwit for storage, not because of the FUDsters, but because it was not clear if the segwit adress use the same private key of the legacy adress that was used to create it, or if it dont have a private key at all. Since this was never cleared, I keep the cold storage in legacy adresses. Today, this dont make too much of a difference, since the fees are very low.
A legacy address start with 1, a segwit start with 3. This was technically cleared, and it dont matter when the address was created.