I do not think it affects security, the idea of moving to a new address comes in as "spare security". 
It does affect security a little bit. If ECDSA will ever be cracked (eg. with quantum computer), then re-using addresses will be less secure.
New address will still be safe.