If your wallet has a lot of addresses it will have a significant impact on performance as the Bitcoin client will be scanning new inputs and checking them against each "address" you own.