This has been discussed before. There is no less security to having addresses with just letters. Yes in theory if you are running any of the brute forcing key cracking software it will get there sooner.
So instead of finding the key after the heat death of the universe, it will happen a week or two before that.
Still long after the sun has gone nova and reduced the earth to a cinder.

-Dave