Sorry guys, I shouldn't have used the word exchange. I should have said third party. Meaning any kind of wallet software that you have to download or sign up for.
It just seems like anyone should be able to send Bitcoin without downloading someone else's software without knowing what is really going on.
You need a third party wallet to generate your keys. Where you store your keys is up to you but in any case you do need a wallet.