There is a really simple way to fix this problem and make your brain wallet 100 times more secure.
The biggest advantage of a brain wallet is that all the information needed to redeem your money is in your brain (arguably, that is the
only advantage of a brain wallet).
The biggest disadvantage of a brain wallet is that people tend to forget passphrases (if your passphrase has even slightly reasonable entropy, it is
much more likely to be forgotten than brute-forced).
So your method does
not enjoy the main advantage of brain wallets, but it
does suffer from the main disadvantage. Clever.
You should pick one option: Either make a very strong brain wallet (using some clever key stretching, like warpwallet) and try really hard not to forget it, or make a split paper wallet and store the pieces in several places. That way you at least gain one of the advantages.
Oh and by the way - how is your method any different from storing a BIP38-encrypted private key?