It's not. To brute force your own local encryption, an attacker needs access to your encrypted file, and dedicate all his computing power to just your case.
With Brainwallets, one attacker can brute force all existing users on the planet at the same time, and thus has a much larger chance of finding a match.