A much better, but similar solution would be to use PGP and somehow associate your PGP public key with your bitcoin address.

This would resolve the issue of potentially exposing your private key to anyone while keeping your goal of encrypting messages involving your bitcoin address.