If you've got a Mac, try GPG Tools.

It does everything you need with GPG, but my favorite feature is the Finder integration. After you install it, you can right-click on any file in the Finder and you get the following options under Services: