I am not that great with networking but I wanted to prevent this with my own VPN, so I wrote a small tutorial here:

http://www.brianhare.com/wordpress/2012/12/16/prevent-vpn-from-exposing-your-real-ip-on-disconnection/