Which wallet are you using? If its Windows, make sure you allow 'Public IP Access' for any firewall you're using, otherwise it won't connect.