Alright, I figured out a way around connection issues. If your firewall does not support UPnP, you will need to forward port 41338 to the server with your wallet on it. Rockin 42 connections now.
Although that is a way to get more connections, it isn't 100% necessary. See the above posts - I've got 8 connections, behind a firewall which doesn't allow UPnP or have ports forwarded.