Last time I looked into the Satoshi client code it either ignored or de-prioritized peers listening on a non-default port.