It shouldn't matter much but I gave ports 8330 to 8450 highest priority on my router (since I use a couple different pools w/ different ports it was easiest to make one range).

If the outbound link becomes saturated the router will delay other traffic to ensure timely mining traffic.

Mining uses so little bandwidth I doubt it makes much of a difference but it can't hurt.