Yes, keeping it open will make sure that your transaction does not get forgotten by the network as the client will rebroadcast it from time to time. For the future it also helps to keep the client open for a while before you send a TX (more than just syncing) this allows it to collect enough other TX to make a good judgement on how high the fee should be.