As far as I can tell, none.  I was worried that I'd have to pay the interest on the term, but that didn't happen.  Just make sure you have enough unused swap to cover the swaps you are closing.