I think that If they started mining their own blocks from say a 5 block deficit when they finally overtook the main chain and became the new longest chain, all transactions in those 5 blocks plus in any subsequent blocks mined since the attack started, would no longer be part of this new chain (unless the attacker had also mined them). Since they are no longer part of the new main chain, this means they never happened and so effectively would be reversed.