I would build a more permanent wall to separate hot and cold to eliminate any air "short circuiting", that'd probably help a lot. I'd also look at getting a bit more CFM on the exhaust side.