I would build a more permanent wall to separate hot and cold to eliminate any air "short circuiting", that'd probably help a lot. I'd also look at getting a bit more CFM on the exhaust side.
I don't want to spend a bunch more money on this - I think I might just double tarp it and get another AC unit for the summer months and blow it on the miners.