There’s no way to avoid transfer fees, it’s 0.001 ZEN per transfer.

As far as switching pools, I’d only switch to the other pool if it finds more blocks and has a larger hash to make the lesser pool fee worth it.