Tools -> Preferences -> Transactions -> Uncheck "Use change addresses";

This will make the wallet send the change back to the address of origin (IIRC).