It's now complete.
If complete means the transaction has a confirmation or some confirmations, it won't be reversed.
But can he now withdraw the money since he has my bitcoin wallet address?
He can not because you only gave him your public address. That sender does not have your private key so "not his keys, not his coins".