There's a time frame of 1-3 weeks before the funds are being sent to the sender. So he can basically ask you to prove that your sending address is owned by you

That does not work for coinbase wallets, simply because the sending address is not owned by me.