I thought the biggest problem was with stolen credit cards, not people performing chargebacks with their own cards.

It doesn't matter what communication happened between buyer and seller or what proof of delivery is provided if it wasn't the legitimate cardholder making the purchase.