I think you should demand your coins and card back. You know where he lives etc. He wasn't much of a crook giving you his details but crooks are often stupid and/or forgetful. Maybe it was just a crime of opportunity done on the spur of the moment so he didn't think it through. Nonetheless, get everything back.
There is no guarantee that the guy actually stole his BTC. Many wallet stealers won't take the funds right away but will wait until a sizeable amount is transferred into the wallet before it cleans it out.