Give him an IP ban and be done with it, stealing users funds is a big no no in this industry. Especially if you want to grow bigger and increase your userbase.
Yeah, absolutely. They have every right to refuse him service, and even permanently ban him from the site. But taking the guys money is just not fair.