You should have used an escrow, I don't see why the other party needs to refund you for your loss. I certainly wouldn't.
Well I'll make sure not to do business with you. If someone were to gain access to my account(s) and used my name to steal from innocent people I would repay them. Maybe I just have a higher set of morals