Would you think they would release the private key to me?
Probably not in that case, but I don't think that they would just keep your money either.
They are in the business to grow their operation, I don't think they want the liability of keeping your money if you can show that it is a mistake was honestly made.