Security is definitely the most important factor or if money is stolen, it would be fair to refund it from their frozen balance.
Secondly, it may be decentralization. So managing our exchange wallet with private key is fair. Exchange is like a prison, ''restrictive''.