Apparently it's random. Smaller withdrawals have a higher probability of working than larger ones.

No real explanation so far as to what is causing the problem.