I do not think that recovering accounts merely is signing a message and then verifying that message but requires user verification. "More investigations to verify the user."
These investigations require more time to verify that you are the actual user of that account and have not sold it and attempted to recover it.
Also, the rank and importance of your account play a role in determining the time required to recover it since the overall error returns to you in protecting your account.