You would have a different wallet for that. So you would transfer from your delayed multisig wallet into your instant hot wallet as much as you think you might need in the next couple of hours.

If you allowed special 'fast' address, the hacker could just do the same.