You are pretty much correct. I won't go into details that there's an average of 10 minutes and so on. But yes, if the hash rate drops a lot, the next adjustment will come in ... much later.
But the thing is that realistically it's very unlikely to have such a major drop. This is the beauty of being decentralized. Many countries/regions. Many not even using electricity from the grid. They can't all just go down.