Mining difficulty follows price, not the other way around.

If too many miners drop out, the difficulty automatically adjusts so that the block interval is still about the same.

It is elegant in that the more Bitcoin is worth, the more resources are put into protecting it.