So the confirmation speed may decrease if people do turn miners off and others do not tun miners on to make it more profitable?
No, the difficulty adjusts every 2016 blocks so that confirmations will always average about 10 minutes.
Which could create an incredible jam in transaction confirmations if lots of people suddenly turn off miners