Actually no, miners with big hashpower jump on and finds blocks quicker than the 3 minute average then leave, this lets the little miners take over and wait for things to stabilize out.

If you look at the average times it is roughly 20 blocks per hour, now if 20 blocks get found in 10 minutes what do you think it would do ? Average out of course