I would disagree with your statement about there being no such thing as "efficient" mining hardware. I would define efficient miners as machines that use less electricity per GHs then the network does as a whole.
Your theory doesn't match the facts. People just keep adding more mining hardware until the electricity consumption is as much as they can stand. The diff rises and they get less BTC than they were getting with the lower efficiency setup.