mining stops being cost effective?

I imagine people would stop mining which would drop difficulty and allow a profit to be made once again?  Eventually this should stabilize to a pretty steady rate of profit?

Thoughts?