Difficulty does only good. It increases BTC value and promotes common sense so that miners don't become too greedy.

I mean, bitcoin mining can not exist without difficulty. Because without difficulty, BTC value would probably just drop all the time.