I really hope people with high hashrate willing to drop their hashrate till the diff adjusted .... so it won't go too high for small miners like me

It would really be a win win for them, they could go snag up some other coins and as soon as the next diff adjust hits they come back and keep pulling in a lot of coins rather than raising it and pulling in less coins.
Before that happens I need to figure out why my CPU is accepting shares but they don't show up in the pool.