So if we add alot of these ASIC miners to the network and the hashrate doubles then, any miner but the big ASIC is going to be
screwed over by difficulty?
You are correct. GPU mining will never even come close to paying off the cards once a few hundred of these make it out the door. A few more batches and a thousand or two ASIC systems will make GPUs not even worth the electricity they cost to run. The same thing happened to CPU miners back whenh GPUs started showing up.