Something else must be wrong. Im still mining on my 3GB's which are a mix of different brands, they are nothing special.
Try reinstalling drivers? Got another pc you could try one GPU in to confirm the problem is with that rig?
Got another rig mixed 1050s+1060s, same problem. Friend has 16 1060s in 2 rigs, same problem
All 3GB, different brands, different driver versions.