I've just wanted to post the same  
My development machine has 128 Gb physical RAM installed, so I didn't observe this issue, my rigs are 5x1060 3Gb's, so they don't suffer from this issue too.

Little explanation: there's thing in Nvidia architecture called Unified Memory and this one works quite differently starting form Pascal and needs prefetching , in other words, code is accessible from both CPU and GPU, memory pages and tables are created on access. Kernel specific makes it need to have full amount of memory (even by using virtual pagefile) installed on the system to cover full amount of memory allocated on GPU's. So, if it's 6x1080? each allocates 6260+, amount of physical RAM + pagefile should be more than 6260*6 >= 37560 Mb.

I'll add this info to the first page, thank you  natan069 !!!