I was getting a lot of "the GPU is responding slowly" and it would stop accepting jobs for about 5-6 minutes before finally timing out the card.
I managed to reproduce this now on my mixed card rig with the AMD cards running on --xintensity 1024. Added logging and debug, and let it run over night.