My 6-gpu rig runs fine on genoil, but in claymore one of the GPUs has 0 hashrate from the beginning, hangs in OpenCLL, claymore restarts, then the system becomes non-responsive.
Since it runs fine on genoil, I'm not sure what the problem could be?
PSU, the riser and the distribution of the power cables also can cause this. Especially pay attention on the PSU rails distribution among the VGA cards and try to move the power connectors to ensure they connect well. However some details could help: psu, vgas, risers, anything.
I assumed the problem was unique to claymore, since genoil is working. I don't understand why a riser would work on genoil by not claymore.
The cards are: XFX RX 480 8GB; MSI RX 580 Armor 8GB; MSI Twin Frozr 4 GB; Powercolor RX 580 Red Dragon 4 GB; and ASUS Rog Strix RX 580 8GB.
PSU is EVGA 1kW.
I don't remember where the risers came from.
Running on Windows 10.
I understand, however as they are two different codes, they may load the cards in a bit different way. That may be enough to unveil an unstable connection between your components or some poor quality chips on one of the risers. At least I recommend to try out to change a riser on that card and put it on another one. Same stuff with the cables connected (power/data). This can lead you to the weak point easily, if there's any. The fact that genoil runs with no issue does not mean your rig is fully stable. However, I can see you mixed VGA cards from rather different manufacturers. Claymore's code might have some bug handling this case, but I suppose, there's no any vendor-specific code in the source. Maybe (!) it's sensitive to the mixed sizes of VRAMs.
Anyway, please ensure, that you installed all the updates on your OS (including Creative update in the case of Win10) and use the latest official drivers. with 17.6.2 I had no issues, but I tested Radeon only in a single setup.