I have 580 8GB, 1070 ti, 1080ti on windows with no issues. 1080 ti is just under 39 mh/s. I tried phoenixminer and wasn't stable at all on my system and had lower hashrate than claymore on the green cards but increased on 580.
Could you share your phoenixminer overlock setting for RX580. Thanks in advance)