The thing about running algo switchers is you need to tune down your cards
Just because it runs stable on one algo OC'd to this or that amount doesn't mean it will be stable on all of them.
This seems to be especially a problem if a GPU is driving the display. Nvidia drivers really don't like the algo switching in those scenarios.
My mining rig handles the algo switching much better. .. . Presumably because I don't have any of hte cards driving displays.
I don't even bother with algo switching on the personal rig. Too much of a pain.
Is the answer still to just not have any displays connected, are there other alternatives or fixes?
Having a display connected or not connected will not make any difference. What will make a difference is GPU BIOS Flashing, Video Drivers & Miners (and how the miner is configured). And as said above, different algols with behave differently, you will have to test each one you want to mine to get the best out of them.