I had two nvidia cards for long time and neve had this problem.
Right now I ahve RTX 3090 and GTX 1070 Ti on the same desktop and everything is fine

I'm pretty sure it's only a probleme with driver or maybe your mobo slot