I figured it out. One of the rails on my PSU is malfunctioning. I moved the GPU power cable to a another one and it works now.