Remove the SSD too. It's not about booting, it's not even about the BIOS.
It's about power.

It's either a faulty PSU, a faulty mobo or, less likely, a short somewhere else that's tripping the PSU.

I already suggested how to proceed.