I have just confirmed that the computer does stay on when I remove the extender but leave the graphics card powered. That is what I find weirdest about the whole thing.

Also, I have tried removing hard drive and DVD drive power, no luck.