I had 1 PSU powering the boards and the controller. I put another psu on the controller and booted up the boards first, and now it is running at full speed. Thanks for the advise you two..

This makes you wonder if it would be worth installing a cut-off switch on the power cable that connects to the controller. This would be helpful if you are using a single large PSU...