I figured it out. But not sure what was going on. I reinstalled ubuntu from usb, stared fresh. Bsgs is now holding 17 exa keys/s stable. All 80 cpu threads loaded around 50-60 percent. Appears my ram can now not keep up. But the speed drop out is gone.