Everything seems to be working ok now. It's almost like it need to "warm up". Odd
Thats a pool issue. What pool are you running on? Hashrate displayed is an average, so what's going on is that your pool is causing the miner to spit out a lot of errors when if first connects (most likely due to it being a mutipool and/or starting off the miner with way to low of a diff), then when is starts to mine fine the average slowly starts to go up.