BTW, you are not using any "-O" flags on your command.
Did you make some tests with -O2, -O3 ?
just use ./build.sh
All my commits are automatically tested here :
https://travis-ci.org/tpruvot/cpuminer-multiThis is the proof your problem is somewhere between your chair and the keyboard