Here's an interesting comparison of compilers/settings, looks like I should try out intel's compiler.

http://www.behardware.com/articles/847-15/the-impact-of-compilers-on-x86-x64-cpu-architectures.html