Google chrome is the most used browser, but this makes it a high profile target on privacy/malware. Good to support all browsers because you just never know which way usage will run.
You're saying chrome has a larger attack surface which is true but I doubt it has more exploits(per arbitrary unit of time such as month) than IE, if I'm wrong then I don't mind being corrected.