Anything that challenges the established order is labelled controversial. First they ignore you, then they laugh at you, then they fight you, then you win. Bitcoin is currently on step #3.
The fighting bit is for the banks. The people love Bitcoin. In their minds, I think Bitcoin has already won.
Bitcoin is controversial because people from all walks of life love it - the geeks, the venture capitalists, the drug dealers..