Bank institutions, USA government or other powerful organization could bring down bitcoin if they wanted to. It's not that strong yet.
If these organizations can make more profit by embracing bitcoin. They will integrate it. If they cannot beat bitcoin, they will join it.
My answer is similar - what could take Bitcoin down is not disagreement among developers, this will be worked out. What can really take Bitcoin down is Banks, Governments and bad press. I am hoping though that they cannot beat it and will have to join.