If you really want to worry, worry about core devs getting coopted (bribery, extortion), or quantum crypto destroying all the ECC infrastructure. That is what troubles me.
What kinds of actions would you worry the core devs could be coopted into taking?
Backdoor-ing the implementation, e.g. by weakening the crypto. Anything else would be obvious and precipitate a fork. Backdoors can be excruiciatingly subtle.