I define "another layer of trust" as trusting anything else but the Bitcoin network.

In that regard colored coins are less decentralized than sidechains.