I'm just wondering why I should trust a Trezor, as I trust Armory. With Armory, it's software on GitHub that I compile. With Trezor, it's hardware and I have no idea what they put into the hardware and I don't know much about hardware. So I'm kind of scared of it.
I share your feeling. I suspect that we are wrong, but I feel the same way

Are there any software alternatives to Armory that use SPV (so I don't have to carry the blockchain with me) but also have determinstic wallets (for one backup only)?
Electrum. It even has offline storage like Armory, but is badly missing n-of-m backups, and probably several other Armory features.