Now all this worked perfect, but I just realised that Armory never asked for my passphrase for the imported (encrypted) wallet. It just imported it and was good to go.
The encryption only encrypts the private keys. You cannot spend the coins without the password, but you can see them.