You're installing those so that you can either build armory or put qt into the package.
I see, but if someones 5 year from now tries to reproduce the steps, and by the time something not backward-compatibly changed in swig, that may lead to some frustration.
Anyway after installing it with brew, Armory compiles and builds.