100 witnesses would require too much much work for an individual to investigate about each witness and determinate if he can be trusted or not.
the more witnesses - the slower the network, the speed of the txs is the main reason to build the network with (
limited amount of) trusted nodes/witnesses
If we have fast CPU or network connection, is that a problem. I heard Dash has many more than 12 nodes (witness?)