More hashrate doesn't make the network automatically less vulnerable to a 51% attack, but the distribution of hashpower does.
If I build a new pool and attract more than half of current miners to use my pool, I don't care what the hash rate is. So your point, OP, is not valid.

Under "the infrastructure" they really mean adoption (places to accept the currency, payment processors, ATMs, etc..), not the hashrate.