The number of real users on smart contract and privacy focused cryptocurrencies are smaller than you think. Looking at statistics, there might be many people using those coins you are referring to but most of them use it merely for speculation. I wouldn't count those who use privacy focused cryptocurrency and erc20 tokens contract to speculate as users if I were you.