i think i will add more base on my little knowledge :
- price move too high and not stable
- government regulation
- relation between country
- bankers
- job that will lost because traditional bank is lost
etc
Most of the difficulties have been outlined, but we have to understand that even if crypto will end up being used, the government will not give up centralization for decentralization and that would always still be in majority of the crypto world while most of the crypto we are seeing today will end up just like stocks.
It is a good thing we are here and there is nothing that does not have its own challenges but for now, these are some of the things we should face mostly like you have mentioned.