In the super long term the problem would be the continued loss of bitcoins. When all 21 million have been mined, any loss of private keys due to hardware failure or such would result in more and more bitcoin being lost to the void.
Even now I wonder how many bitcoins available are actually accessible by someone.