The same reason why most average or a little above average didn't buy.
Many never trusted it would survive
And those that believed in it's potential went around in building something around it
More like being pioneers.
Besides if a billionaire has gotten quite a number of Bitcoin around Say a million Bitcoin
Many would consider it a Damocles sword.