I think what most of us don't have, which these wealthy people all have in common are connections. They know a guy, who knows a guy that knows a guy, who can offer them good investments with virtually zero risk. They can just take a loan to the bank, ensure said bank that they are capable of paying then putting these new investments as collateral, and profit off of those new investments. Once you get to a certain point where you are very close with bankers, you basically get richer and richer every time.
For us mere mortals wanting to be at that level, I guess you need to have an insane amount of luck to hit a jackpot on the investment side of things, and gather as much connections as possible to unlock this cheat code that they have which makes them extremely rich.
You can invest all you want, get all the hits and get all the $$$ flowing to your bank account, but without the proper connection, you will be stuck in the same cycle and always, always, hope that your next investment makes it big again as you are always sucking up the risks yourself instead of letting others suck it up for you.