Look at it from a different perspective: it's almost impossible for a poor person to accrue substantial debt, only a fool would lend money to someone who can't pay. That's why bums don't live in mansions and drive Ferraris -- no one offers them that kind (or any kind of) credit.
Does this clear things up at all?
Do yourself a favor and read about 2008 sub-prime implosion caused exactly by bums living in mansions and driving Ferraris. Educate yourself.