because you think they deserve it, instead the poor are stupid or something, instead they are just not lucky enough

Way too legit. This upsets rich people, they think are special butterflies when they are just lucky.

Not all the rich people were lucky and not all the poor people were unlucky, the skill also matters.

Define skill.

A rich guy who is not smart enough will wile away his entire fortune. A fool and his money are soon parted.

Ability to gain skill and perform great = predisponed by genetic and environmental factors = aka LUCK.