Not being the top dog can hurt.
We constantly hear things about successful people and their successful success, how persistence and hard work let them achieved their place, how they simply loved what they've been doing and this is how they made their fortunes, how they were excelling at everything they've been doing...
Of course, nobody would tell you anything about anyone who worked as hard as them yet failed for reasons not related to their hard work. What if they are just not smart enough? What if they are naturally too humble or anxious to take even minor risks? What if they are just not made for success - or, maybe it is success not made for them?
Some people never achieve more than being a dishwasher in McDonalds regardless of how hard they try - and they won't achieve anything more. Finding yourself in a similar position and realizing the limits of your potential may be frustrating.