It's not about buying too late, it's about selling too early.
Buy and hold. Longterm. 10+ years.
Maybe late buying is also a factor because the chance to earn higher amount will affect if the value in coin or token is already pump or increased. On the other hand, you are also correct that it is also about long term holding.