It's not really a negative thing, but I think it mainly has negative connotations because people are scared the bagholders will dump their stash of coins at one point, or it's used negatively to describe someone who is foolishly holding onto their worthless coins in the hope that they go to the moon in the future (which they will then dump).