Panic sellers are annoying because they cause volatility in the market. If they all head to the exit and leave it with just believers, then bitcoin will have a chance for mass adoption, and for actual use as a currency.