Yes, I would panic. Usually the first candles are an indicator of the price and interest of people to the token. If the first prices were low, most likely there will not be any growth.