If you're evaluating your portfolio in BTC you should be even less worried, since you'd be in for the long haul. Altcoins are riskier than BTC, so some will take longer to appreciate while others will flat-out die or even fail compared to Bitcoin. With diversification your overall portfolio should be up within a few months of investing though.