If your portfolio value is dwindles sporadically,  there is no reason why you should not panic.  In fact, you must start to panic so that you can at least cut your losses and if your plan is to hold,  then you have no business in current prices!