No, it doesn't scare me.  I actually love when the market goes down because it gives me another chance to buy coins for  a cheap price before they skyrocket up agai.