If you exchange your Fiat money for bitcoin at the time when you want to pay something, it's never time to panic.
Only if you are a trader or use bitcoin as a value storage, there could be a reason to start panicking!
But until today bitcoin always recovered, so I personally would be relaxed if it will drop again one day.