Well, this is a relative question. It has two forms of answers and approaches to use in handling situation like this.

1. Be worried if the transaction has not been delivered due to the fact that you use wrong software tools such as wallet, websites etc.
2. Do not worry if the problem was as a result of poor network. If it, be patient because there will be a self-correction.

I hope this help..