Safe if you can make sure the wallet is safe on the place that no one can found it!
But if you lost it on somewhere, you lost you're asset on it. So stil need aware from you to make sure you won't lost it in the future. Good luck for your hardware wallet