There isn't really any good way to include a safeguard on Bitcoins that you want to be able to carry around with you and also spend.  But there are ways to separate your Bitcoins into various places with varying levels of protection against theft.  You can have a spending wallet that only contains a small amount that might get stolen, and a savings wallet that you keep in a safe place.

Businesses usually use time-lock safes in order to enable the storage of large sums while discouraging theft.  Put your savings wallet in one of those.