That is only if your have gone about telling everyone you have a lot of money in BTC, and due to that the attackers specifically target you because they know you have a lot of coins. However, if robbers break into your house to steal fiat and valuables from you, and then find your wallet file in your device, they might believe you have just the $100-500 in your base wallet. If you have a lot of coins, then loading the base wallet with a higher amount is even better.