Who would be tracking Bitcoin users thru IP addresses?
I wouldn't be worrying so much about connecting home wifi directly without TOR or using VPN, everyone around the world I think already have been aware of BTC and people uses BTC every corner. Maybe the users involve in dark market especially if they are buying contraband.
Are you sure people already uses BTC every corner? currently only 2 countries is accept Bitcoin as a legal tender e.g. El Salvador and Central African Republic. Personally I don't know where you live, but in my countries where Bitcoin isn't accepted as legal tender, there's no businesses accept Bitcoin as an alternative payment. People also still view Bitcoin enthusiast is a rich person, so if they hear you have Bitcoin, you might got blackmail and beggars asking for money.
Privacy ≠ Dark market/ illegal stuffs, don't mix it.
If you didn't care with your privacy, I think you're fine to tell us what is your real name, location, face, how many Bitcoin you have, etc?
He is just saying that no one will give a damn about your IP or Identity if ypu are just a regular bitcoin user that doing nothing wrong on it. But this is a case to case basis and depends on your country policy about Bitcoin like China that has strict law against Bitcoin.
In your case, You are afraid about blackmailing if someone knew you are using Bitcon but the question is how will someone knew it if you are not posting online or letting them know thay you are using Bitcoin? Unless there is only few people in your country and its easy to track your daily activity. Because if a hacker will hack you through your IP then how come he will choose you as target without any basis for his attempt?