I've never been afraid of going out into the world and exchanging bitcoin. I do it in public and I've never had any problems.
Most of the time bitcoiners are really friendly. We exchange opinions about the market and joke around from funny situations, even talk about memes and tell bitcoin jokes.
I've never become real friends with any of these people because we're both cautious, but it was always a good experience.
If people were to target you as a bitcoiner, wouldn't they simply go to a bitcoin conference and follow people who attend?