I tried to wear Bitcoin clothing way back in 2018 - 2019 together with my friends who know about Bitcoin. I did not notice anyone looking at us with curiosity in mind. Probably during those time, Bitcoin were not deeply propagated among the masses reason why the reaction of people was not the same as yours.
I do not think it brings any threat since such designs is normal especially when it is trending. There are even stalls selling that kind of design, unless a person bragged that he has Bitcoin, I do not think that wearing such a design indicates that the person is holding BTC.
Back in 2018/2019 there already was a certain awareness about bitcoin but probably it was still possible to go unnoticed, at least in the majority of cases. Now things changed a lot, so again, maybe back then it wasn't a big deal, now I would suggest you to reconsider your ideas. As I said before anyway it mainly depends on where you live and the crime level of your country.