Viewing it from that perspective can somehow be right. Yes, after you buy Bitcoin through exchanges which requires kyc your identity is actually tied to the ownership of that coin. But after you have used that coin or transferred it to another users, you are actually signing full ownership to a new recipient wallet.
You don't have any reason to worry about how the new owner spends it. If he carries out illegal activities, sure it would only be seen on the Blockchain that you were the previous owner of that coin. But I don't think you would be penalized for that.
It depends on the level of the illegality committed by the receiver because if the receiver's wallet is flagged for money laundering or scam activities of means all connected addresses will also be looked at and investigated, but if the involvement of the address and its overall transactions volume have not exceeded a significant amount that could attract the investigator's attention you may easily be ignored.
But that doesn't mean you are totally avoided or off the radar, you are just overlooked, so you have to watch who you send your coins to and what they use them for unless on the p2p level where the transaction may be off the chain.