Of course when bitcoin first came out, in it's earlier years there were more of the same like minded type of people who kind of got things kicked off, but as it's mass adoption grew, there was of course an inevitability that other types of political minded people would join in. 

I still think that those same libertarians who made up a large part of the bitcoin "crowd" are still around, they just perhaps don't have the same loud voice they had before being that there's so many more people involved now.

Lastly, from what I saw, most of those people who claimed to be libertarians were actually right wing conservatives..so I don't think there were truly as many libertarians as people like to claim.