I actually expected that number to be substantially higher.

Sure, there's a number of people within my typical group of friends and associates that knows of Bitcoin...however if I jump down south a bit, I don't expect the folks there to know how many planets are in the solar system, let alone what a growing cryptocurrency is.