In principle, you are right. From that perspective, Bitcoin is not much different than rock except that, unlike rocks, the supply is limited to 21 million.
Let me know if you come across some rocks with a very limited supply. Oh wait, we already have rocks that fit that description; they're called diamonds! So how about we start comparing Bitcoin to diamonds?