However both diamonds and bitcoin receive their scarcity from being in the hands of relatively few people which purposefully control the market to give them higher value.
Wrong. Bitcoins are scarce (not infinite) because the algorithm to create Bitcoins (generation subsidy) tends toward zero and is published (open source).
Diamonds are not truly scarce, since they can be synthesized at or near the cost of mining them naturally.