4 USD per token approx seems to be bit expensive, but There is no difference if you have 10M tokens priced at 5 USD or 100M tokens priced at 0.5 USD.
Project has great potential in terms of market cap, the price of a token does not matter, as I expect market capitalization will soar in future
The only aspect it matters is the psychological aspect. For some reason people think there is a higher chance that a token worth 1 cent will be worth 1 dollar some day, than a token worth 1 dollar will be worth 100 dollar. But as you said, this is complete nonsense if you don't consider the market cap. The market cap is the only thing that actually matters. The price of the token itself ,without taking into account the token supply, does not say much.