You can buy bitcoin with cash using Peach Bitcoin app and you don't need to perform any verification with some daily limitations.
Other alternatives are Bisq exchange, Robosats and Agoradesk, so you can try to find what is best for your location.
There are other services that accept credit cards but you could be asked to perform kyc there for trading.