You can try changeNow instant exhange. It's a non custodial exchange that supports purchasing of crypto with fiat and crypto. You don't need to create account so no need for them to hold your funds. You can conveniently buy your favorite crypto with less stress as you were describing. You can purchase up to $20,000 with your bank card in day.