Buy the bitcoins from coinbase and then store them on proper wallet like others said above so you're the one in control of your own money.
Is there any way to get around the 4% fee? I would preferably like to use paypal or a prepaid credit card. I'm not quite sure about giving my actual credit card to them. I thought that was the whole appeal of Bitcoin was the anonymity.