I'm also new and don't know all that much, but from my understanding someone would need your wallet.dat file. I don't think your public wallet address is enough for someone to use it other then adding funds to it.

Hopefully someone with more insight might be able to elaborate on that. It would also help me out. But my guess is that it uses public/private key encryption.