The public key is to receive funds like your bank account number. The private key is like the password to your funds. To spend it you have to import your private key in a bitcoin wallet. So if you want to spend the coins importing the private key is not a huge mistake it is the only way to do it.