The point is that you do not encrypt anything with public key cryptography in bitcoin, just for signing only. When you send bitcoins, you sign a transaction that says which public key (address) can send these coins in the future, this transaction then validated by the entire network and the miner adds it into the block.