An address is a hash of the public key, so when a recipient claims the coins in a future transaction they both provide their public key (which can be hashed to prove it links to the address) and they sign the previous transaction (which can be decrypted with the public key) to prove they're the valid owner of that address.

Does that make sense, and is it correct?