The "public key" and "private key" are proper cryptographical names.

However, addresses are often confused with public keys. An address is actually a hash of the public key, normally Base58-encoded.