Cryptocurrencies are stored on the blockchain. Just like banks have account name & number, cryptocurrencies have addresses to their wallets on the blockchain. Each wallet has a public address and a private address. Public address is where you can receive token/altcoin at, while the private address is the key to access your wallet or to send token/altcoin.