Not always, there are mobile wallets, desktop wallets and also cold storage hardware wallets as well. Boy there were paper wallets before as well. So you can pretty much proceed it from various places, but the point is how safe and secure these origins are. One thing for sure never keep your entire holdings on exchanges, you will pretty much regret it.