In the beginning that was the only option. Direct peer-to-peer transactions are what bitcoin is all about. You never need a bank, an exchange, or any third party. They only exist because sometimes it makes more sense. For example exchanges facilitate easy transactions by connecting buyers and sellers, banks have vaults for holding you private keys. But no one is needed.