You can not eliminate the middle man in businesses, especially in this digital age, be it fiat or cryptocurrencies, because they have come to stay. Big exchanges like Binance, are cashing in on being the middle man in businesses, an unavoidable indirect business associates, in your face, waiting for you to go through them.
Unfortunately being a third-party company in a decentralized technology has become a very lucrative business, Satoshi envisioned an environment without the middleman man but the lack of trust between the two parties gives power to the middleman, the third-party system has been with us since time immemorial and unfortunately, it integrates in a decentralized exchange because of the lack of trust.
Honestly, I have more numbers of trades using a middleman than using a peer-to-peer I'm sure all of us here third parties will always be with us, we are so used to it, It applies in many industries it applies in Cryptocurrency.