Biggest challenge relies on exchanges themselves. They have to propose such technology to let crypto traders act as fast as usual HFT traders do.
That's correct. Classic stock exchanges have hundreds of times more power (> 10m orders per second), compared to "web exchanges"(< 100k orders per second) which are sometimes done entirely on PHP and API works only on websockets.