Yeah, the struggle is real.
There already is a tool to simplify this task: scrape a 1000+ Bitcointalk [ANN] thread into a single highly readable HTML document for better reading and analysis. source

And i am working on a fork of this tool to improve it