I've been thinking about expanding my archived posts to
all posts that haven't been deleted yet. It would be useful for
a case like this. It requires scraping a couple million pages, and storing 50+ million posts. I can limit the number of files on the server by storing 10 or 100 posts per page. Would this be useful?