Post
Topic
Board Meta
Re: Archive of forum pages
by
Quickseller
on 21/11/2021, 00:08:20 UTC
you can write a script to scrape the person's post history and save it somewhere
My one-liner:
Code:
userID=2627711; pages=430; mkdir $userID; echo "Downloading $pages post history pages for user $userID"; i=1; while [ $i -le $pages ]; do wget -qO $userID/$i.html "https://bitcointalk.org/index.php?action=profile;u=$userID;sa=showPosts;start=$((i*20-20))"; echo -n "."; sleep 1; ((i++)); done # Add browser cookie to include Investigations
If the OP's goal is to save the person's post history, my guess is he probably wants to be able to quickly find a particular post, or particular content. Your script might be good if the OP believes someone is about to edit their post history so he can quickly save it, however at one point, the post history will need to be processed and stored in a more searchable format.