Post
Topic
Board Meta
Re: Talksearch.io - Advanced Bitcointalk Search Engine
by
NotATether
on 09/08/2025, 13:09:30 UTC
Sorry I missed your notification somehow.
I tried to find it but it didn't show up. I'm not sure whether I filled the right data!
This was the post: https://bitcointalk.org/index.php?topic=5450546.msg65659774#msg65659774

Your post is also not in the index. Moreover, it is getting more difficult for me to scrape posts. It seems that scraping a very long topic such as this one is causing the scraper to encounter 429 errors. These are not like the temporary 503 "back-off" errors, and they have completely halted the scraper. Additionally, there is no reason for my scraper to be scraping this particular topic from the beginning, since I already have some older part of it. So I think this is a bug in my scraper.

I will try to see if I can get it to resume with proxies/tor becut I am not going to be hammering the forum with concurrent instances anytime soon.