Post
Topic
Board Meta
Re: "Show All" on long topics
by
CookieFactory
on 01/10/2019, 22:22:15 UTC
Limitations
I scrape a maximum of 500 pages per topic (sorry Wall Observer).
If it's not too much work, maybe you can do something like http://loyce.club/show/178336.html?last=10 to help people catch up easier with the last couple of pages (it can be useful exactly for WO) without killing your scrapper or the browser?
And another 80 minutes wasted Tongue
How's this:
All posts in the Wall Observer thread in the past 1h, 24h and 7d
All posts in the past 1 hour: WallObserver.tk/1h.html (updated every 3 minutes).
All posts in the past 24 hours: WallObserver.tk (updated every 30 minutes).
All posts in the past 7 days: WallObserver.tk/7d.html (updated every 2 hours).

Domain WallObserver.tk expires a year from now, I'll see by then if anyone uses it.
All times are set to Amsterdam time.

Limitations:
Images still go through Bitcointalk's image proxy, and they don't load when there are too many on one page. In Firefox a fix is to go to the URL-bar a few times, and press Enter. Just "Reload" doesn't help.

This is awesome. I have a "sentiment analysis" bot that currently runs on tweets and subreddits but I'll incorporate this feed as well. Thanks!