Next scheduled rescrape ... never
Version 2
Last scraped
Edited on 03/04/2025, 06:49:39 UTC
Big update!

I've added post edited versions.

Now every new post will be scraped at least three times: first when posted, then after 5 minutes, and a third time after 30 minutes. I also added the possibility to rescrape a post when needed, and a "rescrape now" button is planned real soon (it's 3 am, so enough for today). I'm still thinking, but I might add more scheduled rescrapes for all posts (i.e rescrape every post *again* after 7 days).

- Every post now has a list of changes (new content, new title, deleted). A diff will be shown with added text shown as green and removed text shown as red.
- When searching posts, posts that were deleted or have been edited will be indicated on the results (click to open versions tab).

Soon you'll also be able to include the content of the all post versions on your searches. This means finding posts with words that were only included on a later edit!

Also made countless smaller improvements everywhere.

Feedback is appreciated!

Quote
List of changes



Quote
Edit/deleted indicator

Version 1
Scraped on 03/04/2025, 06:24:39 UTC
Big update!

I've added post edited versions.

Now every new post will be scraped at least three times: first when posted, then after 5 minutes, and a third time after 30 minutes. I also added the possibility to rescrape a post when needed, and a "rescrape now" button is planned real soon (it's 3 am, so enough for today). I'm still thinking, but I might add more scheduled rescrapes for all posts (i.e rescrape every post *again* after 7 days).

- Every post now has a list of changes (new content, new title, deleted). A diff will be shown with added text shown as green and removed text shown as red.
- When searching posts, posts that were deleted or have been edited will be indicated on the results (click to open versions tab).

Soon you'll also be able to include the content of the all post versions on your searches. This means finding posts with words that were only included on a later edit!

Also made countless smaller improvements everywhere.

Quote
List of changes

[REMOVED IMAGE]


Quote
Edit/deleted indicator

Original archived Re: [BETA] [NEW] beta.ninjastic.space (forum search, archive and data visualization)
Scraped on 03/04/2025, 06:19:20 UTC
Big update!

I've added post edited versions.

Now every new post will be scraped at least three times: first when posted, then after 5 minutes, and a third time after 30 minutes. I also added the possibility to rescrape a post when needed, and a "rescrape now" button is planned real soon (it's 3 am, so enough for today).

- Every post now has a list of changes (new content, new title, deleted). A diff will be shown with added text shown as green and removed text shown as red.
- When searching posts, posts that were deleted or have been edited will be indicated on the results (click to open versions tab).

Soon you'll also be able to include the content of the all post versions on your searches. This means finding posts with words that were only included on a later edit!

Quote
List of changes



Quote
Edit/deleted indicator