Post
Topic
Board Meta
Merits 1 from 1 user
Re: Post history
by
suchmoon
on 02/11/2022, 23:35:00 UTC
⭐ Merited by JollyGood (1)
For example, I would think at quickest a cron job would run every minute which means if a post was made and deleted after a scrape already took place but before the next scrape was due (within 59 seconds), it will not be archived.

You wouldn't start a new cronjob for every scrape, and even if you did - there are ways to start them more often than once a minute (e.g. multiple jobs with different sleep intervals at the beginning). Anyway, the point is that scrapers can catch new posts within seconds.