Example:
What you are describing would > 4081ffba8ba8e9aa702ba47c868c86ab
you are describing would only > a4476131d8f6a76d09daabe2c0e12ff5
are describing would only detect > f805a9b6e8756ec0e7e8d9d9b9f6085e
would only detect entire posts that > 3190387c55974545cf2d2045197ee70b
After generating the checksums, only the checksums have to be sorted and searched for duplicates. I've used that before to find matching Bitcoin addresses in very long lists, and it only takes seconds to search through gigabytes of data. The benefit of this method is being able to use very efficient existing sorting algorithms.
You're on the right path just keep in mind that you would still end up with a nearly unmanageable number of n-grams (which is roughly equivalent to the number of words) and even with n=5 you would have an enormous number of false positives using single n-gram matches. So you would likely need to (1) increase the n or (2) match more than one n-gram per post. #1 is obviously counterproductive and doesn't reduce the dataset, and #2 raises the complexity exponentially. However there are some methods that can help with #2... minhash is what I used. It can be tuned to a wide range of accuracy.
Oh, and anything longer than a 32-bit hash is probably going to take too long to compute to be feasible so you'll need to figure out how to deal with collisions.
I guess lauda finally pissed suchmoon off.
Suchmoon releases these bombs on people when they piss him off.
Suchmoon gave it to mozprognoz another scammer who worked with lauda when they said suchmoon was a fat pig.
Anyway we dont care how people sniff through others shit.
1. This is sneaky grafting and deliberate grafting in their copy and paste between their own words
2. Lol at the photographic memory that lauda has no recollection of or control over bullshit excuse
3. Lauda says for others that 2 years sig ban is not enough he wants people perm banned
4. You people showing any empathy for lauda are going to be tagged by nullius for empathy
5. Lauda is a proven scammer
6. Lauda was removed from mod for serious extortion
7. Lauda has been banned many times before and given several chances
8. Lauda uses red tags to punish people that present evidence of his scamming
9. Lauda is trading red tag removals with other scammers so they both have a clean trust sheet
Cats have 9 lives.... looks like they just ran the fuck out
We will welcome back every plagiarist unless you can show me they are more net negative than lauda.
Good luck with that. I'm looking forward to going through every part of laudas history in detail.
The scumbag was pure poison from the moment it joined. Lying and scamming since the start.