Seems AI-assisted posting is becoming more rampant, and we should work together to brainstorm some concrete criteria for identification of AI-written posts.
For me, the best indicator if a post is AI-generated is if it is written in flawless English. Even the best posters who are native English speakers don't necessarily write every post using the precision in punctuation, spelling & grammar executed by ChatGPT. If a user's native language isn't English (as can be evidenced by their posting history), and they suddenly start posting in flawless English, it means one of two things:
1. The text is plagiarized, or
2. The text is AI-generated.
Its worth noting that not all plagiarized texts are written with the same mastery of English as ChatGPT. In fact, they seldom are.
The second best indicator is taking an average of separate AI text identification systems; the more, the better. This is the one created by the makers of ChatGPT and is thus probably the best for identifying such text:
https://platform.openai.com/ai-text-classifierHere are 6 other ones.
https://writer.com/ai-content-detector/ (max. 1500 chars)
https://gptzero.me/ (min. 250 chars)
https://contentatscale.ai/ai-content-detector/ (min. 25 words)
https://x.writefull.com/gpt-detector (50-2000 words)
https://hivemoderation.com/ai-generated-content-detection (max. 8192 chars)
https://paraphrasingtool.ai/ai-content-detector/ (max. 4900 chars)
Seems like too much work to run a text through all 7, and some probably use extremely similar methods.
Of course, they are not always accurate, but if the majority of them say "likely" or "over 50% likely", then I'd say its compelling evidence the text is AI generated.
For example,
this post - which I'm almost certain is AI-generated - comes back as "unlikely" to be AI-generated according to OpenAI's Text Classifier, yet it is "99% likely" AI generated according to the Hive Moderation checker.
Here is how you ask ChatGPT to generate such a list:
Prompt:
Can you write me a list of bullet points about Bitcoin, with each one starting with a letter of the alphabet? For example:
"A- All your crypto journey could begin here and set you on the right path if you ask questions and follow up question and threads of your interest
B- Bitcoin should be your first coin of choice when you're mentally ready to enter into the market because it's one of the best coins and generally accepted one.
C- consistency is the easiest if not the only way to achieve everything you desire in everything you do and it's very evident over here in the forum."
etc.
It generated an extremely similar list which comes back as "unclear" according to the OpenAI Text Classifier and "99% likely to contain AI generated text" according to the Hive Moderation site.
The problem is people can now be lazier than ever on the forum and get paid for it, which actually hurts them in the long run. Instead of thinking or learning anything for themselves, they just plug in a prompt, and prompt-plugging is the only actual skill they are gathering. Has nothing to do with Bitcoin, cryptocurrency, the blockchain, etc.
TL;DR - What are the rock-solid criteria for detection & definition of AI-generated text?I suggest we put examples of what are believed to be AI-written posts in this thread to help evaluate them and come up with a refined consensus on how to detect them.