Wikipedia Editors Adopt ‘Speedy Deletion’ Policy for AI Slop Articles | 404 Media

submitted by

www.404media.co/wikipedia-editors-adopt-speedy-…

7
154
1

Log in to comment

Hot Top New Old
OP

I think the how is the most interesting part here.

The solution Wikipedians came up with is to allow the speedy deletion of clearly AI-generated articles that broadly meet two conditions. The first is if the article includes “communication intended for the user.” This refers to language in the article that is clearly an LLM responding to a user prompt, like "Here is your Wikipedia article on…,” “Up to my last training update …,” and "as a large language model.” This is a clear tell that the article was generated by an LLM, and a method we’ve previously used to identify AI-generated social media posts and scientific papers.

The other condition that would make an AI-generated article eligible for speedy deletion is if its citations are clearly wrong, another type of error LLMs are prone to. This can include both the inclusion of external links for books, articles, or scientific papers that don’t exist and don’t resolve, or links that lead to completely unrelated content. Wikipedia's new policy gives the example of “a paper on a beetle species being cited for a computer science article.”

 reply
57
edited

Sounds fair. Only issue might be... that creating an automated cleanup tool to remove those triggers, wouldn't be all that difficult.

 reply
7

Speedy deletion is for deletions that require zero discussion, so it needs to be very simple and clear. For less sloppy genai there may need to be a discussion (unless it falls under different speedy deletion criteria.

Sometimes those discussions are very straightforward, but they allow for dissenting voices. But for "almost obvious" cases not a lot of effort is spent on them.

 reply
18

Of course. I also hope this will stop like 99% of the skiddie spam. I'm just afraid that, like it has happened with hacking in general, a noob installing Kali will get a ton of one-click ways to bypass these measures... and then, what's next?

Genai inserting watermarking would be great, but that's hard to do with text, in any way that isn't easily removed.

 reply
4

I don't understand why ppl do this. Is this malicious? Do they think they are somehow helping?

 reply
12
edited

I saw a similar story about how an open source software project (I think it was curl) have cancelled their bug bounty programme because it's being overrun with LLM-generated reports and they don't have enough volunteers to verify them all. The relevant bit is that while many were doing it for the financial reward, some do it for reputation and some genuinely do think they're helping by adding info they think is missing but not realising that what they're posting is unreliable.

 reply
14

Comments in Technology@lemmy.zip

How does Wikipedia continue to be such a bastion of awesome in an increasingly shitty internet? Keep on, good folks!

 reply
42
edited

This reminds me of when Quora automatically deleted questions containing spam (instead of reverting the spammy edits for some reason), so some political actors used it to provoke the deletion of thousands of years-old inconvenient questions (with all answers) by editing the questions into something that triggered the spam deletion bot. Quora never restored the questions and answers. They did ban the editing of anything, so now the site is full of bad grammar and typos, redundant topics, and wrongly bot-tagged questions.

 reply
14

I haven't looked into it yet, but my guess is that this is only for new articles, but existing ones defaced by AI can just be reverted.

 reply
2
Insert image