Technology

37739 readers

522 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago

MODERATORS

[email protected]

145

AI Slop Is Flooding Medium (www.wired.com)

submitted 3 weeks ago by [email protected] to c/[email protected]

30 comments fedilink hide all child comments

archive.is link

Earlier this year, WIRED asked AI detection startup Pangram Labs to analyze Medium. It took a sampling of 274,466 recent posts over a six week period and estimated that over 47 percent were likely AI-generated. “This is a couple orders of magnitude more than what I see on the rest of the internet,” says Pangram CEO Max Spero. (The company’s analysis of one day of global news sites this summer found 7 percent as likely AI-generated.)

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 37 points 3 weeks ago (2 children)

How well does the "AI detection startup's" product work? This is a big unsolved problem but I'd be hecka skeptical.

[–] [email protected] 17 points 3 weeks ago (1 children)

It doesn’t, and never will

[–] [email protected] 5 points 3 weeks ago (1 children)

That's because of bots like you. (I kid to make a point.)

[–] [email protected] 5 points 3 weeks ago

That's exactly what a bot would say, to stay undetected.

[–] [email protected] 3 points 3 weeks ago (1 children)

That is why I liked the comparison with articles from 2018. Then you have comparable texts in the same format and can more easily figure out differences in your analysis.
If true, a jump from 3% to 40% is significant to say the least.

[–] [email protected] 1 points 3 weeks ago (1 children)

@Black616Angel numbers in the article are 7% for the pre-2018 corpus, and 47% for the post-2018 corpus. That is from less than 1 in 10 to almost 1 in 2, or a coin toss…

[–] [email protected] 1 points 3 weeks ago (1 children)

In 2018, 3.4 percent were estimated as likely AI-generated.

For 2024, with a sampling of 473 articles published this year, it suspected that just over 40 percent were likely AI-generated.

My numbers were from the Originality AI part.

[–] [email protected] 1 points 3 weeks ago

@Black616Angel yes, I’ve realized that and corrected my post while you responded 😉

Maybe the blurb was AI-generated? 🤦🏻‍♂️