Technology

59587 readers

2584 users here now

This is a most excellent place for technology news and articles.

Our Rules

Follow the lemmy.world rules.
Only tech related content.
Be excellent to each another!
Mod approved content bots can post up to 10 articles per day.
Threads asking for personal tech support may be deleted.
Politics threads may be removed.
No memes allowed as posts, OK to post as comments.
Only approved bots from the list below, to ask if your bot can be added please contact us.
Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago

MODERATORS

[email protected]

277

The world's most-powerful AI model suddenly got 'lazier' and 'dumber.' A radical redesign of OpenAI's GPT-4 could be behind the decline in performance. (www.businessinsider.com)

submitted 1 year ago by [email protected] to c/[email protected]

89 comments fedilink hide all child comments

Users of OpenAI's GPT-4 are complaining that the AI model is performing worse lately. Industry insiders say a redesign of GPT-4 could be to blame.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 86 points 1 year ago* (last edited 1 year ago) (16 children)

The model has become inbred because it’s now impossible to scrape the web without AI content getting ingested, which is full of “hallucinations” and other weird artifacts. The last opportunity to get “uncontaminated” training data was sometime in mid 2022.

Not to say that it’s causing this particular problem, but this issue will emerge eventually. Garbage in = garbage out. Eventually GPT-19 will grow a mighty Habsburg chin.

[–] [email protected] 21 points 1 year ago* (last edited 1 year ago) (5 children)

Maybe not yet, but...

Spez will turn Reddit into a bot farm and sell this as training data
Musk turns Twitter into a bigoted cesspool and will sell this as training data, which will subsequently be flagged for low quality (also: a botfarm)
Threads is a corporate ad dashboard (and we already know how easy it is to GPT copy) and Zuck will sell this as training data
Facebook is either dead or only good for boomers and Poles
blogs are dead
Fediverse is out there waiting to be scraped but possibly too small to sustain a big model

We'te getting there, hopefully.

[–] [email protected] 3 points 1 year ago (1 children)

..is Facebook popular with Polish people? Or was this a weird polish joke I don't get?

[–] [email protected] 1 points 1 year ago

Very. Twitter never took off among general population (only politicians, journalists, botfarms and people who troll politicians and journalists), tiktok is for kids, Instagram is popular but again, rather among influencers and people who need to show off pictures not as a default SM app. I don't really know where did Americans and west Europeans move from Facebook.

load more comments (3 replies)

load more comments (13 replies)