this post was submitted on 19 Jan 2024
255 points (95.4% liked)
Technology
57473 readers
3609 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
While I do work in the space, I'm more pessimistic. I think LLM's will allow the tech companies to breach plateaus that they've found with compositional models, but what we will see is other companies catch up to GPT4, perhaps surpassing it a little.
I won't pretend to be an expert on AI, but my view is that we're purely seeing a future where multiple companies will own LLM's. We also won't see many improvements over what we have now, and this is the pessimist in me again, what I think we'll see is that many of the benefits we saw from GPT4 were likely from the fact that their datasets contained an unbelievable amount of PII and stolen data. Without that data, we've seen ChatGPT get worse, and it's one area where researchers and other tech firms have tried to explain the performance gap.