this post was submitted on 14 Jul 2024
487 points (96.9% liked)
Technology
59415 readers
2905 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
AI was a promise more than anything. When ChatGPT came out, all the AI companies and startups promised exponential improvements that will chaaangeee the woooooorrlllddd
Two years later it's becoming insanely clear they hit a wall and there isn't going to be much change unless someone makes a miraculous discovery. All of that money was dumped in to just make bigger models that are 0.1% better than the last one. I'm honestly surprised the bubble hasn't popped yet, it's obvious we're going nowhere with this.
@[email protected]
@[email protected] @[email protected]
ai has been doing that trick since the 1950s. There have been a lot of use coming out of ai, but it has never been called ai once successful and never lived up to the early hype. some in the know about all those previous ones were surprised by the hype and not surprised about where it has gone, while others pushed the hype.
The details have changed but nothing else.
Yeah the only innovation here is that OpenAI had the balls to use the entire internet as a training set. The underlying algorithms aren't really new, and the limitations have been understood by data scientists, computer scientists, and mathematicians for a long time.
So now it just has to use every conversation that happens as a data set. They could use microphones from all over the world to listen and learn and understand better....
(Repeating myself due to being banned from my previous instance for offering to solve a problem with nukes)
Bring back Lisp machines. I like what was called AI when they were being made.
You should all see the story about the invention blue LEDs. No one believed that it could work except some japanese guy (Shuji Nakamura) who kept working on it despite his company telling him to stop. No one believed it could ever be solved despite being so close. He solved it and the rewards were astronomical.
This could very well be another case of being so close to a breakthrough. Two years since GPT-3 came out is nothing. If you were paying any sort of attention you would see there are promising papers coming out almost every week. It's clear there is a lot we don't know about training neural nets effectively. Our own brains are the proof of that.
I mean if you ignore all the papers that point out how dubious the gen AI benchmarks are, then it is very impressive.
There is a difference in not knowing how to do a thing and someone coming out doing the thing, and knowing how something works, knowing it's by design limitations, and still hoping it may work out.
mwahahah. The people who are working on LLMs right now are the dumbasses and MBAs of the industry. If we ever get anything like an artificial general AI, it will come from a team of serious researchers / engineers who don't give a shit about marketing.
I don't think they were really trying, it was just an easy way to get funds no?
There are millions of people devoting huge amounts of time and energy into improving AI capabilities, publishing paper after paper finding new ways to improve models, training, etc. Perhaps some companies are using AI hype to get free money but that doesn’t discredit the hard work of others.
millions of students who bought into the marketing bullshit, you mean.
Can't believe you get downvoted for saying that. No worries though as the haters will all be proven wrong eventually.