this post was submitted on 15 Jul 2024
72 points (77.7% liked)

Technology

57435 readers
3629 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 135 points 1 month ago* (last edited 1 month ago) (9 children)

I am increasingly starting to believe that all these rumors and "hush hush" PR initiatives about "reasoning AI" is an attempt to keep the hype going (and VC investments) till the vesting period for their stock closes out.

I wouldn't be surprised if all these "AI" companies have come to a point where they're basically at the limits of LLM capabilities (due to problems with its fundamental architecture) while not being able to solve its core drawbacks (hallucinations, ridiculously high capex and opex cost).

[–] [email protected] 44 points 1 month ago (2 children)

Yea this. It's a weird time though. All of it is hype and marketing hoping to cover costs by searching for some unseen product down the line ... even the original chatGPT feels like a basic marketing stunt: "If people can chat with it they'll think it's miraculous however useful it actually is".

OTOH, it's easy to forget that genuine progress has happened with this rush of AI that surprised many. Literally the year before AlphaGo beat the world champion no one thought it was going to happen any time soon. And though I haven't checked in, from what I could tell, the progress on protein folding done by DeepMind was real (however hyped it was also). Whether new things are still coming or not I don't know, but it seems more than possible. But of course, it doesn't mean there isn't a big pile of hype that will blow away in the wind.

What I ultimately find disappointing is the way the mainstream has responded to all of this.

  1. The lack of conversation about what we want this to look like in the end. There's way too much of a passive "lets see where the technology and big-corp capitalism take us and hope it doesn't lead to some sort of apocalypse"
  2. The very seamless and reflexive acceptance that an AI chat interface could be an all knowing authority for everything in life ... was somewhat shocking to me. Obviously decades of "Googling" to get the answers to things has laid the groundwork for that, but still, there was IMO an unseemly acceptance of a pretty troubling future that indicated just how easily some dark timeline could arise.
[–] [email protected] 25 points 1 month ago* (last edited 1 month ago) (2 children)

Progress is definitely happening. One area that I am somewhat knowledgeable about is image/video upscaling. Neural net enhanced upscaling has been around for a while, but we are increasingly getting to a point where SD (DVD source, older videos from the 90s/2000s) to HD upscaling is working almost like in the science fiction movies. There are still issues of course, but the results are drastically better than simply scaling the source media by x2.

The framing of LLMs as some sort of techno-utopian "AI oracle" is indeed a damning reflection of our society. Although I think this topic is outside the scope of current "AI" discussions and would likely involve a fundamental reform of our broader social, economic, political and educational models.

Even the term "AI" (and its framing) is extremely misleading. There is no "artificial intelligence" involved in a LLM.

[–] [email protected] 8 points 1 month ago

Sure but that's specialist models.

Generalist models are stagnant and show little potential for progress.

[–] [email protected] 7 points 1 month ago

One area that I am somewhat knowledgeable about is image/video upscaling

Oh I believe you. I've seen it done on a home machine on old time-lapse photos. It might have been janky for individual photos, but as frames in a movie it easily elevated the footage.

load more comments (6 replies)