this post was submitted on 20 Feb 2024
155 points (91.0% liked)

Technology

60102 readers
2781 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] [email protected] 134 points 10 months ago (4 children)

Jesus Christ, can we leave things alone that aren't infinitely growing

[–] [email protected] 76 points 10 months ago (3 children)

"Gentlemen, it's come to our attention that every one who could pay to use our product is paying to use our product. Unfortunately, it also means we're no longer growing infinitely like we promised the shareholders we would. How do we fix this?"

The infinite growth mindset is so fucking stupid. Like, you're still making an insane amount of money, what's the fucking problem?

[–] [email protected] 24 points 10 months ago (1 children)

Yup. Shareholders are the problem, who bought shares at price X and want to sell those shares at X+Y.

And they will do anything to get it.

[–] [email protected] 4 points 10 months ago* (last edited 10 months ago)

Yes but what they stupidly never realize is Y is a signed integer not unsigned

[–] [email protected] 17 points 10 months ago* (last edited 10 months ago) (1 children)

Because stock bros be lazy AF. They can't even be bothered to buy and sell stock based off of who is and isn't doing well, so they utilize investment firms who offer safe and risky bets like ETFs and Futures respectively. Ultimately, everyone really just wants to buy one stock, have it make them money that exponentially makes even more money quarter after quarter forever, and then do whatever they'd actually do if money were no object (i.e. actually live life).

We don't live in a world where desire/need scales evenly with this desire for exponential, eternal growth. Therefore capitalists, who promise this impossible prospect to Wall Street, exploit human fears, desires, and needs however they can (union busting, lobbying, etc.) to keep growth up for as long as they can.

George Carlin probably put this concept best in what has to be one of the greatest bits of all time, on The Big Club. Although not directly related to this topic per se, it points to the truth of how this game between government politicians and capitalist corporate overlords is played. All the while, the majority of people, who are not in "The Big Club", are basically fucked.

[–] rottingleaf 6 points 10 months ago

Still I'm feeling tickles of admiration with nature seeing how these two seemingly unconnected things work together (human dream of making something from nothing without work, politicians being corrupt without realizing it).

[–] [email protected] 4 points 10 months ago* (last edited 10 months ago)

Business people really are just monkeys chasing shiny things. They tend to be less developed emotionally and are often very insecure on top of the entitlement. All they have is the chase, nothing else.

The most useless degree a university can grant is one in business administration.

[–] [email protected] 17 points 10 months ago (1 children)

No. Money has to make money with those sweet sweet interested payments. It's baked in the system. How else are you going to maintain a small elite of filthy rich people?

[–] [email protected] 2 points 10 months ago* (last edited 10 months ago)

Ever more wealth must be constantly created in the World purelly to service the interest on all that debt out there otherwise you would get defaults and banks failing.

It's not by chance that everywhere the "solution" for the 2008 Crash (that happenned due to over-indebtness mainly in the mortgage segment) was to lower interest rates to pretty much zero - it weakens the pressure on the entire system to constantly grow merelly to generate the additional wealth needed to pay the interest on the debt.

You'll also notice that as soon as interest rates went up just a bit bank profits mssivelly grew.

[–] [email protected] 6 points 10 months ago
[–] rottingleaf 3 points 10 months ago

Well, there are demands unsatisfied as long as humanity exists, so there is always space for good growth.

Only that is about infrastructure, or housing, or food production. Not chat bots.

[–] [email protected] 52 points 10 months ago (2 children)

It writes my most boring emails so that I can save a scrap of mental energy for parenting properly after work. Even though my WPM ranges between 70-90 with >98% accuracy, I would rather save some of that mental energy to respond more thoughtfully as a dad.

Of note, I do not give one cold shit about GPT's "growth". It's a linguistic power tool that needs to be carefully handled if you use it for any valuable work.

[–] [email protected] 10 points 10 months ago (2 children)

Of note, I do not give one cold shit about GPT's "growth"

I mean, if you like the platform, it's growth is tied to its continued existence and free usability. Still in the honeymoon phase as long as it's growing.

[–] [email protected] 21 points 10 months ago (2 children)

Why is growth tied to continued existence?

[–] [email protected] 42 points 10 months ago (1 children)

Because companies insist on it and when growth stops they'll start to cannibalize their own company and charge more money for things that used to be free or fairly-priced until they price themselves out of the market entirely and die as a service.

Yay, capitalism!

load more comments (1 replies)
[–] [email protected] 29 points 10 months ago (1 children)

Capitalism demands that number must go up.

load more comments (1 replies)
[–] [email protected] 8 points 10 months ago (1 children)

They will start charging and or plaster it full of ads ive already sidestepped that with an api key and a foss frontent.

[–] [email protected] 6 points 10 months ago

Before I respond to your question, first a message from our sponsor LMNT: Did you know that you're about to die of dehydration? Our product stops that!

load more comments (1 replies)
[–] [email protected] 27 points 10 months ago* (last edited 10 months ago) (3 children)

This was inevitable, not sure why it's newsworthy. ChatGPT blew up because it brought LLM tech to the masses in an easily accessible way and was novel at the mainstream level.

The majority of people don't have a use for chat bots day-to-day, especially one that's as censored and outdated as ChatGPT (its dataset is from over 2 years ago). Casual users would want it for simple stuff like quickly summarizing current events or even as a Google search-like repository of info. Can't use it for that when even seemingly innocuous queries/prompts are met with ChatGPT scolding you for being offensive, or that its dataset is old and not current. Sure, it was fun to have it make your grocery lists and workout plans, but that novelty eventually wears off as it's not very practical all the time.

I think LLMs in the form of ChatGPT will truly become ubiquitous when they can train in real time on up-to-date data. And since that's very unlikely to happen in the near future, I think OpenAI has quite a bit of progress left to make before their next breakout moment comes again. Although, Sora did wow the mainstream (anyone in the AI scene has been well aware of AI generated video for awhile now), OpenAI has already said they're not making that publicly available for now (which is a good thing for obvious reasons unless strict safety measures are implemented).

[–] [email protected] 13 points 10 months ago (3 children)

I'm genuinely surprised anytime I get anything remotely useful from any of the AI chatbots out there. About half the responses are beyond basic-level shit that I could've written on my own or just found by Googling it, or it'll give just plain wrong information. It's almost useless with important, fact-based information if you can't trust any of its responses, so the only thing it's good for is brainstorming creative ideas or porn, and the majority of them out there won't touch anything even mildly titillating, so you're just left with this overly sensitive chatbot that takes about as much work to craft a good prompt as it would to just write the answer out yourself.

I tried playing a game of 20 Questions with one of them (my word was "donkey", it was way off and even cheated a bit) and it kind of scolded me at the end because I told it the thing wasn't bigger than a house, as if I was the one who got that fact wrong.

load more comments (3 replies)
[–] [email protected] 11 points 10 months ago

The P in GPT is Pretrained. Its core to the architecture design. You would need to use some other ANN design if you wanted it to continuously update, and there is a reason we don't use those at scale atm, they scale much worse than pretrained transformers.

[–] [email protected] 3 points 10 months ago (1 children)

It's not exactly training, but Google just recently previewed a LLM with a million-token context that can do effectively the same thing. One of the tests they did was to put a dictionary for a very obscure language (only 200 speakers worldwide) into the context, knowing that nothing about that language was in its original training data, and the LLM was able to translate it fluently.

OpenAI has already said they’re not making that publicly available for now

This just means that OpenAI is voluntarily ceding the field to more ambitious companies.

[–] [email protected] 6 points 10 months ago (2 children)

Gemini is definitely poised to bury ChatGPT if its real world performance lives up to the curated examples they've demostrated thus far. As much as I dislike that it's Google, I am still interested to try it out.

This just means that OpenAI is voluntarily ceding the field to more ambitious companies.

Possibly. While text to video has been experimented with for the last year by lots of hobbyists and other teams, the end results have been mostly underwhelming. Sora's examples were pretty damn impressive, but I'll hold judgment until I get to see more examples from common users vs cherry-picked demos. If it's capable of delivering that level of quality consistently, I don't see another model catching up for another year or so.

load more comments (2 replies)
[–] [email protected] 26 points 10 months ago (1 children)

GPT tried to convince me that there was more time in 366 days than 1.78 years.

[–] [email protected] 16 points 10 months ago (2 children)

Large language models are notoriously poor at math, you should probably use a different tool for that sort of thing.

[–] [email protected] 10 points 10 months ago

glorified autocorrect bad at math. who could have guessed

[–] [email protected] 6 points 10 months ago (3 children)

How do reconcile that with all of the people claiming they use it to write code?

[–] [email protected] 9 points 10 months ago

Writing code to do math is different from actually doing the math. I can easily write "x = 8982.2 / 98984", but ask me what value x actually has and I'll need to do a lot more work and quite probably get it wrong.

This is why one of the common improvements for LLM execution frameworks these days is to give them access to external tools. Essentially, give it access to a calculator.

load more comments (1 replies)
[–] [email protected] 21 points 10 months ago (1 children)

Jesus Christ it's not all about growth.

[–] [email protected] 11 points 10 months ago

Line must go up

[–] [email protected] 20 points 10 months ago (1 children)

hopefully it dies a quick but very painful death

load more comments (1 replies)
[–] [email protected] 13 points 10 months ago

hopefully it shrinks :)

[–] [email protected] 11 points 10 months ago

This was always going to be limited. Eventually, it doesn't matter how much data you dump in, it won't be unique enough to train anything new out of the model.

[–] [email protected] 10 points 10 months ago

I hope it goes away

[–] [email protected] 9 points 10 months ago* (last edited 10 months ago) (1 children)

I somehow think its usefulness isn’t tied to consumers logging in and just using it. Eventually, this thing will be bundled into a personal assistant like Siri or Alexa and that will be how most people use it.

Additionally, businesses are going to try to use it in a lot of different ways… replacing phone and chat support, writing ad copy, articles, code, legal documents, etc, etc, etc. It still feels a bit early for companies to have adopted it. I imagine it will just take a lot of work integrating it. ChatGPT also needs to be able to DO things, and wiring that all up is some work. For example, if I call a company for support with a product and ask for a refund, the AI needs to have access to the company’s systems to be able to do that task. It also has to do it reliably and correctly all the time.

It’s still really early days.

[–] [email protected] 5 points 10 months ago

Microsoft has a library that does exactly what you describe - Semantic Kernel. You can register plugins that do all sorts of things in the real world, and the AI API responds with instructions on how to use these plugins.

I'm very sceptical of LLMs, but this is the closest this technology came to actually being useful.

[–] [email protected] 8 points 10 months ago* (last edited 10 months ago) (1 children)

Given they quietly walked back their stance on military projects during the altman drama my guess would be MI related contracts.

[–] [email protected] 5 points 10 months ago (1 children)

What does your mother-in-law have to do with AI?

load more comments (1 replies)
[–] [email protected] 7 points 10 months ago* (last edited 10 months ago)

This article will be aged junk in 3,2 …

I get that the article is about user count but that really is about perceived usefulnesses and also more decent ai competitors to chatgpt pro.

They literally only just released text to video which they say will be used as a foundation for agi reasoning.

They have also hinted that training on gpt5 has begun and that it will be faster to train then gpt4

Just before that google came out with a new model that can keep track off 10 mil tokens, beats gemini pro and is also much faster to train. Gemini pro is barely a month old

This will not be a quite year for ai, if theres any flatline its going go be vertical, googles progress nearly is. Most ai progress benefits the entire industry over time.

[–] [email protected] 6 points 10 months ago (1 children)

Obviously you're not evolved enough to realize th AI is THE FUTURE of all things and everything is better with AI! A child in a poor environment was saved by AI! A king who was mean was dethroned with AI! Everyone was made happy by AI! Say it! SAY IT!!!

[–] [email protected] 3 points 10 months ago (1 children)
[–] [email protected] 5 points 10 months ago

Allen Iverson.

[–] [email protected] 6 points 10 months ago

That's what the 7 TRILLION dollars they are seeking are for.

[–] [email protected] 4 points 10 months ago (8 children)

Was this article written by an ai?

load more comments (8 replies)
[–] [email protected] 3 points 10 months ago (1 children)

The free version sucks and the paid version increasingly refuses to do things for 'safety' and they have competitors finally catching up.

So where it goes is GPT-5 this year.

[–] [email protected] 3 points 10 months ago (1 children)

It pisses me off when I ask it to do something specific and it comes back with some verbose response about all the things I should think about or look into if I were to want to do that thing. Like, bitch, I’m not asking for advice, do it.

load more comments (1 replies)
load more comments
view more: next ›