1044
Why is no one talking about how unproductive it is to have verify every "hallucination" ChatGPT gives you?
(lemmy.world)
this post was submitted on 19 Nov 2024
1044 points (97.8% liked)
People Twitter
5264 readers
1617 users here now
People tweeting stuff. We allow tweets from anyone.
RULES:
- Mark NSFW content.
- No doxxing people.
- Must be a tweet or similar
- No bullying or international politcs
- Be excellent to each other.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I just tried out Gemini.
I asked it several questions in the form of 'are there any things of category x which also are in category y?' type questions.
It would often confidently reply 'No, here's a summary of things that meet all your conditions to fall into category x, but sadly none also fall into category y'.
Then I would reply, 'wait, you don't know about thing gamma, which does fall into both x and y?'
To which it would reply 'Wow, you're right! It turns out gamma does fall into x and y' and then give a bit of a description of how/why that is the case.
After that, I would say '... so you... lied to me. ok. well anyway, please further describe thing gamma that you previously said you did not know about, but now say that you do know about.'
And that is where it gets ... fun?
It always starts with an apology template.
Then, if its some kind of topic that has almost certainly been manually dissuaded from talking about, it then lies again and says 'actually, I do not know about thing gamma, even though I just told you I did'.
If it is not a topic that it has been manually dissuaded from talking about, it does the apology template and then also further summarizes thing gamma.
...
I asked it 'do you write code?' and it gave a moderately lengthy explanation of how it is comprised of code, but does not write its own code.
Cool, not really what I asked. Then command 'write an implementation of bogo sort in python 3.'
... and then it does that.
...
Awesome. Hooray. Billions and billions of dollars for a shitty way to reform web search results into a coversational form, which is very often confidently wrong and misleading.
copilot did the same with basic math. just to test it I said "let's say I have a 10x6 rectangle. what number would I have to divide width and height by, in order to end up with a rectangle that's half the area?"
it said "in order to make it half, you should divide them by 2. so [pointlessly lengthy steps explaining the divisions]"
I said "but that would make the area 5x3 = 15 units which is not half the area of 60"
it said "you're right! in order to ... [fixing the answer to √2 using approximation"
I don't know if I said it then, or after some other fucking nonsense but when I said "you're useless" it had the fucking audacity to take offense and end the conversation!
like fuck off, you don't get to have fake pride if you don't have basic fake intelligence but use it in your description.
Its a perfect encapsulation of the corpo mindset:
Whatever I do is profound, meaningful, with endless possibilities for future greatness...
... even though I'm just talking out of my ass 99% of the time...
... and if you have the audacity, the nerve, to have a completely normal reaction when you determine that that is what I am doing, pshaw, how uncouth, I won't stand for your abuse!
...
They've done it. They've made a talking (not thinking) machine in their own image.
And it was not good.