this post was submitted on 28 Aug 2024
6 points (71.4% liked)

AI

4116 readers
10 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago
6
How reliable are modern LLMs? (lemmy.today)
submitted 2 months ago by [email protected] to c/[email protected]
21 comments fedilink hide all child comments
 

I wanted to extract some crime statistics broken by the type of crime and different populations, all of course normalized by the population size. I got a nice set of tables summarizing the data for each year that I requested.

When I shared these summaries I was told this is entirely unreliable due to hallucinations. So my question to you is how common of a problem this is?

I compared results from Chat GPT-4, Copilot and Grok and the results are the same (Gemini says the data is unavailable, btw :)

So is are LLMs reliable for research like that?

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 9 points 2 months ago (1 children)

Treat it like an eager impressionable intern with a confident stride.

[–] [email protected] 4 points 2 months ago (1 children)

Who is also 15 yrs old and has brain damage

[–] [email protected] 2 points 2 months ago

Proof that you can do anything if somebody piles billions of money on you.