this post was submitted on 10 Jul 2023
211 points (100.0% liked)

Technology

37757 readers
679 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 12 points 1 year ago (1 children)

But when the answers aren't original thoughts but regurgitations of other peoples' thoughts about the book, then it's plagiarism. LLMs can't provide original output, only variations on what people have made available (whether legally or not). The answer might not even be correct or make any sense. It's just predictive text to a crazy degree.

When you copy someone's work without attribution, that's plagiarism. When your output is only possible because of someone else's work over which they own copyright and the output replicated the copyrighted material, that's copyright infringement.

[–] [email protected] 1 points 1 year ago (1 children)

LLMs can provide original output, but they can also make errors. You'd have to prove it meets the grounds for plagiarism, and to my knowledge no one's been able to. It's all been claims with no substance or merit so far.

[–] [email protected] 14 points 1 year ago (1 children)

An LLM can't make something original, it can only make something derivative. But that derivative work isn't the same as when a human makes a derivative work because a human isn't writing each word or phrase based on the likely "correct" next word or phrase through an algorithmic process. What humans do is magnitudes more complex, though it can at times also be accidental or intentional plagiarism.

In short, an LLM's output is necessarily a string of preexisting human inputs. A human's output, while it can be informed by and reference other human inputs, can be an original analysis. The AI that is publicly available is not sophisticated enough to be more than fancy predictive text.

[–] [email protected] 5 points 1 year ago (1 children)

You're making a hasty generalization here, namely by making sweeping claims without evidence or examples. Also, you're begging the question by assuming that humans are more original than LLMs, again without providing any support or justification.

Take for example this study that found doctors prefered Med-paLM's output to human doctor's. If Everything is a remix, there's no reason LLMs can't meet the minimum criteria for creativity, especially absent any evidence to the contrary.

[–] [email protected] 12 points 1 year ago

You're making a hasty generalization here

I'm really not, though I'll readily admit I'm simplifying things. An LLM can only create something it's been given. I guess it can generate a string of characters and assign a definition to it, but it's not really intentional creation. There are many similarities between how a human generates something and how an LLM does, but to argue they're the same radically oversimplifies how humans work. While we can program an LLM, we literally do not have the capability to replicate a human brain.

For example, can you tell me what emotions the LLM had when it produced the output it did? Did its physical condition have any effect? What about its past, not just what it has learned but how it was treated? What is its motivation? A human response to anything involving creativity factors in many things that we aren't even consciously aware of, and these are things an LLM doesn't have.

The study you're citing is from Google, there's likely some bias and selective reporting. That said, we were talking about creativity, not regurgitating facts or analyzing data. I think it's universally accepted that as the tech gets better, it's preferable to have a computer make the first attempt at a diagnosis, especially for a scan or large data analysis, then have a human confirm.

For the remix example, don't forget that samples get attribution. Artists credit what they sampled and get called out when they don't. I'm actually unclear as to whether an LLM actually can cite to how it derived its output just because the coders haven't revealed if there's some sort of derivation log.