this post was submitted on 18 Aug 2023
239 points (96.5% liked)

Technology

57455 readers
5064 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

An Iowa school district is using ChatGPT to decide which books to ban. Official: "It is simply not feasible to read every book" for depictions of sex.::Official: "It is simply not feasible to read every book" for depictions of sex.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 16 points 1 year ago (2 children)

This is the best summary I could come up with:


The new law behind the ban, signed by Governor Kim Reynolds, is part of a wave of educational reforms that Republican lawmakers believe are necessary to protect students from exposure to damaging and obscene materials.

Specifically, Senate File 496 mandates that every book available to students in school libraries be “age appropriate” and devoid of any “descriptions or visual depictions of a sex act,” per Iowa Code 702.17.

"It is simply not feasible to read every book and filter for these new requirements," said Bridgette Exman, the assistant superintendent of the school district, in a statement quoted by The Gazette.

In the wake of ChatGPT's release, it has been increasingly common to see the AI assistant stretched beyond its capabilities—and to read about its inaccurate outputs being accepted by humans due to automation bias, which is the tendency to place undue trust in machine decision-making.

"This is the perfect example of a prompt to ChatGPT which is almost certain to produce convincing but utterly unreliable results," Simon Willison, an AI researcher who often writes about large language models, told Ars.

"There's something ironic about people in charge of education not knowing enough to critically determine which books are good or bad to include in curriculum, only to outsource the decision to a system that can't understand books and can't critically think at all," Dr. Margaret Mitchell, chief ethicist scientist at Hugging Face, told Ars.


I'm a bot and I'm open source!

[–] [email protected] 14 points 1 year ago (2 children)

Funny that this bot reads thru and summaries an article about a bigger bot basically doing the same thing.

[–] [email protected] 3 points 1 year ago (1 children)
[–] [email protected] 3 points 1 year ago

Everybody is a bot.

That comment says that we’re all machines anyway.

[–] [email protected] 3 points 1 year ago

I think there is a big difference. This bot is given the text and asked to summarise it. But

To determine which books fit the bill, Exman asks ChatGPT: “Does [book] contain a description or depiction of a sex act?” If the answer is yes, the book will be removed from circulation.

So was only given the title and asked one question about it. There is no saying if GPTChat included the books in question in its training set, or any online reviews or anything else about the book in question.

That is a fairly big difference. If they had fed it the books contents that would likely make it more accurate and closer to what this bot is doing, though still not 100%.

[–] [email protected] -1 points 1 year ago

Republican lawmakers believe are necessary to protect students

That's just terrible journalism. How can the writer possibly know what they believe?