this post was submitted on 16 Sep 2024
25 points (77.8% liked)

Firefox

17938 readers
14 users here now

A place to discuss the news and latest developments on the open-source browser Firefox

founded 4 years ago
MODERATORS
 

On Valentine's Day 2024, Mozilla came out with a piece critical of AI chatbots titled "Creepy.exe: Mozilla Urges Public to Swipe Left on Romantic AI Chatbots Due to Major Privacy Red Flags."

But before they found red flags, back in 2019, Mozilla promoted a workshop on a creepy, rainbow-washed, chatbot ecosystem where people identified as "queer" were required to bare their most intimate sexual thoughts.

From the post:

your... interactions will be recorded... you will occasionally be prompted with random survey questions

What kinds of questions did they randomly ask the people who would "queer the AI"? Creepy stuff like

Have you ever sexted with a stranger?
Have you ever sexted with a machine?
Do you remember the first time you were aroused by language?
Do you think an artificial intelligence could help fulfill some of these... needs?

The workshop providers guided people into establishing an intimate, sexual connection with the chatbot they could create.

How might we build trust with an AI?
How might we give it its own sense of desire?

Even the consenting participants in the workshop complained about the AI's creep factor:

it feels like the A.I. is gas-lighting you. Seems like a noncommittal sexting bot. It should at least be clear about what it’s trying to do.

The startup that Mozilla fostered for this panel ended up crashing and burning, but its creepier, worse brethren live on inside of Firefox 130, displayed as first-class options within Mozilla's chatbot options. I just thought it would be fun to take a trip down memory lane to see how many creepy red flags AI companies could get within Mozilla's view without ever concerning them.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 8 points 2 months ago

Do you remember the first time you were aroused by language?

I do! Hadn't thought about it in at least twenty years. Thanks for the reminder, creepy chatbot that inspired this post. Thinking that an LLM could develop "its own sense of desire" was naive and seems ridiculous today, but I suppose their intentions were honorable as well as erotic.