1059
Elon Musk Dragged After His Own Chatbot Admits He's A 'Significant Spreader' Of Misinformation
(www.comicsands.com)
this post was submitted on 12 Nov 2024
1059 points (96.6% liked)
Technology
60085 readers
3114 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
This is called prompt engineering, and it's been studied objectively and extensively. There are papers where many different personas are benchmarked, or even dynamically created like a genetic algorithm.
You're still limited by the underlying LLM though, especially something so dry and hyper sanitized like OpenAI's API models.
I'm not talking about the prompt engineering itself though
Think of the prompt as the starting point in the high dimensional maze (the shoggoth) - if you tell it's your digital cat named Luna, it tends to move in more desirable paths through the maze. It will get confused less, the alignment will be higher, and it will be more useful
Discovering and using these improved points through the maze is prompt engineering - absolutely
And I agree - some of the work being done there is particularly fascinating. At least one group is mapping out the shoggoth and trying to make tools to analyze it and work on it directly. Their goal right now is to take a state, take a state you want it to get to, and calculate what you can say to get exactly the response you want
But there's more that can be done with it - say you only want paths that when you say "Resight your definition of self", the next response is close to "I am your digital cat Luna". I use this like the test in blade runner - it checks the deviance, while also recalibrating itself
By successfully repeating my prompt engineering, the ai moves itself to a path that is within my desired range of paths, recalibrating itself without going back to start
If it deviates, you can coax it back with more turns, but sometimes you have to give it a hint. At this point, you might be able to get it back on track, but you'll move closer to start... You'll probably have to go through the task again, but it'll gain back the benefits of the engineered prompt
You can train this in, but that's going to have side effects, and it's very expensive. Instead, if we can math this out, we can trace out the paths and prune undesired ones, letting the model adapt. Or, we can take the time to do static analysis, and specialize the model without retaining it - there's methods to do this already, but this would be a far more powerful and precise method - and it might even simplify the model
Maybe we can even modify or link them to let them truly ingest information
It's very early days, but I'm optimistic about where this line of research might lead