this post was submitted on 24 Mar 2024
271 points (98.2% liked)

Risa

6912 readers
155 users here now

Star Trek memes and shitposts

Come on'n get your jamaharon on! There are no real rules—just don't break the weather control network.

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 8 months ago (1 children)

I'm writing with a similar type of AI, saw the meme, and thought to ask the ST nerds. I was a bit young for NG on a deeper level and I'm not a big show watcher. I wouldn't have had a clue about the alignment problem until the last couple of years anyway.

I have read most of Asimov's robot stuff and a bunch of theory summary type info on the issues of AI. Humans are a basket case of contradictions under the surface and just outside of most people's awareness. This is one of the largest issues that causes problems with LLM's and it only gets worse the more integrated AI gets within the analogue world.

I think there must be an external AI that only has the job of spotting the alignment problem acting like an silent observer in a mixture of experts.

The ship is likely AI in ST, although I never put it in that context in my head while watching and I'm not sure how it was presented on the show. This is the likely management entity that could have been used with Data. The question in my mind that needs further exploring is how to make the connection and control in a way that the controlling entity is not just a bigger alignment problem with minions.

[–] [email protected] 3 points 8 months ago (1 children)

Star Trek tries to avoid using fully sapient AI, in fact it's illegal for fully integrated ship components to be sapient in Starfleet ships. It's why the ships computer can solve nearly any problem you give it, but it can't give you anything unless you ask the correct question.

[–] [email protected] 1 points 8 months ago (1 children)

Interesting! So the ship is like LLM's presently; static/not AGI

[–] [email protected] 2 points 8 months ago

Pretty much, the Ship's main computer doesn't even have the ability to learn user preferences.