this post was submitted on 27 May 2024
88 points (97.8% liked)
Hacker News
2171 readers
2 users here now
A mirror of Hacker News' best submissions.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I don't think the models absorb new information from questions, do they?
I'd be surprised if they didn't, to be honest.
They do not. My understanding is that the models are static.
Their settings imply that they do
I guess I should be a bit more specific. There's no feedback loop into the currently running model. They could potentially use that data to tune or train future versions of the model, but there's no mechanism to live update the model weights in place. Or at least not to my knowledge.
The only things that'll make a difference in the same version of the model are the system prompt, context window and prompt.
Yeah, its still trained on the data it's fed