Machine Learning

1765 readers

10 users here now

founded 4 years ago

MODERATORS

[email protected]

Can gpt generate a gpt model? (sh.itjust.works)

submitted 4 months ago by [email protected] to c/[email protected]

5 comments fedilink hide all child comments

Imagine AI giving offsprings...

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 5 points 4 months ago (1 children)

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.

permalink
fedilink
source
hideshow 2 child comments

[–] [email protected] 2 points 4 months ago

Yep, this is called model distillation.

permalink
fedilink
source
parent