this post was submitted on 09 Jun 2024
6 points (75.0% liked)

Machine Learning

1717 readers
1 users here now

founded 4 years ago
MODERATORS
 

Imagine AI giving offsprings...

top 5 comments
sorted by: hot top controversial new old
[–] [email protected] 7 points 2 months ago

Not directly no.

It may be able to code one (the code is relatively short and well known) and give training program, and then you would need to spend a few trillion tokens to make it generate data.

[–] [email protected] 5 points 2 months ago (1 children)

You can generate synthetic data matching the distribution your transformer learned. You can use this dataset to train another model. As of now, that's about it.

[–] [email protected] 2 points 2 months ago

Yep, this is called model distillation.

[–] [email protected] 3 points 2 months ago (1 children)

Don't give them any ideas.. 😂

[–] [email protected] 0 points 2 months ago