AI

4015 readers

3 users here now

Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.

founded 3 years ago

Nvidia’s ‘Nemotron-4 340B’ model redefines synthetic data generation, rivals GPT-4 (venturebeat.com)

submitted 2 months ago by [email protected] to c/[email protected]

4 comments fedilink hide all child comments

top 4 comments

sorted by: hot top controversial new old

[–] [email protected] 2 points 2 months ago (1 children)

Redefines synthetic data generation? From "making fake data" to what? (I get it, it's hyperbole.)

Training on synthetic data is the most garbage-sounding thing I've ever heard. Isn't Reddit and Wattpad fake enough? At least those posts were generated by actual humans.

I guess I'll wait and see, but I'm really skeptical that this will be a good thing.

[–] [email protected] 6 points 2 months ago

Its a promising idea. Limitless training data in any domain you want. Whether or not it actually pans out is a whole different story.

[–] [email protected] 1 points 2 months ago (1 children)

340B is fucking huge, holy shit. How big is GPT-4?

[–] [email protected] 2 points 2 months ago

The rumor is 1.76 trillion, or 8x220B (mixture of experts) to be specific: https://wandb.ai/byyoung3/ml-news/reports/AI-Expert-Speculates-on-GPT-4-Architecture---Vmlldzo0NzA0Nzg4