this post was submitted on 14 Dec 2024
74 points (100.0% liked)

Technology

1573 readers
151 users here now

Which posts fit here?

Anything that is at least tangentially connected to the technology, social media platforms, informational technologies and tech policy.


Rules

1. English onlyTitle and associated content has to be in English.
2. Use original linkPost URL should be the original link to the article (even if paywalled) and archived copies left in the body. It allows avoiding duplicate posts when cross-posting.
3. Respectful communicationAll communication has to be respectful of differing opinions, viewpoints, and experiences.
4. InclusivityEveryone is welcome here regardless of age, body size, visible or invisible disability, ethnicity, sex characteristics, gender identity and expression, education, socio-economic status, nationality, personal appearance, race, caste, color, religion, or sexual identity and orientation.
5. Ad hominem attacksAny kind of personal attacks are expressly forbidden. If you can't argue your position without attacking a person's character, you already lost the argument.
6. Off-topic tangentsStay on topic. Keep it relevant.
7. Instance rules may applyIf something is not covered by community rules, but are against lemmy.zip instance rules, they will be enforced.


Companion communities

[email protected]
[email protected]


Icon attribution | Banner attribution

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 week ago (5 children)

No, they can’t, because you can just pull the git repo with the old license as use them as they were at the time of upload, just like any software on a git repository. And too many people have them downloaded to delete them from the internet.

There are also finetunes inheriting the old license, and those orga are not going to pull the weights.

[–] MCasq_qsaCJ_234 2 points 1 week ago (4 children)

And in that case, will the Llama fork be the same as the Meta fork? We are talking about AI that has a considerable development, companies would probably not participate because it is not an open source license and its clause limits in those aspects.

Also you have to think that if the new version of Llama with the new license is 3 times better than Llama with the previous license, do you really think that the community will continue to develop the previous version?

[–] [email protected] 1 points 1 week ago* (last edited 1 week ago) (3 children)

And in that case, will the Llama fork be the same as the Meta fork? We are talking about AI that has a considerable development, companies would probably not participate because it is not an open source license and its clause limits in those aspects.

Llama has tons of commercial use even with its “non open” license, which is basically just a middle finger to companies the size of Google or Microsoft. And yes, companies would keep using the old weights like nothing changed… because nothing did. Just like they keep using open source software that goes through drama.

Also you have to think that if the new version of Llama with the new license is 3 times better than Llama with the previous license, do you really think that the community will continue to develop the previous version?

Honestly I have zero short term worries about this because the space is so fiercely competitive. If Llama 3 was completely closed, the open ecosystem would have been totally fine without Meta.

Also much of the ecosystem (like huggingface and inference libraries) is open source and out of their control.

And if they go API only, they will just get clobbered by Google, Claude, Deepseek or whomever.

In the longer term… these transformers style models will be obsolete anyway. Honestly I have no idea what the landscape will look like.

[–] MCasq_qsaCJ_234 1 points 1 week ago (1 children)

Well, I agree that we don't know what the situation will look like over time.

There may be a limit that will cause another AI winter, driving companies away for a while because they invested money and received little.

Transformers may remain relevant or end up being obsolete, although there are still many papers related to AI in one way or another.

[–] [email protected] 1 points 1 week ago (1 children)

The limit is already (apparently) starting to be data… and capital, lol.

There could be a big computer breakthrough like , say, fast bitnet training that makes the multimodal approach much easier to train though.

[–] MCasq_qsaCJ_234 1 points 1 week ago

I think this method is not convincing for companies, because they prefer more power and to do it on their own, because they don't want their ideas to be replicated.

load more comments (1 replies)
load more comments (1 replies)
load more comments (1 replies)