They is no chance they are the one training it. It costs hundreds of millions to get a descent model. Seems like they will be using mistral, who have scrapped pretty much 100% of the web to use as training data.
L_Acacia
Buying second hand 3090/7090xtx will be cheaper for better performances if you are not building the rest of the machine.
You are limited by bandwidth not compute with llm, so accelerator won't change the interferance tp/s
I use similar feature on discord quite extensively (custom emote/sticker) and i don't feel they are just a novelty. Allows us to have inside joke / custom reaction to specific event and I really miss it when trying out open source alternatives.
Too be fair to Gemini, even though it is worse than Claude and Gpt. The weird answer were caused by bad engineering and not by bad model training. They were forcing the incorporattion off the Google search results even though the base model would most likely have gotten it right.
The training doesn't use csam, 0% chance big tech would use that in their dataset. The models are somewhat able to link concept like red and car, even if it had never seen a red car before.
The models used are not trained on CP. The models weight are distributed freely and anybody can train a LORA on his computer. Its already too late to ban open weight models.
They know the tech is not good enough, they just dont care and want to maximise profit.
Whatsapp is europe's iMessage
You can take a look at exllama and llama.cpp source code on github if you want to see how it is implemented.
Mistral modèles don't have much filter don't worry lmao