this post was submitted on 08 Aug 2023
95 points (100.0% liked)
Chat
7475 readers
41 users here now
Relaxed section for discussion and debate that doesn't fit anywhere else. Whether it's advice, how your week is going, a link that's at the back of your mind, or something like that, it can likely go here.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I just got a Llama 2 70B LLM (offline chat AI) working on my laptop. That is a much larger (smarter) system than I thought was possible on a laptop. It takes every bit of 64GB of RAM, and it is about as fast as AOL instant messanger on bad 56k dialup, but it works.
I think I also fixed my problem that stopped me from using text to speech AI. Now I just need to figure out speech to text, get a few billion dollars, and make an iron man suit.
Is that for training the LLM or just simply running it?
Just running