this post was submitted on 30 Sep 2024
11 points (100.0% liked)

The Linux Lugcast Podcast

171 readers
4 users here now

website: https://www.linuxlugcast.com/

mumble chat: lugcast.minnix.dev in the lugcast room

email: [email protected]

matrix room: https://matrix.to/#/#lugcast:minnix.dev

youtube: https://www.youtube.com/@thelinuxlugcast/videos

peertube: https://nightshift.minnix.dev/c/linux_lugcast/videos

founded 1 year ago
MODERATORS
[email protected]
[email protected]
11
Exploring Llamafile: Mozilla's Attempt in the World of Open Source AI (itsfoss.com)
submitted 1 month ago by [email protected] to c/[email protected]
4 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 3 points 1 month ago (1 children)

I find the 7b models dont have the capabilities id like and i cant image the tokens per second would be very good.

[โ€“] [email protected] 2 points 1 month ago

Yeah running it and it actually being useful are two very different things.