this post was submitted on 25 Dec 2023
1925 points (97.9% liked)

People Twitter

5268 readers
789 users here now

People tweeting stuff. We allow tweets from anyone.

RULES:

  1. Mark NSFW content.
  2. No doxxing people.
  3. Must be a tweet or similar
  4. No bullying or international politcs
  5. Be excellent to each other.

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 10 months ago

Those server farms are because the needs of corporations might just be different from the needs of regular users.

I'm running a 8 GB LLM model locally on my PC that performs better than 16 GB models from just a few months ago.

It's almost as if technology can get better and more efficient over time.