this post was submitted on 30 Aug 2023
408 points (100.0% liked)

196

16593 readers
2252 users here now

Be sure to follow the rule before you head out.

Rule: You must post before you leave.

^other^ ^rules^

founded 1 year ago
MODERATORS
 

Also shout out to all non-electron-based apps

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 16 points 1 year ago (4 children)

I upgraded to 64gb, which is surprisingly cheap nowadays. Plus it allows you to run quantised LLMs locally.

[–] darkevilmac 4 points 1 year ago (3 children)

Only downside is the memory training times on reboots.

[–] [email protected] 4 points 1 year ago

Isn't it supposed to Do that only once?

[–] [email protected] 3 points 1 year ago

You can set manual timings and disable the training

[–] [email protected] 1 points 1 year ago

shouldnt there be ways around this?

like taking a snapshot of memory and saving it to disk