this post was submitted on 30 Aug 2023
408 points (100.0% liked)
196
16593 readers
2251 users here now
Be sure to follow the rule before you head out.
Rule: You must post before you leave.
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I upgraded to 64gb, which is surprisingly cheap nowadays. Plus it allows you to run quantised LLMs locally.
Only downside is the memory training times on reboots.
Isn't it supposed to Do that only once?
You can set manual timings and disable the training
shouldnt there be ways around this?
like taking a snapshot of memory and saving it to disk