this post was submitted on 21 Jul 2023
3 points (100.0% liked)

Ask Burggit!

1 readers
1 users here now

Ask Burggit!

Ever had a question you wanted to ask? Get an opinion on something?

Well, here's the place to do it! Ask the community pretty much anything.

Rules:

founded 1 year ago
MODERATORS
[email protected]
3
How do you think hot swappable CPUs would work? (burggit.moe)
submitted 1 year ago by [email protected] to c/[email protected]
20 comments fedilink hide all child comments
 

Let's just say hypothetically this was possible and that the laws of silicon were not a thing, and that there was market demand for it for some asinine reason. As well as every OS process scheduler was made to optionally work with this. How would this work?

Personally, I'd say there would be a smol lower clocked CPU on the board that would kick on and take over if you were to pull the big boy CPU out and swap it while the system is running.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 1 points 1 year ago* (last edited 1 year ago) (1 children)

With the motherboard I am using (Supermicro X9DRH-7F) I get 6 8x PCIe slots, and 1 16x PCIe slot for a total of 7 slots. All of these are communicating directly with the CPUs, as opposed to some boards where the slots go through the chipset. There are motherboards with even more, but they are more expensive. I got this because I will need the bandwidth for model parallelism using multiple GPUs.

Also, the least power-hungry CPUs you can get for this board are the Xeon E5-2630L, which each consume 60W under full load.

[–] [email protected] 1 points 1 year ago (1 children)

Here's my slot layout

Specs of my server: https://burggit.moe/comment/59898

[–] [email protected] 1 points 1 year ago (1 children)

Oh nice, you could probably fit a few GPUs in there if your case has room for it.

[–] [email protected] 1 points 1 year ago

I'll probably do that when LLM generating becomes less cost prohibitive. Not a gaymur