Hi, so I have a very individual homelab. It's a collection of stuff accumulated over nearly 30 years of doing weird stuff.
For the past 9 years it's been running as a bunch of lxc containers (privileged because unprivileged did not exist, back then) but several of those containers are p2v conversions of physical hosts dating back to debian woody and earlier. They're all upgraded to at least buster, most are bookworm. Stuff like asterisk, email, home assistant, nextcloud, matrix synapse run there these days.
The server is a 15 year old HP gen6 thing, and is getting quite long in the tooth. There's also a dedicated cheapy microserver with an i4 running opnsense on bare metal as a firewall.
Trying to run stuff like local voice stuff for home assistant is showing the HP's age quite badly. Also, our area is getting fibre, and the opnsense box is maxed out at gigabit. More speed would be nice.
So, I'm in two minds. The homelab has been a lot of fun over the years, but I'm over 50 now, I want lower maintenance. This latest wave of upgrades is making me rethink the next 20 years of homelab. I don't want to leave something stupidly "only me" if I were to die tomorrow (diabetes is a fickle bastard). My wife might want to try and carry on this thing - it runs some useful stuff around the house (but it should be noted that nothing in this house requires a server or cloud) - and that's not going to happen with the current solution.
I think I might have a path, using proxmox, from where I am now, to something that can be deployed on e.g. a bunch of ms01 class devices. I'm thinking to convert the existing HP server to proxmox, to allow me to redeploy all my existing lxc containers into the proxmox world. As I acquire hardware over the next year, I can look at a k8s migration of the services onto a small, MUCH lower power cluster. One of the keys is that I don't want to have big outages of services for days or weeks while I migrate everything so it's gotta be a rolling upgrade as it were.
I'm here soliciting feedback. Has anyone ever migrated from a deeply legacy homebrew homelab into something like this? Does it reduce the workload long term? What's the practicality of this for someone rather less tech savvy?
Thanks!
I migrated from a mix of proxmox, hyper-V, bare metal, and Synology hosted docker onto a full k8s cluster.
It is much easier to manage now, including adding or replacing nodes. Including a rebuild of the cluster from 7 rpis onto 7 elite desk mini PCs. (From arm to x86 and from Debian to Talos)
But it wasn't a small process either.
You'll have to deploy your k8s cluster, learn how to host the services you want (using a load balancer, dns setup, cluster IPs, etc), and setting up a storage provider (I use NFS to my Synology share, not the fastest or most secure but easiest)
And then you'll need to migrate your services off the old hardware onto the cluster one by one... Which means learning docker and k8s and how they work together.
There are some things that I cannot host on the cluster like zwave2mqtt which requires a physical location centralized in my house and access to a USB zwave adapter. So even then not quite 100% ended up on the cluster, it runs on docker on an rpi though. (Technically you can do this if you pin the container to a single host and pass through the USB device, but I didn't see a reason for it.)
But, service upgrades, adding new services now that I'm used to it is very easy... Expanding compute is also pretty easy. So maintenance has gone down a bunch. But it was also a decent amount of work and learning to get there.
K8s is relatively specialized knowledge compared to the general computer literate population that knows how computers generally work... So in terms of someone being able to take over your work, if they already know k8s, then it would be reasonably easy. If they don't but are savvy enough to learn it would take a bit but not be too bad. If someone doesn't already know their way around Linux and a terminal, it would probably not be possible for them to pick it up in a reasonable amount of time though.
I’ve migrated most of my lab from a mess of proxmox lxcs over to k3s (I use k8s at work), except for home assistant. I’ve been back and forth on that one. I really like being able to back up the entire vm before running updates or whatever. Could you use a node selector to force zwave or zigbee or whatever to run on the node that has the usb device? Or is it still a pain in the ass that way cause you have to know the path on the specific host… I haven’t tried that yet.
You can pin the pod to a specific node and pass through the USB device path and that will work. But the whole point of k8s is redundancy and workloads running anywhere.
Plus for IOT networks like zigbee and zwave, controller position in your house is important. If your server is more centrally located that may not be a concern for you.
I've heard of some using a USB serial over Ethernet device to relocate their controller remotely but i haven't looked into that. Running this one off rpi for the controller just made more sense for me.
Makes sense, thanks. Yeah idk about usb serial over Ethernet, it’s an interesting idea but I wouldn’t want to introduce more moving parts (and/or latency) to the network.