đ 5âYear’s a Homelab: The Ultimate Playground for AI, IaC, and Edge Computing
âA homelab is not a hobby; itâs a laboratory for the future.â â Inspired by the ethos of the openâsource community.
For more then five years, Iâve been building, tearing down, and reâbuilding a lab thatâs become my personal sandbox for everything.
From AI research to InfrastructureâasâCode (IaC) experimentation. Itâs a living, breathing ecosystem that pushes the limits of my hardware, software, and curiosity.
Below is a deep dive into the heart of my homelab, the tech stack that fuels it, and how each component. It is the steppingâstone toward mastering tomorrowâs computing paradigms.
The Operating System Journey - Insight
For more than three years, my home computer has run on ArchâŻLinux with a modern, eyeâpleasing desktop called Hyprland. I chose Linux over Windows long before most people even heard of it, and Iâve never once thought about switching back.
A Personal Commitment đŞ
When I first moved into my own space, I wanted a system that would grow with me, not with a companyâs software updates. I found that Linux gave me exactly that freedom.
- I installed Arch Linux because itâs the most flexible, âdoâitâyourselfâ operating system around.
- The base installation is lean, with only the software I needâno extra programs that slow things down.
- Every time I update my system, I get the newest improvements immediately, without having to wait for a big upgrade.
- Highly customizable with a looks/feel and needs that suite me and not something pushed upon users by the big technology corporations.
A Desktop That Feels Like Home đ
Hyprland is my Waylandâbased desktop environment. Itâs built to be fast, simple, and highly customizable.
- The windows âtilingâ layout is similar to what I liked about i3, but with smoother animations and a cleaner look.
- I can change how my display looks with a single text file, so I can switch from fullâscreen gaming to a multiâmonitor workspace in a flash.
- Input devices (mouse, touchpad, keyboard) feel responsive because the system uses a modern driver that works with Wayland.
- Audio is handled by a lightweight service that lets me play music, record, or run voice assistants with minimal lag.
Why Linux Stays My Choice đą
- Speed and Efficiency â My computer runs faster when I use the openâsource drivers that Linux offers, especially for my graphic card.
- Control and Privacy â I can keep everything on my machine, from running local AI models to rendering the desktop, without sending data to external servers.
- Community Support â The Arch community is huge and helpful. If I run into a problem, I can find solutions on the Arch Wiki or ask on forums, and the fixes are often ready in days.
- No Microsoft â I never wanted the feel of Microsoft Windows again. Iâve learned to use my machine in a way that feels natural and powerful, and Iâm proud of the freedom that Linux gives me.
Read more: Arch Wiki â Getting Started (2024) â https://wiki.archlinux.org/title/Installation_guide
By building my homelab on Arch Linux with Hyprland, Iâve created a personal computing experience thatâs as smooth as it is powerful. Every tweak, every update feels like a small win, and Iâve never imagined using a closedâsource operating system again.đ
1ď¸âŁ Hardware â The Foundation of Experimentation
| Category | Model | Specs | Role |
|---|---|---|---|
| Personal Workstation | AMD Ryzen 5 7600X | 64âŻGB 6000âŻMHz RAM, Radeon RXâŻ6800âŻXT, 2âŻNVMe (3âŻTB total) | Development, AI inference, UI hosting |
| Networking | Ubiquiti UniFi Dream Machine SE (UDMâSE) | - | Edge router & firewall |
| USWâ10Gb (Aggregation) | 10âŻGbE uplink | Core switching | |
| USWâ24âŻG2 | 24âport Gigabit | Access layer | |
| USWâFlex mini (x4) | 4âport | Edge / PoE distribution | |
| UniFi AP (x3) | WiâFi 6E | Wireless coverage | |
| Compute Cluster | SUN X4271 (x2) | DualâCPU, 96âŻGB RAM | Highâperformance workloads |
| HP DL360âŻG7 (x4) | DualâCPU, 368âŻGB RAM total | Legacy highâdensity servers | |
| HP DualâManaged L2/L3 Switch | 24 ports Gigabit switching | Dataâcenter networking | |
| Edge & LowâPower | Raspberry Pi Cluster | 7âŻCM3, 2âŻPiâŻ5âŻ4âŻGB, 2âŻPiâŻ4âŻ4âŻGB, 1âŻPiâŻ400âŻ4âŻGB, numerous PiâŻZero | Edge computing, lowâpower experiments |
| NVMeâHat & Halo Compute | â | Storageâcentric PiâŻ5 workloads |
Why this mix?
The highâend workstation handles interactive AI and UI workloads, while the enterpriseâgrade servers provide the compute density needed for heavyâlifting tasks. The Raspberry Pi swarm is the âedgeâ playground, letting me prototype IoT, AI inference on lowâpower devices, and test IaC on ARM.
2ď¸âŁ Networking â Unified, Flexible, and Scalable
All traffic funnels through the UDMâSE, which offers robust firewalling, VPN, and SDâWAN capabilities. From there, the 10âŻGbE aggregation switch stitches everything together, feeding into the 24âport core and the PoEâcapable Flex minis. The result? Zero broadcast storms, low latency, and full network isolation for experimental labs.
Documentation:
- UDMâSE Setup Guide â Ubiquiti
- USWâ10Gb â Ubiquiti Docs
- PoE Power Planning â Ubiquiti Knowledge Base
3ď¸âŁ Software Stack â Turning Hardware into a Living Lab
3.1 Docker Swarm on the Raspberry Pi Cluster
The Pi cluster runs a lightweight Docker Swarm orchestrator, hosting the following services:
| Service | Purpose | Notes |
|---|---|---|
| Homepage | Service dashboard | main dashboard |
| UptimeâKuma | Availability monitoring | Realâtime alerts |
| Portainer | Docker management | Easy GUI |
| Grafana | Metrics & dashboards | Pulls from Prometheus |
| FileâBrowser | File sharing | WebâUI for Pi storage |
Why Swarm?
Docker Swarmâs simplicity and builtâin HA make it ideal for a small cluster where you need zeroâconfig resilience. It also gives me a realâworld playground for IaC scripts that deploy to edge nodes.
3.2 Personal Workstation Services
| Service | Role | Tech Stack |
|---|---|---|
| Ollama | AI inference (multiple models) | Local LLM hosting |
| OpenâWebUI | Webâfront for Ollama | FastAPI + Vue |
| SearxNG | Decentralized search engine | Python/Django |
| GitLab CI/CD | Centralize code base & Automation pipelines | GitLab Runner (Docker) |
| Authentik | Identity & access management | Django + OAuth |
| Prometheus | Metrics scraping | Nodeâexporter + custom exporters |
| Kasm | Sandbox containers | Chromium + VNC |
Learning Outcomes:
- AI: Running LLMs locally on a GPU gives handsâon insight into inference latency, memory usage, and model optimization.
- IaC: GitLab CI/CD pipelines drive automated provisioning of Docker Swarm services, enabling repeatable deployments.
- Edge: Prometheus metrics collected from Pi nodes reveal power consumption, CPU temperature, and network throughputâessential data for edgeâaware design.
4ď¸âŁ Automation & Power Management â The âSmartâ Side
I built a NodeâRED flow that interfaces with the HP serversâ iLO and the Raspberry Piâs GPIO to control power states. The flow:
- Monitors CPU load (via Prometheus).
- Decides whether to power down idle nodes.
- Sends SSH commands or iLO APIs to shut them off.
This not only saves electricity but also protects hardware from overâuse during idle periods.
5ď¸âŁ Why This Homelab Matters
| Domain | What I Learn | RealâWorld Impact |
|---|---|---|
| AI | Model inference on GPU, fineâtuning, LLM deployment | AI democratization, privacyâfirst inference |
| IaC | Terraform, Ansible, GitLab pipelines | DevOps automation, reproducible environments |
| Edge Computing | ARM inference, lowâpower networking, realâtime data collection | IoT, 5G edge, distributed AI |
| Networking | VLANs, QoS, SDâWAN | Enterprise network design, resilience |
| Monitoring | Prometheus/Grafana dashboards, alerting | Operations reliability, observability |
Research Corner:
- Edge AI Deployment â IEEE Internet of Things Journal (2023)
- IaC for DevOps â Kubernetes & Docker: A HandsâOn Guide (OâReilly, 2021)
- PowerâEfficient Data Centers â ACM Digital Library (2019)
These experiments keep me at the cutting edge of technology, turning every tweak into a potential research paper or openâsource contribution.
6ď¸âŁ Future Horizons â Where Iâm Going Next
| Goal | Planned Upgrade | Why |
|---|---|---|
| Edge AI | More PiâŻ5 with Neural Compute Sticks | Run YOLOv8 on ARM |
| Serverless | Deploy K3s on the cluster | Microâservice scaling |
| Edge Analytics | Install Apache Kafka on Pi cluster | Stream processing at the edge |
| GPUâScale | Add a second RXâŻ6800âŻXT | Larger LLMs, GPUâcluster experiments |
| Hybrid IaC | Terraform + Ansible for network config | Declarative network provisioning |
6ď¸âŁ Closing Thoughts
My homelab is more than a collection of gadgets. Itâs an everâevolving laboratory that has taught me the fundamentals of AI, IaC, and edge computingâand more importantly, how to iterate fast, fail quickly, and learn from realâworld constraints. The knowledge gained here translates directly into:
- Better DevOps pipelines that can be scaled to corporate data centers.
- Smarter edge devices that consume less power while delivering more intelligence.
- Privacyâpreserving AI that runs locally without sending data to the cloud.
If youâre considering building your own homelab, start small, iterate fast, and let the hardware and software talk to each other. The future is handsâon, and the best way to stay ahead is to experimentâand thatâs exactly what my 5âyearâold homelab has taught me.
đ References & Resources
- Ubiquiti UniFi Docs â https://help.ui.com/hc/en-us
- Docker Swarm Documentation â https://docs.docker.com/engine/swarm/
- Prometheus Official Site â https://prometheus.io/docs/
- NodeâRED Official Docs â https://nodered.org/docs/
- Ollama GitHub â https://github.com/ollama/ollama
- OpenâWebUI GitHub â https://github.com/open-webui/open-webui
- SearxNG â https://github.com/searxng/searxng
- Authentik â https://github.com/goauthentik/authentik
- Kasm â https://github.com/kasmtech/kasm
- IEEE IoT Edge AI Survey â IEEE Internet of Things Journal, 2023.
All configurations are versionâcontrolled in my GitLab setup
Takeaway:
A homelab is your personal testbed for the next wave of technology. Build it, break it, rebuild it, and let curiosity be your guide. Happy Lab-in’! đ
vmlab blog (c) 2025
