Kubernetes and VLANs

Hi,

I will go straight to the point I am building my Kubernetes (3 nodes that are master and worker at the same time) homelab and I was wondering if having my cluster VLAN aware is a good idea or not

The purpose is to having two Service Load Balancer served by Cilium/MetalLB for the DMZ and LAN VLAN. Then I would be exposing my workloads on the right gateway depending of their "exposure"

But since I have only one NIC on each node I would configure my switch to have 2 VLAN on those links instead of only one (that's why I said VLAN aware)

The main purpose is to have a better isolation and so security overall. But I feel it maybe a bit overengineering, I may can achieve the same thing with Network Policies inside the cluster itself. Also I want to be able to bootstrap my nodes from iPXE, not sure how it would work with a "tagged network link" with multiple VLAN

What do you think ?

reddit.com
u/lief91 — 1 day ago
▲ 548 r/minilab+1 crossposts

Jumping into the mini rack rabbit hole

Hello,

After looong years with devices here and there I finally decided to fully commit to something reliable, portable, and aesthetically pleasing

It has been a long run but I am super proud of the result especially considering I am not a handyman at all 😅. For those interested here my setup (top to bottom):

  • Wifi AP : TP-Link Omada Business WiFi 6 AX3000 Ceiling Mount Access Point (EAP650)
  • Firewall : QOTOM Q730G5 (OPNSense as an OS)
  • Desk PI's patch panel provided with the rack
  • Router : TP-Link Jetstream TL-SG2008P
  • Switch : TP-Link TL-SG105 5 ports 1G + Controller : TP-Link Omada controller OC200
  • KVM : KVM Ezcoo + JetKVM
  • 3x Mini PC : Beelink Mini PC, Mini S12 Pro Intel 12th Gen 4-Core N100 (up to 3.4GHz)
  • NAS : Synology DS918+ (with 4x4 To HDD)
  • UPS : Not in the picture but CyberPower CP1500GAVR 1500 VA

Now that hardware is sorted I will be moving to software part and configuring a K3s stack fully provisioned by FluxCD over Flatcar OS (still a work in progress 👀)

Detailed information and the logbook of my journey here : https://homelabeur.eu/deskpi-rack
All the rack mounts have been 3D printed you can retrieved them in the above blog post.

I will be more than happy to answer any questions or receiving feedback !

u/lief91 — 1 month ago