u/j-web-admin

I caught the bug after I purchased the Dell Pro Max GB10 in April.

Left Rack (GeeekPi 8U Server Rack Cabinet):
HP 800 G4 mini PC with i5-8500T 32GB RAM and 4TB NVMe

Running Paperclipi, Hermes, GBrain, Grafana and Prometheus for rotating fleet dashboard
Using the DGX cluster for all inference

Asus Ascent GX10
Dell Pro Max GB10

Currently running DSv4 0731

D-Link DGS-110-05PD switch

10” Touchscreen Monitor (Prechen HD-103 from Amazon)

Rotates through a dashboard for each device

Right Rack (YQMRCZRF 6u)- bought first but regret not getting the GeeekPi 8U Server Rack Cabinet):
3 x HP mini PC with i5-8500T 16GB RAM and 2 x 2TB NVMe, dual Nics

Proxmox cluster
1TB NVMe for ZFS pool
I built it for fun with no real goal of what to run on it. I have a few apps that I created running on the cluster.

Netgear GS108Tv3 switch

Core network is all HPE (Aruba) Instant On - Thinking about transitioning to Unifi or Omada so I can bring all the networking into a single management plane.

I 3d printed all the shelves for the devices.

Update 08152029 - 4:45pm EST
Thanks for the engagement, everybody. I appreciate the comments and thoughts on what I got going on here. Going to be really transparent… I built this setup so I could tinker with it on Saturday and Sunday mornings when my family is asleep. More of learning tool then running local assets for the house.

I started out with the Dell GB10, thinking I'll point Opencode to local AI models instead of the typical Frontier models. Then I built that little HP that's running Paperclip and Hermes to play with Agent orchestrations. I was like, "Oh, I wanted to run multiple models for the various Hermes agent type, from a developer to a marketer." So I'll get a second DGX for more capacity. Right now, I think a single model running the cDGX cluster is what I need.

The reason why I'm using Paperclip is to mess around with agent orchestration. I set up a company in Paperclip with an org of Hermes agents and feed my Chief of Staff various business plans from a Shopify storefront to an app for sending my daughter daily dad jokes, and just let the agents go to work and see what is capable. I've done this a couple times by iterating through different concepts so I can learn and understand how to write better souls and skills. It’s kind of fun (and frustrating at times) to try different permutations of models to see how they perform.

For the Proxmox cluster, I run a few apps. TBH, probably not as much as I thought I would before I built it. At the moment, I have a meal planning app that I built for my wife and a Minecraft server running for my kids. I enjoyed sourcing the parts, racking the gear, and building the cluster. My focus has been on agent orchestration since I feel like this is more applicable to my day job.

Did my best to make it clean

Caught the bug a few months ago