u/GyGeek

Hermes, local LLMs and integrations

Looking like markdown is shaping up to be the standard for everything AI. Going to be integrating obsidian into my network.

Hermes is running on a Proxmox VM. The brain is a local LLM on a dedicated machine from Framework with 128gb iGpu. It serves up the model with ollama. I access everything with various Linux and Windows machines on the home network, as well as via tailscale remotely.

How do you integrate everything if you are keeping things local?

I really don't have a workflow. Not doing anything super important. Just use local AI because it's interesting to see how it can be incorporated with local computing.

reddit.com
u/GyGeek — 9 days ago