u/Horny_Dinosaur69

harness for personal assistant? (Using local smaller models)

Hey all, I always see a lot of talk around coding harnesses but don’t see a lot regarding ‘personal assistants’ outside of Hermes or OpenClaw for the most part. While you can always arguably just use a stripped down harness for this purpose, I’m curious if anyone knows of/uses a lightweight Hermes-esque harness that performs well for local models? I’ve been using 9B models and they sometimes can get stuck/looping as of late.

I’ve noticed that Hermes/OpenClaw have gotten fairly heavy and it’s made me reconsider swapping my harness in my local system. I use Hermes in my system as a personal assistant of sorts, managing various homelab services, chrons, tasks, quick research, automation (STT stuff), etc.

I have a lightweight, custom harness I’ve been working on by myself for the last 6 months or so that aims to accomplish this, but it would be nice if I wasn’t reinventing the wheel. A more lightweight option would mean potentially supporting even smaller models, which would always be nice

reddit.com
u/Horny_Dinosaur69 — 7 days ago