u/Electrical_Offer5667

Anyone running Qwen3.5-9B locally with Hermes?

Anyone running Qwen3.5-9B locally with Hermes?

I’ve been doing some experiments with a modified Qwen3.5-9B runtime on a 4090. I’m testing a mapped/tiered KV setup where most old context (90%) can sit in normal RAM, while the GPU keeps a small hot working set and only pulls back the regions it actually needs.
I'm still new to Hermes but I've used LM Studio and Ollama a lot.

The main objective is to add massive kv cache runway to local processes.

My Setup / context

  • RTX 4090, 24 GB VRAM
  • Ryzen 9 7900X
  • 64 GB system RAM
  • Windows 11
  • Running local models regularly
  • Current test model: Qwen3.5 9B
  • Running the 9B in bf16 for the current experiments
  • Also already running Qwen3.8 27B Q8_0 in LM Studio, but it is a tight fit on 24 GB VRAM
  • Interested in Hermes as an actual local agent environment, not just one off chat inference
  • Main concern: longer running agent sessions and context growth on consumer hardware

Questions for Qwen3.5-9B / Hermes users

  • Anyone running Qwen3.5 9B locally with Hermes?
  • What hardware are you using?
  • What quant are you using?
  • What context size do you normally run?
  • How does it behave once sessions get genuinely long?
  • Does KV/VRAM pressure become a problem for you?
  • Do you reduce context because of VRAM?
  • Do you notice tokens/sec dropping as context grows?
  • How is Qwen3.5 9B for long running agent sessions?
  • How is its tool use?
  • How is instruction following?
  • How is coding?
  • How well does it retain information from far back in a session?
  • Any failure modes that only show up after long conversations?
  • Anyone compared 9B with the 4B or 27B in Hermes?
  • Anyone using CPU/RAM KV offload already?
  • If so, how bad is the PCIe/latency penalty?

I don't expect anyone to answer all of these questions but any responses are appreciated.

u/Electrical_Offer5667 — 8 hours ago

Installed Hermes locally last night. What should I know as a newb?

Setup: Windows, RTX 4090
So far I've tried Qwen 3.8 27b (Context at 128k and KV set to Q8_0) and Gemma 4 26b via LM Studio. Got it working with a Telegram bot which is pretty cool. In the future I may integrate Hermes into a startup that I'm working on.

What do you wish you'd known your first week?
What's your local vs cloud split?
Can I run on my ChatGPT subscription instead of burning through API credits?

reddit.com
u/Electrical_Offer5667 — 4 days ago

Obsideo: a distributed storage network I've been building with Claude Code

What it is. Obsideo is my project. It's a client-side encrypted distributed storage network with proof of retrievability, built for autonomous software, agents, and humans. In plain terms, encrypted cloud storage. Your data is encrypted on your machine before it goes anywhere, spread across independent operators rather than sitting in one company's datacenter, and every operator holding a copy has to cryptographically prove it still has your bytes on a continuous cycle. It isn't trusted to keep them; it's checked, roughly every four hours, and paid only for the proofs it passes.

The operators. The network runs on hardware I don't own. Independent operators run the storage nodes, on their own machines, disks, and connections, and get paid for the proofs they pass. They can join, and they can leave; when one drops or fails a proof, the coordinator re-replicates that data to others, so the network routes around a bad or absent operator without the customer doing anything. So part of the build was the software, and part of it was the human side: finding operators, onboarding them, and keeping enough healthy capacity online that customer data always sits on three of them. A storage network with one participant is just a hard drive. The work is making it a real one.

How it was built. Almost all of it was written with Claude Code. I've used it as my primary development environment for the whole project, so the overwhelming majority of the implementation came through coding agents: the coordinator and the storage node binary (both Go), a Python CLI, an S3-compatible gateway, an MCP server, the test suites, and most of the deployment and monitoring tooling around them. I architected it, but the actual code is agent-written.

Where it's at. Live and in production. A small fleet of operator nodes, roughly 70,000 objects under continuous proof, and paying customers running real workloads against it, mostly recurring automated backups pushing batches of objects, the largest single one 104 GB so far. Money moves in both directions: customers pay for verified storage, operators earn for the proofs they pass. Revenue is small but real. Small, growing, and legitimate, not a weekend demo and not a finished product either.

Using it. The interface is deliberately boring, which is the point: an S3-compatible gateway, a CLI, and an MCP server, so you reach it from tooling you already use instead of learning a proprietary API. The MCP server is the one most relevant here, an agent can put and get objects directly, and the network keeps proving that data is still there afterward, which is the kind of persistence agent workflows usually don't have. There's a free tier, and signup happens right inside the MCP server, so trying it costs nothing. The code is here if you'd rather read before touching anything: github.com/Regan-Milne/obsideo-mcp

What's next. It's early, and the gaps are: more operators for capacity and independence, and the durability and tooling work that turns alpha into something you'd trust without watching it. That's the current focus. If you're building with agents and want them to keep state that outlives a session, or you just want to kick the tires on the storage itself, I'd genuinely like to hear how it holds up for you.

So that's the short version. I'll answer questions if there are any.

reddit.com
u/Electrical_Offer5667 — 10 days ago

I built a sourced, dated comparison of 25 object storage providers: price per TB, egress, free tiers, minimums, encryption, and whether they can cryptographically prove they still have your data [disclosure: I run one of the 25]

Disclosure first: I run Obsideo, which appears as one of the 28 rows. I'll explain why I think the table is still useful to you despite that.

https://obsideo.io/compare/

While doing competitive research I kept finding storage comparisons that were stale, unsourced, or a vendor page with the vendor's row highlighted in green. So I built the thing I wanted to exist, with rules designed to keep me honest:

  • Every numeric fact links to a source URL with the date it was fetched.
  • My row uses the same schema as every other row, sorted alphabetically. The only special treatment is a small "that's us" tag so you know exactly which row to be skeptical of.
  • I am visibly not the cheapest option. Glacier Deep Archive is about 15x cheaper than my own row.
  • On the column I care most about, cryptographic possession proofs, the table rates Arweave and Sia above me, because their proofs settle on a public chain and mine do not.

Columns: $/TB-month, egress $/TB and its semantics, free tiers, minimum charges and retention gotchas, S3 API compatibility, encryption model, and whether the provider can cryptographically prove it still holds your bytes.

The 28 rows cover the hyperscalers (S3 Standard plus all three Glacier tiers, OCI, R2), the budget S3 crowd (Backblaze B2, Wasabi, Hetzner, IDrive e2, Contabo), the backup specialists (rsync.net, BorgBase, Tarsnap), and Arweave, Sia and Storj.

I added the Glacier tiers this morning because a mod asked for them when I requested permission to post. Their notes cover the parts that bite: the 90 and 180 day minimum durations, the 40 KB per-object metadata overhead, the retrieval fees that stack on top of egress, and the fact that AWS bills in binary GB so a real TB costs about 2.4% more than the decimal figure.

The whole dataset is machine-readable JSON under CC BY 4.0 if you want it for your own projects: https://obsideo.io/compare/providers.json

If you spot an error, say so here or use the correction email on the page. Every fix ships with a source. Corrections are the point of publishing this.

u/Electrical_Offer5667 — 27 days ago