Login

u/Resident-Pen-3757

r/LocalLLM r/VibeCodeDevs r/openrouter
▲ 2 r/openrouter

What locked-in price and usage limits would make you switch LLM providers?

Looking into starting a service hosting some open-source models. I know the big companies still lose money on this even with scale, but I'm more interested in what regular users would actually pay and what they'd need to switch from their current provider.
Please reply in this format if you can:

  1. Monthly price you'd consider switching for
  2. Preferred usage structure (rolling hourly budget, monthly cap, pure API, something else)
  3. Token/usage limits you'd want
  4. Models that matter most to you
  5. Anything else that would make you switch

Personally I'd want something like:

  1. $30/month
  2. Rolling hourly token budget
  3. ~10 million tokens per hour
  4. DeepSeek V4 Flash (and other strong open-source options)
  5. Cost and allowances that are not liekly to change. I'm getting tired of the nerfing of tokens, increased costs and ability of models.

What would it take for you to switch?

reddit.com
u/Resident-Pen-3757 — 1 day ago
▲ 5 r/VibeCodeDevs+1 crossposts

Low-end coding LLM viability test ideas (8GB VRAM target)

I have 8GB VRAM and 32GB RAM. Looking to see what I can actually get out of a low-end coding model, mostly in one-shot style tests.

I already built my own harness so I can change almost everything through the UI (skills, system prompts, tools, etc.).

End goal is figuring out whether a model that fits in ~5-6GB VRAM with almost no RAM offload is usable as a daily driver for my coding work. Subscription and API costs are getting annoying.

What I’m thinking:

  • Pick a solid reference model + harness (OpenCode or similar)
  • Run it on a fixed set of tests and track time, bugs, final context size, cache hits, output quality
  • Run the same small model in OpenCode on those exact tests
  • Then run both models inside my harness with default settings
  • Finally start customizing skills/tools on the small model and see how far I can push the results

Any thoughts on this approach, better test ideas, or models worth trying?

Harness if anyone’s curious: https://github.com/aaron-tot/visual-studio-harness/

u/Resident-Pen-3757 — 11 days ago
▲ 4 r/VibeCodeDevs

What OS is everyone vibe coding on and why?

I'm using Fedora KDE as my daily driver. Officially left windows about 2 months ago. Curious what others are using.

reddit.com
u/Resident-Pen-3757 — 11 days ago
▲ 1 r/VibeCodeDevs

Local AI dev harness because I wanted to actually see what the agent was doing, and configure everything without touching a config file. Visual Studio Harness ;)

https://reddit.com/link/1vikasc/video/rcvdvrdpl2ih1/player

Side project I've been chipping away at for a while. Two things I kept getting frustrated with using other harnesses, so I built my own around them:

Insights. I didn't like that the agent was kind of a black box. In mine you can see the full system prompt, every step the agent takes, tool calls, token usage, cost, even cache hits. And project knowledge doesn't die in chat history, specs, plans, research notes and audits live as scoped documents that stick around, plus a knowledge base with semantic search.

Configuration. I wanted everything to be changeable through the UI, not by editing files. Providers and models, per-agent settings (each agent gets its own model, system prompt sections, skill access, workspace manifest), tool permissions, MCP servers, hooks, prompt sections and joiners, the knowledge base, all in a settings panel.

It's early and rough, the API and schema will change, there are bugs, lots more things to add, stabilize, and I've only really tested a handful of providers.

If that sounds interesting, give it a go and tell me what's broken or missing. If enough people care about this direction, I'll put more time into it.

GitHub: https://github.com/aaron-tot/visual-studio-harness/

reddit.com
u/Resident-Pen-3757 — 12 days ago