Best Coding LLM with 5090. Stingy Claude

What is the best model and parameters I can run locally for coding purposes on a 5090?

Plenty of other threads about it. Feeling like claude and anthropic have gotten stingy (or my apps just gotten massive). $100/month for pro plan and developing a SaaS app for mortgage with a huge relational databasing, CRM, email features. Lots of subagent work for UI polishing, backend, auditing math generated and displayed, external outputs via email. The program has grown a lot over the last 3 months and now I feel like every time I run an audit, database verification, simple feature add-on build I hit my limit. I host on DigitalOcean and currently develop on VS Code with Claude CLI, Opus 4.8.

Originally got the 5090 for model training for another app that was computer vision focused with huge image datasets, now that's done I've moved on to this one I'm bumping into usage limits now that I'm further into development. I've played around with hermes and qwen models for some smaller projects and haven't transitioned this latest larger app buildout to a model I have confidence with. Started with claude, apprehensive moving away from it but I'm tired waiting for usage limit resets after what I'd consider minor improvements to my app. I keep thinking about hermes running subagents for programming, project manager, auditor, verifying, endpoint checks, and just setting it up to automate the entire workflow end-to-end or a particular feature and letting it rip for as long as it takes and sending the work back to the various agents until the PM agent is 100% happy based on the objectives I give it. Possible anyone?

Is there a way to run hermes, a 30ish gb model with certain parameters and tie it in for no limit local usage even if it takes longer? I assume quality might be lessened w smaller model, but is there a model and parameters that would minimize this gap with my GPU?

Appreciate anyone's input, thoughts, comments, experiences running some smaller models or am I just in that middle ground between pay to play and spending 10k+ for a rtx6000 which I don't want to do because of future advancements to the hardware surely coming.

reddit.com
u/dwoj206 — 14 days ago

Thematic changes post 100% ready to go state - In Claude I Do Not Trust

Just as the title says, Claude has not won my trust on making theme/style changes to my app. Everything it generates from a technical standpoint I've enjoyed, and works. It's great for some things, and inferior for others.

What are you all using to create beautiful UI's? I see some really nice screenshots floating around on here. Everything claude has generated is very simplified, python(y) look. unified single font, flat, lacks depth on buttons, no gradients, no dynamics whatsoever. Not trying to do too much, just give it a little pop. For coding, it's been great now I'm down to refining the user experience without overdoing it and it's a tough balance.

Are there particular apps, models that I can use and ask for recommendations from for doing thematic overhaul to an entire program that will actually hit all the pages, end points thoroughly?

my App -- CRM platform, with tools, pop out panels, interactive table views (similar to an airtable or monday feel) built in as well as charts/graphs for referral tree and other features.

reddit.com
u/dwoj206 — 3 months ago

Hermes Agent for Real Estate Assistant

Good day all, first foray into agents and picked up the hermes agent based on a recommendation from someone more experienced than I. Looking for anyone's thoughts on how to make it better, build skills, and add functionality as it's currently in it's infancy and needs some skills and a lot more background.

I've started up an Hermes agent for my wife, who is a real estate broker who's always forgetting things, doesn't keep a database, scatterbrain and quite frankly, needs a lot of help on the IT side. It's running on a docker container on my local PC along with the help of a 5090 running the llama.3.3:70b-instruct-Q2_K model.

Issues I'm having --

  1. I've set it up to communicate with it via telegram with my (OP's) user ID # and built out some initial context/memory to what's going on day-to-day in her job, current clients, names, numbers, search criteria, lead type ie past client, new client, buyer/seller, etc and some info on her current listings and pending transactions. ISSUE -- I've added her as a 2nd user, and tried to merge the memory across all users, but doesn't seem to have granular detail about it all. IS THIS POSSIBLE TO DO? Is there a way to share memory across both telegram users so I can build out the background for her so she can just carry forward and interact with it knowing all that I've told it about her history?

  2. New skills -- How do I build new skills? any resources you'd recommend to learn more? Ideally, I'd like the bot to be able to respond thoroughly with "Look up X property and store details, neighborhood, address, sqft, beds, baths, days on market, etc". I was able to get it to search the web, but it's only storing the address and square footage. Pretty basic. Hermes gives feedback that it's built out a dataset for search_properties of call it 20 fields, but is only populating a small handful.

  3. Scheduler - like a to-do list, reminders, daily calendar, daily follow ups, warm/cold leads. What's the best way implement this?

Thanks all and appreciate any tips

reddit.com
u/dwoj206 — 3 months ago