Workflow uses int8 model, Krea2TEnhancer with 0.5 strength,Wan2.1 fp32 VAE, DDIM and Beta57.
I lost so many hours of sleep the last couple of days its insane, I find myself not using ideogram4 that much anymore.
Gemma4-31b-qat-q4
Seems to perform better for me as daily driver for Hermes agent than Qwen3.6-27B-MTP-q4
It handles complex instructions better than Qwen, for example in memory I have a section about using TTS only when user used voice input, and only in the same language as user spoke in, gemma never misses that, qwen sometimes just answer with TTS when i just typed some text, and it can mix languages more often.
For specific complex problems I did move to qwen and it did fix it, but for 90% of the tools I made it was all handled by Gemma.
The added benefit of still being strong with tool calls and coding and having more “alive” personality, and having more languages opposed to Qwen aim to English/Chinese.
I wonder why r/Localllama embrace qwen as the overall superior model, while in practice it might be a bit different
Follow up to my other thread:
https://www.reddit.com/r/StableDiffusion/s/FpyDvF7vEd
First Image is Ideogram4 (20Steps) Second Image is Krea2 Turbo (8Steps)
Same prompt but for Ideogram it goes through another enhancement to make it a json prompt.
First Image is always Ideogram4 (20 steps), second image is Krea2 (turbo at 8 steps)
I used my Hermes Agent (Gemma4-31b at Q4) to do all the prompting and tool call to comfyui for generating those images, its not apples to apples because of ideogram4 json format, but its very close as the process starts with a long and detailed prompt, some of those came out very close in composition.
Advantage for Krea2 - Speed, World Knowledge, License.
Advantage for Ideogram4 - Fine Details, Better Composition.
I just realized I haven’t looked for any images to pdf, youtube downloader, files manipulation (transforming .png to .ico etc) for weeks.
Hermes just does it all for me with ease, no rate limits, no upgrade to add more files, all of those websites were not relevant for programmers who knew the packages to use, they just do it in cli, now the average Joe can also do it, in natural language.
“Tranform those images into a PDF”
Also letting it run on a folder full of unnamed images and organizing it based on vision and what’s actually in the image, insane!
Just a thought I wanted to share.
Within a day it built itself image generation, image editing, song generation, all using comfyui and llama cpp, not a single api call for any of this, gemma4-31B-it-qat is insane, no errors and no issues, all just works.
I am seriously blown away by the sheer amount of things this thing can achieve.
Whenever I talk in a foreign language through telegram, it does understand my words but translate it to English, it does not keep it in the same language it always translate it.
Faster Whisper should support auto detect and provide the LLM with the original language text transcription.
Hermes itself couldnt fix it,
But it either forces a specific language, or does not work any idea?
This was just Gemma4-31b coming up with memes / banned episodes of random shows, basically letting the LLM go ham and create a json for ideogram4.
There are more crazy results from uncensored Gemma4 but they are not appropriate for this subreddit and I rather not share them :D
Official WF from comfyui + detailed json prompts.
I am speechless at the detail and amount of control this brings, with a local model running alongside it, an image takes around 3 minutes to generate at quality preset + LLM stage to create structured json prompt, but results are outstanding, well worth it over a turbo model for most cases.
With that pipleine I see it as a true GPT-Image competitor, I can just provide a very simple prompt and the enhancing of prompt does it magic.
Its using the official comfyui workflow, and a custom node I made for the json part, pair this model with either Qwen3.6-27B or Gemma4-31B for best results.
Vibe coded a custom node for myself that uses local llama cpp server to enhance and expand simple prompt into a long json format prompt, unload the llama cpp model and go on with the generation.
makes it much easier to work with, and keeps the whole thing local.
You can git clone in /custom_nodes and use it as well!
https://github.com/iChristGit/comfyui-llamacpp-ideogram
Example workflow is based on the official comfy ideogram4 workflow.
Let me know if there are any issues.
I already set up all my custom tools 3 times, and sometimes after update they are just gone, the skills are still there so building the native tool and adding it to the toolset is easier for the LLM, but still can take 1-2 hours to get everything set up again.
The major tools are image gen, image edit and song generation all powered by comfyui.
I also create reddit tool, better web search for me that does not require apis and other small changes, /offload to offload models from llama cpp etc
Im kinda burned out and just want a continuously working agent but still being able to update regularly.
(Whenever there is a prompt to apply local changes I always press Y, so not sure why it keeps resetting the tools but keeps the skills memory etc)
Any insight will be helpful!
My agent has successfully created a new slash command for hermes /offload that can easily free my vram and offload the llamacpp model.
Also created 3 native tools, song\_generate, image\_generate and browse\_reddit.
The image and song generate are using comfyui locally, with vram offloading so i can squeeze ace step, z image and llm using 1 24g gpu.
I get a .png or .mp3 directly to telegram.
Things that took me weeks to set up with open webui has been created with a couple of prompts, no community tools, no special setup.
All specific to my needs.
This is so awesome! Wanted to see what more people do with their agent.
When you start a new hermes session what is the amount of context already used by skills/memory/user/soul.md? For you?
For me its 19K out of the 100K my 3090 can handle with Qwen3.6-27B
Ive tried to cut it but it just stays the same, it might be the massive amount of skills hermes ships with.
I assime it can also degrade model accuracy to have a lot of accumulated memories and “noise” in context
Any insight from the community will be helpful.
Hardware: RTX 3090Ti, 64GB RAM
Model: unsloth/Qwen3.6-27B-UD-Q4_K_XL. (MTP Version)
Prompt: "make a flappy bird in html" — fresh chat each run, all numbers pulled directly from llama.cpp output stats (open-webui)
Launch args
@echo off
cd "C:\Llama CPP"
set GGML_CUDA_NO_PEER_COPY=1
llama-server.exe ^
--host 0.0.0.0 ^
--port 8082 ^
-ngl 99 ^
--threads 2 ^
-b 2048 ^
-ub 512 ^
--cache-type-k q8_0 ^
--cache-type-v q8_0 ^
-fa on ^
-c 32768 ^
--mlock ^
--cont-batching ^
--spec-type draft-mtp ^
--spec-draft-n-max 1 ^
--reasoning off ^
--no-mmproj ^
--models-max 1 ^
--sleep-idle-seconds 480
pause
Full results
Depth |Gen Speed |Prefill Speed |Acceptance Rate |Draft Accepted |vs Baseline
No MTP |41.1 t/s |175.9 t/s |— |— |1x
MTP 1 |52.5 t/s |164.1 t/s |95.5% |1436/1503 |1.28x
MTP 2 |73.5 t/s |105.0 t/s |91.3% |1698/1860 |1.79x
MTP 3 |75.2 t/s |152.6 t/s |86.9% |2105/2421 |1.83x
MTP 4 |7.93 t/s |48.1 t/s |79.1% |1738/2196 |0.19x Still not sure why prefill drops in MTP2 and goes back to 152 with MTP3.
This was without any context so all of those responses started instantly, once there is context (system prompt, tools, etc) the context is at 1000t/s with MTP3.
Need to make more tests so don’t take notes of the prefill speeds.
Also tested other creative writing tasks and the speed-up is also noticeable!
This really shrinks the gap between the speeds of the 35B MoE and the dense model, I might just main one model now.
https://openwebui.com/posts/531f5d48-691f-41bc-95c7-bd0cad98d095
Made this with Hermes Agent, using the official docs and 10 tool examples to learn exactly how to make Open Webui tools, plugging this skill into Open Webui will let any LLM (preferably Qwen3.6/Gemma4) to create any kind of tool!
https://openwebui.com/posts/qr_code_generator_for_open_webui_fb931955
I got rate limited after 1 prompt using Claude and decided why not just create the Open-Webui tool with Open-webui itself! Used Qwen3.6-27B-Q5 and used the attached a webpage feature to give it the full docs of how to create openwebui tools, it created a fully working tool to just get any QR code created in seconds, embedded in chat and easily shareable.
It created both the code, the docs, everything, nothing special I did.
pretty cool knowing that I can someday just let the AI run and improve itself and create new tools and capabilities for itself!
Now we just need open-webui to have an ability to let the LLM enable the tools by itself when needed, to avoid needing to enable 100 different tools.