r/Gemma4

▲ 3 r/Gemma4+1 crossposts

Poor "intelligence" with Gemma4

I am testing Hermes with Gemma 4 (gemma-4-26B-A4B-it-OptiQ-4bit running with OMLX) on a Mac mini M4 64GB:

it is fast in terms of response times, but it sucks IMHO in terms of "intelligence" and "agency".

After several days spent (with the help of Claude) debugging and prompting I gave up: even a simple daily cron task (message me the output of curl -s 'https://wttr.in/{city1,city2,city3}?format=3') fails with hallucinations.

Same for a briefing (extracting news headlines from RSS feed links, for which I provided the python code as it was unable to code a working version of it): some times it works, most of the times it doesn't.

I was having much better results with much earlier explorations of OpenClaw.

Where am I wrong?

reddit.com
u/mkeee2015 — 2 days ago
▲ 10 r/Gemma4+1 crossposts

I built a Chrome extension that summarizes the paragraphs you scroll past — Gemma 4 via WebGPU, nothing is uploaded ✨

When you flick through a long article, Skim Recap notices the passage you skipped and shows a short recap next to your cursor. You stay where you are - no scrolling back up.

Each recap covers that one flick, not everything above it. Flick 4,000 px and you get those 4,000 px; flick again and the next recap is of the new stretch.

There's also a Feynman button: instead of restating the passage, it explains it, and is allowed to define a term the page never bothered to define.

How it runs:

- Gemma 4 E4B, on your GPU, through LiteRT-LM + WebGPU

- No API key, no account, no summarization server

- Article text never leaves the browser

Before you install — the honest part:

Running a real model in the browser isn't free. First use downloads a 2.97 GB model from Hugging Face, cached locally after that. You need WebGPU and about 22 GB of free disk space. If that's a dealbreaker, it's a dealbreaker, and I'd rather you know now than after the download bar starts.

Chrome Web Store: https://chromewebstore.google.com/detail/skim-recap/febndabjnmbmdodeoenjmnplfcalmnmc

More detail + source: https://skim-recap.vercel.app

u/One_Tradition_3492 — 5 days ago