OpenWebUI MCPs don't work on local models

OpenWebUI MCPs don't work on local models

Hi all, I am implementing a local offline LLM (Qwen3.6 35b A3b) to analyse my splunk logs. I have confirmed the MCP works because it works fine when I use a cloud model but the moment I use a local model, it says it can't access my Splunk instance and just gives me a search to run myself.

Whats the deal? I have Function calling set to native if that changes things?

Edit: I fixed it, though not satisfactorily. Its cause my KV cache was overflowing and the LLM would just go wild without context and basically forget that it even connected to splunk mcp in the first place. I ran it with a much lighter model and started to get results

https://preview.redd.it/bzbrx2cnl4ih1.png?width=941&format=png&auto=webp&s=a37e31bdfa33ead45edd879dc56fdfd6aa35274f

reddit.com
u/Public-Lychee-5603 — 12 days ago
▲ 2 r/MCPservers+1 crossposts

Weird MCP calls

So I connected my splunk instance to Hermes via MCP and I was running nemotron models to extract some information from my splunk instance. The tool calls seemed to be fine at first but them there was a spontaneous skills patch that Hermes did that created a bunch of weird pseudo MCP tool calls that mimicked what my actual splunk mcp calls were but were just completely wrong.

What happened and how can i fix it?

Pseudo mcp tools that are incorrect

Actual MCP tools

reddit.com
u/Public-Lychee-5603 — 13 days ago