Agent Not Working
Hey guys,
I'm trying to get a local AI agent to create and edit files on my Windows machine, but I’m stuck in a frustrating loop. Every time I ask the agent to do a file operation, it just prints the raw JSON tool call into the chat box or terminal instead of actually executing it.
My Specs:
- Windows
- 12 GB RAM
- Backend: Ollama (running locally)
- Model: qwen2.5-coder:7b
The Issue: If I tell the agent: "Create a text file named salut.txt containing 'hello'", nothing happens on my drive.
- In Open Interpreter, it just prints the PowerShell code inside a text block: {"name": "execute", "arguments": {...}} and stops dead.
- In AnythingLLM (Workspace Agent mode), it does the exact same thing. It spits out: { "name": "create-text-file", "arguments": { "filename": "salut.txt", ... } } right in the chat bubble.
The model clearly understands what I want and formats the JSON perfectly, but the host apps (AnythingLLM / Open Interpreter) won't intercept it to trigger the actual script.
Has anyone managed to get Qwen's tool-calling to actually work with Ollama on Windows? Do I need a specific system prompt or a workaround to force the apps to recognize the JSON output as an action?
Thanks!