How do you get a local model to properly run as an agent?
Hello all, newbie to opencode and locally hosting llms in general, I figured I'd give it a shot so I can have an agent working on more menial background tasks while I work on high priority things. I've tried llama 3.1 and qwen 2.5 coder 7b with a context window of 16k. Whenever I use one of the free models opencode comes with, they function just fine and just go ahead and do what I tell them to. However, any exchange with either of the two local models goes like this:
- Me: Read (file), (file) and (file) and look for (something). Then implement a fix.
- Model: To answer your question, we can read a file using the read tool: (some raw JSON with the tool parameters) and the write tool (more raw JSON with tool parameters).
- Me: Go ahead and execute the tools you listed.
- Model: We can use the read tool: (again raw JSON)
It's honestly getting pretty tiring. I know my hardware is capable of running the model, but I can't seem to get it to act as a proper agent. Any solutions?