Does vllm *need* a restart once in a while?
Out of the blues I started getting replies from the agent that completely broke tool parsing. Like
<read", "path": "/home/agent/.agents/skills/research/SKILL.md"}{"path": "/home/agent/.agents/skills/research/SKILL.md"}</read>
I checked all my code and made sure nothing I did today could have impacted this. No changes in version, nothing. But try after try, it just kept outputting this kind of garbage.
Out of desperation, I shutdown vllm and turned it back on. Lo and behold, it works like a charm again.
So now I'm really confused, are we supposed to refresh vllm once in a while? Could long running sessions corrupt memory in a way that harm the way it works?