u/Britbong1492

64k min tokens to run?

I set up a local LLM with auto compacting just to get this error message: "...which is below the minimum 64,000 required by the Hermes agent. Choose a model with at least 64K context".

What are the risks to just over-riding the settings in config.yaml ?

reddit.com
u/Britbong1492 — 5 days ago