
Context/token question??
So I used google/gemma-4-31b-it:free from openrouter. But when I almost reached/around 30k+ tokens (based on chat memory), it seems like the LLM went into seizure even if I use a different api key with the same model. Rerolling the message also doesn't help at all. In OpenRouter, the model is stated to have 262k of context. But when I made a new chat, the reply went on normally, so I guess it's because of the context itself.
The eventual seizure of the LLM
Can this be resolved without changing to a different model? Or if not, I would like to at least understand the cause of this. Is it possible for message rerolling to add some sort of invisible token/memory?