u/minerinvocal

We could finally have a 'light at the end of the tunnel'. It looks like we have a workaround for long context on our local machines. The keyword is RIS-Kernel. I would really like to hear your opinions on it. They said it was tested on several subjects, and it worked just fine for all of them. In my opinion, if it is really true, it would be a waste that such a solution is not broadly known by the machine learning community.

As a frequent user of the advertised long-context LLMs, I often need to reset a conversation because the model starts to forget the previous context. It is very annoying to restart the prompt context all the time.
Does anybody know when we will have a real long-context LLM?