u/Temporary-Roof2867

Preamble 1: I'm a noob

Preamble 2: I don't know much English and I'm using the translator, so forgive me if I spell it wrong.

Preamble 3: Did I already say I'm a noob? 🤔 Forgive me if I'm naive!

I often see many users creating very small LLMs, even less than a billion parameters, and then sticking to a few million; it's certainly much easier because there's no need for huge resources like large GPUs! However... if you created a system of many of these micro LLMs (I think they're called 'SLMs'? I don't know because I'm a noob), each interacting with each other with a different function but integrated into a "single system", in total they could perhaps be equivalent to an even larger LLM of... 3 billion parameters? Or even... 12 billion parameters? Or even more? Is it possible to do it? If so, has anyone already tried it? I wouldn't even know where to begin! So I'm asking you, who know so much more than I do.

Forgive the naivety of this post, I'm a noob, bear with me! If a project, understood as a set of files, is larger than the context window of a model, how do you fit it in? After doing some naive research, various major LLMs like Deepseek, Kimi, and company say the solution is Aider, which creates a sort of "map" of the project and tells the agent which portion should be used at that moment. But this sort of "map" isn't a permanent memory but something temporary. Is this really the case, or are these just collective hallucinations of major LLMs? Searching here on Reddit, very few people talk about Aider, and those few speak badly of it. I'm trying Aider and I'm finding it very inconvenient, but I'm just starting out. What are the alternatives, if any? Or is this problem currently unsolvable? That is, in reality, an agent can't act on a project if it's larger than its context window? Thank you all for your attention.