Could Local LLMs help discover relevant humans, not just relevant information?
Most work around Local LLMs focuses on helping users find information:
- RAG over documents
- Personal knowledge bases
- Semantic search
- Agent workflows
- Tool use
But I've been wondering about a different problem.
Imagine two people are:
- Reading the same documentation
- Exploring the same GitHub repository
- Researching the same model
- Working through the same technical problem
A local model could potentially understand the context of what a user is doing and identify others with overlapping interests or goals.
Instead of only answering questions, the model could help users discover relevant people.
Something like:
"Five other people have been researching this project recently."
or
"Three users are exploring the same inference optimization techniques."
Obviously there are major privacy and consent challenges, but I'm curious whether anyone here sees value in this concept.
Questions:
- Would human discovery be a useful capability for Local LLMs?
- Could embeddings be used to match interests or context while preserving privacy?
- Are there existing projects exploring this idea?
- Does this sound genuinely useful or just like another layer of noise?
Interested to hear thoughts from people building local-first AI systems and agents.