u/ScalarNeo

▲ 2 r/Rag

Best open source model for RAG application

We are in hackathon, and we want to build a RAG application which can run locally. we are having 2 laptops: 32GB ram with i7 13th gen processor (with no GPU) and another with 16GB ram and i5 12th gen processor with 4GB nvdia graphics card. then according to you which OS LLM should we use for best performance and avoid hallucinations?

reddit.com
u/ScalarNeo — 2 days ago