Need help setting up a local RAG chatbot with Flowise + Ollama
Need help setting up a local RAG chatbot with Flowise + Ollama
Hi everyone,
I'm pretty new to AI development and I'm trying to learn how to build local RAG chatbots using Flowise and Ollama. My long-term goal is to learn how these systems work so I can eventually build chatbots for businesses, but right now I'm just working on a simple learning project.
The project I'm trying to build is a fitness-only RAG chatbot. I've created a fitness knowledge base text file, installed Ollama, downloaded the llama3.2 and nomic-embed-text models, and set up a document store in Flowise.
The problem is that I can't get the document store working properly. When I try to upsert my knowledge base, I keep getting errors. I've tried multiple vector stores (including Chroma and FAISS), changed settings, and followed several tutorials, but I still can't get the documents indexed successfully.
I've also had issues with Flowise itself. I wasn't able to get a normal local installation working through Command Prompt and ended up running it through Docker instead. Ollama itself seems to work fine — I can run models directly from the command line without any issues.
At this point I'm not sure whether the problem is:
- My Flowise installation
- My document store configuration
- My vector store configuration
- The way I've set up embeddings
- Or something else entirely
I'm attaching screenshots of my setup and the errors I'm getting.
If anyone has experience with Flowise, Ollama, local RAG systems, or document stores, I'd really appreciate any advice on what I might be doing wrong.
Thanks!