u/vanilla_cappucchino

Been building RAG stuff and starting to think a lot about failure modes , curious if anyone's had their retrieval/RAG setup confidently give a wrong answer in prod (or a demo), and what that looked like on your end.

Specifically curious:

• how'd you even catch it (user complained? you noticed manually? never did?)
• did you know why it happened — bad chunk, bad retrieval, stale doc, prompt issue?
• what'd you actually do to fix it

Not selling anything, just trying to understand real failure patterns instead of guessing. Would love to hear stories 🙏