Building my first RAG - what makes this harder than it looks?
I've just completed the corpus on a RAG I'm building for local lawyers, realtors, and contractors who want fast information about every parcel in town without having to go through town hall's antiquated records system. I'm not trying to make a buck - just trying to learn how to make AI more precise in domains where that's important.
The corpus is tiny (only a couple hundred PDFs). I plan to use structure-aware chunking with contextual enrichment. Here are the steps:
- Parse PDF into text
- Detect structure (agenda items, sections, paragraphs)
- Split at natural boundaries
- For each chunk, generate a context summary via Claude
- Prepend context to chunk before embedding
- Store both the enriched chunk (for embedding) and the raw chunk (for citation)
Am I on the right track? Any land mines to watch out for?