Is it possible to use locally deployed open-source LLMs to scan local documents and build a private local vector database for offline document query assistant?
Is it possible to use locally deployed open-source LLMs to scan local documents and build a private local vector database for offline document query assistant?
I want to build a fully offline local document assistant:
Scan various local files (PDF, Word, txt, images with text)
Use local AI model to extract & parse content
Automatically store data into local vector database
Realize offline intelligent retrieval and Q&A without internet
What complete technical stacks, deployment tutorials and best practices do you recommend? Thanks a lot
u/FLY123456ai — 7 days ago