▲ 3 r/LocalLLM
Which LLM model should i use?
Quick background - i read and summarize a lot of medical records that come in huge PDFs, like 5000pages.
I was thinking of trying the NVIDIA DGX Spark, to run some LLM, to help break up the PDFs into dates of service, and then summarize them.
Does anyone have any idea if that will work, and if so which LLM would you suggest I start with.
It's important to stay local, for HIPAA compliance.
Thanks!!
u/brianbonedoc — 3 hours ago