
Finetuned Qwen3.5-4B: NuExtract3 released, open-weight 4B VLM for Markdown, OCR and structured extraction
Disclaimer: I work for Numind, the company behind this open-weight model
We just released a 4B model based on Qwen3.5-4B, under Apache-2.0 license. The goal is to make information extraction from complex documents more practical with an open model: PDFs, screenshots, forms, tables, receipts, invoices, multi-page documents, and other visually structured inputs.
Many thanks to the Alibaba Qwen team behind this wonderful model, it was fairly good at OCR from the get-go and the finetuning process was a bliss since most libraries integrate their architecture fast.
Try it, we have a huggingface space that is completely free (you don't even have to sign-up): https://huggingface.co/spaces/numind/NuExtract3
If you ever used NuMarkdown, NuExtract3 is the successor.
There are some examples to guide you. Feel free to re-use this model for any task.
A few things it is designed for:
- converting document images to Markdown
- extracting structured data from documents using a target json template
- handling tables, forms, and layout-heavy pages
- working with both text and visual document inputs
- serving as a local/open-weight alternative for document extraction pipelines
It was trained on a node of 8xH100 for 3 days to train on as much context as we could, so it should perform fairly well even on long document. For Markdown, we'd still recommend going page by page for the best results and inference speed, since you can parallelize better this way.
It's very easy to self-host, since we provide fairly extensive documentation, Safetensors, GGUF and MLX weights. With as little as 4GB of VRAM, you should be good to go. We provide multiple quantizations (GPTQ, W8A8, FP8, Q4, Q6...) so you should be able to run it anywhere.
We mostly tried vLLM, SGLang, llama.cpp.
We have a blog post and a pretty decent model card:
- https://about.nuextract.ai/blog/nuextract-3-release
- https://huggingface.co/numind/NuExtract3
- https://huggingface.co/collections/numind/nuextract3
I'm currently writing a paper on this model so I'll post it as soon as it's accepted. It's not yet on Arxiv yet as it has been submitted in a peer-review journal/conference.
I'll try to answer as many questions as possible if you have any. We would really appreciate feedback from the community.
We also have a discord if you're interested
https://discord.com/invite/3tsEtJNCDe