Open Web UI my usage (local LLM for a compagny)
Setup
Ryzen 9950X / 128 GB of RAM / RTX 5090 32 GB / 3.6 TB of NVMe, running Ubuntu.
The model is Qwen3.6-27B, quantized to int4, with a 32k context. vLLM, with reasoning and vision enabled. A single model does it all: chat, plan analysis, code generation, and tool invocation.
Architecture
Open WebUI is the single point of entry. Users only see this
vLLM performs inference using continuous batching—this is what allows it to process multiple requests simultaneously without anyone having to wait. Open Terminal serves as a sandbox: it executes the generated Python code, produces Word, Excel, PowerPoint, or PDF files, and, most importantly, reviews what it has just created to correct its own errors before returning the file.
RAGFlow handles document search. At the same time, an SQLite database stores numerical values to improve search speed.
For now, this is my setup,
I’d like to significantly improve the ability to generate PDF, Excel, and Word files,
Do you have any ideas? Open Terminal is good, but it lacks features like opening windows (open the excel file / see with vision and adapt) and others. I’m just getting started in the world of agents and related tools,
Any similar setups or needs?