u/Sullinator07

Is it smart to run two separate local models for different roles, or am I overengineering this?

Hardware:

• i9-13900K
• RTX 3090
• 96GB DDR5

Current thought process:

• Primary model for RAG + general business Q&A/report drafting:
  • Qwen 3 27B Dense @ Q4_K_M
• Secondary model for automations/tool-calling/agent workflows:
  • gpt-oss 20B @ Q5_K_M

Idea is basically:

• One “thinking/writing” model
• One “doer” model

Does this architecture actually make sense in practice, or am I overthinking it?

Thanks in advance!