u/-davidde-

I'm trying to replace a Claude Code subscription with locally hosted LLM (tested several qwen models, mostly 3.5 9b and 27b with different contexts, on an Nvidia RTX 5060 16GB VRAM with 64GB system RAM). However, the models don't even seem to receive my prompts and just make up something to do or just ask me what they should do, when I've literally just told them. Is it possible at all with only 16 GB VRAM?