Qwen 3.6 always generates linux path horribly wrong. Am I doing something wrong?
Everyone says Qwen 3.6 is very good, but I could not use it because it always had a problem with path generation. I though it was because of Q4 quantization so I upped to Q6. Nothing changes. Every finetune model, every size variant straight up hallucinates wrong path for some reason. I had no problem with Gemma4. Any clues?
Example: "/home/username/PROJ/rabbit" becomes "/home/username/PROX/Rabbit" or "/home/UsErNaMe/PROj/ra" and such.
llama.cpp option:
(I tried --top-k 25 --top-p 0.95 --min-p 0 --temp 0.7 initially. Also tried -ctk -ctv full precision)
-m "$MODEL" \
-dev CUDA0 \
-ngl 99 \
-ctk q8_0 -ctv q8_0 \
-fa on -c $CTX -np 1 \
--cache-ram 0 --no-warmup --jinja \
--no-mmproj \
--reasoning auto \
--dry-multiplier 0.5 --dry-base 1.75 --dry-allowed-length 2 \
--dry-sequence-breaker '\n,:"/' \
--top-k 15 --top-p 1.0 --min-p 0.2 --temp 1.0 \
--host 127.0.0.1 --port $PORT \
> /tmp/llama-server-qwen.log 2>&1 &