Best harness for coding with local LLM... Pi, OpenCode, Qwen Agent, Claude Code,...

Vote the best harness for coding with local LLM

  • Pi
  • OpenCode
  • Qwen Agent
  • Claude Code
  • DeepSeek Harness
  • ...

Tell me yuor favourite and why if possible.

I vote mine

  1. Pi, for speed and low context usage.
  2. OpenCode, good balance of speed and token consumption, the most mature for local AI.
  3. Qwen Agent, for all rounding, good tools.
  4. Claude Code, for wasting tokens.
  5. DeepSeek Harness, everyones mad for it, but it creates more troubles than goodness here :D
reddit.com
u/sblantipodi_ — 2 days ago
▲ 16 r/unsloth

Qwen 3.8 27B NVFP4 and RTX5090 with 32GB, no more than 128K context possible.

As title.

Using vLLM with this params:

unsloth/Qwen3.8-27B-NVFP4

--dtype auto

--safetensors-load-strategy=prefetch

--tensor-parallel-size 1

--attention-backend flashinfer

--performance-mode interactivity

--language-model-only

--skip-mm-profiling

--kv-cache-dtype fp8_e4m3

--gpu-memory-utilization 0.94

--cpu-offload-gb 0

--max-model-len 128000

--max-num-seqs 1

--max-num-batched-tokens 6144

--enable-chunked-prefill

--enable-prefix-caching

--no-disable-hybrid-kv-cache-manager

--reasoning-parser qwen3

--default-chat-template-kwargs '{"enable_thinking": false}'

--enable-auto-tool-choice

--tool-call-parser qwen3_coder

--quantization compressed-tensors

--speculative-config '{"method":"mtp","num_speculative_tokens":3}'

I can't go past 128K context with 32GB of VRAM.

Is there a way to achieve 200K context?

I can't extend --gpu-memory-utilization 0.94

cause I need that vram for the destkop.

reddit.com
u/sblantipodi_ — 3 days ago

Qwen3. 6 27B, unsloth vs Nvidia checkpoint

Using Qwen 3.6 27B here with vLLM.

I noticed that the unsloth checkpoint requires significantly more ram than the Nvidia checkpoint.

Why? They are both NVFP4, is the unsloth checkpoint really better than the Nvidia one?

reddit.com
u/sblantipodi_ — 7 days ago

Unsloth checkpoint Vs Nvidia checkpoint

Using Qwen 3.6 27B here with vLLM.

I noticed that the unsloth checkpoint requires significantly more ram than the Nvidia checkpoint.

Why? They are both NVFP4, is the unsloth checkpoint really better than the Nvidia one?

reddit.com
u/sblantipodi_ — 7 days ago
▲ 15 r/Qwen_AI

Thank you Alibaba, Qwen 3.6 27B NVFP4 is crazy good on RTX5090

As title,

coding with Qwen 3.6 27B NVFP4 is crazy good on RTX5090.

126 token per second with NVFP4 and MTP3 with vLLM.

bye bye Claude and OpenAI.

u/sblantipodi_ — 11 days ago
▲ 12 r/JavaFX

[JavaFX memory hog] A simple UI requires 1GB of RAM.

https://preview.redd.it/7ct94qsc91fh1.png?width=452&format=png&auto=webp&s=995a9ecdf9e70253860aa9c9ca809d60dc885685

https://preview.redd.it/yyoylpsc91fh1.png?width=452&format=png&auto=webp&s=e9c6290f129bac7ff54c6300218152698b55c8e2

This UI, requires 1GB of RAM on Linux. The same UI does not require more than 300MB on Windows.
I would not consider it cheap on Windows but on Linux it's pretty unacceptable.

How this is possible? Is there some problems with JavaFX in Linux Wayland?

Thanks
Davide

reddit.com
u/sblantipodi_ — 28 days ago

Are there any discounts for professional level exams?

As title.

Are there any vouchers or discounts?

I usually see discounts, now that I need it I can't find them xD

reddit.com
u/sblantipodi_ — 29 days ago

Is Qwen still relevant for local AI?

As title.

It seems that they stopped releasing small (but good) models that can run locally like Qwen 3.6 27B.

Where is Qwen 3.8 27B?

Do they abandoned the models for peasants?

reddit.com
u/sblantipodi_ — 29 days ago

I failed my AIP‑C01 Generative AI Developer Professional exam.

I usually pass every certification exam I take because I tend to study thoroughly before sitting for it.

This time, however, I scored 725/750 and failed the AIP‑C01 exam.The problem is that I don’t know what else I should study to pass the exam with confidence.

I’ve covered all the topics listed in the exam guide, yet I still didn’t pass.

I’ve also completed the Tutorial Dojo practice exams with ease, but that didn’t translate into success on the real test.Do you have any suggestions?

reddit.com
u/sblantipodi_ — 1 month ago

IntelliJ AI Agent doesn't work with 1000 lines files

I'm using the gen ai plugin with Qwen 3.6 27B on a RTX5090 using the qwen coder agent.

the read_file tool is pretty bad. the agent have troubles reading a file of 1000 lines even if I configured qwen for a 131K context with a modelconfig.

The agent continue to say:

The read_file keeps ignoring offsets on this large file. Let me use grep with more context to see the exact block I need to edit:

I have no problems with smaller files but the jetbrain agents does not work with 1000 lines files

Any idea?

reddit.com
u/sblantipodi_ — 2 months ago
▲ 21 r/Qwen_AI+1 crossposts

Qwen 3.6 27B local and IntelliJ or CLion.

hi there... is there someone using Qwen 3.6 locally with IntelliJ or Clion?

I'm using Ollama with Qwen 3.6 27B running on a RTX5090 with 32GB of VRAM.

I integrate this in intellij using the official jetbrain's "AI Chat " along with a Qwen Code agents installed via the ACP registry.

The model fits perfectly in the VRAM but when I try to ask him something, it overthinks for minutes, and then often ends up asking me on what he is working on because he forgot it.

What am I doing wrong?

People says that qwen 3.6 is good but to me it seems completely unuseful even on a power system like an RTX5090 with 32GB of VRAM.

reddit.com
u/sblantipodi_ — 2 months ago

Luciferin: dynamic bias lighting masterpiece

Luciferin is an open‑source suite that transforms your monitor into a beautiful dynamic bias‑lighting system.

The project uses a PC application that captures the screen and sends color data to a firmware running on a microcontroller, which then drives the LEDs through a dedicated hardware PCB.

the software is really advanced, and it can handles various satellites for cinematic bias lighiting effect.

Key features:

- Best in class performance combined with ultra low CPU/GPU usage.

- Advanced algorithms for smooth colors transitions and color correction.

- Wireless or cabled, local or remote? Choose your flavour with MQTT support and Home Assistant integration.

- Multi monitor support with single or multiple instances.

- Surround lighting with satellites.

- Web browser firmware installer and Web Interface.

- Programmable firmware, change your microcontroller's settings on the fly.

- Frequent updates, upgrade your PC software and your firmware in one click.

- Automatic switching between aspect ratios based on your video content.

- Made from a gamer, for gamers. No added lag, stutter free.

- Multi platform, Windows and Linux ready. macOS is coming when it's ready.

There is also a complete wiki here:

https://github.com/sblantipodi/firefly_luciferin/wiki

here a video of the software in action

https://youtu.be/PO37JC7-Nn4?si=ZcGqRiugqlXtypvu

please leave a star on GitHub if you like it :slight_smile:

https://preview.redd.it/ae70z0eps60h1.png?width=2642&format=png&auto=webp&s=cb66cbfe47c379ae0b208ce7d3d535d726f920cf

https://preview.redd.it/036hc8lps60h1.jpg?width=1024&format=pjpg&auto=webp&s=65ce3c7fe53f993f5a7e8a9b66ab242321311e44

https://preview.redd.it/4z7dxtwps60h1.jpg?width=1755&format=pjpg&auto=webp&s=16066826f844c16f86e4ce4cadce3006c86b9e8c

https://preview.redd.it/mxrd6u4qs60h1.jpg?width=1580&format=pjpg&auto=webp&s=c4d9f8c4a6ba75e223d571aa5c67c9f2a2d45be3

https://preview.redd.it/yydlccfqs60h1.jpg?width=4096&format=pjpg&auto=webp&s=9b3292c9cb3b38b1e119b96d4e5a19b52399726a

https://preview.redd.it/kmr2o7nqs60h1.jpg?width=4096&format=pjpg&auto=webp&s=a634da438b2dad72fed2a4cdb0023f1e3dc58ef9

https://preview.redd.it/qhh769uqs60h1.png?width=1110&format=png&auto=webp&s=c88da28a57db42f5f584e649af40d202a9caa823

reddit.com
u/sblantipodi_ — 3 months ago

Luciferin: dynamic bias lighting masterpiece

Luciferin is an open‑source suite that transforms your monitor into a beautiful dynamic bias‑lighting system.

The project uses a PC application that captures the screen and sends color data to a firmware running on a microcontroller, which then drives the LEDs through a dedicated hardware PCB.

the software is really advanced, and it can handles various satellites for cinematic bias lighiting effect.

Key features:

- Best in class performance combined with ultra low CPU/GPU usage.

- Advanced algorithms for smooth colors transitions and color correction.

- Wireless or cabled, local or remote? Choose your flavour with MQTT support and Home Assistant integration.

- Multi monitor support with single or multiple instances.

- Surround lighting with satellites.

- Web browser firmware installer and Web Interface.

- Programmable firmware, change your microcontroller's settings on the fly.

- Frequent updates, upgrade your PC software and your firmware in one click.

- Automatic switching between aspect ratios based on your video content.

- Made from a gamer, for gamers. No added lag, stutter free.

- Multi platform, Windows and Linux ready. macOS is coming when it's ready.

There is also a complete wiki here:

https://github.com/sblantipodi/firefly_luciferin/wiki

here a video of the software in action

https://youtu.be/PO37JC7-Nn4?si=ZcGqRiugqlXtypvu

please leave a star on GitHub if you like it :slight_smile:

https://preview.redd.it/cmv66f1ls60h1.png?width=2642&format=png&auto=webp&s=df85fc86b4740669cfb8f038b7903180b337d55c

https://preview.redd.it/qb3uzi9ls60h1.jpg?width=1024&format=pjpg&auto=webp&s=c191c601ea1832622a797ed9376ad9e2fa5ea86c

https://preview.redd.it/c6e3f5lls60h1.jpg?width=1755&format=pjpg&auto=webp&s=d0369312bf352715aeb79b7f793ad8a90087bbed

https://preview.redd.it/slve0huls60h1.jpg?width=1580&format=pjpg&auto=webp&s=825c5c7aae8a733c802def012f8355b1d332a6bd

https://preview.redd.it/0mr3td6ms60h1.jpg?width=4096&format=pjpg&auto=webp&s=c0f77b359e3d9fd1ba1049c7b34c1a9927b8948f

https://preview.redd.it/yq9edpims60h1.jpg?width=4096&format=pjpg&auto=webp&s=97c2a01104e8627cb4bd05f9af5ffb8f22c638cd

https://preview.redd.it/xszgwevms60h1.png?width=1110&format=png&auto=webp&s=5285fb18f2d7a9af46e54c61f7f95513394e1bed

reddit.com
u/sblantipodi_ — 3 months ago
▲ 2 r/led

Luciferin: dynamic bias lighting masterpiece

Luciferin is an open‑source suite that transforms your monitor into a beautiful dynamic bias‑lighting system.

The project uses a PC application that captures the screen and sends color data to a firmware running on a microcontroller, which then drives the LEDs through a dedicated hardware PCB.

the software is really advanced, and it can handles various satellites for cinematic bias lighiting effect.

Key features:

- Best in class performance combined with ultra low CPU/GPU usage.

- Advanced algorithms for smooth colors transitions and color correction.

- Wireless or cabled, local or remote? Choose your flavour with MQTT support and Home Assistant integration.

- Multi monitor support with single or multiple instances.

- Surround lighting with satellites.

- Web browser firmware installer and Web Interface.

- Programmable firmware, change your microcontroller's settings on the fly.

- Frequent updates, upgrade your PC software and your firmware in one click.

- Automatic switching between aspect ratios based on your video content.

- Made from a gamer, for gamers. No added lag, stutter free.

- Multi platform, Windows and Linux ready. macOS is coming when it's ready.

There is also a complete wiki here:

https://github.com/sblantipodi/firefly_luciferin/wiki

here a video of the software in action

https://youtu.be/PO37JC7-Nn4?si=ZcGqRiugqlXtypvu

please leave a star on GitHub if you like it :slight_smile:

https://preview.redd.it/js9y7cfbs60h1.png?width=2642&format=png&auto=webp&s=c14dc6f1cc2fa16dc8daf466d50acd54a614ed99

https://preview.redd.it/02gs5inbs60h1.jpg?width=1024&format=pjpg&auto=webp&s=c226aff1debefd38b7ec2304a754845cd227fd07

https://preview.redd.it/pov4tbxbs60h1.jpg?width=1755&format=pjpg&auto=webp&s=17c00a8684a0cb3e461dd21363e31a5abc8f172f

https://preview.redd.it/4dehjo6cs60h1.jpg?width=1580&format=pjpg&auto=webp&s=ea0962467ab0367dcec1d54f4999f01f84624cc5

https://preview.redd.it/q27e81ecs60h1.jpg?width=4096&format=pjpg&auto=webp&s=df176dc04d5647a4315ae5a7b9426b50794ff68b

https://preview.redd.it/jcwyonocs60h1.jpg?width=4096&format=pjpg&auto=webp&s=d760e76c3622ca6e10de9b0d1f45187c500bf185

https://preview.redd.it/auopa1ycs60h1.png?width=1110&format=png&auto=webp&s=2ae37a122f376acdc524c814bf2b02f2b95d2e3f

reddit.com
u/sblantipodi_ — 3 months ago

Luciferin: dynamic bias lighting masterpiece

Luciferin is an open‑source suite that transforms your monitor into a beautiful dynamic bias‑lighting system.

The project uses a PC application that captures the screen and sends color data to a firmware running on a microcontroller, which then drives the LEDs through a dedicated hardware PCB.

the software is really advanced, and it can handles various satellites for cinematic bias lighiting effect.

Key features:

- Best in class performance combined with ultra low CPU/GPU usage.

- Advanced algorithms for smooth colors transitions and color correction.

- Wireless or cabled, local or remote? Choose your flavour with MQTT support and Home Assistant integration.

- Multi monitor support with single or multiple instances.

- Surround lighting with satellites.

- Web browser firmware installer and Web Interface.

- Programmable firmware, change your microcontroller's settings on the fly.

- Frequent updates, upgrade your PC software and your firmware in one click.

- Automatic switching between aspect ratios based on your video content.

- Made from a gamer, for gamers. No added lag, stutter free.

- Multi platform, Windows and Linux ready. macOS is coming when it's ready.

There is also a complete wiki here:

https://github.com/sblantipodi/firefly_luciferin/wiki

here a video of the software in action

https://youtu.be/PO37JC7-Nn4?si=ZcGqRiugqlXtypvu

please leave a star on GitHub if you like it :slight_smile:

https://preview.redd.it/37jonh12s60h1.png?width=2642&format=png&auto=webp&s=9553c9fbdff00066344a372e4fd35d5a610a5fd6

https://preview.redd.it/tj4qhjh2s60h1.jpg?width=1024&format=pjpg&auto=webp&s=aece27f0c4253569c1c1bd10feb6930968840a63

https://preview.redd.it/h4nei8s2s60h1.jpg?width=1755&format=pjpg&auto=webp&s=b76fc1bd69179f04666975fa594573a04afbe9a0

https://preview.redd.it/ovi7wc93s60h1.jpg?width=1580&format=pjpg&auto=webp&s=42cbda267b567434fa9ff9e8e830c3c23573211b

https://preview.redd.it/4f7irtx3s60h1.jpg?width=4096&format=pjpg&auto=webp&s=c4785e5cb258328fa8f86b28a5777c4d958ec8f2

https://preview.redd.it/lyr64x44s60h1.jpg?width=4096&format=pjpg&auto=webp&s=046be02bfa1b38b7094a7a1765a8216e46267192

https://preview.redd.it/gqpn5se4s60h1.png?width=1110&format=png&auto=webp&s=54ed3fe88b7b8a90794d0293ca0affc90e80a261

reddit.com
u/sblantipodi_ — 3 months ago

Luciferin dynamic bias lighting masterpiece

Luciferin is an open‑source suite that transforms your monitor into a beautiful dynamic bias‑lighting system.

The project uses a PC application that captures the screen and sends color data to a firmware running on a microcontroller, which then drives the LEDs through a dedicated hardware PCB.

the software is really advanced, and it can handles various satellites for cinematic bias lighiting effect.

Key features:

- Best in class performance combined with ultra low CPU/GPU usage.

- Advanced algorithms for smooth colors transitions and color correction.

- Wireless or cabled, local or remote? Choose your flavour with MQTT support and Home Assistant integration.

- Multi monitor support with single or multiple instances.

- Surround lighting with satellites.

- Web browser firmware installer and Web Interface.

- Programmable firmware, change your microcontroller's settings on the fly.

- Frequent updates, upgrade your PC software and your firmware in one click.

- Automatic switching between aspect ratios based on your video content.

- Made from a gamer, for gamers. No added lag, stutter free.

- Multi platform, Windows and Linux ready. macOS is coming when it's ready.

There is also a complete wiki here:

https://github.com/sblantipodi/firefly_luciferin/wiki

here a video of the software in action

https://youtu.be/PO37JC7-Nn4?si=ZcGqRiugqlXtypvu

please leave a star on GitHub if you like it :slight_smile:

https://preview.redd.it/4bnykiefr60h1.png?width=2642&format=png&auto=webp&s=d7f21a3831b3cf98964e0139d14273902b0a8f2d

https://preview.redd.it/wzl8ku1gr60h1.jpg?width=1024&format=pjpg&auto=webp&s=25e6d2ab449f0a02989bb3189efaf88d4c818e1b

https://preview.redd.it/lkyoe1ggr60h1.jpg?width=1755&format=pjpg&auto=webp&s=3871a80f53266fdafaf40c95f7e1c7b74b3944f9

https://preview.redd.it/77x377ygr60h1.jpg?width=1580&format=pjpg&auto=webp&s=aa6b20c84b56cc8dc2dfcc4bebb2bc6e836c4211

https://preview.redd.it/rmuuufdhr60h1.jpg?width=4096&format=pjpg&auto=webp&s=788c6b549e28e4441aa0b48e5e4694e39616bb0d

https://preview.redd.it/3wlgpdshr60h1.jpg?width=4096&format=pjpg&auto=webp&s=ebe5d661e8eaf1e0114cb1b8ca333437bf8eff1f

https://preview.redd.it/ufmo0l6ir60h1.png?width=1110&format=png&auto=webp&s=57a8018d5db5580f8e443d9625a77cf323e3baef

https://preview.redd.it/30v97zkir60h1.jpg?width=543&format=pjpg&auto=webp&s=205578a2d5cd6c735525825439df2fe54240daa0

reddit.com
u/sblantipodi_ — 3 months ago