u/VirtualWishX

Since I came from Open Code and now from LM Studio BIONIC I could choose the main project folder where I run all my chat/code sessions so I won't need to tell the prompt where the project files, folders and sub-folders on every single new session.

But... how does it work in **unsloth Desktop**?

When I created a Project, all I see is a **RAG** related files when I **Linked folder**...

because it says:

Linked local folders
Keep supported documents indexed as this folder changes.

but I'm not talking about RAG related only (PDFs, docs, or text).
I would like to define the main Project Folder with all my sub-folders and files without telling it every single time in the prompt?

I tested it just in case it's not only RAG related, but it didn't know where my project files are when I asked it, another test I did was to create a simple MD file, but it didn't appear in the: Link Folder that I chose...
When I asked where the files are, I noticed it's a weird path I did not like at all... I noticed that's where unsloth desktop create it's projects but it's not to my taste, I definitely prefer to pre-define folder so it will only look inside it and it's sub-folders, similar to how Open Code, VS Code, LM Studio BIONIC and others works.

Since I just moved to unsloth Deskop it's new to me so maybe I need to click some hidden feature or do something in the settings, I'm not sure, maybe it's simple but I missed it that's why I'm asking here.

and if I'm not telling the prompt... it seems to create a random folder with some weird path I'm not interested in since I have a very specific project folders and paths to keep things organized.

---

Can somebody please guide me where this option is hidden and how to set it up so I can work in each project path folder with ease?

Thanks ahead! 🙏❤️

If I understood correctly, Qwen 3.8 27B have 3 thinking modes:
- LOW
- MEDIUM
- XHIGH

My question is:
Which are actually apply within Unsloth Desktop because we have 5 modes:

Is it:
- Low
- Medium
- Extra High

or

- Preserve Thinking

or maybe Preserve Thinking = Xhigh actually? 🤔

---

Can somebody please explain and approve which one works,
and from which one to ignore while working with Qwen 3.8 27B ?

Thanks ahead 🙏

So I'm using RTX 5090 32GB VRAM and doing lots tests with the brand new Qwen 3.8 27B
Since I get super slow speed something like 30-37 tps (with the official unsloth model version and recommended settings) it's not crazy fast but also Qwen 3.8 27B on MEDIUM thinking enjoy eating Context so everything takes A LOT OF TIME.

SO!
I wanted to try the new NVFP4 from unsloth, but I noticed it's not in the Model Hub at all (I tried filtered and manually typing it etc..) there are many NVFP4 but not the official unsloth release:
👉 https://huggingface.co/unsloth/Qwen3.8-27B-NVFP4

Sure, probably it won't be amazing as Q5_K_M or Q6 but I'm curious about the SPEED!

So, in LM Studio BIONIC I can just enter the URL and it will grab it and place it in the correct folder and will run with ease...

I didn't find any secret button or other way to do the same to insert custom URL to download models that does not appear in unsloth Desktop

I find it strange because it's unsloth Desktop and Unsloth Model release... and it can't show it? 🤔
Considering it's already 3-4 days out there... I'm not sure why, but it's strange.

Maybe there is a way to grab it via unsloth Dekstop and I'm missing something?
Please tell if it is.

If it helps:
I'm using the most up to date unsloth Desktop app version for Windows 11

--

Anyhow,
I'm not here to complain, I'm here to help with my feedback and hopefully the amazing unsloth team devs will see this and will be able to improve these things for the Desktop app and also allow to just type in the URL for the model to grab it if it's not in the filtered built-in Model Hub.

Hi All,
With my hardware I'm getting about 31-37 tps:

• Intel Core Ultra 9 285K
• Nvidia RTX 5090 32 GB VRAM
• 96 GB RAM DDR5 6400 MHz
• NVMEe SSD M.2 SSD
• Windows 11 Pro

But then I ran into this:
https://www.youtube.com/watch?v=NjfHqiNHTxk

Still, not sure how to actually make it work within UNSLOTH DESKTOP software.

Do I need to play with some files? do I only change something in the GUI?
What settings do I change beside turning on MTP or DRAFT and which one exactly?
What numbers do I need to type in?

Can somebody please add a screenshot of the settings so I can give it a try and see if I actually gain speed?

Hi, I'm playing around with Unsloth Desktop (already fell in love ❤️) and I'm also using the fresh Qwen 3.8 27B via 100% local randomly testing things at the moment.

I really wanted to test the new feature which allow to describe a VIDEO, but I noticed when I try to add any popular container/codec such as mp4/h.264 or others, sadly Unsloth Desktop does not accept any at all in the chat or project files.

---

Just to be clear - I'm not talking about the Drag and Drop issue:
https://github.com/unslothai/unsloth/issues/9036

I'm talking about the option to do that even with the + PLUS button to add files to the current chat (or project), it seems like unsloth Desktop is not there yet but I just realized it.

I hope that the amazing unsloth team will make it happen soon so I won't need to move from this wonderful app, because I REALLY want to grow with it and stop moving from one app to another.

Thanks ahead for your hard work! ❤️

NOTICE:
The VIDEO is CUT from 4 minutes of gameplay, you can watch the BOSS at the end 😉

Hello World!
I've tried so many agentic/harness apps in the last few months, and FINALLY I found out that UNSLOTH DESKTOP feels good, and I'm saying this because I'm not a programmer and I don't understand code, yet...

I just grabbed it, installed it, also downloaded Unsloth Qwen 3.8 27B Q5_K_M from unsloth desktop of course it was easy as 1, 2, 3...

I created a Project, selected an empty folder for it, and dropped in the markdown (MD) file with a mini-game prompt as my very first test with BOTH: the model and the app! 🤞

And... everything was pretty AMAZING!

Honestly, I'm still amazed that Qwen 3.8 27B delivered this result in about 9 MINUTES on my RTX 5090 32GB VRAM with ZERO BUGS. It just cooked for a while, and I could never manage to do something even close to this in ONE SHOT.

OF COURSE the whole bad level design and lack of sounds, music, etc... is on me because I created a simple prompt I wanted a simplistic BOSS, (as seen in the video) for example... and considering that was a ONE-SHOT prompt, 100% locally, I must say I'm impressed.

---

🙏🙏🙏 THE ONLY THING in UNSLOTH DESKTOP that was missing for me:
And I know it's not very popular and most of you guys don't care, but I decided to share this because it can make my experience 100% more natural while using it.

I used the prompt in Hebrew, which means RTL, and as with other cases, some apps can handle it and some can't... I totally get it, it's such a low priority for the AWESOME unsloth team, but if they could add both RTL / LTR modes, it would be so amazing.

A good example of how it works well with both chat in Hebrew (in my case) as RTL and English as LTR is Gemini, and even Zoo-Code within VS Code (after tweaking some code, so it's not official, sadly). But... I REALLY want to stick with UNSLOTH DESKTOP, and if RTL is supported natively, it will feel completely finished!

The real struggle is reading in LTR when using two languages where the main one is RTL, as it displays in the wrong order and is very hard to read in general.

---

Hopefully someone from the Unsloth Desktop dev team will read this and consider adding it to their priorities, because VIBE CODING and planning in RTL languages is not foreign to many people around the globe, and it would be really nice to have in a future version.

Thanks for all the amazing releases, from every MODEL to Unsloth Desktop!
Much love to you guys and please keep up the good work! ❤️

I'm looking for a good workflow to create that famous 4 split images in one to create different character sheets for MiniMax H3. but it can defiantly be helpful for almost any other workflow that needs a proper detailed character in a SINGLE image.

I'm talking about these famous LEFT to RIGHT over WHITE BACKGROUND usually:

1️⃣ - Neck to Head Portrait View- (Full Head, Hair, Face)

2️⃣ - Perfect Side Profile View - (Full body)

3️⃣ - Back View - (Full body)

4️⃣ - Front View - (Full body)

Sometimes it's 3/4 view instead of Front, but you got the idea.
Usually when I watch what people use on YouTube, they use cloud/online like Nano Banana or GPT etc..

Sure, it's easy to make it with a single prompt with any of the cloud services but I'm looking for the 100% local offline solution to work within ComfyUI.

---

⚠️ Just to be more specific:
The workflow needs to work from an IMAGE SOURCE as reference for a specific character result,
so basically not Text to Image (T2I).

---

I've tried some workflows via Krea-2 and Flux-2 Klein-9B but never got a steady result, and I'm not a pro-user in ComfyUI so I can't build my own.

I believe it's supposed to be a simple workflow with a very fixed accurate prompt and fixed seed, but it's just a guess.

---

If there is a specific LoRA or Model / Checkpoint needed for the workflow you'll suggest, please include LINKS if it's not already included within the Workflow itself.

If anyone can share the BEST one they're happy with, please do!
Sharing here will help anyone else who is looking for the same solution.

Thanks ahead! ❤️

---

The visual example made with Gemini Flash, I believe we can get HIGHER resolution locally.

Originally I planned to reply to this:
https://www.reddit.com/r/LocalLLM/comments/1s0ibbj/is_there_anyone_who_actually_regrets_getting_a/

But I decided to share the whole experience,
Sorry ahead 🙏 it's a LONG one but hopefully it helps in one way or another:

---

I built this PC around March 2025 so it was expansive but not as expansive as NOW and it only gets higher and higher every day, Sure I can run any game I like, but it's not my interest so I have a clean machine without extra junk:

• Intel Core Ultra 9 285K
• Nvidia RTX 5090 32 GB VRAM
• 96 GB RAM 6400 Mhz DDR5 - x2 48 GB
• x2 Nvme SSD - 2TB for OS and Software + 4TB for Models and AI in general.
• Windows 11 Pro

When I built it, I originally didn't think much about AI but more like my general focus which is CGI, heavy video composite, FX and also ComfyUI to run smooth as possible with the whole combo.

But few months later I got into Local LLM land, the more time goes the better models we got.
Sure, now days 32GB VRAM is nothing compare to the multi-GPU or DGX Spark / RTX Spark etc..

Nope, I'm NOT regretting buying it at all:
First of all, when I bought it price was high, and when I look at the same system now it's more than double the price, everything went up crazy from GPUS, VRAM in general, SSD etc.. and I'm glad I bought it in time, also when I bought it, I was lucky to get one because it was new and the waiting was about 2-3 months...

---

🟢 LOCAL LLM:
This is the thing, I'm not a programmer, but I discover VIBE CODE and I'm talking about 100% LOCAL ONLY!
There are 2 lead (probably temporary for now) that I'm in love with:
- Gemma 4
- Qwen 3.6
- DENSE Models = until we'll see some more accurate MOE / Diffusion / Whatever TECH will popup next..

Sure, there are many fine tuned, MTP, QAT, and now we'll start to see more Diffusion which is INSANE (the moment it will be more accurate and won't loose quality and accuracy it will be the next BIG THING for sure).
So far for Gemma the QAT is good to me, and for Qwen the MTP, there are some combos and fine-tuned but I'm testing a lot of them and not very impressed in most cases the BASE or QAT / MTP are great.

Qwopus3.6 27B v2 MTP - this is my current Qwen3.6 favorite MTP one, for code + reasoning + visual

Gemma-4 QAT - My FAVORITE for chat, brainstorming ideas, design ideas, UI / UX and believe it or not it even self-review it's own AGENTS.md and RULES and helping me with my personal needs to shape itself! consider I still have much more to learn, it's a great help and it feels MUCH smarter than Qwen 3.6 when I don't touch code.

---

🔥 TEMPERATURE:
0.1 - 0.2 = For code:
0.7-0.8 = For anything else.

I usually use 0.1-0.2 when it comes to code, because I'm not a programmer and I do VIBE-CODING so I like that tiny "touch" from the model itself, and if you think of it since it's vibe-code I mostly TALK with the model I can't review the code, but only the LOGIC or of something went wrong, new features, etc.. so it's important.

REMEMBER: these numbers are from my experiments where I kept playing around and tuned them until I was happy with the results for a bit, that means, it's no actual benchmarks, no actual facts, just my personal experience of real-life cases, but not huge projects so even that's not accurate to say...

My point: it didn't disappoint me yet, so I shared it with you because why not.

---

🟢 LM STUDIO and CONTEXT in general:
This is the most important thing I keep learning how it changes working with ANY model.
So, I started with 160K Context which is in my opinion not enough for Vibe Code per chat, but it works, I could even do nice things with 80K and 120K but when possible 200K is my limit, after the 180K things starting to get too slow anyway.

My Simple System (for now)
- LM Studio (provider for the models) - super easy to control, download latest models.
- Open Code Desktop - it's new, some bugs and issues, but it's CLEAN and promising
or
- VS Code + Cline (extension) - I'm new to it but I'm impressed!

So far CLINE seems MUCH SMARTER than the other plugins (not just MCP) I used in Open Code Desktop!
I mean, straight out-of-the-box with CLINE I felt a very similar workflow to what we know from CLOUD MODELS, if it's the nice MENUS to click, if it's the Plan and Act built-in modes, if it's the use of Agents, Rules, Skills, etc..

I'm still learning CLINE but so far, I don't see a reason to go back to Open Code Desktop until they'll fix their sh*t, there are too many bugs (nothing critical you can still work with it) and their SETUP for each file is not user-friendly as CLINE for example.

What I learn is that I need at least 128K - 200K Context per chat session, so when you do VIBE CODE,
you're not just doing CODE only, you are TALKING with the model, you ASK questions, you do A LOT of chat that is not really CODE ONLY because you instruct it and when there are problems, you will keep TALKING to your model.

There are other VERY important settings needs to made within whatever model you pick:
for example:
- ALWAYS go for the 100% GPU Offload if possible! (unless you want a bit more context)
- Change Max Concurrent Predictions to 1
- K / V Cache = Change to Q8_0 and you will gain more headroom for extra CONTEXT (that's how I got to 160K for example)

MOST IMPORTANT advice from what I'm aiming for at least:

- As long as you can GPU OFFLOAD 100% of the model to your VRAM and have extra headroom (2-3 GB VRAM) for any other software or usage, for example Godot game engine, GO FOR IT!
If you have no choice reduce Context and make sure you're not using 100% of your VRAM and let me tell you, 32GB VRAM isn't forgiving in all models, that's why I share what I tried and works (FOR ME) so far:

🖼️

The SCREENSHOT attached is an example of one setup I have which takes actually about 28.3 GB VRAM.
Since the Estimated Memory Usage isn't always accurate, you better check out your Task Manager and sometimes you'll gain more, sometimes not, so you can play with the numbers.

Most of my current tests were done with the above setup but sometimes I pushed it to 200K Context, while the rest of the values are similar-ish.

---

🟢 MCP: (simple example)
I tried some (when needed), but unlike these every YouTube channel doing comparisons and most of the time showing how they created a website, dashboard or a poor game with primitive shapes via HTML/CSS/JS etc..
I pushed it to see if it can do REAL WORLD CASE work with: Godot MCP so I used a Game Engine and MCP to let my AGENT control things, (I have no idea how to use Godot, I'm a designer, not a programmer) so there are MANY Godot MCP out there, so far I tried: Godot MCP Runtime, and the more promising one: Godot MCP GoPeak which have more tools, screenshots etc..
Just for example, I did try to make simple clone games such as: Space shooter, Arkanoid, Snake, and more but... that was NOT the test, the test for me was to see:

1 - Can local LLM on my limited system work with it as if I had the brain to program?
2 - Can I keep add / remove / change features ?
3 - Can I fix bugs? (mostly done via the MCP in this case) but LOGICAL bugs that I'm not happy with?

All the 3 questions (so far at least) worked fine! but there is a VERY IMPORTANT thing I learn:
- DO NOT GO FOR "ONE-SHOT" if you have such a limited MODEL and System compare to the huge cloud models, it's not even far to compare these powers...
- You go CAREFUL step-by-step, small tasks, and you will (mostly) be fine!

In my small random tests, (not just with Godot) what I found is, because our MODELS not that smart compare to the CLOUD models, doesn't mean they are stupid, especially with code they are not bad at all,
As a vibe-code user I'm SUPER WRONG here but I talk about the results, I bet the code looks like crap at the end but... that's why I mention it, at the end we can get results but if a HUMAN programmer will look at it, probably they will puke... honestly, if it works, I don't care much at the moment because I'm just learning and experimenting.

I was pretty amazed from 2 things in the experience in Open Code Desktop and Cline:
When there was a BUG, I just told it to fix it, and... in CLINE it was smart enough to tell me, "I see this and that, I suggest we'll fix one by the other" and it worked in many times.
The other thing was the fact I could ADD FEATURES and OPTIONS above, just like I would do in my design experience, not ONE-SHOT everything, one above the other, testing, add stuff, or get rid of something, and continue... at the end I got the results I want, and the reason I was amazed... I have ZERO knowledge about code, I only know the LOGIC and MECHANICS I want to design, but no code... and it worked as if I would pay a programmer to do it, but... it took minutes / hours, not days or weeks... so I can't say it didn't inspire me to continue.

Nothing is perfect, there are cases that I had to scream at the model to do something and it didn't went well until I found the RIGHT PROMPT to explain it better which means I kept UPDATING my AGENT and RULES so it won't repeat these problems in future cases, and believe it or not it HELPED A LOT! and the more I tweaked the AGENTS and the RULES the better my next chat / code / tests were with less issues.

My point is that my tests are NOT 100% PROOF, it's based on my own experience and I still have much more to learn.

---

🟢 AGENT / RULES / SKILLS:
Super important (and I'm still learning) - Basically, if you make a good AGENT to focus on whatever your main goals, for example: "You're an expert in Godot 4.x " and more, my AGENTS.MD currently taking almost 20K context but it worth it! it knows my system, when downloading and installing things for me, I don't need to explain it what we need, it already knows, but that's the most basic thing I did, it could be in general Rules and not inside the AGENT but I'm just giving a rough example.

---

What did I learn so far that works great for CODE (as a non-programmer):
Model Type = Go for DENSE
It is slower, it is sometimes larger in VRAM, but it's usually more accurate, doing much better job in my small tests,

It's important to mention: my "CODE" tests are at the moment random but at the same time challenging!
I'm still learning, and the more I learn and try things NEW MODELS coming, and the good news, they are getting SMALLER and SMARTER and that's why I'm very happy with my RTX 5090 purchase so far, sure if you can afford a better GPU or system, go for it... I purchased what I could afford, but I'm 100% not regretting it.

---
EDIT / UPDATE:

Thanks to the great tip by u/alex9001 in the comments, I've changed K / V from Q8_0 to Q5_1
Based on this chart, the difference is so minor so it worth it:
https://anbeeld.com/articles/kv-cache-quantization-benchmarks-for-long-context#section-8

I could easily get to 200K context (and probably to the max 260K if I want) but I'm being careful because from my experience so far around 160K - 180K things starting to be slower.

From Q8_0 to Q5_1 this is what I gained:

☑️ 28.3 GB VRAM - Q8_0 - 160K Context
✅ 27.5 GB VRAM - Q5_1 - 200K Context

THE BAD NEWS: (for now)
It seems like Q5_1 / Q5_0 seems to work EXTREMELY SLOW in some models, for example in the MTP I just tried, and also in other I get ERRORS in CLINE, so... I'll have to keep experiment, so I can't use it... at least not with LM STUDIO, so I'm for I'll mostly use Q8_0 until I'll find the right combo that works with LM STUDIO because anything else is hell to install and manager compare to LM STUDIO.

The REAL TEST will be on my next tests, so I can't say if this minor will affect the experience probably I won't be able to tell the difference unlike my experiences with Q4_0 which something I can blame on the experience (can't be accurate blaming because it's not a proper accurate benchmark) but in general Q5_1 seems like an amazing tip and I will give it a try.

This gives me the chance to try better quantization's on the MODELS beside the K/V Cache, for example I found out that Q6 are SO MUCH better (based on my comparisons and tests) and even Q5 should be better than the default we (noobs) uses because we want to fit it in our system limitations.

The idea is to keep some headroom, and mostly 2-3 GB VRAM is more than fine, unless you're doing some heavy 3D and Shaders, but if it's a 2D Game or Software, you'll be fine.
Sure, you can always use your CPU RAM for heavier missions and more context, if you don't mind slowing down give it a try! EXPERIEMENT like I do... don't let YouTube comparison videos tells you what works or not, try it yourself!

---

MY 🤞 PREDICTION to what's coming (so far it looks promising):
I'm no prophet, but this is based on what I've experience as the evolution in the last 12-6 months with the same system!

I have a strong feeling that we will see more open source SMARTER, SMALLER, FASTER models that will demand less VRAM, I may be wrong... but this is based on my personal experience so far.
Also just like we suddenly seeing MTP appeared, and QAT and Diffusion... we will see NEWER TECH on the upcoming models, and it will help us running LOCAL LLMS with lower ends.

I'm not saying it's 100% gonna happen, and I'm not saying you don't need a lot of VRAM or better systems, because it always can help you to have stronger, faster, better machine.

I hope that this personal experience helped a tiny bit ❤️