u/Useful_Watercress350

Will there be support for exporting trained models to NVFP4 directly in Unsloth Studio in the future?

Hey everyone. Let me be upfront - I'm not a training expert, not a programmer. I just recently switched to local training.

The Question: Is there any way to switch Unsloth Studio to a proper notebook mode? How do you guys even train in this thing?

I tried training Gemma 4 31B on my RTX 5090. I know people are doing this. Unsloth themselves claimed you only need 22GB VRAM. But I can't get it to work at all. Before this, I only trained in free Colab with smaller models like Gemma 4 E4B (since that's all you can fit in free Colab). Now I wanted to train proper 31B models locally for my tasks, because I live in a country where they can cut off the internet any minute, and I want the ability to train everything locally.

And Unsloth Studio is just terribly inconvenient. No proper control, no logging (or I just couldn't find it). Error pops up? No data about it whatsoever.

What happened:

I tried training the same way I did in Colab - immediate crashes ('modelopt' or Training process terminated unexpectedly). In Colab, I could comfortably offload things to RAM. Here? Complete disaster.

So I had to use Unsloth's pre-quantized QLoRA model (as I understand it). Somehow managed to train it. Decided to quantize it since I couldn't test it - because Unsloth's comparison mode loads BOTH versions of the 31B model simultaneously (base AND fine-tuned). What the hell?

Anyway, I somehow merged everything into fp16. It created a 62GB model for me. Then this thing told me the quantized 31B model would weigh 4GB in Q4. A 31B model. WHAT THE HELL?

And then the quantization got stuck at:
"Importing Unsloth... Loading checkpoint:"

Hung for 39 minutes until I gave up. Looks like Unsloth tried to cram everything into the single 5090.

In Colab, I quantized through swap and it worked fine. But here, the delicate Unsloth can't do anything.

I repeat - I'm not a training expert at all. I hoped Unsloth Studio would make my life easier, but it turned out to be the opposite. Dealing with Colab and vibe-coding was actually more productive.

If anyone has trained Gemma 4 31B or larger LLMs on a 5090, I'm hoping for your help.

My specs:

64GB RAM

32GB VRAM (RTX 5090)

70GB pagefile

Sorry for the rant, but this thing really wore out my nerves... wasted a ton of time on obvious nonsense.

Thanks in advance for your help!