Image 1 — Solar System with Qwen3.8 27B
Image 2 — Solar System with Qwen3.8 27B
Image 3 — Solar System with Qwen3.8 27B
Image 4 — Solar System with Qwen3.8 27B
Image 5 — Solar System with Qwen3.8 27B
▲ 40 r/LocalLLM+1 crossposts

Solar System with Qwen3.8 27B

A few days ago I tried generating a single html file for a solar system using different LLMs. Since Qwen3.8 27B is released now, I thought I should give the same test to this model too.

My system:

  • AMD AI Pro R9700 (32 GB VRAM)
  • 32 GB system RAM

Model: unsloth/Qwen3.8-27B-Q6_K (The best quant I can run locally)

Context Size: 98,048 tokens

It's truly a thinking model, it really really likes to think. It was thinking for over 14+ minutes (at 35-40 t/s in my system with MTP)

Total time taken for the html file: 17m 9s

Total generated tokens: 42,530 tokens (reasoning + result)

Initial prompt:

>Write a self contained html file for a living solar system. It should be beautiful.

And it did not work. It was a blank canvas with some controls that did not work. There was a error in the code. I gave the error back to the model. It suggested a fix, after applying the fix I got the orbits to be visible. But there were still no sun or planets.

The console still had some more errors which I provided back to the model. It identified some more issues and provided fix for them. I applied the fix and it was working now.

Honestly, the final result was the best interface generated by any model in my tests so far.

HTML File: https://limewire.com/d/BmGv5#5nNSQz6Zhj

u/xdcfret1 — 7 days ago

Anyone remembers the Will Smith Spaghetti Video? - (LTX 2.5)

We have come a long way from that video. So I thought why not try to recreate it again?

u/xdcfret1 — 9 days ago

LTX 2.5 in ComfyUI: Fast, crisp, but physics still wonky?

Just spent some time testing the new LTX 2.5 workflows in ComfyUI, and I wanted to share my initial impressions.

The Good:

Speed: It is honestly super fast. I'm getting generations much quicker than previous versions. Diffusion Fidelity Rendering is the real deal. Image Quality: A significant step up. The details are sharper, and it feels less "muddy". Audio: I know audio in video models can be hit-or-miss, but in my runs, the audio alignment and quality were actually good.

The "Needs Work":

Physics: It's still hallucinating a bit here. Objects sometimes clip or move in unnatural ways, so don't expect perfect realism just yet.


Overall, it feels like a solid update. What do you think?


The attached video was super impressive for the first 6 seconds. Then she started riding backwards.

u/xdcfret1 — 9 days ago

I built a faster UI (maybe?)

I built my own frontend (for easy access) and I'm using ComfyUI purely as a backend through its API.

One thing I noticed is that image generation seems significantly faster than when using the standard ComfyUI frontend. So far I've only tested image generation.

Is this just a fluke, or is there a reason why driving ComfyUI directly via the API could actually improve throughput? Has anyone else observed this?

reddit.com
u/xdcfret1 — 14 days ago
▲ 108 r/ROCm

AMD Released an AI model

Instella Moe 16B A3B Think

A 16 billion parameters and 2.8 billion active parameters model trained end-to-end from scratch on AMD GPUs.

What is your opinion on this?

reddit.com
u/xdcfret1 — 24 days ago

Girls please answer this…

I’ve seen enough posts of girls sharing the creepy/weird DMs they get from guys. Fair enough, every sub has plenty of those.

But I’ve never seen anyone share the good DMs. The ones that actually worked. The ones that got a reply.

Share those too. Let the clueless guys learn what does work instead of only seeing what doesn’t.

And yes, post the screenshots too, just like everyone posts screenshots of the bad ones.

reddit.com
u/xdcfret1 — 24 days ago

I tested Laguna S 2.1 on affordable VRAM

I wanted to see if I could run Laguna S 2.1 on my personal PC.

My system:

  • AMD AI Pro R9700 (32 GB VRAM)
  • 32 GB system RAM

Definitely not the ideal setup for a 118B model, but I managed to get it running.

I used Unsloth's UD_IQ4_XS quant with llama.cpp. With Q8_0 KV quantization and 25 layers of experts offloaded to the CPU, I was able to get:

  • ~66k context
  • ~20 tokens/s

I mainly wanted to compare it against Qwen3.6 27B MTP Q6_K, which is currently the best model I can comfortably run. That one gives me 200k+ context and around 50 tokens/s.

For the comparison, I gave both models the same simple prompt:

>Write a self-contained HTML file for a living solar system. No external libraries or modules. It should be beautiful.

Honestly, I wasn't that impressed with the Laguna output. I know the recommended quant is Q4_K_M and I'm using UD_IQ4_XS instead, so that definitely isn't ideal. But I was still expecting to see a more noticeable improvement over a good 27B model.

Another thing I noticed is that Laguna didn't seem to think/reason at all for this prompt. Not sure if that's expected with this setup or if I have something configured wrong.

I'm attaching the HTML files from both models if anyone wants to compare.

One question for people following Laguna: if a ternary Bonsai version of Laguna S 2.1 comes out, do you think it would perform significantly better on hardware like this, or is this about what I should expect?

HTML Files: https://limewire.com/d/URqgx#srL2p87cG7

u/xdcfret1 — 25 days ago

I tested Laguna S 2.1 on affordable VRAM

I wanted to see if I could run Laguna S 2.1 on my personal PC.

My system:

  • AMD AI Pro R9700 (32 GB VRAM)
  • 32 GB system RAM

Definitely not the ideal setup for a 118B model, but I managed to get it running.

I used Unsloth's UD_IQ4_XS quant with llama.cpp. With Q8_0 KV quantization and 25 layers of experts offloaded to the CPU, I was able to get:

  • ~66k context
  • ~20 tokens/s

I mainly wanted to compare it against Qwen3.6 27B MTP Q6_K, which is currently the best model I can comfortably run. That one gives me 200k+ context and around 50 tokens/s.

For the comparison, I gave both models the same simple prompt:

>Write a self-contained HTML file for a living solar system. No external libraries or modules. It should be beautiful.

Honestly, I wasn't that impressed with the Laguna output. I know the recommended quant is Q4_K_M and I'm using UD_IQ4_XS instead, so that definitely isn't ideal. But I was still expecting to see a more noticeable improvement over a good 27B model.

Another thing I noticed is that Laguna didn't seem to think/reason at all for this prompt. Not sure if that's expected with this setup or if I have something configured wrong.

I'm attaching the HTML files from both models if anyone wants to compare.

One question for people following Laguna: if a ternary Bonsai version of Laguna S 2.1 comes out, do you think it would perform significantly better on hardware like this, or is this about what I should expect?

HTML Files: https://limewire.com/d/URqgx#srL2p87cG7

u/xdcfret1 — 25 days ago
▲ 32 r/ROCm+1 crossposts

PSA: If you have AMD GPU, use --enable-dynamic-vram

I have an AI Pro R9700 GPU, and until recently I kept getting stuck at Requested to load LTXAV when trying to run LTX 2.3 I2V with the Q8_0 GGUF model.

Before, the best I could do was:

  • 11s @ 480p
  • 6s @ 720p

(7–10 minutes)

Then I added --enable-dynamic-vram to my launch script.

Now I can generate:

  • 11s @ 480p in 168s
  • 10s @ 720p in 191s
  • 10s @ 1080p in 322s

I haven't tested the limits yet, but based on these results, dynamic VRAM management seems to make a huge difference on this GPU.

I honestly feel liberated. 😄

reddit.com
u/xdcfret1 — 26 days ago
▲ 1 r/LocalLLM+1 crossposts

I got a new GPU. What can I do with it?

So I swapped my RX 9070 XT with an AI Pro R9700.
It’s the same chip, but comes with a bigger 32GB Vram.
So, what can I do with it now that I couldn’t before?
Guide me please.

reddit.com
u/xdcfret1 — 27 days ago
▲ 12 r/ROCm

So I built flash attention for ComfyUI

I built flash attention 2 from source for using with ComfyUI. Results were not as good as I had hoped.

I have RX 9070 XT, paired with Ubuntu 26.04 and ROCm 7.14.0.

It took 3 tries, some debugging with Claude, and over 6 hours in total.

Finally, the build succeeded and Flash Attention was installed.

I run ComfyUI with —use-flash-attention and queue a few image generations with Krea 2.

There’s no visible generation speed up.

I switch to and back —use-pytorch-cross-attention.

It’s the same. There is no difference.

Did I waste 6+ hours? Or am I doing something wrong?

reddit.com
u/xdcfret1 — 1 month ago

AMD: Which attention backend do you prefer?

AMD Gpu users, which attention backend do you prefer to use with ComfyUI? Especially those on RDNA4.
Is it
- SDPA
- Flash Attention
- Sage Attention
Which one is the fastest and most stable in your experience? Which GPU and OS are you using? And what kind of speed differences did you notice?
Also, are you using the standard versions or a different port or fork of the original?
I would really like to know.

reddit.com
u/xdcfret1 — 1 month ago

Should I replace my gpu?

I’m thinking about replacing my RX 9070 XT with an RTX 5060 Ti (16GB) primarily for ComfyUI.
I also use llama.cpp, but ComfyUI performance and compatibility are my main motivations for this switch.
For those who’ve used both AMD ROCm and NVIDIA CUDA in ComfyUI:
Would you make this switch?
Is the better CUDA support worth the raw performance tradeoff?
Have you found the NVIDIA experience significantly more stable or feature-complete?
I’d love to hear from people with real-world experience rather than benchmark numbers.

reddit.com
u/xdcfret1 — 1 month ago
▲ 2 r/LocalLLM+1 crossposts

LLM + Diffusion : What should I buy?

I want to buy a device for running inference but not sure what to buy? A PC? A Mac studio? A upgraded GPU for my current PC?
Mac studio seems like a ready made solution but I am confused due to its unified memory design. How much will be able to use for inference and how much will be reserved for the system?
And is Mac even a good system for Diffusion models? Does it have support?

reddit.com
u/xdcfret1 — 1 month ago
▲ 6 r/ollama

What is the best Local model for agentic use cases (non-coding)?

Everywhere I look people are just talking about agentic coding models. What about non-coding agentic workflows?
Which local AI model is the best for non-coding workflows?

It should be good at reasoning, tool calling, preferably multi-modal, and intelligent.

What is your favourite AI assistant model?

reddit.com
u/xdcfret1 — 1 month ago
▲ 5 r/Ubuntu+1 crossposts

btop fails with segmentation fault

Ubuntu 24.04.4
Ryzen 9 7900x
RX 9070 XT

I installed btop

$ sudo apt install btop

I try to run it

$ btop

it errors. Show segmentation fault and the terminal becomes unusable.

Any idea how to fix it and get it working?

UPDATE: Installation from apt or snap both did not work. So I built it from the source. It is working now.

reddit.com
u/xdcfret1 — 1 month ago
▲ 3 r/ROCm+1 crossposts

Krea2: Working yesterday, broken today

System info:

OS: Ubuntu

CPU: Ryzen 9 7900X

GPU: RX 9070 XT

RAM: 32 GB

My Krea2 workflow with base fp8 + turbo lora was working fine yesterday. Today it can't generate images anymore.

My other workflow with Flux2 Klein 9B image edit is working fine, so I don't think it is a GPU issue.

I tried taking help from Chat GPT and Calude but could not find a solution even after hours of debugging.

Did anyone else face this issue? Any help or suggestions would be appreciated.

u/xdcfret1 — 1 month ago

Anyone has INT8 diffusion models that would fit in 16 GB VRAM?

ComfyUI now natively supports INT8. But I can't find the models. Please help.

reddit.com
u/xdcfret1 — 2 months ago