u/Simusid

Because I can, that's why! 0.2 t/s isn't usable, but I just wanted to try and do it. I'm fascinated by models quantized to this level and I'm trying to compare the quality of this output to Qwen 3.6 27B Q6_K.

Also I've changed the hostname to "Treebeard"

UPDATE - Deepseek V4 Flash UD-Q2_K_XL is fully on GPU at 17 t/s

For anyone who has a DGX-Spark and is having problems during these very hot summer months, you can underclock with:

sudo nvidia-smi -lgc 0,900

My temps dropped from 85C to 60C and this fixed my problem of overtemp lockups.

Edit: Yes, I know that fans exist

For anyone who has a DGX-Spark and is having problems during these very hot summer months, you can underclock with:

sudo nvidia-smi -lgc 0,900

My temps dropped from 85C to 60C and this fixed my problem of overtemp lockups.

I am very seriously considering a Golden Ellipse. I tried on a 5738R at an AD and I like it very much. They did not have a 5738P available, but given the choice I'd likely go with blue over black, though both are fine.

I work in a "business casual" office and I wonder if this watch is too formal. Right now my daily driver is either a milgauss or submariner, or occasionally an ALS Saxonia. Would you put the Ellipse into that rotation or would you save it only for very special occasions?

I'm fortunate to have a DGX-H200 and I was very excited last week to download the unsloth version of Nemotron-3-Ultra. I serve it with llama-server and launch with this:

CUDA_VISIBLE_DEVICES="6,5,4" build/bin/llama-server -hf unsloth/NVIDIA-Nemotron-3-Ultra-550B-A55B-GGUF:UD-Q4_K_S  -ngl 999 -fa auto -c 0 --parallel 2  --threads 16 --batch-size 4096 --host 0 --port 8899

I get about 20 t/s most of the time. But occasionally the performance seems to drop to nearly zero and it's 5 seconds per token. what am I doing wrong? Using top I don't see anything else suspicious. I'm looking for any tips about running a giant model on a giant box.

Title sums up the question. My town has had a spate of car fires and a few of them were EV/hybrid. I'm considering donating an EV fire blanket because I know they do not have one/any. Obviously, I don't want to buy something that is considered useless. Some of the comments I've seen point out that they don't put out the fire, they trap heat, they trap gasses, etc. I'd like to know if they are considered totally useless, nice to have, or indispensable.

If you think "useless" can you propose another $2.5K piece of equipment you would rather have?

EDIT - Thanks folks, excellent info.

I'm on a shared DGX-H200 that unfortunately does not have current gcc-toolset-13, and I cannot update it. When I build my local version of llama.cpp I have to set cmake flags to disable all AVX instructions. I'm installing unsloth-studio via the single script:

curl -fsSL https://unsloth.ai/install.sh | sh

How do I modify the build config of the llama.cpp within the install ?

I've inherited the IT at a small non-profit and I'm slowly understanding their old hardware and layout. Basically a flat 10.0.1.* set of Win10 and now Win11 desktops. This is serviced by comcast business. From the ingress it goes into a Fortinet 30e that feeds the building via a tangled mess. None of that matters and I'll jump straight to the problem which is a download speed of about 5 Mbps. This was working fine until a recent cyber event.

I connect directly from the comcast modem to my laptop and I get 660 Mbps download speed. Great.

I disconnect the LAN side of the fortinet to the rest of the building and I connect my laptop directly to the LAN side. I'm the only connection. I run the speed test again and get 5 Mbps or less.

I reboot the fortinet. same thing. So it must be the fortinet.

I log onto the console and I see the CPU idling, I confirm link is 1000mbps, I see nothing obvious in any status, and in fact most logs are empty. DNS on fortinet is 8.8.8.8. I know little about this device. Would you just factory reset it?