u/Moist-Buffalo386

The gguf's arch tag is bailingmoe3 and stock llama.cpp won't load it. build the fork or wait for upstream ?

Hi,

Someone posted this load screen from a run and I went to look up how you'd run the thing yourself. Two lines on it are the ones that matter. The arch line reads BailingMoE3, and the engine line says llama.cpp compiled, not installed.

I sat there for a minute wondering why it said compiled instead of installed.

Per the gguf card, stock llama.cpp builds without bailingmoe3 support will not load the model, and it points you at a fork to use while waiting on upstream support. So what happens on the Ollama side ? I genuinely don't know whether a pull gets you a build with that arch in it.

The model is Ling 3.0 Flash, if you want to go read the card yourself.

There is an upstream PR open for it, ggml-org/llama.cpp#26608. No idea how close that is to landing. PRs sit.

So, build the fork on day one, or wait ?

u/Moist-Buffalo386 — 8 days ago

▲ 1 r/Rag

The card says it was trained to 256K. The local build ships with a 131K default.

Hey everyone,

I read the two pages for one of the long context models people keep naming here.

I wanted to know if the big window was trained or configured.

Trained, as far as the card goes. The lab publishes the schedule. 8K, then 32K, then 256K. I had assumed the opposite. I was wrong about it.

Then the other page. The build most people would actually download says it supports up to 256K. Its own usage example starts you at 131,072. Two numbers for the same window, one page apart. I didn't notice anything on either page pointing that out.

That gap matters here more than most places. The chunk versus stuff argument is an argument about the room you actually have. The model is Ling 3.0 Flash if you want to read the two pages next to each other. I haven't run any of it. This is reading, not measurement.

So which number were you budgeting against? And if you did open it all the way up, what broke first?

reddit.com

u/Moist-Buffalo386 — 8 days ago

▲ 10 r/pokemonmemes

▲ 400 r/MxRMods+1 crossposts

squirtel gang present!!

u/Moist-Buffalo386 — 8 days ago

▲ 0 r/pokemonmemes

ash look at you

u/Moist-Buffalo386 — 8 days ago

▲ 0 r/estimators

giving up custom excel sheets

honestly at a crossroads with how i bid. right now i use a basic takeoff tool and a monster excel sheet i built myself. its ugly but i know how every formula works. been looking at scopetakeoff to maybe get the measurements and pricing in one screen. but im terrified of giving up my custom excel setup. what if i cant adjust pricing on the fly? has anyone moved from a custom spreadsheet to one of these all in one tools? kinda feels like i might just be holding onto excel out of stubbornness idk.

reddit.com

u/Moist-Buffalo386 — 8 days ago

▲ 1.0k r/pokemonmemes