u/NullSmoke

Fine tuning?

Heyo...

Looking for an assistant while I'm working on some stuff in the Godot Engine... but most LLMs seem to have a LOT of problems with GDScript, to put it mildly (Codex crapped itself creating nothing usable, all the while lecturing me on the contents and wording in my project, Qwen didn't fare any better... and mistral... well... it's still working on my test task 2 days later). Claude used to have issues with it, but seems 4.6 actually manages to get shit done...

I do recall hearing somewhere that Mistral offered fine tuning services... would it be reasonable to fine tune mistral against the Godot documentation? What would be the price of that fun? Should I expect that to produce a decent assistant?

reddit.com
u/NullSmoke — 20 hours ago

Okay, I've been using NotebookLM on and off for what... a few years now.

It's always had problems. It halucinates like its life depends on it, skips sources etc. But, it has been a decent service. Even the halucinations have been useful.

When I feed it a story I'm working on, the halucinations have been a decent way to flag where I've let too much lay unexplained by assumption.

Now, after a few months of dealing with the death of my fiancee, I'm back to writing again, so I tried to hand it the current state of a book I'm working on with 8 chapters... and... it's been a nightmare.

Let's start with the Slide deck and infographic...

https://preview.redd.it/0w6edn7lk2yg1.png?width=418&format=png&auto=webp&s=e742b2c55ca2f1a938d7948927650400f040854d

Good god, does this thing ever work? Most of them spin for like 20 seconds at most, then fails. Why does this even exist? I already know from using this in December that failed generations count against my quota, so at this rate it will run out before I get even one generated properly.

Okay, but I can still use Audio, can't I? That's the core thing of this platform after all.

Oh, holy gender war weirdness. Anytime a female character faces hardship, I get a lecture on patriarchal systems and suppressing women. Since most of my protagonists are female, that means that I get to enjoy about 25 out of the 35-40 minutes audio lecturing me about how it's due to the patriarchy that the protagonist has a headache after drinking bottles of wine the eve before. Are you for real?! I'd be just as annoyed, but understand it more if it started taling about Misandry, taken how every power character thus far in the story is female, and I focus on female spaces, not male ones, but no, the wine is patriachal.

Why am I paying for this... I don't get any of the image generation related stuff, and I get a nonsensical long lecture about gender wars at anything I give it. Maybe if I stop writing females? Just pretend they do not exist? Is that the solution?

I gave up and fed it to ChatGPT to see if it was me.... and ChatGPT also LOVES talking about gender wars, and will take ANY chance to ramble about it, so seems like a fair place to test. Nothing.

"The document is a Markdown manuscript draft for a fantasy story titled “<REMOVED>” by <REMOVED**>**. It currently contains Chapters 1 through 8, mostly following Lady <REMOVED>, with later perspective shifts to Lady <REMOVED>."

"a mix of:

  • wartime mobilisation,
  • religious bureaucracy,
  • caste manipulation,
  • diplomatic crisis,
  • covert statecraft,
  • and institutional panic dressed up as holy ceremony."

Nothing about gender wars at all... and all but one characters are female... and the one male character is pretty much a wallflower, having gotten a grand total of 2 statements during 8 chapters...

I'm so tired of this... no idea what this even is for anymore... absolutely useless for me at least...

reddit.com
u/NullSmoke — 23 days ago