u/Competitive-Pie-5454

How do I know I ran out of context?

As the title says. Is there a clear indicator anywhere? On the other site I use, when the limit is reached, the AI usually gives a little message saying that everything before this point will no longer be remembered. How do I track it on Saucepan? I've just noticed that LLM began giving character descriptions for key NPC's again, as if they are being introduced for the first time, and that made me check how much it actually remembers via ooc summary request - turns out, a good chunk of the chat is now forgotten, along with some key relationship developments. It would really have been helpful if I could catch it in time.

On that note, if I ask for a summary *before* running out of context, and everything important does end up listed in the message, will the LLM remember the summary?

reddit.com
u/Competitive-Pie-5454 — 6 days ago

How to prohibit LLM doing things?

Here is a persistent problem I have with 2 of my bots: LLMs coming up with their own lore elements and enthusiastically inserting them in the roleplay at every bloody opportunity (like, same stuff every time). So the logical conclusion is "tell AI not to use these elements", right? I tried adding "forbidden inventions/anachronisms" sections to the bots personality description and a prompt into a lorebook - no dice. So I suspect my only hope now is Advanced prompt, but how much can I actually stuff there before LLM starts ignoring parts of it? Right now, there are general instructions for roleplay (British English conventions and the usual "avoid repetitions and euphemisms" taking up about 500 tokens - British language stuff works at least most of the time, but the "avoid euphemisms" is totally useless, at least on Arita).

If I keep telling the LLM "it's not lore-compliant, tobacco doesn't exist, fix it" every time, will it eventually stop? (Probably not, but I need to know for sure).

I really don't want LLM to keep inserting tobacco into one setting and shadowy tentacles/darkness teleportation and energy readings into another... Please advise.

reddit.com
u/Competitive-Pie-5454 — 10 days ago

First impressions

Spicy origin: >!let me preface with the fact that I've only been actively interacting with AI and chatbots for the past month or so. I began with Spicychat and Chatgpt as an assistant (keeping track of events in chats and tracking lore consistency for a more complex setting I was working on). But, as fun as Spicy is, it is, in essence, a horny jail and not suitable for long-term story-driven roleplay. 4k context free memory, repetitive language and, as far as I can tell, lorebooks are useless. My fantasy setting chatbot never pulled any information from an attached lorebook even when I used the keywords. The platform is very weird about censoing, too. I had to reword stuff in bot's description and lorebook because of the word 'minor' (I understand why that's a trigger, but what's wrong with 'a minor inconveniece' or 'a minor noble house'?) for the platform to accept it. The primary advantages of Spicy are avatar generation, unlimited messages and the fact that nsfw roleplay is a breeze. It doesn't take any effort - in fact, keeping things from escalating into nsfw territory is the real challenge. And the language is what you'd expect from proper smut - very few euthemisms, direct, descriptive, filthy. !<

Janitor attempt: >!But I wanted more context memory and tried Janitor. Got put off by the interface and what I can only describe as 'word vomit'. Spicy taught me to me mindful of token usage for memory's sake, and Janitor's tendency to use long-ass messages that are 80% filler was not ideal. I tried playing around with settings to make the messages shorter - and that just made the bot's responses cut off in the middle of a sentence instead of generating more compressed chunks of text. Useless. !<

At last, Saucepan: The very first thing I liked was the fact that I didn't need VPN for the page to load (yay). Then, the UI. After Spicy and Janitor, my eyes craved light, and the home page provided. The next appealing thing was free context window (huge, compared to Spicy), and limited free usage of premium models (good for checking things out and adding variety). Then how message generation on the user's end works. Nothing beats being able to describe what you want to see happen (or even just the emotion you need to convey) and get it written out in a more eloquent way.

But what fully won me over was how the lorebooks work here. I love-love-love the way lorebooks are being utilised by bots, holy hell. Finally, putting all that lore in makes sense, because it is being used! And I don't have to nudge the bot to do it, it takes the provided info and runs with it all by itself. Amazing. Revolutionary. Cosmic. (I jest, but really. It's a game changer).

Arita... well. She is lovely, don't get me wrong. She is also very nsfw-averse, and you have to actively micromanage her to get the results you want (and you still won't get them, not really). Even with the Visceral Codex or alternative crutches for adult roleplay. The premium models are way better in comparison, from what I can tell. Not Spicy levels of filth, but they aren't as shy as the free model. And there is way less "he didn't do this, he did that" (seriously, what's up with that?) in their speech patterns.

Story-driven roleplay though? The chat with my fantasy setting bot with its own lore book is going very well, much better than it did back on spicychat. That alone is enough to make me want to stick around. (And even subscribe, potentially, though I don't think it is possible from where I live. I'll have to look into it more).

reddit.com
u/Competitive-Pie-5454 — 12 days ago

How to avoid going to sleep?

What are best ways of preventing LLM from assuming it's night and putting characters to sleep after nsfw activities, even though (in theory), the context window still has space and it should remember that you are not in a bedroom and the whole thing shoudln't have taken literal hours to justify the time-skip to nighttime? Happens every single time I introduce a spicy scene. It's just past noon, me are in a supply tent, we are supposed to be counting gold! There is no bed, and there is no reason to go out like a light after a quickie! (I'm close to tearing my hair out at this point).

Maybe there is a way to put a specifically-worded prompt once the scene is underway? So far I've been manually fixing the messages after generation, but it's tedious.

reddit.com
u/Competitive-Pie-5454 — 20 days ago