u/confusedstreamings

Hi all! Since all of you are such kind people I hope this post isn't such a bother for the feed, but I do need some help returning to IF's. I kind of gave up when dashingdon went down but I'm feeling ready to start again. Or not. I have a tracker that I had and it is FULL, and I'm just hoping to get a little help, because I know I can do stuff myself but honestly it's a bit daunting, so hopefully a few can help a bit!

https://docs.google.com/spreadsheets/d/1vtNcJvvkxa3EyfnCD8HZmQSnL6pULKpfLfkh6TStags/edit?usp=sharing

Here is the spreadsheet I made AWHIIILLEEE AGO, and I'm just hoping someone can recognize some titles and to comment down if it had any recent updates, so I know what to put in my new list first. I'm aware some of the IF's have been completed, and don't mind the colors, it's my own code. I just want to start up a better and new list now, now that everything is on CoGDemos (˃̣̣̥ᯅ˂̣̣̥)

New WIP suggestions would also be nice if you can't find it in the sheet ^^ discontinued, on hiatus, active, doesn't matter. I am already scrawling through different threads for new WIPs to read. Thank you... I really don't know where to start now hahaha...I can totally replay everything if they're available on CoGDemos, but I'd love to jumpstart new content first :33 And well the fact that I have to check each one if they DID transfer to CogDemos, ahem

Hello! So I wanted to go back to SillyTavern, and Chub was my main frontend for a while now. I use DeepSeek and so far, DeepSeek has been VERY cheap with Chub, and so I'm concerned if I'm doing something wrong with SillyTavern

For the past few days I've been searching up for tips about cache miss and have been trying my best to understand the ST docs as best as I can, but I'm still wondering if there's anything else I can do to have my cache hit as much as it does with Chub. Maybe I missed something in the docs or didn't understand other users suggestions properly? Haha

What I've done for ST so far from multiple searches:

Made the lorebook entries be constant instead of triggered, positioned after char
Turned off recursive scan
Hid messages after summarizing
Cranked up the context size to 1M

I also use ST on mobile, and using the app of u/ Sanitised-STA

And then I thought, let me try to compare the two with the same card, same notes, same preset, because maybe the preset or card was the one making all these cache miss?

Note: I used two seperate deepseek keys to see comparison :DD

https://preview.redd.it/lwxzcm9rxrfh1.png?width=953&format=png&auto=webp&s=d94c619cbc9ec0fd35a23c6ba8bfa47fd53ba3aa

So this is my main key for DeepSeek, and this is my use throughout July, and it seems VERY cheap. The exception being the most expensive one and with the most cache miss, but it was because it was the day I just started ST and used this key as well, so there's also that comparison I suppose?

https://preview.redd.it/ycbrn33hqrfh1.png?width=958&format=png&auto=webp&s=6149817514d389beab16688dbf6efdf9493b78d0

This one is the key I use mainly for ST, and I acknowledge that it legitimately is still very cheap, cause if this keeps up, it would only be 1 dollar for 1k+ requests, but it's kind of crazy compared to 3k+ requests for 1 dollar with Chub

And then July 27, I tested it together... Same card, same lorebook, same preset, and then I tried to make as many of the settings the same as possible, also turned off the auto summary in Chub. Then around the 50th message mark, I changed cards (because I read that switching cards CAN cause cache miss cause of new info). I changed a lot more with Chub just to see how much it would miss. I even let 5 minutes pass for Chub, because I read about a timeout (though I'm unsure if it applies to DS)

I also changed presets several times in Chub, and once in ST...

I did this in the morning so I've had the whole day to know and realize that this is a very messy comparison/not everything is equal, but I can still see the disparity of cache miss between the two keys.

120 requests today for ST and costs $0.08, 118 for Chub $0.04. ST today was honestly more cheaper actually! But Chub is still half, so I'm just wondering—should I just accept my fate with ST? I'm only wondering if I am actually maximizing my use of ST. Maybe Chub does something on its end, or not. Maybe I'm just clueless...

Returning To IF's

Having a Hard Time With Cache Miss