r/KoboldAI

im new to this and im looking for some models for nsfw image generation. any suggestions?

after selecting the gguf it starts loading up, then before i can actualy do anything my entire pc freezes. any idea how to fix this?

Congratulations to the dev team on being able to add support for so many new models like ltx, idea 2 and ideogram 4. It looks like the json format required for ideogram 4 to perform at its best takes a bit more effort to pull off than text prompting, but the trade-off is enhanced control over specific compositional elements. However, in order to gain some of that control, bbox must be used to identify the space in which objects or text should be placed. In order to do this, it looks like the user must identify the pixel space/coordinates for each bbox. Since most users are not aware of these dimensions without using a separate program, I was thinking that perhaps the UI for inpainting would be a possibility for drawing bbox to create the json within kobold, and then feed the result directly to the model, since the inpainting UI knows the canvas size and location of marked spaces. Is something like this possible to implement?

Hi all:
I’ve been exploring koboldcpp and koboldai lite on my local inference machine. It’s been good fun as I’ve been doing a few RP sessions.

I use the chat app telegram to keep up with my friends and community and telegram recently released an update that allows for chat automations that I want to explore.

I take a long time to get back to people and most of the time it’s banal sentiments that people like to do to feel connected. It’s sweet but a responsibility that leaves me feeling a bit socially drained. I’d love to have an AI impersonate me and help me keep up with messages until I slide back into being naturally social.

Is this possible with kobold? Any recommendations or advise on using the platform to get it to chat like me?

HF blocks download threads

I want to signal this early to the community since this seems to be a very recent change.
Upon starting a KoboldCpp instance I was greeted with 403 errors on every thread except for one.

This kind of download acceleration is needed in the current way the GGUF ecosystem is handled, its large single files and the single thread download speed is often capped at 40mb/s.

With tools like hf cli downloading an entire repo is accelerated by downloading multiple separate files at once and in safetensors repositories its common place to have a lot of smaller split files to achieve parallelism. The GGUF repositories however are not suitable for this currently, they contain large files and every single quant in the same branch. This makes downloading an entire branch pointless, and it also means that currently most models you can't apply the kind of acceleration we have been doing.

I hope that huggingface reverses this change since I see very little difference between the impact of us all downloading 16 files at once, or one file 16 times at once. But with this in place downloads will be significantly slower unless the GGUF ecosystem also transitions into large amounts of split files which most people do not find desirable.

If this is not reversed one option would be uploading quants in large amounts of split files each in their own branch of a repository, similar to how the exl uploaders have been doing it. This would help people download them much faster, but would then mean they have to manually merge them if they wish to keep them as a single file. This is much less desirable than HF helping the community out by reversing this.

Which version of Deepseek V4 Flash on huggingface is the best? Obviously it will also have to be uncensored