u/MenuNo294

Hi all:
I’ve been exploring koboldcpp and koboldai lite on my local inference machine. It’s been good fun as I’ve been doing a few RP sessions.

I use the chat app telegram to keep up with my friends and community and telegram recently released an update that allows for chat automations that I want to explore.

I take a long time to get back to people and most of the time it’s banal sentiments that people like to do to feel connected. It’s sweet but a responsibility that leaves me feeling a bit socially drained. I’d love to have an AI impersonate me and help me keep up with messages until I slide back into being naturally social.

Is this possible with kobold? Any recommendations or advise on using the platform to get it to chat like me?

Hi All:

Earlier this year I built a new machine specifically for inference work. I went with 2x RTX6k Pro Max-Q to start with. I've mostly just been using Qwen3.6-35b-a3b which is great but I'm not really taking advantage of the 2 cards. There's plenty of much larger models like kimi, deepseek, and the like; but I cant run those on 2 cards.

I think my workflow would benefit from some of these bigger models, but my question is, does upgrading from 2 to 4 cards make sense? It feels like many people jump straight up to 8 cards.

Do people who use 4x RTX6kPro cards feel like the models that run on that hardware is worthwhile? Are you comfortable where you are at that level of vram?

Thanks for your thoughts!