u/MegaSuplexMaster

I’m 100% a newbie when it comes to working with local models, but I had a question for the group.Has anyone here successfully built or deployed a local AI model for the company they work at? If so, what are you running, and what are you using it for?I know that’s a pretty vague question, but I’m mainly trying to see what others are doing in the real world.

Right now, we’re testing a local setup using Open WebUI + Ollama with:

qwen2.5:7b-instruct-q4_K_M

We have about 8 people using it in a small test group, and so far they’re happy with it. It works well for basic chatbot stuff like writing, editing, summarizing, and general questions.

The next step is figuring out how far we can take it. Long term, the goal would be to keep an internal AI chatbot where the data stays inside the company, then eventually have it connect to internal systems and maybe perform some automated tasks.

That said, I know the hardware we have now probably won’t scale much, so I’m curious what others are using and what kind of use cases you’ve actually had success with.

Thanks in advance.

So we are doing a POC at work, and I’m currently running Ollama (systemd) + Open WebUI (Docker) on Ubuntu with Llama 3 on T4 GPUs. It’s working great as a chatbot for simple questions, editing emails, summaries, etc.

However, I want to connect it to other sources that would help people in the business. I keep reading about MCP, and I’m trying to understand if I have this right.

Would I create an MCP server for each service I’m trying to connect to? Then once that’s done, when I ask questions in the chatbot, it can reach out to those services and return answers based on those connections?

If anyone thinks I should be doing this differently, or recommends a different frontend other than Open WebUI, please let me know. Also, bear with me, I’m new to this. Thanks.

This is partially a joke, but also kinda serious. I got diagnosed with ADHD when I was 7… I’m 47 now. I’ve basically struggled every damn day since then with finishing tasks, talking too much, interrupting everyone and everything, oversharing, being hyper as hell, being lazy, starting 27 projects and never finishing them, putting stuff off forever then feeling guilty about it later. Sitting around depressed thinking about dumb shit that happened 10 years ago for absolutely no reason. The list just keeps going.

But this week something kinda crazy happened. I wrote down a list of projects around the house I’ve been avoiding or never started. Last night I finally did one of them, built a firepit in the backyard and cleaned up an area that looked like total garbage.

Long story short, when I finished, I felt freaking amazing. I slept through the entire night for the first time in years. No waking up, no racing thoughts, no overthinking nonsense at 2AM. It honestly felt like my brain finally shut off for once.

I think I found the key: stop letting projects and unfinished crap linger in my head. Just do them. The problem is… I already know this, and e I feel like most of us with ADHD do too. But every time I do this its like I just figured out the key to life. How do I making it stick.

Right now I feel like I’m on cloud 9. My wife calls it my “ADHD upswing” because I’ll crush life for a week, get a million things done, feel unstoppable… then somehow slide right back into being miserable again.

Morning,

I’m in a pretty rough place lately and honestly don’t know how to pull myself out of it.

I’m 47, married 20 years, two daughters (17 and 22). On paper, things look fine decent job in tech, nice home, all that. But the reality feels completely different.

My daughters are going through their phases and are miserable a lot of the time. My wife is dealing with perimenopause and it feels like she’s constantly angry or checked out. On top of that, we’ve burned through our savings and 401k just trying to keep up with credit cards and dumb financial decisions. I have no clue how we’re supposed to retire, help the kids with college, or really do anything long-term.

Mentally, I feel shot. I’ve been pretty depressed for about a year now. I've gone to see a shrink last year and to be honest i felt like a big waste of time. I go to work, come home, have a couple drinks (nothing out of control maybe 2 or 3 beers), go to bed, repeat. That’s about it. My wife and I barely connect anymore. I try and get close to her get pushed away, i try to get close in a non sexual manner get pushed away. However she does seem like she wants to be here obviouslly its just not the same anymore. One kid is never home working, the other is busy with school and work. Feels like I’m just existing in the background.

People always say “work out, find a hobby, do something for yourself,” but I can’t get anything to stick. I was diagnosed with ADHD as a kid, and it honestly feels like that plays into it. I’ll start something, it goes okay for a day or two, then I drop it. Plus, money’s tight, so even trying new things feels like a stretch.

I’m constantly angry, frustrated, down, and just tired of feeling this way. Nights are the worst my mind races, I overthink everything, and it feels like I barely sleep. Then I get up and do it all over again.

Anyway… that’s my “short” version. If anyone has advice or has been through something similar, I’d really appreciate hearing it.