u/Glensta

Turns out the fastest AI model is completely different depending on how much text you send it

Turns out the fastest AI model is completely different depending on how much text you send it

Someone just published a study where they made 2,000 API calls to 9 small AI models across Google, OpenAI, and Anthropic at different prompt sizes from tiny to 1 million tokens.

The interesting finding is that model speed rankings completely flip depending on how much context you're sending. OpenAI's GPT-4.1-nano is the fastest for short prompts but becomes one of the slowest for large context. Google's Gemini Flash Lite is the opposite — slow for small stuff but handles 600K+ tokens faster than anything else tested.

There's also a bizarre result where Gemini Flash Lite actually gets faster when you send it more data around the 100K token mark. The theory is Google is routing to different hardware at that threshold.

Other finding worth knowing: Anthropic's tokenizer uses about 14% more tokens than OpenAI for the same text. So cost comparisons between providers are off if you're just looking at per-token pricing.

Full writeup with interactive charts: https://blog.0xmmo.co/forensics/post.html

u/Glensta — 3 days ago
▲ 2 r/SSRIs

If your antidepressants haven't worked, there are options beyond just switching to another SSRI

I spent about 2 years cycling through SSRIs thinking that was all there was. Lexapro, Zoloft, Wellbutrin added on top. Every appointment was the same adjust the dose, try a new one, give it 6 weeks. Nothing ever really stuck.

Nobody used the words "treatment-resistant depression" with me. I had to find that term on my own and once I did a whole set of options opened up that my psychiatrist had never mentioned.

I found this page that breaks it down really well: http://your-self-advocate.com/trd

It's not a generic "what is depression" site. It's specifically for people whose antidepressants haven't worked well enough and it gives you actual options to discuss with your doctor. Has coupons for some of the newer meds that are ridiculously expensive without help. There's also a section on clinical trials including some studying psychedelic-based therapies some offer free treatment and a small payment for participating.

Just sharing because I wasted a long time thinking switching SSRIs was my only path forward. It's not.

reddit.com
u/Glensta — 6 days ago

If your antidepressants haven't worked and you're running out of options, there are clinical trials actively looking for people right now

I know a lot of us have been through the cycle of trying SSRI after SSRI and getting nowhere. I've been there. At some point you start wondering if anything is ever going to work.

I found this site recently that lists clinical trials specifically for treatment-resistant depression that are actively recruiting right now. Not the ClinicalTrials gov nightmare where half the results are closed or irrelevant this is filtered to only show trials that are currently looking for participants across the US.

mentalhealthfrontiers.com

A lot of the trials are studying newer approaches including psychedelic based therapies which is worth knowing about if conventional meds haven't done enough. Some of them offer free treatment and a small payment for participating. The site also explains in plain language why you might or might not want to participate which is helpful because most trial sites assume you're a doctor reading them.

Not saying clinical trials are for everyone but when your options feel like they've run out its good to know there are things being studied right now that aren't available through a normal prescription yet. Figured I'd share in case it helps someone here.

reddit.com
u/Glensta — 6 days ago

For anyone whose anxiety meds aren't working well enough there are newer treatments being studied right now that you can access through trials

I know the medication cycle for anxiety is exhausting. Try this SSRI for 6 weeks, doesn't work, try another one, maybe add a benzo but only shortterm, try therapy, try a different therapy. If you've been through all of that and still aren't where you want to be it can feel like there's nothing left.

But there are clinical trials actively recruiting right now for anxiety that are studying completely different approaches. One of them is a Phase 3 trial using an LSD-based compound for generalized anxiety disorder. There are others studying different mechanisms too.

I found them through mentalhealthfrontiers.com which only lists trials that are currently recruiting. Way easier than trying to find anything useful on ClinicalTrials gov. The site explains what participating involves in normal language and it's not affiliated with any pharma company so it's not just pushing one specific trial.

Participation is free and some trials pay a small amount. Not saying it's for everyone but if you feel like you've exhausted your current options it's worth knowing these exist. I didn't know about most of them until recently and I wish I had sooner.

If you're in crisis or struggling right now please reach out to a professional or someone you trust. This is just one option among many but knowing it's there can help.

reddit.com
u/Glensta — 6 days ago

We built a tool that installs frameworks like ComfyUI, Ollama, OpenWebUI etc on any cloud GPU in one command and saves your whole setup between sessions

We kept running into the same problem every time we rented a GPU to run Ollama + OpenWebUI or ComfyUI, we'd spend the first 45 minutes reinstalling everything. Custom nodes, models, configs, all of it. Docker images went stale fast, different providers had different base images, and nothing was truly portable. We got sick of it and built swm.

Here's what it does for ComfyUI users specifically:

swm gpus -g a100 --max-price 2.00 --sort price shows you the cheapest available GPU across RunPod, Vast ai, Lambda, and 7 other providers in one view

swm pod create — spins up an instance on whatever provider you pick

swm setup install comfyui — installs ComfyUI on the pod

From there the main thing is the workspace sync. Your entire setup custom nodes, models, outputs, configs lives in S3-compatible object storage (I use B2). When you're done you run swm pod down and it pushes everything, kills the instance, and next time you spin up on any provider you just pull and everything is exactly where you left it. No more reinstalling 15 custom nodes and redownloading checkpoints every session.

We also built a lifecycle guard because we kept falling asleep mid-session and waking up to dumb bills. It watches GPU utilization and if nothing's happening for 30 minutes (configurable), it saves your workspace and terminates automatically. Has saved us more money than we want to admit lol.

A few other things:

  • Background auto-sync daemon pushes changes every 60 seconds so you don't have to remember to save
  • Tar mode for huge workspaces with tons of small files packs everything into one S3 object instead of 600k individual uploads
  • Also supports vLLM, Ollama, Open WebUI, SwarmUI, and Axolotl if you do more than SD
  • Works with Cursor, Claude Code, Codex, Windsurf if you want your AI agent to manage GPU instances for you

Free, open source, Apache 2.0.

pipx install swm-gpu

Would love feedback from anyone who rents GPUs. What's the most annoying part of your current workflow? We are also looking for contributors to the open source repo and suggestions on new frameworks/extensions to be included. Please share your thoughts

reddit.com
u/Glensta — 8 days ago
▲ 57 r/OpenSourceAI+1 crossposts

I built a free tool that installs ComfyUI on any cloud GPU in one command and saves your whole setup between sessions. Open source.

Got frustrated reinstalling ComfyUI every time I rented a GPU. Custom nodes, models, configs every session started with 45 minutes of setup before I could actually generate anything. Docker images got stale fast and different providers have different base images so nothing was truly portable.

So I built swm. It's a CLI that handles GPU rental and setup across 10 cloud providers.

For ComfyUI specifically:

  • swm gpus -g a100 --max-price 2.00 --sort price shows you the cheapest GPU across RunPod, Vast ai, Lambda, and 7 others
  • swm pod create — spins up whatever's cheapest
  • swm setup install comfyui — installs ComfyUI on the pod
  • Your whole workspace (custom nodes, models, outputs, everything) syncs to S3 so next session you just pull and it's all there. No starting from scratch every time.

The other thing that's saved me a lot of money is the lifecycle guard. It watches GPU utilization and if nothing's happening for 30 minutes (configurable), it saves your workspace and terminates the instance. I used to fall asleep or get distracted mid-session and wake up to stupid bills. Doesn't happen anymore.

It also works with vLLM, Ollama, Open WebUI, SwarmUI, and Axolotl if you do more than just SD.

Free, open source, Apache 2.0. pipx install swm-gpu

Site: https://swmgpu.com GitHub: https://github.com/swm-gpu/swm 

Curious if anyone else has been dealing with the same setup-every-time problem or if I'm the only one who was doing it wrong lol. Open to feedback on what to build next.

reddit.com
u/Glensta — 5 days ago

I’ve been trying to find one bag I can use for work travel without looking like I’m about to go hiking

Right now I use an old backpack from a local shop, that’s comfortable but definitely doesn’t fit business travel/conference vibes. Looking for something cleaner that can still fit:

  • laptop
  • chargers
  • clothes for a few days
  • maybe an extra pair of shoes

So far I’ve been looking at:

  • Aer Travel Pack 3
  • Peak Design Travel Backpack
  • Bellroy Transit Backpack Plus
  • Carl Friedrik Traverse Backpack

I’d love recommendations from people who travel regularly and found something that actually holds up long term.

reddit.com
u/Glensta — 14 days ago

We built an app around this idea and genuinely don't know if it works for everyone or just for us. The app is called BeatYou, it's on the App Store. The concept is simple you set habits, pick a charity, and when you break a streak the app prompts you to donate. It doesn't deduct anything automatically or touch your bank account, you make the donation yourself. It's an honor system accountability thing.

For us it works because we don't feel guilty when we fail. The money did something good. We actually open the app the next day instead of avoiding it. But we've talked to a few people who said the money element would stress them out regardless of where it goes.

We're looking for people who want to try it and give us a straight answer.

reddit.com
u/Glensta — 21 days ago