u/cattwoman007

[ Removed by Reddit on account of violating the content policy. ]

Went through a proper eval of gateway options for routing across providers this year, sharing the breakdown since most posts on this stop at feature lists.

OpenRouter

Fastest to get running, point your existing client at their endpoint and it basically works, huge model catalog. Weak on the control plane side though, no real per-team budget caps or org-wide routing policy, fallback is defined per request rather than centrally.

LiteLLM

The open source workhorse, self-hosted, normalizes the API across providers so you're not maintaining provider specific request formats. Strong community, fast to get new models supported. You own the ops though, dashboards and governance are things you build on top rather than get out of the box.

Portkey

Real production controls, configurable retries and fallback conditions, semantic caching that genuinely cuts cost, solid observability. Most granular per-request reliability config of the group. Gets awkward at org scale though, more built for per-request setup than one policy applied across many services.

LiteLLM Proxy vs self-hosted gateways aside, Requesty is worth a mention here too, smaller but does per-request routing with decent fallback logic. Less mature ecosystem, fewer integrations than the bigger three.

Orq

Centralizes routing policy so budget caps and fallback chains apply across every service at once instead of per app. Part of a broader platform (prompt management, evals, observability sit alongside it) rather than a standalone gateway. Smaller model catalog than OpenRouter and a newer, less battle tested player than LiteLLM, so if catalog breadth or pure community size is what you need most, it's not the strongest pick here.

Real fork in this list is whether the problem is give me model access or help me govern usage across the org, first points to OpenRouter or LiteLLM, second to Portkey or Orq depending on whether it's reliability on a few services or policy across many.

What's everyone actually running in prod right now, and did you end up combining two of these rather than picking one?

So I was watching The Room (2003), and yes it was possibly the worst filmmaking I have witnessed. It was so bad that I actually ended up enjoying the hell out of it. like, I can't go an hour now without quoting a dialogue from this movie.

So I was looking for other films like this that are so bad, so cringe that you ended up having a blast watching them?