u/PreviousAd9843

Seldon has been a popular choice for running AI and machine learning models in production, especially for large companies. Now that TrueFoundry has acquired Seldon, the combined platform can handle both AI model serving and the tools needed to manage AI agents, gateways, and workflows in one place.

This seems useful for enterprises that want to deploy AI without stitching together multiple tools. It could be especially valuable for industries like healthcare, finance, and government that need strong security, compliance, and on, premises deployment options.

What do you think? Will companies prefer a single platform that covers both inference and AI gateways, or will they continue using separate tools for each part of their AI stack?

We're handling 25K AI requests a day across Openai, Anthropic, and Bedrock. Direct API integrations are becoming difficult to manage due to provider outages, cost visibility issues, API key sprawl, and customer-tier rate limiting. We've been evaluating gateways and so far Bifrost, Truefoundry AI gateway, Cloudflare AI gateway, LiteLLM, and Kong AI gateway seem like the strongest options, each with different tradeoffs around performance, governance, observability, and operational complexity. Curious what others are running in production today and what has worked best at scale.

niliingia reddit some years back wakati writing ulikuwa unatafuta wazungu everywhere lakini sahii soko nikama ilikuwa over saturated, over the time ikakuwa inactive, sahii naona sharp boys everywhere wanaearn na reddit but I have no clue how, mtu anicomb jameni ni kunoma huku nje,