r/LLM_Gateways

I work for a dev tool company primarily associated with observabity,evals and gateways. (am not mentioning the name of the company cause i dont want to pitch or sell you guys something). Do you guys think that something breaking in prod and getting to know it from users and then spending time on debugging is actually a frustation or pain point for you guys. Or is it something like a false belief the company has

been exploring options since a while. how to give access to models across multiple vendors like openai , anthropic etc to our employees.. mainly for our internal playgrounds and demos only..

we are into service and our clients have their own models in across their vpc and we do not supply their infrastructure.

just got an understanding of llm gateways which gives the ability to control access through proxies and synthettic keys

want to know if anyone here has a recommendation or experience?