u/OrneryCar6139

Hi everyone,

I'm looking for an open-source, self-hosted AI/LLM Gateway that sits between agent frameworks (CrewAI, LangGraph, AutoGen, etc.) and multiple LLM providers.

My main requirement is dynamic runtime routing. I should be able to:

Add/remove models

Enable/disable models

Change routing weights/strategy

without restarting either the gateway or the agents.

Other features I'm looking for:

Multi-provider support

Load balancing

Fallbacks

Retries

Timeouts

Health checks

Latency/metrics

OpenAI-compatible API

I've looked at LiteLLM and Portkey, but they don't seem to provide a simple self-hosted solution for centrally managing routing configuration with hot updates (unless I'm missing something).

Is there an OSS project that already does this, or do most teams build their own lightweight gateway/control plane?

Would love to hear what you're using in production.

Hi everyone,

I'm looking for an open-source, self-hosted AI/LLM Gateway that sits between agent frameworks (CrewAI, LangGraph, AutoGen, etc.) and multiple LLM providers.

My main requirement is dynamic runtime routing. I should be able to:

Add/remove models

Enable/disable models

Change routing weights/strategy

without restarting either the gateway or the agents.

Other features I'm looking for:

Multi-provider support

Load balancing

Fallbacks

Retries

Timeouts

Health checks

Latency/metrics

OpenAI-compatible API

I've looked at LiteLLM and Portkey, but they don't seem to provide a simple self-hosted solution for centrally managing routing configuration with hot updates (unless I'm missing something).

Is there an OSS project that already does this, or do most teams build their own lightweight gateway/control plane?

Would love to hear what you're using in production.

Hi everyone,

I'm looking for an open-source, self-hosted AI/LLM Gateway that sits between agent frameworks (CrewAI, LangGraph, AutoGen, etc.) and multiple LLM providers.

My main requirement is dynamic runtime routing. I should be able to:

Add/remove models

Enable/disable models

Change routing weights/strategy

without restarting either the gateway or the agents.

Other features I'm looking for:

Multi-provider support

Load balancing

Fallbacks

Retries

Timeouts

Health checks

Latency/metrics

OpenAI-compatible API

I've looked at LiteLLM and Portkey, but they don't seem to provide a simple self-hosted solution for centrally managing routing configuration with hot updates (unless I'm missing something).

Is there an OSS project that already does this, or do most teams build their own lightweight gateway/control plane?

Would love to hear what you're using in production.

Hi everyone,

I'm looking for an open-source, self-hosted AI/LLM Gateway that sits between agent frameworks (CrewAI, LangGraph, AutoGen, etc.) and multiple LLM providers.

My main requirement is dynamic runtime routing. I should be able to:

Add/remove models

Enable/disable models

Change routing weights/strategy

without restarting either the gateway or the agents.

Other features I'm looking for:

Multi-provider support

Load balancing

Fallbacks

Retries

Timeouts

Health checks

Latency/metrics

OpenAI-compatible API

I've looked at LiteLLM and Portkey, but they don't seem to provide a simple self-hosted solution for centrally managing routing configuration with hot updates (unless I'm missing something).

Is there an OSS project that already does this, or do most teams build their own lightweight gateway/control plane?

Would love to hear what you're using in production.

Hi everyone,

I'm looking for an open-source, self-hosted AI/LLM Gateway that sits between agent frameworks (CrewAI, LangGraph, AutoGen, etc.) and multiple LLM providers.

My main requirement is dynamic runtime routing. I should be able to:

Add/remove models

Enable/disable models

Change routing weights/strategy

without restarting either the gateway or the agents.

Other features I'm looking for:

Multi-provider support

Load balancing

Fallbacks

Retries

Timeouts

Health checks

Latency/metrics

OpenAI-compatible API

I've looked at LiteLLM and Portkey, but they don't seem to provide a simple self-hosted solution for centrally managing routing configuration with hot updates (unless I'm missing something).

Is there an OSS project that already does this, or do most teams build their own lightweight gateway/control plane?

Would love to hear what you're using in production.

Hi everyone,

I'm planning a 2-day trip from Delhi tomorrow or the day after and am considering Chakrata, Mussoorie, or Nainital.

How's the weather there currently? Is it raining heavily, and are the roads safe to drive on? Which of these destinations would you recommend at the moment considering the current conditions?

Thanks in advance!

Hi everyone,

I'm planning a 2-day trip from Delhi and wanted to know which hill station is currently getting the least rainfall and is safe to visit over the next couple of days. I'm looking for places with lower chances of landslides, road closures, or major travel disruptions.

Any recent experiences or suggestions would be really helpful. Thanks!

Hi everyone,

I'm planning a trip to Jim Corbett and would love some advice.

Which safari zone would you recommend for the best wildlife experience? Any good resorts you've personally stayed at? Also, if you know any reliable safari booking contacts or trusted local operators, please share them.

Thanks in advance!

Hi everyone! I'm planning a 2-day trip to Jaipur with my family next week. Could you suggest an ideal itinerary covering the must-visit places without feeling too rushed?

Also, how are the current rain, waterlogging, and heat conditions? Is sightseeing comfortable, or should we expect disruptions? Any local tips would be appreciated. Thanks!

Hi everyone,

I'm planning to drive from Delhi to Jaipur with my family next week. I've seen videos of waterlogging near Jal Mahal. Is it limited to that area, or is it affecting most of the city? Is it a good time to visit?

Thanks!

Hi everyone,

I'm planning to drive from Delhi to Jaipur with my family next week. I've seen videos of waterlogging near Jal Mahal. Is it limited to that area, or is it affecting most of the city? Is it a good time to visit?

Thanks!

Hi everyone,

I'm driving from Delhi to Udaipur with my family next week. Which route would you recommend for the best roads and overall safety? Is it safe to drive overnight, or is daytime travel a better option?

Also, if you have any recommendations for good food stops or any tips for the journey, I'd really appreciate them.

Thanks!

Hi everyone,

I'm driving from Delhi to Udaipur with my family next week. Which route would you recommend for the best roads and overall safety? Is it safe to drive overnight?

Also, if you have any recommendations for good food stops or any tips for the journey, I'd really appreciate them.

Thanks!

Can anyone recommend a reliable place in Delhi NCR for getting a customized silver bar or silver tray made?

Looking for good craftsmanship, proper hallmarking, and a trustworthy seller. Personal experiences and recommendations would be greatly appreciated.

Thanks!

Hi everyone,

​

I'm planning a Goa trip for my parents (both in their early 50s) from 28 June to 1 July and would appreciate some advice from people who have visited Goa during the monsoon.

​

They are looking for a relaxed vacation rather than nightlife or water sports. Their priorities are:

​

- Comfortable hotel/resort

- Good food and cleanliness

- Scenic views and sightseeing

- Easy local transportation

- Safe and enjoyable experience during the rains

​

A few questions:

​

1. Is Goa worth visiting from 28 June to 1 July, or will the monsoon be too disruptive?

2. Would you recommend North Goa or South Goa for a couple in their 50s?

3. What are the best monsoon activities and sightseeing spots during this period?

4. Are there any resorts or hotels that offer particularly good value in the monsoon season?

​

I'm also looking for package recommendations that include:

​

- Flights from Delhi

- Hotel stay

- Airport transfers

- Sightseeing (if possible)

​

If you've booked a similar package recently, please share:

​

- Cost per person

- Travel company used

- Hotel name

- Overall experience

​

Budget is around ₹20,000–₹35,000 per person including flights, but I'm mainly looking for the best value and comfort.

​

Would you recommend Goa during these dates, or is there another destination in India that would be better for a couple in their 50s?

​

Thanks in advance!

Hi everyone,

​

I recently got selected for a GenAI / Agentic AI Developer role at HCLTech and wanted to get some honest feedback about the Noida Sector 60 office before making a decision.

​

The role involves working on technologies like LLMs, RAG, Agentic AI, embeddings, tool calling, and related GenAI solutions.

​

A few things I'd love to know:

​

- How is the overall work culture at the Noida Sector 60 office?

- Is the work mode mostly hybrid or work-from-office?

- How are the GenAI/AI projects and teams?

- Is the work more development-focused or support/maintenance-oriented?

- How is the work-life balance and growth for someone in a GenAI role?

​

Would really appreciate insights from current or former HCLTech employees.

​

Thanks!

I am not sure if this is the correct subreddit to ask this question but now it is what it is

​

Hi everyone,

​

I attended the HCL walk-in drive in Noida yesterday for a GenAI / Agentic AI Developer role and was informed that I have been selected. HR is expected to call me on Monday regarding the offer and compensation.

​

A bit about my profile:

​

- Current CTC: 6 LPA

- Experience: ~1 year

- Current role: GenAI Developer at a service-based company in Gurgaon

- Working on RAG, Agentic AI, LangGraph, CrewAI, Voice AI, Azure OpenAI, embeddings, tool calling, etc.

- Current job is fully remote with good work-life balance

​

I asked for 12 LPA during the interview process.

​

My first two technical rounds went really well. The final round was more focused on classical ML, Data Science, and compensation expectations. The interviewer mentioned that a 100% hike is quite high and that companies typically consider something closer to a 30% increase. I mentioned that my expectation was based on my research of compensation for similar AI/GenAI roles and didn't feel unrealistic.

​

He felt that while my GenAI skills were strong, I had some gaps in classical ML/Data Science, which made a 100% hike harder to justify. I explained that those are areas I haven't worked on extensively in my current role but can learn quickly, and that I had performed well in the earlier technical rounds.

​

He said he would discuss the compensation internally, and HR would get back to me.

​

Another consideration is that my current role is fully remote, whereas this HCL role is likely hybrid/on-site (I'll confirm with HR). Since the location is quite far for a daily commute, the overall switch would need to make sense both professionally and financially.

​

For people who have negotiated with HCL or similar service companies:

​

- What would be a realistic offer to expect?

- Should I continue targeting 12 LPA?

- If the offer is around 8–9 LPA, is it worth negotiating further?

- How much weight does clearing multiple technical rounds carry during salary discussions?

​

Would appreciate any advice from people who have been in a similar situation.

​

Thanks!

Hi everyone,

​

I attended the HCL walk-in drive in Noida yesterday for a GenAI / Agentic AI Developer role and was informed that I have been selected. HR is expected to call me on Monday regarding the offer and compensation.

​

A bit about my profile:

​

- Current CTC: 6 LPA

- Experience: ~1 year

- Current role: GenAI Developer at a service-based company in Gurgaon

- Working on RAG, Agentic AI, LangGraph, CrewAI, Voice AI, Azure OpenAI, embeddings, tool calling, etc.

- Current job is fully remote with good work-life balance

​

I asked for 12 LPA during the interview process.

​

My first two technical rounds went really well. The final round was more focused on classical ML, Data Science, and compensation expectations. The interviewer mentioned that a 100% hike is quite high and that companies typically consider something closer to a 30% increase. I mentioned that my expectation was based on my research of compensation for similar AI/GenAI roles and didn't feel unrealistic.

​

He felt that while my GenAI skills were strong, I had some gaps in classical ML/Data Science, which made a 100% hike harder to justify. I explained that those are areas I haven't worked on extensively in my current role but can learn quickly, and that I had performed well in the earlier technical rounds.

​

He said he would discuss the compensation internally, and HR would get back to me.

​

Another consideration is that my current role is fully remote, whereas this HCL role is likely hybrid/on-site (I'll confirm with HR). Since the location is quite far for a daily commute, the overall switch would need to make sense both professionally and financially.

​

For people who have negotiated with HCL or similar service companies:

​

- What would be a realistic offer to expect?

- Should I continue targeting 12 LPA?

- If the offer is around 8–9 LPA, is it worth negotiating further?

- How much weight does clearing multiple technical rounds carry during salary discussions?

​

Would appreciate any advice from people who have been in a similar situation.

​

Thanks!