u/DurthVadr

We're shipping SHIM (https://getshim.tech/) an AI gateway that sits between your app and OpenAI / Anthropic / Gemini / Ollama. Three things make it different from LiteLLM or Portkey:

PII scrubbing before the prompt leaves your network — Presidio plus custom recognizers for AWS keys, GitHub tokens, JWT, credit cards, EU + TR national IDs. Not a regex wrapper.
Semantic cache (vector similarity, not exact-match) In our internal load tests it catches 25-40% of repeat prompts.
Sub-100ms middleware overhead — measured, not promised.

What I need: teams running real LLM workloads (agents, chatbots, RAG) who want a free 6-month Enterprise license in exchange for 30 min of biweekly feedback. You get direct influence on the roadmap; we get unfiltered reactions.

Good fit: you handle user data that shouldn't leak to a third-party LLM; you've felt the pain of either DIY caching or eating retry costs; you can commit 30 min every 2 weeks.

I am open to DMs and happy to answer anything in comments.

Looking for Design Partners for AI gateway for LLM apps that need real PII compliance