r/voiceagents

▲ 1 r/voiceagents+1 crossposts

CX reporting on AI voice agents at 50K+ calls/month what's working?

Looking for advice from CX leaders running AI voice agents at real volume.

We're a fintech and our AI voice agent now handles around 100k inbound calls a month — billing questions, account issues, the usual mix. It's been a win on cost and response time. The problem now is reporting up to leadership.

Every Monday our exec team wants to know things like why customer sentiment shifted last week, what's driving the spike in cancellation requests, whether certain account types are calling more often than others. Real voice of customer questions.

Today we answer those by pulling a sample of 50 calls, listening to them, categorizing by hand, and writing up the patterns we noticed. It takes the team most of the week. The answer is always partial because we're sampling 50 out of 100,000.

How are other CX teams in this position handling reporting? Is anyone happy with what they're doing today, or is everyone stuck on sampling and guessing?

reddit.com
▲ 19 r/voiceagents+13 crossposts

How do you actually test a voice AI agent without calling it yourself every time?

So we've been working on a voice bot that handles customer calls and honestly the testing part has been brutal. We were literally calling the thing ourselves to check if it broke after every change.

Eventually we just wrote a framework that synthesizes fake caller audio, pipes it into the agent, and checks if the response is sane — latency, hallucinations, whether it handles interruptions, etc. Runs locally against a SQLite db, no cloud stuff.

It connects over websockets, can mock twilio streams, works with elevenlabs and vapi agents too. You can also plug in ollama as the judge so the whole thing runs offline.

We open sourced it: https://github.com/unforkopensource-org/decibench

Curious how others here handle this. Are you just vibing and hoping production doesn't break or is there a better workflow I'm missing?

u/Tricky_School_4613 — 2 days ago

I want to test your AI Voice Agent

I'm working with my team on a research project that analyses common problems of modern AI voice agents.

I'm seeking agencies or developers who build AI voice agents that would allow us to call them via a phone number.

You will receive a detailed quality report of your voice agent at the end of our project. Ultimately the goal will be to publish the results anonymously (or if you like we can including a backlink to your website).

Please let me know if you'd like to participate in this research project. No cost involved.

reddit.com
u/AnxietyMost958 — 11 days ago

Looking for 10-min calls with anyone running Pipecat / LiveKit / Vapi-custom-LLM in production

I'm Nico, building Patter (open-source voice AI SDK, alpha). Before I write another line of code I want to talk to 10 people actually running voice agents in production right now.

Specifically looking for:

  1. Pipecat in production
  2. LiveKit Agents in production
  3. Vapi with custom LLM endpoint in production

10 min on a call. No pitch, not trying to sell anything.

DM me or drop a comment with your stack.

reddit.com
u/nicolotognoni — 10 days ago