u/Sumit-Voiceman

We've made incredible progress over the last year.

LLMs are smarter than ever.

STT is highly accurate.

TTS can sound almost indistinguishable from a real person.

Latency is getting close to real-time.

And yet... after talking to most AI voice agents for less than a minute, you still know it's AI.

Personally, I don't think it's just latency or voice quality anymore.

It feels like humans subconsciously pick up on hundreds of tiny conversational signals—knowing exactly when to speak, when to pause, when to interrupt, when to acknowledge with a quick "mm-hmm," how to recover from awkward moments, and how to adapt naturally as the conversation unfolds.

I'm curious what others building in this space think.

If you could solve only ONE problem to make AI voice agents genuinely indistinguishable from humans, what would it be?

Turn-taking?

Interruptions (barge-in)?

Endpoint detection?

Backchanneling?

Emotional prosody?

Long-term memory?

Context switching?

Something else entirely?

I'd love to hear from people building production voice agents. What has been the hardest problem for you to solve—and why?

We’re currently exploring voice AI platforms for inbound/outbound calling use cases in regional Indian languages, specifically Assamese.

Most platforms seem to support Hindi, English, Tamil, Telugu, etc., but Assamese support is either missing or very limited.

Requirements:

- Assamese speech recognition + text-to-speech

- Natural sounding conversations

- API or workflow integration

- Ability to build AI call agents / voice bots

- Good latency for real-time calls

Would love recommendations from anyone who has actually tested this in production or at least in demos.

Open to startups, APIs, conversational AI platforms, or full-stack voice agent providers.

I’ve been building voice AI agents for businesses at Vomyra for quite some time now, and one thing we noticed early was this:

Most people don’t actually care which AI model you’re using.

They care about one thing:

“Does it feel natural?”

And honestly… most AI voice agents still sound robotic.

Not because the technology is bad.

But because real conversations are imperfect.

Humans:

pause while thinking

breathe between sentences

whisper sometimes

laugh unexpectedly

change tone based on emotion

Most AI systems only focus on words.

Very few focus on conversation behavior.

Over the last few months we tested multiple TTS engines like:

ElevenLabs

Cartesia

xAI voices

Voxtral and more for real-world customer calls.

Some had amazing voice quality.

Some had ultra-low latency.

Some handled emotions better.

Some worked better for Indian languages like Hindi, Tamil, Telugu, Kannada etc.

But the biggest learning was:

The moment AI starts sounding less perfect… it actually starts sounding more human.

We recently started adding:

natural pauses

breathing

whispering

emotional tone shifts

human-like conversation flow

And customer reactions changed instantly.

People stopped asking:

“Is this AI?”

Instead they started saying:

“This actually feels real.”

Curious to know:

What makes an AI voice sound robotic to you?

latency?

monotone speech?

wrong emotions?

unnatural pauses?

pronunciation?

over-politeness?

Would love to hear real experiences from people using voice AI tools daily.

#VoiceAI #ConversationalAI #TextToSpeech #AI #ElevenLabs #Cartesia #OpenAI #AIvoice