soniox-rt-v4 transcribing in real time. This is unedited, actual speed (see linked source video from Gawne). Partial results stream as speech comes in before chunks get finalized with confidence. Huge amount of tokens is not a bottleneck for Soniox.
Video source: https://youtu.be/dncb_5CXE7o?si=tTy2vnGJ71YYg_yy&t=41
New post on the Soniox blog walking through a reference demo for real-time speech-to-speech translation across 60+ languages.
The whole loop is built on Soniox APIs:
stt-rt-v4): streaming transcription with language ID, mid-sentence language switching, and accurate alphanumericstranslation field on the STT config. Tokens stream mid-sentence, tagged original or translation in the same WebSocketFull Python + JS source on GitHub, linked in the post. Good read if you're building voice agents, meeting tools, support call translation, or anything where doing just subtitles breaks the UX.
Code-switching remains one of the harder problems in speech-to-text, especially on real-world audio. We are often asked how Soniox compares to Deepgram so here’s a comparison of Soniox stt-rt-v4 and Deepgram nova-3 on multilingual speech transcription where speakers overlap.
Both providers have speaker diarization turned on and context keyterms are passed for improved entity recognition of foreign names "İclal" and "Mahya".
Developers using Pipecat can now use a single speech stack supporting the same 60+ languages for both sides of the conversation (STT + TTS) when using Soniox, which makes building multilingual voice agents even easier.
With the recent launch of Soniox Text-to-Speech model and API, we also built a complete voice agent demo.
Guide:
https://soniox.com/docs/demo-apps/soniox-voice-agent
Code is freely available on Github:
https://github.com/soniox/soniox_examples/tree/master/apps/soniox-voice-bot-demo
Hoping this comes handy for putting together the building blocks for a solid voice agent.
Major step forward for Soniox - we launched Soniox Text-to-Speech - already available through Soniox API.
Soniox TTS is built for the hardest parts of speech generation:
• Native-speaker-quality speech in 60+ languages
• Hallucination-free speech generation
• Alphanumerics spoken correctly like numbers, IDs, addresses
• Correct pronunciation for names and foreign words
• Ultra-low-latency streaming for real-time voice applications
Read more:
https://soniox.com/blog/soniox-text-to-speech
https://soniox.com/docs/tts/models