u/Western_Bug_5085

We put together a short reel showing Push-to-Talk and Hands-Free voice interactions for Convai-powered AI characters.

Push-to-Talk gives users direct control over when they speak, which works well for focused interactions and structured experiences.

Hands-Free mode lets users talk more naturally, with voice activity detection helping the character know when the user starts and stops speaking.

This gives developers more flexibility when building AI characters for games, simulations, virtual guides, training experiences, and other interactive 3D applications.

Get started:
https://convai.com

Convai Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Feedback and questions are welcome.

With Custom Actions, developers can add project-specific actions that avatars can perform through natural language commands.

These can range from simple actions like dance moves to more complex behaviors like walking up to an object and picking it up.

This helps make AI characters more interactive and connected to game engine projects, virtual worlds, simulations, and other real-time 3D experiences.

Full tutorial:
https://www.youtube.com/watch?v=gNILGcnjgck

Get started:
https://convai.com

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

We put together a short reel on Convai Avatar Studio.

Avatar Studio lets you create AI avatars directly in the browser. You can start with your character’s AI mind, including backstory, personality, voice, language, and knowledge, then bring it to life as a talking 3D avatar.

You can customize the avatar, choose an environment, adjust the experience, and start testing without setting up a game engine.

This can be useful for product demos, virtual guides, onboarding, training experiences, customer support, kiosks, and other interactive web-based applications.

Get started:
https://convai.com

We put together a short reel showing how Convai-powered AI avatars can trigger animations and actions from natural language commands.

Convai comes with out-of-the-box animations and behaviors like navigation, movement, gesturing, and basic actions.

With the updated Actions system, developers can also add custom animations and project-specific behaviors, making AI characters more interactive inside game engine projects.

Get started:
https://convai.com

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Convai Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Feedback and questions are welcome.

We put together a short reel on Dynamic Context for Convai-powered AI characters.

Dynamic Context lets AI characters receive live information such as gameplay events, task progress, player state, environmental changes, and more.

Combined with Vision and long-term memory, this helps characters respond with more awareness of what is happening in the experience, what the user is doing, and what has changed in the world around them.

This can be useful for games, simulations, training experiences, digital twins, virtual guides, and other virtual world applications.

Convai Dynamic Context Tutorial: https://youtu.be/zGIBCWSElXs

Get started: https://convai.com

Convai Unreal Engine Plugin: https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Convai Unity Plugin: https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Feedback and questions are welcome.

Hi everyone,

Making this post on behalf of the Convai team (this is my second post here), so I wanted to share something practical for VR developers.

The workflow (YT link) below helps you bring AI characters to Unity and Unreal Engine VR projects. They can hold natural voice conversations, understand scene context, and respond in real time.

With Convai's updated Actions system, these characters can also navigate the scene, follow the player, trigger animations, and perform simple behaviors inside the virtual world, fully out-of-box.

The workflow can be used to build VR training simulations, digital twins, onboarding experiences, virtual guides, interactive companions, and other immersive 3D applications.

Unreal Engine VR tutorial for anyone who wants to test this workflow inside a VR project:
https://youtu.be/rUTrXkH1wfg

Get started:
https://convai.com

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Convai Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

I don’t want to spam here, so please do let me know if tutorials like this are useful and I’ll share more implementation-focused VR character content going forward.

We put together a short reel from our Unity setup tutorial.

The updated Convai Unity plugin lets developers build interactive AI characters with hands-free voice conversations, lower-latency WebRTC interaction, long-term memory, knowledge integration, live game context, and real-time lip sync with natural facial animation.

In the full tutorial, we walk through installing the Convai SDK, setting up the Convai Manager, Player, and Character components, adding transcript UI, and enabling real-time lip sync on a Unity avatar.

Full tutorial:
https://youtu.be/bxjGnOvNL4E

Convai Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Unity Plugin Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/unity-plugin-beta-overview

Blog:
https://convai.com/blog/unity-tutorial-interactive-conversational-ai-characters-webrtc-neurosync

Questions and feedback are welcome.

Hi everyone,

Our team has put together a short reel for the updated Convai Unreal Engine plugin, now available on Fab.

The plugin supports different avatar setups, including Metahumans, Reallusion avatars, custom avatars, and disembodied AI guides.

It is built on top of the Live Character APIs and supports low-latency interactions, contextual responses, and enhanced vision and environmental awareness for AI characters in Unreal Engine projects.

Convai Unreal Engine Plugin on Fab:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Setup Tutorial:
https://www.youtube.com/watch?v=n-UG3nmMeZQ

Would be interested to hear how Unreal developers are approaching conversational AI avatars, virtual guides, and AI-driven characters in UE projects.

We published a short reel from our Convai MCP tutorial for Unreal Engine.

With Convai MCP, developers can use AI coding agents like Codex or Claude Code to connect a Convai AI mind to an avatar, make it conversational, and keep adding behavior inside Unreal Engine.

In the demo, we add player greetings, navigation, command-triggered animations, and simple gameplay logic.

Full tutorial:
https://youtu.be/dQgOzt8BNIk

Convai Unreal Engine Plugin on Fab:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

AI Metahuman Tutorial:
https://youtu.be/4fMCKkrfyaA

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Questions and feedback are welcome.

We are excited to announce that we have published a new tutorial on using Convai MCP in Unreal Engine.

The tutorial shows how to use an AI coding agent like Codex to connect a Convai AI mind to an avatar, make the character conversational, add a proximity greeting, enable follow behavior, trigger a clapping animation, and set up a simple coin collection interaction.

The goal is to make it easier to build and iterate on AI character behavior directly inside Unreal Engine.

Full tutorial:
https://youtu.be/dQgOzt8BNIk

Convai Quick Setup Guide:
https://youtu.be/n-UG3nmMeZQ

Convai Unreal Engine Plugin on Fab:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Questions and feedback are welcome.

We put together a short reel from our Object in Attention tutorial for Unreal Engine.

With Object in Attention, Convai-powered AI players can understand what the user is looking at and respond with the right object context.

In the demo, the user looks at an item in a weapon shop and asks about it naturally, without naming it directly.

Full tutorial:
https://youtu.be/Ffkzgof_wKw

AI Metahuman Tutorial:
https://youtu.be/4fMCKkrfyaA

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Convai Unreal Engine Plugin on Fab:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Questions and feedback are welcome.

We put together a short reel showing Convai Actions in Unreal Engine.

With Convai Actions, AI players can understand natural language commands and perform actions inside the game world. In this demo, the character follows the player and triggers a clapping animation.

The updated Convai Unreal Engine plugin is now available on Fab.

Full Actions Tutorial:
https://youtu.be/lB5_KRWdg_w

Convai Unreal Engine Plugin on Fab:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

AI Metahuman Tutorial:
https://youtu.be/4fMCKkrfyaA

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Questions and feedback are welcome.

We just published a new Unreal Engine tutorial on Object in Attention.

With Object in Attention, Convai-powered AI players can understand what the user is looking at and respond with the right object context.

In the demo, the user looks at different weapons in a virtual shop and asks about their price. Once Gaze Attention is enabled and the objects are defined, the AI player can identify the focused object and answer naturally.

The tutorial covers enabling Gaze Attention, adding the Convai Object component, setting up object highlights, configuring gaze response settings, and customizing gaze-related properties.

Full tutorial:
https://youtu.be/Ffkzgof_wKw

Convai Unreal Engine Setup Tutorial:
https://youtu.be/n-UG3nmMeZQ

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Questions and feedback are welcome.

You can now bring Convai-powered AI characters to your games, simulations, and other virtual world experiences in Unreal Engine 5.8.

Get the Convai Unreal Engine plugin on Fab:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

#Convai #UnrealEngine #UE5 #AICharacters

Convai helps developers bring AI avatars into Unity and Unreal Engine with natural voice conversations, real-time vision, dynamic context, and Dialogue to Action capabilities.

That means AI characters can respond to the user’s voice, understand what is happening in the scene, use live game context, and trigger actions inside the environment.

This can be used across games, training simulations, digital twins, virtual guides, onboarding experiences, and immersive 3D applications.

Get started:
https://convai.com

Unity Plugin:
https://assetstore.unity.com/packages/tools/behavior-ai/npc-ai-engine-dialog-actions-voice-and-lipsync-convai-235621

Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Questions and feedback are welcome.

We put together a short reel for Convai Avatar Studio.

Avatar Studio lets you build AI avatars directly in the browser. You can start by creating the character’s AI mind in the Convai Playground, including its backstory, personality, voice, language, and knowledge.

Then you can bring that character into Avatar Studio to customize its appearance, environment, animations, interface, and more.

The avatar can hold real-time voice conversations and be used across web-based experiences, kiosks, training simulations, product demos, and customer support workflows.

Get started:
https://convai.com

Developer Forum:
https://forum.convai.com

Questions and feedback are welcome.

We put together a short reel from our Object in Attention tutorial for Unreal Engine.

With Object in Attention, Convai-powered AI players can understand what the user is looking at and respond with the right object context.

In the demo, the user looks at different weapons in a virtual shop and asks about their price. Once Gaze Attention is enabled and the objects are defined, the AI player can identify the focused object and answer naturally.

The full tutorial covers enabling Gaze Attention, adding the Convai Object component, setting up object highlights, configuring gaze response settings, and customizing gaze-related properties.

Full tutorial:
https://youtu.be/qKJ3zJwQp1A

AI Metahuman Tutorial:
https://youtu.be/4fMCKkrfyaA

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Questions and feedback are welcome.

This reel shows a Convai-powered Metahuman triggering different dance animations inside Unreal Engine.

The setup uses Custom Actions to define the behavior, and Parameterized Actions to let one action support multiple controlled variations, such as different dance types.

If the user asks for a dance outside the supported list, fallback behavior prevents the wrong action from being triggered and lets the character respond appropriately.

Full tutorial:
https://youtu.be/gNILGcnjgck

Custom Action Handlers Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/character-actions/building-custom-action-handlers

Parameterized Actions Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin/features/character-actions/parameterized-actions

Convai Unreal Engine Plugin:
https://www.fab.com/listings/ba3145af-d2ef-434a-8bc3-f3fa1dfe7d5c

Questions and feedback are welcome.

Bring AI-powered 3D avatars to your VR worlds in Unreal Engine.

With Convai, avatars can hold hands-free conversations, understand the scene, and respond in real time. They can follow the user, point to objects, trigger animations, and interact inside the environment.

This is built for VR training simulations, onboarding characters, digital twins, virtual guides, and immersive 3D experiences.

Full Unreal Engine VR tutorial:
https://youtu.be/rUTrXkH1wfg

AI Metahuman Tutorial:
https://youtu.be/4fMCKkrfyaA

Convai Actions Tutorial:
https://youtu.be/lB5_KRWdg_w

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Blog:
https://convai.com/blog/how-to-set-up-hands-free-ai-npc-conversations-in-vr-with-convai-and-unreal-engine-5

Questions and feedback are welcome.

We put together a short reel from our Unreal Engine VR tutorial.

With Convai, VR avatars can hold hands-free voice conversations, understand their surroundings, and respond contextually inside the scene.

The tutorial shows how to set up a Convai-powered AI player with a 3D chat widget, hands-free conversation, scene objects, and Actions inside VR.

In the demo, the avatar follows the user, points to a fireplace, and answers questions about the environment.

Full Unreal Engine VR tutorial:
https://youtu.be/rUTrXkH1wfg

AI MetaHuman Tutorial:
https://youtu.be/4fMCKkrfyaA

Convai Actions Tutorial:
https://youtu.be/lB5_KRWdg_w

Convai Unreal Engine Documentation:
https://docs.convai.com/api-docs/plugins-and-integrations/convai-unreal-engine-plugin

Blog:
https://convai.com/blog/how-to-set-up-hands-free-ai-npc-conversations-in-vr-with-convai-and-unreal-engine-5

Questions and feedback are welcome.