Building my first humanoid robot from scratch — the head now has local voice + vision
I’ve been building a humanoid robotics project called Evopien, mostly as a solo engineering project, and I’ve reached the point where the first head prototype can actually interact in a reasonably coherent way.
I decided not to start with arms or locomotion.
My first milestone was to get the basic sensory/conversational system working properly:
camera → visual input
microphone array → speech
local ASR → transcription
local LLM → reasoning/conversation
local TTS → speech output
The whole thing currently runs on an NVIDIA Jetson Orin Nano Super 8GB.
The head can now:
- listen and speak locally
- continue listening while it is speaking
- be interrupted naturally
- switch between English and Spanish
- use the camera when asked visual questions
- answer based on a current camera frame
The current hardware is intentionally pretty ugly. C920, ReSpeaker, external speakers, Jetson and cables.
I’m trying to prove the architecture before spending time designing the physical head.
The next major step is moving from a stationary conversational head toward proper perception/attention and eventually head movement, followed later by arms and hands.
Here is the current demo if anyone wants to see it working:
https://www.youtube.com/watch?v=iAxzePzF4cM
I’d especially appreciate criticism from people who have gone from a perception prototype into actual physical robotics. What would you make the next milestone before starting the mechanical head?