Early demo: Gemini-powered “Mentor on Call” for Meta Ray-Ban Display
Hey everyone, I’ve been building an early prototype called Mentor on Call for Meta Ray-Ban Display / Meta Display glasses.
The idea is an expert-on-demand assistant that lives on the glasses. You choose a mentor trained on a manual, checklist, or persona, then ask it questions about what you are seeing. For visual questions, the companion captures a still image, sends it to Gemini with the active mentor context, and the display shows a small avatar, response, and eventually a highlight over the part being discussed.
This clip uses a Miranda-inspired fashion-editor mentor because outfit critique makes the visual loop easy to understand. The bigger direction is more practical: repair manuals, machine setup, restaurant procedures, training checklists, or any situation where someone needs guidance while looking at the real world.
The design constraint I’m exploring:
- Web App stays lightweight and display-only: mentor picker, avatar, captions, image preview, targeting hints.
- Phone/DAT companion acts as the eyes, ears, and controller: camera/audio, Gemini calls, backend coordination. But they have a lot of design limitations around what is possible or not for this use-case like no continuous camera mirror; visual turns are user-triggered stills.
Small note: this is not available as an app yet. I’m posting it as an early prototype to get feedback from other builders and people thinking about glasses-native AI interfaces. If anyone is interested in helping test, shape, or eventually launch something like this, I’d love to chat.