[Open Source] TripOptic — AI trip planner on Spectacles: AR plan, pack scan, spatial destination (Gemini + SIK)
Trip planning still feels like 2012 — too many searches, open tabs, the same route rechecked many times, and packing from memory until you're already at the door.
I travel often. After repeating that loop enough times, when I got Spectacles I kept thinking:
Why is all of this still happening on my phone?
The plan should live in the space around you.
The camera should see what’s in the bag.
The glasses should already know where you’re going.
TripOptic is where this idea landed — a lens that turns a spoken trip brief into a spatial plan you browse with a pinch. No phone. No tab juggling. No context switching.
What’s in the demo
| Beat | What you’ll see |
|---|---|
| Input | Voice-first STT or AR keyboard — stepped fields with same TripDraft |
| Plan | One Gemini generateContent call → transport, stay, places, food, weather, pack |
| Browse | SIK pinch → spatial category rows → detail panel (formatted notes & options) |
| Pack | Camera capture → Gemini Vision grounded in trip + AccuWeather forecast |
| Destination | RSG Imagen → texture decode → native Spatial Image (layered planes fallback) |
Why Spectacles — not a phone, not a chatbot
- Hands-free capture — speak the trip at the airport, mid-pack, or walking out the door
- Spatial plan board — categories live around you instead of inside a vertical scroll
- Contextual pack scan — the camera sees the bag, the plan knows the route, the forecast shapes the suggestions
The interaction changes when the plan exists in your physical space instead of behind glass.
Scope (honest)
Planning and browsing only, not booking (yet)
Transport and stay rows are structured AI suggestions with “check Skyscanner”-style pointers — no live fare APIs in this repo.
API keys are configured via Lens Studio RSG credentials (not committed).
Exploring next: fresh-session search per category tap to reduce repeat lookups on the same route.
This entry focuses on the in-lens: plan → pack validation → destination preview.
Stack
Lens Studio
Spectacles Interaction Kit (SIK)
Remote Service Gateway (Gemini plan + vision, Imagen destination)
AccuWeather
Optional TTS (OpenAI via RSG, local config only)
UI/UX: AurixEmberwave | ArtStation
Roast welcome — especially:
- Weird city/date voice inputs
- Pack scan results on device
- Spatial Image vs layered planes — which feels more native?
If you were building for Spectacles, what would you ship next: Spatial itinerary timeline or flight-day mode?