u/stspanho

Lenslist asked Pavlo and me for a simple phone-recorded interview about building AR for Snap Spectacles. We went a bit overboard 😅: we wrote the answers as a script, cloned our voices with qwen3-tts, rendered our Bitmojis in Blender from 12 angles as character references, and let Seedance 2.5 generate the whole thing shot by shot, lip-synced to the cloned audio.

The setting is the 3D cave from our portfolio site, and every prop is one of our shipped projects.

This was definitely not a one-shot. We generated a lot of takes and kept the best ones. The lip sync quality surprised us the most, even on stylized characters with a beard covering half the mouth.

Full making-of with the examples prompts and pipeline: https://pavlo-stijn.dev/blog/posts/creator-spotlight-with-seedance-2-5.html

⚽ Every fan has re‑coached a goal in their head. I built a way to actually watch the alternate ending, in photoreal, on my kitchen table.

This is a real World Cup phase: Belgium vs Senegal. I took the actual 3D tracking data from the match, the real positions of every player and the ball, and rebuilt the phase as a live 3D scene on my table through Specs

Then I reach in and re‑coach it. In this one I nudge Brandon Mechele up a couple of metres to hold Belgium's offside line, and Senegal's goal comes back offside. The goal that counted, undone.

AI turns that edit back into real broadcast footage, two ways:

🎬 Full re‑render: reposition players and a video model regenerates the entire phase as a brand‑new, photoreal clip.

⚡ Real time: freeze the moment, drag a defender, and the photorealistic broadcast updates live. No waiting.

 How it works, high level:

 → Real World Cup 3D tracking data (every player and the ball) rebuilt as a 3D scene
 → Pitch‑line camera calibration to lock that 3D scene onto the real broadcast camera
 → Spectacles hand‑tracking for grab‑and‑move
 → Generative video models turn the edited 3D "blockout" back into photoreal football

Built with: Snap Spectacles + Lens Studio, using CLAD to build it fast. Realtime generation by Decart (Lucy 2.5). Full re‑render via Seedance.

We just released a one-click YOLOv7 object-detection trainer for Spectacles. The goal: go from "I want to detect X" to a model running on-device, without the usual data-labeling and export grind.

It runs as a single model on Replicate. You give it:

• a zip of real footage recorded through the Specs, and
• a few text prompts describing what you want to detect

…hit Run, and the pipeline does the rest:

1. FLUX.1-schnell generates extra first-person/POV training frames from your prompts, so you don't have to shoot hundreds of images yourself
2. SAM 3 auto-labels every frame (real + synthetic): zero manual annotation
3. YOLOv7-tiny fine-tunes on the combined set
4. exports a 224×224 SnapML ONNX, ready to drop straight into Lens Studio

Out comes a zip with the .onnx you swap into your Lens. Want to detect bananas instead of cups? Change one input and re-run.

To prove it works end-to-end, we trained a small batch on coffee cups and built a small example Lens: point your Spectacles at a real mug and it detects it and rises steam off it in AR. The whole example is open source and documented.

Links:

• One-click trainer: https://replicate.com/stspanho/spectacles-yolov7-trainer
• Example Lens + README: https://github.com/stspanho/spectacles-yolo-ml-example

Please let us know if it works!

Pavlo & Stijn (https://pavlo-stijn.dev/)

Training a custom object detector for Spectacles used to eat a whole weekend. Now it's one click. 🍎👓

Drop in some Snap Spectacles footage, add a few synthetic frames, hit run — and out comes a SnapML-ready ONNX model that drags straight into Lens Studio.

Under the hood: synthetic data tuned to look like what the glasses actually see, SAM3 auto-labelling every frame, a YOLOv7-tiny trained in the cloud, exported for on-device inference. No manual labelling, no local CUDA, no model surgery.

Huge thanks to u/Pavlo_Tkachenko for helping building this one 🙌.

It's in alpha. If you build for Spectacles and want early access: https://pavlo-stijn.dev/blog/posts/training-yolov7-for-spectacles.html

I took Micro Art, our new lens (made together with u/Pavlo_Tkachenko), out into nature and figured I'd share what I captured.

The idea is simple: you hold your phone like a magnifying glass, point it at anything (a leaf, bark, a petal, even rust on an old fence) and take a snapshot. The lens opens up the hidden micro-world of that surface and brings it to life as a glowing 3D material, floating right in front of you, ready to hold, turn, and explore. Your phone becomes your magnifier and your controller.

Taking it outside was where it really clicked for me. Stuff you'd walk straight past suddenly becomes this whole floating, glowing universe you can spin around in your hands. It brought back that childhood feeling of wanting a microscope and finding a whole world in the smallest things.

These are some of my favorite captures from the trip. 👇

Try it on Spectacles: https://www.spectacles.com/lens/f367568f2fbb4ac28c6af75f3dba28bb?type=SNAPCODE&metadata=01

Open on your phone: https://pavlo-stijn.dev/micro-art/

Made with: https://www.reddit.com/user/Pavlo_Tkachenko/