IOBT Shipped Three Years Ago - Yet Apple Vision Pro Can't Catch Up; I Reverse Engineered Apple's Unreleased Body Tracking Solver on a Mac!
▲ 13 r/OculusQuest+1 crossposts

IOBT Shipped Three Years Ago - Yet Apple Vision Pro Can't Catch Up; I Reverse Engineered Apple's Unreleased Body Tracking Solver on a Mac!

Hey, I'm a huge fan of the Quest, Meta RLR and Oculus (of course). Yet oddly, I was set to start at Apple back in June 2024, to build the Codec Avatars of the future within Persona for Apple Vision Pro, and other features for AppleTV+.

After ten interviews, Apple told me I was going to be offered the job in 24-48 hours, until I revealed details of my disabilties, including the fact I'd just been diagnosed with ADHD and was starting a new medication. This apparently made the initial onboarding period impossible due to the inseparable nature of the software from the hardware.

Two years later, Apple Vision Pro has no Full Body Persona, it doesn't even have full Inside Out Body Tracking. Yet as we know, it shipped on Quest 3, coming up three years ago :)

While I know this is not Quest related directly, the article I've published goes into the tech, advances and the odd questions surrounding how a headset 7-10x times cheaper than the Apple Vision Pro (the Quest 3) has had full body tracking.

It does also link directly to my legal case. However I hope you enjoy the technical analysis if that's not your thing.

Meta get a lot of hate, but they pushed the state of the art in XR and AI Egocentric Glasses further than any other company. I think this shows just how far head they work, even back in 2023.

I hope you enjoy.

edgecaseexistence.com
u/IHeartBigGPUs — 6 days ago
▲ 56 r/visionosdev+1 crossposts

Apple's Unreleased Persona Body Animation Solver, Running on a Mac

Further to my prior post on this sub, I thought I'd share a fun project. Implementing Apple's TBD Persona Body Tracking / Animation code, inside the Vision OS Simulator. You can run it, on a Mac, no Vision Pro needed!

This is Something Apple's and it's legal team said is impossible outside their own lab! I detailed my process and decided to share it with context to the world.

I was hired to implement this tech. It's not shipped :/

This raises some very interesting questions about what the heck happened to the embodied telepresence we were promised, and how did one lanky guy, currently suing Apple for disability discrimination manage to prove them wrong.

Maybe we'll see the feature ship at WWDC 2026, I wouldn't bet on it though.

If you have any questions, let me know :)

gitlab.com
u/IHeartBigGPUs — 5 days ago