I'm prototyping the real object tracking and here is what I got so far.

How I made it

- I scanned the mug with Reality Composer on my iPhone Pro.

- I trained a .referenceobject with Create ML on my M4 Pro Mac mini. That took about 5.5 hours.

- Then I imported it into Locus.

What you're seeing

- Desk & Surroundings: Locus tracks the mug and opens a mug-shaped window through the Virtual Space, so you see the real mug through passthrough.

- Crown / full immersion: there's no passthrough there, so I render the 3D model where the real mug is.

Honest notes

- The scan is rough. You can see the flaws in the model in the Crown part of the video: the rim isn't round and the surface is lumpy. Tracking works anyway.

- I've only tried this one mug. Generic cups and printed markers didn't work for me; only training on this exact mug did.

- Tilt the mug and it loses track, which you can see in the video. My guess is that I trained with Create ML's "upright" viewing angles, so tilted views are outside what it learned. Training with all angles might help, but I haven't tested that.

There are better ways to build the model than a quick phone scan. I'm going to try a cleaner reconstruction next and will report back if tracking improves.

I'll include Real Objects as an experimental feature in the next version (Settings › Real Objects, after turning on the Experimental switch) and free, with no paywall. But initially there won't be any official models.

I've tried other things like building a general mug model, it doesn't work. Also the image trackers only works if it's put flat in front of my eyes. When I put them down on the table they stop working.

Hi everyone! I’m the developer of Locus, a free Apple Vision Pro app that lets you pair immersive scenery with a virtual room to create your own place to work and browse.

Locus is optimized for working using a keyboard on a desk.

For 1.1, much of the work went into improving the browser, including website compatibility. The goal was simple: let you find a 360° skybox on the web, download it, and apply it directly in Locus.

There’s something lovely about finding a panorama you like and then having it become the view around you—all without leaving the app.
We’ve also added support for night scenes and Room Lights, giving you more ways to shape the atmosphere of your space, along with a selection of new 12K AI-created 360° panoramas.

For people who make their own Room models, we’ve added experimental model animation support too. None of our current environments use it yet, but the capability is there for creators to explore.

There are plenty of smaller improvements throughout the app as well, including better organization for your Places, browser favorites, and window sizing.

The video takes a look at what’s new in 1.1. I’d love to hear what you think, and what kind of place you’d like to spend time in next.

AppStore Link

Explore Locus⁠

Hi! I’ve been working on a Vision Pro app called Locus that gives you a customizable virtual space to work in.

The idea is pretty simple: you get a virtual room and desk, but you can customize the space with your own content. You can import your own 3D model for the room and use any 360° panorama as the surrounding skybox.

Most of the app is free. I added an optional IAP if you want to keep more than one imported environment at a time, mainly as a way to support continued development.

Originally, I wanted Locus to simply be an environment where you could run your existing productivity apps. Unfortunately, visionOS doesn’t currently allow other apps to appear inside an app’s immersive environment, so I added a simple built-in browser instead.

My own main use case, though, is using Vision Pro’s Developer Mode to keep Mac Virtual Display inside the virtual environment. I initially added a passthrough cutout for the desk, but I’ve found that the automatically detected keyboard passthrough works surprisingly well, so I usually just rely on that.

If this sounds interesting, feel free to give it a try:

AppStore link: https://apps.apple.com/app/id6802168265

https://enterlocus.com/

I’d love to hear any feedback, feature requests, or ideas for environments you’d like to see!