u/Walker-Dev

Showing Off Our Custom Lighthouse Tracker With SteamSDK (Manollo Mancelli Crushed It)

For those who have been following my development on stuff, they would know Manollo Mancelli is a very important part of the team; he's been spearheading the development of the headset physically!

Long story short: turns out it is absolutely possible to create custom Lighthouse-tracked objects. Manollo has been working on this on the side, and we are looking at utilizing it across our entire ecosystem ranging from our headset, controllers, and gloves, to a lower-cost alternative to Tundra Trackers with EOZVR/Shinra Meisin line!

This is still very, very early stuff, but we wanted to show off the raw tracker demo working in real-time. This is more a "Hey this exists" post!

To be completely transparent, I'm incubating this hardware project on the company side and am not as deep into the low-level code/circuits as Manollo, so I won't be answering deep technical questions as much as I usually do..

I think a lot of people who have been asking about lighthouse tracking will be interested in this track; i'm going to leave a few images as well given someone in the past confused this for being a Steam HDK evaluation device rather than custom

(For everyone else, should be showing off the SLAM tracking soon!)

u/Walker-Dev — 3 days ago
▲ 290 r/VRGaming+1 crossposts

TL;DR: Open-source mid-range AR/VR headset (WIP) — $800–$850 target, in-house eye/mouth tracking, inside-out tracking, and controller/glove-based inside out FBT — Part 2

My team and I are continuing development on an open-source modular AR/VR headset focused on repairability, scalable compute, and in-house tracking systems.

This update is focused on real hardware integration + early system demos.

Special thanks to Manolo Mancelli and John for really pushing this!

Hardware Prototype (Now physically integrated)

We’ve moved from design into partial assembly and systems validation:

  • The SCORN (Silicon Core Optimized Recharge Node) power board is now physically soldered and will soon be mounted after testing
  • Battery system uses 4× Amprius silicon cells (3.6V, 6400mAh each) for long playtime (We only use Silicon batteries)
  • Early SLAM motherboard footprint mapped directly into headset shell constraints

We are also actively changing the specifications of the system, including discussions under MNDA with Qualcomm about using the Snapdragon 8s Gen 3 as the chip used for high performance standalone rather than our plan before!

Eye Tracking Module

  • 640×480/100fps IR camera system
  • IR Illumination currently being added

Tracking system (The Shinra Meisin) near bottom of post

Auto-IPD System (Functional Prototype)

  • Motorized IPD adjustment system is working, soon to be on video when LCDs arrive (although we had to use placeholder 1600x1600s, i'm a uni student bootstrapping, bite me)
  • Designed for automated calibration during setup

Tracking + Camera System (Updated Front Module)

Front module now includes:

  • Dual inside-out tracking cameras (wide FOV)
  • IR environment illumination system
  • Eye tracking integration module
  • Mouth tracking camera being added (We wanted a discrete design but this might be near impossible)

We want it to be a single, easy to replace module (Right to repair ftw!)

The XRUIOS and Coding Shenannigans

The XRUIOS (Our spatial computing system) is being ported into a custom Godot fork internally called Aether Engine.

Basically I jumped between Unity, Godot, Evergine, Stride, S&Box and wasn't happy with either, so I decided we have to cook our own solution. Overall, the idea is to

Got a few people on board (Like RedSim) to help in making extremely optimized but high visual fidelity systems so developing on XR feels better! Also replacing 2D Node UI system entirely with a Unity Canvas style system I have someone working on!

We are making an Archlinux fork (YuukOS) made specifically for the XRUIOS (With the goal of performance, privacy and presentation)!

Also using Zenoh to create a system that allows for high quality IoT between devices (Yuuko Protocol) alongside high performant screen/app mirroring with native APIs supporting Windows 8+ and Linux (Weyland/DX11) (Facade) but more on these WAY later

Finally, found a way to possibly allow thousands of users to exist with custom themes to performantly exist in the same space without needing any sort of data farm (The SCCN, i'm really excited to share a video on this soon)

It will be a while before some of these technologies are up enough to properly share, but I do want to let people know they exist! All in all very WIP section

Tracking Stack (Shinra Meisin)

Open-source tracking system covering:

  • Eye tracking (active)
  • Mouth tracking (in integration)
  • Controller-based inside-out FBT (planned)
  • SLAM system (in development)
  • BCI support layer (research phase)

We are also talking with EOZVR about creating modules using these for a few headsets, it'd also mean we can create a dataset for improved robustness with a focus on supporting all types of faces! GDPR-conscious paid volunteers and such

Upgrading our app to app system (Eclipse) to act as a FOSS alternative to OSC as well both locally and online; when Zenoh is added here, it will technically be able to support 4 million inputs/second which is important for a few future plans!

SLAM pipeline demo is currently in final preparation and will be shown very soon.

This is the next major milestone toward full inside-out spatial tracking and a long time coming!

Video Links

XRUIOS system demo:
https://www.youtube.com/watch?v=SDlKi2PJMD4

Shinra Meisin (Eye Tracking System):
https://www.youtube.com/watch?v=QlfCfkzkBB4

Overall, the same focus on fashion, function and privacy at an accessible cost is still at the core of what we do.

(P.S. new website WIP, www.walkerindustries.xyz)

u/Walker-Dev — 6 days ago

We Made An Open Source VR Eye Tracker (The Shinra Meisin)

Long story short, we are working on a VR headset and AR glasses; for it to work, we needed eye tracking and decided to go the custom route!

The Shinra Meisin is a modular tracking system made to handle a few things related to XR (Such as eye and mouth tracking).

The next video showcased will likely be the SLAM tracking!

youtu.be
u/Walker-Dev — 8 days ago
▲ 3 r/virtualreality+1 crossposts

We Made a VR Sandbox MMO in 36 Hours (Sorta)

Basically wanted to make a project i've been thinking about for a while; with the help of friends we managed to make a proof of concept for something i'll develop down the line called Echoes Online for Pacific Portal XR's Hackathon

For the hackathon I focused on making it so you would be able to create things in the environment while my friends made models (Although the nature elements are from an asset; the main building you see is a kitbash from the primitive arches and columns we made and I did actually sculpt the world and all that fancy stuff)

Going to focus on making it look and feel like a proper thing through our custom fork of Godot

We lost but still fun experience!

youtube.com
u/Walker-Dev — 12 days ago
▲ 20 r/swordartonline+2 crossposts

Nine years ago, middle school me saw Ordinal Scale and wondered "Why doesn't this exist in every household?" It's been a busy few years but I am pretty happy with the progress since i've started!

This isn't done and i'm currently working towards customizing a fork of Godot to make this lightweight but more performant and better looking for AR/VR.

I'm hoping to have a demo out later in the year, with multiplayer and all working! It'll also ship with a headset i'm developing with a team!

u/Walker-Dev — 2 days ago

For my spatial computing project, I created this; it understands when you say certain utterances and has a modular system underneath.

For example you could say

"Invoke Calendar Within 10 Breaths" or "Invoke Planner Upon Hallowed Space"

Then it uses a spirit system

You say "Spirit Essence" then the specific incantation for it to change the color of the UI elements; the spawning system was a little jank so I didn't get to show that off as much as I wanted

Then I made a spell system (The dark tempest part)

I love saying chunni nonsense with my friends so making this felt like it was eventual, although it's part of the below project (I'll probably showcase this in it's own post later)

I was inspired the most by Nier Replicant and Re Zero for this; the Grimoire with Nier Replicant and the spirit summons with Re Zero!

All in all, it was made for this project i'll probably put on another post

https://youtu.be/SDlKi2PJMD4

u/Walker-Dev — 22 days ago