u/LumKitty

LIVnyan+OnAirTap - VR streams without LIV, with Spout2 and Linux support

[This video is not VRChat. It is a 3D art package, OpenBrush, that does not have any form of avatar support. The avatar is VNyan Spout2 output injected into the footage]

LIVnyan is my existing project to integrate VNyan with LIV VR. This allows you place an external camera into your game's VR world, and insert VNyan video into it to give you the appearance of standing in the world. LIV is commonly used by cam streamers with a greenscreen in their VR space. It works but there is some jank, both from LIV itself and in how we extract the layers.

A dev named MilkyDelta approached me. They figured out how to tap into LIV's API from a BepInEx mod, and send the foreground / background layers as Spout2 sources. Allowing for more efficient capture and Linux support

Since then we have integrated the two more closely and can offer several improvements over a LIV setup:

  • Adjusting the foreground/background split point based on the position of VTuber bones (Recommended: hips + 0.15cm (6") towards the camera). LIV only allows a static split point so if you moved too far from centre you could incorrectly appear in front of an object you should be behind (Demonstration vid - background is filtered to pink)
  • Spout2 output - more efficient, lower latency
  • Output resolution can automatically match VNyan
  • Output resolution can be any size or aspect ratio, not limited to the options in LIV's menus
  • Linux support (requires Spout2PW)

This is in addition to the standard improvements that LIVnyan offers over vanilla LIV

  • Can use a .VSFavatar, no longer limited to VRM
  • All your VNyan redeems will work without alteration
  • LIV's external camera is now controlled by VNyan for perfect alignment

In theory it will work with any VR game that uses the LIV 1.5 SDK and can load BepInEx mods. There is also a special build for Beat Saber. Currently it's been tested only in Beat Saber and OpenBrush.

This is very much beta software, but if you are willing to test, please check it out!
https://github.com/LumKitty/LIVnyan

u/LumKitty — 6 days ago