r/virtualproduction
arkitremap v3 - convert metahuman animator to arkit
some characters are too hard to convert to metahumans, like that cyclops. but its easy to rig characters with FaceIt - to have 52 blendshapes and animate their face.
arkit remap is essentially a mapping table that uses native engine tools (rigmapper) to convert metahuman animator into arkit blendshapes, to be used on those characters you couldn't convert to metahumans
pretty much at quality parity - look at metahuman #1 and #3 to see MHA vs the remap
https://github.com/Dylanyz/ARKitRemap
im still testing v3 over the next few weeks. let me know if you find bugs or have feature requests
Gaussian splat self-shadowing natively in Blender
Been working with gaussian splats for a while and the thing that always killed it for me is that you cant really do much with it in Blender. Looks incredible in a web viewer, you import it, and then it just sits there ignoring every light in your scene. Seeing Houdini implement self-shadowing got me thinking.
So I built an addon. Splats come in as normal scene objects. Your lights affect them, and they self-shadow, driven by each gaussian's opacity rather than a proxy cage, so wispy parts stay soft instead of turning into a solid blob. Works in EEVEE and Cycles although Cycles isn't recommended since the transparency light paths needed for this method to work tanks performance. I believe Blender foundation is working on this exact problem right now so hopefully we see some improvements in the near future.
The free (LITE) version is the whole viewer and relighter, not a demo. You get the full shading, the relighting and self shadowing, and export back out to standard .ply. If what you want
is to get a capture into Blender and light it properly, that is the free one and you're done.
Other things I ended up adding that I believe will help professionals implement this into their workflow. (Pro Version)
Build a proxy mesh off the splat and bind to it, then the splats ride the surface through armatures, lattices, shape keys, cloth, softbody. This should also allow for sims such as water and smoke sims to actually be affected by your splats. Weight paint a mask and transfer PBR onto the splats, so you can paint emission onto a captured car and the headlights actually glow. Bake your scene lighting int the splat so the relit look survives export back out to .ply and still looks right in SuperSplat. Crop, shave floaters, merge, decimate. Pull in the capture cameras from a COLMAP or nerfstudio solve. Play 4D captures back on the timeline. And it'll train a splat from any video where the camera moves, locally on your own GPU.
You can find the addon here on: Superhive (formerly Blender Market)
Or here if you prefer: Gumroad
Testing the new Composite Depth Mesh actors in UE5.8 just for fun. I recorded it as an unscripted, Let’s Play style work-through, just in case it’s useful to anyone. Latest vid on my youtube channel (search for Dean Yurke). Thanks!
Applying archival thinking to a personal visual archive
I’m a software engineer, not a professional archivist.
I’ve been trying to apply some archival thinking to my personal photo/video archive, which had become surprisingly large before I started paying attention to it.
I wrote down the method I ended up with after a few years of refining it. I wanted it to stay minimal and app-agnostic: preserving context, normalizing dates and filenames, checking files before archiving, and making the archive easy to refine over time.
Article:
https://open.substack.com/pub/cl3don/p/a-living-visual-archive
I’m curious whether this resonates with professional archivists, and where the approach seems naive or misses important archival concepts.
Unreal Engine Noob help!
For a bit of background, I’m a cinematographer, and I edit and produce. In the past I’ve made virtual studios and streamed them using Wirecast.
Now I know I’m VERY late (fashionably late!?) to the party, but I’ve recently seen just what Unreal Engine can do for virtual studio production. And my tiny mind has been blown.
After a long sit down and a cup of tea, I think I should come here. I would love to have a chat with people who use the software, and have some hints and tips for a total Noob like me. I’d love to tell someone more about my project, and if they can help me with some knowledge- even better.
I’m looking to essentially create a virtual live TV studio, with a live presenter, which can then be broadcast/streamed live.
Can’t wait to chat with you guys!