Remember me? I made a post about this a while back, but now I've made it into a video.
This is the DIY version of the Rokoko headrig i made for myself as part of my full-body tracking setup. Trackers are expensive as it is, and I didn't want to pay another few hundred bucks for something so simple.
Items used to make my headrig (not affiliate links):
https://www.amazon.com/dp/B087X1Z5XJ?th=1
Hey Everyone! I know there are a bunch of people here using Booth Companion already and I am very thankful for that <3
I wanted to announce that "Booth Companion PT" is out, it is a Discord version of the extension and is basically a Price Tracker for BOOTH items that can send you notifications directly into your Discord Server/Guild.
If you wanna check it out: Invite it here
All Commands that are needed/available are in the 2nd Image.
There are probably still some bugs, so feedback is welcome!
Please tell me this is possible. I commissioned a 3D avatar, which I’ve paid good money for, and the artist is finishing it for vseeface and animaze.
I stream on my Mac and I’m just now seeing that neither of those platforms are Mac compatible. I definitely feel like an idiot right now, and maybe should’ve done more research before agreeing to this job, but I didn’t think I would run into a roadblock like this. On top of that, I’m not seeing really any platforms that support 3D models on Mac? WTF?
Are there any workarounds to this. Preferably any that aren’t going to break the bank, as I wasn’t expecting another large expense. Thanks so much for any help.
Edit: ok I think maybe I can run it through the animaze iPhone app and send that to my Mac. Can’t really test it yet at the moment. Praying this works otherwise I’ll be sick lol.
Hello
I really need some advice about tracking hands with gloves. I am considering options for StretchSense and udcap, but it is difficult to choose between them...
Does anyone use any of them? I've been wanting gloves for a very long time, it's my vtuber dream.
Also, I wonder if trackers like vive on gloves don't get in the way (or bring discomfort)? I understand that they are necessary, even though they are being kept silent about them for some reason.
it is very difficult to buy any tracking gloves in my region (both financially and locally), and therefore it takes a long time to decide and ask friends from other countries to help with delivery. That's why I want to make a choice that I won't regret (ToT)/~~~
Hi, so I made my first VroidStudio model, and when I was editing each expression "happy, sad, U, A.. " I added shark teeth to 50 and upper shark teeth to 30 on each expression. Now I cannot seem to find that option again, as under expressions there's not an option to manually tweak the teeth and now it's only one big menu for all of the expressions. In that menu the shark teeth parameters are all set to 0, yet the teeth are moving along with each blink which leads to the mouth being full of teeth whenever I talk.
I really don't want to redo the model from zero, can someone help me fix this?
I want to be a VTuber, but I don't have enough money for a model yet, and I don't really know how to draw, or I don't know how to draw with color. If there are any good programs for this, please let me know!
Hey team! I hope someone can help, as I have been struggling for HOURS.
I'd like to know how I can have my edits for the Ragdoll Head stay as it is per Character Swap/Outfit Change. As you can see, I'm having to readjust the Ragdool Head every time.
I have Twitch Channel Point Redeems where chat can throw Props at my Models head, and I don't wanna have to realign the Ragdoll Head every single time.
Especially since I wanna have Channel Point Redeems for Outfit changes, aka Model Swaps.
I've been trying to figure out how to set up a Blueprint to have my Ragdoll changes converted over with every Character Swap, but nothing had worked.
Warudo Version: 0.14.3 Personal
Thank you!!
If you ask in almost any VTuber community what to get for tracking, someone will recommend an iPhone. Sure, iPhones work great for face tracking! And almost always, they will go ahead and explain something like this:
> You see, iPhones don't just have a webcam, they have a special depth camera that sees in 3D and that's why not even the world's best camera can compete. The only way to get the best face tracking is an iPhone.
I want you to do an experiment. Grab your iPhone, open up VTube Studio (or your favorite tracking app), and pull up the camera/ARKit mask preview. Go ahead, move around, make sure it's tracking well. Now grab a thin item like a pen, and sweep it around the top of your phone. Notice where it covers up the picture in the camera preview? That's the front selfie camera. A regular old webcam. Notice something? When you cover up the selfie cam, and only the selfie cam, the tracking stops working.
Now grab some opaque tape (or sticky notes). Cut out two pieces, and place them to the left and right of the selfie cam you just found, so only the camera can see through, right at the edge of its field of view. If you're paranoid, do the top and bottom too.
You have just blocked out the Face ID/TrueDepth camera system (actually a bunch of things: the IR camera, the flood illuminator, and the dot projector, which are the three independent parts that make up the 3D scanning system). Go ahead, try to unlock your phone with Face ID. You can't.
Now try VTube Studio again.
It still tracks. Practically indistinguishably from before.
It's not the magical camera. Apple just have really good webcam tracking software built into every iPhone. That's it. That's all it is! Any other phone or device COULD be just as good... if someone like Google stepped up their face tracking ML model game to match Apple's. The only hardware you need is a high quality camera (and on a mobile device, probably a neural accelerator, but on a PC the GPU would be more than enough).
(Obviously Apple have good cameras too, that does play a role and it's why the tracking works well in low light too. No, you don't need the 3D camera for low light tracking either, try it!)
I actually looked into the Apple code. Behind the scenes it's called FaceKit and it uses a machine learning model called CaraNet. There are two versions, one for a pure RGB feed (no depth), and one for RGBD (with depth). I don't know if the RGBD one is used at all with VTube Studio, but if it is, I believe the only thing it really does in practice is give slightly improved distance information for the face. This is important for AR applications, but it doesn't matter for VTubing (the exact distance to your face doesn't matter, even if you use the Z parameter for model size or whatever it doesn't matter if it's physically accurate in meters or not since the model isn't in AR and doesn't have to interact with real objects).
If you can manage to show a difference in the ARKit blend shape data with and without the depth camera covered, please record it and share a video. I haven't been able to.
The other question is... Apple, why not release ARKit/FaceKit for macOS? 😇
Edit: This all gets pretty confusing when you start talking about different apps and setups like VBridger/etc. Those apps can change the result but they all use the same source data that plain old VTS does, coming from ARKit/FaceKit. Some setups work better than others, but that still has nothing to do with iPhone hardware, and it could still be replicated with a webcam if good enough software existed. Feel free to do the above experiment with your favorite iPhone tracking setup!
Edit 2: All the downvotes and disagreement but nobody is doing the test and showing me how I'm wrong... come on people, this is something you can easily test yourself! I'm not telling you to take my word for it, I gave you step by step instructions. This is how we learn and improve our understanding of the world, by doing experiments, and that works for mysterious technology sold by Apple too!
The reason I want to dispel this myth is that I don't want people trying out/reviewing and especially people considering developing webcam tracking to have a preconceived notion that it has to be worse than iPhone. It really doesn't. It might be today, but it doesn't have to be.
I'm not sure what might be going wrong, but, in short, VBridger has very recently started going haywire on me. Whenever I click any of the standard actions (e.g., Connect, Calibrate, Connect to iPhone, or Disconnect), the app opens up VBridger's "Saves" folder, then sends me multiple invites to the VBridger Discord (which I'm already a part of) and opens multiple tabs to PiPuProductions' Github. (See the included video for what it looks like when it does this.)
A further problem (not shown in the video) is that the tracking is malfunctioning (e.g., my eyes, mouth, or X- or Y-axis head movement will randomly not track (though it's always only one or two of these tracking failures at a time, rather than all at once), or the smoothing will fail, etc.).
So far I've tried uninstalling and reinstalling VBridger; unfortunately, it didn't fix the problem (if anything, it made the problem worse). I've also tried loading different VBbridger settings/profiles (e.g., default, V2, V3, etc.), but none of those have fixed the problem, either.
Does anyone else have experience with a problem like this and/or thoughts on what might be causing it? Thanks in advance for any help anyone can offer.
Hi! I'm new to the space : ) I downloaded the Test-Chan model here on Booth, and the expressions are so dynamic when I use it in VSeeFace! I decided to make my own model in VRoid, and I made sure to have all of the expressions set on my model as well. However, when I use my model in VSeeFace, it's not pulling the same expressions (see video). Any ideas on how to fix this? Is it a plugin with Test-Chan that I can add to mine? Thanks!!
Hi im a very small V-Tuber but somehow I still got an offer for a merchandise license deal.
I dont know ANYTHING about any legal things and I dont know how any of this works so please help me out.
Theres a guy who owns a shop who wants to find danish V-Tubers (yes im danish) and he said he needs the rights to produce and sell merch online and irl and I would get a procentage of what he sells of it (that part I understand).
He said he also needs access to using the art of my V-Tuber avatar that I have the rights for.. im not sure if he means my V-Tuber model or my character design?
My character design I own because I made it, but my model is just a costumizable model which I dont own and therefor he cant use it to make merch.
Also since im a small V-Tuber and i dont have an income, I dont have the money to comission people. Im confused if he will be comissioning people for me or if I have to do it and pay myself?
Please if anyone knows anything about this please tell me because i feel like a baby with this, not knowing anything about it xD. I also dont know my legal rights of what i should give him access to and not.
Any help is much appreciated☾
A year ago or so I brought a full set up for being a vtuber just not the model, then some life stuff happened and so on but now I’m completely broke and want to try vtubing and thought I could do what I’ve been doing with my friends for god knows how many years and do ( almost ) anything for money, I don’t know if that’s frowned upon or not? If you have any tips or just want to call me names please let me know.
Don't know if this is the right place to ask, but I'm in desperate need of help. I commissioned a model off vgen and now I'm stuck on how to rig it properly.
Went to liveD cubism and a lot of the layers aren't showing on the face model. Struggling to see how to fix it and properly learn about rigging. Any videos that might help or somewhere where I can commission someone credible to rig? Hoping to see someone with past works and proof. Thanks!
I've been trying for a couple of hours but just putting the port number in doesn't seem to do anything. I'm sure I'm just missing something, but I'm not sure what. Do I need to install some kind of plugin? Should I try other software?