Not sure if this is exactly a beginner level question lol, but I’m def still pretty new to TD, so here it goes.
I’m trying to control a rigged model using face tracking inputs from MediaPipe. The end goal is to end up with something a lil bit like VSeeFace, and I already have a decent bit working, but there’s still a few things I’m struggling with.
The main thing is just how to get values for blendshapes and animation keys into the model (IDK if those are the right terms but just bear with me, I have no idea what I’m doing lol). The model I’m using is controlled through a mix of blendshapes and bones (this avatar is set up for use with VRChat and VRCFaceTracking), and, at the moment, I’m just doing something a lil bit like this to “inject” blendshape values and animation keys into the model.
This is how I’m doing blendshapes. The
default_weight node here is a null CHOP that’s acting as the input to the blendshapes, which I am using because originally everything was pointed at an import select CHOP of the same name (which I renamed to default_weights), but I don’t know how to change the name of it since it’s being referenced by a bunch of autogenerated python expressions.
Same thing but for animation keys. I’m just bringing in the animation overrides with that
select1 CHOP and replacing the relevant things from the select_animation CHOP.
Now, this does work, but I’m trying to find a way to do this without needing to go in and modify the model COMP, since I’d like to be able to switch that out in the future (I also have plans to maybe publish some TOXes in the future and I wanna make it pretty easy to set up, even for people with minimal TD experience). Also, a lot of this just seems kinda jank, and I feel like there has to be a better way to do it. So I’m mainly just wondering if there is.
I’m also very confused about how to set up the rig for IK. I haven’t read too much of the docs for this yet, so if there’s something obvious I missed feel free to just point me there, but I’m really just not sure where to even begin with that. Once again, I’d like to be able to set this up without needing to go in and modify the model much. I’d also like to set up some things like physics for prop throwing, but I think I can figure most of that (and IK) out once I have a general idea where to start.