Texture for Face Tracking

I’ve noticed when I run it off 2023.11220, TD crashes pretty instantly. It’s the most stable on 2022.35320, so I’ll just work with that for now. I’m wondering if you have any advice on how to effect geometry so that I can apply texture or various effects to face tracking. I’ve got a constant mat, but not sure how to tweak it to my liking. I would love a subtle absTime animation with cool texture effects, but not sure if or how to go about it. Would GLSL be the best bet? Or is there a way I can mask it through movefilein but maintain the integrity of the vertices? Are there any tutorials you could lead me toward? This is what I’ve got so far, which is pretty but not quite what I’m hoping to achieve…


Sorry to hear about the crashing. If you get any dump files from it, you can send those to support@derivative.ca and we can take a further look at them.

As far as texture mapping the face tracking mesh, unfortunately the Nvidia AR library does not provide UV coordinates with the mesh which does make it tricky. However, since the structure of the mesh remains constant you might be able to freeze a copy of the face in a neutral expression, project UV coordinates onto that and then merge those UVs with the live animated mesh. I’m not sure on all of the steps involved there, but I think it should be possible.

1 Like

that sounds like a good solution to investigate. Thank you.

@CarolynTariq If you don’t have dump files, maybe you could send us your project to support so we can try to reproduce the issue. We’d really like to know if this is a Face Track CHOP issue or the Nvidia BG TOP issue and fix it immediately.
Thanks in advance for anything you can share with us.

sure. I’m feeling a bit cagey sharing via the forum as I’m using a toxe from shared Patreon and I don’t want to share their work without consent. I’ll email it through now

1 Like

We tracked down the issue offline, but for everyone else it looks like the problem was with the version of face mesh file being used in the Face Track CHOP. The latest versions of 2022 and 2023 now use the 0.8.2 release of the Nvidia Maxine AR library and this requires a different version of the face mesh file (.nvf) then in previous versions.

The correct mesh file is now included with the TouchDesigner installer in Config/Models/face_model2.nvf

1 Like

Hey Rob,

Could this be related to the issues I have, with facetrackCHOP/SOP make it crashes?

I don’t think this is the problem. I believe in this case there was a new version of the Face Track library pointing to an old incompatible face mesh model. However, that older model was never included with Touch and your project is pointing to the correct version.