Nuitrack Skeleton Tracking plugin for TouchDesigner

Techniques
, , ,
22

NuitrackTDRotations (1)

:tada: A new project has been added! Run the “Rotations” project and check the joint rotations. :tada:

There are also projects included for a quick start:

  • Nuitrack-Sample.toe - Real-time 3D skeleton (you can use up to 19 joints)

  • InteractiveParticles.toe - Example of interactive particles (based on a point cloud)

  • NuitrackUltimateTest.toe - Check all the plugin’s features at once

Get the plugin: Real-Time Interactive Art

23

Hi!

Continuing our experiments, we tried updating five projects from YouTube.

Everything worked smoothly and easily. Now, regardless of the sensor, these projects can use skeletal tracking and any camera data.

24

@Stepan_R

Hi!

I’ve got questions with activating Touchdesigner OPs

I have subscribed to Creative AI bundle, and it seems that I’m still in 7 days trial. I have already installed Nuitrack app and tested my license with my camera (Orbbec femto bolt). It works well in the Nuitrack app. But I can’t use Nuitrack TOP and CHOP in Touchdesigner. It shows error with “The license is not found”.

I’m using windows x64 with Touchdesigner 2025.32460.

Looking forward to your reply, thank you!

25

Hi @helloangel99,
The version of the plugin available via the link in the email is out of date. Nuitrack has been officially added to TouchDesigner 2025.33230 https://derivative.ca/release/202533230/75275. Can you download this version?

26

Nuitrack CHOP outputs only one skeleton, although two people are tracked (Femto Bolt)

Hi,

I’m using the Nuitrack plugin with an Orbbec Femto Bolt and a Nuitrack AI Creative subscription (TouchDesigner 2025.32460, Windows 11), and I’m trying to track two performers at the same time. I can only get one skeleton out of the Nuitrack CHOP.

What I found:

  • In the Nuitrack desktop app (“Try Nuitrack!”), two people are tracked at the same time.
  • The Nuitrack TOP’s Player Index shows two separate people.
  • The Nuitrack CHOP outputs one sample with 120 channels, which is exactly one skeleton (20 joints × tx/ty/tz/rx/ry/rz). There is no second set of channels and no user id channel.
  • The CHOP’s parameters are only Active, Sensor Name, Restart, Output Positions and Output Rotations, so I can’t find a way to select a user or increase the number of users.
  • In nuitrack.config, Skeletonization.ActiveUsers is already 2. Changing Skeletonization.MaxDistance (4000 → 6500) and restarting did not help.

So Nuitrack itself and the TOP see two people, but the CHOP gives me only one skeleton.

Has anyone managed to get more than one skeleton out of the Nuitrack CHOP? Is it a plugin limitation, or is there a setting I’m missing? I only need the distance between two performers, so the Player Index plus point cloud is my fallback for now, but skeleton data would be much better.

Thanks!