Azure Kinect Body Tracking Won't Work

Hi, this is my first time posting on the forums. Nice to meet you all :slight_smile: I have a friend that is experiment with the Azure Kinect and Touch Designer (Community) (she doesn’t speak English, so I’m writing on her behalf), I have a little experience with touch designer but I’m baffled at why this error is occurring. I’ve pasted an image of the error, but what’s happening that we’re focusing on is that it says that she does not have a GPU with cuda cores as well as to make sure she installed the touch designer with the correct “cuDNN” libraries (though there’s only one installer on the site as far as I can see). She can get all the other modes working but the “player index” setting which is body tracking. Her GPU definitely can do it, we’ve checked (RTX 2060 Super) and we’ve also installed the CUDA toolkit (11.2) to make sure but the error is still showing up, even after restarting the computer/touch designer and making a new project.

Would anyone be able to provide insight to why this might be happening? That would make my day.

Thanks very much,
Jack

EDIT: The error about only one kinect azure top can be ignored. We got rid of that, nothing changed.

1 Like

Sorry you’re having problems. An RTX 2060 should definitely be able to run body tracking, but those error messages indicate that both Touch’s own CUDA initialization and the Kinect’s tracking initialization have failed.

Is there a chance that her machine could be using a different GPU than the RTX card - like an onboard intel card or something? In the ‘Body Tracking GPU Device’ parameter, does it show the RTX card? Is there more than one card listed?

Regarding the ‘correct cudnn libraries’ part of the message, that is an old reference to a compact installer that we had in the 2020 release that didn’t include the Kinect Azure libraries. The installer for the 2021 release always includes the Kinect libraries and we should remove that message.

Actually when you mention it, when we go to the ‘Body Tracking GPU Device’ parameter, the only thing that shows us is ‘default’, nothing else! That does seem pretty fishy now that I think about it. I am confident that the GPU is installed and in the computer as it can be seen in the task manager and she does not have another GPU (though perhaps intel graphics). I have some ideas, but I’m not really sure how to fix an error like this. For reference, both I and she were using version 2021.11180. I don’t own a kinect, but I opened the kinect azure TOP and it’s the same for me (even after updating to 2021.12380). I have a GTX 1070 and all it shows is ‘default’
image

Sorry for the delay. I’ve just been asking around to see if anyone had any ideas.

Just to confirm, have you updated the video drivers recently? I think we need at least driver version 460.89 to run Cuda. You can check your current version by right-clicking on your desktop, selecting ‘Nvidia Control Panel’, and then clicking the ‘System Information’ link in the bottom-left.

1 Like

Hi. I run in a similar issue here.
Can you help me as soon as possible?
I have the latest official version installed
I can only select player index and I don’t know why.

Sorry you’re having problems. Based on the screenshots, it sounds like CUDA is initializing correctly, but the Kinect body tracking library is failing for some reason. A few things you can try:

1 Like

Mr.Robmc
Hello. I am a user of TouchDesigner in Japan. I am Jack’s friend. Thank you for helping me. The problem was the driver version. Kinect is now working. So I’m very happy. I’m sorry for my bad English. Thanks for reading.

2 Likes

I’m glad you got it working. Let me know if run into any other issues.

I have the same problems. The same error message is displayed.
Graphics card: 3070Ti / driver version: 471.68 (latest)

I have tested the TD version 11180 and 10330. CUDA 11.4 is installed and the cdNNA 11.4 library.

In Microsoft Viewer, skeleton tracking works very well.

I need help quickly (sry), what else can I do?

Many, many thanks!

Hi,

When you say you’re having the same problems, are you getting both of the error messages “A CUDA compatible video card is requried …” and “Error: Device is unable to track …” or just one of them?

Have you changed any of the other settings like the body tracking mode? Do you see your 3070 card in the GPU device list? Does it work if you switch to CPU body tracking?

Have you tried any of the newer TouchDesigner releases?

Hello, thanks for the fast reply. The video card is displayed. In the versin 14.360 and 12380 I get the error message: “Device is unable to track. Ensure that you used the installer that includes the cuDNN” I changed nothing and it i working in CPU mode. But its very laggy.

Yeah, CPU mode isn’t really practical for real applications, but I was curious if it would at least work or not.

Aside from drivers (which you said are up to date), I’m not aware of any other issues with getting body tracking to work, so the next step might be to enable error logging for the kinect which might give us more information on why it is failing.

This can be done using the environment variables K4ABT_ENABLE_LOG_TO_A_FILE and K4ABT_LOG_LEVEL (there’s more information on microsoft’s website here: Azure Kinect known issues and troubleshooting | Microsoft Learn)

Make sure to set the K4ABT versions (the K4A ones don’t give body tracking info).

I’d suggest setting the log level to ‘w’ to return any warnings or higher. By default the log file will appear on your desktop.

Let me know what results you get or if you need any help setting up the environment variables (typing Environment into the windows search should lead you to a dialog window where you can add them).

Here is the log file:

Is it possible that another graphics card could fix the problem?

Thanks for the details. It does give a little more information, but unfortunately still doesn’t make it clear why it is failing.

The message implies there’s an incorrect parameter when trying to initialize the onnxruntime module from inside the kinect code, but doesn’t say what that parameter is. One odd thing, is that is appears to be trying to create a directml (dml) instance rather than CUDA which I would expect for your video card.

Do you know of any settings on your system that might be disabling cuda or preventing the kinect from using it? Do you have any other graphics cards installed on that machine (directml is used for intel or amd cards). The 3070 card should be great for this, but maybe its trying to initialize on a different card?

Which version of the microsoft kinect sdk do you have installed? I read a report online of a similar issue where it was related to using version 1.0.1 vs 1.1.0 of the body tracking sdk.

Cuda 11.4 is newer than what we’re using, maybe try uninstalling it?

You could also turn up the logging level to trace and see if that gives any more useful information.

I have the same problem, body tracking is fine without a kinect azure chop referenced, but as soon as I reference the kinect, it throws a cudNN error…

What video card are you using and have you updated the drivers recently?

It’s a 3090 with latest drivers… TBF it works fine on ‘default’ so maybe it is actually working fine…

Any news on how to get this stable? I just realized my lagging Azure skelton tracking might be the same issue and I have a show in a forthnight. I am on a 3080 Ti, Nvidia driver 472.39, latest Touch. 3080 Is avalable in the “Body Tracking GPU Device” but when i turn on the Kinect Azure Chop ith throws the cuDNN error.

Should I get drivers at https://developer.nvidia.com/cudnn
or dowgrade?

Sidenote:
Kinect Azure Viewer app works with 29% CPU / 25% GPU
Touch with default GPU and Skelton tracking on hogs 72% CPU / 1,6% GPU
Without skelton tracking 11.3% CPU / 13% GPU

Any updates on this topic. I have the same issue.

What I did:

  • Fresh install of windows 10
  • Updated Windows 10 to version 20H2
  • Installed Nvidia Studio driver 511.09
  • Installed Kinect SDK 1.4.1
  • Updated Kinect to version 1.6.110079014 (supplied with SDK)
  • Installed Touchdesigner 2021.15020 (latest version compatible with my license)
  • Error during body track: Device is unable to track. Ensure you have used the installer that includes the cuDNN libraries.
  • Installed Cuda version 11.6.0_511.23_windows
  • Still Error during body track: Device is unable to track. Ensure you have used the installer that includes the cuDNN libraries.
  • Parallel installed TouchDesigner.2021.16270
  • Error during bodytrack in version 2021.16270: Unable to start body tracking.

My system:
-Intel i7 8700k

  • Nvidia RTX 2060
  • 32GB Ram

Any idea’s / tips how to get this running. Wierdly enought it runs on my laptop on TD version 2021.15020

Thanks!

Menno Broere