Calibrating Kinect Joints with Camera


I’m using a Kinect V2 and trying to calibrate the joints in 3D space with the default settings camera in my render network. Basically the joints don’t line up with the video feed.

I’ve learned the 2D way to line up the joints using the u,v values instead of the XYZ, but in my case it’s important to have the spatial values since I’m using SOPs.

Is there some camera matrix projection for the Camera COMP that I’m unable to find? I have a suspicion I’m supposed to use the depthu and depthv channels, but I’m not sure how.

My goal is: place a sphere SOP at every joint in 3D space and line up perfectly with the camera.