Depth Map from Kinect to mask geometry

A question about masking and geometry.
I want to create the illusion of geometry ‘wrapped around’ a person using the depth mask from a Kinect. Think simple Torus. Using the Depth camera to simply mask 2 textures is simple enough, but how to use it to mask geometry in 3D space?