Sensor for joint tracking behind glass

Hardware
, , ,
1

Hi,

I am researching possibilities for tracking hand movements with the sensor positioned behind a shopping window. So far I have tested Kinect v2 with mixed success - it seems that if the sensor has sky in the field of view there are gaps in depth data. Has anyone inplemented anything similar with Kinect v1 or v2?

Do you think non-IR approaches should be preferred? If so do you have recommendations for a tech/method?

Maybe Iphone with Arkit and Zigsim? Not sure if it uses lidar or stereo camera for joint tracking though.

Thanks!

2

I’d say a Kinect behind a double glass pane will be very hard to get working reliably. Another option is an RGB camera and then use OpenCV in Script TOP (and probably in Engine COMP) with something like mediapipe hands module. Hands | mediapipe