Pick instance id using kinect and renderpick

Hello,

Using kinect sensor, I am trying to get an instance id of one of rectangles instanced on a sphere but without any luck, so very much appreciated if you can help me, i am a newbie on TD btw.

The idea of the project is to use right hand to pick one of the instanced rectangles and scale it (kind of zoom on it to fit a texture image on full screen).

Let me explain what i did:

-i have a GEO with a rectangle SOP in it
-i have a sphere SOP to instance the GEO with rectangles

-i have a kinect sensor and i isolated right hand gestures for x, y, z coordinates and hand closed.

image

To ‘grab’ a specific rectangle using kinect:

→ a multitouch in DAT
→ a table DAT which holds the u,v and select from k CHOP then an eval DAT to get kinect values
→ a MERGE between multitouch and this eval DAT and used this merge DAT output as input to renderpick DAT, however i am not able to get the instance id.

To get instance ID i am using a renderpick DAT callback and just trying to print put for now, no results however.

Attached is the toe file if any details needed.

Thank you in advance!
renderpick_object_by_kinect_tests.2.toe (11.4 KB)

As reference i used this tutorial : https://youtu.be/LQoY6-fax5o?si=DOtsugjT0Lhpx9mn