Hello. I am using the hand tracking component of MediaPipe. I am finding that I have to move the hand very slowly otherwise it often stops tracking. The skeleton and points just disappear from the frame, then comes back. Does anyone have any experience with making a stronger connection with the hand tracking feature? Thanks
Hey @roomB
The hand tracking model from Google was trained pretty close to the camera, so make sure not to get too far away. Also, you can change the sensitivity of the model on the MediaPipe.tox. Under the Hands tab you could try lowering the Detection, Presence, and Tracking Confidence threshold so the hands tracking should appear more often.
There’s more info about the parameters on the MediaPipe webpage here.
Hope this helps!
Best,
Torin
1 Like
Thank you!
I am also trying to display the video feed without the hand skeleton and points being visible. Any tips?
You should be able to either disable the overlay by bypassing the hand’s skeleton render inside of the MediaPipe comp. The you can hide the Skeleton Geometry object of the overlay by toggling the small Blue and Purple flags. Or you could simply skip it by selecting whatever MediaPipe is using for its input.
We experienced similar issues when using it at a distance, so cropping the tracking area to where the hands are larger in frame works surprisingly well.
We even used NDI Tools Webcam to run 4 smaller crops for 4 separate MediaPipe stations out of one camera. Not sure if that helps, but it is a decent method. In our use case, it was a circular table with an overhead camera.
I’ve used feedback chops to freeze hands at the last detected point when they jump off like that. Also using some filtering is nice. There’s a Kalman Filter tox around here that works well and I modified it to be able to work on multichannel CHOPs. Happy to post it if you want to give it a try
Thank you! I will try that.