Change mouse input to hand tracking

I’ve been following a water color project tutorial by elekktronaut for a projection installation and wanted to change the way the mouse interacted with the colours appearing to something that used hand tracking with a webcam. I had come across media pipe hand tracking capabilities by Torin Blankensmith and have got both things to work separately but can’t seem to figure out how to utilize it for the watercolour project. My goal would be to have someone wave their hands with the colours to appear and then have it reset after 8-10 seconds.

Any help would be greatly appreciated in understanding how to change the mouse inputs to hand inputs that create the same action.