Has anyone tried driving particles in the ParticlesGPU component using output from Mediapipe?
I’m familiar with using Optical Flow but want instead to use tracking data from Mediapipe.
I’ve searched but surprisingly cannot find anything.
1 Like
Sounds like you want to position e.g. a circle at the hand position and color in that circle with a color encoding the current velocity of the hand. So red = v.x and green = v.y. Then you have a texture that is really similar to what you get out of an optical flow component (but with „better“ data)
1 Like
Thanks Josef
This seems like a better solution than using optical flow component I’m surprised i haven’t seen any examples of this technique.
Would the result then be plugged into the optical flow input on particles GPU?
To be honest, I never used the particlesGPU component myself, I assumed that you normally use the opticalFlowTOP yourself and provide the result as an input to the particleGPU, which you could now replace with the bespoken mediapipe thing. But if you normally provide just a texture that changes over time, from which optical flow is computed inside of the particleGPU, you need to dive into the particleGPU and replace the correct texture in there with the one created from mediapipe
1 Like