Gesture-based interactive system

Real-time image generation via Computer vision + StreamDiffusion + TouchDesigner. I created a system that combines a pre-rendered animation and a noise map to control the output of my generative AI animation. Along with this, I used gesture-based rules to dynamically swap between text prompts that are also conditioning the image output.


Complete Video here!
Github Repo on how I did it

2 Likes