I’m completely new to this, and knowing myself, I need to create something with TouchDesigner and connect it to Unreal to get hands-on. I’ve seen some amazing examples where users perform gestures that trigger actions in Unreal. Can anyone recommend where to start to achieve something like that?
I want to use this project I created, and since I’ve already implemented the exposed controls, the Unreal part is mostly done. Is setting up a gesture recognition system in TouchDesigner something achievable with the help of a tutorial?
If you’re just starting out with TouchDesigner/Unreal integration, sending and receiving data over OSC is a great place to start.
This tutorial isn’t exactly the same, but it should get you most of the way:
And then with gesture recognition, there isn’t anything built-in to TouchDesigner, however this tutorial here discusses how to recognise ‘swipes’ on a touch screen:
Also in the Palette on there is a MultiTouch example - a little advanced but can be good to dive into to see how things are done.
Thanks @Jaydos , I had watched the first tutorial, and while it seems simple, I felt it lacked control. I’d prefer to trigger it using gestures, sound, or something with more interaction. But thanks—I’ll check out the second video.
Do you know if gesture recognition is available in the free version of TouchDesigner?
There is no ‘gesture recognition’ provided in TouchDesigner (that I’m aware of), however TouchDesigner provides the tools to create your own ‘gesture recognition’. And this is all accessible in the free version. However with some googling you might find a .TOE or .TOX file that someone has already created for recognising some gestures.
If you wanted to experiment with audio, you can try the Audio Analysis example in Tools section in the Palette (on the left hand side of the TouchDesigner window). Plug in some audio (either a file or microphone) and it will output different variables based on the detection parameters. Then you could send that to Unreal via OSC like in the first video.
