Material-based LED Interaction in TouchDesigner

General TouchDesigner Discussion
1

Hello, I’m currently working on a graduation project using TouchDesigner and LED strips.

So far, I’ve successfully connected an Art-Net LED controller and LED strips, and I’m currently testing basic LED control in TouchDesigner.

Recently, I started exploring a new interaction direction:
Instead of hand-tracking interaction, I want different material surfaces to trigger different LED behaviors.

For example:

  • touching a holographic material panel could trigger flickering or shimmering LED effects

  • touching a rough stone-like surface could create fragmented or slow LED movement

  • touching soft fabric materials could create smooth and diffused light transitions

The main idea is to create tactile/material-based interaction and emotional responses through light.

At the moment, I’m thinking more about using each material surface itself as an interaction trigger/interface, rather than using AI-based material recognition.

I’m wondering:

  1. Is this kind of interaction feasible with TouchDesigner?

  2. What would be the simplest and most stable way to implement this?

  3. Would capacitive touch sensors, pressure sensors, or conductive materials be a good approach?

Any advice or references would really help. Thank you!

2

Yes

I would recommend to use an Arduino or ESP32 and connect that to TouchDesigner.

I would start trying with a capacity sensor, as it’s so simple and cheap. You can already create one using an Arduino without any external sensors - you only need a resistor and a length of wire attached to piece of aluminium foil. And it detects proximity without touching!

Some other options (which could be more stable) are proximity sensors based on IR or ultrasonic.

Here are some pointers to get started:

3

or hand tracking with a camera. (each technique comes with its own limitations/challenges.)