Can I use Mediapipe Face Tracking in TouchDesigner for eye-gaze-based interaction?

Beginners
1

Hello, I’m a student currently working on an interactive media art project using eye-tracking.

My plan is to divide one monitor into 5–6 regions and measure how long the audience’s gaze stays within each area.

I recently found that TouchDesigner can use Mediapipe for face tracking, and I noticed that it provides several data values related to the eyes (as shown in the reference image).

Before I proceed, I’d like to ask:
:backhand_index_pointing_right: Is Mediapipe’s face tracking accurate enough for this kind of eye-gaze interaction?
I want to know if it can reliably detect which region the viewer is looking at.

Thank you for your time!

MediaPipe TouchDesigner.toe (241.2 KB)
While researching eye tracking in TouchDesigner, I found an incredibly helpful tutorial file about MediaPipe.

image
image1285×269 19.8 KB

2

Hi @angela135 ,

maybe @blankensmithing has some insight on this topic.
There is also some information available from google on that topic, so might be worth checking that first:

cheers
Markus