Hi everyone,
I’d like to share a new open-source project that may be of interest to the TouchDesigner community — especially those using Wekinator or building real-time, interactive systems.
RTML Tool Kit is a Unity-native machine learning engine inspired by Wekinator, but built entirely in C# for real-time use inside Unity.
It’s designed for OSC-based communication and works great with TouchDesigner.
What it does:
- Trains and runs ML models directly in Unity — no external GUI or desktop app needed
- Supports Linear Regression, KNN, and a placeholder DTW recogniser
- Allows runtime save/load of trained models (Unity Inspector or C#)
- Communicates with TD via standard OSC (send input, receive prediction, toggle train mode, etc.)
- Mobile- and XR-ready — works on Quest, Android, etc.
: GitHub
Example Workflow:
- TouchDesigner sends OSC inputs to Unity
- Unity processes them via RTML and makes predictions
- Predictions are sent back to TD (e.g. to control visuals or state)
No Python required, no dependencies. You can use this in installations, performances, or mobile builds without relying on Wekinator or cloud services.
If you’re already sending/receiving OSC in TouchDesigner, integrating this takes just a few minutes.
Happy to hear your thoughts or feedback — and let me know if you need help setting it up!
Saim