Creating music from visual input via Mediapipe without using Ableton or Bitwig

I would love to know if it is possible to create music/sound in general by for example having one hand be responsible for piano and the other responsible for drums specifically without using bitwig or abelton. The positions of my hands would change tempo and rhythm as well as distortion, delay, reverb, etc. I have seen this done with Ableton and Bitwig before but seeing as those are out of my price range currently, I would like to know if it is possible without it.

Thanks in advance!

hi @paperback ,
as long as you have data streams it is “just” a matter of mapping them to the parameters of the software you decide to use for sound.

If you want to work within a DAW, I’d suggest REAPER, which has a very accessible price and comes packed with free effects. Then you could use any of the many free samplers/VSTi out there to play the sounds you like

Another possibility is going with SuperCollider, which is open source. Either way, you’ll have to do some pre-processing on the data you retrieve from TD, converting them to meaningful MIDI (and possibly OSC) messages to be sent to the audio software

Hope this helps a bit

1 Like

Awesome, thank you for the advice I really appreciate it!