Gestrument Research (video)

Video description:

First steps with the iOS app Gestrument being controlled by visual tracking of juggling patterns with a Kinect 360 camera. This work was a proof of concept- future refinements will include advanced calibration and appropriately tuned presets to find matching aesthetics between the audio and visuals.

This is interesting stuff ...