A number of example applications are suggested including development of musical instruments, video games and other systems for gesture analysis and feedback. The Wekinator supports OSC so any device that can output OSC can be used as a controller and anything that can receive OSC can be controlled. A list of hardware and software that support OSC can be found on the opensoundcontrol website. As an example, a user may want to use a Wiimote accelerometer to control the volume of a sound. So the first thing they would need to do is perform the specific gesture a number of times and associate them to the volume parameter. The wekinator creates a mapping relationship between these two values and starts to develop new mapping relationships between inputs and output parameters.

The following diagram, sourced from the ChucK/Wekinator integration instructions, provides an overview of the system.

   

A new VST plugin by Niall Moody called Brush Strokes is an audiovisual instrument. It uses two oscillators, their waveforms determined by scanning the x and y-axis positions of the mouse position. Louder sounds are generated by larger gestures and when there is no movement there is no sound. The VST and a processing applet (both with source code) can be found at Niall’s ndcplugs website.