The Wekinator

The Wekinator is a software application developed by Rebecca Fiebrink which uses machine learning principles in order to help develop interactive systems. The GUI provides the user with a way to ‘create machine learning models from scratch, without any programming’.

A number of example applications are suggested including development of musical instruments, video games and other systems for gesture analysis and feedback. The Wekinator supports OSC so any device that can output OSC can be used as a controller and anything that can receive OSC can be controlled. A list of hardware and software that support OSC can be found on the opensoundcontrol website. As an example, a user may want to use a Wiimote accelerometer to control the volume of a sound. So the first thing they would need to do is perform the specific gesture a number of times and associate them to the volume parameter. The wekinator creates a mapping relationship between these two values and starts to develop new mapping relationships between inputs and output parameters.

The following diagram, sourced from the ChucK/Wekinator integration instructions, provides an overview of the system.

wekinator system

IanniX

IanniX is a graphical editor based on the UPIC compositional tool which was created by Iannis Xenakis. The following video shows Iannix in action with max/msp.

Brush Strokes

    brushStrokes2

A new VST plugin by Niall Moody called Brush Strokes is an audiovisual instrument. It uses two oscillators, their waveforms determined by scanning the x and y-axis positions of the mouse position. Louder sounds are generated by larger gestures and when there is no movement there is no sound. The VST and a processing applet (both with source code) can be found at Niall’s ndcplugs website.

Web Phases

Web Phases is a music webapp that uses internet traffic to help to construct musical compositions. It consists of four dropdown boxes for the user to select different musical elements such as drum beats, piano, drones and strings.

Sonasphere

Sonasphere is an audiovisual software application by Nao Tokui which provides the user with a 3D canvas onto which they can add objects. The objects can be sound samples, effects or mixers, and it is possible to connect these objects together to modify the sound. Parameters of the objects can be assigned to 3D coordinates for the 3D canvas, so a filter object can have the cutoff frequency assigned to the x axis, the resonance to the y. The distance between a connected sound object and filter object control the volume. In addition gravitational forces act between each of the objects to create a more dynamic and chaotic environment.