How Does it Work

Inside the H.E.Ai.D.:

A 30fps camera collects motion data, which is interpreted as blobs by identifying groups of changing pixel from an updating background field. MaxMSP processes input blob centroids size and rotation information into usable OSC controller data. Blobs are tracked and maintained. Motion following data is passed to a single laser (250mW) overhead blanked and then split with a galvanometer in order to provide visual feedback. Audio controller data is sent also as midi to software like Abelton Live which enables musical interpretation using organized clips or sound generation. Audio is also created directly from MaxMSP using more subtle motion data.

Max/MSP isn interactive graphical programming environment for music, audio, and media.

A blob detection system detects entities and the direction and velocity of their movement in the play space.

Playspace mapping is used so that individual people activate sounds depending on where they are detected in the playspace.

Sounds are generated using either sound samples provided by DJs or composers, or programmatically using MaxMSP.