Painting Music

02/2018

About the project

PAT 452 is an interactive media design course offered through the Performing Arts Technology Department at the University of Michigan. For our first project of the semester, we were tasked to design a unique, compelling, and interactive digital musical instrument. “Painting Music” merges the visual and sonic arts by using an array of photo-resistors to interpret the performer’s brush strokes and manipulation of light sources into sound.

After brainstorming and multiple design iterations, I began constructing the instrument body out of clear plexiglass using a laser cutter and shop tools. Photoresistors were sandwiched between two layers of plexiglass, and the signals were multiplexed and sent through Arduino to MaxMSP. For the first part of the performance, the sound was influenced and filtered by the model of a basin filling with water as the performer filled the canvas with paint. When the amount of paint on the board caused the “basin” to overflow, an audible cue indicated to the performer to progress to the next part of the piece.

“Painting Music” was played for two unique compositions, the class final presentation and at the PAT department showcase.