Reacting to Sensors

Two sketches

Two sketches using an IMU (Inertial Motion Unit) orientation sensors for controlling audio and other or other parameters for interactive installations and performance instruments to be further developed in proposed workshops for new work.

An Arduino Nano Sense 33 has an IMU orientation is used to control audio and other parameters. The IMU here sense XYZ orientation information over USB. There is also a bluetooth wireless version to be documented under separate cover.

IMU controlling rotating loudspeaker and audio parameters

The orientation of the Arduino Nano is used to control

  • degree of rotation of a rotating loudspeaker
  • audio parameters for a simple Max patch

Wii xy wiggling servo motors with Accelerometer controlling audio

A Wii controller (with IMU and Joystick) is used to control XY servo motors that have the Arduino Nano clipped to the servo motors. The fishing pole tip has enough mass to perturb the servo feedback loop wigging the servos that is pickup up by the Arduino and sent to a simple MAX patch generating the audio.

Click to expand for more more material on two Installations using sensors and haptic devices

Pepsi Modulator Revisited – a duet (2021)

A pair of visitor to a gallery are presented a pair of iPads with touch sensitive sliders to adjust a sound field based on material recorded from the Pepsi Modulator as recreated by Michael Johnsen from Gordon Mumma’s original schematics for the E.A.T. Pavilion.

Foreground: Pepsi Modulator Revisited, MdM Salzburg

Pepsi Modulator for 8 thumbs

This installation work that invites visitors to use XBOX controllers to play variations on recordings made from a reconstruction of the Mumma Sound Modulator . An LED strip provides feedback, attraction and distraction. The work will further developed to use other game pad sensors an haptic feedback and adapted for concert setting performance.

See also Shreiks and Nuptials which uses the motion sensors in iPad in performance setting.