{"id":5893,"date":"2026-04-11T18:11:08","date_gmt":"2026-04-11T18:11:08","guid":{"rendered":"https:\/\/composers-inside-electronics.net\/cie-wp20\/?p=5893"},"modified":"2026-04-19T10:57:35","modified_gmt":"2026-04-19T10:57:35","slug":"reacting-to-sensors","status":"publish","type":"page","link":"https:\/\/composers-inside-electronics.net\/cie-wp20\/reacting-to-sensors\/","title":{"rendered":"Reacting to Sensors"},"content":{"rendered":"\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_85 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Table of Contents<\/p>\n<label for=\"ez-toc-cssicon-toggle-item-6a59c1536833a\" class=\"ez-toc-cssicon-toggle-label\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/label><input type=\"checkbox\"  id=\"ez-toc-cssicon-toggle-item-6a59c1536833a\"  aria-label=\"Toggle\" \/><nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/reacting-to-sensors\/#Two_sketches\" >Two sketches<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/reacting-to-sensors\/#IMU_controlling_rotating_loudspeaker_and_audio_parameters\" >IMU controlling rotating loudspeaker and audio parameters<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/reacting-to-sensors\/#Wii_xy_wiggling_servo_motors_with_Accelerometer_controlling_audio\" >Wii xy wiggling servo motors with Accelerometer controlling audio<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/reacting-to-sensors\/#Pepsi_Modulator_Revisited_%E2%80%93_a_duet_2021\" >Pepsi Modulator Revisited &#8211; a duet (2021)<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/reacting-to-sensors\/#Pepsi_Modulator_for_8_thumbs\" >Pepsi Modulator for 8 thumbs<\/a><\/li><\/ul><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Two_sketches\"><\/span>Two sketches <span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Two sketches using an IMU (Inertial Motion Unit) orientation sensors for controlling audio and other or other parameters for interactive installations and performance instruments to be further developed in proposed workshops for new work.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">An Arduino Nano Sense 33  has an IMU orientation is used to control audio and other parameters. The IMU here sense XYZ orientation information over USB.  There is also a bluetooth wireless version to be documented under separate cover.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"IMU_controlling_rotating_loudspeaker_and_audio_parameters\"><\/span>IMU controlling rotating loudspeaker and audio parameters<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The orientation of the Arduino Nano is used to control <\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>degree of rotation of a rotating loudspeaker<\/li>\n\n\n\n<li>audio parameters for a simple Max patch<\/li>\n<\/ul>\n\n\n\n<iframe loading=\"lazy\" src=\"https:\/\/drive.google.com\/file\/d\/1wwHRjhujfRHCcbqE6qBOlqLSEksz-tF_\/preview\" width=\"640\" height=\"480\"><\/iframe>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Wii_xy_wiggling_servo_motors_with_Accelerometer_controlling_audio\"><\/span>Wii xy wiggling servo motors with Accelerometer controlling audio<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A Wii controller (with IMU and Joystick) is used to control XY servo motors that have the Arduino Nano clipped to the servo motors.  The fishing pole tip has enough mass to perturb the servo feedback loop wigging the servos that is pickup up by the Arduino and sent to a simple MAX patch generating the audio.<\/p>\n\n\n\n<iframe loading=\"lazy\" src=\"https:\/\/drive.google.com\/file\/d\/1XJ26rCuVPXXeWymWu6FrKfKcg_WyqQxx\/preview\" width=\"640\" height=\"480\"><\/iframe>\n\n\n\n<div class=\"wp-block-group\"><div class=\"wp-block-group__inner-container is-layout-constrained wp-block-group-is-layout-constrained\">\n<details class=\"wp-block-details is-layout-flow wp-block-details-is-layout-flow\"><summary>Click to expand for more more material on two Installations using sensors and haptic devices<\/summary>\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Pepsi_Modulator_Revisited_%E2%80%93_a_duet_2021\"><\/span>Pepsi Modulator Revisited &#8211; a duet (2021)<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">A pair of visitor to a gallery are presented a pair of iPads with touch sensitive sliders to adjust a sound field based on material recorded from the Pepsi Modulator as recreated by Michael Johnsen from Gordon Mumma&#8217;s original schematics for the E.A.T. Pavilion.<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1024\" height=\"768\" fetchpriority=\"low\" src=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/2EA588AD-A583-467A-8662-DE99B855F742_1_105_c.jpeg\" alt=\"\" class=\"wp-image-5480\" srcset=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/2EA588AD-A583-467A-8662-DE99B855F742_1_105_c.jpeg 1024w, https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/2EA588AD-A583-467A-8662-DE99B855F742_1_105_c-300x225.jpeg 300w, https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/2EA588AD-A583-467A-8662-DE99B855F742_1_105_c-768x576.jpeg 768w, https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/2EA588AD-A583-467A-8662-DE99B855F742_1_105_c-960x720.jpeg 960w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Foreground: Pepsi Modulator Revisited, MdM Salzburg <\/figcaption><\/figure>\n\n\n\n<h3 class=\"wp-block-heading\"><span class=\"ez-toc-section\" id=\"Pepsi_Modulator_for_8_thumbs\"><\/span>Pepsi Modulator for 8 thumbs<span class=\"ez-toc-section-end\"><\/span><\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">This installation work that invites visitors to use XBOX controllers to play variations on recordings made from a reconstruction of the Mumma Sound Modulator . An LED strip provides feedback, attraction and distraction. The work will further developed to use other game pad sensors an haptic feedback and adapted for concert setting performance. <\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" width=\"1024\" height=\"768\" fetchpriority=\"low\" src=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/E90C2103-5F95-4A8F-9E3D-A245CEC67E33_1_105_c.jpeg\" alt=\"\" class=\"wp-image-5463\" srcset=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/E90C2103-5F95-4A8F-9E3D-A245CEC67E33_1_105_c.jpeg 1024w, https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/E90C2103-5F95-4A8F-9E3D-A245CEC67E33_1_105_c-300x225.jpeg 300w, https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/E90C2103-5F95-4A8F-9E3D-A245CEC67E33_1_105_c-768x576.jpeg 768w, https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-content\/uploads\/2025\/06\/E90C2103-5F95-4A8F-9E3D-A245CEC67E33_1_105_c-960x720.jpeg 960w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n<\/details>\n<\/div><\/div>\n\n\n\n<p class=\"wp-block-paragraph\">See also <a href=\"https:\/\/composers-inside-electronics.net\/cie-wp20\/shrieks-and-nuptials-kitchen-2018\/\">Shreiks and Nuptials <\/a>which uses the motion sensors in iPad in performance setting.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Two sketches Two sketches using an IMU (Inertial Motion Unit) orientation sensors for controlling audio and other or other parameters for interactive installations and performance [&#8230;]<\/p>\n","protected":false},"author":2,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"open","template":"","meta":{"h5ap_radio_sources":[],"footnotes":""},"class_list":["post-5893","page","type-page","status-publish","hentry"],"post_type":"page","author_name":"Philip Edelstein","_links":{"self":[{"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/pages\/5893","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/comments?post=5893"}],"version-history":[{"count":6,"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/pages\/5893\/revisions"}],"predecessor-version":[{"id":6078,"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/pages\/5893\/revisions\/6078"}],"wp:attachment":[{"href":"https:\/\/composers-inside-electronics.net\/cie-wp20\/wp-json\/wp\/v2\/media?parent=5893"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}