Research & Innovation
A Pipa Player's Wrist Rotations Are Now Driving an Entire Room's Sound and Light
Unfinished Motion, a project by Hsiao Yung-Shen presented through IRCAM Forum, builds a multimodal interactive system that translates pipa performance gestures into spatial sound and visuals. Using Laban Movement Analysis to quantify a performer's physical "effort," the system pipes pose data through Dicy2 for machine co-creation, Spat5 for spatialized sound, and TouchDesigner for visuals — treating the body as the source of intention, not just of sound.