The main goal of this project is linking contemporary music and visual art through a real-time processing on a trio-band which consists of an erhu player, cellist and pianist.
Technical details:
Infra-red tracking of the arm movement of the er-hu player
Accelerometers for tracking of the wrist movement of the cellist
DSP sound processing of the audio signal from the pianist
Software platform:
MAX/MSP/Jitter
A meaningful 2D/3D visualization will be correspondence within the original thinking of the composer/arranger after an exhaustive analysis of the score for the concert attending to the different parameters of the music language: harmony, counterpoint, instrumentation, formal analysis, style and background of the composer. The music performer’s expression will be interacting with the music and the 3D visualization to create an interactive visual art in real-time. The audience will be able to listen to the music and at the same time appreciating the meaning of the musical scenes in visual art. The dynamic visual art projected behind the musicians adds a new dimension to contemporary music appreciation and it helps the audience to apprehend the intention of the composer and the expression of the performer.
Work featured in NUS Arts Festival 2007, Techno Arts Series, titled “An Interactive Visual Art Concert”.
http://www.mixedreality.nus.edu.sg/index.php?option=com_content&task=view&id=145&Itemid=172
