PhD

ACTION — SOUND. Developing Methods and Tools to Study Music-Related Body Movement.

Abstract: Body movement is integral to both performance and perception of music, and this dissertation suggests that we also think about music as movement. Based on ideas of embodied music cognition, it is argued that ecological knowledge of action-sound couplings guide our experience of music, both in perception and performance. Then follows a taxonomy of music-related body movements, before various observation studies of perceiver’s music-movement correspondences are presented: air instrument performance, free dance to music, and sound-tracing. These studies showed that both novices and experts alike seem to associate various types of body movement with features in the musical sound. Knowledge from the observation studies was used in the exploration of artificial action-sound relationships through the development of various prototype music controllers, including the Cheapstick, music balls, and the Music Troll. This exploration showed that it is possible to create low-cost and human-friendly music controllers that may be both intuitive and creatively interesting. The last part of the dissertation presents tools and methods that have been developed throughout the project, including the Musical Gestures Toolbox for the graphical programming environment Max/MSP/Jitter; techniques for creating motion history images and motiongrams of video material; and development of the Gesture Description Interchange Format (GDIF) for streaming and storing music-related movement data. These tools may be seen as an answer to many of the research questions posed in the dissertation, and have facilitated the analysis of music-related movement and creation of artificial action-sound relationships in the project.

Citation

Jensenius, A. R. (2007). Action–Sound: Developing Methods and Tools to Study Music-Related Body Movement. PhD thesis, University of Oslo.

@phdthesis{Jensenius:2007,
	Author = {Jensenius, Alexander Refsum},
	School = {University of Oslo},
	Title = {Action--Sound: Developing Methods and Tools to Study Music-Related Body Movement},
	Year = {2007}}

About

  • Carried out within the Musical Gestures Group at the University of Oslo 2004-2007.
  • The dissertation was submitted 11 July 2007 and was defended for the degree Philosopiae Doctor (Ph.D.) at the University of Oslo on 31 January 2008.

Advisors

  • Professor Rolf Inge Godøy, Universitetet i Oslo
  • Associate Professor Marcelo M. Wanderley, McGill University

Committee

  • Professor Sylvie Gibet, Université de Bretagne Sud
  • Dr. Roberto Bresin, Kungliga Tekniska Högskolan
  • Professor Stan Hawkins, Universitetet i Oslo

Pictures from the defense

Overview of the hallDissertation presentation Gesturing... The audience Interviewed by a journalistWith the committee and advisors Tired candidate at the dinnerReceiving the diploma