Multimodal perception

Stefania Serafin just held a great lecture on multimodal perception and sonic interaction design at the SMC summer school. It is fascinating with the differences in spatiotemporal resolution between the different senses:

Spatial resolution

  1. eye
  2. tactile
  3. ear

Temporal resolution

  1. ear
  2. tactile
  3. eye

Stefania showed a number of examples of the application of this knowledge in interaction design, one example being the tactile floor they are building at McGill.

Published by


Alexander Refsum Jensenius is a music researcher and research musician living in Oslo, Norway.