AudioVideoAnalysis

To allow everyone to watch their own synchronised spectrograms and motiongrams, I have made a small application called AudioVideoAnalysis. Download AudioVideoAnalysis for OS X (8MB) It currently has the following features: Draws a spectrogram from any connected microphone Draws a motiongram/videogram from any connected camera Press the escape button to toggle fullscreen mode Built with [...]

Managing e-mail

While in Genova for the last couple weeks, I only had limited time to read and write e-mails, and now that I am back in my office I am slowly trying to get through everything that was left behind. I have found it inspiring to read some of the blog entries on e-mail handling over [...]

NIME paper

A group of Jamoma-developers presented a paper suggesting an extension to OSC at this year’s NIME in Genova two weeks ago: Reference: Place, T., T. Lossius, A. R. Jensenius, N. Peters and P. Baltazar (2008): Proceedings of the 2008 International Conference on New Interfaces for Musical Expression, 5-7 June 2008, Genova. Downloads: Full paper Poster [...]

Motiongrams sync’ed to spectrograms

One of my reasons for developing motiongrams was to have a solution for visualising movement in a way that would be compatible to spectrograms. That way it would be possible to study how movement is evolving over time, in relation to how the audio is changing over time. In my current implementation of motiongrams in [...]

Multimodal perception

Stefania Serafin just held a great lecture on multimodal perception and sonic interaction design at the SMC summer school. It is fascinating with the differences in spatiotemporal resolution between the different senses: Spatial resolution eye tactile ear Temporal resolution ear tactile eye Stefania showed a number of examples of the application of this knowledge in [...]