To allow everyone to watch their own synchronised spectrograms and motiongrams, I have made a small application called AudioVideoAnalysis.

It currently has the following features:

  • Draws a spectrogram from any connected microphone
  • Draws a motiongram/videogram from any connected camera
  • Press the escape button to toggle fullscreen mode

Built with Max/MSP by Cycling ’74 on OS X.5. I will probably make a Windows version at some point, but haven’t gotten that far yet.

A snapshot of the main interface:

The main window of the AudioVideoAnalysis application

The fullscreen can be toggled with the escape button:

Fullscreen mode in the AudioVideoAnalysis application

The are, obviously, lots of things that can and will be improved in future versions. Please let me know of any problems you experience with the application, and if there is anything in particular you think should be included.

Published by


Alexander Refsum Jensenius is a music researcher and research musician living in Oslo, Norway.

4 thoughts on “AudioVideoAnalysis”

  1. Hi! First I’d like to thank you for this fascinating tool. I’ll use this software to study movements in a martial art I train. I am particularly interested in motiongrams and their applications. Regarding to this I have some questions:

    How accurate are motiongrams in relation to small versus tall people? Are we getting to different values here? Can we measure those movement curves? If its possible, I would include application where you can measure the differences between arm, leg and upper body movements.

    Btw, I’ve found that if you move your connected camera, software records that as if an object has moved and motiongrams are shown. Is that normal?

    ps:I am looking forward to improvements!


  2. Reply to question 1:
    The motiongram is just a reduction of the original motion image (which again is just the difference between consecutive frames in the video image), so there is no awareness of the “content” of the image, e.g. small or tall people. This entirely depends on how much space they fill up in the video image.

    Reply to question 2:
    If you move the camera this will make a trace in the motion image. Motiongrams are therefore mainly suited for cases where the camera is locked in a fixed position.

  3. Ok. Jeg tror at jeg skal skrive på norsk nå . Har lest artikkelen din og skjønner lit mer av dette. Har du mulighet til å ogradere software senere med dette:
    -zoom motiongram
    -lagre motiongram
    -kopiere motingram-

    Og kanskje skrive litt i en help-fil om hvordan tolkes forskjellige kurver? For eksempel hand, hode og kroppsbevelser?

    Kanskje blir dette for mye? 🙂


  4. Funksjonaliteten du etterspør er tilgjengelig i Musical Gestures Toolbox som er endel av Jamoma-pakken for Max/MSP, men dette krever at man har Max/MSP installert og klarer å sette sammen modulene selv. Målet er å lage et selvstendig program som inneholder alle de viktigste funksjonene, og jeg kommer til å arbeide videre med dette etter sommerferien Da kommer det også mer og bedre dokumentasjon.

Comments are closed.