
Video sonification in the browser
There were several presentations on the sonification of human body movement at MOCO. This, combined with my recent successes in developing browser versions of both VideoViz and VideoScrub, led me to attempt to revive another old Max patch. Motiongram-based sonification There are many ways of sonifying body motion. Nowadays, we often work with skeleton or marker-based models and advanced synthesis engines. However, two decades ago, I began exploring how to turn motiongrams into sound, treating the motiongram as if it were a spectrogram. I also published a paper on the method in 2012. ...