RTSM home

This is a centralized web-link for exploring stuff you can do with our  real-time-sheet music demo-apps, whose basis is discussed in more detail in references [1] and [2] below.  

A partly functional version our color Firefox-only browser app (for mobile devices as well as computers) may be found through here. Our older black and white app, now with a volume control, is here. 

This flickr-group is available to see what others have managed to come up with, and for sharing your own sound snapshots obtained with the apps. 

The apps under development here were inspired by work with spatial harmonics in crystals, and developed initially for classroom use in our How Things Work class e.g. in conjunction with physics of music presentations by the Arianna String Quartet. 

Our first primer on this approach was posted up here on the web, where we offer a walk-through on topics like amplitude and frequency modulation, log-frequency plots of the treble and bass clef, and the idea of displaying the spoken word (as in the figure below) as well as music on the same sheet.

Poster for the 2016 AES convention on total sound videography

Footnotes

• 1. Stephen Wedekind and P. Fraundorf (Sept 2016) "Log complex color for visual pattern recognition of total sound" Audio Engineering Society Convention 141, paper 9647 (AES library, laTeX version, arXiv:1907.09936, HAL-02173823).

  2.  Philip Fraundorf, Stephen Wedekind and Wayne Garver, Log complex color for visual pattern recognition of total sound, U.S. Patent 10,341,795 filed November 28, 2017 and issued July 2, 2019, WIPO, Justia, FPO.