This page is about a method for total sound visualization based on U.S. Patent 10,341,795. It may be the basis for field guides to total sound e.g. from animals, musical instruments, and equipment up on wikipedia downstream.
Our first paper on this subject is at https://aes2.org/publications/elibrary-page/?id=18451 . Our google sites page, with link to our first attempt at a browser app is at https://sites.google.com/site/realtimesheetmusic/ . The current best homemade browser app is at https://www.umsl.edu/~fraundorfp/nanowrld/jsfft/RTSM_v19c.html .
The first version of our browser app that attempts to do phase coloring properly has been put together with help from Claude.ai, and is located at https://www.umsl.edu/~fraundorfp/nanowrld/jsfft/claude_rtsm_modernized_v9.html. This also our first attempt at on-line hybrid intepolation between linear frequency coefficients on the vertical log-frequency scale.
If you manage to capture some screen captures of some interesting sounds, let us know!
The interactive storybook pictured above is at:
https://g.co/gemini/share/f4d01852d256 .
A slightly "more technical" Claymation storybook is at:
This is a NotebookLM "video" slideshow about a recently patented method for total sound visualization. It may be the basis for field guides to total sound e.g. from animals, musical instruments, and equipment up on wikipedia downstream.
The thumbnail shows a log frequency and log complex color plot of a spoken phrase, superposed on musical treble and bass clefs. Who is saying what here? Can you e.g. tell by playing this on your piano?
A screen capture of a Northern Cardinal chirp, using the new Claude version of our real time sheet music app, is shown here. Can a human really imitate that? What other interesting sounds might be fun to create visualizations for?
To explore Fourier phase relationships, stay tuned for work underway using electronic sounds, like square, triangle & half wave snippets. Downstream, it may also be fun to show that we can replay the sound, from the picture!
Bull frogs (not shown) are lower in frequency, so many of those shown at left are likely tree frogs from across the world. As in the case of the Cardinal, they look almost like hieroglyphics. They might, moreover, retain similarities from chirp to chirp, and may even be useful in distinguishing individuals if we (like their frog peers?) could actually hear all the details that we can see with this app.