Scan Sequencer Javascript is an innovative tool that transforms real-time webcam images into music by detecting changes in the color of pixels and generating trigger signals. The tool works like a virtual keyboard, with the vertical keys responding to pixel color changes, creating a unique auditory experience.
Learning Activities in the Studio:
Music and Art Integration
Encourage your students to experiment with different visuals, patterns, and color combinations to create their own compositions. This can be a unique way to explore the relationship between visual arts and music, as well as an opportunity to discuss the concept of synesthesia.
Coding and Algorithm Exploration
Encourage your students to explore the underlying code and algorithms that power this tool. This can serve as an introduction to coding principles, algorithm design, and creative applications of technology.
Science and Math Connections
Use the tool to explore the connection between frequency, pitch, and color. Students can create graphs or charts to represent the relationship between these elements and discuss the underlying scientific and mathematical concepts.
Collaborative Performances
Have your students work in groups to design and perform a multimedia presentation that combines live webcam images, music, and visual art. This can foster teamwork, communication, and creative problem-solving skills.
"Keyboard" is an interactive musical keyboard experiment that allows users to play music using their face, body, mouse, or keyboard. With a webcam, the experiment tracks a specific point on the user's body, such as their nose, to control the musical notes. The experiment does not store or send images to any servers.Â
Learning Activities in the Studio:
Accessible Music Creation
Introduce your students to an accessible way of creating music, regardless of their physical abilities or prior musical experience. This experiment can help break down barriers and encourage students to explore their musical potential.
Motion Tracking and Technology
Discuss the principles of motion tracking and computer vision technology that power this experiment. Encourage students to think about other applications of this technology in different fields, such as gaming, virtual reality, or sports analysis.
Music Theory and Composition
Use this experiment to teach basic music theory concepts, such as scales, intervals, and chords. Students can experiment with various scales and create their own melodies, fostering an understanding of musical structures.
Interdisciplinary Projects
Combine this experiment with other artistic mediums or STEAM subjects for collaborative projects. For example, students could create a performance that combines music generated by this experiment with dance or visual arts, or explore the physics of sound waves and resonance through the experiment.
"Body Synth" is an interactive musical experiment that allows users to create music simply by moving their bodies. The experiment uses a webcam to detect body movements and translates them into different notes or sounds. The images are not stored or sent to any servers. Users can adjust the sensitivity for big or small movements, change chords, and switch instruments using voice commands, like "C chord" or "guitar."
Learning Activities in the Studio:
Movement and Music
Encourage your students to explore the relationship between movement and music by creating their own compositions using their body movements. This can help students develop a deeper understanding of rhythm, tempo, and coordination.
Music and Dance Collaboration
Organize a collaborative project where students work in pairs or groups to choreograph a dance routine that produces a unique musical composition using this experiment. This activity fosters teamwork, creativity, and communication skills.
Exploring Sound and Motion
Discuss the principles of sound and motion, and how they are interconnected in this experiment. Encourage students to think about other ways in which motion can be used to generate sound or music, and vice versa.
Inclusive Music-Making
Use it as a tool to promote inclusivity in music-making, as it allows students of all physical abilities to participate and create music. This can help build an understanding of accessibility and the importance of inclusive design in technology.
"Seeing Music" is a tool designed to visualize music, providing an immersive experience that allows users to see and understand the connection between sound and visuals. Users can turn on their microphone to sing or play sounds, drop in their own audio or video files, or use different modes to display the subtle textures of sound, paths, and shapes of melodies.
Learning Activities in the Studio:
Visualizing Sound Waves: Encourage students to explore the relationship between sound and visuals by experimenting with different modes in this tool. This can help students develop a deeper understanding of sound waves, frequencies, and harmonics.
Music and Art Collaboration: Organize a collaborative project where students work in pairs or groups to create visual art inspired by the music they visualize using the tool. This activity promotes teamwork, creative expression, and communication.
Exploring Music Accessibility: Discuss how this tool can help individuals who are deaf or hard of hearing experience music in a different way. Encourage students to think about other ways technology can make music more accessible and inclusive for everyone.
This page is being updated continuously.