Week 4

• Gesture Inventory

1. Combing hair

Movement Annotation

Body part: Head, wrist, fingers
Range of motion: Repetitive downward stroke
Speed: Moderate, rhythmic
Tension/Relaxation: Light tension
Effort level: Medium

Sound Mapping

When the hand moves downward while combing, the sound gradually becomes higher in frequency and sharper. 

Once the system recognizes this motion, the sound transforms into something like strings,

2. Petting a cat

Movement Annotation

Body part: Fingers, palm
Range of motion: Back and  forth
Speed: Slow, gentle
Tension/Relaxation: Relaxed
Effort level: Low

Sound Mapping

Sound turns into a soft purring sound. 

The sound is slightly distorted, creating a sense of distance and spatial depth.

3. Typing

Movement Annotation

Body part: Fingers
Range of motion: Small vertical taps
Speed: Fast, repetitive
Tension/Relaxation: Light tension
Effort level: Low but frequent

Sound Mapping

Sound becomes intermittent, crisp sounds, like glass marbles. 

Variations in finger tapping speed can change the pitch.

4. Rubbing neck

Movement Annotation

Body part: Hand, neck
Range of motion: Circular / kneading motion
Speed: Slow
Tension/Relaxation: Relaxed
Effort level: Medium

Sound Mapping

A relaxing low-frequency sound, like wind. 

Creating an immersive, surrounding spatial quality, with a rotating sound in space.

5. Walking

Movement Annotation

Body part: Legs, feet
Range of motion: Steps
Speed: Quick - slow
Tension/Relaxation: Light tension
Effort level: Medium

Sound Mapping

Footsteps generate rhythmic drum beats. Different walking speeds change the tempo.

 The slower the walk, the larger the spatial reverb.

6. Skin Caring

Movement Annotation

Body part: Face, palm, fingers
Range of motion:  Circular  motions, pressing
Speed: Slow
Tension/Relaxation: Relaxed
Effort level: Low

Sound Mapping

The sound becomes slightly distorted, like stirring liquid.

7. Twisting a Bottle Cap

Movement Annotation

Body part: Fingers, thumb, wrist, arm
Range of motion: Small circular rotation
Speed: Slow, sudden stop when it opens
Tension/Relaxation: Gradual increase in tension
Effort level: Medium

Sound Mapping

The sound tightens and the pitch rises, creating a sense of tension. 

At the moment the hand opens, a pop sound is produced.

8. Clapping Hands

Movement Annotation

Body part: Hands, wrists, arms
Range of motion: Arms move inward and palms meet
Speed: Variable
Tension/Relaxation: Light tension
Effort level: Medium

Sound Mapping

As the palms gradually move closer together, the pitch rises. Each time the palms make contact, the sound switches between a low octave and a high octave.

• Tutorial Sketch

Tutorial: PPPANIK -- "Liquid Image Displacement". https://www.youtube.com/watch?v=Z8B-N_pvLis

 link to .tox: https://drive.google.com/file/d/1soWxLCBr4ystQtxbTpYlf4M5VSOVu4Mv/view?usp=sharing

• Process

This tutorial mainly uses Noise and Displacement to create a liquid, flowing effect. What I found fascinating is that she first used a Constant to create a long strip at the top of the frame, and then combined it with Noise, Transform, and other operators to produce a sense of movement flowing from top to bottom. She also added Slope and Inside to create a more three-dimensional effect, making the noise look less like it’s simply distorting the image and more like a layer of flowing water covering it. One part I didn’t fully understand is how she made the noise effect become transparent. In the video, she added a Constant and adjusted it to Inside, which somehow achieved the transparency effect.