Strumming to the Beat: Audio-Conditioned Contrastive Video Textures

Unconditional Contrastive Video Textures

Red bar at the bottom indiciates part of the source video that's being played.

Source

Texture

Source

Texture

Audio Conditioned Video Textures

NOTE: If the videos don't play, please go to chrome://settings/content/cookies and click the 'Add' button next to 'Allow' adding [*.]google.com

Source Video

Conditioning Audio

(Click the pop out to play)

morningsun.wav

Synthesized Video

Source Video

Conditioning Audio

(Click the pop out to play)

madworld.wav

Synthesized Video

Qualitative Results

Unconditional Video Textures

Input

Contrastive

Classic

Classic +

Classic ++

Classic Deep

Input

Contrastive

Classic

Classic +

Classic ++

Classic Deep

Input

5.mp4

Contrastive

Classic

Classic+

Classic++

Classic Deep

Audio Conditioned Video Textures

Piano

Input

piano1.mp4

Contrastive

Random Clip

random_pianoT3.mp4

VRB

Classic + Audio

classic_audio (1).mp4

Guitar

Input

Contrastive

Random Clip

random_sadguitar_sadT1.mp4

VRB

vrb_sadT1.mp4

Classic + Audio

classic_sad_T1.mp4

Sitar

Input

Contrastive

Random Clip

random_sitar1_sitarT.mp4

VRB

Classic + Audio

classic_audio (2).mp4

Dance

Input

Contrastive

Random Clip

random_lisa.mp4

VRB

5_vrb.mp4

Classic + Audio

5_classic_audio.mp4

Guitar

Input

Contrastive

Random Clip

VRB

Classic + Audio

Interpolation

Without Interpolation With Interpolation

Without Interpolation With Interpolation