VideoGen: Generative Modeling of Videos Using VQ-VAE and Transformers

BAIR Single-Frame Conditioned Samples

BAIR Single-Frame + Action Conditioned Samples (each row is same action sequence)

bp_frame_cond.mp4
bp_frame_action_cond.mp4


ViZDoom HGS Unconditional Samples

ViZDoom HGS Action Conditioned Samples (Each row is same action sequence)

hgs.mp4
hgs_action_cond.mp4

ViZDoom Battle2 Unconditional Samples

ViZDoom Battle2 Action Conditioned Samples (Each row is same action sequence)

battle2.mp4
battle2_action_cond.mp4