Vector Quantized Models for Planning

Additional material for Vector Quantized Models for Planning.

Accepted at ICML 2021, arXiv.

Samples generated by VQM of the DeepMind Lab level explore_rat_goal_locations_small. The first 16 frames are a prompt from the validation set. Thereafter, the model samples every frame. Each sample uses a different sampling RNG, and thus generates a completely different sample even after conditioning on the same prompt.