Physics-as-Inverse-Graphics: Unsupervised Learning of Physical Parameters from Video

Long-term video prediction

Gravitational system

True sequence

Physics+Inverse-Graphics

Interaction Net+Inverse-Graphics

DDPAE

Spring system

True sequence

Physics+Inverse-Graphics

Interaction Net+Inverse-Graphics

DDPAE

Pendulum control

After 2000 environment steps

Oracle

Physics+Inverse-Graphics

PlaNet

DDPG

After 20.000 environment steps

Oracle

Physics+Inverse-Graphics

PlaNet

DDPG

Counterfactual reasoning: increasing gravity by x1.4

Oracle

Physics+Inverse-Graphics

PlaNet

Goal-directed control: using non-vertical target position

Goal state

Physics+Inverse-Graphics

Page updated

Google Sites

Report abuse