Representation Learning for Hierarchical RL

Videos of successfully trained policies and their learned representations. Square at upper left shows learned representations (green is current observation representation, blue is trajectory of representations, magenta is goal chosen by higher-level policy).

Our method is able to learn good representations as well as successful hierarchical policies on top of these representations, regardless of whether the raw state observation is position based or image based.