Multimodal Sensing for Localization, Planning and Scene Understanding