Robust Multimodal Learning

Shah Nawaz is an assistant professor at Johannes Kepler University Linz. 

Abstract: Multimodal networks have demonstrated remarkable performance improvements over their unimodal counterparts. Existing multimodal networks are designed in a multi-branch fashion that, due to the reliance on fusion strategies, exhibit deteriorated performance if one or more modalities are missing. In this talk, we will discuss multimodal learning methods inherently robust to missing modalities.