MuSe 2020 -
The Multimodal Sentiment
in Real-life Media Challenge

The goal of the Challenge is to provide a common benchmark for multimodal information processing and to bring together the Affective Computing, and Sentiment Analysis communities, to compare the merits of multimodal fusion for the three core modalities under well-defined conditions. Another motivation is the need to advance sentiment and emotion recognition systems to be able to deal with fully, previously unexplored naturalistic behaviour in large volumes of in-the-wild data, as this is exactly the type of data that both multimedia and human-machine/ human-robot communication interfaces have to face in the real world.

We are calling for teams to participate in three Sub-Challenges:

1. Multimodal Sentiment in-the-Wild Sub-challenge (MuSe-Wild): Predicting the level of emotional dimensions (arousal, valence) in a time-continuous manner from audio-visual recordings.

2. Multimodal Emotion-Target Sub-challenge (MuSe-Topic): Predicting 10-class domain-specific topics as the target of 3-class (low, medium, high) emotions of valence and arousal.

3. Multimodal Trustworthiness Sub-challenge (MuSe-Trust): Predicting the level of trustworthiness of user-generated audio-visual content in a sequential manner utilising a diverse range of features and (optional) emotional (arousal and valence) predictions.

more