Sidney D’Mello is an Associate Professor at the Institute of Cognitive Science and the Department of Computer Science at the University of Colorado Boulder (since July 1, 2017). He was previously an Assistant (2012 to 2015) and Associate (2015 to 2017) Professor in the departments of Psychology and Computer Science at the University of Notre Dame

D'Mello's research is at the intersection of the cognitive, affective, computing, and learning sciences. Specific interests include affective computing, attentional computing, intelligent learning environments, speech and language processing, human-computer interaction and computational models of cognition.


  • ACM ICMI 2018We are hosting the 20th International Conference on Multimodal Interaction (ICMI) in Boulder, Colorado, October 16-20th, 2018 [Details]

  • New paper:   How Effective is Emotional Design? A Meta-Analysis of Facial Anthropomorphisms and Pleasant Colors during Multimedia Learning in Educational Research Review. [PDF]

  • New paper:   How the stimulus influences mind wandering in semantically-rich task contexts in CRPI. [PDF]

  • New paper: Multimodal Modeling of Coordination and Coregulation Patterns in Speech Rate during Triadic Collaborative Problem Solving in ICMI 2018. [PDF]

  • New paper:  No Pain, No Gain: A Brief Behavioral Measure of Frustration Tolerance Predicts Academic Achievement Two Years Later in Emotion. [PDF]

    New paper: 
    Automatically Measuring Question Authenticity in Real-World Classrooms in Educational Researcher. [PDF]

His team conducts basic research on affective and cognitive states (e.g., confusion, boredom, mind wandering) during complex learning and problem solving, develops real-time computational models of these states, and integrates the models in learning environments that intelligently respond to learner mental states. 

This research uses a range of techniques such as eye tracking, speech recognition, physiological sensing, computer vision, nonlinear time series analyses, discourse modeling, and machine learning. The interaction contexts include intelligent tutoring, educational games, collaborative problem solving, classroom discourse, text, scene, and film comprehension, and everyday life. Data is collected in the lab, online, in schools, and the workplace.

D'Mello has co-edited six books and has published over 250 journal papers, book chapters, and conference proceedings in these areas. He is an associate editor for IEEE Transactions on Learning Technologies, the International Journal of Artificial Intelligence in Educationand formerly for IEEE Transactions on Affective Computing and IEEE Access. He serves on the editorial boards of the User Modeling & User-Adapted Interaction and Discourse Processes. D'Mello also serves on the executive board of the International Artificial Intelligence in Education Society, the International Educational Data Mining Society, and the Association for the Advancement of Affective Computing.

Download CV here