Home

Sidney D’Mello is an Associate Professor at the Institute of Cognitive Science and the Department of Computer Science at the University of Colorado Boulder (since July 1, 2017). He was previously an Assistant (2012 to 2015) and Associate (2015 to 2017) Professor in the departments of Psychology and Computer Science at the University of Notre Dame

D'Mello's research is at the intersection of the cognitive, affective, computing, and learning sciences. Specific interests include affective computing, social signal processing, intelligent learning environments, speech and language processing, human-computer interaction, and multimodal machine learning.

His team is interested in the dynamic interplay between cognition and emotion while individuals and groups engage in complex real-world tasks. We apply insights gleaned from this basic research program to develop intelligent technologies that help people achieve to their fullest potential by coordinating what they think and feel with what they know and do.

Announcements

  • Learn about our U.S. National Science Foundation (NSF) AI Institute for Student-AI Teaming here, here, and here.

  • Prospective PhD students - see here for details.

  • New paper: Looking for a Deal? Social Visual Attention during Negotiations via Mixed Media Videoconferencing in CSCW 2020.[PDF]

  • New paper: Multimodal, Multiparty Modeling of Collaborative Problem Solving Performance in ICMI 2020 [PDF]

  • New paper: What Eye Movements Reveal about Comprehension during Naturalistic Reading of Long, Connected in Cognitive Science. [PDF]

  • New paper: Validation of survey effort measures of grit and self-control in a sample of high school students in PLOS ONE [PDF]

  • New paper: TL;DR:  Longer sections of text increase rates of unintentional mind-wandering in Journal of Experimental Education. [PDF]

This research uses a range of techniques such as eye tracking, speech recognition, physiological sensing, computer vision, nonlinear time series analyses, discourse modeling, and machine learning. The interaction contexts include educational games, collaborative problem solving, classroom discourse, computerized reading, and workplace activities. Data is collected in the lab, online, in schools, and the workplace.

D'Mello has co-edited seven books and has published close to 300 journal papers, book chapters, and conference proceedings in these areas. He is an associate editor for Discourse Processes and PLoS ONE, and formerly for IEEE Transactions on Affective Computing, IEEE Transactions on Learning Technologies, International Journal of Artificial Intelligence in Education, and IEEE Access. He serves on the editorial boards of User Modeling & User-Adapted Interaction. D'Mello also serves on the executive board of the International Artificial Intelligence in Education Society, the International Educational Data Mining Society, and the Association for the Advancement of Affective Computing.

Download CV here