HCI@NYU Seminar Series

NYU Human-Computer Interaction Seminar

The Human-Computer Interaction (HCI) Seminar Talk Series, is hosted by NYU Tandon School of Engineering's CSE and TMI Departments, and is co-organized by NYU Steinhardt School of Culture, Education, and Human Development.

This series aims to bring together NYU researchers, industry experts, designers, technologists, and HCI enthusiasts to explore the latest trends, innovations, and challenges in the ever-evolving field of HCI. Whether you're a student, a professional, or someone curious about how technology interacts with human behavior, this series offers an opportunity to engage with thought leaders who are shaping the future of user experience, interface design, and interactive systems.

This seminar series is open to all NYU affiliates. Please join the HCI @ NYU google group to stay connected.

We’re excited to have you join us for these engaging discussions and hope they inspire new perspectives on how we can reimagine the technology of the future!

Upcoming Speakers

Summer term speakers to be announced...

Past Speakers

March 20, 2025

11:00 am - 12:00 pm

2 Metrotech, Rm 1099

Host: Graham Dove

Wendy Ju, Cornell Tech, New York

Robots in the City

Abstract: Robots are increasingly being deployed in public spaces–for example, to deliver food, to clean or vacuum, or to help maintain safety. Often in these deployments, the robots are also tasked with observing the social context. This is necessary for pragmatic reasons, to steer clear of hazards, for example, or to understand issues that might affect wider deployment. In this talk, I will talk about urban human-robot interaction projects in light of the robot’s role as social observer. I will talk about key areas in urban HRI research, with a discussion of the ethics of this robot role, some cross-cultural differences that emerge from this activity, and how the urban science community might rise to the challenge.

Bio: Wendy Ju is an Associate Professor at the Jacobs Technion-Cornell Institute at Cornell Tech and the Technion. She is a member of the Information Science field at Cornell University. Dr. Ju comes to Cornell Tech from the Center for Design Research at Stanford University, where she was Executive Director of Interaction Design Research, and from the California College of the Arts, where she was an Associate Professor of Interaction Design in the Design MFA program. Her work in the areas of human-robot interaction and automated vehicle interfaces highlights the ways that interactive devices can communicate and engage people without interrupting or intruding. Dr. Ju has innovated numerous methods for early-stage prototyping of automated systems to understand how people will respond to systems before the systems are built. She has a PhD in Mechanical Engineering from Stanford, and a Master’s in Media Arts and Sciences from MIT. Her monograph on The Design of Implicit Interactions was published in 2015.

March 05, 2025

11:00 am - 12:00 pm

370 Jay St, Rm 1114

Host: Dishita Turakhia

John Liu, LEAP Group, MIT Mechanical Engineering Dept., Cambridge

XR Experiences to Scale and Enhance Learning Manufacturing Analysis and Skills

Abstract: The economy and national security of nations depend on its ability to innovate and produce. STEM skills are in the critical path to compete in this technologically-dependent, post-COVID world. Digital learning environments such as those offered in extended reality (XR) can scale learning, but they often facilitate lower-level cognitive thinking, script the learning pathway, or are disconnected from authentic assessment. This talk will explore crafting extended reality experiences for learning analysis and hands-on skills within manufacturing contexts, ranging from machine shops to online courses. Next, a framework for intelligent tutoring systems for learning psychomotor skills in VR environments will be presented. The talk will conclude by highlighting the potential impact effective workforce solutions can have on individuals, companies, and communities.

Bio: Dr. John Liu is the Director and Principal Investigator of the MIT Learning Engineering and Practice (LEAP) Group, which investigates the intersection of learning technologies, STEM workforce and education, and digital learning and MOOCs. He is a Lecturer in MIT's Mechanical Engineering department and a Scientist in the MIT Digital Learning Lab. He leads education and workforce development efforts for MIT's new initiative: Manufacturing@MIT. He was the Director of the Principles of Manufacturing MicroMasters program, an online certificate program that has now enrolled over 200,000 learners across the globe. He has received several Best Paper Awards from ASEE and IEEE DEMOCon. He has co-authored dozens of publications and currently serves as an executive guest editor for Manufacturing Letters. His research is supported by the Department of Commerce, Department of Defense, Massachusetts Technology Collaborative, Schmidt Futures, National Science Foundation, MIT, and industry partners.

Feb 25, 2025

11:00 am - 12:00 pm

370 Jay St, Rm 1114

Host: Kayla DesPortes

Christina Harrington, Carnegie Mellon University, Pittsburgh

Anthropomorphism, Personification, and Embodiment: Considering Inclusive AI Agents

Abstract: There have been long-standing debates in HCI over the use of anthropomorphism, personification, and embodiment in AI agents, considering the act of projecting human-like qualities onto AI-based systems. The influx of conversational and artificial intelligent systems across the landscape of emerging technology could be a promising intervention to address challenges in many domains, such as healthcare. This is particularly critical among historically marginalized communities who often face amplified disparities, bias, and microaggressions in their real-life experiences, which may be exacerbated by intelligent systems that are also biased. As sociotechnical researchers continue to examine potential impacts of such a pervasive rollout of AI-based technologies and how to safeguard marginalized groups, the question emerges of whether such systems should use anthropomorphic traits, personification or embodiment. This talk will explore research with racially minoritized groups that has examined the design and ethical considerations of inclusive AI agents.

Bio: Christina Harrington is a designer and qualitative researcher who works at the intersection of interaction design and health and racial equity. She combines her background in electrical engineering and industrial design to focus on the areas of universal, accessible, and inclusive design. Specifically, she looks at how to use design in the development of products to support historically excluded groups such as Black and LatinX communities, older adults, and individuals with differing abilities in maintaining their health, wellness, and autonomy in defining their future. Christina is passionate about using design to center communities that have historically been at the margins of mainstream design. She looks to methods such as design justice and community collectivism to broaden and amplify participation in design by addressing the barriers that corporate approaches to design have placed on our ability to see design as a universal language of communication and knowledge. Dr. Harrington is the Director of the Equity and Health Innovations Design Research Lab.

Dec 03, 2024

11:00 am - 12:00 pm

2 Metrotech, Rm 1099

Host: Graham Dove

Mor Naaman, Cornell Tech

From Autocomplete to Auto-Everything: The Consequences of AI-Mediated Communication

Abstract: From autocomplete and smart replies to video filters and deepfakes, we increasingly live in a world where communication between humans is augmented by artificial intelligence. AI often operates on behalf of a human communicator by recommending, suggesting, modifying, or generating messages to accomplish communication goals. We call this phenomenon AI-Mediated Communication (or AI-MC). While AI-MC has the potential of making human communication more efficient, it impacts other aspects of our communication in ways that are not yet well understood. Over the last six years, my collaborators and I have been documenting the impact of AI-MC on communication outcomes, language use, interpersonal trust, and more. The talk will outline experimental findings from this work. For example, the research shows that AI-MC involvement can impact the evaluation of others; change the extent to which we take ownership over our messages; and shift not only what we write, but even our expressed attitudes. AI-MC may also have a disparate effect on different demographic groups in terms of use, or evaluation. Overall, AI-MC raises significant practical and ethical concerns as it stands to reshape human communication, calling for new approaches to the development of these technologies.

Bio: Mor Naaman is the Don and Mibs Follett professor of Information Science at the Jacobs Technion-Cornell Institute at Cornell Tech. He currently serves as Cornell Tech's Associate Dean for Faculty Affairs. Mor leads a research group looking at topics at the intersection of technology, media and democracy. The group applies multidisciplinary techniques — from machine learning to qualitative social science — to study our information ecosystem and its challenges, with a special focus on AI-mediated communication and its impact on society. Before Cornell, Mor was on the faculty at the Rutgers School of Communication and Information, led a research team at Yahoo! Research Berkeley, received a Ph.D. in Computer Science from the Stanford University InfoLab, and played professional basketball for Hapoel Tel Aviv. He is also a former startup co-founder, and advises startup companies in social computing and related areas. He is a recipient of a NSF Early Faculty CAREER Award, research awards and grants from numerous corporations including Microsoft, Meta and Google, and multiple best paper awards.

Nov 27, 2024

Host: Dishita Turakhia

Payod Panda, BREW Team, Microsoft Research Cambridge (UK)

Tools for Thought

Abstract: Can we design technology to augment human cognition, helping individuals think, learn, and solve problems? Rather than automating routine tasks, the Tools for Thought initiative at MSR Cambridge aims to design tools that leverage LFMs and Generative AI for deeper understanding and to foster critical thinking. In this talk, I will introduce an early-stage exploratory project under this initiative. Rabbit Hole (🐇🕳️) is a design concept with the aim of allowing users to delve deep into topics without losing their train of thought as they navigate interconnected subjects. The tool allows users to "emerge" from one line of inquiry and enter another, facilitating a non-linear, curiosity-driven learning experience. I'll discuss the design considerations behind Rabbit Hole and its implementation, followed by open questions I'd love to explore further.

Bio: Panda works at the intersection of design, engineering, and research to study the future of collaborative work using emerging technologies like spatial computing and GenAI. As a Design Engineering Researcher, he leads artefact-led research in the Tools for Thought team at Microsoft Research. More recently, he has been exploring using GenAI as a tool for thought in various scenarios—augmenting human intelligence and intentionality rather than automating tasks. Before Microsoft, Panda completed a PhD in Design at North Carolina State University where he studied collaborative ideation in VR. His work has received best paper awards and several patents.

Nov 21, 2024

Host: Graham Dove

Michael Madaio, Google Research, New York

Responsible AI (h)as a Learning and Design Problem

Abstract: To address the potential harms of AI systems, prior work has developed resources (e.g., toolkits) to support responsible AI (RAI) development and studied how AI practitioners use such resources in their development practices. However, recent work suggests that AI practitioners may not have the relevant skills or knowledge to effectively use RAI resources—particularly as pre-trained AI models have made it easier for more people to build AI-based applications. In this talk, I will share findings from my recent research on 1) what and how AI practitioners in industry contexts are learning about responsible AI on-the-job, and 2) opportunities to support practitioners’ in situ learning during AI design. I will close with implications of our findings and open questions for how HCI, design, and the learning sciences might contribute to the responsible design and development of AI.

Bio: Michael Madaio is a Senior Research Scientist at Google Research. His current research draws on methods from human-computer interaction to help AI practitioners responsibly design AI systems. Prior to joining Google, he was a postdoc at Microsoft Research’s FATE research group on fairness, accountability, transparency, and ethics in AI. He completed his Ph.D. in Human-Computer Interaction from Carnegie Mellon University, where he was a fellow in the Institute for Education Sciences’ Program for Interdisciplinary Education Research (PIER). His research has received several best paper awards, including at the ACM Conference on Fairness, Accountability, and Transparency (FAccT), the ACM Conference on Human Factors in Computing Systems (CHI), the International Conference of the Learning Sciences (ICLS), and others.

Oct 30, 2024

Host: Dishita Turakhia

Sang Ho Yoon, HCI Tech Lab, HCI KAIST, S. Korea

Towards Human-centered Interactive Technologies with Advanced Sensing Techniques and Haptic Interactions

Abstract: The advancement in audiovisual rendering and sensor/actuator hardware have enabled the development of wearable interfaces for AR/VR. However, understanding user intent and providing appropriate feedback remain significant challenges. To address this, I have explored methods to unlock the capability of understanding the user’s intents. Additionally, I have explored haptic-based interaction to offer tailored feedback for AR/VR experiences. In this talk, I will present our lab’s research on leveraging biosignals to offer novel input techniques such as context-aware interaction and user-intent estimation. I will then present a haptic interaction framework designed to promote the integration of haptic feedback into AR/VR environments.

Bio: Sang Ho Yoon is an Assistant Professor of Graduate School of Culture Technology (affiliated with the School of Computing and Graduate School of Metaverse) at KAIST, where he leads KAIST’s Human-centered Interactive Technologies Lab (HCI Tech Lab) as part of the HCI@KAIST. Before joining KAIST, Sang Ho was a principal engineer at Samsung AR Lab and a research engineer at Microsoft Applied Sciences. Sang Ho received his PhD from Purdue University, working with Prof. Karthik Ramani. His research has focused on promoting natural interactions by enabling novel sensing techniques and haptic experiences with the aid of applied machine learning for next-generation XR interfaces. In particular, he has developed a keen interest in proposing novel sensing and haptic interactions for more immersive and inclusive applications.

Organizers

Dishita Turakhia, NYU, Tandon CSE

Dishita is the lead organizer of the HCI seminar series. In the fall of 2024, she joined NYU's Tandon School of Engineering, as a faculty fellow in the Computer Science Engineering department where she teaches the graduate and undergraduate HCI course, and is part of the VIDA group. She received her Ph.D. in Electrical Engineering and Computer Science from MIT with a research focus in Human-Computer Interaction and Design and a minor in Brain and Cognitive Science.

Dishita's research is at the intersection of Human-Computer Interaction and Learning Sciences, specifically focused on designing systems for learning physical skills, such as motor skills, fabrication skills, and maker skills. using enabling technologies like ubiquitous sensing, AR/VR/XR tools, and generative AI.

Claudio Silva, NYU, Tandon CSE

Cláudio T. Silva is Institute Professor of Computer Science and Engineering at NYU Tandon School of Engineering, and Professor of Data Science at the NYU Center for Data Science. He is also affiliated with the Center for Urban Science and Progress (which he helped co-found in 2012) and the Courant Institute of Mathematical Sciences.

Claudio is a Fellow of the IEEE and has received the IEEE Visualization Technical Achievement Award. He was the senior technology consultant (2012-17) for MLB Advanced Media’s Statcast player tracking system, which received a 2018 Technology & Engineering Emmy Award from the National Academy of Television Arts & Sciences (NATAS). His work has been covered in The New York Times, The Economist, ESPN, and other major news media.

Kayla DesPortes, NYU, Steinhardt

Kayla DesPortes is an Assistant Professor of Human-Computer Interaction and the Learning Sciences at NYU Steinhardt in the Department of Administration Leadership and Technology. Prior to her appointment she gained a Bachelor's degree in Electrical and Computer Engineering from Cornell University, and a PhD in Human-Centered Computing from Georgia Institute of Technology.

Kayla’s work transforms computing technology, learning opportunities, and the underlying exclusionary practices of computing to support self-empowerment of marginalized individuals and communities to create a more equitable society.

Graham Dove, NYU, Tandon TMI

Graham Dove is a human-computer interaction researcher and designer. His research in the People+Technology lab focuses on human-centered and participatory design approaches to A.I., and to creating data-enabled products, services, and artifacts.

Graham is co-director of the Human-Centered Technology, Innovation and Design PhD program, and teaches courses in digital civics and designing A.I. innovation.