Tentative schedule -- subject to change
Slides are available in the Google Drive folder (ND login required)
Introduction of the course and logistics
Todo:
Sign-up for the discussion leading (in-class)
Vote on HCI research topics for lectures (in-class)
Topic: Research questions and contributions
Overview of types of HCI research contributions
How to come up with good research questions
Required Reading:
Jacob O. Wobbrock, Julie A. Kientz. Research Contributions in Human-Computer Interaction. Interactions, 2016.
Scott E. Hudson and Jennifer Mankoff. Concepts, Values, and Methods for Technical Human-Computer Interaction Research. Ways of Knowing in HCI
Topic: Research contributions 1
Empirical research contributions
Methodological research contributions
Required Reading:
Tawanna R Dillahunt, Aarti Israni, Alex Jiahong Lu, Mingzhi Cai, and Joey Chiao-Yin Hsiao. 2021. Examining the Use of Online Platforms for Employment: A Survey of U.S. Job Seekers. CHI 2021.
Nikhil Sharma, Q. Vera Liao, and Ziang Xiao. 2024. Generative Echo Chamber? Effect of LLM-Powered Search Systems on Diverse Information Seeking. CHI 2024.
Raina Langevin, Ross J Lordon, Thi Avrahami, Benjamin R. Cowan, Tad Hirsch, and Gary Hsieh. Heuristic Evaluation of Conversational Agents. CHI 2021.
Joon Sung Park, Lindsay Popowski, Carrie Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2022. Social Simulacra: Creating Populated Prototypes for Social Computing Systems. UIST 2022.
Optional Reading:
Yaman Yu, Tanusree Sharma, Sauvik Das, and Yang Wang. 2024. "Don't put all your eggs in one basket": How Cryptocurrency Users Choose and Secure Their Wallets. In CHI 2024.
Michel Beaudouin-Lafon. 2000. Instrumental interaction: an interaction model for designing post-WIMP user interfaces. CHI 2000.
Todo:
Research contribution checkpoint (due 9/24)
Literature review checkpoint (due 10/8)
Topic: Research contributions 2
Artifact contributions
Theoretical contributions
Discussion Leader 1: TBD
Required Reading:
Zheng Zhang, Jie Gao, Ranjodh Singh Dhaliwal, and Toby Li. 2023. VISAR: A Human-AI Argumentative Writing Assistant with Visual Programming and Rapid Draft Prototyping. UIST 2023. Watch the demo video.
Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. Wall++: Room-Scale Interactive and Context-Aware Sensing. CHI 2018. Watch the demo video on ACM DL.
Ali Alkhatib and Michael Bernstein. Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions. CHI 2019.
Stuart K. Card, Jock D. Mackinlay, and George G. Robertson. The design space of input devices. CHI 1990.
Optional Reading:
Ian Arawjo, Chelse Swoopes, Priyan Vaithilingam, Martin Wattenberg, and Elena L. Glassman. 2024. ChainForge: A Visual Toolkit for Prompt Engineering and LLM Hypothesis Testing. CHI 2024. Watch the demo video on ACM DL.
Chen Liang, Yasha Iravantchi, Thomas Krolikowski, Ruijie Geng, Alanson P. Sample, and Anhong Guo. 2023. BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation. In UIST 2023. Watch the demo video on ACM DL.
Tae Soo Kim, Yoonjoo Lee, Minsuk Chang, and Juho Kim. 2023. Cells, Generators, and Lenses: Design Framework for Object-Oriented Interaction with Large Language Models. In UIST 2023.
Topic: Research contributions 3
Dataset contributions
Survey contributions
Opinion contributions
Discussion Leader 2: TBD
Required Reading:
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. Rico: A Mobile App Dataset for Building Data-Driven Design Applications. In UIST 2017.
Tawanna R. Dillahunt, Xinyi Wang, Earnest Wheeler, Hao Fei Cheng, Brent Hecht, and Haiyi Zhu. 2017. The Sharing Economy in Computing: A Systematic Literature Review. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 38 (November 2017).
Tessa Lau. Why Programming-By-Demonstration Systems Fail: Lessons Learned for Usable AI. AI Magazine. 30, 4 (Oct. 2009).
Topic: Overview of technical research in HCI 1
Origins of the field
Interaction models
Discussion Leader 3: TBD
Required Reading:
J.C.R. Licklider. Man-Computer Symbiosis. IRE Transactions on Human Factors in Electronics, Vol. HFE-1 (March 1960), pp. 4-11
Ivan E. Sutherland. Sketch pad a man-machine graphical communication system. Proceedings of the SHARE design automation workshop (DAC '64)
Brad A. Myers. Challenges of HCI Design and Implementation. ACM Interactions. vol. 1, no. 1. January, 1994.
I. Scott MacKenzie. Fitts' law as a research and design tool in human-computer interaction. Hum.-Comput. Interact. 7, 1 (March 1992), 91-139.
Optional Reading:
Douglas C. Engelbart, "Augmenting human intellect: A Conceptual Framework", SRI Summary Report AFOSR-3223, 1962. http://www.dougengelbart.org/pubs/augment-3906.html.
Brad A. Myers. All the Widgets. 2 hour, 15 min video. Technical Video Program of the SIGCHI'90 conference.
Topic: Overview of technical research in HCI 2
Ubiquitous computing
Multi-modal interaction
Discussion Leader 4: TBD
Required Reading:
Ken Hinckley, Jeff Pierce, Mike Sinclair, and Eric Horvitz. Sensing techniques for mobile interaction. UIST 2000.
Mark Weiser. 1999. The computer for the 21st century. SIGMOBILE Mob. Comput. Commun. Rev. 3, 3
Xuhai Xu, Prerna Chikersal, Afsaneh Doryab, Daniella K. Villalba, Janine M. Dutcher, Michael J. Tumminia, Tim Althoff, Sheldon Cohen, Kasey G. Creswell, J. David Creswell, Jennifer Mankoff, and Anind K. Dey. 2019. Leveraging Routine Behavior and Contextually-Filtered Features for Depression Detection among College Students. ACM IMWUT.
Sharon Oviatt. Ten myths of multimodal interaction. Commun. ACM 42, 11 (November 1999)
Optional Reading:
Gierad Laput, Robert Xiao, and Chris Harrison. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. UIST 2016. Watch the demo video on ACM DL.
Richard A. Bolt. “Put-that-there”: Voice and gesture at the graphics interface. SIGGRAPH 1980. Watch the demo video.
Toby Jia-Jun Li, Marissa Radensky, Justin Jia, Kirielle Singarajah, Tom M. Mitchell, and Brad A. Myers. PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations. UIST 2019. Watch the demo video on ACM DL.
Zheng Ning, Brianna L Wimer, Kaiwen Jiang, Keyi Chen, Jerrick Ban, Yapeng Tian, Yuhang Zhao, and Toby Jia-Jun Li. 2024. SPICA: Interactive Video Content Exploration through Augmented Audio Descriptions for Blind or Low-Vision Viewers. CHI 2024. Watch the demo video on ACM DL.
Topic: Overview of technical research in HCI 3
Mixed-initiative interaction
Direct manipulation and interface agents
Cognitive dimensions
Discussion Leader 5: TBD
Required Reading:
Eric Horvitz. Principles of mixed-initiative user interfaces. CHI 1999.
Ben Shneiderman and Pattie Maes. Direct manipulation vs. interface agents. interactions 4, 6 (Nov./Dec. 1997).
TRG Green. Cognitive dimensions of notations. People and computers V. 1989 Sep 5:443-60.
Optional Reading:
Pattie Maes. Agents that reduce work and information overload. Commun. ACM 37, 7 (July 1994).
Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andrés Monroy-Hernández. Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop. CHI 2017. Also, watch the demo video on ACM DL.
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. Guidelines for Human-AI Interaction. CHI 2019.
Topic: Design research in HCI
Discussion Leader 6: TBD
Required Reading:
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. Research through design as a method for interaction design research in HCI. CHI 2007.
Herb A. Simon. The Science of Design: Creating the Artificial. Chapter in The Sciences of the Artificial. 1969.
One of the following:
William Odom, Ron Wakkary, Youn-kyung Lim, Audrey Desjardins, Bart Hengeveld, and Richard Banks. From Research Prototype to Research Product. CHI 2016.
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. CHI 2020.
Optional Reading:
William Gaver. What should we expect from research through design? CHI 2012.
Short presentations of research contribution checkpoints
Research contribution checkpoint due
Todo:
CITI training (due 10/8)
NO CLASS MEETING
Asynchronous:
Watch the talk video: Interaction-Centric AI by Juho Kim
Submit a reflection post by participating in the Canvas discussion by 10/6 11:59pm
Topic: Computing for Coexistence
Guest Lecturer: Mohammad Rashidujjaman Rifat
Abstract: In this lecture, I will present my research agenda, “Computing for Coexistence.” I will ask how sociotechnical systems can sustain plural ethical, cultural, and religious worldviews without collapsing them into a single ideal. Drawing on HCI, AI ethics, and critical social science, I will discuss two detailed case studies: (1) a VR-based interfaith learning system that fosters intergroup understanding and empathy, and (2) the design of projects for social goods integrating differing ethical frameworks and value preferences. Building on these and other related studies that I conducted, I will conclude with theoretical and design insights for developing systems that help diverse communities live, learn, and deliberate together.
Required Reading:
Mohammad Rashidujjaman Rifat, Jay Chen, and Kentaro Toyama. Money, God, and SMS: Explorations in Supporting Social Action Through a Bangladeshi Mosque. CHI 2017.
Mohammad Rashidujjaman Rifat, et al. Cohabitant: The design, implementation, and evaluation of a virtual reality application for interfaith learning and empathy building. CHI 2024.
Mohammad Rashidujjaman Rifat, et al. Data, Annotation, and Meaning-Making: The Politics of Categorization in Annotating a Dataset of Faith-based Communal Violence. FAcct 2024.
Topic: Social research in HCI
Discussion Leader 7: TBD
Required Reading:
Moira Burke, Robert Kraut, and Cameron Marlow. Social capital on Facebook: differentiating uses and users. CHI 2011.
Thomas Erickson and Wendy A. Kellogg. Social translucence: an approach to designing systems that support social processes. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000)
Mark S. Ackerman. The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Hum.-Comput. Interact. 15, 2 (September 2000)
Optional Reading:
Nicolas Ducheneaut and Robert J. Moore. The social side of gaming: a study of interaction patterns in a massively multiplayer online game. CSCW 2004.
Sunny Consolvo, David W. McDonald, and James A. Landay. Theory-driven design strategies for technologies that support behavior change in everyday life. CHI 2009.
Jonathan Grudin. Why CSCW applications fail: problems in the design and evaluationof organizational interfaces. CSCW 1988.
Topic: Ethics and regulation
Research ethics in HCI
IRB process
Discussion Leader 8: TBD
Required Reading:
Amy Bruckman. Research Ethics and HCI. Ways of Knowing in HCI.
Wendy Moncur. The emotional wellbeing of researchers: considerations for practice. CHI 2013.
Cosmin Munteanu, Heather Molyneaux, Wendy Moncur, Mario Romero, Susan O'Donnell, and John Vines. Situational Ethics: Re-thinking Approaches to Formal Ethics Requirements for Human-Computer Interaction. CHI 2015.
Optional (but strongly encouraged) Reading:
Kapania, Shivani, Ruiyi Wang, Toby Jia-Jun Li, Tianshi Li, and Hong Shen. I'm categorizing LLM as a productivity tool": Examining ethics of LLM use in HCI research practices. arXiv preprint arXiv:2403.19876 (2024).
CITI training due
Literature Review Checkpoint due
Todo:
Research contribution revision checkpoint (due 10/27)
Proposed method checkpoint (due 11/24)
(optional) IRB application
Topic: Sustainable Physical Intelligence
Guest Lecturer: Tingyu Cheng
No class meeting -- Feel free to work on your projects.
Topic: Qualitative methods 1
Survey
Interview
Ethnography
Discussion Leader 9: TBD
Required Reading:
Hendrik Müller, Aaron Sedley, Elizabeth Ferrall-Nunge. Survey Research in HCI. Ways of Knowing in HCI.
Paul Dorish. Reading and Interpreting Ethnography. Ways of Knowing in HCI.
Jonathan Lazar, Jinjuan Heidi Feng, Harry Hochheiser. Interviews and Focus Groups. Chapter in Research Methods in Human-Computer Interaction.
Research contribution revision checkpoint due
Todo:
Qualitative practice stage 1 (due 11/12)
Guest Lecture: Simret Araya Gebreegziabher
Topic: Qualitative methods 2
Qualitative coding
Thematic analysis
Grounded theory
Discussion Leader 10: TBD
Required Reading:
Michael Muller. Curiosity, Creativity, and Surprise as Analytic Tools: Grounded Theory Method. Ways of Knowing in HCI.
Nielsen Norman Group. How to Analyze Qualitative Data from UX Research: Thematic Analysis.
Jonathan Lazar, Jinjuan Heidi Feng, Harry Hochheiser. Analyzing Qualitative Data. Chapter in Research Methods in Human-Computer Interaction.
Topic: Human-centered design methods
Discussion Leader 11: TBD
Required Reading:
Michael Muller. Participatory Design: The Third Space in HCI. Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications.
Chadia Abras, Diane Maloney-Krichmar, Jenny Preece. User-Centered Design. Berkshire Encyclopedia of Human-Computer Interaction.
Mary Beth Rosson and John Carroll. Scenario-Based Design. Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications.
Topic: Prototyping interactive systems
Discussion Leader 12: TBD
Required Reading:
Kara Pernice. UX Prototypes: Low Fidelity vs. High Fidelity. Nielsen Norman Group.
Michel Beaudouin-Lafon, Wendy Mackay. Prototyping Tools and Techniques. Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications.
Topic: Quantitative methods
Log data analysis
Eye-tracking
Sensor data streams
Qualitative practice stage 1 due
Todo:
Qualitative practice stage 2 (due 11/24)
Discussion Leader 13: TBD
Required Reading:
Stephen Voida, Donald J. Patterson, Shwetak N. Patel. Sensor Data Streams. Ways of Knowing in HCI.
Susan Dumais, Robin Jeffries, Daniel M. Russell, Diane Tang, Jaime Teevan. Understanding User Behavior Through Log Data and Analysis. Ways of Knowing in HCI.
Vidhya Navalpakkam, Elizabeth F. Churchill. Eye Tracking: A Brief Introduction. Ways of Knowing in HCI.
Topic: Methods for evaluating interactive systems
Discussion Leader 14: TBD
Required Reading:
Saul Greenberg and Bill Buxton. Usability evaluation considered harmful (some of the time). CHI 2008.
Katie A. Siek, Gillian R. Hayes, Mark W. Newman, John C. Tang. Field Deployments: Knowing from Using in Context. Ways of Knowing in HCI.
Amy Ko, Thomas LaToza, Margaret Burnett. A practical guide to controlled experiments of software engineering tools with human participants. Empirical Software Engineering
Todo:
Final presentation (starting on 12/1)
Final proposal (due 12/14)
Topic: Broader impacts in technical HCI research
Discussion Leader 15 : TBD
Content warning: The reading materials for this class session may contain references to racism, sexism, classism, ableism, and sexual assault. If you ever feel the need to step outside the classroom during the discussion, discuss your personal reactions to the materials with me outside the classroom, or read alternative reading materials for the topic of this class, please feel free to reach out to me.
Required Reading:
Zheng Ning, Leyang Li, Daniel Killough, JooYoung Seo, Patrick Carrington, Yapeng Tian, Yuhang Zhao, Franklin Mingzhe Li, and Toby Jia-Jun Li. AROMA: Mixed-Initiative AI Assistance for Non-Visual Cooking by Grounding Multi-modal Information Between Reality and Videos. UIST 2025.
Christina Harrington, Sheena Erete, and Anne Marie Piper. Deconstructing Community-Based Collaborative Design: Towards More Equitable Participatory Design Engagements. CSCW 2019.
Nicola Dell and Neha Kumar. The Ins and Outs of HCI for Development. CHI 2016.
Optional Reading:
Ari Schlesinger, W. Keith Edwards, and Rebecca E. Grinter. Intersectional HCI: Engaging Identity through Gender, Race, and Class. CHI 2017.
Lynn Dombrowski, Ellie Harmon, and Sarah Fox. Social Justice-Oriented Interaction Design: Outlining Key Design Strategies and Commitments. In DIS 2016.
Megan Hofmann, Devva Kasnitz, Jennifer Mankoff, and Cynthia L Bennett. Living Disability Theory: Reflections on Access, Research, and Design. ASSETS 2020.
Peer-critique sessions for proposed methods
Qualitative practice stage 2 due
Proposed method checkpoint due
Todo:
Qualitative practice stage 3 (due 12/3)
Sign-up for the final presentation slots.
Final presentations 1
Qualitative practice stage 3 due
Final presentations 2
Final presentations 3
Final proposal due at 11:59pm on 12/14