Tentative schedule -- subject to change
Introduction of the course and logistics
Todo:
Sign-up for discussion leading (due 08/23 - in-class activity)
Vote on HCI research topics for lectures (due 08/29)
Topic: Research questions and contributions
Overview of types of HCI research contributions
How to come up with good research questions
Required Reading:
Jacob O. Wobbrock, Julie A. Kientz. Research Contributions in Human-Computer Interaction. Interactions, 2016.
Scott E. Hudson and Jennifer Mankoff. Concepts, Values, and Methods for Technical Human-Computer Interaction Research. Ways of Knowing in HCI
Topic: Research contributions 1
Empirical research contributions
Methodological research contributions
Discussion Leader 1: TBD
Vote on HCI research topics due.
Required Reading:
Tawanna R Dillahunt, Aarti Israni, Alex Jiahong Lu, Mingzhi Cai, and Joey Chiao-Yin Hsiao. 2021. Examining the Use of Online Platforms for Employment: A Survey of U.S. Job Seekers. CHI 2021.
Amy X. Zhang, Michael Muller, and Dakuo Wang. How do Data Science Workers Collaborate? Roles, Workflows, and Tools. Proc. ACM Hum.-Comput. Interact. 4, CSCW1.
Allison Druin. Cooperative inquiry: developing new technologies for children with children. CHI 1999.
Todo:
Research contribution checkpoint (due 9/21)
Literature review checkpoint (due 10/3)
Topic: Research contributions 2
Artifact contributions
Theoretical contributions
Discussion Leader 2: TBD
Required Reading:
Ritam Jyoti Sarmah, Yunpeng Ding, Di Wang, Cheuk Yin Phipson Lee, Toby Jia-Jun Li, and Xiang 'Anthony' Chen. 2020. Geno: A Developer Tool for Authoring Multimodal Interaction on Existing Web Applications. UIST 2020. Also, watch the demo video on ACM DL.
Yang Zhang, Chouchang (Jack) Yang, Scott E. Hudson, Chris Harrison, and Alanson Sample. Wall++: Room-Scale Interactive and Context-Aware Sensing. CHI 2018. Also, watch the demo video on ACM DL.
Ali Alkhatib and Michael Bernstein. Street-Level Algorithms: A Theory at the Gaps Between Policy and Decisions. CHI 2019.
Stuart K. Card, Jock D. Mackinlay, and George G. Robertson. The design space of input devices. CHI 1990.
Topic: Research contributions 3
Dataset contributions
Survey contributions
Opinion contributions
Discussion Leader 3: TBD
Required Reading:
Biplab Deka, Zifeng Huang, Chad Franzen, Joshua Hibschman, Daniel Afergan, Yang Li, Jeffrey Nichols, and Ranjitha Kumar. Rico: A Mobile App Dataset for Building Data-Driven Design Applications. In UIST 2017.
Tawanna R. Dillahunt, Xinyi Wang, Earnest Wheeler, Hao Fei Cheng, Brent Hecht, and Haiyi Zhu. 2017. The Sharing Economy in Computing: A Systematic Literature Review. Proc. ACM Hum.-Comput. Interact. 1, CSCW, Article 38 (November 2017).
Tessa Lau. Why Programming-By-Demonstration Systems Fail: Lessons Learned for Usable AI. AI Magazine. 30, 4 (Oct. 2009).
Topic: Overview of technical research in HCI 1
Origins of the field
Interaction models
Discussion Leader 4: TBD
Required Reading:
J.C.R. Licklider. Man-Computer Symbiosis. IRE Transactions on Human Factors in Electronics, Vol. HFE-1 (March 1960), pp. 4-11
Ivan E. Sutherland. Sketch pad a man-machine graphical communication system. Proceedings of the SHARE design automation workshop (DAC '64)
Brad A. Myers. Challenges of HCI Design and Implementation. ACM Interactions. vol. 1, no. 1. January, 1994.
I. Scott MacKenzie. Fitts' law as a research and design tool in human-computer interaction. Hum.-Comput. Interact. 7, 1 (March 1992), 91-139.
Optional Reading:
Douglas C. Engelbart, "Augmenting human intellect: A Conceptual Framework", SRI Summary Report AFOSR-3223, 1962. http://www.dougengelbart.org/pubs/augment-3906.html.
Brad A. Myers. All the Widgets. 2 hour, 15 min video. Technical Video Program of the SIGCHI'90 conference.
Topic: Overview of technical research in HCI 2
Ubiquitous computing
Multi-modal interaction
Discussion Leader 5: TBD
Required Reading:
Ken Hinckley, Jeff Pierce, Mike Sinclair, and Eric Horvitz. Sensing techniques for mobile interaction. UIST 2000.
Mark Weiser. 1999. The computer for the 21st century. SIGMOBILE Mob. Comput. Commun. Rev. 3, 3
Anind Dey. Understanding and Using Context . Personal Ubi Comp 5, 4–7 (2001).
Sharon Oviatt. Ten myths of multimodal interaction. Commun. ACM 42, 11 (November 1999)
Optional Reading:
Gierad Laput, Robert Xiao, and Chris Harrison. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. UIST 2016. Also, watch the demo video on ACM DL.
Richard A. Bolt. “Put-that-there”: Voice and gesture at the graphics interface. SIGGRAPH 1980. Watch the demo video here.
Toby Jia-Jun Li, Marissa Radensky, Justin Jia, Kirielle Singarajah, Tom M. Mitchell, and Brad A. Myers. PUMICE: A Multi-Modal Agent that Learns Concepts and Conditionals from Natural Language and Demonstrations. UIST 2019. Also, watch the demo video on ACM DL.
Topic: Overview of technical research in HCI 3
Mixed-initiative interaction
Direct manipulation and interface agents
Cognitive dimensions
Discussion Leader 6: TBD
Required Reading:
Eric Horvitz. Principles of mixed-initiative user interfaces. CHI 1999.
Ben Shneiderman and Pattie Maes. Direct manipulation vs. interface agents. interactions 4, 6 (Nov./Dec. 1997).
TRG Green. Cognitive dimensions of notations. People and computers V. 1989 Sep 5:443-60.
Optional Reading:
Pattie Maes. Agents that reduce work and information overload. Commun. ACM 37, 7 (July 1994).
Justin Cranshaw, Emad Elwany, Todd Newman, Rafal Kocielnik, Bowen Yu, Sandeep Soni, Jaime Teevan, and Andrés Monroy-Hernández. Calendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop. CHI 2017. Also, watch the demo video on ACM DL.
Saleema Amershi, Dan Weld, Mihaela Vorvoreanu, Adam Fourney, Besmira Nushi, Penny Collisson, Jina Suh, Shamsi Iqbal, Paul N. Bennett, Kori Inkpen, Jaime Teevan, Ruth Kikin-Gil, and Eric Horvitz. Guidelines for Human-AI Interaction. CHI 2019.
Topic: Design research in HCI
Discussion Leader 7: TBD
Required Reading:
John Zimmerman, Jodi Forlizzi, and Shelley Evenson. Research through design as a method for interaction design research in HCI. CHI 2007.
Herb A. Simon. The Science of Design: Creating the Artificial. Chapter in The Sciences of the Artificial. 1969.
One of the following:
William Odom, Ron Wakkary, Youn-kyung Lim, Audrey Desjardins, Bart Hengeveld, and Richard Banks. From Research Prototype to Research Product. CHI 2016.
Qian Yang, Aaron Steinfeld, Carolyn Rosé, and John Zimmerman. Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design. CHI 2020.
Optional Reading:
William Gaver. What should we expect from research through design? CHI 2012.
Short presentations of research contribution checkpoints
Research contribution checkpoint due
Todo:
CITI training (due 09/28)
Topic: Social research in HCI
Discussion Leader 8: TBD
Required Reading:
Moira Burke, Robert Kraut, and Cameron Marlow. Social capital on Facebook: differentiating uses and users. CHI 2011.
Thomas Erickson and Wendy A. Kellogg. Social translucence: an approach to designing systems that support social processes. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000)
Mark S. Ackerman. The intellectual challenge of CSCW: the gap between social requirements and technical feasibility. Hum.-Comput. Interact. 15, 2 (September 2000)
Optional Reading:
Nicolas Ducheneaut and Robert J. Moore. The social side of gaming: a study of interaction patterns in a massively multiplayer online game. CSCW 2004.
Sunny Consolvo, David W. McDonald, and James A. Landay. Theory-driven design strategies for technologies that support behavior change in everyday life. CHI 2009.
Topic: Ethics and regulation (Guest Lecture: Eric Felde, JD. Director of Research Compliance for Notre Dame Research)
Research ethics in HCI
IRB process
Discussion Leader 9: TBD
Required Reading:
Amy Bruckman. Research Ethics and HCI. Ways of Knowing in HCI.
Wendy Moncur. The emotional wellbeing of researchers: considerations for practice. CHI 2013.
Cosmin Munteanu, Heather Molyneaux, Wendy Moncur, Mario Romero, Susan O'Donnell, and John Vines. Situational Ethics: Re-thinking Approaches to Formal Ethics Requirements for Human-Computer Interaction. CHI 2015.
CITI training due
Topic: Qualitative methods 1
Survey
Interview
Ethnography
Discussion Leader 10: TBD
Required Reading:
Hendrik Müller, Aaron Sedley, Elizabeth Ferrall-Nunge. Survey Research in HCI. Ways of Knowing in HCI.
Paul Dorish. Reading and Interpreting Ethnography. Ways of Knowing in HCI.
Jonathan Lazar, Jinjuan Heidi Feng, Harry Hochheiser. Interviews and Focus Groups. Chapter in Research Methods in Human-Computer Interaction.
Literature review checkpoint due
Todo:
Qualitative practice stage 1 (due 10/31)
(optional) IRB application
Topic: Qualitative methods 2
Qualitative coding
Thematic analysis
Grounded theory
Discussion Leader 11: TBD
Required Reading:
Michael Muller. Curiosity, Creativity, and Surprise as Analytic Tools: Grounded Theory Method. Ways of Knowing in HCI.
Nielsen Norman Group. How to Analyze Qualitative Data from UX Research: Thematic Analysis.
Jonathan Lazar, Jinjuan Heidi Feng, Harry Hochheiser. Analyzing Qualitative Data. Chapter in Research Methods in Human-Computer Interaction.
HCI hot research topic 1
Speaker: Sherry Tongshuang Wu, University of Washington
Title: To Debug and Correct imperfect AI, in development and in collaboration
Abstract: AI research has progressed at an incredible speed, to the point where it is being introduced, explicitly and behind the scenes, into everyone's lives. However, these AI models usually have flaws hidden under their impressive accuracy, which may amplify social bias, or even lead to fatal accidents. How do we identify, improve, and cope with imperfect models, such that they still augment and support us as designed? In the talk, I will discuss two scenarios around users interactively debugging and correcting AIs: (1) when AI designers and developers systematically validate an AI system before they are unleashed, and (2) when end users identify and overwrite AI errors as they collaborate in real-time. I will compare the unique goals in these two cases, with an emphasis of the role of HCI research.
Required Reading:
Heer, Jeffrey. "Agency plus automation: Designing artificial intelligence into interactive systems." Proceedings of the National Academy of Sciences 116.6 (2019): 1844-1850.
Amershi, Saleema, et al. "Guidelines for human-AI interaction." Proceedings of the 2019 CHI conference on human factors in computing systems. 2019.
Sambasivan, Nithya, et al. "Everyone wants to do the model work, not the data work”: Data Cascades in High-Stakes AI." proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 2021.
Optional Reading:
Ribeiro, Marco Tulio, et al. "Beyond accuracy: Behavioral testing of NLP models with CheckList.” ACL 2020
Topic: Quantitative methods 1
Log data analysis
Eye-tracking
Discussion Leader 12: TBD
Required Reading:
Susan Dumais, Robin Jeffries, Daniel M. Russell, Diane Tang, Jaime Teevan. Understanding User Behavior Through Log Data and Analysis. Ways of Knowing in HCI.
Vidhya Navalpakkam, Elizabeth F. Churchill. Eye Tracking: A Brief Introduction. Ways of Knowing in HCI.
HCI hot research topic 2
Speakers: Dr. Xu Wang and Dr. Anhong Guo, University of Michigan
Title: Human-AI Systems for Visual Information Access
Abstract: In this talk, I will describe hybrid human- and AI-powered intelligent interactive systems to provide access to visual information in the real world. By combining the advantages of humans and AI, these systems can be nearly as robust and flexible as humans, and nearly as quick and low-cost as automated AI, enabling us to solve problems that are currently impossible with either alone. We have developed and deployed human-AI systems for two application domains: accessibility and environmental sensing. To make physical interfaces accessible for blind people, we developed systems to interpret static and dynamic interfaces, enabling blind people to independently access them through audio feedback or tactile overlays. For environmental sensing, we developed and deployed a camera sensing system that collects human labels to bootstrap automatic processes to answer real-world visual questions, allowing end-users to actionalize AI in their everyday lives. AI systems often require a huge amount of upfront training data to get started, but targeted human intelligence can bootstrap the systems with relatively little data. Although humans may be slower initially, quickly bootstrapping to automated approaches provides a good balance, enabling human-AI systems to be scalable and rapidly deployable.
Required Reading:
Anhong Guo, Xiang 'Anthony' Chen, Haoran Qi, Samuel White, Suman Ghosh, Chieko Asakawa, and Jeffrey P. Bigham. VizLens: A Robust and Interactive Screen Reader for Interfaces in the Real World. UIST 2016.
Xu Wang, Srinivasa Teja Talluri, Carolyn Rose, and Kenneth Koedinger. UpGrade: Sourcing Student Open-Ended Solutions to Create Scalable Learning Opportunities. L@S '19.
Topic: Quantitative methods 2
Sensor data streams
Crowdsourcing (for large-scale data collection)
Discussion Leader 13: TBD
Required Reading:
Stephen Voida, Donald J. Patterson, Shwetak N. Patel. Sensor Data Streams. Ways of Knowing in HCI.
Serge Egelman, Ed H. Chi, Steven Dow. Crowdsourcing in HCI Research. Ways of Knowing in HCI.
David Martin, Benjamin V. Hanrahan, Jacki O'Neill, and Neha Gupta. Being a turker. In CSCW '14.
Topic: Human-centered design methods
Discussion Leader 14: TBD
Qualitative practice stage 1 due
Todo:
Qualitative practice stage 2 (due 11/9)
Required Reading:
Michael Muller. Participatory Design: The Third Space in HCI. Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications.
Chadia Abras, Diane Maloney-Krichmar, Jenny Preece. User-Centered Design. Berkshire Encyclopedia of Human-Computer Interaction.
Mary Beth Rosson and John Carroll. Scenario-Based Design. Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications.
Topic: Prototyping interactive systems
Discussion Leader 15: TBD
Todo:
Proposed method checkpoint (due 11/16)
Required Reading:
Kara Pernice. UX Prototypes: Low Fidelity vs. High Fidelity. Nielsen Norman Group.
Michel Beaudouin-Lafon, Wendy Mackay. Prototyping Tools and Techniques. Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies, and Emerging Applications.
Topic: Methods for evaluating interactive systems
Discussion Leader 16: TBD
Required Reading:
Saul Greenberg and Bill Buxton. Usability evaluation considered harmful (some of the time). CHI 2008.
Katie A. Siek, Gillian R. Hayes, Mark W. Newman, John C. Tang. Field Deployments: Knowing from Using in Context. Ways of Knowing in HCI.
Amy Ko, Thomas LaToza, Margaret Burnett. A practical guide to controlled experiments of software engineering tools with human participants. Empirical Software Engineering
HCI hot research topic 3
Todo:
Qualitative practice stage 3 (due 11/21)
Qualitative practice stage 2 due
Speaker: Dr. Judith Uchidiuno, Carnegie Mellon University
Title: Designing early literacy education technologies for underserved populations
Abstract: Designing educational technologies for underserved populations is a very challenging but extremely rewarding endeavor. Context is key - the best designed education technologies are bound to fail without immersing oneself in the culture and learning preferences of your target population. In this talk, I will describe my work in the last 6 years designing technology for and with low-income populations in the US and rural villages in Africa. I will discuss how each research endeavour has changed my research outlook, as well as the complexities of working in different contexts. Finally, I will also share research areas that currently excite me and some wisdom on how new researchers can engage with this line of work.
Required Reading:
Judith Uchidiuno, Evelyn Yarzebinski, Michael Madaio, Nupur Maheshwari, Ken Koedinger, and Amy Ogan. Designing Appropriate Learning Technologies for School vs Home Settings in Tanzanian Rural Villages. In COMPASS '18.
Judith Uchidiuno, Evelyn Yarzebinski, Emily Keebler, Kenneth Koedinger, and Amy Ogan. Learning from African classroom pedagogy to increase student engagement in education technologies. In COMPASS '19.
Topic: Broader impacts in technical HCI research
Discussion Leader 17 : TBD
Content warning: The reading materials for this class session may contain references to racism, sexism, classism, ableism, and sexual assault. If you ever feel the need to step outside the classroom during the discussion, discuss your personal reactions to the materials with me outside the classroom, or read alternative reading materials for the topic of this class, please feel free to reach out to me.
Required Reading:
Ihudiya Finda Ogbonnaya-Ogburu, Angela D.R. Smith, Alexandra To, and Kentaro Toyama. Critical Race Theory for HCI. CHI 2020.
Christina Harrington, Sheena Erete, and Anne Marie Piper. Deconstructing Community-Based Collaborative Design: Towards More Equitable Participatory Design Engagements. CSCW 2019.
Nicola Dell and Neha Kumar. The Ins and Outs of HCI for Development. CHI 2016.
Optional Reading:
Ari Schlesinger, W. Keith Edwards, and Rebecca E. Grinter. Intersectional HCI: Engaging Identity through Gender, Race, and Class. CHI 2017.
Lynn Dombrowski, Ellie Harmon, and Sarah Fox. Social Justice-Oriented Interaction Design: Outlining Key Design Strategies and Commitments. In DIS 2016.
Megan Hofmann, Devva Kasnitz, Jennifer Mankoff, and Cynthia L Bennett. Living Disability Theory: Reflections on Access, Research, and Design. ASSETS 2020.
Peer-critique sessions for proposed methods
Todo:
Final presentation (starting on 11/29)
Final proposal (due 12/10)
Proposed method checkpoint due
OPTIONAL help session with the final presentation and the proposal
Qualitative practice stage 3 due
Final presentations 1
Final presentations 2
Final presentations 3
Final proposal due at 11:55pm on 12/10