Older adults (60+) are expected to be among the largest user cohorts of autonomous vehicles, as AVs can support aging in place by providing freedom of mobility. I conducted a two-phase study with older adults (N=26) to understand their perspectives on AVs and identify design needs shaped by age-related sensory and cognitive changes. Based on the findings, I developed multimodal in-car AV interfaces in a VR-based simulation, integrating visual displays, auditory feedback, and two-way conversational interactions. I led all project milestones, including literature review, study design and execution, virtual reality (VR) prototyping (Unity, C#), and data analysis. The user evaluation demonstrated how multimodal interactions can better accommodate older adults' communication needs and support their perceived safety and acceptance of AVs. This work established actionable design guidelines and an AV-passenger design space to inform more inclusive in-car interactions.
Recent advances in large language models (LLMs) create new opportunities for conversational AI agents in AVs. I explored how such agents can be designed to enhance the travel experiences of older adults (60+). I conducted a mixed-methods study (N=23; focus groups and interviews) in which the focus groups identified design preferences for conversational interactions in AVs. Later, I conducted the interviews using a Wizard-of-Oz-inspired setup with a VR simulator and an LLM-powered chatbot. The findings revealed that older adults prefer conversational agents with appropriate anthropomorphic characteristics (i.e., pacing, tone, and frequency) and value proactive social engagement and emergency support. This work provides design recommendations for developing context-aware and adaptive conversational agents that support older passengers' communication, comfort, and perceived safety in AVs.
[Paper]
Many developing countries in the Global South face unique transportation challenges, including inadequate infrastructure, high traffic congestion levels, and limited public transportation access. Additionally, women and girls face significant safety risks (e.g., sexual harassment and assault) when using public transportation, which is a significant barrier to women's mobility.
In this research, I conducted a mixed-methods study (focus groups and co-design) with Bangladeshi women (n=23) to study their daily struggles and concerns in public transportation. The qualitative findings informed the design of AVs to ensure greater mobility and enhanced safety in the Global South and other marginalized communities.
Brainstorming interfaces for unfamiliar technology like AVs can be challenging for non-designers. In this study, I built AV-Sketch, an in-situ (on-site) simulator that enables the creation of automotive interfaces while immersed in VR, allowing active participation in the design process. I conducted a participatory design study (n=15) using PICTIVE (Plastic Interface for Collaborative Technology), which led to the design of AV-Sketch. I further tested the tool in a design session (n=10) to assess users’ experiences in designing AV interfaces.
AV-Sketch enabled better contextualization of design ideas in real-world scenarios, with improved spatial considerations and dynamic aspects of in-vehicle human-machine interfaces (HMI).
[Paper] [Demo]
Despite widespread attention from academia, industry, and policymakers, Islamophobic posts are increasing online. There are significant advances in content moderation within HCI; however, social computing scholarship in this area remains constrained by Western interpretations of justice. This research aims to understand the issues of Islamophobia on social media and explores effective technological and policy solutions to address this problem.
In this work, we developed an online tool for reporting and moderating Islamophobic tweets, using HCI principles with an ML-based pre-analysis score that estimates the likelihood of Islamophobic posts. I led the user-centered study design and conducted usability studies, contextual inquiries, and interviews with 32 participants to assess the tool’s effectiveness in addressing Islamophobic content.
Academic Contributions:
[1] [TSC 2023] Combating Islamophobia: Compromise, Community, and Harmony in Mitigating Harmful Online Content
[2] [CHI 2022 Workshop] Detecting and Mitigating Islamophobic Posts Online
This research investigates the emerging domain of interaction between pedestrians and AVs to design accessible interfaces for vulnerable road users. This includes pedestrians with reduced mobility, like wheelchair users, and individuals with hearing impairments. My work has pioneered accessibility research on pedestrian safety in the automotive domain and is among the most highly cited in this area.
I conducted participatory design studies with interaction design experts (N=5) to explore potential interface ideas. Later, I performed iterative co-design sessions with wheelchair and hearing aid users to understand their unique perspectives and challenges in making crossing decisions as pedestrians. Based on the findings from the qualitative analysis, I developed VR prototypes (Unity, C#) simulating HMIs to establish a better communication medium between AVs and road users.
Academic Contributions:
[1] [CHI 2022 Workshop] Towards Designing Audio Interactions with Autonomous Vehicles: A Hearing-Enhanced Pedestrian Story
[2] [DIS 2021] Co-Designing Interactions between Pedestrians in Wheelchairs and Autonomous Vehicles [Video]
[3] [CHI 2020 LBW] Views from the wheelchair: Understanding interaction between autonomous vehicle and pedestrians with reduced mobility [Video]
This project introduces External Automotive Displays (EADs) to provide visualizations that can share context and user-specific information and offer opportunities for direct and mediated interaction between users and automobiles. I conducted a study with interaction designers to explore design opportunities on EADs. Based on the design study, I prototyped four EADs in virtual reality and presented a preliminary design critique of the prototypes.
Academic Contributions:
[1] [AutoUI 20]: Designing external automotive displays: VR prototypes and analysis