Accepted CHI Papers and Talk Abstracts

Paper presenters have 15 minutes for each presentation. Please upload your slide deck to the folder that was shared with you via email.

Morals, Ethics, and Critiquing the Humanity in HCI

Sevenfold Paths: HCI Journeys through Dystopian Sins and Utopian Virtues

Eszter Vigh, Ellen Weir, Joseph Howard, Anne Roudaut 

This paper explores the moral dynamics of HCI through a dual narrative centred on the Seven Deadly Sins and Seven Capital Virtues. Examining the dark side, we scrutinise how lust, gluttony, greed, sloth, wrath, envy, and pride infiltrate innovative technology and HCI, exploiting human vulnerabilities. In contrast, we explore the utopian potential, highlighting instances where chastity, temperance, charity, diligence, patience, kindness, and humility guide virtuous design, contributing to a harmonious technological landscape. This dual storytelling strategy unveils the extremes within our contemporary society, emphasising the moral dimensions of technology. This paper aims to dissect this connection, shedding light on the intricate interplay between human nature and the omnipresent digital realm; ultimately aiming to foster conscientious and user-centric technology development. 

Data Ethics Emergency Drill: A Toolbox for Discussing Responsible AI for Industry Teams

Vanessa Aisyahsari Hanschke, Dylan Rees, Merve Alanyali, David Hopkinson, Paul Marshall


Researchers urge technology practitioners such as data scientists to consider the impacts and ethical implications of algorithmic decisions. However, unlike programming, statistics, and data management, discussion of ethical implications is rarely included in standard data science training. To begin to address this gap, we designed and tested a toolbox called the data ethics emergency drill (DEED) to help data science teams discuss and reflect on the ethical implications of their work. The DEED is a roleplay of a fictional ethical emergency scenario that is contextually situated in the team’s specific workplace and applications. This paper outlines the DEED toolbox and describes three studies carried out with two different data science teams that iteratively shaped its design. Our findings show that practitioners can apply lessons learnt from the roleplay to real-life situations, and how the DEED opened up conversations around ethics and values. 

Integrating Communications and Surveillance Technologies for Effective Community Policing in Nigeria

Obinna Ogbonnia Otuu 

My research investigates how technologically enhanced community policing (CP) approach can curb crime and insecurity in Nigeria, by efficiently integrating communications and surveillance systems. In order to achieve this, I have conducted a narrative literature review to understand the current state of community policing in Nigeria, and two systematic literature reviews; firstly to comprehensively understand trust and relationship issues between Nigerian police and the citizens, and secondly to identify technologies used in community policing since inception and how each has fared, as to gain better design insight and direction. Also, I have conducted a survey and interview with 1200 and 18 Nigerian citizens respectively, and a separate interview with 6 Nigerian police commissioners representing the 6 geopolitical zones of the country, through which I gathered relevant data as regards the use of technologies in Nigeria to reduce crime and insecurity. The outcome of the survey and interviews informed a design of a novel body-worn device, integrated with a mobile application for real-time information dissemination. My research findings will produce a tool that will improve community policing in Nigeria and lower insecurity and crime rates therein. 

Navigating Afrocentric Human-Computer Interaction Research: A Scoping Review and Proposition of Afro-Postmodernism for Decolonial Praxis  

Oritstetimeyin Arueyingho, Helena Webb, Damiete Lawrence  


Ongoing Human-Computer Interaction (HCI) studies in Africa have revealed the prevalence of colonial influences in current research and design practices. These colonial influences have given rise to racism and discriminatory practices in research, consequently affecting study outcomes and design implications. Responding to this, Afrocentricity which values critical thinking, cultural representation and inclusivity of African heritage has been explored. Its exclusive use, however, could increase the risk of essentialism and exclude Africans without indigenous cultural experiences. Using a keyword-based approach targeting HCI research publications, this scoping review examines 16 empirical HCI publications from 2013 to 2023. By assessing the impact of Afrocentricity on research and design practices, we identify ambiguities in the positionalities of researchers and its role in study design. To address these issues, we propose a deconstructive Afro-postmodernism framework

Stochastic Machine Witnesses at Work: Today's Critiques of Taylorism are Inadequate for Workplace Surveillance Epistemologies of the Future 

Sandy J J Gould 

I argue that epistemologies of workplace surveillance are shifting in fundamental ways, and so critiques must shift accordingly. I begin the paper by relating Scientific Management to Human-Centred Computing's ways of knowing through a study of 'metaverse' virtual reality workplaces. From this, I develop two observations. The first is that today's workplace measurement science does not resemble the science that Taylor developed for Scientific Management. Contemporary workplace science is more passive, more intermediated and less controlled. The second observation is that new forms of workplace measurement challenge the norms of empirical science. Instead of having credentialed human witnesses observe phenomena and agree facts about them, we instead make outsourced, uncredentialed stochastic machine witnesses responsible for producing facts about work. With these observations in mind, I assert that critiques of workplace surveillance still framed by Taylorism will not be fit for interrogating workplace surveillance practices of the future. 

Different Ways of Interacting

Understanding Neurodiverse Social Play Between Autistic and Non-Autistic Children 

Brooke Morris, Hayati Havlucu, Alison Oldfield, Oussama Metatla 

Social play supports children to develop essential life skills and foster friendships. However, autistic and non-autistic children often do not have equal opportunities to engage in social play. Previous research to improve these opportunities tends to invoke social skill interventions solely for autistic children or is focused on designing for only one group, rather than considering the interactions or needs of all children in neurodiverse groups1. In order to understand the different experiences of children during social play, we conducted interviews with 6 professionals who support neurodiverse social play and undertook observation sessions of 36 autistic and non-autistic children during unstructured social play. Our findings move beyond the existing characterizations of autistic social play and build upon the double empathy problem to capture and consider the needs of all children in neurodiverse playgroups. We argue these findings could be used to inform future neurodiverse social play technology design in HCI. 

Squishy, Yet Satisfying: Exploring Deformable Shapes' Cross-Modal Correspondences with Colours and Emotions 

Cameron Steer, Kim Sauvé, Anika Jain, Omosunmisola Lawal, Michael J Proulx, Crescent Jicol and Jason Alexander 

Surfaces with deformable and shape-changing properties seek to enhance and diversify tangible interactions with computing systems. However, we currently lack fundamental knowledge and user interface design principles that connect the inherent properties of deformable shapes with our human senses and cognitive associations. To address this knowledge gap, we systematically explored deformable shapes' cross-modal correspondences (CC) with colours and emotions. In our CC study, 52 participants were presented with deformable shape stimuli that varied in stiffness and angularity. They were asked to associate these stimuli with colours and emotions under (i) visuo-tactile and; (ii) tactile-only conditions. For the first time, our findings reveal (1) how stiffness level primarily influences the CC associations and; (2) that stiffness and angularity play a significant role in CC associations over the visibility of the shapes. The results were distilled into design guidelines for future deformable, shape-changing interfaces that engage specific human senses and responses. 

Watch this! Observational Learning in VR Promotes Better Far Transfer than Active Learning for a Fine Psychomotor Task   

Isabel Sophie Fitton, Elizabeth Dark, Manoela Milena Oliveira da Silva, Jeremy Dalton, Michael J Proulx, Christopher Clarke, Christof Lutteroth  


Virtual Reality (VR) holds great potential for psychomotor training, with existing applications using almost exclusively a `learning-by-doing' active learning approach, despite the possible benefits of incorporating observational learning. We compared active learning (n=26) with different variations of observational learning in VR for a manual assembly task. For observational learning, we considered three levels of visual similarity between the demonstrator avatar and the user, dissimilar (n=25), minimally similar (n=26), or a self-avatar (n=25), as similarity has been shown to improve learning. Our results suggest observational learning can be effective in VR when combined with `hands-on' practice and can lead to better far skill transfer to real-world contexts that differ from the training context. Furthermore, we found self-similarity in observational learning can be counterproductive when focusing on a manual task, and skills decay quickly without further training. We discuss these findings and derive design recommendations for future VR training. 

Fabulous Fabricating  

DisplayFab: The State of the Art and a Roadmap in the Personal Fabrication of Free-Form Displays Using Active Materials and Additive Manufacturing. 

Ollie Hanton, Mike Fraser, Anne Roudaut

Over recent years, there has been significant research within HCI towards free-form physical interactive devices. However, such devices are not straightforward to design, produce and deploy on demand. Traditional development revolves around iterative prototyping through component-based assembly, limiting device structure and implementation. Material-centric personal display fabrication (DisplayFab) opens the possibility of decentralised, configurable production by low-skill makers. Currently, DisplayFab is severely limited by its embryonic stage of development, the complexity of involved processes and materials, and the challenges around designing interactive structures. We present a development framework to provide a path for future research. DisplayFab has been developed by identifying 4 key breakpoints in the existing “Personal Fabrication” framework: Material and Deposition, Conception and Software, Feedback and Interactivity and Responsible Innovation. We use these breakpoints to form a targeted literature review of relevant work. Doing this we identify 30 challenges that act as roadmap for future research in DisplayFab. 

StableLev: Data-Driven Stability Enhancement for Multi-Particle Acoustic Levitation 

Lei Gao, Giorgos Christopoulos, Prateek Mittal, Ryuji Hirayama, Sriram Subramanian 

Acoustic levitation is an emerging technique that has found application in contactless assembly and dynamic displays. It uses precise phase control in an ultrasound transducer array to manage the positions and movements of multiple particles. Yet, maintaining stable mid-air particles is challenging, with unexpected drops disrupting the intended motion and position. Here, we present StableLev, a data-driven pipeline for the detection and amendment of instabilities in multi-particle levitation. We first curate a hybrid levitation dataset, blending optimized simulations with labels based on actual trajectory outcomes. We then design an AutoEncoder to detect anomalies in the simulated data, correlating closely with observed particle drops. Finally, we reconstruct the acoustic field at anomaly regions to improve particle stability and experimentally demonstrate successful dynamic levitation for trajectories within our dataset. Our work provides new insights into multi-particle levitation and enhances its robustness, which will be valuable in a wide range of applications. 

FabSound: Audio-Tactile and Affective Fabric Experiences Through Mid-air Haptics 

Jing Xue, Roberto Montano-Murillo, Christopher Dawes, William Frier, Patricia Cornelio, Marianna Obrist

The sound produced when touching fabrics, like a blanket, often provides information regarding the fabric’s texture properties (e.g., its roughness). Fabric roughness is one of the most important aspects of assessing fabric tactile properties. Prior research has demonstrated that touch-related sounds can alter the perception of textures. However, understanding touch-related sound of digital fabric textures, and how they could convey affective responses remain a challenge. In this study, we mapped digital fabric textures using mid-air haptics stimuli and examined how auditory manipulation influences people’s roughness perception. Through qualitative interviews, participants detailed that while rubbing sounds smoothen fabric texture perception, pure tone sounds of 450Hz and 900Hz accent roughness perception. The rubbing sound of fabric evoked associations with soft-materials and led to more calming experiences. In addition, we discussed how haptic interaction can be extended to multisensory modes, revealing a new perspective of mapping multisensory experiences for digital fabrics.  

Controlled-STM: A two-stage model to predict user’s Perceived Intensity for Multi-point Spatiotemporal Modulation in Ultrasonic Mid-air Haptics 

Zhouyang Shen, Zak Morgan, Madhan Kumar Vasudevan, Marianna Obrist, Diego Martinez Plasencia 

Multi-point STM offers a great range of parameters (i.e., drawing frequency, number of points) to produce different tactile sensations. However, existing studies offer limited insight on the effects of these parameters, and ignore their effect on the physical stimuli delivered, limiting effective haptic design. We propose a two-stage model to predict response to multi-point STM. The first stage predicts physical stimulus properties with 7.8\% error, while the second stage predicts mean and spread of perceived intensity with 8.0\% and 8.8\% error. We report 3 studies conducted to derive this model: one to characterize physical stimuli, another one measuring user perceptual thresholds, and a third one measuring user’s perceptual response to multi-point STM. Besides, we characterize 4 effects that influence device performance, confirm if previous effects reported are due to physical or perceptual effects (or both) and derive recommendations for manufacturers, haptic designers and HCI researchers. 

Body Bytes

“Is it Even Giving the Correct Reading or Not?”: How Trust and Relationships Mediate Blood Pressure Management in India 

Nimisha Karnatak, Brooke Loughrin, Tiffany Amy Kuo, Odeline Mateu-Silvernail, Indrani Medhi Thies, William Thies, and Mohit Jain

While chronic disease afflicts a large Indian population, the technologies used to manage chronic diseases have largely been informed by studies conducted in other sociocultural contexts. To address this gap, we conducted qualitative interviews with 21 patients clinically diagnosed with abnormal blood pressure (BP) living in low-resourced communities of Haryana, Uttarakhand and Uttar Pradesh in India. We found that patients’ trust in the BP ecosystem and social ties plays a significant role in shaping their perceptions of technology and chronic care. Trust in one actor of the ecosystem fosters trust in another, e.g., trust in BP reading depended on the type of device and the person measuring the BP. We also observed nuanced sharing and intermediation of BP devices. Based on our findings, we recommend designs to boost patients’ trust, familiarity, and access to technologies used in BP management and improve their experience of care in low-resource settings in India. 

Sweating the Details: Emotion Recognition and the Influence of Physical Exertion in Virtual Reality Exergaming  

Dominic Potts, Zoe Broad, Tarini Sehgal, Joseph Hartley, Eamonn O 'Neill, Crescent Jicol, Christopher Clarke, Christof Lutteroth 

There is great potential for adapting Virtual Reality (VR) exergames based on a user's affective state. However, physical activity and VR interfere with physiological sensors, making affect recognition challenging. We conducted a study (n=72) in which users experienced four emotion inducing VR exergaming environments (happiness, sadness, stress and calmness) at three different levels of exertion (low, medium, high). We collected physiological measures through pupillometry, electrodermal activity, heart rate, and facial tracking, as well as subjective affect ratings. Our validated virtual environments, data, and analyses are openly available. We found that the level of exertion influences the way affect can be recognised, as well as affect itself. Furthermore, our results highlight the importance of data cleaning to account for environmental and interpersonal factors interfering with physiological measures. The results shed light on the relationships between physiological measures and affective states and inform design choices about sensors and data cleaning approaches for affective VR.  

“I think it saved me. I think it saved my heart”: The Complex Journey From Self-Tracking With Wearables To Diagnosis   

Rachel Keys, Paul Marshall, Aisling O'Kane, Graham Stuart   


Despite their nonclinical origins, wearables are emerging as valuable tools in supporting the diagnosis of cardiovascular disease, one of the leading causes of death worldwide. Diagnostic data once only available via a cardiologist is now available to consumers simply by wearing a smartwatch, so understanding how smartwatches currently support diagnosis is important for healthcare providers and for the designers of increasingly sophisticated personal informatics technology. We conducted a qualitative study comprising interviews and analysis of posts on an online community of accounts of smartwatch assisted cardiac diagnosis. Our findings reveal how smartwatches bridge a current gap in clinical diagnostic modalities, facilitating a diagnostic journey instigated and shaped by the interplay of self-collected data, bodily self-awareness, and increasing clinical acceptance. These insights focus attention on the consequences of the democratisation of health data, with ethical and design implications for health providers, consumer electronic companies, and third-party application designers.

Using and Appropriating Technology to Support The Menopause Journey in the UK    

Emily Lopez Burst, Marianela Ciolfi Felice, Aisling Ann O’Kane  


The menopause transition has a direct impact on half of the global population, yet it has continued to be a stigmatised topic with limited focus on supporting it with technology. Whilst attention being given to menopause in HCI may be new, people experiencing it is not and people have adopted, adapted and appropriated technologies to support their menopause journey. In this questionnaire and interview study, we examine how people in the UK are using (and not using) existing general and menopause-specific technology to support themselves through the transition. Despite limited menopause-specific technologies available, participants have found novel uses of technologies such as social media and smartwatches for 1) connecting and sharing, 2) information seeking, 3) tracking and reflecting, and 4) self-care. This work contributes design considerations for menopause specific technologies, and design opportunities and challenges for technologies that can be appropriated to support menopause. 

Notes for Presenters