Embedded Files
#Human-Agent Interaction #AI-Mediated Communication
#Computer-Supported Cooperative Work (CSCW)
#Affective Computing
Hi, I'm Jieun.
I am currently a Ph.D. Candidate in Information Science at Cornell University, advised by Prof. Susan R. Fussell (Committee members: Prof. Mor Naaman, Prof. Malte F. Jung). I investigate how emerging media technologies, such as artificial intelligence, virtual reality, and voice synthesis, reshape the way people communicate, collaborate, and connect with others.
Before joining Cornell, I completed a master's degree in Interaction Science, with a focus on Behavioral Science and Human-AI Interaction, and two bachelor's degrees in Media Communication and Informatics at Sungkyunkwan University (SKKU) in Seoul. I have received the Cornell Media Studies Grant in 2023 and 2024, and previously interned at Microsoft Research in 2024.
RESEARCH INTEREST
My research envisions a future where emerging forms of virtual representation mediate human communication and collaboration. In the landscape of Human-Agent Interaction (HAI) and AI-Mediated Communication (AIMC), I explore how AI agents and virtual self-representations extend human presence and capabilities in digital environments, and how they introduce new opportunities and challenges in individual and interpersonal collaboration.
I employ empirical approaches and observe how users engage with these technologies using lab experiments, field studies, computational analyses, surveys, and interviews. Based on my expertise in media psychology, information science, and user experience design, I have led multidisciplinary teams of researchers and engineers to develop prototypes of novel interaction systems.
1. Human-Agent Collaboration
1. Human-Agent Collaboration
A central strand of my work investigates how humans perceive and interact with virtual agents. Virtual agents assist human tasks by acting as instructors and collaborators across domains. Beyond functional assistance, they can embody humanlike qualities, such as empathy, personality, and social behaviors, building interpersonal trust and bonds. Building on the Computers-Are-Social-Actors (CASA) paradigm (Nass & Reeves, 1996), my earlier research has demonstrated the interpersonal dynamics in human-agent interactions and their impact on users’ affective and cognitive responses.
LLM-Based Proxy Agent for Interpersonal Communication in Remote Collaboration
Kim, J. & Fussell, R. S. (2025)
Should Voice Agents Be Polite in an Emergency? Investigating Effects of Speech Style and Voice Tone in Emergency Simulation
Kim, J. & Fussell, R. S. (2025)
CHI'25 Proceeding Link
Million Eyes on the "Robot Umps": The Case for Studying Sports in HRI Through Baseball
Kamino et al. (2025)
HRI'25 Proceeding Link
Empathetic Pedagogical Agent: Mitigating Harmful Effects of Negative Feedback Through Self-Disclosure
Kim, J., Lee, K., Kim, W., Jeong, N., Kim, J., & Song, H. (2024)
International Journal of Human-Computer Interaction Link
Urgency Builds Trust: Emotional Expression of a Voice Agent in an Emergency Simulation
Kim, J., González-Pumariega, G., Park, S., & Fussell, S.R., (2023)
CSCW'23 Poster Link
Agreeableness of a Virtual Agent: Effects of Reciprocity and Need for Help
Kim, J., Sah, Y. J., & Song, H. (2021)
IMCOM'21 Proceeding Link
"I Can Feel Your Empathic Voice": Effects of Nonverbal Vocal Cues in Voice User Interface
Kim, J., Kim, W., Nam, J., & Song, H. (2020)
CHI'20 Extended Abstract Link
Collaborative Voice Agent for Blind and Low-Vision Users
Phutane, M., Kim, J., & Azenkot, S.
Using a co-designing method, this project aims to build a collaborative voice assistant that can help blind and low-vision (BLV) workers access web searches, create slides, and prepare presentations. A series of semi-structured interviews was conducted for both BLV people and their sighted companions.
Communication Accommodation in Human-Computer Interaction
Kim, J. & Fussell, S.R.
According to Communication Accommodation Theory (CAT), people aim to achieve communicative success through linguistic and behavioral adaptation to converge with the interactants. This project explored what makes the CAT in Human-Computer Interaction similar or different from the CAT in Human-Human Interaction.
Remote Teamwork: Moderating Online Group Discussion Using Voice Agents
Kim, J. & Fussell, S.R.
With the rise of remote collaboration tools, workplaces have become more interdisciplinary and multicultural, enabling individuals from different backgrounds to leverage their unique strengths and perspectives. As an attempt to build an inclusive and diverse teamwork environment, this study examines the design of an agent system that can effectively moderate group communications, particularly in an online setting.
2. Virtual Self-Representations
2. Virtual Self-Representations
Advances in media technologies allow users to transcend physical constraints and construct their idealized self-representation, creating a new form of interaction with extended selves. Users construct virtual identities by adjusting their visual and vocal representations in online environments. This selective process of self-presentation has a significant impact on how people perceive themselves and interact with others in mediated environments.
Best Version of My Voice: Strategic Voice Customization for Self-Presentation Across Online Speech Interactions
Kim, J., Tong, Y., & Fussell, S.R. (2025)
My Voice as a Daily Reminder: Self-Voice Alarm for Daily Goal Achievement
[Best Paper Honorable Mention 🎉]
Kim, J. & Song, H. (2024)
CHI'24 Proceeding Link
Using a Gender-Swapped Avatar in a VR Job Interview
Kim, J., Sandhaus, H., & Fussell, S.R., (2023)
CSCW'23 Poster Link
Effectiveness of VR Crane Training with Head-Mounted Display: Double Mediation of Presence and Perceived Usefulness
Song, H., Kim, T., Kim, J., Ahn, D., & Kang, Y. (2021)
Automation in Construction Link
Effects of VRET: Relationship between VR and Anxiety mediated by Presence
Jo, S., Lee, J., Lee, H., Song, H., & Kim, J.
This study explains the mechanism of Virtual Reality Exposure Therapy (VRET) where the VR simulation elicits anxiety through VR devices mediated by the feeling of presence. Participants aged 18-39 (N=115) experienced an anxiety-inducing video through either HMD-360 view, Phone-360 view, or Phone-fixed view. Both psychological (i.e., presence) and physiological (i.e. SC, Temp., RR, HR, EMG amp.) states were measured.
3. Online Social Behaviors
3. Online Social Behaviors
Online social behaviors are shaped by how people use social media and interact in digital communities, influencing information sharing, emotional well-being, and interpersonal dynamics. My prior work has investigated the role of message features in spreading misinformation, methods for detecting stressors through online expression, and approaches to identifying and mitigating harassment in community platforms. These studies reveal how digital environments mediate both individual experiences and broader social outcomes.
What Message Features Influence the Intention to Share Misinformation about COVID-19 on Social Media? The Role of Efficacy and Novelty
Song, H., So, J., Shim, M., Kim, J., Kim, A., Lee, K. (2023)
Computers in Human Behavior Link
Effect of audio content on simple and repetitive tasks requiring eyesight: Focus on task performance and emotional responses
Nam, J., Kim, E., Kim, J., Kim, J., Lee, D., Chung, W. (2023)
Information Development Link
Experiencing stress during COVID-19: A computational analysis of stressors and emotional responses to stress
Han, J., Song, H., Kang, J., Kim, J., & Kim, T. (2022)
Cyberpsych, Behavior, and Social Networking Link
Detecting Online Harassment on Reddit Comments
Gilbert, S., Kim, J., & Matias, J.N.
Online harassment remains prevalent despite the community's efforts. In this study, the moderating intervention on online comments on Reddit was tested. From the r/technology subreddit, 9000+ comments were collected and annotated to be classified as either abusive language, bigotry, or personal attack.
Page updated
Report abuse