Research Interests: AI-Mediated-Communication; Human-Agent Interaction; Virtual Self; Digital Representation; Behavior Change; Teams and Collaboration; Future of Work
Hi, I'm Jieun.
I am currently a Ph.D. Candidate in Information Science at Cornell University, Ithaca. I completed a master's degree in Interaction Science, studying behavioral science and Human-AI Interaction, and two bachelor's degrees in Media Communication and Informatics at Sungkyunkwan University, Seoul.
I have received the Cornell Media Studies Grant in 2023 and 2024, and previously interned at Microsoft Research in the summer of 2024.
RESEARCH INTEREST
Jieun investigates how the strategic representation of human factors (e.g., emotions, personality, empathy, agency, and social identities) in virtual entities—virtual agents and virtual selves—can create meaningful interactions with users. She examines existing and emerging technologies that implement human-likeness (e.g., social robots, anthropomorphic agents) and self-similarity (e.g., digital twins, voice cloning) in virtual environments, focusing on how these representations shape psychological authenticity that influences user trust, engagement, and technology acceptance. Through extensive development of speech-based virtual agents and virtual clones in diverse platforms (e.g., video conferencing tools, smart speakers, VR, online games, and mobile applications), she explores how these virtual entities can facilitate individual and group tasks across domains, including healthcare, learning, and teamwork.
Should Voice Agents Be Polite in an Emergency? Investigating Effects of Speech Style and Voice Tone in Emergency Simulation
Kim, J. & Fussell, R. S. (2025)
CHI'25 Proceeding Link
Million Eyes on the "Robot Umps": The Case for Studying Sports in HRI Through Baseball
Kamino et al., (2025)
HRI'25 Proceeding Link
Empathetic Pedagogical Agent: Mitigating Harmful Effects of Negative Feedback Through Self-Disclosure
Kim, J., Lee, K., Kim, W., Jeong, N., Kim, J., & Song, H., (2024)
International Journal of Human-Computer
Interaction Link
My Voice as a Daily Reminder: Self-Voice Alarm for Daily Goal Achievement
[Best Paper 🎉 Honorable Mention]
Kim, J. & Song, H. (2024)
CHI'24 Proceeding Link
Urgency Builds Trust: Emotional Expression of a Voice Agent in an Emergency Simulation
Kim, J., González-Pumariega, G., Park, S., & Fussell, S.R., (2023)
CSCW'23 Poster Link
Using a Gender-Swapped Avatar in a VR Job Interview
Kim, J., Sandhaus, H., & Fussell, S.R., (2023)
CSCW'23 Poster Link
What Message Features Influence the Intention to Share Misinformation about COVID-19 on Social Media? The Role of Efficacy and Novelty
Song, H., So, J., Shim, M., Kim, J., Kim, A., Lee, K. (2023)
Computers in Human Behavior Link
Effect of audio content on simple and repetitive tasks requiring eyesight: Focus on task performance and emotional responses
Nam, J., Kim, E., Kim, J., Kim, J., Lee, D., Chung, W. (2023)
Information Development Link
Experiencing stress during COVID-19: A computational analysis of stressors and emotional responses to stress
Han, J., Song, H., Kang, J., Kim, J., & Kim, T. (2022)
Cyberpsych, Behavior, and Social Networking Link
Agreeableness of a Virtual Agent: Effects of Reciprocity and Need for Help
Kim, J., Sah, Y. J., & Song, H. (2021)
IMCOM'21 Proceeding Link
Effectiveness of VR Crane Training with Head-Mounted Display: Double Mediation of Presence and Perceived Usefulness
Song, H., Kim, T., Kim, J., Ahn, D., & Kang, Y. (2021)
Automation in Construction Link
"I Can Feel Your Empathic Voice": Effects of Nonverbal Vocal Cues in Voice User Interface
Kim, J., Kim, W., Nam, J., & Song, H. (2020)
CHI'20 Extended Abstract Link
Detecting Online Harassment on Reddit Comments
Gilbert, S., Kim, J., & Matias, J.N.
Online harassment remains prevalent despite the community's efforts. In this study, the moderating intervention on online comments on Reddit was tested. From the r/technology subreddit, 9000+ comments were collected and annotated to be classified as either abusive language, bigotry, or personal attack.
Remote Teamwork: Moderating Online Group Discussion Using Voice Agents
Kim, J. & Fussell, S.R.
With the rise of remote collaboration tools, workplaces become more interdisciplinary and multicultural, enabling individuals from different backgrounds to leverage their unique strengths and perspectives. As an attempt to build an inclusive and diverse teamwork environment, this study examines the design of an agent system that can effectively moderate group communications, particularly in an online setting.
Collaborative Voice Agent for Blind and Low-Vision Users
Phutane, M., Kim, J., & Azenkot, S.
Using a co-designing method, this project aims to build a collaborative voice assistant that can help blind and low-vision workers access web searches, create slides, and prepare presentations. A series of semi-structured interviews were conducted for both BLV people and their sighted companions. Based on the attained insights, a Wizard of Oz study was conducted to design a conversational agent that achieves collaborative accessibility.
Communication Accommodation in Human-Computer Interaction
Kim, J. & Fussell, S.R.
According to Communication accommodation theory (CAT), people aim to achieve communicative success through linguistic and behavioral adaptation to converge with the interactants. This project explored what makes the CAT in Human-Computer Interaction similar or different from the CAT in Human-Human Interaction.
Effects of VRET: Relationship between VR and Anxiety mediated by Presence
Jo, S., Lee, J., Lee, H., Song, H., & Kim, J.
This study explains the mechanism of Virtual Reality Exposure Therapy (VRET) where the VR simulation elicits anxiety through VR devices mediated by the feeling of presence. Participants aged 18-39 (N=115) experienced an anxiety-inducing video through either HMD-360 view, Phone-360 view, or Phone-fixed view. Both psychological (i.e., presence) and physiological (i.e. SC, Temp., RR, HR, EMG amp.) states were measured.