My research seeks to understand the cognitive and neural mechanisms underlying human speech processing. Specifically, I am interested in 1) if and how resilient speech learning can be in the context of native and nonnative communication (e.g., talker change, native and nonnative accented speech); 2) the neural mechanisms that support such plasticity in rapid and long-term learning; 3) if and how being bilingual and/or multilingual may influence the learning process
Developing a Multi-scale Toolkit to Quantify Linguistic Experience
Macro-level, stable, community-level experience
Atlas-CH
Successful language comprehension requires listeners to rapidly adapt to linguistic variability, including accented speech. While a growing body of research suggests that long-term exposure to diverse linguistic input can facilitate such adaptation, characterizing the real-world experience remains a challenge. Traditional self-report measures are limited by recall bias and fail to capture incidental exposure. To address this limitation, we introduce a novel geolocation-based metric that quantifies local linguistic diversity using US Census data at the zip code level. Specifically, we use the proportion of nonnative English speakers as a proxy for environmental exposure to accented speech. We report an initial application of this method in a large-scale online perceptual study (N=647) of monolingual English speakers across the United States. Participants completed a cross-modal matching task designed to assess rapid adaptation to Chinese-accented English. Results show that our census-based metric predicted both subjective familiarity with the accent and perceptual adaptation during the first few moments of exposure. Crucially, adaptation was predicted by the prevalence of Chinese-accented speech in participants’ local environment, but not by the prevalence of other accents (e.g., Spanish), suggesting accent-dependent facilitation. This new geolocation-based approach provides a scalable, objective complement to self-reported measures, and is readily applicable even to populations where self-reporting proves infeasible or unreliable, such as older adults and clinical populations. It will enhance our understanding of how linguistic diversity in the environment shapes speech perception, adaptation, and learning.
Atlas-SP
Micro-level, dynamic, individualized experience
SNAP-heritage-Mandarin
Category-specific Adaptation to Nonnative Accents
Hearing Beyond Categories: General Adaptation to Nonnative Speech (in Proceedings of CogSci 2005)
Listeners demonstrate remarkable adaptability in speech perception, rapidly improving their recognition of non-native
accented speech after brief exposure. This study examines whether such adaptation reflects category-specific adjustments or a broader relaxation in processing unfamiliar accented categories. Using a pretest-exposure-posttest paradigm, we conducted two experiments to investigate how native English listeners’ perception of the Mandarin-accented /θ/-/s/ contrast changed as a function of accent exposure. We compared changes in lexical decision performance between participants exposed to Mandarin-accented audio sentences (Experiment 1) and those exposed to pure tones (Experiment 2). Results support the notion of general category relaxation, with both /θ/ and /s/ categories expanding from pretest to posttest.
Error Detection in Nonnative Speech
(* indicates presenting author)
Hsu, H., Gu, Y., Kaiser, E., & Xie, X. Does rapid adaptation affect error detection in nonnative-speech processing? Presented at the 8th California Meeting of Psycholinguistics. 2025. (Talk)
*Gu, Y., Cutler, S., *Xie, X., & Kurumada, C. The Accent Atlas: Effects of long-term exposure to nonnative accents on adaptive speech perception. Presented at the 4th International Max Plank Research School (IMPRS) for Language Sciences. 2024. (Poster)
Gu, Y., Cutler, S., *Xie, X., & Kurumada, C. The Accent Atlas: Effects of long-term exposure to nonnative accents on adaptive speech perception. Presented at the 186th Meeting of the Acoustical Society of America. Ottawa, Canada. 2024. (Poster)
Gu, Y., Cutler, S., Xie, X., & *Kurumada, C. Short- and long- term exposure to nonnative accents on adaptive speech perception. Presented at the 30th Architecture and Mechanisms for Language Processing (AMLaP). Edinburgh, Scotland. 2024. (Poster)
*Gu, Y., Xie, X., & Kurumada, C. Rapid speech adaptation under adverse listening conditions. Presented at the 64th Psychonomic Society's Annual Meeting. 2023. (Poster)
*Gu, Y., Xie, X., & Kurumada, C. Does speech adaptation generalize across adverse listening conditions? Presented at the 15th Annual Meeting of the Society for the Neurobiology of Language. 2023. (Poster)
*Gu, Y., Xie X., & Kurumada, C. Rapid speech adaptation under adverse listening conditions. Presented at the 5th California Meetings on Psycholinguistics. UCLA. 2022. (Poster)
*Gu, Y., Song Y., Kroll, J., & Scontras, G. Lexical entrainment in Mandarin-English bilinguals. Presented at the 7th Annual Florida Psycholinguistics Meeting. 2021. (Poster)