Scientific studies of human communication

Humans effortlessly share their immediate thoughts with other human minds, but it remains a mystery how. A common language certainly helps but we know that it is not necessary for communication, as we also understand tourists and infants who speak a different language or no language at all. In fact, research shows we can instantly build new ways to communicate if we need to, but how we achieve this extraordinary feat is largely an open question. Our understanding may be limited because the open-ended and interpersonal nature of human communication has been largely overlooked or simply out of reach of controlled scientific experiments. The below snapshots and suggested readings represent a selection of studies that have taken up this challenge. This list is not exhaustive but meant to provide a glimpse of the history and status quo of this inter-disciplinary research theme at the roots of human sociality. It includes seminal work in psychology indicating that human messages are best seen as shared conceptualizations of a message's use, governed by local principles of an interaction (Brennan & Clark, 1996; Garrod & Anderson, 1987). The list also includes recent neuroscientific and psychiatric studies on the emergence of those shared conceptualizations during (experimentally-controlled) social interaction. Together, that work is suggesting that people in dialogue understand one another because they continuously develop and coordinate a shared cognitive space that provides critical context for using and interpreting communicative messages (Stolk, Verhagen & Toni, 2016). Our international team aims to understand how this elusive knowledge space is generated in our brains, and how its representation is altered in disorders of human communication.

Autistic individuals struggle to rapidly converge on a shared meaning for an utterance when meaning requires referencing the shared communicative context

This study causally tested the notion of a shared cognitive space underlying human communication in pairs of individuals on the autism spectrum (Wadge et al., Cortex 2019). Despite otherwise indistinguishable performance from neurotypical pairs, pairs containing autistic individuals had lower communicative success. This communicative impairment was predicted by their ability to rapidly align on the meaning of an utterance with their communication partners. This misalignment was greatest when meaning depended on the unique communicative context established through past interaction with their partners.

Brains become synchronized due to the accumulation of shared representations at a scale independent from individual utterances

Using two scanners, this neuroimaging study found that brain areas tracking mutual understanding over a series of interactions become synchronized due to the accumulation of shared representations (Stolk et al., PNAS 2014). This interpersonal synchrony occurred only when the pairs developed new shared representations, and at a temporal scale independent from individual communicative utterances. This observation suggests that the meaning of an utterance is not a property of the utterance itself. Rather, people in dialogue understand one another because they continuously keep their thoughts aligned with one another, forming a shared cognitive space that provides critical context for selecting and interpreting utterances.

Communicators and addressees achieve mutual understanding by using the same computational procedures and neuronal substrates

Using magnetoencephalography, this study found that the same right-hemisphere brain regions in communicators and addressees are already upregulated before a communicative utterance is generated or interpreted during social interaction (Stolk et al., PNAS 2013).

Interpreting indirectness engages overlapping brain networks across overhearers and addressees

Using a fictional job interview setting in the scanner, this study found that interpreting indirect, non-literal answers from interviewees activated brain regions inside as well as outside the language-dominant left hemisphere, including the right hemisphere and medial prefrontal structures, both when those answers were directed to them or to other interviewers (Bašnáková et al., 2015).

Children who spent an increased number of days in daycare may benefit from a greater exposure to social and communicative situations

The style in which five-year-olds tried to communicate changed depending on who the children thought their co-player was. When they thought they were playing with a two-year-old, they spent a great deal of time trying to patiently convey relevant game information. When they were told they were playing with a child their own age, their communication style was not as labored. The more days children spent in daycare, the more they adjusted their communication style, suggesting an important role for early social experience in the development of our interactional abilities (Stolk et al., PLoS One 2013).

Language processing depends on local principles of interaction

This study had pairs of adults describe locations within a predefined spatial network to help each other reach target locations. They could talk back and forth as much as they needed. The main findings are that, in referring to locations, different pairs converge on different descriptions for the same location. However, within the same pair, speakers adopt very similar forms of descriptions, a processed dubbed lexical entrainment. This entrainment is progressive, increasing as the dialogue proceeds, suggesting that dialogue partners coordinate to achieve a singl mutually satisfactory type of description (Garrod & Anderson, Cognition 1987).

Referring as a collaborative process between speakers and listeners

This study had pairs of adults describe figures based on the ancient Chinese game of Tangram in order to achieve a target arrangement of those figures. They could talk back and forth as much as they needed. The study found that when speakers refer to an object, they are proposing a conceptualization of it, a proposal their addressees may or may not agree to. Once they do establish a shared conceptualization, dubbed a conceptual pact, they appeal to it in later references even when they could use simpler references. Over time, speakers simplify conceptual pacts and, when necessary, abandon them for new conceptualizations (Clark & Wilkes-Gibbs, Cognition 1986).

Communicative proficiency improves from kindergarten age onward

This study had pairs of children in kindergarten, 1st, 3rd and 5th grades play a communication game which required they develop names to refer to unique graphic figures, portrayed on a wooden block with a hole in it. They would receiver these blocks one at a time from a dispenser. Then they described the figure to the listener, someone their own age, who then needed to infer and select the intended figure and block. After each description, both players stacked their blocks on a peg, and after each round the pegs were compared for overlap. Unlike older children, kindergartners did not improve their communication across interactions with the same partner, suggesting that age 5 represents a critical milestone in the development of our interactional abilities (Krauss & Glucksberg, Child Development 1969).

Suggested readings

  • Stolk A, Basnakova J, Toni I (202o). Joint epistemic engineering: The neglected process of context construction in human communication. PsyArXiv

  • Toni I, Stolk A (2019). Conceptual alignment as a neurocognitive mechanism for human communicative interactions. in Human Language: from Genes and Brains to Behavior, MIT Press

  • Wheatley T, Boncz A, Toni I, Stolk A (2019). Beyond the isolated brain: The promise and challenge of interacting minds. Neuron 103 (2), 186-188

  • Wadge H, Brewer R, Bird G, Toni I, Stolk A (2019). Communicative misalignment in Autism Spectrum Disorder. Cortex 115, 15-26

  • Kuhlen AK, Bogler C, Brennan SE, Haynes JD (2017). Brains in dialogue: decoding neural preparation of speaking to a conversational partner. Social Cognitive and Affective Neuroscience, 871–880

  • de Boer M, Kokal I, Blokpoel M, Liu R, Stolk A, Roelofs K, van Rooij I, Toni I (2017). Oxytocin modulates human communication by enhancing cognitive exploration. Psychoneuroendocrinology

  • Oosterwijk AM, de Boer M, Stolk A, Hartmann F, Toni I, Verhagen L (2017). Communicative knowledge pervasively influences sensorimotor computations. Scientific Reports

  • Ye Z, Stolk A, Toni I, Hagoort P (2016). Oxytocin modulates semantic integration in speech comprehension. J Cogn Neurosci

  • Stolk A, Verhagen L, Toni I (2016). Conceptual alignment: How brains achieve mutual understanding. Trends in Cognitive Sciences 20 (3), 180-191

  • Stolk A, Blokpoel M, van Rooij I, Toni I (2015). On the generation of shared symbols. in Cognitive Neuroscience of Natural Language Use, Cambridge University Press

  • Stolk A, D'Imperio D, di Pellegrino G, Toni I (2015). Altered communicative decisions following ventromedial prefrontal lesions. Current Biology 25 (11), 1469-1474

  • Basnakova J, van Berkum J, Weber K, Hagoort P (2015). A job interview in the MRI scanner: How does indirectness affect addressees and overhearers? Neuropsychologia 76, 79-91

  • Stolk A, Noordzij ML, Verhagen L, Volman I, Schoffelen J-M, Oostenveld R, Hagoort P, Toni I (2014). Cerebral coherence between communicators marks the emergence of meaning. Proceedings of the National Academy of Sciences 111 (51), 18183-18188

  • Stolk A (2014). In sync: Metaphor, mechanism or marker of mutual understanding? Journal of Neuroscience 34 (16), 5397-5398

  • Stolk A, Noordzij ML, Volman I, Verhagen L, Overeem S, van Elswijk G, Bloem B, Hagoort P, Toni I (2014). Understanding communicative actions: A repetitive TMS study. Cortex 51, 25-34

  • Basnakova J, Weber K, Petersson KP, van Berkum, Hagoort P (2014). Beyond the language given: The neural correlates of inferring speaker meaning. Cerebral Cortex, 24(10), 2572–2578

  • Stolk A, Verhagen L, Schoffelen J-M, Oostenveld R, Blokpoel M, Hagoort P, van Rooij I, Toni I (2013). Neural mechanisms of communicative innovation. Proceedings of the National Academy of Sciences 110 (36), 14574-14579

  • Stolk A, Hunnius S, Bekkering H, Toni I (2013). Early social experience predicts referential communicative adjustments in five-year-old children. PLoS One 8 (8), e72667

  • Blokpoel M, van Kesteren M, Stolk A, Haselager P, Toni I, van Rooij I (2012). Recipient design in human communication: simple heuristics or perspective taking? Frontiers in Human Neuroscience 6, 253

  • Galantucci B, Garrod S (2011). Experimental semiotics: a review. Frontiers in Human Neuroscience 5, 11

  • Brennan SE, Galati A, Kuhlen AK (2010). Two minds, one dialog: coordinating speaking and understanding. Psychol. Learn. Motiv. 53, 301–344

  • Willems RM, de Boer M, de Ruiter JP, Noordzij ML, Hagoort P, Toni I (2010). A dissociation between linguistic and communicative abilities in the human brain. Psychol. Sci. 21, 8–14

  • Noordzij ML, Newman-Norlund SE, de Ruiter JP, Hagoort P, Levinson SC, Toni I (2010). Neural correlates of intentional communication. Frontiers in Neuroscience 4, 188

  • Willems RM, Varley RA (2010). Neural insights into the relation between language and communication. Frontiers in Human Neuroscience 4, 203

  • de Ruiter JP, Noordzij ML, Newman-Norlund S, Newman-Norlund R, Hagoort P, Levinson SC, Toni I (2010). Exploring the cognitive infrastructure of communication. Interact Stud 11, 51–77

  • Hrdy SB (2009). Mothers and Others: The Evolutionary Origins of Mutual Understanding, Harvard University Press

  • Tomasello M (2008). Origins of Human Communication, MIT Press

  • Levinson SC (2006). On the human interactional engine. in Roots of Human Sociality (Enfield, N. and Levinson, S., eds),39–69, Berg

  • Carpendale JI, Lewis C (2004). Constructing an understanding of mind: the development of children's social understanding within social interaction. Behav. Brain Sci. 27, 79–96

  • Clark HH (1996). Using Language, Cambridge University Press

  • Brennan SE, Clark HH (1996). Conceptual pacts and lexical choice in conversation. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(6), 1482–1493

  • Garrod S, Anderson A (1987). Saying what you mean in dialogue: A study in conceptual and semantic co-ordination. Cognition, 27(2), 181–218

  • Clark HH, Wilkes-Gibbs D (1986). Referring as a collaborative process. Cognition 22, 1-39

  • Krauss RM, Gluckberg S (1969). The development of communicaion: competence as a function of age. Child Development, 40(1), 255-266