Neural mechanisms of communicative innovation

Synchrony Across Brains

Second-person neuroscience focuses on studying the behavioral and neuronal mechanisms of real-time social interactions within single and across interacting brains. In this review article, we describe the developments that have been undertaken to study socially interactive phenomena and the behavioral and neurobiological processes that extend across interaction partners. More specifically, we focus on the role that synchrony across brains plays in enabling and facilitating social interaction and communication and in shaping social coordination and learning, and we consider how reduced synchrony across brains may constitute a core feature of psychopathology.

Preserved Spontaneous Mentalizing Amid Reduced Intersubject Variability in Autism During a Movie Narrative

BACKGROUND

While individuals with autism often face challenges in everyday social interactions, they may demonstrate proficiency in structured theory of mind (ToM) tasks that assess their ability to infer others' mental states. Using functional magnetic resonance imaging and pupillometry, we investigated whether these discrepancies stem from diminished spontaneous mentalizing or broader difficulties in unstructured contexts.

METHODS

Fifty-two adults diagnosed with autism and 52 neurotypical control participants viewed the animated short Partly Cloudy, a nonverbal animated film with a dynamic social narrative known to engage the ToM brain network during specific scenes. Analysis focused on comparing brain and pupil responses to these ToM events. Additionally, dynamic intersubject correlations were used to explore the variability of these responses throughout the film.

RESULTS

Both groups showed similar brain and pupil responses to ToM events and provided comparable descriptions of the characters' mental states. However, participants with autism exhibited significantly stronger correlations in their responses across the film's social narrative, indicating reduced interindividual variability. This distinct pattern emerged well before any ToM events and involved brain regions beyond the ToM network.

CONCLUSIONS

Our findings provide functional evidence of spontaneous mentalizing in autism, demonstrating this capacity in a context that affords but does not require mentalizing. Rather than responses to ToM events, a novel neurocognitive signature-interindividual variability in brain and pupil responses to evolving social narratives-differentiated neurotypical individuals from individuals with autism. These results suggest that idiosyncratic narrative processing in unstructured settings, a common element of everyday social interactions, may offer a more sensitive scenario for understanding the autistic mind.

Brain-to-brain coupling forecasts future joint action outcomes

In this study, we investigated whether brain-to-brain coupling patterns could predict performance in a time-estimation task that requires two players to cooperate. The participant pairs were tasked with synchronizing button presses after converging on a shared representation of "short," "medium," and "long" time intervals while utilizing feedback to adjust responses. We employed electroencephalogram (EEG)-hyperscanning and focused on post-feedback brain activity. We found that negative feedback led to increased frontal mid-line theta activity across individuals. Moreover, a correlation in post-feedback theta power between players forecasted failed joint action, while an anti-correlation forecasted success. These findings suggest that temporally coupled feedback-related brain activity between two individuals serves as an indicator of redundancy in adjustment of a common goal representation. Additionally, the anti-correlation of this activity reflects cognitive strategic mechanisms that ensure optimal joint action outcomes. Rather than a paired overcompensation, successful cooperation requires flexible strategic agility from both partners.

Integrating stereotypes and factual evidence in interpersonal communication

Stereotypes can exert a powerful influence on our interactions with others, potentially leading to prejudice when factual evidence is ignored. Here, we identify neuroanatomical and developmental factors that influence the real-time integration of stereotypes and factual evidence during live social interactions. The study uses precisely quantified communicative exchanges in a longitudinal cohort of seventeen-year-olds followed since infancy, testing their ability to moderate stereotype tendencies toward children as contrary evidence accumulates. Our results indicate that the impact of stereotypes on communicative behavior is linked to individual variations in gray matter density and cortical thickness in the right anterior cingulate gyrus. In contrast, the ability to moderate stereotype tendencies is influenced by developmental exposure to social interactions during the initial years of life, beyond the effects of familial environment and later experiences. These findings pinpoint a key brain structure underlying stereotype tendencies and suggest that early-life social experiences have lasting consequences on how individuals integrate factual evidence in interpersonal communication.

The Emerging Science of Interacting Minds

For over a century, psychology has focused on uncovering mental processes of a single individual. However, humans rarely navigate the world in isolation. The most important determinants of successful development, mental health, and our individual traits and preferences arise from interacting with other individuals. Social interaction underpins who we are, how we think, and how we behave. Here we discuss the key methodological challenges that have limited progress in establishing a robust science of how minds interact and the new tools that are beginning to overcome these challenges. A deep understanding of the human mind requires studying the context within which it originates and exists: social interaction.

Conversational production and comprehension: fMRI-evidence reminiscent of but deviant from the classical Broca-Wernicke model

A key question in research on the neurobiology of language is to which extent the language production and comprehension systems share neural infrastructure, but this question has not been addressed in the context of conversation. We utilized a public fMRI dataset where 24 participants engaged in unscripted conversations with a confederate outside the scanner, via an audio-video link. We provide evidence indicating that the two systems share neural infrastructure in the left-lateralized perisylvian language network, but diverge regarding the level of activation in regions within the network. Activity in the left inferior frontal gyrus was stronger in production compared to comprehension, while comprehension showed stronger recruitment of the left anterior middle temporal gyrus and superior temporal sulcus, compared to production. Although our results are reminiscent of the classical Broca-Wernicke model, the anterior (rather than posterior) temporal activation is a notable difference from that model. This is one of the findings that may be a consequence of the conversational setting, another being that conversational production activated what we interpret as higher-level socio-pragmatic processes. In conclusion, we present evidence for partial overlap and functional asymmetry of the neural infrastructure of production and comprehension, in the above-mentioned frontal vs temporal regions during conversation.

Interpersonal alignment of neural evidence accumulation to social exchange of confidence

Private, subjective beliefs about uncertainty have been found to have idiosyncratic computational and neural substrates yet, humans share such beliefs seamlessly and cooperate successfully. Bringing together decision making under uncertainty and interpersonal alignment in communication, in a discovery plus pre-registered replication design, we examined the neuro-computational basis of the relationship between privately held and socially shared uncertainty. Examining confidence-speed-accuracy trade-off in uncertainty-ridden perceptual decisions under social vs isolated context, we found that shared (i.e. reported confidence) and subjective (inferred from pupillometry) uncertainty dynamically followed social information. An attractor neural network model incorporating social information as top-down additive input captured the observed behavior and demonstrated the emergence of social alignment in virtual dyadic simulations. Electroencephalography showed that social exchange of confidence modulated the neural signature of perceptual evidence accumulation in the central parietal cortex. Our findings offer a neural population model for interpersonal alignment of shared beliefs.

Interpersonal neural synchronization underlies mnemonic similarity during collaborative remembering

Although collaborative remembering is a ubiquitous feature of human beings, its underlying neurocognitive process is not well understood. Here we hypothesized that interpersonal neural synchronization (INS) might underlie collaborative remembering, while real collaboration as opposed to other modes of offline collaboration should enhance INS and facilitate mnemonic similarity. To test these hypotheses, brain activity was measured simultaneously from two individuals who performed a group-based selective retrieval practice task either in a real collaboration or in a pseudo-collaboration, i.e., an individual performed the task together with a pre-recorded audio. The results showed that the memory of two individuals converged to a greater level than the chance level in real collaboration but not in control condition. Moreover, collaborative remembering was associated with significant INS increase in the prefrontal cortex (PFC) relative to the baseline in the real collaboration only. Additionally, INS increase was significantly greater in the real collaboration than in control condition. Finally, the PFC's INS increase was positively correlated with and could accurately predict the level of mnemonic similarity in real collaboration. These findings support the hypothesis that the enhanced INS underlies the cognitive process of collaborative remembering.

Neural synchrony underlies the positive effect of shared reading on children's language ability

Although it is well recognized that parent-child shared reading produces positive effects on children's language ability, the underlying neurocognitive mechanisms are not well understood. Here, we addressed this issue by measuring brain activities from mother-child dyads simultaneously during a shared book reading task using functional near infrared spectroscopy hyperscanning. The behavioral results showed that the long-term experience of shared reading significantly predicted children's language ability. Interestingly, the prediction was moderated by children's age: for older children over 30 months, the more the shared reading experience, the better the language performance; for younger children below 30 months, however, no significant relationship was observed. The brain results showed significant interpersonal neural synchronization between mothers and children at the superior temporal cortex, which was closely associated with older children's language ability through the mediation of long-term experience of shared reading. Finally, the results showed that the instantaneous quality of shared reading contributed to children's language ability through enhancing interpersonal neural synchronization and increasing long-term experience. Based on these findings, we tentatively proposed a theoretical model for the relationship among interpersonal neural synchronization, shared reading and children's language ability. These findings will facilitate our understanding on the role of shared reading in children's language development.

Shared intentionality modulates interpersonal neural synchronization at the establishment of communication system

Whether and how shared intentionality (SI) influences the establishment of a novel interpersonal communication system is poorly understood. To investigate this issue, we designed a coordinating symbolic communication game (CSCG) and applied behavioral, functional near-infrared spectroscopy (fNIRS)-based hyperscanning, and hyper-transcranial alternating current stimulation (hyper-tACS) methods. Here we show that SI is a strong contributor to communicative accuracy. Moreover, SI, communicative accuracy, and interpersonal neural synchronization (INS) in the right superior temporal gyrus (rSTG) are higher when dyads successfully establish a novel communication system. Furthermore, the SI influences communicative accuracy by increasing INS. Additionally, using time series and long short-term memory neural network analyses, we find that the INS can predict communicative accuracy at the early formation stage of the communication system. Importantly, the INS partially mediates the relationship between the SI and the communicative accuracy only at the formation stage of the communication system. In contrast, when the communication system is established, SI and INS no longer contribute to communicative accuracy. Finally, the hyper-tACS experiment confirms that INS has a causal effect on communicative accuracy. These findings suggest a behavioral and neural mechanism, subserved by the SI and INS, that underlies the establishment of a novel interpersonal communication system.

Speaking and listening to inter-brain relationships

Studies of inter-brain relationships thrive, and yet many reservations regarding their scope and interpretation of these phenomena have been raised by the scientific community. It is thus essential to establish common ground on methodological and conceptual definitions related to this topic and to open debate about any remaining points of uncertainty. We here offer insights to improve the conceptual clarity and empirical standards offered by social neuroscience studies of inter-personal interaction using hyperscanning with a particular focus on verbal communication.

Gamma‐band neural coupling during conceptual alignment

Conceptual alignment is a prerequisite for mutual understanding. However, little is known about the neurophysiological brain‐to‐brain underpinning during conceptual alignment for mutual understanding. Here, we recorded multi‐channel electroencephalogram (EEG) simultaneously from two participants in Experiment 1 and adopted the dual‐tACS techniques in Experiment 2 to investigate the underlying brain‐to‐brain EEG coupling during conceptual alignment and the possible enhancement effect. Our results showed that 1) higher phase‐locking value (PLV), a sensitive measure for quantifying neural coupling strength between EEG signals, at the gamma frequency band (28–40 Hz), was observed in the left temporoparietal site (left TP) area between successful versus unsuccessful conceptual alignment. The left TP gamma coupling strength correlated with the accuracy of conceptual alignment and differentiated whether subjects belonged to the SUCCESS or FAILURE groups in our study. 2) In‐phase gamma‐band transcranial alternating current stimulation (tACS) over the left TP area increased the accuracy of subjects in the SUCCESS group but not the FAILURE group. 3) The effect of perspective‐taking on the accuracy was mediated by the gamma coupling strength within the left TP area. Our results support the role of gamma‐band coupling between brains for interpersonal conceptual alignment. We provide dynamic interpersonal neurophysiological insights into the formation of successful communication.

Familiarity modulates neural tracking of sung and spoken utterances

Music is often described in the laboratory and in the classroom as a beneficial tool for memory encoding and retention, with a particularly strong effect when words are sung to familiar compared to unfamiliar melodies. However, the neural mechanisms underlying this memory benefit, especially for benefits related to familiar music are not well understood. The current study examined whether neural tracking of the slow syllable rhythms of speech and song is modulated by melody familiarity. Participants became familiar with twelve novel melodies over four days prior to MEG testing. Neural tracking of the same utterances spoken and sung revealed greater cerebro-acoustic phase coherence for sung compared to spoken utterances, but did not show an effect of familiar melody when stimuli were grouped by their assigned (trained) familiarity. However, when participant's subjective ratings of perceived familiarity were used to group stimuli, a large effect of familiarity was observed. This effect was not specific to song, as it was observed in both sung and spoken utterances. Exploratory analyses revealed some in-session learning of unfamiliar and spoken utterances, with increased neural tracking for untrained stimuli by the end of the MEG testing session. Our results indicate that top-down factors like familiarity are strong modulators of neural tracking for music and language. Participants' neural tracking was related to their perception of familiarity, which was likely driven by a combination of effects from repeated listening, stimulus-specific melodic simplicity, and individual differences. Beyond simply the acoustic features of music, top-down factors built into the music listening experience, like repetition and familiarity, play a large role in the way we attend to and encode information presented in a musical context.

Interpersonal Conflict Increases Interpersonal Neural Synchronization in Romantic Couples

Previous studies on dual-brain social interaction have shown different patterns of interpersonal neural synchronization (INS) between conflictual and supportive interactions, but the role of emotion in the dual-brain mechanisms of such interactions is not well understood. Furthermore, little is known about how the dual-brain mechanisms are affected by relationship type (e.g., romantic relationship vs. friendship) and interaction mode (e.g., verbal vs. nonverbal). To elaborate on these issues, this study used functional near-infrared spectroscopy to collect hemodynamic signals from romantic couples and cross-sex friends while they were discussing conflictual, neutral, or supportive topics. For the couples but not the friends, INS between the sensorimotor cortex of both participants was greater when discussing the conflictual topic than when discussing the supportive topic. INS was positively correlated with the arousal level but not the valence level of communication contents. INS was also positively correlated with interpersonal physiological synchronization based on galvanic skin response, a physiological measure of arousal. Furthermore, the differences in INS between the conflictual and supportive topics were closely associated with verbal rather than nonverbal behaviors. Together, these findings suggest that it is the arousal level induced by verbal interactions during interpersonal conflicts that increases romantic couples' INS.

HuGoS: a virtual environment for studying collective human behavior from a swarm intelligence perspective

Swarm intelligence studies self-organized collective behavior resulting from interactions between individuals, typically in animals and artificial agents. Some studies from cognitive science have also demonstrated self-organization mechanisms in humans, often in pairs. Further research into the topic of human swarm intelligence could provide a better understanding of new behaviors and larger human collectives. This requires studies with multiple human participants in controlled experiments in a wide variety of scenarios, where a rich scope of possible interactions can be isolated and captured. In this paper, we present HuGoS—‘Humans Go Swarming’—a multi-user virtual environment implemented using the Unity game development platform, as a comprehensive tool for experimentation in human swarm intelligence. We demonstrate the functionality of HuGoS with naïve participants in a browser-based implementation, in a coordination task involving collective decision-making, messaging and signaling, and stigmergy. By making HuGoS available as open-source software, we hope to facilitate further research in the field of human swarm intelligence.

Multimodality and the origin of a novel communication system in face-to-face interaction

Face-to-face communication is multimodal at its core: it consists of a combination of vocal and visual signalling. However, current evidence suggests that, in the absence of an established communication system, visual signalling, especially in the form of visible gesture, is a more powerful form of communication than vocalization and therefore likely to have played a primary role in the emergence of human language. This argument is based on experimental evidence of how vocal and visual modalities (i.e. gesture) are employed to communicate about familiar concepts when participants cannot use their existing languages. To investigate this further, we introduce an experiment where pairs of participants performed a referential communication task in which they described unfamiliar stimuli in order to reduce reliance on conventional signals. Visual and auditory stimuli were described in three conditions: using visible gestures only, using non-linguistic vocalizations only and given the option to use both (multimodal communication). The results suggest that even in the absence of conventional signals, gesture is a more powerful mode of communication compared with vocalization, but that there are also advantages to multimodality compared to using gesture alone. Participants with an option to produce multimodal signals had comparable accuracy to those using only gesture, but gained an efficiency advantage. The analysis of the interactions between participants showed that interactants developed novel communication systems for unfamiliar stimuli by deploying different modalities flexibly to suit their needs and by taking advantage of multimodality when required.

Communicative misalignment in Autism Spectrum Disorder

Communication deficits are a defining feature of Autism Spectrum Disorder (ASD), manifest during social interactions. Previous studies investigating communicative deficits have largely focused on the perceptual biases, social motivation, cognitive flexibility, or mentalizing abilities of isolated individuals. By embedding autistic individuals in live non-verbal interactions, we characterized a novel cause for their communication deficits. Adults with ASD matched neurotypical individuals in their ability and propensity to generate and modify intelligible behaviors for a communicative partner. However, they struggled to align the meaning of those behaviors with their partner when meaning required referencing their recent communicative history. This communicative misalignment explains why autistic individuals are vulnerable in everyday interactions, which entail fleeting ambiguities, but succeed in social cognition tests involving stereotyped contextual cues. These findings illustrate the cognitive and clinical importance of considering social interaction as a communicative alignment challenge, and how ineffective human communication is without this key interactional ingredient.

Taking common ground into account: Specifying the role of the mentalizing network in communicative language production

Several studies have shown that communicative language production as compared to non-communicative language production recruits parts of the mentalizing or theory of mind network, yet the exact role of this network in communication remains underspecified. In this study, we therefore aimed to test under what conditions the mentalizing network contributes to communicative language production. We were especially interested in distinguishing between situations in which speakers have to consider which information they do or do not share with their addressee (common vs. privileged ground information). We therefore manipulated whether speakers had to distinguish between common and privileged ground in order to communicate efficiently with the listener, in addition to comparing language production in a communicative and a non-communicative context. Participants performed a referential communicative game in the MRI-scanner as well as a similar, non-communicative task. We found that the medial prefrontal cortex, a core region of the mentalizing network, is especially sensitive to communicative contexts in which speakers have to take their addressee’s needs into account in order to communicate efficiently. In addition, we found neural differences between the communicative and the non-communicative settings before speakers started to plan their utterances, suggesting that they continuously update common ground in a communicative context.

Neural mechanisms for selectively tuning in to the target speaker in a naturalistic noisy situation

The neural mechanism for selectively tuning in to a target speaker while tuning out the others in a multi-speaker situation (i.e., the cocktail-party effect) remains elusive. Here we addressed this issue by measuring brain activity simultaneously from a listener and from multiple speakers while they were involved in naturalistic conversations. Results consistently show selectively enhanced interpersonal neural synchronization (INS) between the listener and the attended speaker at left temporal–parietal junction, compared with that between the listener and the unattended speaker across different multi-speaker situations. Moreover, INS increases significantly prior to the occurrence of verbal responses, and even when the listener’s brain activity precedes that of the speaker. The INS increase is independent of brain-to-speech synchronization in both the anatomical location and frequency range. These findings suggest that INS underlies the selective process in a multi-speaker situation through neural predictions at the content level but not the sensory level of speech.

When many people are speaking, e.g. at a party, we can selectively attend to just one speaker. Here, using ‘hyperscanning’, the authors show that interpersonal neural synchronization is selectively increased between a listener and the attended speaker, compared to between the listener and an unattended speaker.

A non-invasive, quantitative study of broadband spectral responses in human visual cortex

Currently, non-invasive methods for studying the human brain do not routinely and reliably measure spike-rate-dependent signals, independent of responses such as hemodynamic coupling (fMRI) and subthreshold neuronal synchrony (oscillations and event-related potentials). In contrast, invasive methods—microelectrode recordings and electrocorticography (ECoG)—have recently measured broadband power elevation in field potentials (~50–200 Hz) as a proxy for locally averaged spike rates. Here, we sought to detect and quantify stimulus-related broadband responses using magnetoencephalography (MEG). Extracranial measurements like MEG and EEG have multiple global noise sources and relatively low signal-to-noise ratios; moreover high frequency artifacts from eye movements can be confounded with stimulus design and mistaken for signals originating from brain activity. For these reasons, we developed an automated denoising technique that helps reveal the broadband signal of interest. Subjects viewed 12-Hz contrast-reversing patterns in the left, right, or bilateral visual field. Sensor time series were separated into evoked (12-Hz amplitude) and broadband components (60–150 Hz). In all subjects, denoised broadband responses were reliably measured in sensors over occipital cortex, even in trials without microsaccades. The broadband pattern was stimulus-dependent, with greater power contralateral to the stimulus. Because we obtain reliable broadband estimates with short experiments (~20 minutes), and with sufficient signal-to-noise to distinguish responses to different stimuli, we conclude that MEG broadband signals, denoised with our method, offer a practical, non-invasive means for characterizing spike-rate-dependent neural activity for addressing scientific questions about human brain function.

Cognitive mechanisms for inferring the meaning of novel signals during symbolisation

As participants repeatedly interact using graphical signals (as in a game of Pictionary), the signals gradually shift from being iconic (or motivated) to being symbolic (or arbitrary). The aim here is to test experimentally whether this change in the form of the signal implies a concomitant shift in the inferential mechanisms needed to understand it. The results show that, during early, iconic stages, there is more reliance on creative inferential processes associated with insight problem solving, and that the recruitment of these cognitive mechanisms decreases over time. The variation in inferential mechanism is not predicted by the sign’s visual complexity or iconicity, but by its familiarity, and by the complexity of the relevant mental representations. The discussion explores implications for pragmatics, language evolution, and iconicity research.

Oxytocin modulates human communication by enhancing cognitive exploration

Oxytocin is a neuropeptide known to influence how humans share material resources. Here we explore whether oxytocin influences how we share knowledge. We focus on two distinguishing features of human communication, namely the ability to select communicative signals that disambiguate the many-to-many mappings that exist between a signal's form and meaning, and adjustments of those signals to the presumed cognitive characteristics of the addressee ("audience design"). Fifty-five males participated in a randomized, double-blind, placebo controlled experiment involving the intranasal administration of oxytocin. The participants produced novel non-verbal communicative signals towards two different addressees, an adult or a child, in an experimentally-controlled live interactive setting. We found that oxytocin administration drives participants to generate signals of higher referential quality, i.e. signals that disambiguate more communicative problems; and to rapidly adjust those communicative signals to what the addressee understands. The combined effects of oxytocin on referential quality and audience design fit with the notion that oxytocin administration leads participants to explore more pervasively behaviors that can convey their intention, and diverse models of the addressees. These findings suggest that, besides affecting prosocial drive and salience of social cues, oxytocin influences how we share knowledge by promoting cognitive exploration.

Communicative knowledge pervasively influences sensorimotor computations

Referential pointing is a characteristically human behavior, which involves moving a finger through space to direct an addressee towards a desired mental state. Planning this type of action requires an interface between sensorimotor and conceptual abilities. A simple interface could supplement spatially-guided motor routines with communicative-ostensive cues. For instance, a pointing finger held still for an extended period of time could aid the addressee’s understanding, without altering the movement’s trajectory. A more complex interface would entail communicative knowledge penetrating the sensorimotor system and directly affecting pointing trajectories. We compare these two possibilities using motion analyses of referential pointing during multi-agent interactions. We observed that communicators produced ostensive cues that were sensitive to the communicative context. Crucially, we also observed pervasive adaptations to the pointing trajectories: they were tailored to the communicative context and to partner-specific information. These findings indicate that human referential pointing is planned and controlled on the basis of partner-specific knowledge, over and above the tagging of motor routines with ostensive cues.

You talkin' to me? Communicative talker gaze activates left-lateralized superior temporal cortex during perception of degraded speech

Neuroimaging studies of speech perception have consistently indicated a left-hemisphere dominance in the temporal lobes’ responses to intelligible auditory speech signals (McGettigan and Scott, 2012). However, there are important communicative cues that cannot be extracted from auditory signals alone, including the direction of the talker's gaze. Previous work has implicated the superior temporal cortices in processing gaze direction, with evidence for predominantly right-lateralized responses (Carlin & Calder, 2013). The aim of the current study was to investigate whether the lateralization of responses to talker gaze differs in an auditory communicative context. Participants in a functional MRI experiment watched and listened to videos of spoken sentences in which the auditory intelligibility and talker gaze direction were manipulated factorially. We observed a left-dominant temporal lobe sensitivity to the talker's gaze direction, in which the left anterior superior temporal sulcus/gyrus and temporal pole showed an enhanced response to direct gaze – further investigation revealed that this pattern of lateralization was modulated by auditory intelligibility. Our results suggest flexibility in the distribution of neural responses to social cues in the face within the context of a challenging speech perception task.

•

Talker gaze is an important social cue during speech comprehension.

•

Neural responses to gaze were measured during perception of degraded sentences.

•

Gaze direction modulated activation in left-lateralized superior temporal cortex.

•

Left lateralization became stronger when speech was less intelligible.

•

Results suggest task-dependent flexibility in cortical responses to gaze.

Adjustment of speaker's referential expressions to an addressee's likely knowledge and link with theory of mind abilities

To communicate cooperatively, speakers must determine what constitutes the common ground with their addressee and adapt their referential choices accordingly. Assessing another person's knowledge requires a social cognition ability termed theory of mind (ToM). This study relies on a novel referential communication task requiring probabilistic inferences of the knowledge already held by an addressee prior to the study. Forty participants were asked to present 10 movie characters and the addressee, who had the same characters in a random order, was asked to place them in order. ToM and other aspects of social cognition were also assessed. Participants used more information when presenting likely unknown than likely known movie characters. They particularly increased their use of physical descriptors, which most often accompanied movie-related information. Interestingly, a significant relationship emerged between our ToM test and the increased amount of information given for the likely unknown characters. These results suggest that speakers use ToM to infer their addressee's likely knowledge and accordingly adapt their referential expressions.

Cerebral coherence between communicators marks the emergence of meaning

How can we understand each other during communicative interactions? An influential suggestion holds that communicators are primed by each other's behaviors, with associative mechanisms automatically coordinating the production of communicative signals and the comprehension of their meanings. An alternative suggestion posits that mutual understanding requires shared conceptualizations of a signal's use, i.e., "conceptual pacts" that are abstracted away from specific experiences. Both accounts predict coherent neural dynamics across communicators, aligned either to the occurrence of a signal or to the dynamics of conceptual pacts. Using coherence spectral-density analysis of cerebral activity simultaneously measured in pairs of communicators, this study shows that establishing mutual understanding of novel signals synchronizes cerebral dynamics across communicators' right temporal lobes. This interpersonal cerebral coherence occurred only within pairs with a shared communicative history, and at temporal scales independent from signals' occurrences. These findings favor the notion that meaning emerges from shared conceptualizations of a signal's use.

Simulating the real origins of communication

How communication systems emerge is a topic of relevance to several academic disciplines. Numerous existing models, both mathematical and computational, study this emergence. However, with few exceptions, these models all build some form of communication into their initial specification. Consequently, what these models study is how communication systems transition from one form to another, and not how communication itself emerges in the first place. Here we present a new computational model of the emergence of communication which, unlike previous models, does not pre-specify the existence of communication. We conduct two experiments using this model, in order to derive general statements about how communication systems emerge. The two main routes to communication that we identify correspond with findings from the empirical literature on the evolution of animal signals. We use this finding to explain when and why we should expect communication to emerge in nature. We also compare our model to experimental research on the origins of human communication systems, and hence show that humans are an important exception to the general trends we observe. We argue that this is because humans, and probably only humans, are able to ‘signal signalhood’, i.e. to express communicative intentions.

Creating a communication system from scratch: gesture beats vocalization hands down

How does modality affect people's ability to create a communication system from scratch? The present study experimentally tests this question by having pairs of participants communicate a range of pre-specified items (emotions, actions, objects) over a series of trials to a partner using either non-linguistic vocalization, gesture or a combination of the two. Gesture-alone outperformed vocalization-alone, both in terms of successful communication and in terms of the creation of an inventory of sign-meaning mappings shared within a dyad (i.e., sign alignment). Combining vocalization with gesture did not improve performance beyond gesture-alone. In fact, for action items, gesture-alone was a more successful means of communication than the combined modalities. When people do not share a system for communication they can quickly create one, and gesture is the best means of doing so.

Social learning in humans and other animals

Decisions made by individuals can be influenced by what others think and do. Social learning includes a wide array of behaviors such as imitation, observational learning of novel foraging techniques, peer or parental influences on individual preferences, as well as outright teaching. These processes are believed to underlie an important part of cultural variation among human populations and may also explain intraspecific variation in behavior between geographically distinct populations of animals. Recent neurobiological studies have begun to uncover the neural basis of social learning. Here we review experimental evidence from the past few decades showing that social learning is a widespread set of skills present in multiple animal species. In mammals, the temporoparietal junction, the dorsomedial, and dorsolateral prefrontal cortex, as well as the anterior cingulate gyrus, appear to play critical roles in social learning. Birds, fish, and insects also learn from others, but the underlying neural mechanisms remain poorly understood. We discuss the evolutionary implications of these findings and highlight the importance of emerging animal models that permit precise modification of neural circuit function for elucidating the neural basis of social learning.

What drives successful verbal communication?

There is a vast amount of potential mappings between behaviors and intentions in communication: a behavior can indicate a multitude of different intentions, and the same intention can be communicated with a variety of behaviors. Humans routinely solve these many-to-many referential problems when producing utterances for an Addressee. This ability might rely on social cognitive skills, for instance, the ability to manipulate unobservable summary variables to disambiguate ambiguous behavior of other agents (“mentalizing”) and the drive to invest resources into changing and understanding the mental state of other agents (“communicative motivation”). Alternatively, the ambiguities of verbal communicative interactions might be solved by general-purpose cognitive abilities that process cues that are incidentally associated with the communicative interaction. In this study, we assess these possibilities by testing which cognitive traits account for communicative success during a verbal referential task. Cognitive traits were assessed with psychometric scores quantifying motivation, mentalizing abilities, and general-purpose cognitive abilities, taxing abstract visuo-spatial abilities. Communicative abilities of participants were assessed by using an on-line interactive task that required a speaker to verbally convey a concept to an Addressee. The communicative success of the utterances was quantified by measuring how frequently a number of Evaluators would infer the correct concept. Speakers with high motivational and general-purpose cognitive abilities generated utterances that were more easily interpreted. These findings extend to the domain of verbal communication the notion that motivational and cognitive factors influence the human ability to rapidly converge on shared communicative innovations.