Brain signatures predict communicative function of speech production in interaction

Postnatal dependency as the foundation of social learning in humans

Humans have developed a sophisticated system of cultural transmission that allows for complex, non-genetically specified behaviours to be passed on from one generation to the next. This system relies on understanding others as social and communicative partners. Some theoretical accounts argue for the existence of domain-specific cognitive adaptations that prioritize social information, while others suggest that social learning is itself a product of cumulative cultural evolution based on domain-general learning mechanisms. The current paper explores the contribution of humans' unique ontogenetic environment to the emergence of social learning in infancy. It suggests that the prolonged period of post-natal dependency experienced by human infants contributes to the development of social learning. Because of motor limitations, infants learn to interact with and act through caregivers, establishing social learning abilities and skills that continue to develop as children become less dependent. According to this perspective, at least some key aspects of social development can be attributed to a developmental trajectory guided by infants' early motor development that radically alters how they experience the world.

Causal role of frontocentral beta oscillation in comprehending linguistic communicative functions

Linguistic communication is often considered as an action serving the function of conveying the speaker's goal to the addressee. Although neuroimaging studies have suggested a role of the motor system in comprehending communicative functions, the underlying mechanism is yet to be specified. Here, by two EEG experiments and a tACS experiment, we demonstrate that the frontocentral beta oscillation, which represents action states, plays a crucial part in linguistic communication understanding. Participants read scripts involving two interlocutors and rated the interlocutors' attitudes. Each script included a critical sentence said by the speaker expressing a context-dependent function of either promise, request, or reply to the addressee's query. These functions were behaviorally discriminated, with higher addressee's will rating for the promise than for the reply and higher speaker's will rating for the request than for the reply. EEG multivariate analyses showed that different communicative functions were represented by different patterns of the frontocentral beta activity but not by patterns of alpha activity. Further tACS results showed that, relative to alpha tACS and sham stimulation, beta tACS improved the predictability of communicative functions of request or reply, as measured by the speaker's will rating. These results convergently suggest a causal role of the frontocentral beta activities in comprehending linguistic communications.

Theory of affective pragmatics under biolinguistics

This paper introduces a pioneering investigation into affective pragmatics through the perspective of Darwinian Biolinguistics, an interdisciplinary field at the nexus of biological and linguistic principles. Anchored in Darwin's theory of evolution and the latest developments in neurobiology, this study delves into the influence of biological factors---especially those pertaining to the brain's emotional processing on pragmatic communication. The research posits that human emotional responses, inherent in our biological constitution, profoundly influence the usage and interpretation of language in social interactions.

Temporal neural dynamics of understanding communicative intentions from speech prosody

Understanding the correct intention of a speaker is critical for social interaction. Speech prosody is an important source for understanding speakers' intentions during verbal communication. However, the neural dynamics by which the human brain translates the prosodic cues into a mental representation of communicative intentions in real time remains unclear. Here, we recorded EEG (electroencephalograph) while participants listened to dialogues. The prosodic features of the critical words at the end of sentences were manipulated to signal either suggestion, warning, or neutral intentions. The results showed that suggestion and warning intentions evoked enhanced late positive event-related potentials (ERPs) compared to the neutral condition. Linear mixed-effects model (LMEM) regression and representational similarity analysis (RSA) analyses revealed that these ERP effects were distinctively correlated with prosodic acoustic analysis, emotional valence evaluation, and intention interpretation in different time windows; The onset latency significantly increased as the processing level of abstractness and communicative intentionality increased. Neural representations of intention and emotional information emerged and parallelly persisted over a long time window, guiding the correct identification of communicative intention. These results provide new insights into understanding the structural components of intention processing and their temporal neural dynamics underlying communicative intention comprehension from speech prosody in online social interactions.

The prediction potential indexes the meaning and communicative function of upcoming utterances

Prediction has a fundamental role in language processing. However, predictions can be made at different levels, and it is not always clear whether speech sounds, morphemes, words, meanings, or communicative functions are anticipated during dialogues. Previous studies reported specific brain signatures of communicative pragmatic function, in particular enhanced brain responses immediately after encountering an utterance used to request an object from a partner, but relatively smaller ones when the same utterance was used for naming the object. The present experiment now investigates whether similar neuropragmatic signatures emerge in recipients before the onset of upcoming utterances carrying different predictable communicative functions. Trials started with a context question and object pictures displayed on the screen, raising the participant's expectation that words from a specific semantic category (food or tool) would subsequently be used to either name or request one of the objects. Already 600 msec before utterance onset, a larger prediction potential was observed when a request was anticipated relative to naming expectation. As this result is congruent with the neurophysiological difference previously observed right after the critical utterance, the anticipatory brain activity may index predictions about the social-communicative function of upcoming utterances. In addition, we also found that the predictable semantic category of the upcoming word was likewise reflected in the anticipatory brain potential. Thus, the neurophysiological characteristics of the prediction potential can capture different types of upcoming linguistic information, including semantic and pragmatic aspects of an upcoming utterance and communicative action.

Reward-related regions play a role in natural story comprehension

The reward system was shown to be involved in a wide array of processes. Nevertheless, the exploration of the involvement of the reward system during language processing has not yet been directly tested. We investigated the role of reward-processing regions while listening to a natural story. We utilized a published dataset in which half of the participants listened to a natural story and the others listened to a scrambled version of it to compare the functional MRI signals in the reward system between these conditions and discovered a distinct pattern between conditions. This suggests that the reward system is activated during the comprehension of natural stories. We also show evidence that the fMRI signals in reward-related areas might potentially correlate with the predictability level of processed sentences. Further research is needed to determine the nature of the involvement and the way the activity interacts with various aspects of the sentences.

Predicting and coding sound into action translation in spinal cord injured people

Motor activation in response to perception of action-related stimuli may depend on a resonance mechanism subserving action understanding. The extent to which this mechanism is innate or learned from sensorimotor experience is still unclear. Here, we recorded EEG while people with paraplegia or tetraplegia consequent to spinal cord injury (SCI) and healthy control participants were presented with action sounds produced by body parts (mouth, hands or feet) that were or were not affected by SCI. Non-action sounds were used as further control. We observed reduced brain activation in subjects affected by SCI at both pre- and post-stimulus latencies specifically for those actions whose effector was disconnected by the spinal lesion (i.e., hand sound for tetraplegia and leg sound for both paraplegia and tetraplegia). Correlation analyses showed that these modulations were functionally linked with the chronicity of the lesion, indicating that the longer the time the lesion- EEG data acquisition interval and/or the more the lesion occurred at a young age, the weaker was the cortical activity in response to these action sounds. Tellingly, source estimations confirmed that these modulations originated from a deficit in the motor resonance mechanism, by showing diminished activity in premotor (during prediction and perception) and near the primary motor (during perception) areas. Such dissociation along the cortical hierarchy is consistent with both previous reports in healthy subjects and with hierarchical predictive coding accounts. Overall, these data expand on the notion that sensorimotor experience maintains the cortical representations relevant to anticipate and perceive action-related stimuli.

Examining resting state functional connectivity and frequency power analysis in adults who stutter compared to adults who do not stutter

Introduction

Stuttering is a speech disorder characterized by impaired connections between brain regions involved in speech production. This study aimed to investigate functional connectivity and frequency power during rest in adults who stutter (AWS) compared to fluent adults (AWNS) in the dorsolateral prefrontal cortex (DLPFC), dorsolateral frontal cortex (DLFC), supplementary motor area (SMA), motor speech, angular gyrus (AG), and inferior temporal gyrus (ITG).

Materials and methods

Fifteen AWS (3 females, 12 males) and fifteen age- and sex-matched AWNS (3 females, 12 males) participated in this study. All participants were native Persian speakers. Stuttering severity in the AWS group was assessed using the Persian version of the Stuttering Severity Instrument Fourth Edition (SSI-4). Resting-state electroencephalography (EEG) was recorded for 5 min while participants sat comfortably with their eyes open. We analyzed frequency band power across various frequency bands and investigated functional connectivity within the specified speech region.

Results

Significant between-group differences were found in band powers including alpha, beta, delta, theta, and gamma, specifically in the premotor, SMA, motor speech, and frontal regions. AWS also showed increased coherence between the right motor speech region compared to controls. We demonstrate that the proposed hierarchical false discovery rate (FDR) method is the most effective for both simulations and experimental data. In the expected regions, this method revealed significant synchrony effects at an acceptable error rate of 5%.

Conclusion

The results highlight disrupted functional connectivity in AWS at resting state, particularly in speech-related and associated areas. Given the complex neurological basis of developmental stuttering, robust neural markers are closely linked to this phenomenon. These markers include imbalanced activity within brain regions associated with speech and motor functions, coupled with impaired functional connectivity between these regions. The cortico-basal ganglia-thalamo-cortical system governs the dynamic interplay between cortical regions, with SMA as a key cortical site. It is hypothesized that the aberrant resting state functional connectivity will impact the language planning and motor execution necessary for fluent speech. Examining resting-state metrics as biomarkers could further elucidate the neural underpinnings of stuttering and guide intervention.

Conditionals in context: Brain signatures of prediction in discourse processing

Comprehenders are known to generate expectations about upcoming linguistic input at the sentence and discourse level. However, most previous studies on prediction focused mainly on word-induced brain activity rather than examining neural activity preceding a critical stimulus in discourse processing, where prediction actually takes place. In this EEG study, participants were presented with multiple sentences resembling a discourse including conditional sentences with either only if or if, which are characterized by different semantics, triggering stronger or weaker predictions about the possible continuation of the presented discourses, respectively. Results revealed that discourses including only if, as compared to discourses with bare if, triggered an increased predictive neural activity before the expected critical word, resembling the readiness potential. Moreover, word-induced P300 brain responses were found to be enhanced by unpredictable discourse continuations and reduced in predictable discourse continuations. Intriguingly, brain responses preceding and following the critical word were found to be correlated, which yields evidence for predictive activity modulating word-induced processing on the discourse level. These findings shed light on the predictive nature of neural processes at the discourse level, critically advancing our understanding of the functional interconnection between discourse understanding and prediction processes in brain and mind.

Surface and Contextual Linguistic Cues in Dialog Act Classification: A Cognitive Science View

What role do linguistic cues on a surface and contextual level have in identifying the intention behind an utterance? Drawing on the wealth of studies and corpora from the computational task of dialog act classification, we studied this question from a cognitive science perspective. We first reviewed the role of linguistic cues in dialog act classification studies that evaluated model performance on three of the most commonly used English dialog act corpora. Findings show that frequency-based, machine learning, and deep learning methods all yield similar performance. Classification accuracies, moreover, generally do not explain which specific cues yield high performance. Using a cognitive science approach, in two analyses, we systematically investigated the role of cues in the surface structure of the utterance and cues of the surrounding context individually and combined. By comparing the explained variance, rather than the prediction accuracy of these cues in a logistic regression model, we found that (1) while surface and contextual linguistic cues can complement each other, surface linguistic cues form the backbone in human dialog act identification, (2) with word frequency statistics being particularly important for the dialog act, and (3) the similar trends across corpora, despite differences in the type of dialog, corpus setup, and dialog act tagset. The importance of surface linguistic cues in dialog act classification sheds light on how both computers and humans take advantage of these cues in speech act recognition.

Beyond speaking: neurocognitive perspectives on language production in social interaction

The human faculty to speak has evolved, so has been argued, for communicating with others and for engaging in social interactions. Hence the human cognitive system should be equipped to address the demands that social interaction places on the language production system. These demands include the need to coordinate speaking with listening, the need to integrate own (verbal) actions with the interlocutor's actions, and the need to adapt language flexibly to the interlocutor and the social context. In order to meet these demands, core processes of language production are supported by cognitive processes that enable interpersonal coordination and social cognition. To fully understand the cognitive architecture and its neural implementation enabling humans to speak in social interaction, our understanding of how humans produce language needs to be connected to our understanding of how humans gain insights into other people's mental states and coordinate in social interaction. This article reviews theories and neurocognitive experiments that make this connection and can contribute to advancing our understanding of speaking in social interaction. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Conventionality determines the time course of indirect replies comprehension: An ERP study

Indirect language comprehension requires decoding both the literal meaning and the intended meaning of an utterance, in which pragmatic inference is involved. This study tests the role of conventionality in the time course of indirect reply processing by comparing conventional and non-conventional indirect replies with direct reply, respectively. We constructed discourses which consist of a context and a dialogue with one question (e.g., May I buy a necklace for you) and one reply (e.g., I really have too many). The reply utterance was segmented into three phrases and presented orderly for EEG recording, e.g., with the subject as the first phrase (e.g., I), the adverbial as the second phrase (e.g., really), and the predicate as the third phrase (e.g., have too many). Our results showed that for conventional indirect replies, the second phrase elicited a larger anterior negativity, and the third phrase elicited a larger anterior N400 compared with those in direct replies. By contrast, for the non-conventional indirect reply, only the third phrase elicited a larger late negativity than the direct replies. These findings suggest that conventionality determines the time course of the pragmatic inferences for the most relevant interpretation during indirect replies comprehension.

Linguistic signs in action: The neuropragmatics of speech acts

What makes human communication exceptional is the ability to grasp speaker's intentions beyond what is said verbally. How the brain processes communicative functions is one of the central concerns of the neurobiology of language and pragmatics. Linguistic-pragmatic theories define these functions as speech acts, and various pragmatic traits characterise them at the levels of propositional content, action sequence structure, related commitments and social aspects. Here I discuss recent neurocognitive studies, which have shown that the use of identical linguistic signs in conveying different communicative functions elicits distinct and ultra-rapid neural responses. Interestingly, cortical areas show differential involvement underlying various pragmatic features related to theory-of-mind, emotion and action for specific speech acts expressed with the same utterances. Drawing on a neurocognitive model, I posit that understanding speech acts involves the expectation of typical partner follow-up actions and that this predictive knowledge is immediately reflected in mind and brain.

Representing linguistic communicative functions in the premotor cortex

Linguistic communication is often regarded as an action that serves a function to convey the speaker's goal to the addressee. Here, with an functional magnetic resonance imaging (fMRI) study and a lesion study, we demonstrated that communicative functions are represented in the human premotor cortex. Participants read scripts involving 2 interlocutors. Each script contained a critical sentence said by the speaker with a communicative function of either making a Promise, a Request, or a Reply to the addressee's query. With various preceding contexts, the critical sentences were supposed to induce neural activities associated with communicative functions rather than specific actions literally described by these sentences. The fMRI results showed that the premotor cortex contained more information, as revealed by multivariate analyses, on communicative functions and relevant interlocutors' attitudes than the perisylvian language regions. The lesion study results showed that, relative to healthy controls, the understanding of communicative functions was impaired in patients with lesions in the premotor cortex, whereas no reliable difference was observed between the healthy controls and patients with lesions in other brain regions. These findings convergently suggest the crucial role of the premotor cortex in representing the functions of linguistic communications, supporting that linguistic communication can be seen as an action.

OUP accepted manuscript

During conversations, speech prosody provides important clues about the speaker’s communicative intentions. In many languages, a rising vocal pitch at the end of a sentence typically expresses a question function, whereas a falling pitch suggests a statement. Here, the neurophysiological basis of intonation and speech act understanding were investigated with high-density electroencephalography (EEG) to determine whether prosodic features are reflected at the neurophysiological level. Already approximately 100 ms after the sentence-final word differing in prosody, questions, and statements expressed with the same sentences led to different neurophysiological activity recorded in the event-related potential. Interestingly, low-pass filtered sentences and acoustically matched nonvocal musical signals failed to show any neurophysiological dissociations, thus suggesting that the physical intonation alone cannot explain this modulation. Our results show rapid neurophysiological indexes of prosodic communicative information processing that emerge only when pragmatic and lexico-semantic information are fully expressed. The early enhancement of question-related activity compared with statements was due to sources in the articulatory-motor region, which may reflect the richer action knowledge immanent to questions, namely the expectation of the partner action of answering the question. The present findings demonstrate a neurophysiological correlate of prosodic communicative information processing, which enables humans to rapidly detect and understand speaker intentions in linguistic interactions.