The mismatch negativity (MMN) in basic research of central auditory processing: a review

Systemic neurophysiological signals of auditory predictive coding

Predictive coding framework posits that our brain continuously monitors changes in the environment and updates its predictive models, minimizing prediction errors to efficiently adapt to environmental demands. However, the underlying neurophysiological mechanisms of these predictive phenomena remain unclear. The present study aimed to explore the systemic neurophysiological correlates of predictive coding processes during passive and active auditory processing. Electroencephalography (EEG), functional near-infrared spectroscopy (fNIRS), and autonomic nervous system (ANS) measures were analyzed using an auditory pattern-based novelty oddball paradigm. A sample of 32 healthy subjects was recruited. The results showed shared slow evoked potentials between passive and active conditions that could be interpreted as automatic predictive processes of anticipation and updating, independent of conscious attentional effort. A dissociated topography of the cortical hemodynamic activity and distinctive evoked potentials upon auditory pattern violation were also found between both conditions, whereas only conscious perception leading to imperative responses was accompanied by phasic ANS responses. These results suggest a systemic-level hierarchical reallocation of predictive coding neural resources as a function of contextual demands in the face of sensory stimulation. Principal component analysis permitted to associate the variability of some of the recorded signals.

Attentional ERPs in consumers of smoked and insufflated cocaine associated with neuropsychological performance

BACKGROUND

Cocaine consumption is associated with reduced attentional event-related potentials (ERPs), namely P3a and P3b, indicating bottom-up and top-down deficits respectively. At cognitive level, these impairments are larger for faster routes of administration (e.g., smoked cocaine [SC]) than slower routes (e.g., insufflated cocaine [IC]). Here we assess these ERPs considering the route of cocaine administration. We hypothesized that SC dependent (SCD) would exhibit reduced amplitude of the P3a, while both SCD and IC dependent (ICD) would show reduced amplitude of the P3b.

METHODS

We examined 25 SCD, 22 ICD matched by poly-consumption profiles, and 25 controls matched by demographic variables. We combined EEG data from the Global-Local task with behavioral data from attentional cognitive tasks.

RESULTS

At the behavioral level, SCD exhibited attentional deficits in both bottom-up and top-down processes, while ICD only showed a tendency for top-down deficits. The amplitude of P3a and P3b was lower in Users groups. We observed subtle route-based differences, with larger differences in the P3a for SCD and in the P3b for ICD. Neurophysiological and behavioral data converged, with the P3a associated to bottom-up performance and P3b to top-down.

CONCLUSIONS

Different routes of administration lead to distinct attentional neurocognitive profiles. Specifically, SCD showed greater attentional impairment, mainly at bottom-up/P3a, while ICD showed a trend of top-down/P3b deficits. These findings emphasize the crucial role of considering the route of administration in both clinical and research settings and support the use of attentional ERPs as valid measures for assessing attentional deficits in substance Dependence.

Lower Childhood Socioeconomic Status Is Associated with Greater Neural Responses to Ambient Auditory Changes in Adulthood

Humans' early life experience varies by socioeconomic status (SES), raising the question of how this difference is reflected in the adult brain. An important aspect of brain function is the ability to detect salient ambient changes while focusing on a task. Here, we ask whether subjective social status during childhood is reflected by the way young adults' brain detecting changes in irrelevant information. In two studies (total n = 58), we examine electrical brain responses in the frontocentral region to a series of auditory tones, consisting of standard stimuli (80%) and deviant stimuli (20%) interspersed randomly, while participants were engaged in various visual tasks. Both studies showed stronger automatic change detection indexed by MMN in lower SES individuals, regardless of the unattended sound's feature, attended emotional content, or study type. Moreover, we observed a larger MMN in lower-SES participants, although they did not show differences in brain and behavior responses to the attended task. Lower-SES people also did not involuntarily orient more attention to sound changes (i.e., deviant stimuli), as indexed by the P3a. The study indicates that individuals with lower subjective social status may have an increased ability to automatically detect changes in their environment, which may suggest their adaptation to their childhood environments.

Infant mismatch responses to speech-sound changes predict language development in preschoolers at risk for dyslexia

OBJECTIVE

We investigated how infant mismatch responses (MMRs), which have the potential for providing information on auditory discrimination abilities, could predict subsequent development of pre-reading skills and the risk for familial dyslexia.

METHODS

We recorded MMRs to vowel, duration, and frequency deviants in pseudo-words at birth and 28 months in a sample over-represented by infants with dyslexia risk. We examined MMRs' associations with pre-reading skills at 28 months and 4-5 years and compared the results in subgroups with vs. without dyslexia risk.

RESULTS

Larger positive MMR (P-MMR) at birth was found to be associated with better serial naming. In addition, increased mismatch negativity (MMN) and late discriminative negativity (LDN), and decreased P-MMR at 28 months overall, were shown to be related to better pre-reading skills. The associations were influenced by dyslexia risk, which was also linked to poor pre-reading skills.

CONCLUSIONS

Infant MMRs, providing information about the maturity of the auditory system, are associated with the development of pre-reading skills. Speech-processing deficits may contribute to deficits in language acquisition observed in dyslexia.

SIGNIFICANCE

Infant MMRs could work as predictive markers of atypical linguistic development during early childhood. Results may help in planning preventive and rehabilitation interventions in children at risk of learning impairments.

Auditory Processing of Intonational Rises and Falls in German: Rises Are Special in Attention Orienting

This article investigates the processing of intonational rises and falls when presented unexpectedly in a stream of repetitive auditory stimuli. It examines the neurophysiological correlates (ERPs) of attention to these unexpected stimuli through the use of an oddball paradigm where sequences of repetitive stimuli are occasionally interspersed with a deviant stimulus, allowing for elicitation of an MMN. Whereas previous oddball studies on attention toward unexpected sounds involving pitch rises were conducted on nonlinguistic stimuli, the present study uses as stimuli lexical items in German with naturalistic intonation contours. Results indicate that rising intonation plays a special role in attention orienting at a pre-attentive processing stage, whereas contextual meaning (here a list of items) is essential for activating attentional resources at a conscious processing stage. This is reflected in the activation of distinct brain responses: Rising intonation evokes the largest MMN, whereas falling intonation elicits a less pronounced MMN followed by a P3 (reflecting a conscious processing stage). Subsequently, we also find a complex interplay between the phonological status (i.e., accent/head marking vs. boundary/edge marking) and the direction of pitch change in their contribution to attention orienting: Attention is not oriented necessarily toward a specific position in prosodic structure (head or edge). Rather, we find that the intonation contour itself and the appropriateness of the contour in the linguistic context are the primary cues to two core mechanisms of attention orienting, pre-attentive and conscious orientation respectively, whereas the phonological status of the pitch event plays only a supplementary role.

Conditional deviant repetition in the oddball paradigm modulates processing at the level of P3a but not MMN

The auditory system has an amazing ability to rapidly encode auditory regularities. Evidence comes from the popular oddball paradigm, in which frequent (standard) sounds are occasionally exchanged for rare deviant sounds, which then elicit signs of prediction error based on their unexpectedness (e.g., MMN and P3a). Here, we examine the widely neglected characteristics of deviants being bearers of predictive information themselves; naive participants listened to sound sequences constructed according to a new, modified version of the oddball paradigm including two types of deviants that followed diametrically opposed rules: one deviant sound occurred mostly in pairs (repetition rule), the other deviant sound occurred mostly in isolation (non-repetition rule). Due to this manipulation, the sound following a first deviant (either the same deviant or a standard) was either predictable or unpredictable based on its conditional probability associated with the preceding deviant sound. Our behavioral results from an active deviant detection task replicate previous findings that deviant repetition rules (based on conditional probability) can be extracted when behaviorally relevant. Our electrophysiological findings obtained in a passive listening setting indicate that conditional probability also translates into differential processing at the P3a level. However, MMN was confined to global deviants and was not sensitive to conditional probability. This suggests that higher-level processing concerned with stimulus selection and/or evaluation (reflected in P3a) but not lower-level sensory processing (reflected in MMN) considers rarely encountered rules.

Investigating the neurocognitive background of speech perception with a fast multi-feature MMN paradigm

The speech multi-feature MMN (Mismatch Negativity) offers a means to explore the neurocognitive background of the processing of multiple speech features in a short time, by capturing the time-locked electrophysiological activity of the brain known as event-related brain potentials (ERPs). Originating from Näätänen et al. (Clin Neurophysiol 115:140-144, 2004) pioneering work, this paradigm introduces several infrequent deviant stimuli alongside standard ones, each differing in various speech features. In this study, we aimed to refine the multi-feature MMN paradigm used previously to encompass both segmental and suprasegmental (prosodic) features of speech. In the experiment, a two-syllable long pseudoword was presented as a standard, and the deviant stimuli included alterations in consonants (deviation by place or place and mode of articulation), vowels (deviation by place or mode of articulation), and stress pattern in the first syllable of the pseudoword. Results indicated the emergence of MMN components across all segmental and prosodic contrasts, with the expected fronto-central amplitude distribution. Subsequent analyses revealed subtle differences in MMN responses to the deviants, suggesting varying sensitivity to phonetic contrasts. Furthermore, individual differences in MMN amplitudes were noted, partially attributable to participants' musical and language backgrounds. These findings underscore the utility of the multi-feature MMN paradigm for rapid and efficient investigation of the neurocognitive mechanisms underlying speech processing. Moreover, the paradigm demonstrated the potential to be used in further research to study the speech processing abilities in various populations.

Spatiotemporal brain hierarchies of auditory memory recognition and predictive coding

Our brain is constantly extracting, predicting, and recognising key spatiotemporal features of the physical world in order to survive. While neural processing of visuospatial patterns has been extensively studied, the hierarchical brain mechanisms underlying conscious recognition of auditory sequences and the associated prediction errors remain elusive. Using magnetoencephalography (MEG), we describe the brain functioning of 83 participants during recognition of previously memorised musical sequences and systematic variations. The results show feedforward connections originating from auditory cortices, and extending to the hippocampus, anterior cingulate gyrus, and medial cingulate gyrus. Simultaneously, we observe backward connections operating in the opposite direction. Throughout the sequences, the hippocampus and cingulate gyrus maintain the same hierarchical level, except for the final tone, where the cingulate gyrus assumes the top position within the hierarchy. The evoked responses of memorised sequences and variations engage the same hierarchical brain network but systematically differ in terms of temporal dynamics, strength, and polarity. Furthermore, induced-response analysis shows that alpha and beta power is stronger for the variations, while gamma power is enhanced for the memorised sequences. This study expands on the predictive coding theory by providing quantitative evidence of hierarchical brain mechanisms during conscious memory and predictive processing of auditory sequences.

Suppression and omission effects in auditory predictive processing-Two of the same?

Recent theories describe perception as an inferential process based on internal predictive models that are adjusted by prediction violations (prediction error). Two different modulations of the auditory N1 event-related brain potential component are often discussed as an expression of auditory predictive processing. The sound-related N1 component is attenuated for self-generated sounds compared to the N1 elicited by externally generated sounds (N1 suppression). An omission-related component in the N1 time-range is elicited when the self-generated sounds are occasionally omitted (omission N1). Both phenomena were explained by action-related forward modelling, which takes place when the sensory input is predictable: prediction error signals are reduced when predicted sensory input is presented (N1 suppression) and elicited when predicted sensory input is omitted (omission N1). This common theoretical account is appealing but has not yet been directly tested. We manipulated the predictability of a sound in a self-generation paradigm in which, in two conditions, either 80% or 50% of the button presses did generate a sound, inducing a strong or a weak expectation for the occurrence of the sound. Consistent with the forward modelling account, an omission N1 was observed in the 80% but not in the 50% condition. However, N1 suppression was highly similar in both conditions. Thus, our results demonstrate a clear effect of predictability for the omission N1 but not for the N1 suppression. These results imply that the two phenomena rely (at least in part) on different mechanisms and challenge prediction related accounts of N1 suppression.

Decoding predicted musical notes from omitted stimulus potentials

Electrophysiological studies have investigated predictive processing in music by examining event-related potentials (ERPs) elicited by the violation of musical expectations. While several studies have reported that the predictability of stimuli can modulate the amplitude of ERPs, it is unclear how specific the representation of the expected note is. The present study addressed this issue by recording the omitted stimulus potentials (OSPs) to avoid contamination of bottom-up sensory processing with top-down predictive processing. Decoding of the omitted content was attempted using a support vector machine, which is a type of machine learning. ERP responses to the omission of four target notes (E, F, A, and C) at the same position in familiar and unfamiliar melodies were recorded from 25 participants. The results showed that the omission N1 were larger in the familiar melody condition than in the unfamiliar melody condition. The decoding accuracy of the four omitted notes was significantly higher in the familiar melody condition than in the unfamiliar melody condition. These results suggest that the OSPs contain discriminable predictive information, and the higher the predictability, the more the specific representation of the expected note is generated.

Systematic review and meta-analysis of the visual mismatch negativity in schizophrenia

Mismatch negativity (MMN) is an event-related potential component automatically elicited by events that violate predictions based on prior events. To elicit this component, researchers use stimulus repetition to induce predictions, and the MMN is obtained by subtracting the brain response to rare or unpredicted stimuli from that of frequent stimuli. Under the Predictive Processing framework, one increasingly popular interpretation of the mismatch response postulates that MMN represents a prediction error. In this context, the reduced MMN amplitude to auditory stimuli has been considered a potential biomarker of Schizophrenia, representing a reduced prediction error and the inability to update the mental model of the world based on the sensory signals. It is unclear, however, whether this amplitude reduction is specific for auditory events or if the visual MMN reveals a similar pattern in schizophrenia spectrum disorder. This review and meta-analysis aimed to summarise the available literature on the vMMN in schizophrenia. A systematic literature search resulted in 10 eligible studies that resulted in a combined effect size of g = -.63, CI [-.86, -.41], reflecting lower vMMN amplitudes in patients. These results are in line with the findings in the auditory domain. This component offers certain advantages, such as less susceptibility to overlap with components generated by attentional demands. Future studies should use vMMN to explore abnormalities in the Predictive Processing framework in different stages and groups of the SSD and increase the knowledge in the search for biomarkers in schizophrenia.

The frequency-following response in late preterm neonates: a pilot study

Introduction

Infants born very early preterm are at high risk of language delays. However, less is known about the consequences of late prematurity. Hence, the aim of the present study is to characterize the neural encoding of speech sounds in late preterm neonates in comparison with those born at term.

Methods

The speech-evoked frequency-following response (FFR) was recorded to a consonant-vowel stimulus /da/ in 36 neonates in three different groups: 12 preterm neonates [mean gestational age (GA) 36.05 weeks], 12 "early term neonates" (mean GA 38.3 weeks), and "late term neonates" (mean GA 41.01 weeks).

Results

From the FFR recordings, a delayed neural response and a weaker stimulus F0 encoding in premature neonates compared to neonates born at term was observed. No differences in the response time onset nor in stimulus F0 encoding were observed between the two groups of neonates born at term. No differences between the three groups were observed in the neural encoding of the stimulus temporal fine structure.

Discussion

These results highlight alterations in the neural encoding of speech sounds related to prematurity, which were present for the stimulus F0 but not for its temporal fine structure.

Sex differences during development in cortical temporal processing and event related potentials in wild-type and fragile X syndrome model mice

BACKGROUND

Autism spectrum disorder (ASD) is currently diagnosed in approximately 1 in 44 children in the United States, based on a wide array of symptoms, including sensory dysfunction and abnormal language development. Boys are diagnosed ~ 3.8 times more frequently than girls. Auditory temporal processing is crucial for speech recognition and language development. Abnormal development of temporal processing may account for ASD language impairments. Sex differences in the development of temporal processing may underlie the differences in language outcomes in male and female children with ASD. To understand mechanisms of potential sex differences in temporal processing requires a preclinical model. However, there are no studies that have addressed sex differences in temporal processing across development in any animal model of ASD.

METHODS

To fill this major gap, we compared the development of auditory temporal processing in male and female wildtype (WT) and Fmr1 knock-out (KO) mice, a model of Fragile X Syndrome (FXS), a leading genetic cause of ASD-associated behaviors. Using epidural screw electrodes, we recorded auditory event related potentials (ERP) and auditory temporal processing with a gap-in-noise auditory steady state response (ASSR) paradigm at young (postnatal (p)21 and p30) and adult (p60) ages from both auditory and frontal cortices of awake, freely moving mice.

RESULTS

The results show that ERP amplitudes were enhanced in both sexes of Fmr1 KO mice across development compared to WT counterparts, with greater enhancement in adult female than adult male KO mice. Gap-ASSR deficits were seen in the frontal, but not auditory, cortex in early development (p21) in female KO mice. Unlike male KO mice, female KO mice show WT-like temporal processing at p30. There were no temporal processing deficits in the adult mice of both sexes.

CONCLUSIONS

These results show a sex difference in the developmental trajectories of temporal processing and hypersensitive responses in Fmr1 KO mice. Male KO mice show slower maturation of temporal processing than females. Female KO mice show stronger hypersensitive responses than males later in development. The differences in maturation rates of temporal processing and hypersensitive responses during various critical periods of development may lead to sex differences in language function, arousal and anxiety in FXS.

Auditory change detection and visual selective attention: association between MMN and N2pc

While the auditory and visual systems each provide distinct information to our brain, they also work together to process and prioritize input to address ever-changing conditions. Previous studies highlighted the trade-off between auditory change detection and visual selective attention; however, the relationship between them is still unclear. Here, we recorded electroencephalography signals from 106 healthy adults in three experiments. Our findings revealed a positive correlation at the population level between the amplitudes of event-related potential indices associated with auditory change detection (mismatch negativity) and visual selective attention (posterior contralateral N2) when elicited in separate tasks. This correlation persisted even when participants performed a visual task while disregarding simultaneous auditory stimuli. Interestingly, as visual attention demand increased, participants whose posterior contralateral N2 amplitude increased the most exhibited the largest reduction in mismatch negativity, suggesting a within-subject trade-off between the two processes. Taken together, our results suggest an intimate relationship and potential shared mechanism between auditory change detection and visual selective attention. We liken this to a total capacity limit that varies between individuals, which could drive correlated individual differences in auditory change detection and visual selective attention, and also within-subject competition between the two, with task-based modulation of visual attention causing within-participant decrease in auditory change detection sensitivity.

Effects of the cardiac cycle on auditory processing: A preregistered study on mismatch negativity

The systolic and diastolic phases of the cardiac cycle are known to affect perception and cognition differently. Higher order processing tends to be facilitated at systole, whereas sensory processing of external stimuli tends to be impaired at systole compared to diastole. The current study aims to examine whether the cardiac cycle affects auditory deviance detection, as reflected in the mismatch negativity (MMN) of the event-related brain potential (ERP). We recorded the intensity deviance response to deviant tones (70 dB) presented among standard tones (60 or 80 dB, depending on blocks) and calculated the MMN by subtracting standard ERP waveforms from deviant ERP waveforms. We also assessed intensity-dependent N1 and P2 amplitude changes by subtracting ERPs elicited by soft standard tones (60 dB) from ERPs elicited by loud standard tones (80 dB). These subtraction methods were used to eliminate phase-locked cardiac-related electric artifacts that overlap auditory ERPs. The endogenous MMN was expected to be larger at systole, reflecting the facilitation of memory-based auditory deviance detection, whereas the exogenous N1 and P2 would be smaller at systole, reflecting impaired exteroceptive sensory processing. However, after the elimination of cardiac-related artifacts, there were no significant differences between systole and diastole in any ERP components. The intensity-dependent N1 and P2 amplitude changes were not obvious in either cardiac phase, probably because of the short interstimulus intervals. The lack of a cardiac phase effect on MMN amplitude suggests that preattentive auditory processing may not be affected by bodily signals from the heart.

Unsupervised Characterization of Prediction Error Markers in Unisensory and Multisensory Streams Reveal the Spatiotemporal Hierarchy of Cortical Information Processing

Elicited upon violation of regularity in stimulus presentation, mismatch negativity (MMN) reflects the brain's ability to perform automatic comparisons between consecutive stimuli and provides an electrophysiological index of sensory error detection whereas P300 is associated with cognitive processes such as updating of the working memory. To date, there has been extensive research on the roles of MMN and P300 individually, because of their potential to be used as clinical markers of consciousness and attention, respectively. Here, we intend to explore with an unsupervised and rigorous source estimation approach, the underlying cortical generators of MMN and P300, in the context of prediction error propagation along the hierarchies of brain information processing in healthy human participants. The existing methods of characterizing the two ERPs involve only approximate estimations of their amplitudes and latencies based on specific sensors of interest. Our objective is twofold: first, we introduce a novel data-driven unsupervised approach to compute latencies and amplitude of ERP components accurately on an individual-subject basis and reconfirm earlier findings. Second, we demonstrate that in multisensory environments, MMN generators seem to reflect a significant overlap of "modality-specific" and "modality-independent" information processing while P300 generators mark a shift toward completely "modality-independent" processing. Advancing earlier understanding that multisensory contexts speed up early sensory processing, our study reveals that temporal facilitation extends to even the later components of prediction error processing, using EEG experiments. Such knowledge can be of value to clinical research for characterizing the key developmental stages of lifespan aging, schizophrenia, and depression.

Dissecting Mismatch Negativity: Early and Late Subcomponents for Detecting Deviants in Local and Global Sequence Regularities

Mismatch negativity (MMN) is commonly recognized as a neural signal of prediction error evoked by deviants from the expected patterns of sensory input. Studies show that MMN diminishes when sequence patterns become more predictable over a longer timescale. This implies that MMN is composed of multiple subcomponents, each responding to different levels of temporal regularities. To probe the hypothesized subcomponents in MMN, we record human electroencephalography during an auditory local-global oddball paradigm where the tone-to-tone transition probability (local regularity) and the overall sequence probability (global regularity) are manipulated to control temporal predictabilities at two hierarchical levels. We find that the size of MMN is correlated with both probabilities and the spatiotemporal structure of MMN can be decomposed into two distinct subcomponents. Both subcomponents appear as negative waveforms, with one peaking early in the central-frontal area and the other late in a more frontal area. With a quantitative predictive coding model, we map the early and late subcomponents to the prediction errors that are tied to local and global regularities, respectively. Our study highlights the hierarchical complexity of MMN and offers an experimental and analytical platform for developing a multitiered neural marker applicable in clinical settings.

A Review of Childhood Developmental Changes in Attention as Indexed in the Electrical Activity of the Brain

This review aims to present age-related changes in the neuroelectric responses of typically developing children (TDC) who are presumed to meet developmental stages appropriately. The review is based on findings from the frequently used neuropsychological tasks of active attention, where attention is deliberately focused versus passive attention where attention is drawn to a stimulus, facilitatory attention, which enhances the processing of a stimulus versus inhibitory attention, which suppresses the processing of a stimulus. The review discusses the early and late stages of attentional selectivity that correspond to early and late information processing. Age-related changes in early attentional selectivity were quantitatively represented in latencies of the event-related potential (ERP) components. Age-related changes in late attentional selectivity are also qualitatively represented by structural and functional reorganization of attentional processing and the brain areas involved. The purely bottom-up or top-down processing is challenged with age-related findings on difficult tasks that ensure a high cognitive load. TDC findings on brain oscillatory activity are enriched by findings from attention deficit hyperactivity disorder (ADHD). The transition from the low to fast oscillations in TDC and ADHD confirmed the maturational lag hypothesis. The deviant topographical localization of the oscillations confirmed the maturational deviance model. The gamma-based match and utilization model integrates all levels of attentional processing. According to these findings and theoretical formulations, brain oscillations can potentially display the human brain's wholistic-integrative functions.

Neural correlates of lexical-tone and vowel-quality processing in 6- and 9-month-old German-learning infants and adults

We examined the neurophysiological underpinnings of lexical-tone and vowel-quality perception in learners of a non-tonal language. We tested 25 6- and 25 9-month-old German-learning infants, as well as 24 German adults and expected developmental differences for the two linguistic properties, as they are both carried by vowels, but have a different status in German. In adults, both lexical-tone and vowel-quality contrasts elicited mismatch negativities, with a stronger response to the vowel-quality contrast. Six-month-olds showed positive mismatch responses for lexical-tone and vowel-quality contrasts, with an emerging negative mismatch response for vowel-quality only. The negative mismatch responses became more pronounced for the vowel-quality contrast at 9 months, while the lexical-tone contrast elicited mainly positive mismatch responses. Our data reveal differential developmental changes in the processing of vowel properties that differ in their lexical relevance in the ambient language.

Morphosyntactic prediction in automatic neural processing of spoken language: EEG evidence

Automatic parsing of syntactic information by the human brain is a well-established phenomenon, but its mechanisms remain poorly understood. Its best-known neurophysiological reflection is early left-anterior negativity (ELAN) ERP component with two alternative hypotheses for its origin: (1) error detection, or (2) morphosyntactic prediction/priming. To test these alternatives, we conducted two experiments using a non-attend passive design with visual distraction and recorded ERPs to spoken pronoun-verb phrases and the same critical verbs presented in isolation without pronouns. The results revealed an ELAN at ∼130-220 ms for pronoun-verb gender agreement violations, confirming a high degree of automaticity in early morphosyntactic parsing. Critically, the strongest ELAN was elicited by verbs outside phrasal context, which suggests that the typical ELAN pattern is underpinned by a reduction of ERP amplitudes for felicitous combinations, reflecting syntactic priming/predictability between related words/morphemes (potentially mediated by associative links formed during previous linguistic experience) rather than specialized error-detection processes.

The developmental cognitive mechanism of learning algebraic rules from the dual-process theory perspective

Rule learning is an important ability that enables human beings to adapt to nature and develop civilizations. There have been many discussions on the mechanism and characteristics of algebraic rule learning, but there are still controversies due to the lack of theoretical guidance. Based on the dual-process theory, this study discussed the following arguments for algebraic rule learning across human and animal studies: whether algebraic rule learning is simply Type 1 processing, whether algebraic rule learning is a domain-general ability, whether algebraic rule learning is shared by humans and animals, and whether an algebraic rule is learned consciously. Moreover, we propose that algebraic rule learning is possibly a cognitive process that combines both Type 1 and Type 2 processing. Further exploration is required to establish the essence and neural basis of algebraic rule learning.

Tracking the habituation of the event-related EEG potential in automatic change detection using an auditory two-tone oddball paradigm

The mismatch negativity and the P3a of the event-related EEG potential reflect the electrocortical response to a deviant stimulus in a series of stimuli. Although both components have been investigated in various paradigms, these paradigms usually incorporate many repetitions of the same deviant, thus leaving open whether both components vary as a function of the deviant's position in a series of deviant stimuli-i.e. whether they are subject to qualitative/quantitative habituation from one instantiation of a deviant to the next. This is so because the detection of mismatch negativity/P3a in the event-related EEG potential requires an averaging over dozens or hundreds of stimuli, i.e. over many instantiations of the deviant per participant. The present study addresses this research gap. We used a two-tone oddball paradigm implementing only a small number of (deviant) stimuli per participant, but applying it to a large number of participants (n > 230). Our data show that the mismatch negativity amplitude exhibits no decrease as a function of the deviant's position in a series of (standard and) deviant stimuli. Importantly, only after the very first deviant stimulus, a distinct P3a could be detected, indicative of an orienting reaction and an attention shift, and thus documenting a dissociation of mismatch negativity and P3a.

Effect of musical expertise on the perception of duration and pitch in language: A cross-linguistic study

This study adopts a cross-linguistic perspective and investigates how musical expertise affects the perception of duration and pitch in language. Native speakers of Chinese (N = 44) and Estonian (N = 46), each group subdivided into musicians and non-musicians, participated in a mismatch negativity (MMN) experiment where they passively listened to both Chinese and Estonian stimuli, followed by a behavioral experiment where they attentively discriminated the stimuli in the non-native language (i.e., Chinese to Estonian participants and Estonian to Chinese participants). In both experiments, stimuli of duration change, pitch change, and duration plus pitch change were discriminated. We found higher behavioral sensitivity among Chinese musicians than non-musicians in perceiving the duration change in Estonian and higher behavioral sensitivity among Estonian musicians than non-musicians in perceiving all types of changes in Chinese, but no corresponding effect was found in the MMN results, which suggests a more salient effect of musical expertise on foreign language processing when attention is required. Secondly, Chinese musicians did not outperform non-musicians in attentively discriminating the pitch-related stimuli in Estonian, suggesting that musical expertise can be overridden by tonal language experience when perceiving foreign linguistic pitch, especially when an attentive discrimination task is administered. Thirdly, we found larger MMN among Chinese and Estonian musicians than their non-musician counterparts in perceiving the largest deviant (i.e., duration plus pitch) in their native language. Taken together, our results demonstrate a positive effect of musical expertise on language processing.

Brain Signatures of Early and Late Neural Measures of Auditory Habituation and Discrimination in Autism and Their Relationship to Autistic Traits and Sensory Overresponsivity

Sensory differences are included in the DSM-5 criteria of autism for the first time, yet it is unclear how they relate to neural indicators of perception. We studied early brain signatures of perception and examined their relationship to sensory behaviors and autistic traits. Thirteen autistic children and 13 Typically Developing (TD) children matched on age and nonverbal IQ participated in a passive oddball task, during which P1 habituation and P1 and MMN discrimination were evoked by pure tones. Autistic children had less neural habituation than the TD comparison group, and the MMN, but not P1, mapped on to sensory overresponsivity. Findings highlight the significance of temporal and contextual factors in neural information processing as it relates to autistic traits and sensory behaviors.

Is source-resolved magnetoencephalographic mismatch negativity a viable biomarker for early psychosis?

Mismatch negativity (MMN) is an auditory event-related response reflecting the pre-attentive detection of novel stimuli and is a biomarker of cortical dysfunction in schizophrenia (SZ). MMN to pitch (pMMN) and to duration (dMMN) deviant stimuli are impaired in chronic SZ, but it is less clear if MMN is reduced in first-episode SZ, with inconsistent findings in scalp-level EEG studies. Here, we investigated the neural generators of pMMN and dMMN with MEG recordings in 26 first-episode schizophrenia spectrum (FEsz) and 26 matched healthy controls (C). We projected MEG inverse solutions into precise functionally meaningful auditory cortex areas. MEG-derived MMN sources were in bilateral primary auditory cortex (A1) and belt areas. In A1, pMMN FEsz reduction showed a trend towards statistical significance (F(1,50) = 3.31; p = .07), and dMMN was reduced in FEsz (F(1,50) = 4.11; p = .04). Hypothesis-driven comparisons at each hemisphere revealed dMMN reduction in FEsz occurred in the left (t(56) = 2.23; p = .03; d = .61) but not right (t(56) = 1.02; p = .31; d = .28) hemisphere, with a moderate effect size. The added precision of MEG source solution with high-resolution MRI and parcellation of A1 may be requisite to detect the emerging pathophysiology and indicates a critical role for left hemisphere pathology at psychosis onset. However, the moderate effect size in left A1, albeit larger than reported in scalp MMN meta-analyses, casts doubt on the clinical utility of MMN for differential diagnosis, as a majority of patients will overlap with the healthy individual's distribution.

Computational Synaptic Modeling of Pitch and Duration Mismatch Negativity in First-Episode Psychosis Reveals Selective Dysfunction of the N-Methyl-D-Aspartate Receptor

Mismatch negativity (MMN) to pitch (pMMN) and to duration (dMMN) deviant stimuli is significantly more attenuated in long-term psychotic illness compared to first-episode psychosis (FEP). It was recently shown that source-modeling of magnetically recorded MMN increases the detection of left auditory cortex MMN deficits in FEP, and that computational circuit modeling of electrically recorded MMN also reveals left-hemisphere auditory cortex abnormalities. Computational modeling using dynamic causal modeling (DCM) can also be used to infer synaptic activity from EEG-based scalp recordings. We measured pMMN and dMMN with EEG from 26 FEP and 26 matched healthy controls (HCs) and used a DCM conductance-based neural mass model including α-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid, N-methyl-D-Aspartate (NMDA), and Gamma-aminobutyric acid receptors to identify any changes in effective connectivity and receptor rate constants in FEP. We modeled MMN sources in bilateral A1, superior temporal gyrus, and inferior frontal gyrus (IFG). No model parameters distinguished groups for pMMN. For dMMN, reduced NMDA receptor activity in right IFG in FEP was detected. This finding is in line with literature of prefrontal NMDA receptor hypofunction in chronic schizophrenia and suggests impaired NMDA-induced synaptic plasticity may be present at psychosis onset where scalp dMMN is only moderately reduced. To the best of our knowledge, this is the first report of impaired NMDA receptor activity in FEP found through computational modeling of dMMN and shows the potential of DCM to non-invasively reveal synaptic-level abnormalities that underly subtle functional auditory processing deficits in early psychosis.

Spontaneously emerging internal models of visual sequences combine abstract and event-specific information in the prefrontal cortex

When exposed to sensory sequences, do macaque monkeys spontaneously form abstract internal models that generalize to novel experiences? Here, we show that neuronal populations in macaque ventrolateral prefrontal cortex jointly encode visual sequences by separate codes for the specific pictures presented and for their abstract sequential structure. We recorded prefrontal neurons while macaque monkeys passively viewed visual sequences and sequence mismatches in the local-global paradigm. Even without any overt task or response requirements, prefrontal populations spontaneously form representations of sequence structure, serial order, and image identity within distinct but superimposed neuronal subspaces. Representations of sequence structure rapidly update following single exposure to a mismatch sequence, while distinct populations represent mismatches for sequences of different complexity. Finally, those representations generalize across sequences following the same repetition structure but comprising different images. These results suggest that prefrontal populations spontaneously encode rich internal models of visual sequences reflecting both content-specific and abstract information.

Neural correlates of novelty detection in the primary auditory cortex of behaving monkeys

The neural mechanisms underlying novelty detection are not well understood, especially in relation to behavior. Here, we present single-unit responses from the primary auditory cortex (A1) from two monkeys trained to detect deviant tones amid repetitive ones. Results show that monkeys can detect deviant sounds, and there is a strong correlation between late neuronal responses (250-350 ms after deviant onset) and the monkeys' perceptual decisions. The magnitude and timing of both neuronal and behavioral responses are increased by larger frequency differences between the deviant and standard tones and by increasing the number of standard tones preceding the deviant. This suggests that A1 neurons encode novelty detection in behaving monkeys, influenced by stimulus relevance and expectations. This study provides evidence supporting aspects of predictive coding in the sensory cortex.

Using multivariate pattern analysis to increase effect sizes for event-related potential analyses

Multivariate pattern analysis (MVPA) approaches can be applied to the topographic distribution of event-related potential (ERP) signals to "decode" subtly different stimulus classes, such as different faces or different orientations. These approaches are extremely sensitive, and it seems possible that they could also be used to increase effect sizes and statistical power in traditional paradigms that ask whether an ERP component differs in amplitude across conditions. To assess this possibility, we leveraged the open-source ERP CORE data set and compared the effect sizes resulting from conventional univariate analyses of mean amplitude with two MVPA approaches (support vector machine decoding and the cross-validated Mahalanobis distance, both of which are easy to compute using open-source software). We assessed these approaches across seven widely studied ERP components (N170, N400, N2pc, P3b, lateral readiness potential, error related negativity, and mismatch negativity). Across all components, we found that multivariate approaches yielded effect sizes that were as large or larger than the effect sizes produced by univariate approaches. These results indicate that researchers could obtain larger effect sizes, and therefore greater statistical power, by using multivariate analysis of topographic voltage patterns instead of traditional univariate analyses in many ERP studies.

Comparing auditory distance perception in real and virtual environments and the role of the loudness cue: A study based on event-related potentials

The perception of the distance to a sound source is relevant in many everyday situations, not only in real spaces, but also in virtual reality (VR) environments. Where real rooms often reach their limits, VR offers far-reaching possibilities to simulate a wide range of acoustic scenarios. However, in virtual room acoustics a plausible reproduction of distance-related cues can be challenging. In the present study, we compared the detection of changes of the distance to a sound source and its neurocognitive correlates in a real and a virtual reverberant environment, using an active auditory oddball paradigm and EEG measures. The main goal was to test whether the experiments in the virtual and real environments produced equivalent behavioral and EEG results. Three loudspeakers were placed at ego-centric distances of 2 m (near), 4 m (center), and 8 m (far) in front of the participants (N = 20), each 66 cm below their ear level. Sequences of 500 ms noise stimuli were presented either from the center position (standards, 80 % of trials) or from the near or far position (targets, 10 % each). The participants had to indicate a target position via a joystick response ("near" or "far"). Sounds were emitted either by real loudspeakers in the real environment or rendered and played back for the corresponding positions via headphones in the virtual environment. In addition, within both environments, loudness of the auditory stimuli was either unaltered (natural loudness) or the loudness cue was manipulated, so that all three loudspeakers were perceived equally loud at the listener's position (matched loudness). The EEG analysis focused on the mismatch negativity (MMN), P3a, and P3b as correlates of deviance detection, attentional orientation, and context-updating/stimulus evaluation, respectively. Overall, behavioral data showed that detection of the target positions was reduced within the virtual environment, and especially when loudness was matched. Except for slight latency shifts in the virtual environment, EEG analysis indicated comparable patterns within both environments and independent of loudness settings. Thus, while the neurocognitive processing of changes in distance appears to be similar in virtual and real spaces, a proper representation of loudness appears to be crucial to achieve a good task performance in virtual acoustic environments.

Regionally specific cortical lateralization of abstract and concrete verb processing: Magnetic mismatch negativity study

The neural underpinnings of processing concrete and abstract semantics remain poorly understood. Previous fMRI studies have shown that multimodal and amodal neural networks respond differentially to different semantic types; importantly, abstract semantics activates more left-lateralized networks, as opposed to more bilateral activity for concrete words. Due to the lack of temporal resolution, these fMRI results do not allow to easily separate language- and task-specific brain responses and to disentangle early processing stages from later post-comprehension phenomena. To tackle this, we used magnetoencephalography (MEG), a time-resolved neuroimaging technique, in combination with a task-free oddball mismatch negativity (MMN) paradigm, an established approach to tracking early automatic activation of word-specific memory traces in the brain. We recorded the magnetic MMN responses in 30 healthy adults to auditorily presented abstract and concrete action verbs to assess lateralization of word-specific lexico-semantic processing in a set of neocortical areas. We found that MMN responses to these stimuli showed different lateralization patterns of activity in the upper limb motor area (BA4) and parts of Broca's area (BA45/BA47) within ∼100-350 ms after the word disambiguation point. Importantly, the greater leftward response lateralization for abstract semantics was due to the lesser involvement of the right-hemispheric homologues, not increased left-hemispheric activity. These findings suggest differential region-specific involvement of bilateral sensorimotor systems already in the early automatic stages of processing abstract and concrete action semantics.

Using Multivariate Pattern Analysis to Increase Effect Sizes for Event-Related Potential Analyses

Multivariate pattern analysis approaches can be applied to the topographic distribution of event-related potential (ERP) signals to 'decode' subtly different stimulus classes, such as different faces or different orientations. These approaches are extremely sensitive, and it seems possible that they could also be used to increase effect sizes and statistical power in traditional paradigms that ask whether an ERP component differs in amplitude across conditions. To assess this possibility, we leveraged the open-source ERP CORE dataset and compared the effect sizes resulting from conventional univariate analyses of mean amplitude with two multivariate pattern analysis approaches (support vector machine decoding and the cross-validated Mahalanobis distance, both of which are easy to compute using open-source software). We assessed these approaches across seven widely studied ERP components (N170, N400, N2pc, P3b, lateral readiness potential, error related negativity, and mismatch negativity). Across all components, we found that multivariate approaches yielded effect sizes that were as large or larger than the effect sizes produced by univariate approaches. These results indicate that researchers could obtain larger effect sizes, and therefore greater statistical power, by using multivariate analysis of topographic voltage patterns instead of traditional univariate analyses in many ERP studies.

The effects of positions on deviant processing in mostly incompatible blocks in the flanker task

It is assumed that focused attention is induced by mostly incompatible (MI) blocks in the flanker task. This study aimed to examine the differences in deviant processing between positions of a stimulus in MI blocks. Thirty-nine adults participated in this study. Compatible and incompatible stimuli were classified into three types: typical (central and surrounding colors: black), central-deviant (central: red; surrounding: black), and surrounding-deviant (central: black; surrounding: red). Rare and equiprobable conditions were set for MI blocks. Central- and surrounding-deviant stimuli were presented with low probabilities in the rare condition and with identical probabilities to that of typical stimuli in the equiprobable condition. Deviant processing was evaluated by comparing between event-related potentials in rare and equiprobable conditions. The posterior negativity from 120 to 170 ms (i.e., N1) for central-deviant stimuli was significantly more negative in the rare condition than in the equiprobable condition, whereas there was no difference for surrounding-deviant stimuli. Conversely, the posterior negativity from 180 to 230 ms for both stimuli was significantly more negative in the rare condition than in the equiprobable condition, and the difference (i.e., visual mismatch negativity) was similar in central- and surrounding-deviant stimuli. These findings suggest that focused attention induced by MI blocks leads to differences in deviant processing between central and surrounding areas during the N1 time range. Therefore, evaluations of deviant processing can help examine processing in central and surrounding areas independently and are valuable for understanding cognitive control mechanisms in the flanker tasks.

Twenty-month-olds categorically discriminate similar sounding vowels regardless of vocabulary level, an event related potentials (ERP) study

The current study investigated whether vocabulary relates to phonetic categorization at neural level in early childhood. Electoencephalogram (EEG) responses were collected from 53 Dutch 20-month-old children in a passive oddball paradigm, in which they were presented with two nonwords "giep" [ɣip] and "gip" [ɣɪp] that were contrasted solely by the vowel. In the multiple-speaker condition, both nonwords were produced by twelve different speakers; while, in the single-speaker condition, one single token of each word was used as stimuli. Infant positive mismatch responses (p-MMR) were elicited in both conditions without significant amplitude differences. When the infants were median split based on vocabulary level, the large and small vocabulary groups showed comparable p-MMR amplitudes yet different scalp distribution in both conditions. These results suggest successful phonetic categorization of native similar sounding vowels at 20 months, and a close relationship between speech categorization and vocabulary development.

The perceptual timescape: Perceptual history on the sub-second scale

There is a high-capacity store of brief time span (∼1000 ms) which information enters from perceptual processing, often called iconic memory or sensory memory. It is proposed that a main function of this store is to hold recent perceptual information in a temporally segregated representation, named the perceptual timescape. The perceptual timescape is a continually active representation of change and continuity over time that endows the perceived present with a perceived history. This is accomplished primarily by two kinds of time marking information: time distance information, which marks all items of information in the perceptual timescape according to how far in the past they occurred, and ordinal temporal information, which organises items of information in terms of their temporal order. Added to that is information about connectivity of perceptual objects over time. These kinds of information connect individual items over a brief span of time so as to represent change, persistence, and continuity over time. It is argued that there is a one-way street of information flow from perceptual processing either to the perceived present or directly into the perceptual timescape, and thence to working memory. Consistent with that, the information structure of the perceptual timescape supports postdictive reinterpretations of recent perceptual information. Temporal integration on a time scale of hundreds of milliseconds takes place in perceptual processing and does not draw on information in the perceptual timescape, which is concerned with temporal segregation, not integration.

Predicting and coding sound into action translation in spinal cord injured people

Motor activation in response to perception of action-related stimuli may depend on a resonance mechanism subserving action understanding. The extent to which this mechanism is innate or learned from sensorimotor experience is still unclear. Here, we recorded EEG while people with paraplegia or tetraplegia consequent to spinal cord injury (SCI) and healthy control participants were presented with action sounds produced by body parts (mouth, hands or feet) that were or were not affected by SCI. Non-action sounds were used as further control. We observed reduced brain activation in subjects affected by SCI at both pre- and post-stimulus latencies specifically for those actions whose effector was disconnected by the spinal lesion (i.e., hand sound for tetraplegia and leg sound for both paraplegia and tetraplegia). Correlation analyses showed that these modulations were functionally linked with the chronicity of the lesion, indicating that the longer the time the lesion- EEG data acquisition interval and/or the more the lesion occurred at a young age, the weaker was the cortical activity in response to these action sounds. Tellingly, source estimations confirmed that these modulations originated from a deficit in the motor resonance mechanism, by showing diminished activity in premotor (during prediction and perception) and near the primary motor (during perception) areas. Such dissociation along the cortical hierarchy is consistent with both previous reports in healthy subjects and with hierarchical predictive coding accounts. Overall, these data expand on the notion that sensorimotor experience maintains the cortical representations relevant to anticipate and perceive action-related stimuli.

Assessing mismatch negativity (MMN) and P3b within-individual sensitivity - A comparison between the local-global paradigm and two specialized oddball sequences

Mismatch negativity (MMN) and P3b are well known for their clinical utility. There exists no gold standard, however, for acquiring them as EEG markers of consciousness in clinical settings. This may explain why the within-individual sensitivity of MMN/P3b paradigms is often quite poor and why seemingly identical EEG markers can behave differently across Disorders of consciousness (DoC) studies. Here, we compare two traditional paradigms for MMN or P3b assessment with the recently more popular local-global paradigm that promises to assess MMN and P3b orthogonally within one oddball sequence. All three paradigms were administered to healthy participants (N = 15) with concurrent EEG. A clear MMN and local effect were found for 15/15 participants. The P3b and global effect were found for 14/15 and 13/15 participants, respectively. There were no systematic differences between the global effect and P3b. Indeed, P3b amplitude was highly correlated across paradigms. The local effect differed clearly from the MMN, however. It occurred earlier than MMN and was followed by a much more prominent P3a. The peak latencies and amplitudes were also not correlated across paradigms. Caution should therefore be exercised when comparing the local effect and MMN across studies. We conclude that the within-individual MMN sensitivity is adequate for both the local-global and a dedicated MMN paradigm. The within-individual sensitivity of P3b was lower than expected for both the local-global and a dedicated P3b paradigm, which may explain the often-low sensitivity of P3b paradigms in patients with DoC.

Order effects in task-free learning: Tuning to information-carrying sound features

Event-related potentials (ERPs) acquired during task-free passive listening can be used to study how sensitivity to common pattern repetitions and rare deviations changes over time. These changes are purported to represent the formation and accumulation of precision in internal models that anticipate future states based on probabilistic and/or statistical learning. This study features an unexpected finding; a strong order-dependence in the speed with which deviant responses are elicited that anchors to first learning. Participants heard four repetitions of a sequence in which an equal number of short (30 msec) and long (60 msec) pure tones were arranged into four blocks in which one was common (the standard, p = .875) and the other rare (the deviant, p = .125) with probabilities alternating across blocks. Some participants always heard the sequences commencing with the 30 msec deviant block, and others always with the 60 msec deviant block first. A deviance-detection component known as mismatch negativity (MMN) was extracted from responses and the point in time at which MMN reached maximum amplitude was used as the dependent variable. The results show that if participants heard sequences commencing with the 60 msec deviant block first, the MMN to the 60 msec and 30 msec deviant peaked at an equivalent latency. However, if participants heard sequences commencing with the 30 msec deviant first, the MMN peaked earlier to the 60 msec deviant. Furthermore, while the 30 msec MMN latency did not differ as a function of sequence composition, the 60 msec MMN latency did and was earlier when the sequences began with a 30 msec deviant first. By examining MMN latency effects as a function of age and hearing level it was apparent that the differentiation in 30 msec and 60 msec MMN latency expands with older age and raised hearing threshold due to prolongation of the time taken for the 30 msec MMN to peak. The observations are discussed with reference to how the initial sound composition may tune the auditory system to be more sensitive to different cues (i.e., offset responses vs perceived loudness). The order-effect demonstrates a remarkably powerful anchoring to first learning that might reflect initial tuning to the most valuable discriminating feature within a given listening environment, an effect that defies explanation based on statistical information alone.

Cardio-audio synchronization elicits neural and cardiac surprise responses in human wakefulness and sleep

The human brain can encode auditory regularities with fixed sound-to-sound intervals and with sound onsets locked to cardiac inputs. Here, we investigated auditory and cardio-audio regularity encoding during sleep, when bodily and environmental stimulus processing may be altered. Using electroencephalography and electrocardiography in healthy volunteers (N = 26) during wakefulness and sleep, we measured the response to unexpected sound omissions within three regularity conditions: synchronous, where sound and heartbeat are temporally coupled, isochronous, with fixed sound-to-sound intervals, and a control condition without regularity. Cardio-audio regularity encoding manifested as a heartbeat deceleration upon omissions across vigilance states. The synchronous and isochronous sequences induced a modulation of the omission-evoked neural response in wakefulness and N2 sleep, the former accompanied by background oscillatory activity reorganization. The violation of cardio-audio and auditory regularity elicits cardiac and neural responses across vigilance states, laying the ground for similar investigations in altered consciousness states such as coma and anaesthesia.

Frequency-specific contributions to auditory perceptual priors: Testing the predictive-coding hypothesis

Perceptual priors formed by recent stimuli bias our immediate percept. These priors, expressing our implicit expectations, affect both high- and low-level processing stages. Yet, the nature of the inter-level interaction is unknown. Do priors operate top-down and bias low-level features toward recently experienced objects (predictive-coding hypothesis), or are low-level biases bottom-up driven and formed by local memory circuits? To decipher between these options in auditory perception, we used the "missing fundamental illusion", enabling the dissociation of low-level components from the high-level pitch. Surprisingly, in contrast to predictive coding, when the fundamental frequency was missing, pitch contraction across timbre categories was not found to the previously perceived high-level pitch, but to the physically present frequency. This bottom-up contribution of low-level memory components to perceptual priors, operating independently of recent high-level percepts, may stabilize the perceptual organization and underlie continuity between similar low-level features belonging to different object categories in the auditory modality.

Shared attention in virtual immersive reality enhances electrophysiological correlates of implicit sensory learning

Shared attention effects on learning and memory demonstrate that experiences are amplified when we are not alone. Virtual reality poses new challenges to the study of co-presence. Above all, is coattending together with someone else's avatar in an immersive VR setting comparable with shared experiences at a neural processing level? In the present study we investigate shared attention effects in VR for the first time. We recorded mismatch negativities (MMN) during an auditory roving paradigm, a well-known index of implicit perceptual learning. EEG responses to deviant and standard sounds were registered while subjects were alone (Solo condition) or together (Other condition) with a virtual avatar (Virtual scenario) or physically present confederate (Physical scenario). We found an overall main effect of co-presence on MMN revealed by a point-by-point 2 × 2 ANOVA, thereby replicating previous studies on physical co-presence. Additionally, we found no significant interaction between the scenario (Physical vs. Virtual) and co-presence (Solo vs. Other). Our results indicate that virtual immersive co-presence mimics physical co-presence.

Intact Somatosensory Temporal Sensitivity in Adults on the Autism Spectrum: A High-Density Electrophysiological Mapping Study Using the Mismatch Negativity (MMN) Sensory Memory Paradigm

Atypical reactivity to somatosensory inputs is common in autism spectrum disorder and carries considerable impact on downstream social communication and quality of life. While behavioral and survey work have established differences in the perception of somatosensory information, little has been done to elucidate the underlying neurophysiological processes that drive these characteristics. Here, we implemented a duration-based somatosensory mismatch negativity paradigm to examine the role of temporal sensitivity and sensory memory in the processing of vibrotactile information in autistic (n=30) and neurotypical (n=30) adults. To capture the variability in responses between groups across a range of duration discrepancies, we compared the electrophysiological responses to frequent standard vibrations (100 ms) and four infrequent deviant vibrations (115, 130, 145, and 160 ms). The same stimuli were used in a follow-up behavioral task to determine active detection of the infrequent vibrations. We found no differences between the two groups with regard to discrimination between standard and deviant vibrations, demonstrating comparable neurologic and behavioral temporal somatosensory perception. However, exploratory analyses yielded subtle differences in amplitude at the N1 and P220 time points. Together, these results indicate that the temporal mechanisms of somatosensory discrimination are conserved in adults on the autism spectrum, though more general somatosensory processing may be affected. We discuss these findings in the broader context of the MMN literature in autism, as well as the potential role of cortical maturity in somatosensory mechanisms.

That sounds awful! Does sound unpleasantness modulate the mismatch negativity and its habituation?

There are sounds that most people perceive as highly unpleasant, for instance, the sound of rubbing pieces of polystyrene together. Previous research showed larger physiological and neural responses for such aversive compared to neutral sounds. Hitherto, it remains unclear whether habituation, i.e., diminished responses to repeated stimulus presentation, which is typically reported for neutral sounds, occurs to the same extent for aversive stimuli. We measured the mismatch negativity (MMN) in response to rare occurrences of aversive or neutral deviant sounds within an auditory oddball sequence in 24 healthy participants, while they performed a demanding visual distractor task. Deviants occurred as single events (i.e., between two standards) or as double deviants (i.e., repeating the identical deviant sound in two consecutive trials). All deviants elicited a clear MMN, and amplitudes were larger for aversive than for neutral deviants (irrespective of their position within a deviant pair). This supports the claim of preattentive emotion evaluation during early auditory processing. In contrast to our expectations, MMN amplitudes did not show habituation, but increased in response to deviant repetition-similarly for aversive and neutral deviants. A more fine-grained analysis of individual MMN amplitudes in relation to individual arousal and valence ratings of each sound item revealed that stimulus-specific MMN amplitudes were best predicted by the interaction of deviant position and perceived arousal, but not by valence. Deviants with perceived higher arousal elicited larger MMN amplitudes only at the first deviant position, indicating that the MMN reflects preattentive processing of the emotional content of sounds.

Autistic traits and event-related potentials in the general population: A scoping review and meta-analysis

BACKGROUND

Differences in short and long-latency Event-Related Potentials (ERPs) can help us infer abnormalities in brain processing, considering early and later stages of stimuli processing across tasks and conditions. In autism research, the adult population remains largely understudied compared to samples at early stages of development. In this context, this scoping review briefly summarises what has been described in community and subclinical adult samples of autism.

METHOD

The current scoping review and meta-analysis includes 50 records (N = 1652) and comprehensively explores short and long-latency ERP amplitudes and their relationship with autistic traits in adult community samples.

RESULTS

This meta-analysis identified, with small to medium effect sizes, distinctive patterns in late ERP amplitudes, indicating enhanced responses to visual stimuli and the opposite patterns to auditory tasks in the included sample. Additionally, a pattern of higher amplitudes was also found for the component P3b in autistic traits.

DISCUSSION

Differential effects in visual and auditory domains are explored in light of the predictive processing framework for Autism. It remains possible that different brain mechanisms operate to explain symptoms related with different sensory modalities. P3b is discussed as a possible component of interest in future studies as it revealed a more robust effect for differentiating severity in the expression of autistic traits in adulthood.

Mismatch negativity and polygenic risk scores for schizophrenia and bipolar disorder

OBJECTIVE

Auditory mismatch negativity (MMN) impairment is a candidate endophenotype in psychotic disorders, yet the genetic underpinnings remain to be clarified. Here, we examined the relationships between auditory MMN and polygenic risk scores (PRS) for individuals with psychotic disorders, including schizophrenia spectrum disorders (SSD) and bipolar disorder (BD) and in healthy controls (HC).

METHODS

Genotyped and clinically well-characterized individuals with psychotic disorders (n = 102), including SSD (n = 43) and BD (n = 59), and HC (n = 397) underwent a roving MMN paradigm. In addition MMN, we measured the memory traces of the repetition positivity (RP) and the deviant negativity (DN), which is believed to reflect prediction encoding and prediction error signals, respectively. SCZ and BD PRS were computed using summary statistics from the latest genome-wide association studies. The relationships between the MMN, RP, and DN and the PRSs were assessed with linear regressions.

RESULTS

We found no significant association between the SCZ or BD PRS and grand average MMN in the psychotic disorders group or in the HCs group (all p > 0.05). SCZ PRS and BD PRS were negatively associated with RP in the psychotic disorders group (β = -0.46, t = -2.86, p = 0.005 and β = -0.29, t = -0.21, p = 0.034, respectively). No significant associations were found between DN and PRS.

CONCLUSION

These findings suggest that genetic variants associated with SCZ and BD may be associated with MMN subcomponents linked to predictive coding among patients with psychotic disorders. Larger studies are needed to confirm these findings and further elucidate the genetic underpinnings of MMN impairment in psychotic disorders.

The aesthetic valve: how aesthetic appreciation may switch emotional states from anxiety to curiosity

Pursuing new knowledge in the entropic environment is pivotal for survival. However, dealing with uncertainty is a costly challenge for the agent surrounded by the stochastic sensory world, giving rise to different epistemic emotions, such as curiosity and anxiety. We recently proposed that aesthetic appreciation may have the role of associating pleasant feedback with the update of predictive representations. According to this idea, aesthetic appreciation and its associated rewarding feeling could drive people to seek new knowledge over anxiety. However, the relationship between aesthetic appreciation, curiosity, and anxiety has been still under-examined in the literature. Here, we explore the relationship between these epistemic emotions in a series of three experiments. In study 1, we examined whether music-induced aesthetic appreciation would influence curiosity in a gambling task. In studies 2a and 2b, we explore the relationship between music-induced aesthetic appreciation and anxiety state. Overall, aesthetic appreciation promoted curiosity-driven behaviour while it was negatively associated with anxiety. These results were consistent with the idea that aesthetic appreciation could act as a 'valve', prompting the individual to perceive curiosity (i.e. to consider novelty as a valuable opportunity to acquire new knowledge) rather than anxiety (i.e. to consider novelty as a risk to be avoided). This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

Development, Insults and Predisposing Factors of the Brain's Predictive Coding System to Chronic Perceptual Disorders-A Life-Course Examination

The predictive coding theory is currently widely accepted as the theoretical basis of perception and chronic perceptual disorders are explained as the maladaptive compensation of the brain to a prediction error. Although this gives us a general framework to work with, it is still not clear who may be more susceptible and/or vulnerable to aberrations in this system. In this paper, we study changes in predictive coding through the lens of tinnitus and pain. We take a step back to understand how the predictive coding system develops from infancy, what are the different neural and bio markers that characterise this system in the acute, transition and chronic phases and what may be the factors that pose a risk to the aberration of this system. Through this paper, we aim to identify people who may be at a higher risk of developing chronic perceptual disorders as a reflection of aberrant predictive coding, thereby giving future studies more facets to incorporate in their investigation of early markers of tinnitus, pain and other disorders of predictive coding. We therefore view this paper to encourage the thinking behind the development of preclinical biomarkers to maladaptive predictive coding.

High-density ear-EEG for understanding ear-centered EEG

Background. Mobile ear-EEG provides the opportunity to record EEG unobtrusively in everyday life. However, in real-life, the EEG data quickly becomes difficult to interpret, as the neural signal is contaminated by other, non-neural signal contributions. Due to the small number of electrodes in ear-EEG devices, the interpretation of the EEG becomes even more difficult. For meaningful and reliable ear-EEG, it is crucial that the brain signals we wish to record in real life are well-understood and that we make optimal use of the available electrodes. Their placement should be guided by prior knowledge about the characteristics of the signal of interest.Objective.We want to understand the signal we record with ear-EEG and make recommendations on how to optimally place a limited number of electrodes.Approach.We built a high-density ear-EEG with 31 channels spaced densely around one ear. We used it to record four auditory event-related potentials (ERPs): the mismatch negativity, the P300, the N100 and the N400. With this data, we gain an understanding of how different stages of auditory processing are reflected in ear-EEG. We investigate the electrode configurations that carry the most information and use a mass univariate ERP analysis to identify the optimal channel configuration. We additionally use a multivariate approach to investigate the added value of multi-channel recordings.Main results.We find significant condition differences for all ERPs. The different ERPs vary considerably in their spatial extent and different electrode positions are necessary to optimally capture each component. In the multivariate analysis, we find that the investigation of the ERPs benefits strongly from multi-channel ear-EEG.Significance.Our work emphasizes the importance of a strong theoretical and practical background when building and using ear-EEG. We provide recommendations on finding the optimal electrode positions. These results will guide future research employing ear-EEG in real-life scenarios.

Probing the Neurophysiology of Temporal Sensitivity in the Somatosensory System Using the Mismatch Negativity (MMN) Sensory Memory Paradigm

Duration is an amodal feature common to all sensory experiences, but low-level processing of the temporal qualities of somatosensation remains poorly understood. The goal of the present study was to evaluate electrophysiological discrimination of parametric somatosensory stimuli to better understand how the brain processes the duration of tactile information. This research used a somatosensory mismatch negativity (sMMN) paradigm to evaluate electrophysiological sensitivity to differences in the duration of vibrotactile stimuli in healthy young adults. Specifically, a 100 ms standard vibration was presented 80% of the time while the remaining 20% of presentations were made up of deviant stimuli with one of the following durations: 115, 130, 145, or 160 ms. When a deviation from the anticipated tactile input is detected, the distinct electrophysiological signature of the sMMN is present. A companion behavioral task assessed individual thresholds for cognizant awareness of the standard and deviant vibrotactile stimuli. The results of the present study demonstrated a sMMN response when deviant stimuli were 130, 145, and 160 ms, but not when they were 115 ms. This suggests that on average the participants did not electrophysiologically discriminate between the 100 and 115 ms. Future work may apply this paradigm to better understand atypical tactile sensitivity in various clinical conditions.

Characteristics of different Mandarin pronunciation element perception: evidence based on a multifeature paradigm for recording MMN and P3a components of phonemic changes in speech sounds

Background

As a tonal language, Mandarin Chinese has the following pronunciation elements for each syllable: the vowel, consonant, tone, duration, and intensity. Revealing the characteristics of auditory-related cortical processing of these different pronunciation elements is interesting.

Methods

A Mandarin pronunciation multifeature paradigm was designed, during which a standard stimulus and five different phonemic deviant stimuli were presented. The electroencephalogram (EEG) data were recorded with 256-electrode high-density EEG equipment. Time-domain and source localization analyses were conducted to demonstrate waveform characteristics and locate the sources of the cortical processing of mismatch negativity (MMN) and P3a components following different stimuli.

Results

Vowel and consonant differences elicited distinct MMN and P3a components, but tone and duration differences did not. Intensity differences elicited distinct MMN components but not P3a components. For MMN and P3a components, the activated cortical areas were mainly in the frontal-temporal lobe. However, the regions and intensities of the cortical activation were significantly different among the components for the various deviant stimuli. The activated cortical areas of the MMN and P3a components elicited by vowels and consonants seemed to be larger and show more intense activation.

Conclusion

The auditory processing centers use different auditory-related cognitive resources when processing different Mandarin pronunciation elements. Vowels and consonants carry more information for speech comprehension; moreover, more neurons in the cortex may be involved in the recognition and cognitive processing of these elements.