Spatiotemporal brain hierarchies of auditory memory recognition and predictive coding

Our brain is constantly extracting, predicting, and recognising key spatiotemporal features of the physical world in order to survive. While neural processing of visuospatial patterns has been extensively studied, the hierarchical brain mechanisms underlying conscious recognition of auditory sequences and the associated prediction errors remain elusive. Using magnetoencephalography (MEG), we describe the brain functioning of 83 participants during recognition of previously memorised musical sequences and systematic variations. The results show feedforward connections originating from auditory cortices, and extending to the hippocampus, anterior cingulate gyrus, and medial cingulate gyrus. Simultaneously, we observe backward connections operating in the opposite direction. Throughout the sequences, the hippocampus and cingulate gyrus maintain the same hierarchical level, except for the final tone, where the cingulate gyrus assumes the top position within the hierarchy. The evoked responses of memorised sequences and variations engage the same hierarchical brain network but systematically differ in terms of temporal dynamics, strength, and polarity. Furthermore, induced-response analysis shows that alpha and beta power is stronger for the variations, while gamma power is enhanced for the memorised sequences. This study expands on the predictive coding theory by providing quantitative evidence of hierarchical brain mechanisms during conscious memory and predictive processing of auditory sequences.

Localization of Brain Signals by Alternating Projection

A popular approach for modeling brain activity in MEG and EEG is based on a small set of current dipoles, where each dipole represents the combined activation of a local area of the brain. Here, we address the problem of multiple dipole localization with a novel solution called Alternating Projection (AP). The AP solution is based on minimizing the least-squares (LS) criterion by transforming the multi-dimensional optimization required for direct LS solution, to a sequential and iterative solution in which one source at a time is localized, while keeping the other sources fixed. Results from simulated, phantom, and human MEG data demonstrated the high accuracy of the AP method, with superior localization results than popular scanning methods from the multiple-signal classification (MUSIC) and beamformer families. In addition, the AP method was more robust to forward model errors resulting from head rotations and translations, as well as different cortex tessellation grids for the forward and inverse solutions, with consistently higher localization accuracy in low SNR and highly correlated sources.

LOCALIZATION OF SPATIALLY EXTENDED BRAIN SOURCES BY FLEXIBLE ALTERNATING PROJECTION (FLEX-AP)

Magnetoencephalography (MEG) and electroencephalography (EEG) are widely employed techniques for the in-vivo measurement of neural activity with exceptional temporal resolution. Modeling the neural sources underlying these signals is of high interest for both neuroscience research and pathology. The method of Alternating Projection (AP) was recently shown to outperform the well-established recursively applied and projected multiple signal classification (RAP-MUSIC) algorithm. In this work, we further enhanced AP to allow for source extent estimation, a novel approach termed flexible extent AP (FLEX-AP). We found that FLEX-AP achieves significantly lower errors for spatially coherent sources compared to AP, RAP-MUSIC, and the corresponding extension, FLEX-RAP-MUSIC. We also found an advantage for discrete dipoles under forward modeling errors encountered in real-world scenarios. Together, our results indicate that the FLEX-AP method can unify dipole fitting and distributed source imaging into a single algorithm with promising accuracy.

The dual-path hypothesis for the emergence of anosognosia in Alzheimer's disease

Although neurocognitive models have been proposed to explain anosognosia in Alzheimer's disease (AD), the neural cascade responsible for its origin in the human brain remains unknown. Here, we build on a mechanistic dual-path hypothesis that brings error-monitoring and emotional processing systems as key elements for self-awareness, with distinct impacts on the emergence of anosognosia in AD. Proceeding from the notion of anosognosia as a dimensional syndrome, varying between a lack of concern about one's own deficits (i.e., anosodiaphoria) and a complete lack of awareness of deficits, our hypothesis states that (i) unawareness of deficits would result from primary damage to the error-monitoring system, whereas (ii) anosodiaphoria would more likely result from an imbalance between emotional processing and error-monitoring. In the first case, a synaptic failure in the error-monitoring system, in which the anterior and posterior cingulate cortices play a major role, would have a negative impact on error (or deficits) awareness, preventing patients from becoming aware of their condition. In the second case, an impairment in the emotional processing system, in which the amygdala and the orbitofrontal cortex play a major role, would prevent patients from monitoring the internal milieu for relevant errors (or deficits) and assigning appropriate value to them, thus biasing their impact on the error-monitoring system. Our hypothesis stems on two scientific premises. One comes from preliminary results in AD patients showing a synaptic failure in the error-monitoring system along with a decline of awareness for cognitive difficulties at the time of diagnosis. Another comes from the somatic marker hypothesis, which proposes that emotional signals are critical to adaptive behavior. Further exploration of these premises will be of great interest to illuminate the foundations of self-awareness and improve our knowledge of the underlying paths of anosognosia in AD and other brain disorders.

Hyperbolic graph embedding of MEG brain networks to study brain alterations in individuals with subjective cognitive decline

An expansive area of research focuses on discerning patterns of alterations in functional brain networks from the early stages of Alzheimer's disease, even at the subjective cognitive decline (SCD) stage. Here, we developed a novel hyperbolic MEG brain network embedding framework for transforming high-dimensional complex MEG brain networks into lower-dimensional hyperbolic representations. Using this model, we computed hyperbolic embeddings of the MEG brain networks of two distinct participant groups: individuals with SCD and healthy controls. We demonstrated that these embeddings preserve both local and global geometric information, presenting reduced distortion compared to rival models, even when brain networks are mapped into low-dimensional spaces. In addition, our findings showed that the hyperbolic embeddings encompass unique SCD-related information that improves the discriminatory power above and beyond that of connectivity features alone. Notably, we introduced a unique metric-the radius of the node embeddings-which effectively proxies the hierarchical organization of the brain. Using this metric, we identified subtle hierarchy organizational differences between the two participant groups, suggesting increased hierarchy in the dorsal attention, frontoparietal, and ventral attention subnetworks among the SCD group. Last, we assessed the correlation between these hierarchical variations and cognitive assessment scores, revealing associations with diminished performance across multiple cognitive evaluations in the SCD group. Overall, this study presents the first evaluation of hyperbolic embeddings of MEG brain networks, offering novel insights into brain organization, cognitive decline, and potential diagnostic avenues of Alzheimer's disease.

An F-ratio-based method for estimating the number of active sources in MEG

Introduction

Magnetoencephalography (MEG) is a powerful technique for studying the human brain function. However, accurately estimating the number of sources that contribute to the MEG recordings remains a challenging problem due to the low signal-to-noise ratio (SNR), the presence of correlated sources, inaccuracies in head modeling, and variations in individual anatomy.

Methods

To address these issues, our study introduces a robust method for accurately estimating the number of active sources in the brain based on the F-ratio statistical approach, which allows for a comparison between a full model with a higher number of sources and a reduced model with fewer sources. Using this approach, we developed a formal statistical procedure that sequentially increases the number of sources in the multiple dipole localization problem until all sources are found.

Results

Our results revealed that the selection of thresholds plays a critical role in determining the method's overall performance, and appropriate thresholds needed to be adjusted for the number of sources and SNR levels, while they remained largely invariant to different inter-source correlations, translational modeling inaccuracies, and different cortical anatomies. By identifying optimal thresholds and validating our F-ratio-based method in simulated, real phantom, and human MEG data, we demonstrated the superiority of our F-ratio-based method over existing state-of-the-art statistical approaches, such as the Akaike Information Criterion (AIC) and Minimum Description Length (MDL).

Discussion

Overall, when tuned for optimal selection of thresholds, our method offers researchers a precise tool to estimate the true number of active brain sources and accurately model brain function.

Can a failure in the error-monitoring system explain unawareness of memory deficits in Alzheimer's disease?

Unawareness of memory deficits is an early manifestation in patients with Alzheimer's disease (AD), which often delays diagnosis. This intriguing behavior constitutes a form of anosognosia, whose neural mechanisms remain largely unknown. We hypothesized that anosognosia may depend on a critical synaptic failure in the error-monitoring system, which would prevent AD patients from being aware of their own memory impairment. To investigate, we measured event-related potentials (ERPs) evoked by erroneous responses during a word memory recognition task in two groups of amyloid positive individuals with only subjective memory complaints at study entry: those who progressed to AD within the five-year study period (PROG group), and those who remained cognitively normal (CTRL group). A significant reduction in the amplitude of the positivity error (Pe), an ERP related to error awareness, was observed in the PROG group at the time of AD diagnosis (vs study entry) in intra-group analysis, as well as when compared with the CTRL group in inter-group analysis, based on the last EEG acquisition for all subjects. Importantly, at the time of AD diagnosis, the PROG group exhibited clinical signs of anosognosia, overestimating their cognitive abilities, as evidenced by the discrepancy scores obtained from caregiver/informant vs participant reports on the cognitive subscale of the Healthy Aging Brain Care Monitor. To our knowledge, this is the first study to reveal the emergence of a failure in the error-monitoring system during a word memory recognition task at the early stages of AD. This finding, along with the decline of awareness for cognitive impairment observed in the PROG group, strongly suggests that a synaptic dysfunction in the error-monitoring system may be the critical neural mechanism at the origin of unawareness of deficits in AD.

Functional identification of language-responsive channels in individual participants in MEG investigations

Making meaningful inferences about the functional architecture of the language system requires the ability to refer to the same neural units across individuals and studies. Traditional brain imaging approaches align and average brains together in a common space. However, lateral frontal and temporal cortex, where the language system resides, is characterized by high structural and functional inter-individual variability. This variability reduces the sensitivity and functional resolution of group-averaging analyses. This problem is compounded by the fact that language areas often lay in close proximity to regions of other large-scale networks with different functional profiles. A solution inspired by other fields of cognitive neuroscience (e.g., vision) is to identify language areas functionally in each individual brain using a 'localizer' task (e.g., a language comprehension task). This approach has proven productive in fMRI, yielding a number of discoveries about the language system, and has been successfully extended to intracranial recording investigations. Here, we apply this approach to MEG. Across two experiments (one in Dutch speakers, n=19; one in English speakers, n=23), we examined neural responses to the processing of sentences and a control condition (nonword sequences). We demonstrated that the neural response to language is spatially consistent at the individual level. The language-responsive sensors of interest were, as expected, less responsive to the nonwords condition. Clear inter-individual differences were present in the topography of the neural response to language, leading to greater sensitivity when the data were analyzed at the individual level compared to the group level. Thus, as in fMRI, functional localization yields benefits in MEG and thus opens the door to probing fine-grained distinctions in space and time in future MEG investigations of language processing.

Deep learning-based electroencephalic diagnosis of tinnitus symptom

Tinnitus is a neuropathological phenomenon caused by the recognition of external sound that does not actually exist. Existing diagnostic methods for tinnitus are rather subjective and complicated medical examination procedures. The present study aimed to diagnose tinnitus using deep learning analysis of electroencephalographic (EEG) signals while patients performed auditory cognitive tasks. We found that, during an active oddball task, patients with tinnitus could be identified with an area under the curve of 0.886 through a deep learning model (EEGNet) using EEG signals. Furthermore, using broadband (0.5 to 50 Hz) EEG signals, an analysis of the EEGNet convolutional kernel feature maps revealed that alpha activity might play a crucial role in identifying patients with tinnitus. A subsequent time-frequency analysis of the EEG signals indicated that the tinnitus group had significantly reduced pre-stimulus alpha activity compared with the healthy group. These differences were observed in both the active and passive oddball tasks. Only the target stimuli during the active oddball task yielded significantly higher evoked theta activity in the healthy group compared with the tinnitus group. Our findings suggest that task-relevant EEG features can be considered as a neural signature of tinnitus symptoms and support the feasibility of EEG-based deep-learning approach for the diagnosis of tinnitus.

Detecting Anosognosia from the Prodromal Stage of Alzheimer's Disease

BACKGROUND

Though not originally developed for this purpose, the Healthy Aging Brain Care Monitor (HABC-M) seems a valuable instrument for assessing anosognosia in Alzheimer's disease (AD).

OBJECTIVES

Our study aimed at 1) investigating the validity of the HABC-M (31 items), and its cognitive, psychological, and functional subscales, in discriminating AD patients from controls; 2) exploring whether the HABC-M discrepancy scores between the self-reports of patients/controls in these different domains and the respective ratings provided by their caregivers/informants correlate with an online measure of self-awareness; 3) determining whether the caregiver burden level, also derived from the HABC-M, could add additional support for detecting anosognosia.

METHODS

The HABC-M was administered to 30 AD patients and 30 healthy controls, and to their caregivers/informants. A measure of online awareness was established from subjects' estimation of their performances in a computerized experiment.

RESULTS

The HABC-M discrepancy scores distinguished AD patients from controls. The cognitive subscale discriminated the two groups from the prodromal AD stage, with an AUC of 0.88 [95% CI: 0.78;0.97]. Adding the caregiver burden level raised it to 0.94 [0.86;0.99]. Significant correlations between the HABC-M and online discrepancy scores were observed in the patients group, providing convergent validity of these methods.

CONCLUSIONS

The cognitive HABC-M (six items) can detect anosognosia across the AD spectrum. The caregiver burden (four items) may corroborate the suspicion of anosognosia. The short-hybrid scale, built from these 10 items instead of the usual 31, showed the highest sensitivity for detecting anosognosia from the prodromal AD stage, which may further help with timely diagnosis.

The validity and reliability of wearable devices for the measurement of vertical oscillation for running

Wearable devices are a popular training tool to measure biomechanical performance indicators during running, including vertical oscillation (VO). VO is a contributing factor in running economy and injury risk, therefore VO feedback can have a positive impact on running performance. The validity and reliability of the VO measurements from wearable devices is crucial for them to be an effective training tool. The aims of this study were to test the validity and reliability of VO measurements from wearable devices against video analysis of a single trunk marker. Four wearable devices were compared: the INCUS NOVA, Garmin Heart Rate Monitor-Pro (HRM), Garmin Running Dynamics Pod (RDP), and Stryd Running Power Meter Footpod (Footpod). Fifteen participants completed treadmill running at five different self-selected speeds for one minute at each speed. Each speed interval was completed twice. VO was recorded simultaneously by video and the wearables devices. There was significant effect of measurement method on VO (p < 0.001), with the NOVA and Footpod underestimating VO compared to video analysis, while the HRM and RDP overestimated. Although there were significant differences in the average VO values, all devices were significantly correlated with the video analysis (R > = 0.51, p < 0.001). Significant agreement between repeated VO measurements for all devices, revealed the devices to be reliable (ICC > = 0.948, p < 0.001). There was also significant agreement for VO measurements between each device and the video analysis (ICC > = 0.731, p < = 0.001), therefore validating the devices for VO measurement during running. These results demonstrate that wearable devices are valid and reliable tools to detect changes in VO during running. However, VO measurements varied significantly between the different wearables tested and this should be considered when comparing VO values between devices.

Brain recognition of previously learned versus novel temporal sequences: a differential simultaneous processing

Memory for sequences is a central topic in neuroscience, and decades of studies have investigated the neural mechanisms underlying the coding of a wide array of sequences extended over time. Yet, little is known on the brain mechanisms underlying the recognition of previously memorized versus novel temporal sequences. Moreover, the differential brain processing of single items in an auditory temporal sequence compared to the whole superordinate sequence is not fully understood. In this magnetoencephalography (MEG) study, the items of the temporal sequence were independently linked to local and rapid (2–8 Hz) brain processing, while the whole sequence was associated with concurrent global and slower (0.1–1 Hz) processing involving a widespread network of sequentially active brain regions. Notably, the recognition of previously memorized temporal sequences was associated to stronger activity in the slow brain processing, while the novel sequences required a greater involvement of the faster brain processing. Overall, the results expand on well-known information flow from lower- to higher order brain regions. In fact, they reveal the differential involvement of slow and faster whole brain processing to recognize previously learned versus novel temporal information.

The Neural Representation of a Repeated Standard Stimulus in Dyslexia

The neural representation of a repeated stimulus is the standard against which a deviant stimulus is measured in the brain, giving rise to the well-known mismatch response. It has been suggested that individuals with dyslexia have poor implicit memory for recently repeated stimuli, such as the train of standards in an oddball paradigm. Here, we examined how the neural representation of a standard emerges over repetitions, asking whether there is less sensitivity to repetition and/or less accrual of "standardness" over successive repetitions in dyslexia. We recorded magnetoencephalography (MEG) as adults with and without dyslexia were passively exposed to speech syllables in a roving-oddball design. We performed time-resolved multivariate decoding of the MEG sensor data to identify the neural signature of standard vs. deviant trials, independent of stimulus differences. This "multivariate mismatch" was equally robust and had a similar time course in the two groups. In both groups, standards generated by as few as two repetitions were distinct from deviants, indicating normal sensitivity to repetition in dyslexia. However, only in the control group did standards become increasingly different from deviants with repetition. These results suggest that many of the mechanisms that give rise to neural adaptation as well as mismatch responses are intact in dyslexia, with the possible exception of a putatively predictive mechanism that successively integrates recent sensory information into feedforward processing.

Categorical perception and influence of attention on neural consistency in response to speech sounds in adults with dyslexia

Developmental dyslexia is a common neurodevelopmental disorder that is associated with alterations in the behavioral and neural processing of speech sounds, but the scope and nature of that association is uncertain. It has been proposed that more variable auditory processing could underlie some of the core deficits in this disorder. In the current study, magnetoencephalography (MEG) data were acquired from adults with and without dyslexia while they passively listened to or actively categorized tokens from a /ba/-/da/ consonant continuum. We observed no significant group difference in active categorical perception of this continuum in either of our two behavioral assessments. During passive listening, adults with dyslexia exhibited neural responses that were as consistent as those of typically reading adults in six cortical regions associated with auditory perception, language, and reading. However, they exhibited significantly less consistency in the left supramarginal gyrus, where greater inconsistency correlated significantly with worse decoding skills in the group with dyslexia. The group difference in the left supramarginal gyrus was evident only when neural data were binned with a high temporal resolution and was only significant during the passive condition. Interestingly, consistency significantly improved in both groups during active categorization versus passive listening. These findings suggest that adults with dyslexia exhibit typical levels of neural consistency in response to speech sounds with the exception of the left supramarginal gyrus and that this consistency increases during active versus passive perception of speech sounds similarly in the two groups.

Temporal dynamics of the neural representation of hue and luminance polarity

Hue and luminance contrast are basic visual features. Here we use multivariate analyses of magnetoencephalography data to investigate the timing of the neural computations that extract them, and whether they depend on common neural circuits. We show that hue and luminance-contrast polarity can be decoded from MEG data and, with lower accuracy, both features can be decoded across changes in the other feature. These results are consistent with the existence of both common and separable neural mechanisms. The decoding time course is earlier and more temporally precise for luminance polarity than hue, a result that does not depend on task, suggesting that luminance contrast is an updating signal that separates visual events. Meanwhile, cross-temporal generalization is slightly greater for representations of hue compared to luminance polarity, providing a neural correlate of the preeminence of hue in perceptual grouping and memory. Finally, decoding of luminance polarity varies depending on the hues used to obtain training and testing data. The pattern of results is consistent with observations that luminance contrast is mediated by both L-M and S cone sub-cortical mechanisms.

Electrophysiological Decoding of Spatial and Color Processing in Human Prefrontal Cortex

The prefrontal cortex (PFC) plays a pivotal role in goal-directed cognition, yet its representational code remains an open problem with decoding techniques ineffective in disentangling task-relevant variables from PFC. Here we applied regularized linear discriminant analysis to human scalp EEG data and were able to distinguish a mental-rotation task versus a color-perception task with 87% decoding accuracy. Dorsal and ventral areas in lateral PFC provided the dominant features dissociating the two tasks. Our findings show that EEG can reliably decode two independent task states from PFC and emphasize the PFC dorsal/ventral functional specificity in processing the where rotation task versus the what color task.

MEG Source Localization via Deep Learning

We present a deep learning solution to the problem of localization of magnetoencephalography (MEG) brain signals. The proposed deep model architectures are tuned to single and multiple time point MEG data, and can estimate varying numbers of dipole sources. Results from simulated MEG data on the cortical surface of a real human subject demonstrated improvements against the popular RAP-MUSIC localization algorithm in specific scenarios with varying SNR levels, inter-source correlation values, and number of sources. Importantly, the deep learning models had robust performance to forward model errors resulting from head translation and rotation and a significant reduction in computation time, to a fraction of 1 ms, paving the way to real-time MEG source localization.

A Graph Gaussian Embedding Method for Predicting Alzheimer's Disease Progression With MEG Brain Networks

Characterizing the subtle changes of functional brain networks associated with the pathological cascade of Alzheimer's disease (AD) is important for early diagnosis and prediction of disease progression prior to clinical symptoms. We developed a new deep learning method, termed multiple graph Gaussian embedding model (MG2G), which can learn highly informative network features by mapping high-dimensional resting-state brain networks into a low-dimensional latent space. These latent distribution-based embeddings enable a quantitative characterization of subtle and heterogeneous brain connectivity patterns at different regions, and can be used as input to traditional classifiers for various downstream graph analytic tasks, such as AD early stage prediction, and statistical evaluation of between-group significant alterations across brain regions. We used MG2G to detect the intrinsic latent dimensionality of MEG brain networks, predict the progression of patients with mild cognitive impairment (MCI) to AD, and identify brain regions with network alterations related to MCI.

Neural Decoding Reveals Concurrent Phonemic and Subphonemic Representations of Speech Across Tasks

Robust and efficient speech perception relies on the interpretation of acoustically variable phoneme realizations, yet prior neuroimaging studies are inconclusive regarding the degree to which subphonemic detail is maintained over time as categorical representations arise. It is also unknown whether this depends on the demands of the listening task. We addressed these questions by using neural decoding to quantify the (dis)similarity of brain response patterns evoked during two different tasks. We recorded magnetoencephalography (MEG) as adult participants heard isolated, randomized tokens from a /ba/-/da/ speech continuum. In the passive task, their attention was diverted. In the active task, they categorized each token as ba or da. We found that linear classifiers successfully decoded ba vs. da perception from the MEG data. Data from the left hemisphere were sufficient to decode the percept early in the trial, while the right hemisphere was necessary but not sufficient for decoding at later time points. We also decoded stimulus representations and found that they were maintained longer in the active task than in the passive task; however, these representations did not pattern more like discrete phonemes when an active categorical response was required. Instead, in both tasks, early phonemic patterns gave way to a representation of stimulus ambiguity that coincided in time with reliable percept decoding. Our results suggest that the categorization process does not require the loss of subphonemic detail, and that the neural representation of isolated speech sounds includes concurrent phonemic and subphonemic information.

How expectations of pain elicited by consciously and unconsciously perceived cues unfold over time

Expectation can shape the perception of pain within a fraction of time, but little is known about how perceived expectation unfolds over time and modulates pain perception. Here, we combine magnetoencephalography (MEG) and machine learning approaches to track the neural dynamics of expectations of pain in healthy participants with both sexes. We found that the expectation of pain, as conditioned by facial cues, can be decoded from MEG as early as 150 ms and up to 1100 ms after cue onset, but decoding expectation elicited by unconsciously perceived cues requires more time and decays faster compared to consciously perceived ones. Also, results from temporal generalization suggest that neural dynamics of decoding cue-based expectation were predominately sustained during cue presentation but transient after cue presentation. Finally, although decoding expectation elicited by consciously perceived cues were based on a series of time-restricted brain regions during cue presentation, decoding relied on the medial prefrontal cortex and anterior cingulate cortex after cue presentation for both consciously and unconsciously perceived cues. These findings reveal the conscious and unconscious processing of expectation during pain anticipation and may shed light on enhancing clinical care by demonstrating the impact of expectation cues.

Color Space Geometry Uncovered with Magnetoencephalography

The geometry that describes the relationship among colors, and the neural mechanisms that support color vision, are unsettled. Here, we use multivariate analyses of measurements of brain activity obtained with magnetoencephalography to reverse-engineer a geometry of the neural representation of color space. The analyses depend upon determining similarity relationships among the spatial patterns of neural responses to different colors and assessing how these relationships change in time. We evaluate the approach by relating the results to universal patterns in color naming. Two prominent patterns of color naming could be accounted for by the decoding results: the greater precision in naming warm colors compared to cool colors evident by an interaction of hue and lightness, and the preeminence among colors of reddish hues. Additional experiments showed that classifiers trained on responses to color words could decode color from data obtained using colored stimuli, but only at relatively long delays after stimulus onset. These results provide evidence that perceptual representations can give rise to semantic representations, but not the reverse. Taken together, the results uncover a dynamic geometry that provides neural correlates for color appearance and generates new hypotheses about the structure of color space.

Thalamocortical inhibitory dynamics support conscious perception

Whether thalamocortical interactions play a decisive role in conscious perception remains an open question. We presented rapid red/green color flickering stimuli, which induced the mental perception of either an illusory orange color or non-fused red and green colors. Using magnetoencephalography, we observed 6-Hz thalamic activity associated with thalamocortical inhibitory coupling only during the conscious perception of the illusory orange color. This sustained thalamic disinhibition was temporally coupled with higher visual cortical activation during the conscious perception of the orange color, providing neurophysiological evidence of the role of thalamocortical synchronization in conscious awareness of mental representation. Bayesian model comparison consistently supported the thalamocortical model in conscious perception. Taken together, experimental and theoretical evidence established the thalamocortical inhibitory network as a gateway to conscious mental representations.

Autonomic and Electrophysiological Evidence for Reduced Auditory Habituation in Autism

It is estimated that nearly 90% of children on the autism spectrum exhibit sensory atypicalities. What aspects of sensory processing are affected in autism? Although sensory processing can be studied along multiple dimensions, two of the most basic ones involve examining instantaneous sensory responses and how the responses change over time. These correspond to the dimensions of 'sensitivity' and 'habituation'. Results thus far have indicated that autistic individuals do not differ systematically from controls in sensory acuity/sensitivity. However, data from studies of habituation have been equivocal. We have studied habituation in autism using two measures: galvanic skin response (GSR) and magneto-encephalography (MEG). We report data from two independent studies. The first study, was conducted with 13 autistic and 13 age-matched neurotypical young adults and used GSR to assess response to an extended metronomic sequence. The second study involved 24 participants (12 with an ASD diagnosis), different from those in study 1, spanning the pre-adolescent to young adult age range, and used MEG. Both studies reveal consistent patterns of reduced habituation in autistic participants. These results suggest that autism, through mechanisms that are yet to be elucidated, compromises a fundamental aspect of sensory processing, at least in the auditory domain. We discuss the implications for understanding sensory hypersensitivities, a hallmark phenotypic feature of autism, recently proposed theoretical accounts, and potential relevance for early detection of risk for autism.

New Cognitive Neurotechnology Facilitates Studies of Cortical-Subcortical Interactions

Most of the studies employing neuroimaging have focused on cortical and subcortical signals individually to obtain neurophysiological signatures of cognitive functions. However, understanding the dynamic communication between the cortex and subcortical structures is essential for unraveling the neural correlates of cognition. In this quest, magnetoencephalography (MEG) and electroencephalography (EEG) are the methods of choice because they are noninvasive electrophysiological recording techniques with high temporal resolution. Sophisticated MEG/EEG source estimation techniques and network analysis methods, developed recently, can provide a more comprehensive understanding of the neurophysiological mechanisms of fundamental cognitive processes. Used together with noninvasive modulation of cortical-subcortical communication, these approaches may open up new possibilities for expanding the repertoire of noninvasive cognitive neurotechnology.

A new Graph Gaussian embedding method for analyzing the effects of cognitive training

Identifying heterogeneous cognitive impairment markers at an early stage is vital for Alzheimer's disease diagnosis. However, due to complex and uncertain brain connectivity features in the cognitive domains, it remains challenging to quantify functional brain connectomic changes during non-pharmacological interventions for amnestic mild cognitive impairment (aMCI) patients. We present a quantitative method for functional brain network analysis of fMRI data based on the multi-graph unsupervised Gaussian embedding method (MG2G). This neural network-based model can effectively learn low-dimensional Gaussian distributions from the original high-dimensional sparse functional brain networks, quantify uncertainties in link prediction, and discover the intrinsic dimensionality of brain networks. Using the Wasserstein distance to measure probabilistic changes, we discovered that brain regions in the default mode network and somatosensory/somatomotor hand, fronto-parietal task control, memory retrieval, and visual and dorsal attention systems had relatively large variations during non-pharmacological training, which might provide distinct biomarkers for fine-grained monitoring of aMCI cognitive alteration. An important finding of our study is the ability of the new method to capture subtle changes for individual patients before and after short-term intervention. More broadly, the MG2G method can be used in studying multiple brain disorders and injuries, e.g., in Parkinson's disease or traumatic brain injury (TBI), and hence it will be useful to the wider neuroscience community.

The perceptual neural trace of memorable unseen scenes

Some scenes are more memorable than others: they cement in minds with consistencies across observers and time scales. While memory mechanisms are traditionally associated with the end stages of perception, recent behavioral studies suggest that the features driving these memorability effects are extracted early on, and in an automatic fashion. This raises the question: is the neural signal of memorability detectable during early perceptual encoding phases of visual processing? Using the high temporal resolution of magnetoencephalography (MEG), during a rapid serial visual presentation (RSVP) task, we traced the neural temporal signature of memorability across the brain. We found an early and prolonged memorability related signal under a challenging ultra-rapid viewing condition, across a network of regions in both dorsal and ventral streams. This enhanced encoding could be the key to successful storage and recognition.

How face perception unfolds over time

Within a fraction of a second of viewing a face, we have already determined its gender, age and identity. A full understanding of this remarkable feat will require a characterization of the computational steps it entails, along with the representations extracted at each. Here, we used magnetoencephalography (MEG) to measure the time course of neural responses to faces, thereby addressing two fundamental questions about how face processing unfolds over time. First, using representational similarity analysis, we found that facial gender and age information emerged before identity information, suggesting a coarse-to-fine processing of face dimensions. Second, identity and gender representations of familiar faces were enhanced very early on, suggesting that the behavioral benefit for familiar faces results from tuning of early feed-forward processing mechanisms. These findings start to reveal the time course of face processing in humans, and provide powerful new constraints on computational theories of face perception.

MEG/EEG Group Analysis With Brainstorm

Brainstorm is a free, open-source Matlab and Java application for multimodal electrophysiology data analytics and source imaging [primarily MEG, EEG and depth recordings, and integration with MRI and functional near infrared spectroscopy (fNIRS)]. We also provide a free, platform-independent executable version to users without a commercial Matlab license. Brainstorm has a rich and intuitive graphical user interface, which facilitates learning and augments productivity for a wider range of neuroscience users with little or no knowledge of scientific coding and scripting. Yet, it can also be used as a powerful scripting tool for reproducible and shareable batch processing of (large) data volumes. This article describes these Brainstorm interactive and scripted features via illustration through the complete analysis of group data from 16 participants in a MEG vision study.

Increased variability of stimulus-driven cortical responses is associated with genetic variability in children with and without dyslexia

Individuals with dyslexia exhibit increased brainstem variability in response to sound. It is unknown as to whether increased variability extends to neocortical regions associated with audition and reading, extends to visual stimuli, and whether increased variability characterizes all children with dyslexia or, instead, a specific subset of children. We evaluated the consistency of stimulus-evoked neural responses in children with (N = 20) or without dyslexia (N = 12) as measured by magnetoencephalography (MEG). Approximately half of the children with dyslexia had significantly higher levels of variability in cortical responses to both auditory and visual stimuli in multiple nodes of the reading network. There was a significant and positive relationship between the number of risk alleles at rs6935076 in the dyslexia-susceptibility gene KIAA0319 and the degree of neural variability in primary auditory cortex across all participants. This gene has been linked with neural variability in rodents and in typical readers. These findings indicate that unstable representations of auditory and visual stimuli in auditory and other reading-related neocortical regions are present in a subset of children with dyslexia and support the link between the gene KIAA0319 and the auditory neural variability across children with or without dyslexia.

Ultra-Rapid serial visual presentation reveals dynamics of feedforward and feedback processes in the ventral visual pathway

Human visual recognition activates a dense network of overlapping feedforward and recurrent neuronal processes, making it hard to disentangle processing in the feedforward from the feedback direction. Here, we used ultra-rapid serial visual presentation to suppress sustained activity that blurs the boundaries of processing steps, enabling us to resolve two distinct stages of processing with MEG multivariate pattern classification. The first processing stage was the rapid activation cascade of the bottom-up sweep, which terminated early as visual stimuli were presented at progressively faster rates. The second stage was the emergence of categorical information with peak latency that shifted later in time with progressively faster stimulus presentations, indexing time-consuming recurrent processing. Using MEG-fMRI fusion with representational similarity, we localized recurrent signals in early visual cortex. Together, our findings segregated an initial bottom-up sweep from subsequent feedback processing, and revealed the neural signature of increased recurrent processing demands for challenging viewing conditions.

Tracking the Spatiotemporal Neural Dynamics of Real-world Object Size and Animacy in the Human Brain

Animacy and real-world size are properties that describe any object and thus bring basic order into our perception of the visual world. Here, we investigated how the human brain processes real-world size and animacy. For this, we applied representational similarity to fMRI and MEG data to yield a view of brain activity with high spatial and temporal resolutions, respectively. Analysis of fMRI data revealed that a distributed and partly overlapping set of cortical regions extending from occipital to ventral and medial temporal cortex represented animacy and real-world size. Within this set, parahippocampal cortex stood out as the region representing animacy and size stronger than most other regions. Further analysis of the detailed representational format revealed differences among regions involved in processing animacy. Analysis of MEG data revealed overlapping temporal dynamics of animacy and real-world size processing starting at around 150 msec and provided the first neuromagnetic signature of real-world object size processing. Finally, to investigate the neural dynamics of size and animacy processing simultaneously in space and time, we combined MEG and fMRI with a novel extension of MEG-fMRI fusion by representational similarity. This analysis revealed partly overlapping and distributed spatiotemporal dynamics, with parahippocampal cortex singled out as a region that represented size and animacy persistently when other regions did not. Furthermore, the analysis highlighted the role of early visual cortex in representing real-world size. A control analysis revealed that the neural dynamics of processing animacy and size were distinct from the neural dynamics of processing low-level visual features. Together, our results provide a detailed spatiotemporal view of animacy and size processing in the human brain.