Neuronal mechanisms of perceptual learning: changes in human brain activity with training in orientation discrimination

Visual perceptual learning is effective in the illusory far but not in the near space

Visual shape discrimination is faster for objects close to the body, in the peripersonal space (PPS), compared with objects far from the body. Visual processing enhancement in PPS occurs also when perceived depth is based on 2D pictorial cues. This advantage has been observed from relatively low-level (detection, size, orientation) to high-level visual features (face processing). While multisensory association also displays proximal advantages, whether PPS influences visual perceptual learning remains unclear. Here, we investigated whether perceptual learning effects vary according to the distance of visual stimuli (near or far) from the observer, illusorily induced by leveraging the Ponzo illusion. Participants performed a visual search task in which they reported whether a specific target object orientation (e.g., triangle pointing downward) was present among distractors. Performance was assessed before and after practicing the visual search task (30 minutes/day for 5 days) at either the close (near group) or far (far group) distance. Results showed that participants that performed the training in the near space did not improve. By contrast, participants that performed the training in the far space showed an improvement in the visual search task in both the far and near spaces. We suggest that such improvement following the far training is due to a greater deployment of attention in the far space, which could make the learning more effective and generalize across spaces.

More than the sum of its parts: investigating episodic memory as a multidimensional cognitive process

Why do we remember some events but forget others? Previous studies attempting to decode successful vs. unsuccessful brain states to investigate this question have met with limited success, potentially due, in part, to assessing episodic memory as a unidimensional process, despite evidence that multiple domains contribute to episodic encoding. Using a novel machine learning algorithm known as "transfer learning", we leveraged visual perception, sustained attention, and selective attention brain states to better predict episodic memory performance from trial-to-trial encoding electroencephalography (EEG) activity. We found that this multidimensional treatment of memory decoding improved prediction performance compared to traditional, unidimensional, methods, with each cognitive domain explaining unique variance in decoding of successful encoding-related neural activity. Importantly, this approach could be applied to cognitive domains outside of memory. Overall, this study provides critical insight into the underlying reasons why some events are remembered while others are not.

Functional connectivity interacts with visual perceptual learning for visual field recovery in chronic stroke

A reciprocal relationship between perceptual learning and functional brain changes towards perceptual learning effectiveness has been demonstrated previously; however, the underlying neural correlates remain unclear. Further, visual perceptual learning (VPL) is implicated in visual field defect (VFD) recovery following chronic stroke. We investigated resting-state functional connectivity (RSFC) in the visual cortices associated with mean total deviation (MTD) scores for VPL-induced VFD recovery in chronic stroke. Patients with VFD due to chronic ischemic stroke in the visual cortex received 24 VPL training sessions over 2 months, which is a dual discrimination task of orientation and letters. At baseline and two months later, the RSFC in the ipsilesional, interhemispheric, and contralesional visual cortices and MTD scores in the affected hemi-field were assessed. Interhemispheric visual RSFC at baseline showed the strongest correlation with MTD scores post-2-month VPL training. Notably, only the subgroup with high baseline interhemispheric visual RSFC showed significant VFD improvement following the VPL training. The interactions between the interhemispheric visual RSFC at baseline and VPL led to improvement in MTD scores and largely influenced the degree of VFD recovery. The interhemispheric visual RSFC at baseline could be a promising brain biomarker for the effectiveness of VPL-induced VFD recovery.

Informational feedback accelerates learning in multi-alternative perceptual judgements of orientation

Experience or training can substantially improve perceptual performance through perceptual learning, and the extent and rate of these improvements may be affected by feedback. In this paper, we first developed a neural network model based on the integrated reweighting theory (Dosher et al., 2013) to account for perceptual learning and performance in n-alternative identification tasks and the dependence of learning on different forms of feedback. We then report an experiment comparing the effectiveness of response feedback (RF) versus accuracy feedback (AF) or no feedback (NF) (full versus partial versus no supervision) in learning a challenging eight-alternative visual orientation identification (8AFC) task. Although learning sometimes occurred in the absence of feedback (NF), RF had a clear advantage above AF or NF in this task. Using hybrid supervision learning rules, a new n-alternative identification integrated reweighting theory (I-IRT) explained both the differences in learning curves given different feedback and the dynamic changes in identification confusion data. This study shows that training with more informational feedback (RF) is more effective, though not necessary, in these challenging n-alternative tasks, a result that has implications for developing training paradigms in realistic tasks.

Minimum perturbation theory of deep perceptual learning

Perceptual learning (PL) involves long-lasting improvement in perceptual tasks following extensive training and is accompanied by modified neuronal responses in sensory cortical areas in the brain. Understanding the dynamics of PL and the resultant synaptic changes is important for causally connecting PL to the observed neural plasticity. This is theoretically challenging because learning-related changes are distributed across many stages of the sensory hierarchy. In this paper, we modeled the sensory hierarchy as a deep nonlinear neural network and studied PL of fine discrimination, a common and well-studied paradigm of PL. Using tools from statistical physics, we developed a mean-field theory of the network in the limit of a large number of neurons and large number of examples. Our theory suggests that, in this thermodynamic limit, the input-output function of the network can be exactly mapped to that of a deep linear network, allowing us to characterize the space of solutions for the task. Surprisingly, we found that modifying synaptic weights in the first layer of the hierarchy is both sufficient and necessary for PL. To address the degeneracy of the space of solutions, we postulate that PL dynamics are constrained by a normative minimum perturbation (MP) principle, which favors weight matrices with minimal changes relative to their prelearning values. Interestingly, MP plasticity induces changes to weights and neural representations in all layers of the network, except for the readout weight vector. While weight changes in higher layers are not necessary for learning, they help reduce overall perturbation to the network. In addition, such plasticity can be learned simply through slow learning. We further elucidate the properties of MP changes and compare them against experimental findings. Overall, our statistical mechanics theory of PL provides mechanistic and normative understanding of several important empirical findings of PL.

Musicians show more integrated neural processing of contextually relevant acoustic features

Little is known about expertise-related plasticity of neural mechanisms for auditory feature integration. Here, we contrast two diverging hypotheses that musical expertise is associated with more independent or more integrated predictive processing of acoustic features relevant to melody perception. Mismatch negativity (MMNm) was recorded with magnetoencephalography (MEG) from 25 musicians and 25 non-musicians, exposed to interleaved blocks of a complex, melody-like multi-feature paradigm and a simple, oddball control paradigm. In addition to single deviants differing in frequency (F), intensity (I), or perceived location (L), double and triple deviants were included reflecting all possible feature combinations (FI, IL, LF, FIL). Following previous work, early neural processing overlap was approximated in terms of MMNm additivity by comparing empirical MMNms obtained with double and triple deviants to modeled MMNms corresponding to summed constituent single-deviant MMNms. Significantly greater subadditivity was found in musicians compared to non-musicians, specifically for frequency-related deviants in complex, melody-like stimuli. Despite using identical sounds, expertise effects were absent from the simple oddball paradigm. This novel finding supports the integrated processing hypothesis whereby musicians recruit overlapping neural resources facilitating more integrative representations of contextually relevant stimuli such as frequency (perceived as pitch) during melody perception. More generally, these specialized refinements in predictive processing may enable experts to optimally capitalize upon complex, domain-relevant, acoustic cues.

Differences in neuroanatomy and functional connectivity between motor subtypes of Parkinson’s disease

Background

The “postural instability/gait difficulty” (PIGD) and “tremor-dominant” (TD) motor subtypes of Parkinson’s disease (PD) differ in their clinical manifestations. The neurological basis of these differences is unclear.

Methods

We performed voxel-based morphometric analysis and measured amplitudes of low-frequency fluctuation (ALFF) on 87 PIGD patients and 51 TD patients. We complemented this neuroanatomical comparison with seed-to-voxel analysis to explore differences in functional connectivity.

Results

The PIGD group showed significantly smaller gray matter volume in the medial frontal gyrus (mainly on the right side) than the TD group. Across all patients, gray matter volume in the medial frontal gyrus correlated negatively with severity of PIGD symptoms after controlling for age (r = −0.250, p = 0.003), but this correlation was not observed in separate analyses of only PIGD or TD patients. The PIGD group showed greater functional connectivity of the right superior frontal gyrus with the left lingual gyrus, right lateral occipital cortex, and right lingual gyrus. ALFF did not differ significantly between the two groups.

Conclusion

Postural instability/gait difficulty may be associated with smaller gray matter volume in medial frontal gyrus than TD, as well as with greater functional connectivity between the right superior frontal gyrus and occipital cortex. These results may help explain the clinical differences between the two motor subtypes of PD.

Tracking Fast Neural Adaptation by Globally Adaptive Point Process Estimation for Brain-Machine Interface

Brain-machine interfaces (BMIs) help the disabled restore body functions by translating neural activity into digital commands to control external devices. Neural adaptation, where the brain signals change in response to external stimuli or movements, plays an important role in BMIs. When subjects purely use neural activity to brain-control a prosthesis, some neurons will actively explore a new tuning property to accomplish the movement task. The prediction of this neural tuning property can help subjects adapt more efficiently to brain control and maintain a good decoding performance. Existing prediction methods track the slow change of the tuning property in the manual control, which is not suitable for the fast neural adaptation in brain control. In order to identify the active neurons in brain control and track their tuning property changes, we propose a globally adaptive point process method (GaPP) to estimate the neural modulation state from spike trains, decompose the states into the hyper preferred direction and reconstruct the kinematics in a dual-model framework. We implement the method on real data from rats performing a two-lever discrimination task under manual control and brain control. The results show our method successfully predicts the neural modulation state and identifies the neurons that become active in brain control. Compared to the existing method, ours tracks the fast changes of the hyper preferred direction from manual control to brain control more accurately and efficiently and reconstructs the kinematics better and faster.

Brain functional connectivity in headache disorders: A narrative review of MRI investigations

Resting-state functional magnetic resonance imaging (rs-fMRI) is used to interrogate the functional connectivity and network organization amongst brain regions. Functional connectivity is determined by measuring the extent of synchronization in the spontaneous fluctuations of blood oxygenation level dependent (BOLD) signal. Here, we review current rs-fMRI studies in headache disorders including migraine, trigeminal autonomic cephalalgias, and medication overuse headache. We discuss (1) brain network alterations that are shared amongst the different headache disorders and (2) network abnormalities distinct to each headache disorder. In order to focus the section on migraine, the headache disorder that has been most extensively studied, we chose to include articles that interrogated functional connectivity: (i) during the attack phase; (ii) in migraine patients with aura compared to migraine patients without aura; and (iii) of regions within limbic, sensory, motor, executive and default mode networks and those which participate in multisensory integration. The results of this review show that headache disorders are associated with atypical functional connectivity of regions associated with pain processing as well as atypical functional connectivity of multiple core resting state networks such as the salience, sensorimotor, executive, attention, limbic, visual, and default mode networks.

BST1 rs4698412 allelic variant increases the risk of gait or balance deficits in patients with Parkinson's disease

Aims

We aimed to explore effects of bone marrow stromal cell antigen‐1 (BST1) rs4698412 allelic variant on brain activation and associative clinical symptoms in Parkinson’s disease (PD).

Methods

A total of 49 PD patients and 47 healthy control (HC) subjects were recruited for clinical evaluations, blood samples collection for genotypes, and resting‐state functional MRI (rs‐fMRI) scans. Based on BST1 rs4698412 allelic variant (G → A), participants were further divided into 18 PD‐GG, 31 PD‐GA/AA, 20 HC‐GG, and 27 HC‐GA/AA carriers, which respectively indicated subjects carrying ancestral or risk allele in that locus in PD or HC. Two‐way analysis of covariance (ANCOVA) was applied to investigate main effects and interactions between PD and BST1 rs4698412 allelic variant on brain function via amplitude of low‐frequency fluctuations (ALFF). Spearman’s correlations were then utilized to detect associations between interactive brain regions and clinical symptoms.

Results

Compared to HC subjects, PD patients exhibited increased ALFF values in left cerebellum_8 and cerebellum_9. Significant interaction was in right lingual gyrus, where there were the lowest ALFF values and ALFF values were only negatively associated with Timed Up and Go (TUG) test time in PD‐GA/AA subgroup.

Conclusion

BST1 rs4698412‐modulated lingual gyrus functional alterations could be related to gait and balance dysfunction in PD.

Fear Network Model in Panic Disorder: The Past and the Future

The core concept for pathophysiology in panic disorder (PD) is the fear network model (FNM). The alterations in FNM might be linked with disturbances in the autonomic nervous system (ANS), which is a common phenomenon in PD. The traditional FNM included the frontal and limbic regions, which were dysregulated in the feedback mechanism for cognitive control of frontal lobe over the primitive response of limbic system. The exaggerated responses of limbic system are also associated with dysregulation in the neurotransmitter system. The neuroimaging studies also corresponded to FNM concept. However, more extended areas of FNM have been discovered in recent imaging studies, such as sensory regions of occipital, parietal cortex and temporal cortex and insula. The insula might integrate the filtered sensory information via thalamus from the visuospatial and other sensory modalities related to occipital, parietal and temporal lobes. In this review article, the traditional and advanced FNM would be discussed. I would also focus on the current evidences of insula, temporal, parietal and occipital lobes in the pathophysiology. In addition, the white matter and functional connectome studies would be reviewed to support the concept of advanced FNM. An emerging dysregulation model of fronto-limbic-insula and temporooccipito-parietal areas might be revealed according to the combined results of recent neuroimaging studies. The future delineation of advanced FNM model can be beneficial from more extensive and advanced studies focusing on the additional sensory regions of occipital, parietal and temporal cortex to confirm the role of advanced FNM in the pathophysiology of PD.

Tactile-to-Visual Cross-Modal Transfer of Texture Categorisation Following Training: An fMRI Study

We investigated the neural underpinnings of texture categorisation using exemplars that were previously learned either within modalities (visual training and visual test) or across modalities (tactile training and visual test). Previous models of learning suggest a decrease in activation in brain regions that are typically involved in cognitive control during task acquisition, but a concomitant increase in activation in brain regions associated with the representation of the acquired information. In our study, participants were required to learn to categorise fabrics of different textures as either natural or synthetic. Training occurred over several sessions, with each fabric presented either visually or through touch to a participant. Pre- and post-training tests, in which participants categorised visual images only of the fabrics, were conducted during a functional magnetic resonance imaging (fMRI) scan. Consistent with previous research on cognitive processes involved in task acquisition, we found that categorisation training was associated with a decrease in activation in brain regions associated with cognitive systems involved in learning, including the superior parietal cortex, dorsal anterior cingulate cortex (dACC), and the right dorsolateral prefrontal cortex (DLFC). Moreover, these decreases were independent of training modality. In contrast, we found greater activation to visual textures in a region within the left medial occipital cortex (MOC) following training. There was no overall evidence of an effect of training modality in the main analyses, with texture-specific regional changes associated with both within- (visual) and cross- (touch) modal training. However, further analyses suggested that, unlike categorisation performance following within-modal training, crossmodal training was associated with bilateral activation of the MOC. Our results support previous evidence for a multisensory representation of texture within early visual regions of the cortex and provide insight into how multisensory categories are formed in the brain.

Indexing sensory plasticity: Evidence for distinct Predictive Coding and Hebbian learning mechanisms in the cerebral cortex

The Roving Mismatch Negativity (MMN), and Visual LTP paradigms are widely used as independent measures of sensory plasticity. However, the paradigms are built upon fundamentally different (and seemingly opposing) models of perceptual learning; namely, Predictive Coding (MMN) and Hebbian plasticity (LTP). The aim of the current study was to compare the generative mechanisms of the MMN and visual LTP, therefore assessing whether Predictive Coding and Hebbian mechanisms co-occur in the brain. Forty participants were presented with both paradigms during EEG recording. Consistent with Predictive Coding and Hebbian predictions, Dynamic Causal Modelling revealed that the generation of the MMN modulates forward and backward connections in the underlying network, while visual LTP only modulates forward connections. These results suggest that both Predictive Coding and Hebbian mechanisms are utilized by the brain under different task demands. This therefore indicates that both tasks provide unique insight into plasticity mechanisms, which has important implications for future studies of aberrant plasticity in clinical populations.

Structural and Functional Connectivity Changes Beyond Visual Cortex in a Later Phase of Visual Perceptual Learning

The neural mechanisms of visual perceptual learning (VPL) remain unclear. Previously we found that activation in the primary visual cortex (V1) increased in the early encoding phase of training, but returned to baseline levels in the later retention phase. To examine neural changes during the retention phase, we measured structural and functional connectivity changes using MRI. After weeks of training on a texture discrimination task, the fractional anisotropy of the inferior longitudinal fasciculus, a major tract connecting visual and anterior areas, was increased, as well as the functional connectivity between V1 and anterior regions mediated by the ILF. These changes were strongly correlated with behavioral performance improvements. These results suggest a two-phase model of VPL in which localized functional changes in V1 in the encoding phase of training are followed by changes in both structural and functional connectivity in ventral visual processing, perhaps leading to the long-term stabilization of VPL.

Effects of regular aerobic exercise on visual perceptual learning

This study investigated the influence of five days of moderate intensity aerobic exercise on the acquisition and consolidation of visual perceptual learning using a motion direction discrimination (MDD) task. The timing of exercise relative to learning was manipulated by administering exercise either before or after perceptual training. Within a matched-subjects design, twenty-seven healthy participants (n = 9 per group) completed five consecutive days of perceptual training on a MDD task under one of three interventions: no exercise, exercise before the MDD task, or exercise after the MDD task. MDD task accuracy improved in all groups over the five-day period, but there was a trend for impaired learning when exercise was performed before visual perceptual training. MDD task accuracy (mean ± SD) increased in exercise before by 4.5 ± 6.5%; exercise after by 11.8 ± 6.4%; and no exercise by 11.3 ± 7.2%. All intervention groups displayed similar MDD threshold reductions for the trained and untrained motion axes after training. These findings suggest that moderate daily exercise does not enhance the rate of visual perceptual learning for an MDD task or the transfer of learning to an untrained motion axis. Furthermore, exercise performed immediately prior to a visual perceptual learning task may impair learning. Further research with larger groups is required in order to better understand these effects.

A model for brain life history evolution

Complex cognition and relatively large brains are distributed across various taxa, and many primarily verbal hypotheses exist to explain such diversity. Yet, mathematical approaches formalizing verbal hypotheses would help deepen the understanding of brain and cognition evolution. With this aim, we combine elements of life history and metabolic theories to formulate a metabolically explicit mathematical model for brain life history evolution. We assume that some of the brain's energetic expense is due to production (learning) and maintenance (memory) of energy-extraction skills (or cognitive abilities, knowledge, information, etc.). We also assume that individuals use such skills to extract energy from the environment, and can allocate this energy to grow and maintain the body, including brain and reproductive tissues. The model can be used to ask what fraction of growth energy should be allocated at each age, given natural selection, to growing brain and other tissues under various biological settings. We apply the model to find uninvadable allocation strategies under a baseline setting ("me vs nature"), namely when energy-extraction challenges are environmentally determined and are overcome individually but possibly with maternal help, and use modern-human data to estimate model's parameter values. The resulting uninvadable strategies yield predictions for brain and body mass throughout ontogeny and for the ages at maturity, adulthood, and brain growth arrest. We find that: (1) a me-vs-nature setting is enough to generate adult brain and body mass of ancient human scale and a sequence of childhood, adolescence, and adulthood stages; (2) large brains are favored by intermediately challenging environments, moderately effective skills, and metabolically expensive memory; and (3) adult skill is proportional to brain mass when metabolic costs of memory saturate the brain metabolic rate allocated to skills.

Fluoxetine Does Not Enhance Visual Perceptual Learning and Triazolam Specifically Impairs Learning Transfer

The selective serotonin reuptake inhibitor fluoxetine significantly enhances adult visual cortex plasticity within the rat. This effect is related to decreased gamma-aminobutyric acid (GABA) mediated inhibition and identifies fluoxetine as a potential agent for enhancing plasticity in the adult human brain. We tested the hypothesis that fluoxetine would enhance visual perceptual learning of a motion direction discrimination (MDD) task in humans. We also investigated (1) the effect of fluoxetine on visual and motor cortex excitability and (2) the impact of increased GABA mediated inhibition following a single dose of triazolam on post-training MDD task performance. Within a double blind, placebo controlled design, 20 healthy adult participants completed a 19-day course of fluoxetine (n = 10, 20 mg per day) or placebo (n = 10). Participants were trained on the MDD task over the final 5 days of fluoxetine administration. Accuracy for the trained MDD stimulus and an untrained MDD stimulus configuration was assessed before and after training, after triazolam and 1 week after triazolam. Motor and visual cortex excitability were measured using transcranial magnetic stimulation. Fluoxetine did not enhance the magnitude or rate of perceptual learning and full transfer of learning to the untrained stimulus was observed for both groups. After training was complete, trazolam had no effect on trained task performance but significantly impaired untrained task performance. No consistent effects of fluoxetine on cortical excitability were observed. The results do not support the hypothesis that fluoxetine can enhance learning in humans. However, the specific effect of triazolam on MDD task performance for the untrained stimulus suggests that learning and learning transfer rely on dissociable neural mechanisms.

Acute effects of aerobic exercise promote learning

The benefits that physical exercise confers on cardiovascular health are well known, whereas the notion that physical exercise can also improve cognitive performance has only recently begun to be explored and has thus far yielded only controversial results. In the present study, we used a sample of young male subjects to test the effects that a single bout of aerobic exercise has on learning. Two tasks were run: the first was an orientation discrimination task involving the primary visual cortex, and the second was a simple thumb abduction motor task that relies on the primary motor cortex. Forty-four and forty volunteers participated in the first and second experiments, respectively. We found that a single bout of aerobic exercise can significantly facilitate learning mechanisms within visual and motor domains and that these positive effects can persist for at least 30 minutes following exercise. This finding suggests that physical activity, at least of moderate intensity, might promote brain plasticity. By combining physical activity-induced plasticity with specific cognitive training-induced plasticity, we favour a gradual up-regulation of a functional network due to a steady increase in synaptic strength, promoting associative Hebbian-like plasticity.

Keeping time in the brain: Autism spectrum disorder and audiovisual temporal processing

A growing area of interest and relevance in the study of autism spectrum disorder (ASD) focuses on the relationship between multisensory temporal function and the behavioral, perceptual, and cognitive impairments observed in ASD. Atypical sensory processing is becoming increasingly recognized as a core component of autism, with evidence of atypical processing across a number of sensory modalities. These deviations from typical processing underscore the value of interpreting ASD within a multisensory framework. Furthermore, converging evidence illustrates that these differences in audiovisual processing may be specifically related to temporal processing. This review seeks to bridge the connection between temporal processing and audiovisual perception, and to elaborate on emerging data showing differences in audiovisual temporal function in autism. We also discuss the consequence of such changes, the specific impact on the processing of different classes of audiovisual stimuli (e.g. speech vs. nonspeech, etc.), and the presumptive brain processes and networks underlying audiovisual temporal integration. Finally, possible downstream behavioral implications, and possible remediation strategies are outlined. Autism Res 2016, 9: 720-738. © 2015 International Society for Autism Research, Wiley Periodicals, Inc.

Increased interictal visual network connectivity in patients with migraine with aura

OBJECTIVE

To evaluate the resting-state visual network functional connectivity in patients with migraine with aura and migraine without aura during the interictal period.

POPULATION AND METHODS

Using resting-state functional magnetic resonance imaging, the resting-state visual network integrity was investigated in 20 patients with migraine with aura, 20 age- and sex-matched patients with migraine without aura and 20 healthy controls. Voxel-based morphometry and diffusion tensor imaging were used to assess whether between-groups differences in functional connectivity were dependent on structural or microstructural changes.

RESULTS

Resting-state functional magnetic resonance imaging data showed that patients with migraine with aura, compared to both patients with migraine without aura and healthy controls, had a significant increased functional connectivity in the right lingual gyrus within the resting-state visual network (p < 0.05, cluster-level corrected). This abnormal resting-state visual network functional connectivity was observed in the absence of structural or microstructural abnormalities and was not related to migraine severity.

CONCLUSIONS

Our imaging data revealed that patients with migraine with aura exhibit an altered resting-state visual network connectivity. These results support the hypothesis of an extrastriate cortex involvement, centred in the lingual gyrus, a brain region related to mechanisms underlying the initiation and propagation of the migraine aura. This resting-state functional magnetic resonance imaging finding may represent a functional biomarker that could differentiate patients experiencing the aura phenomenon from patients with migraine without aura, even between migraine attacks.

Adaptive Equilibrium Regulation: A Balancing Act in Two Timescales

An equilibrium involves a balancing of forces. Just as one maintains upright posture in standing or walking, many self-regulatory and interpersonal behaviors can be framed as a balancing act between an ever changing environment and within-person processes. The emerging balance between person and environment, the equilibria, are dynamic and adaptive in response to development and learning. A distinction is made between equilibrium achieved solely due to a short timescale balancing of forces and a longer timescale preferred equilibrium which we define as a state towards which the system slowly adapts. Together, these are developed into a framework that this article calls Adaptive Equilibrium Regulation (ÆR), which separates a regulatory process into two timescales: a faster regulation that automatically balances forces and a slower timescale adaptation process that reconfigures the fast regulation so as to move the system towards its preferred equilibrium when an environmental force persists over the longer timescale. This way of thinking leads to novel models for the interplay between multiple timescales of behavior, learning, and development.

Perceptual training continuously refines neuronal population codes in primary visual cortex

Perceptual learning substantially improves visual discrimination and detection ability, which has been associated with visual cortical plasticity. However, little is known about the dynamic changes in neuronal response properties over the course of training. Using chronically implanted multielectrode arrays, we were able to capture day-by-day spatiotemporal dynamics of neurons in the primary visual cortex (V1) of monkeys trained to detect camouflaged visual contours. We found progressive strengthening and accelerating in both facilitation of neurons encoding the contour elements and suppression of neurons responding to the background components. The enhancement of this figure-ground contrast in V1 was closely correlated with improved behavioral performance on a daily basis. Decoding accuracy of a simple linear classifier based on V1 population responses also paralleled the animal's behavioral changes. Our results indicate that perceptual learning shapes the V1 population code to allow a more efficient readout of task-relevant information.

Brain correlates of experience-dependent changes in stimulus discrimination based on the amount and schedule of exposure

One product of simple exposure to similar visual stimuli is that they become easier to distinguish. The early visual cortex and other brain areas (such as the prefrontal cortex) have been implicated in such perceptual learning effects, but the anatomical specificity within visual cortex and the relationship between sensory cortex and other brain areas has yet to be examined. Moreover, while variations in the schedule (rather than merely the amount) of exposure influence experience-dependent improvement in discrimination, the neural sequelae of exposure schedule have not been fully investigated. In an event-related fMRI study, participants were exposed to confusable pairs of faces, scenes and dot patterns, using either intermixed or blocked presentation schedules. Participants then performed same/different judgements with exposed and novel pairs of stimuli. Stimulus independent activation, which was correlated with experience-dependent improvement in discrimination, was seen in frontal areas (e.g. frontal and supplementary eye fields and dorsolateral prefrontal cortex) and in early visual cortex (V1-4). In all regions, the difference in activation between exposed and novel stimuli decreased as a function of the degree of discrimination improvement. Overall levels of BOLD activation differed across regions, consistent with the possibility that, as a consequence of experience, processing shifts from initial engagement of early visual regions to higher order visual areas. Similar relationships were observed when contrasting intermixed with blocked exposure, suggesting that the schedule of exposure primarily influences the degree of, rather than the mechanisms for, discrimination performance.

The cerebellum and visual perceptual learning: evidence from a motion extrapolation task

Visual perceptual learning is widely assumed to reflect plastic changes occurring along the cerebro-cortical visual pathways, including at the earliest stages of processing, though increasing evidence indicates that higher-level brain areas are also involved. Here we addressed the possibility that the cerebellum plays an important role in visual perceptual learning. Within the realm of motor control, the cerebellum supports learning of new skills and recalibration of motor commands when movement execution is consistently perturbed (adaptation). Growing evidence indicates that the cerebellum is also involved in cognition and mediates forms of cognitive learning. Therefore, the obvious question arises whether the cerebellum might play a similar role in learning and adaptation within the perceptual domain. We explored a possible deficit in visual perceptual learning (and adaptation) in patients with cerebellar damage using variants of a novel motion extrapolation, psychophysical paradigm. Compared to their age- and gender-matched controls, patients with focal damage to the posterior (but not the anterior) cerebellum showed strongly diminished learning, in terms of both rate and amount of improvement over time. Consistent with a double-dissociation pattern, patients with focal damage to the anterior cerebellum instead showed more severe clinical motor deficits, indicative of a distinct role of the anterior cerebellum in the motor domain. The collected evidence demonstrates that a pure form of slow-incremental visual perceptual learning is crucially dependent on the intact cerebellum, bearing the notion that the human cerebellum acts as a learning device for motor, cognitive and perceptual functions. We interpret the deficit in terms of an inability to fine-tune predictive models of the incoming flow of visual perceptual input over time. Moreover, our results suggest a strong dissociation between the role of different portions of the cerebellum in motor versus non-motor functions, with only the posterior lobe being responsible for learning in the perceptual domain.

Two-stage model in perceptual learning: toward a unified theory

Training or exposure to a visual feature leads to a long-term improvement in performance on visual tasks that employ this feature. Such performance improvements and the processes that govern them are called visual perceptual learning (VPL). As an ever greater volume of research accumulates in the field, we have reached a point where a unifying model of VPL should be sought. A new wave of research findings has exposed diverging results along three major directions in VPL: specificity versus generalization of VPL, lower versus higher brain locus of VPL, and task-relevant versus task-irrelevant VPL. In this review, we propose a new theoretical model that suggests the involvement of two different stages in VPL: a low-level, stimulus-driven stage, and a higher-level stage dominated by task demands. If experimentally verified, this model would not only constructively unify the current divergent results in the VPL field, but would also lead to a significantly better understanding of visual plasticity, which may, in turn, lead to interventions to ameliorate diseases affecting vision and other pathological or age-related visual and nonvisual declines.

Beyond perceptual expertise: revisiting the neural substrates of expert object recognition

Real-world expertise provides a valuable opportunity to understand how experience shapes human behavior and neural function. In the visual domain, the study of expert object recognition, such as in car enthusiasts or bird watchers, has produced a large, growing, and often-controversial literature. Here, we synthesize this literature, focusing primarily on results from functional brain imaging, and propose an interactive framework that incorporates the impact of high-level factors, such as attention and conceptual knowledge, in supporting expertise. This framework contrasts with the perceptual view of object expertise that has concentrated largely on stimulus-driven processing in visual cortex. One prominent version of this perceptual account has almost exclusively focused on the relation of expertise to face processing and, in terms of the neural substrates, has centered on face-selective cortical regions such as the Fusiform Face Area (FFA). We discuss the limitations of this face-centric approach as well as the more general perceptual view, and highlight that expert related activity is: (i) found throughout visual cortex, not just FFA, with a strong relationship between neural response and behavioral expertise even in the earliest stages of visual processing, (ii) found outside visual cortex in areas such as parietal and prefrontal cortices, and (iii) modulated by the attentional engagement of the observer suggesting that it is neither automatic nor driven solely by stimulus properties. These findings strongly support a framework in which object expertise emerges from extensive interactions within and between the visual system and other cognitive systems, resulting in widespread, distributed patterns of expertise-related activity across the entire cortex.

Non-verbal emotion communication training induces specific changes in brain function and structure

The perception of emotional cues from voice and face is essential for social interaction. However, this process is altered in various psychiatric conditions along with impaired social functioning. Emotion communication trainings have been demonstrated to improve social interaction in healthy individuals and to reduce emotional communication deficits in psychiatric patients. Here, we investigated the impact of a non-verbal emotion communication training (NECT) on cerebral activation and brain structure in a controlled and combined functional magnetic resonance imaging (fMRI) and voxel-based morphometry study. NECT-specific reductions in brain activity occurred in a distributed set of brain regions including face and voice processing regions as well as emotion processing- and motor-related regions presumably reflecting training-induced familiarization with the evaluation of face/voice stimuli. Training-induced changes in non-verbal emotion sensitivity at the behavioral level and the respective cerebral activation patterns were correlated in the face-selective cortical areas in the posterior superior temporal sulcus and fusiform gyrus for valence ratings and in the temporal pole, lateral prefrontal cortex and midbrain/thalamus for the response times. A NECT-induced increase in gray matter (GM) volume was observed in the fusiform face area. Thus, NECT induces both functional and structural plasticity in the face processing system as well as functional plasticity in the emotion perception and evaluation system. We propose that functional alterations are presumably related to changes in sensory tuning in the decoding of emotional expressions. Taken together, these findings highlight that the present experimental design may serve as a valuable tool to investigate the altered behavioral and neuronal processing of emotional cues in psychiatric disorders as well as the impact of therapeutic interventions on brain function and structure.

Plasticity in the Visual System is Associated with Prosthesis Use in Phantom Limb Pain

The experience of strong phantom limb pain (PLP) in arm amputees was previously shown to be associated with structural neural plasticity in parts of the cortex that belong to dorsal and ventral visual streams. It has been speculated that this plasticity results from the extensive use of a functional prosthesis which is associated with increased visual feedback to control the artificial hand. To test this hypothesis, we reanalyzed data of cortical volumes of 21 upper limb amputees and tested the association between the amount of use of the hand prosthesis and cortical volume plasticity. On the behavioral level, we found no relation between PLP and the amount of prosthesis use for the whole patient group. However, by subdividing the patient group into patients with strong PLP and those with low to medium PLP, stronger pain was significantly associated with less prosthesis use whereas the group with low PLP did not show such an association. Most plasticity of cortical volume was identified within the dorsal stream. The more the patients that suffered from strong PLP used their prosthesis, the smaller was the volume of their posterior parietal cortex. Our data indicate a relationship between prosthesis use and cortical plasticity of the visual stream. This plasticity might present a brain adaptation process to new movement and coordination patterns needed to guide an artificial hand.

Neural changes with tactile learning reflect decision-level reweighting of perceptual readout

Despite considerable work, the neural basis of perceptual learning remains uncertain. For visual learning, although some studies suggested that changes in early sensory representations are responsible, other studies point to decision-level reweighting of perceptual readout. These competing possibilities have not been examined in other sensory systems, investigating which could help resolve the issue. Here we report a study of human tactile microspatial learning in which participants achieved >six-fold decline in acuity threshold after multiple training sessions. Functional magnetic resonance imaging was performed during performance of the tactile microspatial task and a control, tactile temporal task. Effective connectivity between relevant brain regions was estimated using multivariate, autoregressive models of hidden neuronal variables obtained by deconvolution of the hemodynamic response. Training-specific increases in task-selective activation assessed using the task × session interaction and associated changes in effective connectivity primarily involved subcortical and anterior neocortical regions implicated in motor and/or decision processes, rather than somatosensory cortical regions. A control group of participants tested twice, without intervening training, exhibited neither threshold improvement nor increases in task-selective activation. Our observations argue that neuroplasticity mediating perceptual learning occurs at the stage of perceptual readout by decision networks. This is consonant with the growing shift away from strictly modular conceptualization of the brain toward the idea that complex network interactions underlie even simple tasks. The convergence of our findings on tactile learning with recent studies of visual learning reconciles earlier discrepancies in the literature on perceptual learning.

Decreased regional homogeneity in lingual gyrus, increased regional homogeneity in cuneus and correlations with panic symptom severity of first-episode, medication-naïve and late-onset panic disorder patients

This study was designed to explore regional homogeneity (ReHo), an indicator of the synchronization of brain function, in first-episode, medication-naïve and late-onset patients with panic disorder (PD). Participants comprised 30 patients and 21 healthy controls who underwent with 3-Tesla magnetic resonance imaging (MRI) scanning and ReHo functional MRI analysis. All participants were studied with clinical rating scales to assess the severity of PD symptoms. ReHo values were obtained using the REST toolbox (resting-state functional MRI data analysis toolbox). Differences in demographic data and ReHo values between the two groups were evaluated with the independent two-sample t-test function of the Statistical Package for the Social Sciences and REST. There were significant differences in clinical ratings between the two groups. No demographic differences were noted. We found decreased ReHo in the left lingual gyrus and increased ReHo in the right cuneus cortex of patients compared with controls. ReHo values of patients were negatively correlated with PD ratings in the right cuneus. ReHo differences found in the left lingual gyrus and the right cuneus might suggest sensory and inhibitory dysfunction in first-episode, medication-naïve, late-onset patients with PD.

Perceptual learning of motion direction discrimination with suppressed and unsuppressed MT in humans: an fMRI study

The middle temporal area of the extrastriate visual cortex (area MT) is integral to motion perception and is thought to play a key role in the perceptual learning of motion tasks. We have previously found, however, that perceptual learning of a motion discrimination task is possible even when the training stimulus contains locally balanced, motion opponent signals that putatively suppress the response of MT. Assuming at least partial suppression of MT, possible explanations for this learning are that 1) training made MT more responsive by reducing motion opponency, 2) MT remained suppressed and alternative visual areas such as V1 enabled learning and/or 3) suppression of MT increased with training, possibly to reduce noise. Here we used fMRI to test these possibilities. We first confirmed that the motion opponent stimulus did indeed suppress the BOLD response within hMT+ compared to an almost identical stimulus without locally balanced motion signals. We then trained participants on motion opponent or non-opponent stimuli. Training with the motion opponent stimulus reduced the BOLD response within hMT+ and greater reductions in BOLD response were correlated with greater amounts of learning. The opposite relationship between BOLD and behaviour was found at V1 for the group trained on the motion-opponent stimulus and at both V1 and hMT+ for the group trained on the non-opponent motion stimulus. As the average response of many cells within MT to motion opponent stimuli is the same as their response to non-directional flickering noise, the reduced activation of hMT+ after training may reflect noise reduction.

Adult visual cortical plasticity

The visual cortex has the capacity for experience-dependent change, or cortical plasticity, that is retained throughout life. Plasticity is invoked for encoding information during perceptual learning, by internally representing the regularities of the visual environment, which is useful for facilitating intermediate-level vision--contour integration and surface segmentation. The same mechanisms have adaptive value for functional recovery after CNS damage, such as that associated with stroke or neurodegenerative disease. A common feature to plasticity in primary visual cortex (V1) is an association field that links contour elements across the visual field. The circuitry underlying the association field includes a plexus of long-range horizontal connections formed by cortical pyramidal cells. These connections undergo rapid and exuberant sprouting and pruning in response to removal of sensory input, which can account for the topographic reorganization following retinal lesions. Similar alterations in cortical circuitry may be involved in perceptual learning, and the changes observed in V1 may be representative of how learned information is encoded throughout the cerebral cortex.

Neural correlates of multisensory perceptual learning

The brain's ability to bind incoming auditory and visual stimuli depends critically on the temporal structure of this information. Specifically, there exists a temporal window of audiovisual integration within which stimuli are highly likely to be perceived as part of the same environmental event. Several studies have described the temporal bounds of this window, but few have investigated its malleability. Recently, our laboratory has demonstrated that a perceptual training paradigm is capable of eliciting a 40% narrowing in the width of this window that is stable for at least 1 week after cessation of training. In the current study, we sought to reveal the neural substrates of these changes. Eleven human subjects completed an audiovisual simultaneity judgment training paradigm, immediately before and after which they performed the same task during an event-related 3T fMRI session. The posterior superior temporal sulcus (pSTS) and areas of auditory and visual cortex exhibited robust BOLD decreases following training, and resting state and effective connectivity analyses revealed significant increases in coupling among these cortices after training. These results provide the first evidence of the neural correlates underlying changes in multisensory temporal binding likely representing the substrate for a multisensory temporal binding window.

Neural correlates of multisensory perceptual learning

The brain's ability to bind incoming auditory and visual stimuli depends critically on the temporal structure of this information. Specifically, there exists a temporal window of audiovisual integration within which stimuli are highly likely to be perceived as part of the same environmental event. Several studies have described the temporal bounds of this window, but few have investigated its malleability. Recently, our laboratory has demonstrated that a perceptual training paradigm is capable of eliciting a 40% narrowing in the width of this window that is stable for at least 1 week after cessation of training. In the current study, we sought to reveal the neural substrates of these changes. Eleven human subjects completed an audiovisual simultaneity judgment training paradigm, immediately before and after which they performed the same task during an event-related 3T fMRI session. The posterior superior temporal sulcus (pSTS) and areas of auditory and visual cortex exhibited robust BOLD decreases following training, and resting state and effective connectivity analyses revealed significant increases in coupling among these cortices after training. These results provide the first evidence of the neural correlates underlying changes in multisensory temporal binding likely representing the substrate for a multisensory temporal binding window.

Cortical plasticity for visuospatial processing and object recognition in deaf and hearing signers

Experience-dependent plasticity in deaf participants has been shown in a variety of studies focused on either the dorsal or ventral aspects of the visual system, but both systems have never been investigated in concert. Using functional magnetic resonance imaging (fMRI), we investigated functional plasticity for spatial processing (a dorsal visual pathway function) and for object processing (a ventral visual pathway function) concurrently, in the context of differing sensory (auditory deprivation) and language (use of a signed language) experience. During scanning, deaf native users of American Sign Language (ASL), hearing native ASL users, and hearing participants without ASL experience attended to either the spatial arrangement of frames containing objects or the identity of the objects themselves. These two tasks revealed the expected dorsal/ventral dichotomy for spatial versus object processing in all groups. In addition, the object identity matching task contained both face and house stimuli, allowing us to examine category-selectivity in the ventral pathway in all three participant groups. When contrasting the groups we found that deaf signers differed from the two hearing groups in dorsal pathway parietal regions involved in spatial cognition, suggesting sensory experience-driven plasticity. Group differences in the object processing system indicated that responses in the face-selective right lateral fusiform gyrus and anterior superior temporal cortex were sensitive to a combination of altered sensory and language experience, whereas responses in the amygdala were more closely tied to sensory experience. By selectively engaging the dorsal and ventral visual pathways within participants in groups with different sensory and language experiences, we have demonstrated that these experiences affect the function of both of these systems, and that certain changes are more closely tied to sensory experience, while others are driven by the combination of sensory and language experience.

Random noise stimulation improves neuroplasticity in perceptual learning

Perceptual learning is considered a manifestation of neural plasticity in the human brain. We investigated brain plasticity mechanisms in a learning task using noninvasive transcranial electrical stimulation (tES). We hypothesized that different types of tES would have varying actions on the nervous system, which would result in different efficacies of neural plasticity modulation. Thus, the principal goal of the present study was to verify the possibility of inducing differential plasticity effects using two tES approaches [i.e., direct current stimulation (tDCS) and random noise stimulation (tRNS)] during the execution of a visual perceptual learning task.

Co-learning analysis of two perceptual learning tasks with identical input stimuli supports the reweighting hypothesis

Perceptual learning, even when it exhibits significant specificity to basic stimulus features such as retinal location or spatial frequency, may cause discrimination performance to improve either through enhancement of early sensory representations or through selective re-weighting of connections from the sensory representations to specific responses, or both. For most experiments in the literature, the two forms of plasticity make similar predictions (Dosher & Lu, 2009; Petrov, Dosher, & Lu, 2005). The strongest test of the two hypotheses must use training and transfer tasks that rely on the same sensory representation with different task-dependent decision structures. If training changes sensory representations, transfer (or interference) must occur since the (changed) sensory representations are common. If instead training re-weights a separate set of task connections to decision, then performance in the two tasks may still be independent. Here, we performed a co-learning analysis of two perceptual learning tasks based on identical input stimuli, following a very interesting study of Fahle and Morgan (1996) who used nearly identical input stimuli (a three dot pattern) in training bisection and vernier tasks. Two important modifications were made: (1) identical input stimuli were used in the two tasks, and (2) subjects practiced both tasks in multiple alternating blocks (800 trials/block). Two groups of subjects with counter-balanced order of training participated in the experiments. We found significant and independent learning of the two tasks. The pattern of results is consistent with the reweighting hypothesis of perceptual learning.

Attentional modulation in visual cortex is modified during perceptual learning

Practicing a visual task commonly results in improved performance. Often the improvement does not transfer well to a new retinal location, suggesting that it is mediated by changes occurring in early visual cortex, and indeed neuroimaging and neurophysiological studies both demonstrate that perceptual learning is associated with altered activity in visual cortex. Theoretical treatments tend to invoke neuroplasticity that refines early sensory processing. An alternative possibility is that performance is improved because of an altered attentional strategy and that the changes in early visual areas reflect locally altered top-down attentional modulation. To test this idea, we have used functional MRI to examine changes in attentional modulation in visual cortex while participants learn an orientation discrimination task. By examining activity in visual cortex during the preparatory period when the participant has been cued to attend to an upcoming stimulus, we isolated the top-down modulatory signal received by the visual cortex. We show that this signal changes as learning progresses, possibly reflecting gradual automation of the task. By manipulating task difficulty, we show that the change mirrors performance, occurring most quickly for easier stimuli. The effects were seen only at the retinal locus of the stimulus, ruling out a generalized change in alertness. The results suggest that spatial attention changes during perceptual learning and that this may account for some of the concomitant changes seen in visual cortex.

Neural correlates of contextual cueing are modulated by explicit learning

Contextual cueing refers to the facilitated ability to locate a particular visual element in a scene due to prior exposure to the same scene. This facilitation is thought to reflect implicit learning, as it typically occurs without the observer's knowledge that scenes repeat. Unlike most other implicit learning effects, contextual cueing can be impaired following damage to the medial temporal lobe. Here we investigated neural correlates of contextual cueing and explicit scene memory in two participant groups. Only one group was explicitly instructed about scene repetition. Participants viewed a sequence of complex scenes that depicted a landscape with five abstract geometric objects. Superimposed on each object was a letter T or L rotated left or right by 90°. Participants responded according to the target letter (T) orientation. Responses were highly accurate for all scenes. Response speeds were faster for repeated versus novel scenes. The magnitude of this contextual cueing did not differ between the two groups. Also, in both groups repeated scenes yielded reduced hemodynamic activation compared with novel scenes in several regions involved in visual perception and attention, and reductions in some of these areas were correlated with response-time facilitation. In the group given instructions about scene repetition, recognition memory for scenes was superior and was accompanied by medial temporal and more anterior activation. Thus, strategic factors can promote explicit memorization of visual scene information, which appears to engage additional neural processing beyond what is required for implicit learning of object configurations and target locations in a scene.

Visual perception and memory systems: from cortex to medial temporal lobe

Visual perception and memory are the most important components of vision processing in the brain. It was thought that the perceptual aspect of a visual stimulus occurs in visual cortical areas and that this serves as the substrate for the formation of visual memory in a distinct part of the brain called the medial temporal lobe. However, current evidence indicates that there is no functional separation of areas. Entire visual cortical pathways and connecting medial temporal lobe are important for both perception and visual memory. Though some aspects of this view are debated, evidence from both sides will be explored here. In this review, we will discuss the anatomical and functional architecture of the entire system and the implications of these structures in visual perception and memory.

Holistic processing of musical notation: Dissociating failures of selective attention in experts and novices

Holistic processing (i.e., the tendency to process objects as wholes) is associated with face perception and also with expertise individuating novel objects. Surprisingly, recent work also reveals holistic effects in novice observers. It is unclear whether the same mechanisms support holistic effects in experts and in novices. In the present study, we measured holistic processing of music sequences using a selective attention task in participants who vary in music-reading expertise. We found that holistic effects were strategic in novices but were relatively automatic in experts. Correlational analyses revealed that individual holistic effects were predicted by both individual music-reading ability and neural responses for musical notation in the right fusiform face area (rFFA), but in opposite directions for experts and novices, suggesting that holistic effects in the two groups may be of different natures. To characterize expert perception, it is important not only to measure the tendency to process objects as wholes, but also to test whether this effect is dependent on task constraints.

Visual perceptual learning

Perceptual learning refers to the phenomenon that practice or training in perceptual tasks often substantially improves perceptual performance. Often exhibiting stimulus or task specificities, perceptual learning differs from learning in the cognitive or motor domains. Research on perceptual learning reveals important plasticity in adult perceptual systems, and as well as the limitations in the information processing of the human observer. In this article, we review the behavioral results, mechanisms, physiological basis, computational models, and applications of visual perceptual learning.

Brain dynamics underlying training-induced improvement in suppressing inappropriate action

Inhibitory control, a core component of executive functions, refers to our ability to suppress intended or ongoing cognitive or motor processes. Mostly based on Go/NoGo paradigms, a considerable amount of literature reports that inhibitory control of responses to "NoGo" stimuli is mediated by top-down mechanisms manifesting ∼200 ms after stimulus onset within frontoparietal networks. However, whether inhibitory functions in humans can be trained and the supporting neurophysiological mechanisms remain unresolved. We addressed these issues by contrasting auditory evoked potentials (AEPs) to left-lateralized "Go" and right NoGo stimuli recorded at the beginning versus the end of 30 min of active auditory spatial Go/NoGo training, as well as during passive listening of the same stimuli before versus after the training session, generating two separate 2 × 2 within-subject designs. Training improved Go/NoGo proficiency. Response times to Go stimuli decreased. During active training, AEPs to NoGo, but not Go, stimuli modulated topographically with training 61-104 ms after stimulus onset, indicative of changes in the underlying brain network. Source estimations revealed that this modulation followed from decreased activity within left parietal cortices, which in turn predicted the extent of behavioral improvement. During passive listening, in contrast, effects were limited to topographic modulations of AEPs in response to Go stimuli over the 31-81 ms interval, mediated by decreased right anterior temporoparietal activity. We discuss our results in terms of the development of an automatic and bottom-up form of inhibitory control with training and a differential effect of Go/NoGo training during active executive control versus passive listening conditions.

A Multimodal Neural Network Recruited by Expertise with Musical Notation

Prior neuroimaging work on visual perceptual expertise has focused on changes in the visual system, ignoring possible effects of acquiring expert visual skills in nonvisual areas. We investigated expertise for reading musical notation, a skill likely to be associated with multimodal abilities. We compared brain activity in music-reading experts and novices during perception of musical notation, Roman letters, and mathematical symbols and found selectivity for musical notation for experts in a widespread multimodal network of areas. The activity in several of these areas was correlated with a behavioral measure of perceptual fluency with musical notation, suggesting that activity in nonvisual areas can predict individual differences in visual expertise. The visual selectivity for musical notation is distinct from that for faces, single Roman letters, and letter strings. Implications of the current findings to the study of visual perceptual expertise, music reading, and musical expertise are discussed.