Somatosensory and visual crossmodal plasticity in the anterior auditory field of early-deaf cats

Cross-modal plasticity in developmental and age-related hearing loss: Clinical implications

This review explores cross-modal cortical plasticity as a result of auditory deprivation in populations with hearing loss across the age spectrum, from development to adulthood. Cross-modal plasticity refers to the phenomenon when deprivation in one sensory modality (e.g. the auditory modality as in deafness or hearing loss) results in the recruitment of cortical resources of the deprived modality by intact sensory modalities (e.g. visual or somatosensory systems). We discuss recruitment of auditory cortical resources for visual and somatosensory processing in deafness and in lesser degrees of hearing loss. We describe developmental cross-modal re-organization in the context of congenital or pre-lingual deafness in childhood and in the context of adult-onset, age-related hearing loss, with a focus on how cross-modal plasticity relates to clinical outcomes. We provide both single-subject and group-level evidence of cross-modal re-organization by the visual and somatosensory systems in bilateral, congenital deafness, single-sided deafness, adults with early-stage, mild-moderate hearing loss, and individual adult and pediatric patients exhibit excellent and average speech perception with hearing aids and cochlear implants. We discuss a framework in which changes in cortical resource allocation secondary to hearing loss results in decreased intra-modal plasticity in auditory cortex, accompanied by increased cross-modal recruitment of auditory cortices by the other sensory systems, and simultaneous compensatory activation of frontal cortices. The frontal cortices, as we will discuss, play an important role in mediating cognitive compensation in hearing loss. Given the wide range of variability in behavioral performance following audiological intervention, changes in cortical plasticity may play a valuable role in the prediction of clinical outcomes following intervention. Further, the development of new technologies and rehabilitation strategies that incorporate brain-based biomarkers may help better serve hearing impaired populations across the lifespan.

Category selectivity of the N170 and the role of expertise in deaf signers

Deafness is known to affect processing of visual motion and information in the visual periphery, as well as the neural substrates for these domains. This study was designed to characterize the effects of early deafness and lifelong sign language use on visual category sensitivity of the N170 event-related potential. Images from nine categories of visual forms including upright faces, inverted faces, and hands were presented to twelve typically hearing adults and twelve adult congenitally deaf signers. Classic N170 category sensitivity was observed in both participant groups, whereby faces elicited larger amplitudes than all other visual categories, and inverted faces elicited larger amplitudes and slower latencies than upright faces. In hearing adults, hands elicited a right hemispheric asymmetry while in deaf signers this category elicited a left hemispheric asymmetry. Pilot data from five hearing native signers suggests that this effect is due to lifelong use of American Sign Language rather than auditory deprivation itself.

Hemispheric asymmetries in subcortical visual and auditory relay structures in congenital deafness

Neuroplasticity - the capacity of the brain to change as a response to internal and external pressures - has been studied from a number of different perspectives. Perhaps one of the most powerful models is the study of populations that have been congenitally deprived of a sense. It has been shown that the right Auditory Cortex (AC) of congenitally deaf humans is neuroplastically modified in order to represent visual properties of a stimulus. One unresolved question is how this visual information is routed to the AC of congenitally deaf individuals. Here, we performed volumetric analysis of subcortical auditory and visual brains regions - namely the thalamus (along with three thalamic nuclei: the pulvinar, the lateral geniculate nucleus and the medial geniculate nucleus), and the inferior and superior colliculi - in deaf and hearing participants in order to identify which structures may be responsible for relaying visual information toward the altered AC. Because there is a hemispheric asymmetry in the neuroplastic changes observed in the AC of the congenitally deaf, we reasoned that subcortical structures that also showed a similar asymmetry in their total volume could have been enlisted in the effort of relaying visual information to the neuroplastically altered right AC. We show that for deaf, but not for hearing individuals, the right thalamus, right lateral geniculate nucleus and right inferior colliculus are larger than their left counterparts. These results suggest that these subcortical structures may be responsible for rerouting visual information to the AC in congenital deafness.

Crossmodal plasticity in auditory, visual and multisensory cortical areas following noise-induced hearing loss in adulthood

Complete or partial hearing loss results in an increased responsiveness of neurons in the core auditory cortex of numerous species to visual and/or tactile stimuli (i.e., crossmodal plasticity). At present, however, it remains uncertain how adult-onset partial hearing loss affects higher-order cortical areas that normally integrate audiovisual information. To that end, extracellular electrophysiological recordings were performed under anesthesia in noise-exposed rats two weeks post-exposure (0.8-20 kHz at 120 dB SPL for 2 h) and age-matched controls to characterize the nature and extent of crossmodal plasticity in the dorsal auditory cortex (AuD), an area outside of the auditory core, as well as in the neighboring lateral extrastriate visual cortex (V2L), an area known to contribute to audiovisual processing. Computer-generated auditory (noise burst), visual (light flash) and combined audiovisual stimuli were delivered, and the associated spiking activity was used to determine the response profile of each neuron sampled (i.e., unisensory, subthreshold multisensory or bimodal). In both the AuD cortex and the multisensory zone of the V2L cortex, the maximum firing rates were unchanged following noise exposure, and there was a relative increase in the proportion of neurons responsive to visual stimuli, with a concomitant decrease in the number of neurons that were solely responsive to auditory stimuli despite adjusting the sound intensity to account for each rat's hearing threshold. These neighboring cortical areas differed, however, in how noise-induced hearing loss affected audiovisual processing; the total proportion of multisensory neurons significantly decreased in the V2L cortex (control 38.8 ± 3.3% vs. noise-exposed 27.1 ± 3.4%), and dramatically increased in the AuD cortex (control 23.9 ± 3.3% vs. noise-exposed 49.8 ± 6.1%). Thus, following noise exposure, the cortical area showing the greatest relative degree of multisensory convergence transitioned ventrally, away from the audiovisual area, V2L, toward the predominantly auditory area, AuD. Overall, the collective findings of the present study support the suggestion that crossmodal plasticity induced by adult-onset hearing impairment manifests in higher-order cortical areas as a transition in the functional border of the audiovisual cortex.

Species-dependent role of crossmodal connectivity among the primary sensory cortices

When a major sense is lost, crossmodal plasticity substitutes functional processing from the remaining, intact senses. Recent studies of deafness-induced crossmodal plasticity in different subregions of auditory cortex indicate that the phenomenon is largely based on the "unmasking" of existing inputs. However, there is not yet a consensus on the sources or effects of crossmodal inputs to primary sensory cortical areas. In the present review, a rigorous re-examination of the experimental literature indicates that connections between different primary sensory cortices consistently occur in rodents, while primary-to-primary projections are absent/inconsistent in non-rodents such as cats and monkeys. These observations suggest that crossmodal plasticity that involves primary sensory areas are likely to exhibit species-specific distinctions.

The onset of visual experience gates auditory cortex critical periods

Sensory systems influence one another during development and deprivation can lead to cross-modal plasticity. As auditory function begins before vision, we investigate the effect of manipulating visual experience during auditory cortex critical periods (CPs) by assessing the influence of early, normal and delayed eyelid opening on hearing loss-induced changes to membrane and inhibitory synaptic properties. Early eyelid opening closes the auditory cortex CPs precociously and dark rearing prevents this effect. In contrast, delayed eyelid opening extends the auditory cortex CPs by several additional days. The CP for recovery from hearing loss is also closed prematurely by early eyelid opening and extended by delayed eyelid opening. Furthermore, when coupled with transient hearing loss that animals normally fully recover from, very early visual experience leads to inhibitory deficits that persist into adulthood. Finally, we demonstrate a functional projection from the visual to auditory cortex that could mediate these effects.

Visual and auditory systems influence each other during development. Here, the authors show that the onset of eyelid opening regulates critical points during which the auditory cortex is sensitive to hearing loss or the restoration of hearing

Early unilateral cochlear implantation promotes mature cortical asymmetries in adolescents who are deaf

Unilateral cochlear implant (CI) stimulation establishes hearing to children who are deaf but compromises bilateral auditory development if a second implant is not provided within ∼ 1.5 years. In this study we asked: 1) What are the cortical consequences of missing this early sensitive period once children reach adolescence? 2) What are the effects of unilateral deprivation on the pathways from the opposite ear? Cortical responses were recorded from 64-cephalic electrodes within the first week of bilateral CI activation in 34 adolescents who had over 10 years of unilateral right CI experience and in 16 normal hearing peers. Cortical activation underlying the evoked peaks was localized to areas of the brain using beamformer imaging. The first CI evoked activity which was more strongly lateralized to the contralateral left hemisphere than normal, with abnormal recruitment of the left prefrontal cortex (involved in cognition/attention), left temporo-parietal-occipital junction (multi-modal integration), and right precuneus (visual processing) region. CI stimulation in the opposite deprived ear evoked atypical cortical responses with abnormally large and widespread dipole activity across the cortex. Thus, using a unilateral CI to hear beyond the period of cortical maturation causes lasting asymmetries in the auditory system, requires recruitment of additional cortical areas to support hearing, and does little to protect the unstimulated pathways from effects of auditory deprivation. The persistence of this reorganization into maturity could signal a closing of a sensitive period for promoting auditory development on the deprived side.

Cortical and thalamic connectivity of the auditory anterior ectosylvian cortex of early-deaf cats: Implications for neural mechanisms of crossmodal plasticity

Early hearing loss leads to crossmodal plasticity in regions of the cerebrum that are dominated by acoustical processing in hearing subjects. Until recently, little has been known of the connectional basis of this phenomenon. One region whose crossmodal properties are well-established is the auditory field of the anterior ectosylvian sulcus (FAES) in the cat, where neurons are normally responsive to acoustic stimulation and its deactivation leads to the behavioral loss of accurate orienting toward auditory stimuli. However, in early-deaf cats, visual responsiveness predominates in the FAES and its deactivation blocks accurate orienting behavior toward visual stimuli. For such crossmodal reorganization to occur, it has been presumed that novel inputs or increased projections from non-auditory cortical areas must be generated, or that existing non-auditory connections were 'unmasked.' These possibilities were tested using tracer injections into the FAES of adult cats deafened early in life (and hearing controls), followed by light microscopy to localize retrogradely labeled neurons. Surprisingly, the distribution of cortical and thalamic afferents to the FAES was very similar among early-deaf and hearing animals. No new visual projection sources were identified and visual cortical connections to the FAES were comparable in projection proportions. These results support an alternate theory for the connectional basis for cross-modal plasticity that involves enhanced local branching of existing projection terminals that originate in non-auditory as well as auditory cortices.

Single-unit analysis of somatosensory processing in the core auditory cortex of hearing ferrets

The recent findings in several species that the primary auditory cortex processes non-auditory information have largely overlooked the possibility of somatosensory effects. Therefore, the present investigation examined the core auditory cortices (anterior auditory field and primary auditory cortex) for tactile responsivity. Multiple single-unit recordings from anesthetised ferret cortex yielded histologically verified neurons (n = 311) tested with electronically controlled auditory, visual and tactile stimuli, and their combinations. Of the auditory neurons tested, a small proportion (17%) was influenced by visual cues, but a somewhat larger number (23%) was affected by tactile stimulation. Tactile effects rarely occurred alone and spiking responses were observed in bimodal auditory-tactile neurons. However, the broadest tactile effect that was observed, which occurred in all neuron types, was that of suppression of the response to a concurrent auditory cue. The presence of tactile effects in the core auditory cortices was supported by a substantial anatomical projection from the rostral suprasylvian sulcal somatosensory area. Collectively, these results demonstrate that crossmodal effects in the auditory cortex are not exclusively visual and that somatosensation plays a significant role in modulation of acoustic processing, and indicate that crossmodal plasticity following deafness may unmask these existing non-auditory functions.

Decoding Visual Location From Neural Patterns in the Auditory Cortex of the Congenitally Deaf

Sensory cortices of individuals who are congenitally deprived of a sense can exhibit considerable plasticity and be recruited to process information from the senses that remain intact. Here, we explored whether the auditory cortex of congenitally deaf individuals represents visual field location of a stimulus-a dimension that is represented in early visual areas. We used functional MRI to measure neural activity in auditory and visual cortices of congenitally deaf and hearing humans while they observed stimuli typically used for mapping visual field preferences in visual cortex. We found that the location of a visual stimulus can be successfully decoded from the patterns of neural activity in auditory cortex of congenitally deaf but not hearing individuals. This is particularly true for locations within the horizontal plane and within peripheral vision. These data show that the representations stored within neuroplastically changed auditory cortex can align with dimensions that are typically represented in visual cortex.

Differential activity in Heschl's gyrus between deaf and hearing individuals is due to auditory deprivation rather than language modality

Sensory cortices undergo crossmodal reorganisation as a consequence of sensory deprivation. Congenital deafness in humans represents a particular case with respect to other types of sensory deprivation, because cortical reorganisation is not only a consequence of auditory deprivation, but also of language-driven mechanisms. Visual crossmodal plasticity has been found in secondary auditory cortices of deaf individuals, but it is still unclear if reorganisation also takes place in primary auditory areas, and how this relates to language modality and auditory deprivation. Here, we dissociated the effects of language modality and auditory deprivation on crossmodal plasticity in Heschl's gyrus as a whole, and in cytoarchitectonic region Te1.0 (likely to contain the core auditory cortex). Using fMRI, we measured the BOLD response to viewing sign language in congenitally or early deaf individuals with and without sign language knowledge, and in hearing controls. Results show that differences between hearing and deaf individuals are due to a reduction in activation caused by visual stimulation in the hearing group, which is more significant in Te1.0 than in Heschl's gyrus as a whole. Furthermore, differences between deaf and hearing groups are due to auditory deprivation, and there is no evidence that the modality of language used by deaf individuals contributes to crossmodal plasticity in Heschl's gyrus.

Cortical cross-modal plasticity following deafness measured using functional near-infrared spectroscopy

Evidence from functional neuroimaging studies suggests that the auditory cortex can become more responsive to visual and somatosensory stimulation following deafness, and that this occurs predominately in the right hemisphere. Extensive cross-modal plasticity in prospective cochlear implant recipients is correlated with poor speech outcomes following implantation, highlighting the potential impact of central auditory plasticity on subsequent aural rehabilitation. Conversely, the effects of hearing restoration with a cochlear implant on cortical plasticity are less well understood, since the use of most neuroimaging techniques in CI recipients is either unsafe or problematic due to the electromagnetic artefacts generated by CI stimulation. Additionally, techniques such as functional magnetic resonance imaging (fMRI) are confounded by acoustic noise produced by the scanner that will be perceived more by hearing than by deaf individuals. Subsequently it is conceivable that auditory responses to acoustic noise produced by the MR scanner may mask auditory cortical responses to non-auditory stimulation, and render inter-group comparisons less significant. Uniquely, functional near-infrared spectroscopy (fNIRS) is a silent neuroimaging technique that is non-invasive and completely unaffected by the presence of a CI. Here, we used fNIRS to study temporal-lobe responses to auditory, visual and somatosensory stimuli in thirty profoundly-deaf participants and thirty normally-hearing controls. Compared with silence, acoustic noise stimuli elicited a significant group fNIRS response in the temporal region of normally-hearing individuals, which was not seen in profoundly-deaf participants. Visual motion elicited a larger group response within the right temporal lobe of profoundly-deaf participants, compared with normally-hearing controls. However, bilateral temporal lobe fNIRS activation to somatosensory stimulation was comparable in both groups. Using fNIRS these results confirm that auditory deprivation is associated with cross-modal plasticity of visual inputs to auditory cortex. Although we found no evidence for plasticity of somatosensory inputs, it is possible that our recordings may have included activation of somatosensory cortex that masked any group differences in auditory cortical responses due to the limited spatial resolution associated with fNIRS.

Binaural fusion and listening effort in children who use bilateral cochlear implants: a psychoacoustic and pupillometric study

Bilateral cochlear implants aim to provide hearing to both ears for children who are deaf and promote binaural/spatial hearing. Benefits are limited by mismatched devices and unilaterally-driven development which could compromise the normal integration of left and right ear input. We thus asked whether children hear a fused image (ie. 1 vs 2 sounds) from their bilateral implants and if this “binaural fusion” reduces listening effort. Binaural fusion was assessed by asking 25 deaf children with cochlear implants and 24 peers with normal hearing whether they heard one or two sounds when listening to bilaterally presented acoustic click-trains/electric pulses (250 Hz trains of 36 ms presented at 1 Hz). Reaction times and pupillary changes were recorded simultaneously to measure listening effort. Bilaterally implanted children heard one image of bilateral input less frequently than normal hearing peers, particularly when intensity levels on each side were balanced. Binaural fusion declined as brainstem asymmetries increased and age at implantation decreased. Children implanted later had access to acoustic input prior to implantation due to progressive deterioration of hearing. Increases in both pupil diameter and reaction time occurred as perception of binaural fusion decreased. Results indicate that, without binaural level cues, children have difficulty fusing input from their bilateral implants to perceive one sound which costs them increased listening effort. Brainstem asymmetries exacerbate this issue. By contrast, later implantation, reflecting longer access to bilateral acoustic hearing, may have supported development of auditory pathways underlying binaural fusion. Improved integration of bilateral cochlear implant signals for children is required to improve their binaural hearing.

Auditory feedback modulates development of kitten vocalizations

Effects of hearing loss on vocal behavior are species-specific. To study the impact of auditory feedback on feline vocal behavior, vocalizations of normal-hearing, hearing-impaired (white) and congenitally deaf (white) cats were analyzed at around weaning age. Eleven animals were placed in a soundproof booth for 30 min at different ages, from the first to the beginning of the fourth postnatal month, every 2 weeks of life. In total, 13,874 vocalizations were analyzed using an automated procedure. Firstly, vocalizations were detected and segmented, with voiced and unvoiced vocalizations being differentiated. The voiced isolation calls (‘meow’) were further analyzed. These vocalizations showed developmental changes affecting several parameters in hearing controls, whereas the developmental sequence was delayed in congenitally deaf cats. In hearing-impaired and deaf animals, we observed differences both in vocal behavior (loudness and duration) and in the calls’ acoustic structure (fundamental frequency and higher harmonics). The fundamental frequency decreased with age in all groups, most likely due to maturation of the vocal apparatus. In deaf cats, however, other aspects of the acoustic structure of the vocalizations did not fully mature. The harmonic ratio (i.e., frequency of first harmonic divided by fundamental frequency) was higher and more variable in deaf cats than in the other study groups. Auditory feedback thus affects the acoustic structure of vocalizations and their ontogenetic development. The study suggests that both the vocal apparatus and its neuronal motor control are subject to maturational processes, whereas the latter is additionally dependent on auditory feedback in cats.

Synaptic Basis for Cross-modal Plasticity: Enhanced Supragranular Dendritic Spine Density in Anterior Ectosylvian Auditory Cortex of the Early Deaf Cat

In the cat, the auditory field of the anterior ectosylvian sulcus (FAES) is sensitive to auditory cues and its deactivation leads to orienting deficits toward acoustic, but not visual, stimuli. However, in early deaf cats, FAES activity shifts to the visual modality and its deactivation blocks orienting toward visual stimuli. Thus, as in other auditory cortices, hearing loss leads to cross-modal plasticity in the FAES. However, the synaptic basis for cross-modal plasticity is unknown. Therefore, the present study examined the effect of early deafness on the density, distribution, and size of dendritic spines in the FAES. Young cats were ototoxically deafened and raised until adulthood when they (and hearing controls) were euthanized, the cortex stained using Golgi-Cox, and FAES neurons examined using light microscopy. FAES dendritic spine density averaged 0.85 spines/μm in hearing animals, but was significantly higher (0.95 spines/μm) in the early deaf. Size distributions and increased spine density were evident specifically on apical dendrites of supragranular neurons. In separate tracer experiments, cross-modal cortical projections were shown to terminate predominantly within the supragranular layers of the FAES. This distributional correspondence between projection terminals and dendritic spine changes indicates that cross-modal plasticity is synaptically based within the supragranular layers of the early deaf FAES.

Enhanced peripheral visual processing in congenitally deaf humans is supported by multiple brain regions, including primary auditory cortex

Brain reorganization associated with altered sensory experience clarifies the critical role of neuroplasticity in development. An example is enhanced peripheral visual processing associated with congenital deafness, but the neural systems supporting this have not been fully characterized. A gap in our understanding of deafness-enhanced peripheral vision is the contribution of primary auditory cortex. Previous studies of auditory cortex that use anatomical normalization across participants were limited by inter-subject variability of Heschl's gyrus. In addition to reorganized auditory cortex (cross-modal plasticity), a second gap in our understanding is the contribution of altered modality-specific cortices (visual intramodal plasticity in this case), as well as supramodal and multisensory cortices, especially when target detection is required across contrasts. Here we address these gaps by comparing fMRI signal change for peripheral vs. perifoveal visual stimulation (11-15° vs. 2-7°) in congenitally deaf and hearing participants in a blocked experimental design with two analytical approaches: a Heschl's gyrus region of interest analysis and a whole brain analysis. Our results using individually-defined primary auditory cortex (Heschl's gyrus) indicate that fMRI signal change for more peripheral stimuli was greater than perifoveal in deaf but not in hearing participants. Whole-brain analyses revealed differences between deaf and hearing participants for peripheral vs. perifoveal visual processing in extrastriate visual cortex including primary auditory cortex, MT+/V5, superior-temporal auditory, and multisensory and/or supramodal regions, such as posterior parietal cortex (PPC), frontal eye fields, anterior cingulate, and supplementary eye fields. Overall, these data demonstrate the contribution of neuroplasticity in multiple systems including primary auditory cortex, supramodal, and multisensory regions, to altered visual processing in congenitally deaf adults.

How does visual language affect crossmodal plasticity and cochlear implant success?

Cochlear implants (CI) are the most successful intervention for ameliorating hearing loss in severely or profoundly deaf children. Despite this, educational performance in children with CI continues to lag behind their hearing peers. From animal models and human neuroimaging studies it has been proposed the integrative functions of auditory cortex are compromised by crossmodal plasticity. This has been argued to result partly from the use of a visual language. Here we argue that 'cochlear implant sensitive periods' comprise both auditory and language sensitive periods, and thus cannot be fully described with animal models. Despite prevailing assumptions, there is no evidence to link the use of a visual language to poorer CI outcome. Crossmodal reorganisation of auditory cortex occurs regardless of compensatory strategies, such as sign language, used by the deaf person. In contrast, language deprivation during early sensitive periods has been repeatedly linked to poor language outcomes. Language sensitive periods have largely been ignored when considering variation in CI outcome, leading to ill-founded recommendations concerning visual language in CI habilitation.

Functional and structural changes throughout the auditory system following congenital and early-onset deafness: implications for hearing restoration

The absence of auditory input, particularly during development, causes widespread changes in the structure and function of the auditory system, extending from peripheral structures into auditory cortex. In humans, the consequences of these changes are far-reaching and often include detriments to language acquisition, and associated psychosocial issues. Much of what is currently known about the nature of deafness-related changes to auditory structures comes from studies of congenitally deaf or early-deafened animal models. Fortunately, the mammalian auditory system shows a high degree of preservation among species, allowing for generalization from these models to the human auditory system. This review begins with a comparison of common methods used to obtain deaf animal models, highlighting the specific advantages and anatomical consequences of each. Some consideration is also given to the effectiveness of methods used to measure hearing loss during and following deafening procedures. The structural and functional consequences of congenital and early-onset deafness have been examined across a variety of mammals. This review attempts to summarize these changes, which often involve alteration of hair cells and supporting cells in the cochleae, and anatomical and physiological changes that extend through subcortical structures and into cortex. The nature of these changes is discussed, and the impacts to neural processing are addressed. Finally, long-term changes in cortical structures are discussed, with a focus on the presence or absence of cross-modal plasticity. In addition to being of interest to our understanding of multisensory processing, these changes also have important implications for the use of assistive devices such as cochlear implants.

Benefits and detriments of unilateral cochlear implant use on bilateral auditory development in children who are deaf

We have explored both the benefits and detriments of providing electrical input through a cochlear implant in one ear to the auditory system of young children. A cochlear implant delivers electrical pulses to stimulate the auditory nerve, providing children who are deaf with access to sound. The goals of implantation are to restrict reorganization of the deprived immature auditory brain and promote development of hearing and spoken language. It is clear that limiting the duration of deprivation is a key factor. Additional considerations are the onset, etiology, and use of residual hearing as each of these can have unique effects on auditory development in the pre-implant period. New findings show that many children receiving unilateral cochlear implants are developing mature-like brainstem and thalamo-cortical responses to sound with long term use despite these sources of variability; however, there remain considerable abnormalities in cortical function. The most apparent, determined by implanting the other ear and measuring responses to acute stimulation, is a loss of normal cortical response from the deprived ear. Recent data reveal that this can be avoided in children by early implantation of both ears simultaneously or with limited delay. We conclude that auditory development requires input early in development and from both ears.

Visual movement perception in deaf and hearing individuals

A number of studies have investigated changes in the perception of visual motion as a result of altered sensory experiences. An animal study has shown that auditory-deprived cats exhibit enhanced performance in a visual movement detection task compared to hearing cats (Lomber, Meredith, & Kral, 2010). In humans, the behavioural evidence regarding the perception of motion is less clear. The present study investigated deaf and hearing adult participants using a movement localization task and a direction of motion task employing coherently-moving and static visual dot patterns. Overall, deaf and hearing participants did not differ in their movement localization performance, although within the deaf group, a left visual field advantage was found. When discriminating the direction of motion, however, deaf participants responded faster and tended to be more accurate when detecting small differences in direction compared with the hearing controls. These results conform to the view that visual abilities are enhanced after auditory deprivation and extend previous findings regarding visual motion processing in deaf individuals.

Signed words in the congenitally deaf evoke typical late lexicosemantic responses with no early visual responses in left superior temporal cortex

Congenitally deaf individuals receive little or no auditory input, and when raised by deaf parents, they acquire sign as their native and primary language. We asked two questions regarding how the deaf brain in humans adapts to sensory deprivation: (1) is meaning extracted and integrated from signs using the same classical left hemisphere frontotemporal network used for speech in hearing individuals, and (2) in deafness, is superior temporal cortex encompassing primary and secondary auditory regions reorganized to receive and process visual sensory information at short latencies? Using MEG constrained by individual cortical anatomy obtained with MRI, we examined an early time window associated with sensory processing and a late time window associated with lexicosemantic integration. We found that sign in deaf individuals and speech in hearing individuals activate a highly similar left frontotemporal network (including superior temporal regions surrounding auditory cortex) during lexicosemantic processing, but only speech in hearing individuals activates auditory regions during sensory processing. Thus, neural systems dedicated to processing high-level linguistic information are used for processing language regardless of modality or hearing status, and we do not find evidence for rewiring of afferent connections from visual systems to auditory cortex.

Altered cross-modal processing in the primary auditory cortex of congenitally deaf adults: a visual-somatosensory fMRI study with a double-flash illusion

The developing brain responds to the environment by using statistical correlations in input to guide functional and structural changes-that is, the brain displays neuroplasticity. Experience shapes brain development throughout life, but neuroplasticity is variable from one brain system to another. How does the early loss of a sensory modality affect this complex process? We examined cross-modal neuroplasticity in anatomically defined subregions of Heschl's gyrus, the site of human primary auditory cortex, in congenitally deaf humans by measuring the fMRI signal change in response to spatially coregistered visual, somatosensory, and bimodal stimuli. In the deaf Heschl's gyrus, signal change was greater for somatosensory and bimodal stimuli than that of hearing participants. Visual responses in Heschl's gyrus, larger in deaf than hearing, were smaller than those elicited by somatosensory stimulation. In contrast to Heschl's gyrus, in the superior-temporal cortex visual signal was comparable to somatosensory signal. In addition, deaf adults perceived bimodal stimuli differently; in contrast to hearing adults, they were susceptible to a double-flash visual illusion induced by two touches to the face. Somatosensory and bimodal signal change in rostrolateral Heschl's gyrus predicted the strength of the visual illusion in the deaf adults in line with the interpretation that the illusion is a functional consequence of the altered cross-modal organization observed in deaf auditory cortex. Our results demonstrate that congenital and profound deafness alters how vision and somatosensation are processed in primary auditory cortex.

Compromise of auditory cortical tuning and topography after cross-modal invasion by visual inputs

Brain damage resulting in loss of sensory stimulation can induce reorganization of sensory maps in cerebral cortex. Previous research on recovery from brain damage has focused primarily on adaptive plasticity within the affected modality. Less attention has been paid to maladaptive plasticity that may arise as a result of ectopic innervation from other modalities. Using ferrets in which neonatal midbrain damage results in diversion of retinal projections to the auditory thalamus, we investigated how auditory cortical function is impacted by the resulting ectopic visual activation. We found that, although auditory neurons in cross-modal auditory cortex (XMAC) retained sound frequency tuning, their thresholds were increased, their tuning was broader, and tonotopic order in their frequency maps was disturbed. Multisensory neurons in XMAC also exhibited frequency tuning, but they had longer latencies than normal auditory neurons, suggesting they arise from multisynaptic, non-geniculocortical sources. In a control group of animals with neonatal deafferentation of auditory thalamus but without redirection of retinal axons, tonotopic order and sharp tuning curves were seen, indicating that this aspect of auditory function had developed normally. This result shows that the compromised auditory function in XMAC results from invasion by ectopic visual inputs and not from deafferentation. These findings suggest that the cross-modal plasticity that commonly occurs after loss of sensory input can significantly interfere with recovery from brain damage and that mitigation of maladaptive effects is critical to maximizing the potential for recovery.

Enriched and deprived sensory experience induces structural changes and rewires connectivity during the postnatal development of the brain

During postnatal development, sensory experience modulates cortical development, inducing numerous changes in all of the components of the cortex. Most of the cortical changes thus induced occur during the critical period, when the functional and structural properties of cortical neurons are particularly susceptible to alterations. Although the time course for experience-mediated sensory development is specific for each system, postnatal development acts as a whole, and if one cortical area is deprived of its normal sensory inputs during early stages, it will be reorganized by the nondeprived senses in a process of cross-modal plasticity that not only increases performance in the remaining senses when one is deprived, but also rewires the brain allowing the deprived cortex to process inputs from other senses and cortices, maintaining the modular configuration. This paper summarizes our current understanding of sensory systems development, focused specially in the visual system. It delineates sensory enhancement and sensory deprivation effects at both physiological and anatomical levels and describes the use of enriched environment as a tool to rewire loss of brain areas to enhance other active senses. Finally, strategies to apply restorative features in human-deprived senses are studied, discussing the beneficial and detrimental effects of cross-modal plasticity in prostheses and sensory substitution devices implantation.

Multisensory dysfunction accompanies crossmodal plasticity following adult hearing impairment

Until now, cortical crossmodal plasticity has largely been regarded as the effect of early and complete sensory loss. Recently, massive crossmodal cortical reorganization was demonstrated to result from profound hearing loss in adult ferrets (Allman et al., 2009a). Moderate adult hearing loss, on the other hand, induced not just crossmodal reorganization, but also merged new crossmodal inputs with residual auditory function to generate multisensory neurons. Because multisensory convergence can lead to dramatic levels of response integration when stimuli from more than one modality are present (and thereby potentially interfere with residual auditory processing), the present investigation sought to evaluate the multisensory properties of auditory cortical neurons in partially deafened adult ferrets. When compared with hearing controls, partially-deaf animals revealed elevated spontaneous levels and a dramatic increase (∼2 times) in the proportion of multisensory cortical neurons, but few of which showed multisensory integration. Moreover, a large proportion (68%) of neurons with somatosensory and/or visual inputs was vigorously active in core auditory cortex in the absence of auditory stimulation. Collectively, these results not only demonstrate multisensory dysfunction in core auditory cortical neurons from hearing impaired adults but also reveal a potential cortical substrate for maladaptive perceptual effects such as tinnitus.