Crossmodal plasticity in the fusiform gyrus of late blind individuals during voice recognition

Top-down and emotional attention in blind and sighted individuals

There is evidence that congenitally blind individuals possess superior auditory perceptual skills compared to sighted people. However, relatively little is known about the auditory-specific cortical correlates of spatial attention in the blind and how task-irrelevant emotional stimulus features could further modulate such neural processes. This study tested blind and sighted participants in a challenging auditory discrimination task. All participants were blindfolded and seated between loudspeakers at 45-degree angles, while pseudowords were randomly presented. The task was to identify target sounds from either the left or the right speaker while ignoring nontarget stimuli, the irrelevant loudspeaker, and irrelevant speaker identity. Emotional valence-neutral, happy, fearful, threatening-of pseudowords was task-irrelevant, focusing solely on syllable detection. Our focus was on measuring the moment-to-moment deployment of auditory-selective attention. This was achieved using the lateralized N2ac event-related potential component characterised by greater negativity at anterior electrodes on the side contralateral to an attended auditory stimulus and observed 75 to 250 ms after stimulus onset. We observed that blind individuals showed better behavioural performance and reduced N2ac amplitudes than sighted individuals. Furthermore, for both groups, N2ac amplitudes were increased for the target compared to nontarget stimuli and stimuli appearing at spatially relevant versus irrelevant locations. Our study highlights the superiority of auditory processing capabilities in blind individuals. The results also highlight the N2ac component's sensitivity to top-down attentional engagement and emotional attention, offering new insights into how blind and sighted individuals process auditory information.

Brief periods of visual deprivation in adults increase performance on auditory tasks

Plastic changes in the brain are primarily limited to early postnatal periods. Recovery of adult brain plasticity is critical for the effective development of therapies. A brief (1-2 weeks) duration of visual deprivation (dark exposure, DE) in adult mice can trigger functional plasticity of thalamocortical and intracortical circuits in the primary auditory cortex suggesting improved sound processing. We tested if DE enhances the ability of adult mice to detect sounds. We trained and continuously evaluated the behavioral performance of mice in control and DE conditions using automated home-cage training. Consistent with age-related peripheral hearing loss present in C57BL/6J mice, we observed decreased performance for high-frequency sounds with age, which was reduced by DE. In CBA mice with preserved peripheral hearing, we also found that DE showed modest auditory performance improvements in low and mid frequencies over time compared to the control.

The mechanism of phonetic information in voice identity discrimination: a comparative study based on sighted and blind people

Purpose

The purpose of this study is to examine whether phonetic information functions and how phonetic information affects voice identity processing in blind people.

Method

To address the first inquiry, 25 normal sighted participants and 30 blind participants discriminated voice identity, when listening forward speech and backward speech from their own native language and another unfamiliar language. To address the second inquiry, combining articulatory suppression paradigm, 26 normal sighted participants and 26 blind participants discriminated voice identity, when listening forward speech from their own native language and another unfamiliar language.

Results

In Experiment 1, not only in the voice identity discrimination task with forward speech, but also in the discrimination task with backward speech, both the sighted and blind groups showed the superiority of the native language. This finding supports the view that backward speech still retains some phonetic information, and indicates that phonetic information can affect voice identity processing in sighted and blind people. In addition, only the superiority of the native language of sighted people was regulated by the speech manner, which is related to articulatory rehearsal. In Experiment 2, only the superiority of the native language of sighted people was regulated by articulatory suppression. This indicates that phonetic information may act in different ways on voice identity processing in sighted and blind people.

Conclusion

The heightened dependence on voice source information in blind people appears not to undermine the function of phonetic information, but it appears to change the functional mechanism of phonetic information. These findings suggest that the present phonetic familiarity model needs to be improved with respect to the mechanism of phonetic information.

Perception and discrimination of real-life emotional vocalizations in early blind individuals

Introduction

The capacity to understand others' emotions and react accordingly is a key social ability. However, it may be compromised in case of a profound sensory loss that limits the contribution of available contextual cues (e.g., facial expression, gestures, body posture) to interpret emotions expressed by others. In this study, we specifically investigated whether early blindness affects the capacity to interpret emotional vocalizations, whose valence may be difficult to recognize without a meaningful context.

Methods

We asked a group of early blind (N = 22) and sighted controls (N = 22) to evaluate the valence and the intensity of spontaneous fearful and joyful non-verbal vocalizations.

Results

Our data showed that emotional vocalizations presented alone (i.e., with no contextual information) are similarly ambiguous for blind and sighted individuals but are perceived as more intense by the former possibly reflecting their higher saliency when visual experience is unavailable.

Disussion

Our study contributes to a better understanding of how sensory experience shapes ememotion recognition.

Dark exposure reduces high-frequency hearing loss in C57BL/6J mice

Plastic changes in the brain are primarily limited to early postnatal periods. Recovery of adult brain plasticity is critical for the effective development of therapies. A brief (1-2 week) duration of visual deprivation (dark exposure, DE) in adult mice can trigger functional plasticity of thalamocortical and intracortical circuits in the primary auditory cortex suggesting improved sound processing. We tested if DE enhances the ability of adult mice to detect sounds. We trained and continuously evaluated the behavioral performance of mice in control and DE conditions using automated home-cage training. Consistent with age-related peripheral hearing loss present in C57BL/6J mice, we observed decreased performance for high-frequency sounds with age, which was reduced by DE. In CBA mice with preserved peripheral hearing, we also found that DE enhanced auditory performance in low and mid frequencies over time compared to the control.

Reorganization of thalamocortical connections in congenitally blind humans

Cross-modal plasticity in blind individuals has been reported over the past decades showing that nonvisual information is carried and processed by "visual" brain structures. However, despite multiple efforts, the structural underpinnings of cross-modal plasticity in congenitally blind individuals remain unclear. We mapped thalamocortical connectivity and assessed the integrity of white matter of 10 congenitally blind individuals and 10 sighted controls. We hypothesized an aberrant thalamocortical pattern of connectivity taking place in the absence of visual stimuli from birth as a potential mechanism of cross-modal plasticity. In addition to the impaired microstructure of visual white matter bundles, we observed structural connectivity changes between the thalamus and occipital and temporal cortices. Specifically, the thalamic territory dedicated to connections with the occipital cortex was smaller and displayed weaker connectivity in congenitally blind individuals, whereas those connecting with the temporal cortex showed greater volume and increased connectivity. The abnormal pattern of thalamocortical connectivity included the lateral and medial geniculate nuclei and the pulvinar nucleus. For the first time in humans, a remapping of structural thalamocortical connections involving both unimodal and multimodal thalamic nuclei has been demonstrated, shedding light on the possible mechanisms of cross-modal plasticity in humans. The present findings may help understand the functional adaptations commonly observed in congenitally blind individuals.

Brain mechanism of unfamiliar and familiar voice processing: an activation likelihood estimation meta-analysis

Interpersonal communication through vocal information is very important for human society. During verbal interactions, our vocal cord vibrations convey important information regarding voice identity, which allows us to decide how to respond to speakers (e.g., neither greeting a stranger too warmly or speaking too coldly to a friend). Numerous neural studies have shown that identifying familiar and unfamiliar voices may rely on different neural bases. However, the mechanism underlying voice identification of individuals of varying familiarity has not been determined due to vague definitions, confusion of terms, and differences in task design. To address this issue, the present study first categorized three kinds of voice identity processing (perception, recognition and identification) from speakers with different degrees of familiarity. We defined voice identity perception as passively listening to a voice or determining if the voice was human, voice identity recognition as determining if the sound heard was acoustically familiar, and voice identity identification as ascertaining whether a voice is associated with a name or face. Of these, voice identity perception involves processing unfamiliar voices, and voice identity recognition and identification involves processing familiar voices. According to these three definitions, we performed activation likelihood estimation (ALE) on 32 studies and revealed different brain mechanisms underlying processing of unfamiliar and familiar voice identities. The results were as follows: (1) familiar voice recognition/identification was supported by a network involving most regions in the temporal lobe, some regions in the frontal lobe, subcortical structures and regions around the marginal lobes; (2) the bilateral superior temporal gyrus was recruited for voice identity perception of an unfamiliar voice; (3) voice identity recognition/identification of familiar voices was more likely to activate the right frontal lobe than voice identity perception of unfamiliar voices, while voice identity perception of an unfamiliar voice was more likely to activate the bilateral temporal lobe and left frontal lobe; and (4) the bilateral superior temporal gyrus served as a shared neural basis of unfamiliar voice identity perception and familiar voice identity recognition/identification. In general, the results of the current study address gaps in the literature, provide clear definitions of concepts, and indicate brain mechanisms for subsequent investigations.

The impact of low vision on social function: The potential importance of lost visual social cues

Visual cues usually play a vital role in social interaction. As well as being the primary cue for identifying other people, visual cues also provide crucial non-verbal social information via both facial expressions and body language. One consequence of vision loss is the need to rely on non-visual cues during social interaction. Although verbal cues can carry a significant amount of information, this information is often not available to an untrained listener. Here, we review the current literature examining potential ways that the loss of social information due to vision loss might impact social functioning. A large number of studies suggest that low vision and blindness is a risk factor for anxiety and depression. This relationship has been attributed to multiple factors, including anxiety about disease progression, and impairments to quality of life that include difficulties reading, and a lack of access to work and social activities. However, our review suggests a potential additional contributing factor to reduced quality of life that has been hitherto overlooked: blindness may make it more difficult to effectively engage in social interactions, due to a loss of visual information. The current literature suggests it might be worth considering training in voice discrimination and/or recognition when carrying out rehabilitative training in late blind individuals.

Naturalistic stimuli reveal a sensitive period in cross modal responses of visual cortex: Evidence from adult-onset blindness

How do life experiences impact cortical function? In people who are born blind, the "visual" cortices are recruited during nonvisual tasks, such as Braille reading and sound localization. Do visual cortices have a latent capacity to respond to nonvisual information throughout the lifespan? Alternatively, is there a sensitive period of heightened plasticity that makes visual cortex repurposing especially possible during childhood? To gain insight into these questions, we leveraged meaningful naturalistic auditory stimuli to simultaneously engage a broad range of cognitive domains and quantify cross-modal responses across congenitally blind (n = 22), adult-onset blind (vision loss >18 years-of-age, n = 14) and sighted (n = 22) individuals. During fMRI scanning, participants listened to two types of meaningful naturalistic auditory stimuli: excerpts from movies and a spoken narrative. As controls, participants heard the same narrative with the sentences shuffled and the narrative played backwards (i.e., meaningless sounds). We correlated the voxel-wise timecourses of different participants within condition and group. For all groups, all stimulus conditions induced synchrony in auditory cortex while only the narrative stimuli synchronized responses in higher-cognitive fronto-parietal and temporal regions. As previously reported, inter-subject synchrony in visual cortices was higher in congenitally blind than sighted blindfolded participants and this between-group difference was particularly pronounced for meaningful stimuli (movies and narrative). Critically, visual cortex synchrony was no higher in adult-onset blind than sighted blindfolded participants and did not increase with blindness duration. Sensitive period plasticity enables cross-modal repurposing in visual cortices.

Visual mechanisms for voice-identity recognition flexibly adjust to auditory noise level

Recognising the identity of voices is a key ingredient of communication. Visual mechanisms support this ability: recognition is better for voices previously learned with their corresponding face (compared to a control condition). This so‐called ‘face‐benefit’ is supported by the fusiform face area (FFA), a region sensitive to facial form and identity. Behavioural findings indicate that the face‐benefit increases in noisy listening conditions. The neural mechanisms for this increase are unknown. Here, using functional magnetic resonance imaging, we examined responses in face‐sensitive regions while participants recognised the identity of auditory‐only speakers (previously learned by face) in high (SNR −4 dB) and low (SNR +4 dB) levels of auditory noise. We observed a face‐benefit in both noise levels, for most participants (16 of 21). In high‐noise, the recognition of face‐learned speakers engaged the right posterior superior temporal sulcus motion‐sensitive face area (pSTS‐mFA), a region implicated in the processing of dynamic facial cues. The face‐benefit in high‐noise also correlated positively with increased functional connectivity between this region and voice‐sensitive regions in the temporal lobe in the group of 16 participants with a behavioural face‐benefit. In low‐noise, the face‐benefit was robustly associated with increased responses in the FFA and to a lesser extent the right pSTS‐mFA. The findings highlight the remarkably adaptive nature of the visual network supporting voice‐identity recognition in auditory‐only listening conditions.

Advances in Neuroscience, Not Devices, Will Determine the Effectiveness of Visual Prostheses

Background: Innovations in engineering and neuroscience have enabled the development of sophisticated visual prosthetic devices. In clinical trials, these devices have provided visual acuities as high as 20/460, enabled coarse navigation, and even allowed for reading of short words. However, long-term commercial viability arguably rests on attaining even better vision and more definitive improvements in tasks of daily living and quality of life. Purpose: Here we review technological and biological obstacles in the implementation of visual prosthetics. Conclusions: Research in the visual prosthetic field has tackled significant technical challenges, including biocompatibility, signal spread through neural tissue, and inadvertent activation of passing axons; however, significant gaps in knowledge remain in the realm of neuroscience, including the neural code of vision and visual plasticity. We assert that further optimization of prosthetic devices alone will not provide markedly improved visual outcomes without significant advances in our understanding of neuroscience.

Neural mechanisms of visual sensitive periods in humans

Sensitive periods in brain development are phases of enhanced susceptibility to experience. Here we discuss research from human and non-human neuroscience studies which have demonstrated a) differences in the way infants vs. adults learn; b) how the brain adapts to atypical conditions, in particular a congenital vs. a late onset blindness (sensitive periods for atypical brain development); and c) the extent to which neural systems are capable of acquiring a typical brain organization after sight restoration following a congenital vs. late phase of pattern vision deprivation (sensitive periods for typical brain development). By integrating these three lines of research, we propose neural mechanisms characteristic of sensitive periods vs. adult neuroplasticity and learning.

Visual experience is not necessary for the development of face-selectivity in the lateral fusiform gyrus

The fusiform face area responds selectively to faces and is causally involved in face perception. How does face-selectivity in the fusiform arise in development, and why does it develop so systematically in the same location across individuals? Preferential cortical responses to faces develop early in infancy, yet evidence is conflicting on the central question of whether visual experience with faces is necessary. Here, we revisit this question by scanning congenitally blind individuals with fMRI while they haptically explored 3D-printed faces and other stimuli. We found robust face-selective responses in the lateral fusiform gyrus of individual blind participants during haptic exploration of stimuli, indicating that neither visual experience with faces nor fovea-biased inputs is necessary for face-selectivity to arise in the lateral fusiform gyrus. Our results instead suggest a role for long-range connectivity in specifying the location of face-selectivity in the human brain.

The role of spatial selective attention in the processing of affective prosodies in congenitally blind adults: An ERP study

The question whether spatial selective attention is necessary in order to process vocal affective prosody has been controversially discussed in sighted individuals: whereas some studies argue that attention is required in order to process emotions, other studies conclude that vocal prosody can be processed even outside the focus of spatial selective attention. Here, we asked whether spatial selective attention is necessary for the processing of affective prosodies after visual deprivation from birth. For this purpose, pseudowords spoken in happy, neutral, fearful or threatening prosodies were presented at the left or right loudspeaker. Congenitally blind individuals (N = 8) and sighted controls (N = 13) had to attend to one of the loudspeakers and detect rare pseudowords presented at the attended loudspeaker during EEG recording. Emotional prosody of the syllables was task-irrelevant. Blind individuals outperformed sighted controls by being more efficient in detecting deviant syllables at the attended loudspeaker. A higher auditory N1 amplitude was observed in blind individuals compared to sighted controls. Additionally, sighted controls showed enhanced attention-related ERP amplitudes in response to fearful and threatening voices during the time range of the N1. By contrast, blind individuals revealed enhanced ERP amplitudes in attended relative to unattended locations irrespective of the affective valence in all time windows (110-350 ms). These effects were mainly observed at posterior electrodes. The results provide evidence for "emotion-general" auditory spatial selective attention effects in congenitally blind individuals and suggest a potential reorganization of the voice processing brain system following visual deprivation from birth.

Brain morphological changes in hypokinetic dysarthria of Parkinson's disease and use of machine learning to predict severity

Background

Up to 90% of patients with Parkinson's disease (PD) eventually develop the speech and voice disorder referred to as hypokinetic dysarthria (HD). However, the brain morphological changes associated with HD have not been investigated. Moreover, no reliable model for predicting the severity of HD based on neuroimaging has yet been developed.

Methods

A total of 134 PD patients were included in this study and divided into a training set and a test set. All participants underwent a structural magnetic resonance imaging (MRI) scan and neuropsychological evaluation. Individual cortical thickness, subcortical structure, and white matter volume were extracted, and their association with HD severity was analyzed. After feature selection, a machine‐learning model was established using a support vector machine in the training set. The severity of HD was then predicted in the test set.

Results

Atrophy of the right precentral cortex and the right fusiform gyrus was significantly associated with HD. No association was found between HD and volume of white matter or subcortical structures. Favorable and optimal performance of machine learning on HD severity prediction was achieved using feature selection, giving a correlation coefficient (r) of .7516 and a coefficient of determination (R²) of .5649 (P < .001).

Conclusion

The brain morphological changes were associated with HD. Excellent prediction of the severity of HD was achieved using machine learning based on neuroimaging.

Mental Imagery Follows Similar Cortical Reorganization as Perception: Intra-Modal and Cross-Modal Plasticity in Congenitally Blind

Cortical plasticity in congenitally blind individuals leads to cross-modal activation of the visual cortex and may lead to superior perceptual processing in the intact sensory domains. Although mental imagery is often defined as a quasi-perceptual experience, it is unknown whether it follows similar cortical reorganization as perception in blind individuals. In this study, we show that auditory versus tactile perception evokes similar intra-modal discriminative patterns in congenitally blind compared with sighted participants. These results indicate that cortical plasticity following visual deprivation does not influence broad intra-modal organization of auditory and tactile perception as measured by our task. Furthermore, not only the blind, but also the sighted participants showed cross-modal discriminative patterns for perception modality in the visual cortex. During mental imagery, both groups showed similar decoding accuracies for imagery modality in the intra-modal primary sensory cortices. However, no cross-modal discriminative information for imagery modality was found in early visual cortex of blind participants, in contrast to the sighted participants. We did find evidence of cross-modal activation of higher visual areas in blind participants, including the representation of specific-imagined auditory features in visual area V4.

Plastic reorganization of neural systems for perception of others in the congenitally blind

Recent evidence suggests that the function of the core system for face perception might extend beyond visual face-perception to a broader role in person perception. To critically test the broader role of core face-system in person perception, we examined the role of the core system during the perception of others in 7 congenitally blind individuals and 15 sighted subjects by measuring their neural responses using fMRI while they listened to voices and performed identity and emotion recognition tasks. We hypothesised that in people who have had no visual experience of faces, core face-system areas may assume a role in the perception of others via voices. Results showed that emotions conveyed by voices can be decoded in homologues of the core face system only in the blind. Moreover, there was a specific enhancement of response to verbal as compared to non-verbal stimuli in bilateral fusiform face areas and the right posterior superior temporal sulcus showing that the core system also assumes some language-related functions in the blind. These results indicate that, in individuals with no history of visual experience, areas of the core system for face perception may assume a role in aspects of voice perception that are relevant to social cognition and perception of others' emotions.

Brain circuit-gene expression relationships and neuroplasticity of multisensory cortices in blind children

Sensory deprivation reorganizes neurocircuits in the human brain. The biological basis of such neuroplastic adaptations remains elusive. In this study, we applied two complementary graph theory-based functional connectivity analyses, one to evaluate whole-brain functional connectivity relationships and the second to specifically delineate distributed network connectivity profiles downstream of primary sensory cortices, to investigate neural reorganization in blind children compared with sighted controls. We also examined the relationship between connectivity changes and neuroplasticity-related gene expression profiles in the cerebral cortex. We observed that multisensory integration areas exhibited enhanced functional connectivity in blind children and that this reorganization was spatially associated with the transcription levels of specific members of the cAMP Response Element Binding protein gene family. Using systems-level analyses, this study advances our understanding of human neuroplasticity and its genetic underpinnings following sensory deprivation.

State-dependent modulation of functional connectivity in early blind individuals

Resting-state functional connectivity (RSFC) studies have provided strong evidences that visual deprivation influences the brain's functional architecture. In particular, reduced RSFC coupling between occipital (visual) and temporal (auditory) regions has been reliably observed in early blind individuals (EB) at rest. In contrast, task-dependent activation studies have repeatedly demonstrated enhanced co-activation and connectivity of occipital and temporal regions during auditory processing in EB. To investigate this apparent discrepancy, the functional coupling between temporal and occipital networks at rest was directly compared to that of an auditory task in both EB and sighted controls (SC). Functional brain clusters shared across groups and cognitive states (rest and auditory task) were defined. In EBs, we observed higher occipito-temporal correlations in activity during the task than at rest. The reverse pattern was observed in SC. We also observed higher temporal variability of occipito-temporal RSFC in EB suggesting that occipital regions in this population may play the role of a multiple demand system. Our study reveals how the connectivity profile of sighted and early blind people is differentially influenced by their cognitive state, bridging the gap between previous task-dependent and RSFC studies. Our results also highlight how inferring group-differences in functional brain architecture solely based on resting-state acquisition has to be considered with caution.

Crossmodal interactions during non-linguistic auditory processing in cochlear-implanted deaf patients

Due to signal distortion, speech comprehension in cochlear-implanted (CI) patients relies strongly on visual information, a compensatory strategy supported by important cortical crossmodal reorganisations. Though crossmodal interactions are evident for speech processing, it is unclear whether a visual influence is observed in CI patients during non-linguistic visual-auditory processing, such as face-voice interactions, which are important in social communication. We analyse and compare visual-auditory interactions in CI patients and normal-hearing subjects (NHS) at equivalent auditory performance levels. Proficient CI patients and NHS performed a voice-gender categorisation in the visual-auditory modality from a morphing-generated voice continuum between male and female speakers, while ignoring the presentation of a male or female visual face. Our data show that during the face-voice interaction, CI deaf patients are strongly influenced by visual information when performing an auditory gender categorisation task, in spite of maximum recovery of auditory speech. No such effect is observed in NHS, even in situations of CI simulation. Our hypothesis is that the functional crossmodal reorganisation that occurs in deafness could influence nonverbal processing, such as face-voice interaction; this is important for patient internal supramodal representation.

The Effect of Early Visual Deprivation on the Neural Bases of Auditory Processing

Transient congenital visual deprivation affects visual and multisensory processing. In contrast, the extent to which it affects auditory processing has not been investigated systematically. Research in permanently blind individuals has revealed brain reorganization during auditory processing, involving both intramodal and crossmodal plasticity. The present study investigated the effect of transient congenital visual deprivation on the neural bases of auditory processing in humans. Cataract-reversal individuals and normally sighted controls performed a speech-in-noise task while undergoing functional magnetic resonance imaging. Although there were no behavioral group differences, groups differed in auditory cortical responses: in the normally sighted group, auditory cortex activation increased with increasing noise level, whereas in the cataract-reversal group, no activation difference was observed across noise levels. An auditory activation of visual cortex was not observed at the group level in cataract-reversal individuals. The present data suggest prevailing auditory processing advantages after transient congenital visual deprivation, even many years after sight restoration.

SIGNIFICANCE STATEMENT

The present study demonstrates that people whose sight was restored after a transient period of congenital blindness show more efficient cortical processing of auditory stimuli (here speech), similarly to what has been observed in congenitally permanently blind individuals. These results underscore the importance of early sensory experience in permanently shaping brain function.