Cross-modal plasticity and cochlear implants

Mandarin-speaking Children With Cochlear Implants Face Challenges in Using F0 Expansion to Express Contrastive Focus

OBJECTIVES

Children with cochlear implants (CIs) face challenges in perceiving fundamental frequency (F0) information because CIs do not transmit F0 effectively. In Mandarin, F0 can contrast meanings at the word level, that is, via lexical tones with distinct F0 contours, and signal contrastive relations between words at the utterance-level, that is, via contrastive focus with expanded F0 range and longer duration. Mandarin-speaking children with CIs have been reported to face challenges in producing distinct F0 contours across tones, but early implantation facilitates tonal acquisition. However, it is still unclear if utterance-level prosody, such as contrastive focus, is also challenging for these children, and if early implantation also offers benefits for focus production. Therefore, this study asked how accurately children with CIs can produce contrastive focus, and if early implantation leads to more accurate focus production, with acoustic patterns approaching that of children with typical hearing (TH).

DESIGN

Participants included 55 Mandarin-speaking children (3 to 7 years) with CIs and 55 age-matched children with TH. Children produced noun phrases with and without contrastive focus, such as RED-COLORED cat versus red-colored cat. Three adult native listeners perceptually scored the productions as correct or incorrect. The "correct" productions were then acoustically analyzed in terms of F0 range and duration.

RESULTS

Based on the perceptual scores, children with CIs produced focus with significantly lower accuracy (38%) than their TH peers (84%). The acoustic analysis on their "correct" productions showed that children with TH used both F0 and duration to mark focus, producing focal syllables with an expanded F0 range and long duration, and postfocal syllables with a reduced F0 range and short duration. However, children with CIs differed from children with TH in that they produced focal syllables with long duration but not an expanded F0 range, although they produced postfocal syllables with a reduced F0 range and short duration like their TH peers. In addition, early implantation correlated with the percept of more accurate focus productions and better use of F0 range in focal marking.

CONCLUSIONS

This study finds that Mandarin-speaking children with CIs are still learning to apply appropriate acoustic cues to contrastive focus. The challenge appears to lie in the use of an expanded F0 range to mark focus, probably related to the limited transmission of F0 information through the CI devices. These findings thus have implications for parents and those working with children with CIs, showing that utterance-level prosody also requires speech remediation, and underscores the critical role of identifying problems early in the acquisition of F0 functions in Mandarin, not only at the word level but also at the utterance-level.

The Effect of Visual Articulatory Cues on the Identification of Mandarin Tones by Children With Cochlear Implants

PURPOSE

This study explored the facilitatory effect of visual articulatory cues on the identification of Mandarin lexical tones by children with cochlear implants (CIs) in both quiet and noisy environments. It also explored whether early implantation is associated with better use of visual cues in tonal identification.

METHOD

Participants included 106 children with CIs and 100 normal-hearing (NH) controls. A tonal identification task was employed using a two-alternative forced-choice picture-pointing paradigm. Participants' tonal identification accuracies were compared between audio-only (AO) and audiovisual (AV) modalities. Correlations between implantation ages and visual benefits (accuracy differences between AO and AV modalities) were also examined.

RESULTS

Children with CIs demonstrated an improved identification accuracy from AO to AV modalities in the noisy environment. Additionally, earlier implantation was significantly correlated with a greater visual benefit in noise.

CONCLUSIONS

These findings indicated that children with CIs benefited from visual cues on tonal identification in noise, and early implantation enhanced the visual benefit. These results thus have practical implications on tonal perception interventions for Mandarin-speaking children with CIs.

A systematic review of altered resting-state networks in early deafness and implications for cochlear implantation outcomes

Auditory deprivation following congenital/pre-lingual deafness (C/PD) can drastically affect brain development and its functional organisation. This systematic review intends to extend current knowledge of the impact of C/PD and deafness duration on brain resting-state networks (RSNs), review changes in RSNs and spoken language outcomes post-cochlear implant (CI) and draw conclusions for future research. The systematic literature search followed the PRISMA guideline. Two independent reviewers searched four electronic databases using combined keywords: 'auditory deprivation', 'congenital/prelingual deafness', 'resting-state functional connectivity' (RSFC), 'resting-state fMRI' and 'cochlear implant'. Seventeen studies (16 cross-sectional and one longitudinal) met the inclusion criteria. Using the Crowe Critical Appraisal Tool, the publications' quality was rated between 65.0% and 92.5% (mean: 84.10%), ≥80% in 13 out of 17 studies. A few studies were deficient in sampling and/or ethical considerations. According to the findings, early auditory deprivation results in enhanced RSFC between the auditory network and brain networks involved in non-verbal communication, and high levels of spontaneous neural activity in the auditory cortex before CI are evidence of occupied auditory cortical areas with other sensory modalities (cross-modal plasticity) and sub-optimal CI outcomes. Overall, current evidence supports the idea that moreover intramodal and cross-modal plasticity, the entire brain adaptation following auditory deprivation contributes to spoken language development and compensatory behaviours.

Decoding auditory deprivation: resting-state fMRI insights into deafness and brain plasticity

Deafness, as a profound manifestation of sensory deprivation, prompts a cascade of intricate cerebral adaptations. In this study, involving 35 deaf individuals and 35 hearing controls, we utilized resting-state functional magnetic resonance imaging (rs-fMRI) to delve into the depths of functional connectivity nuances distinguishing deaf individuals from their hearing counterparts. Leading our analytical approach was the application of multi-voxel pattern analysis (fc-MVPA). This advanced method provided a refined perspective, revealing amplified neural connectivity within the deaf population. Notably, regions such as the left postcentral somatosensory association cortex, the anterior and posterior corridors of the left superior temporal gyrus (STG), and the left mid-temporal lobe were identified as hotspots of heightened connectivity. Further, fc-MVPA shed light on intricate interaction effects, which became more pronounced when examining variables such as the duration of auditory deprivation and the extent of sign language exposure. These interactions were particularly evident in the premotor and left frontal mid-orbital regions. Complementing this, seed-based connectivity assessments illuminated pronounced coupling dynamics within the left STG spectrum. Concurrently, local correlation (LCOR) value analysis in the deaf group revealed significant shifts in the right superior STG and bilateral precuneus. In addition, amplitude of low-frequency fluctuation (ALFF) evaluations indicated modulations in the bilateral mid cingulum and left superior mid frontal gyrus. This comprehensive, fc-MVPA-driven exploration uncovers the multifaceted functional adaptations resulting from deafness, highlighting the profound plasticity of the human brain and its potential implications for targeted rehabilitative strategies.

Motor Processing in Children With Cochlear Implants as Assessed by Functional Near-Infrared Spectroscopy

Auditory-motor and visual-motor networks are often coupled in daily activities, such as when listening to music and dancing; but these networks are known to be highly malleable as a function of sensory input. Thus, congenital deafness may modify neural activities within the connections between the motor, auditory, and visual cortices. Here, we investigated whether the cortical responses of children with cochlear implants (CI) to a simple and repetitive motor task would differ from that of children with typical hearing (TH) and we sought to understand whether this response related to their language development. Participants were 75 school-aged children, including 50 with CI (with varying language abilities) and 25 controls with TH. We used functional near-infrared spectroscopy (fNIRS) to record cortical responses over the whole brain, as children squeezed the back triggers of a joystick that vibrated or not with the squeeze. Motor cortex activity was reflected by an increase in oxygenated hemoglobin concentration (HbO) and a decrease in deoxygenated hemoglobin concentration (HbR) in all children, irrespective of their hearing status. Unexpectedly, the visual cortex (supposedly an irrelevant region) was deactivated in this task, particularly for children with CI who had good language skills when compared to those with CI who had language delays. Presence or absence of vibrotactile feedback made no difference in cortical activation. These findings support the potential of fNIRS to examine cognitive functions related to language in children with CI.

Prediction of Cochlear Implant Effectiveness With Surface-Based Morphometry

OBJECTIVE

This study aimed to determine whether surface-based morphometry of preoperative whole-brain three-dimensional T1-weighted magnetic resonance imaging (MRI) images can predict the clinical outcomes of cochlear implantation.

STUDY DESIGN

This was an observational, multicenter study using preoperative MRI data.

SETTING

The study was conducted at tertiary care referral centers.

PATIENTS

Sixty-four patients with severe to profound hearing loss (≥70 dB bilaterally), who were scheduled for cochlear implant (CI) surgery, were enrolled. The patients included 19 with congenital hearing loss and 45 with acquired hearing loss.

INTERVENTIONS

Participants underwent CI surgery. Before surgery, high-resolution three-dimensional T1-weighted brain MRI was performed, and the images were analyzed using FreeSurfer.

MAIN OUTCOME MEASURES

The primary outcome was monosyllable audibility under quiet conditions 6 months after surgery. Cortical thickness residuals within 34 regions of interest (ROIs) as per the Desikan-Killiany cortical atlas were calculated based on age and healthy-hearing control regression lines.

RESULTS

Rank logistic regression analysis detected significant associations between CI effectiveness and five right hemisphere ROIs and five left hemisphere ROIs. Predictive modeling using the cortical thickness of the right entorhinal cortex and left medial orbitofrontal cortex revealed a significant correlation with speech discrimination ability. This correlation was higher in patients with acquired hearing loss than in those with congenital hearing loss.

CONCLUSIONS

Preoperative surface-based morphometry could potentially predict CI outcomes and assist in patient selection and clinical decision making. However, further research with larger, more diverse samples is necessary to confirm these findings and determine their generalizability.

Increased Resting-State Positron Emission Tomography Activity After Cochlear Implantation in Adult Deafened Cats

OBJECTIVES

Cochlear implants are widely used for hearing rehabilitation in patients with profound sensorineural hearing loss. However, Cochlear implants have variable.

RESULTS

and central neural plasticity is considered to be a reason for this variability. We hypothesized that resting-state cortical networks play a role in conditions of profound hearing loss and are affected by cochlear implants. To investigate the resting-state neuronal networks after cochlear implantation, we acquired 18F-fluorodeoxyglucose (FDG)-positron emission tomography (PET) images in experimental animals.

METHODS

Eight adult domestic cats were enrolled in this study. The hearing threshold of the animals was within the normal range, as measured by auditory evoked potential. They were divided into control (n=4) and hearing loss (n=4) groups. Hearing loss was induced by co-administration of ethacrynic acid and kanamycin. FDG-PET was performed in a normal hearing state and 4 and 11 months after the deafening procedure. Cochlear implantation was performed in the right ear, and electrical cochlear stimulation was performed for 7 months (from 4 to 11 months after the deafening procedure). PET images were compared between the two groups at the three time points.

RESULTS

Four months after hearing loss, the auditory cortical area's activity decreased, and activity in the associated visual area increased. After 7 months of cochlear stimulation, the superior marginal gyrus and cingulate gyrus, which are components of the default mode network, showed hypermetabolism. The inferior colliculi showed hypometabolism.

CONCLUSION

Resting-state cortical activity in the default mode network components was elevated after cochlear stimulation. This suggests that the animals' awareness level was elevated after hearing restoration by the cochlear implantation.

Hearing and sociality: the implications of hearing loss on social life

Hearing is essential to the formation of social relationships and is the principal afferent of social life. Yet hearing loss, which is one of the most prevalent forms of sensory disability worldwide and is critical for social development, has received little attention from the social interventionalist perspective. The purpose of this mini-review is to describe the basic neurobiological principles of hearing and to explore the reciprocal relationships between social support, hearing loss, and its psychosocial comorbidities. We also discuss the role of social enrichment in sensorineural recovery and identify open questions within the fields of hearing physiology and social networks.

Evaluation of Verbal Working Memory and Phonemic Analysis Skills in Adolescents with Cochlear Implant

Introduction  Adolescents with cochlear implants may have difficulty developing language and memory abilities. Objective  The primary objectives of this study are (1) to evaluate the language skills and verbal working memory performance of early and late diagnosed-intervened cochlear implanted adolescents and (2) to investigate the relationship between the verbal working memory and phonemic analysis skills in adolescents with cochlear implant. Methods  This study included 72 participants with cochlear implant aged between 10 and 18 years. The participants were divided into two groups; those who had first hearing aid at the age of 6 months at the latest and had a first cochlear implant in at least one ear at the latest at 24 months were included in the early group, all the others were in the late group. The phonemic analysis test, a subtest of the test of language development: Primary, 4th edition (TOLD: P-4) - Turkish version, was used to assess language-based abilities, and the meaningless word repetition (MWR) test was utilized to assess verbal working memory. Results  The adolescents with cochlear implants who received early diagnosis and intervention performed statistically significantly better in phonemic analysis scores and verbal working memory tests ( p  < 0.001). A statistically significant relationship was found between phonemic analysis and verbal working memory skills (Pearson, r = 0.567 and r = 0.659, p  < 0.001). Conclusions  Rehabilitation of phonological skills can contribute to the development of verbal working memory in adolescents with cochlear implants. There is a need for further studies on this issue with more detailed tests.

Reduced attentional inhibition for peripheral distractors of angry faces under central perceptual load in deaf individuals: evidence from an event-related potentials study

Background

Studies have shown that deaf individuals distribute more attention to the peripheral visual field and exhibit enhanced visual processing for peripheral stimuli relative to hearing individuals. This leads to better detection of peripheral target motion and simple static stimuli in hearing individuals. However, when threatening faces that represent dangerous signals appear as non-targets in the periphery, it remains unclear whether deaf individuals would retain an advantage over hearing individuals in detecting them.

Methods

In this study, 23 deaf and 28 hearing college students were included. A modified perceptual load paradigm and event-related potentials (ERPs) were adopted. In the task, participants were instructed to search for a target letter in a central letter array, while task-irrelevant face distractors (happy, neutral, and angry faces) were simultaneously presented in the periphery while the central perceptual load was manipulated.

Results

Behavioral data showed that angry faces slowed deaf participants' responses to the target while facilitating the responses of hearing participants. At the electrophysiological level, we found modulation of P1 amplitude by central load only in hearing individuals. Interestingly, larger interference from angry face distractors was associated with higher P1 differential amplitude only in deaf individuals. Additionally, the amplitude of N170 for happy face distractors was smaller than that for angry and neutral face distractors in deaf participants.

Conclusion

The present data demonstrates that, despite being under central perceptual load, deaf individuals exhibit less attentional inhibition to peripheral, goal-irrelevant angry faces than hearing individuals. The result may reflect a compensatory mechanism in which, in the absence of auditory alertness to danger, the detection of visually threatening information outside of the current attentional focus has a high priority.

Cortical responses correlate with speech performance in pre-lingually deaf cochlear implant children

Introduction

Cochlear implantation is currently the most successful intervention for severe-to-profound sensorineural hearing loss, particularly in deaf infants and children. Nonetheless, there remains a significant degree of variability in the outcomes of CI post-implantation. The purpose of this study was to understand the cortical correlates of the variability in speech outcomes with a cochlear implant in pre-lingually deaf children using functional near-infrared spectroscopy (fNIRS), an emerging brain-imaging technique.

Methods

In this experiment, cortical activities when processing visual speech and two levels of auditory speech, including auditory speech in quiet and in noise with signal-to-noise ratios of 10 dB, were examined in 38 CI recipients with pre-lingual deafness and 36 normally hearing children whose age and sex matched CI users. The HOPE corpus (a corpus of Mandarin sentences) was used to generate speech stimuli. The regions of interest (ROIs) for the fNIRS measurements were fronto-temporal-parietal networks involved in language processing, including bilateral superior temporal gyrus, left inferior frontal gyrus, and bilateral inferior parietal lobes.

Results

The fNIRS results confirmed and extended findings previously reported in the neuroimaging literature. Firstly, cortical responses of superior temporal gyrus to both auditory and visual speech in CI users were directly correlated to auditory speech perception scores, with the strongest positive association between the levels of cross-modal reorganization and CI outcome. Secondly, compared to NH controls, CI users, particularly those with good speech perception, showed larger cortical activation in the left inferior frontal gyrus in response to all speech stimuli used in the experiment.

Discussion

In conclusion, cross-modal activation to visual speech in the auditory cortex of pre-lingually deaf CI children may be at least one of the neural bases of highly variable CI performance due to its beneficial effects for speech understanding, thus supporting the prediction and assessment of CI outcomes in clinic. Additionally, cortical activation of the left inferior frontal gyrus may be a cortical marker for effortful listening.

Crossmodal plasticity in hearing loss

Crossmodal plasticity is a textbook example of the ability of the brain to reorganize based on use. We review evidence from the auditory system showing that such reorganization has significant limits, is dependent on pre-existing circuitry and top-down interactions, and that extensive reorganization is often absent. We argue that the evidence does not support the hypothesis that crossmodal reorganization is responsible for closing critical periods in deafness, and crossmodal plasticity instead represents a neuronal process that is dynamically adaptable. We evaluate the evidence for crossmodal changes in both developmental and adult-onset deafness, which start as early as mild-moderate hearing loss and show reversibility when hearing is restored. Finally, crossmodal plasticity does not appear to affect the neuronal preconditions for successful hearing restoration. Given its dynamic and versatile nature, we describe how this plasticity can be exploited for improving clinical outcomes after neurosensory restoration.

Learning a Sign Language Does Not Hinder Acquisition of a Spoken Language

PURPOSE

The purpose of this study is to determine whether and how learning American Sign Language (ASL) is associated with spoken English skills in a sample of ASL-English bilingual deaf and hard of hearing (DHH) children.

METHOD

This cross-sectional study of vocabulary size included 56 DHH children between 8 and 60 months of age who were learning both ASL and spoken English and had hearing parents. English and ASL vocabulary were independently assessed via parent report checklists.

RESULTS

ASL vocabulary size positively correlated with spoken English vocabulary size. Spoken English vocabulary sizes in the ASL-English bilingual DHH children in the present sample were comparable to those in previous reports of monolingual DHH children who were learning only English. ASL-English bilingual DHH children had total vocabularies (combining ASL and English) that were equivalent to same-age hearing monolingual children. Children with large ASL vocabularies were more likely to have spoken English vocabularies in the average range based on norms for hearing monolingual children.

CONCLUSIONS

Contrary to predictions often cited in the literature, acquisition of sign language does not harm spoken vocabulary acquisition. This retrospective, correlational study cannot determine whether there is a causal relationship between sign language and spoken language vocabulary acquisition, but if a causal relationship exists, the evidence here suggests that the effect would be positive. Bilingual DHH children have age-expected vocabularies when considering the entirety of their language skills. We found no evidence to support recommendations that families with DHH children avoid learning sign language. Rather, our findings show that children with early ASL exposure can develop age-appropriate vocabulary skills in both ASL and spoken English.

Brain structural changes in blindness: a systematic review and an anatomical likelihood estimation (ALE) meta-analysis

In recent decades, numerous structural brain imaging studies investigated purported morphometric changes in early (EB) and late onset blindness (LB). The results of these studies have not yielded very consistent results, neither with respect to the type, nor to the anatomical locations of the brain morphometric alterations. To better characterize the effects of blindness on brain morphometry, we performed a systematic review and an Anatomical-Likelihood-Estimation (ALE) coordinate-based-meta-analysis of 65 eligible studies on brain structural changes in EB and LB, including 890 EB, 466 LB and 1257 sighted controls. Results revealed atrophic changes throughout the whole extent of the retino-geniculo-striate system in both EB and LB, whereas changes in areas beyond the occipital lobe occurred in EB only. We discuss the nature of some of the contradictory findings with respect to the used brain imaging methodologies and characteristics of the blind populations such as the onset, duration and cause of blindness. Future studies should aim for much larger sample sizes, eventually by merging data from different brain imaging centers using the same imaging sequences, opt for multimodal structural brain imaging, and go beyond a purely structural approach by combining functional with structural connectivity network analyses.

Speech Perception of Second Cochlear Implant after 6 Years of Age in Prelingually Deaf Children

Sequential bilateral cochlear implantation in children becomes less effective as the inter-implant interval increases. However, the cause of this and the age at which speech perception becomes impossible are unclear. We examined the cases of 11 prelingually deaf children who underwent unilateral cochlear implantation at our hospitals before the age of 5 years old, followed by a second implantation procedure on the contralateral side when they were aged ≥ 6 years old (6-12 years old). The subjects' hearing thresholds and speech discrimination scores for the second cochlear implant were evaluated at 3 postoperative months and 1-7 years. All of the subjects demonstrated improvements in their hearing thresholds to a mean of 30 dB HL at 1 year. Regarding speech perception, one patient (a 12-year-old), who had developed bilateral hearing loss at 30 months of age after contracting mumps, demonstrated a 90% improvement in his speech discrimination score at 1 year. However, among the other congenitally deaf children, there were two patients whose speech discrimination scores had improved by ≥ 80% at > 4 postoperative years. The congenitally deaf children exhibited poor speech perception despite showing improved hearing thresholds in the ears that received second cochlear implants. Assuming that the auditory pathway beyond the superior olivary complex remained functional, the reduced speech perception abilities associated with the second cochlear implants may have been attributable to the loss of the spiral ganglion and cochlear nucleus cells due to a lack of auditory input since birth.

Plasticity After Hearing Rehabilitation in the Aging Brain

Age-related hearing loss, presbycusis, is an unavoidable sensory degradation, often associated with the progressive decline of cognitive and social functions, and dementia. It is generally considered a natural consequence of the inner-ear deterioration. However, presbycusis arguably conflates a wide array of peripheral and central impairments. Although hearing rehabilitation maintains the integrity and activity of auditory networks and can prevent or revert maladaptive plasticity, the extent of such neural plastic changes in the aging brain is poorly appreciated. By reanalyzing a large-scale dataset of more than 2200 cochlear implant users (CI) and assessing the improvement in speech perception from 6 to 24 months of use, we show that, although rehabilitation improves speech understanding on average, age at implantation only minimally affects speech scores at 6 months but has a pejorative effect at 24 months post implantation. Furthermore, older subjects (>67 years old) were significantly more likely to degrade their performances after 2 years of CI use than the younger patients for each year increase in age. Secondary analysis reveals three possible plasticity trajectories after auditory rehabilitation to account for these disparities: Awakening, reversal of deafness-specific changes; Counteracting, stabilization of additional cognitive impairments; or Decline, independent pejorative processes that hearing rehabilitation cannot prevent. The role of complementary behavioral interventions needs to be considered to potentiate the (re)activation of auditory brain networks.

Electrically Evoked Auditory Brainstem Responses in Children Fitted with Hearing Aids Prior to Cochlear Implantation

This study investigates the effect of hearing aid use on the peripheral auditory pathways in children with sensorineural hearing loss prior to cochlear implantation, as revealed by the electrically evoked auditory brainstem response (EABR). Forty children with hearing aids were recruited. Half of them had normal inner ear structures and the other half had inner ear malformations (IEMs). The EABR was evoked by electrically stimulating the round window niche (RWN) and round window membrane (RWM) during the cochlear implantation operation. The onset age of hearing aid use was significantly correlated with the peak latencies, but not amplitudes, of the wave III (eIII) and wave V (eV). Higher EABR thresholds were found for RWN stimulation than for RWM stimulation and in the children with IEMs than in those without IEMs. Our study provides neurophysiological evidence that earlier use of hearing aids may ameliorate physiological functions of the peripheral auditory pathway in children with and without IEMs. The EABR evoked by the electrical stimulation at RWM is more sensitive compared with that at RWN for evaluating functions of the auditory conduction pathway.

The 100 Most-Cited Manuscripts in Hearing Implants: A Bibliometrics Analysis

The aim of the study was to characterise the most frequently cited articles on the topic of hearing implants. A systematic search was carried out using the Thomson Reuters Web of Science Core Collection database. Eligibility criteria restricted the results to primary studies and reviews published from 1970 to 2022 in English dealing primarily with hearing implants. Data including the authors, year of publication, journal, country of origin, number of citations and average number of citations per year were extracted, as well as the impact factors and five-year impact factor of journals publishing the articles. The top 100 papers were published across 23 journals and were cited 23,139 times. The most-cited and influential article describes the first use of the continuous interleaved sampling (CIS) strategy utilised in all modern cochlear implants. More than half of the studies on the list were produced by authors from the United States, and the Ear and Hearing journal had both the greatest number of articles and the greatest number of total citations. To conclude, this research serves as a guide to the most influential articles on the topic of hearing implants, although bibliometric analyses mainly focus on citations. The most-cited article was an influential description of CIS.

Evidence of visual crossmodal reorganization positively relates to speech outcomes in cochlear implant users

Deaf individuals who use a cochlear implant (CI) have remarkably different outcomes for auditory speech communication ability. One factor assumed to affect CI outcomes is visual crossmodal plasticity in auditory cortex, where deprived auditory regions begin to support non-auditory functions such as vision. Previous research has viewed crossmodal plasticity as harmful for speech outcomes for CI users if it interferes with sound processing, while others have demonstrated that plasticity related to visual language may be beneficial for speech recovery. To clarify, we used electroencephalography (EEG) to measure brain responses to a partial face speaking a silent single-syllable word (visual language) in 15 CI users and 13 age-matched typical-hearing controls. We used source analysis on EEG activity to measure crossmodal visual responses in auditory cortex and then compared them to CI users' speech-in-noise listening ability. CI users' brain response to the onset of the video stimulus (face) was larger than controls in left auditory cortex, consistent with crossmodal activation after deafness. CI users also produced a mixture of alpha (8-12 Hz) synchronization and desynchronization in auditory cortex while watching lip movement while controls instead showed desynchronization. CI users with higher speech scores had stronger crossmodal responses in auditory cortex to the onset of the video, but those with lower speech scores had increases in alpha power during lip movement in auditory areas. Therefore, evidence of crossmodal reorganization in CI users does not necessarily predict poor speech outcomes, and differences in crossmodal activation during lip reading may instead relate to strategies or differences that CI users use in audiovisual speech communication.

Cross-Modal Reorganization From Both Visual and Somatosensory Modalities in Cochlear Implanted Children and Its Relationship to Speech Perception

HYPOTHESIS

We hypothesized that children with cochlear implants (CIs) who demonstrate cross-modal reorganization by vision also demonstrate cross-modal reorganization by somatosensation and that these processes are interrelated and impact speech perception.

BACKGROUND

Cross-modal reorganization, which occurs when a deprived sensory modality's cortical resources are recruited by other intact modalities, has been proposed as a source of variability underlying speech perception in deaf children with CIs. Visual and somatosensory cross-modal reorganization of auditory cortex have been documented separately in CI children, but reorganization in these modalities has not been documented within the same subjects. Our goal was to examine the relationship between cross-modal reorganization from both visual and somatosensory modalities within a single group of CI children.

METHODS

We analyzed high-density electroencephalogram responses to visual and somatosensory stimuli and current density reconstruction of brain activity sources. Speech perception in noise testing was performed. Current density reconstruction patterns were analyzed within the entire subject group and across groups of CI children exhibiting good versus poor speech perception.

RESULTS

Positive correlations between visual and somatosensory cross-modal reorganization suggested that neuroplasticity in different sensory systems may be interrelated. Furthermore, CI children with good speech perception did not show recruitment of frontal or auditory cortices during visual processing, unlike CI children with poor speech perception.

CONCLUSION

Our results reflect changes in cortical resource allocation in pediatric CI users. Cross-modal recruitment of auditory and frontal cortices by vision, and cross-modal reorganization of auditory cortex by somatosensation, may underlie variability in speech and language outcomes in CI children.

The Effects of Cortical Reorganization and Applications of Functional Near-Infrared Spectroscopy in Deaf People and Cochlear Implant Users

A cochlear implant (CI) is currently the only FDA-approved biomedical device that can restore hearing for the majority of patients with severe-to-profound sensorineural hearing loss (SNHL). While prelingually and postlingually deaf individuals benefit substantially from CI, the outcomes after implantation vary greatly. Numerous studies have attempted to study the variables that affect CI outcomes, including the personal characteristics of CI candidates, environmental variables, and device-related variables. Up to 80% of the results remained unexplainable because all these variables could only roughly predict auditory performance with a CI. Brain structure/function differences after hearing deprivation, that is, cortical reorganization, has gradually attracted the attention of neuroscientists. The cross-modal reorganization in the auditory cortex following deafness is thought to be a key factor in the success of CI. In recent years, the adaptive and maladaptive effects of this reorganization on CI rehabilitation have been argued because the neural mechanisms of how this reorganization impacts CI learning and rehabilitation have not been revealed. Due to the lack of brain processes describing how this plasticity affects CI learning and rehabilitation, the adaptive and deleterious consequences of this reorganization on CI outcomes have recently been the subject of debate. This review describes the evidence for different roles of cross-modal reorganization in CI performance and attempts to explore the possible reasons. Additionally, understanding the core influencing mechanism requires taking into account the cortical changes from deafness to hearing restoration. However, methodological issues have restricted longitudinal research on cortical function in CI. Functional near-infrared spectroscopy (fNIRS) has been increasingly used for the study of brain function and language assessment in CI because of its unique advantages, which are considered to have great potential. Here, we review studies on auditory cortex reorganization in deaf patients and CI recipients, and then we try to illustrate the feasibility of fNIRS as a neuroimaging tool in predicting and assessing speech performance in CI recipients. Here, we review research on the cross-modal reorganization of the auditory cortex in deaf patients and CI recipients and seek to demonstrate the viability of using fNIRS as a neuroimaging technique to predict and evaluate speech function in CI recipients.

Celebrating the one millionth cochlear implant

Cochlear implants have been the most successful neural prosthesis, with one million users globally. Researchers used the source-filter model and speech vocoder to design the modern multi-channel implants, allowing implantees to achieve 70%-80% correct sentence recognition in quiet, on average. Researchers also used the cochlear implant to help understand basic mechanisms underlying loudness, pitch, and cortical plasticity. While front-end processing advances improved speech recognition in noise, the unilateral implant speech recognition in quiet has plateaued since the early 1990s. This lack of progress calls for action on re-designing the cochlear stimulating interface and collaboration with the general neurotechnology community.

A case study in phenomenology of visual experience with retinal prosthesis versus visual-to-auditory sensory substitution

The phenomenology of the blind has provided an age-old, unparalleled means of exploring the enigmatic link between the brain and mind. This paper delves into the unique phenomenological experience of a man who became blind in adulthood. He subsequently underwent both an Argus II retinal prosthesis implant and training, and extensive training on the EyeMusic visual to auditory sensory substitution device (SSD), thereby becoming the first reported case to date of dual proficiency with both devices. He offers a firsthand account into what he considers the great potential of combining sensory substitution devices with visual prostheses as part of a complete visual restoration protocol. While the Argus II retinal prosthesis alone provided him with immediate visual percepts by way of electrically stimulated phosphenes elicited by the device, the EyeMusic SSD requires extensive training from the onset. Yet following the extensive training program with the EyeMusic sensory substitution device, our subject reports that the sensory substitution device allowed him to experience a richer, more complex perceptual experience, that felt more "second nature" to him, while the Argus II prosthesis (which also requires training) did not allow him to achieve the same levels of automaticity and transparency. Following long-term use of the EyeMusic SSD, our subject reported that visual percepts representing mainly, but not limited to, colors portrayed by the EyeMusic SSD are elicited in association with auditory stimuli, indicating the acquisition of a high level of automaticity. Finally, the case study indicates an additive benefit to the combination of both devices on the user's subjective phenomenological visual experience.

Side-of-Implantation Effect on Functional Asymmetry in the Auditory Cortex of Single-Sided Deaf Cochlear-Implant Users

Cochlear implants (CIs) allow to restore the hearing function in profoundly deaf individuals. Due to the degradation of the stimulus by CI signal processing, implanted individuals with single-sided deafness (SSD) have the specific challenge that the input highly differs between their ears. The present study compared normal-hearing (NH) listeners (N = 10) and left- and right-ear implanted SSD CI users (N = 10 left, N = 9 right), to evaluate cortical speech processing between CI- and NH-ears and to explore for side-of-implantation effects. The participants performed a two-deviant oddball task, separately with the left and the right ear. Auditory event-related potentials (ERPs) in response to syllables were compared between proficient and non-proficient CI users, as well as between CI and NH ears. The effect of the side of implantation was analysed on the sensor and the source level. CI proficiency could be distinguished based on the ERP amplitudes of the N1 and the P3b. Moreover, syllable processing via the CI ear, when compared to the NH ear, resulted in attenuated and delayed ERPs. In addition, the left-ear implanted SSD CI users revealed an enhanced functional asymmetry in the auditory cortex than right-ear implanted SSD CI users, regardless of whether the syllables were perceived via the CI or the NH ear. Our findings reveal that speech-discrimination proficiency in SSD CI users can be assessed by N1 and P3b ERPs. The results contribute to a better understanding of the rehabilitation success in SSD CI users by showing that cortical speech processing in SSD CI users is affected by CI-related stimulus degradation and experience-related functional changes in the auditory cortex.

Cortical imbalance following delayed restoration of bilateral hearing in deaf adolescents

Unilateral auditory deprivation in early childhood can lead to cortical strengthening of inputs from the stimulated side, yet the impact of this on bilateral processing when inputs are later restored beyond an early sensitive period is unknown. To address this, we conducted a longitudinal study with 13 bilaterally profoundly deaf adolescents who received unilateral access to sound via a cochlear implant (CI) in their right ear in early childhood before receiving bilateral access to sound a decade later via a second CI in their left ear. Auditory‐evoked cortical responses to unilateral and bilateral stimulation were measured repeatedly using electroencephalogram from 1 week to 14 months after activation of their second CI. Early cortical responses from the newly implanted ear and bilateral stimulation were atypically lateralized to the left ipsilateral auditory cortex. Duration of unilateral deafness predicted an unexpectedly stronger representation of inputs from the newly implanted, compared to the first implanted ear, in left auditory cortex. Significant initial reductions in responses were observed, yet a left‐hemisphere bias and unequal weighting of inputs favoring the long‐term deaf ear did not converge to a balanced state observed in the binaurally developed system. Bilateral response enhancement was significantly reduced in left auditory cortex suggesting deficits in ipsilateral response inhibition of new, dominant, inputs during bilateral processing. These findings paradoxically demonstrate the adaptive capacity of the adolescent auditory system beyond an early sensitive period for bilateral input, as well as restrictions on its potential to fully reverse cortical imbalances driven by long‐term unilateral deafness.

Recording EEG in Cochlear Implant Users: Guidelines for Experimental Design and Data Analysis for Optimizing Signal Quality and Minimizing Artifacts

Cochlear implants (CI) are neural prostheses that can restore hearing in individuals with severe to profound hearing loss. Although CIs significantly improve quality of life, clinical outcomes are still highly variable. An important part of this variability is explained by the brain reorganization following cochlear implantation. Therefore, clinicians and researchers are seeking objective measurements to investigate post-implantation brain plasticity. Electroencephalography (EEG) is a promising technique because it is objective, non-invasive, and implant-compatible, but is nonetheless susceptible to massive artifacts generated by the prosthesis's electrical activity. CI artifacts can blur and distort brain responses; thus, it is crucial to develop reliable techniques to remove them from EEG recordings. Despite numerous artifact removal techniques used in previous studies, there is a paucity of documentation and consensus on the optimal EEG procedures to reduce these artifacts. Herein, and through a comprehensive review process, we provide a guideline for designing an EEG-CI experiment minimizing the effect of the artifact. We provide some technical guidance for recording an accurate neural response from CI users and discuss the current challenges in detecting and removing CI-induced artifacts from a recorded signal. The aim of this paper is also to provide recommendations to better appraise and report EEG-CI findings.

Cross-modal integration and plasticity in the superior temporal cortex

In congenitally deaf people, temporal regions typically believed to be primarily auditory enhance their response to nonauditory information. The neural mechanisms and functional principles underlying this phenomenon, as well as its impact on auditory recovery after sensory restoration, yet remain debated. In this chapter, we demonstrate that the cross-modal recruitment of temporal regions by visual inputs in congenitally deaf people follows organizational principles known to be present in the hearing brain. We propose that the functional and structural mechanisms allowing optimal convergence of multisensory information in the temporal cortex of hearing people also provide the neural scaffolding for feeding visual or tactile information into the deafened temporal areas. Innate in their nature, such anatomo-functional links between the auditory and other sensory systems would represent the common substrate of both early multisensory integration and expression of selective cross-modal plasticity in the superior temporal cortex.

Neuroplasticity following cochlear implants

The auditory cortex of people with sensorineural hearing loss can be re-afferented using a cochlear implant (CI): a neural prosthesis that bypasses the damaged cells in the cochlea to directly stimulate the auditory nerve. Although CIs are the most successful neural prosthesis to date, some CI users still do not achieve satisfactory outcomes using these devices. To explain variability in outcomes, clinicians and researchers have increasingly focused their attention on neuroscientific investigations that examined how the auditory cortices respond to the electric signals that originate from the CI. This chapter provides an overview of the literature that examined how the auditory cortex changes its functional properties in response to inputs from the CI, in animal models and in humans. We focus first on the basic responses to sounds delivered through electrical hearing and, next, we examine the integrity of two fundamental aspects of the auditory system: tonotopy and processing of binaural cues. When addressing the effects of CIs in humans, we also consider speech-evoked responses. We conclude by discussing to what extent this neuroscientific literature can contribute to clinical practices and help to overcome variability in outcomes.

A Brief History of Nuclear Medicine Physics, Instrumentation, and Data Sciences in Korea

We review the history of nuclear medicine physics, instrumentation, and data sciences in Korea to commemorate the 60^th anniversary of the Korean Society of Nuclear Medicine. In the 1970s and 1980s, the development of SPECT, nuclear stethoscope, and bone densitometry systems, as well as kidney and cardiac image analysis technology, marked the beginning of nuclear medicine physics and engineering in Korea. With the introduction of PET and cyclotron in Korea in 1994, nuclear medicine imaging research was further activated. With the support of large-scale government projects, the development of gamma camera, SPECT, and PET systems was carried out. Exploiting the use of PET scanners in conjunction with cyclotrons, extensive studies on myocardial blood flow quantification and brain image analysis were also actively pursued. In 2005, Korea's first domestic cyclotron succeeded in producing radioactive isotopes, and the cyclotron was provided to six universities and university hospitals, thereby facilitating the nationwide supply of PET radiopharmaceuticals. Since the late 2000s, research on PET/MRI has been actively conducted, and the advanced research results of Korean scientists in the fields of silicon photomultiplier PET and simultaneous PET/MRI have attracted significant attention from the academic community. Currently, Korean researchers are actively involved in endeavors to solve a variety of complex problems in nuclear medicine using artificial intelligence and deep learning technologies.

Cortical Auditory Evoked Potential in Adults With Cochlear Implants: A Comparison With Adults With Normal Hearing

Background and Objectives

To examine the maturational status of the auditory cortex in adults with cochlear implants (CIs) using the latencies of the P1, N1, and P2 components of cortical auditory-evoked potentials (CAEPs).

Subjects and Methods

A total of 25 adults with CIs and 25 age-matched, normal-hearing control subjects participated in this study. Specifically, patients with CIs were divided into three groups depending on their age of deafness onset: Group A comprised patients with prelingual deafness who had received CI during early childhood (n=7), Group B comprised patients with early childhood-onset, progressive deafness who had received CI during childhood (n=6), and Group C comprised patients with adult-onset deafness (n=12). The P1, N1, and P2 latencies of their CAEPs were then compared between CI patients and normal-hearing subjects.

Results

All participants showed clear CAEP responses. P1 and N1 latencies in Group A and Group C patients were significantly longer than those in the control group. Meanwhile, Group B patients had significantly longer N1 and P2 latencies, as compared with those in the control group.

Conclusions

Patients with prelingual deafness and those with early-childhood onset, progressive deafness who received CI developed primary and higher-order auditory areas postoperatively when they became adults. However, their auditory cortex maturational statuses seemed to be worse than that of normal-hearing individuals. Furthermore, adult patients with late-onset deafness might experience degenerative auditory cortex changes during the auditory deprivation period between deafness onset and cochlear implantation.

Use of Functional Near-Infrared Spectroscopy to Predict and Measure Cochlear Implant Outcomes: A Scoping Review

Outcomes following cochlear implantation vary widely for both adults and children, and behavioral tests are currently relied upon to assess this. However, these behavioral tests rely on subjective judgements that can be unreliable, particularly for infants and young children. The addition of an objective test of outcome following cochlear implantation is therefore desirable. The aim of this scoping review was to comprehensively catalogue the evidence for the potential of functional near infrared spectroscopy (fNIRS) to be used as a tool to objectively predict and measure cochlear implant outcomes. A scoping review of the literature was conducted following the PRISMA extension for scoping review framework. Searches were conducted in the MEDLINE, EMBASE, PubMed, CINAHL, SCOPUS, and Web of Science electronic databases, with a hand search conducted in Google Scholar. Key terms relating to near infrared spectroscopy and cochlear implants were used to identify relevant publications. Eight records met the criteria for inclusion. Seven records reported on adult populations, with five records only including post-lingually deaf individuals and two including both pre- and post-lingually deaf individuals. Studies were either longitudinal or cross-sectional, and all studies compared fNIRS measurements with receptive speech outcomes. This review identified and collated key work in this field. The homogeneity of the populations studied so far identifies key gaps for future research, including the use of fNIRS in infants. By mapping the literature on this important topic, this review contributes knowledge towards the improvement of outcomes following cochlear implantation.

Alterations of Regional Homogeneity in Children With Congenital Sensorineural Hearing Loss: A Resting-State fMRI Study

Background: Brain functional alterations have been observed in children with congenital sensorineural hearing loss (CSNHL). The purpose of this study was to assess the alterations of regional homogeneity in children with CSNHL.

Methods: Forty-five children with CSNHL and 20 healthy controls were enrolled into this study. Brain resting-state functional MRI (rs-fMRI) for regional homogeneity including the Kendall coefficient consistency (KCC-ReHo) and the coherence-based parameter (Cohe-ReHo) was analyzed and compared between the two groups, i.e., the CSNHL group and the healthy control group.

Results: Compared to the healthy controls, children with CSNHL showed increased Cohe-ReHo values in left calcarine and decreased values in bilateral ventrolateral prefrontal cortex (VLPFC) and right dorsolateral prefrontal cortex (DLPFC). Children with CSNHL also had increased KCC-ReHo values in the left calcarine, cuneus, precentral gyrus, and right superior parietal lobule (SPL) and decreased values in the left VLPFC and right DLPFC. Correlations were detected between the ReHo values and age of the children with CSNHL. There were positive correlations between ReHo values in the pre-cuneus/pre-frontal cortex and age (p < 0.05). There were negative correlations between ReHo values in bilateral temporal lobes, fusiform gyrus, parahippocampal gyrus and precentral gyrus, and age (p < 0.05).

Conclusion: Children with CSNHL had RoHo alterations in the auditory, visual, motor, and other related brain cortices as compared to the healthy controls with normal hearing. There were significant correlations between ReHo values and age in brain regions involved in information integration and processing. Our study showed promising data using rs-fMRI ReHo parameters to assess brain functional alterations in children with CSNHL.

Functional Consequences of Poor Binaural Hearing in Development: Evidence From Children With Unilateral Hearing Loss and Children Receiving Bilateral Cochlear Implants

Poor binaural hearing in children was hypothesized to contribute to related cognitive and academic deficits. Children with unilateral hearing have normal hearing in one ear but no access to binaural cues. Their cognitive and academic deficits could be unique from children receiving bilateral cochlear implants (CIs) at young ages who have poor access to spectral cues and impaired binaural sensitivity. Both groups are at risk for vestibular/balance deficits which could further contribute to memory and learning challenges. Eighty-eight children (43 male:45 female, aged 9.89  ±  3.40 years), grouped by unilateral hearing loss (n = 20), bilateral CI (n = 32), and typically developing (n = 36), completed a battery of sensory, cognitive, and academic tests. Analyses revealed that children in both hearing loss groups had significantly poorer skills (accounting for age) on most tests than their normal hearing peers. Children with unilateral hearing loss had more asymmetric speech perception than children with bilateral CIs (p < .0001) but balance and language deficits (p = .0004, p < .0001, respectively) were similar in the two hearing loss groups (p > .05). Visuospatial memory deficits occurred in both hearing loss groups (p = .02) but more consistently across tests in children with unilateral hearing loss. Verbal memory was not significantly different than normal (p > .05). Principal component analyses revealed deficits in a main cluster of visuospatial memory, oral language, mathematics, and reading measures (explaining 46.8% data variability). The remaining components revealed clusters of self-reported hearing, balance and vestibular function, and speech perception deficits. The findings indicate significant developmental impacts of poor binaural hearing in children.

Cochlear Implant Research and Development in the Twenty-first Century: A Critical Update

Cochlear implants (CIs) are the world's most successful sensory prosthesis and have been the subject of intense research and development in recent decades. We critically review the progress in CI research, and its success in improving patient outcomes, from the turn of the century to the present day. The review focuses on the processing, stimulation, and audiological methods that have been used to try to improve speech perception by human CI listeners, and on fundamental new insights in the response of the auditory system to electrical stimulation. The introduction of directional microphones and of new noise reduction and pre-processing algorithms has produced robust and sometimes substantial improvements. Novel speech-processing algorithms, the use of current-focusing methods, and individualised (patient-by-patient) deactivation of subsets of electrodes have produced more modest improvements. We argue that incremental advances have and will continue to be made, that collectively these may substantially improve patient outcomes, but that the modest size of each individual advance will require greater attention to experimental design and power. We also briefly discuss the potential and limitations of promising technologies that are currently being developed in animal models, and suggest strategies for researchers to collectively maximise the potential of CIs to improve hearing in a wide range of listening situations.

Can Haptic Stimulation Enhance Music Perception in Hearing-Impaired Listeners?

Cochlear implants (CIs) have been remarkably successful at restoring hearing in severely-to-profoundly hearing-impaired individuals. However, users often struggle to deconstruct complex auditory scenes with multiple simultaneous sounds, which can result in reduced music enjoyment and impaired speech understanding in background noise. Hearing aid users often have similar issues, though these are typically less acute. Several recent studies have shown that haptic stimulation can enhance CI listening by giving access to sound features that are poorly transmitted through the electrical CI signal. This “electro-haptic stimulation” improves melody recognition and pitch discrimination, as well as speech-in-noise performance and sound localization. The success of this approach suggests it could also enhance auditory perception in hearing-aid users and other hearing-impaired listeners. This review focuses on the use of haptic stimulation to enhance music perception in hearing-impaired listeners. Music is prevalent throughout everyday life, being critical to media such as film and video games, and often being central to events such as weddings and funerals. It represents the biggest challenge for signal processing, as it is typically an extremely complex acoustic signal, containing multiple simultaneous harmonic and inharmonic sounds. Signal-processing approaches developed for enhancing music perception could therefore have significant utility for other key issues faced by hearing-impaired listeners, such as understanding speech in noisy environments. This review first discusses the limits of music perception in hearing-impaired listeners and the limits of the tactile system. It then discusses the evidence around integration of audio and haptic stimulation in the brain. Next, the features, suitability, and success of current haptic devices for enhancing music perception are reviewed, as well as the signal-processing approaches that could be deployed in future haptic devices. Finally, the cutting-edge technologies that could be exploited for enhancing music perception with haptics are discussed. These include the latest micro motor and driver technology, low-power wireless technology, machine learning, big data, and cloud computing. New approaches for enhancing music perception in hearing-impaired listeners could substantially improve quality of life. Furthermore, effective haptic techniques for providing complex sound information could offer a non-invasive, affordable means for enhancing listening more broadly in hearing-impaired individuals.

Supra-normal skills in processing of visuo-auditory prosodic information by cochlear-implanted deaf patients

Cochlear implanted (CI) adults with acquired deafness are known to depend on multisensory integration skills (MSI) for speech comprehension through the fusion of speech reading skills and their deficient auditory perception. But, little is known on how CI patients perceive prosodic information relating to speech content. Our study aimed to identify how CI patients use MSI between visual and auditory information to process paralinguistic prosodic information of multimodal speech and the visual strategies employed. A psychophysics assessment was developed, in which CI patients and hearing controls (NH) had to distinguish between a question and a statement. The controls were separated into two age groups (young and aged-matched) to dissociate any effect of aging. In addition, the oculomotor strategies used when facing a speaker in this prosodic decision task were recorded using an eye-tracking device and compared to controls. This study confirmed that prosodic processing is multisensory but it revealed that CI patients showed significant supra-normal audiovisual integration for prosodic information compared to hearing controls irrespective of age. This study clearly showed that CI patients had a visuo-auditory gain more than 3 times larger than that observed in hearing controls. Furthermore, CI participants performed better in the visuo-auditory situation through a specific oculomotor exploration of the face as they significantly fixate the mouth region more than young NH participants who fixate the eyes, whereas the aged-matched controls presented an intermediate exploration pattern equally reported between the eyes and mouth. To conclude, our study demonstrated that CI patients have supra-normal skills MSI when integrating visual and auditory linguistic prosodic information, and a specific adaptive strategy developed as it participates directly in speech content comprehension.

Ear-Specific Hemispheric Asymmetry in Unilateral Deafness Revealed by Auditory Cortical Activity

Profound unilateral deafness reduces the ability to localize sounds achieved via binaural hearing. Furthermore, unilateral deafness promotes a substantial change in cortical processing to binaural stimulation, thereby leading to reorganization over the whole brain. Although distinct patterns in the hemispheric laterality depending on the side and duration of deafness have been suggested, the neurological mechanisms underlying the difference in relation to behavioral performance when detecting spatially varied cues remain unknown. To elucidate the mechanism, we compared N1/P2 auditory cortical activities and the pattern of hemispheric asymmetry of normal hearing, unilaterally deaf (UD), and simulated acute unilateral hearing loss groups while passively listening to speech sounds delivered from different locations under open free field condition. The behavioral performances of the participants concerning sound localization were measured by detecting sound sources in the azimuth plane. The results reveal a delayed reaction time in the right-sided UD (RUD) group for the sound localization task and prolonged P2 latency compared to the left-sided UD (LUD) group. Moreover, the RUD group showed adaptive cortical reorganization evidenced by increased responses in the hemisphere ipsilateral to the intact ear for individuals with better sound localization whereas left-sided unilateral deafness caused contralateral dominance in activity from the hearing ear. The brain dynamics of right-sided unilateral deafness indicate greater capability of adaptive change to compensate for impairment in spatial hearing. In addition, cortical N1 responses to spatially varied speech sounds in unilateral deaf people were inversely related to the duration of deafness in the area encompassing the right auditory cortex, indicating that early intervention would be needed to protect from maladaptation of the central auditory system following unilateral deafness.

Electro-Tactile Stimulation Enhances Cochlear-Implant Melody Recognition: Effects of Rhythm and Musical Training

OBJECTIVES

Electro-acoustic stimulation (EAS) enhances speech and music perception in cochlear-implant (CI) users who have residual low-frequency acoustic hearing. For CI users who do not have low-frequency acoustic hearing, tactile stimulation may be used in a similar fashion as residual low-frequency acoustic hearing to enhance CI performance. Previous studies showed that electro-tactile stimulation (ETS) enhanced speech recognition in noise and tonal language perception for CI listeners. Here, we examined the effect of ETS on melody recognition in both musician and nonmusician CI users.

DESIGN

Nine musician and eight nonmusician CI users were tested in a melody recognition task with or without rhythmic cues in three testing conditions: CI only (E), tactile only (T), and combined CI and tactile stimulation (ETS).

RESULTS

Overall, the combined electrical and tactile stimulation enhanced the melody recognition performance in CI users by 9% points. Two additional findings were observed. First, musician CI users outperformed nonmusicians CI users in melody recognition, but the size of the enhancement effect was similar between the two groups. Second, the ETS enhancement was significantly higher with nonrhythmic melodies than rhythmic melodies in both groups.

CONCLUSIONS

These findings suggest that, independent of musical experience, the size of the ETS enhancement depends on integration efficiency between tactile and auditory stimulation, and that the mechanism of the ETS enhancement is improved electric pitch perception. The present study supports the hypothesis that tactile stimulation can be used to improve pitch perception in CI users.

Effects of in vivo repositioning of slim modiolar electrodes on electrical thresholds and speech perception

The slim modiolar electrode has been reported to ensure better modiolar proximity than previous conventional perimodiolar electrodes and consistently high scala tympani localization. Nonetheless, variability in modiolar proximity exists even among slim modiolar electrodes, still leaving room for further improvement of modiolar proximity, which may positively affect functional outcomes. Given this, the pull-back maneuver was reported to increase the modiolar proximity of slim modiolar electrodes in a cadaveric study, but in vivo repositioning effects remain to be established. Here we identified that the pull-back maneuver led to better modiolar proximity than conventional insertion while maintaining a similar angular insertion depth. Notably, the reduced electrode-modiolus distance from the pull-back maneuver was associated with significantly lower impedances across electrodes postoperatively as well as reduced intraoperative electrophysiological thresholds than conventional insertion. Among adult cochlear implant recipients, this maneuver resulted in significantly better sentence recognition scores at three months postoperatively when compared to those with a conventional insertion; however, this benefit was not observed at later intervals. Collectively, slim modiolar electrodes with the pull-back maneuver further enhance the modiolar proximity, possibly leading to better open-set sentence recognition, at least in the early postoperative stage.

Effects of long-term unilateral cochlear implant use on large-scale network synchronization in adolescents

Unilateral cochlear implantation (CI) limits deafness-related changes in the auditory pathways but promotes abnormal cortical preference for the stimulated ear and leaves the opposite ear with little protection from auditory deprivation. In the present study, time-frequency analyses of event-related potentials elicited from stimuli presented to each ear were used to determine effects of unilateral CI use on cortical synchrony. CI-elicited activity in 34 adolescents (15.4±1.9 years of age) who had listened with unilateral CIs for most of their lives prior to bilateral implantation were compared to responses elicited by a 500Hz tone-burst in normal hearing peers. Phase-locking values between 4 and 60Hz were calculated for 171 pairs of 19-cephalic recording electrodes. Ear specific results were found in the normal hearing group: higher synchronization in low frequency bands (theta and alpha) from left ear stimulation in the right hemisphere and more high frequency activity (gamma band) from right ear stimulation in the left hemisphere. In the CI group, increased phase synchronization in the theta and beta frequencies with bursts of gamma activity were elicited by the experienced-right CI between frontal, temporal and parietal cortical regions in both hemispheres, consistent with increased recruitment of cortical areas involved in attention and higher-order processes, potentially to support unilateral listening. By contrast, activity was globally desynchronized in response to initial stimulation of the naïve-left ear, suggesting decoupling of these pathways from the cortical hearing network. These data reveal asymmetric auditory development promoted by unilateral CI use, resulting in an abnormally mature neural network.

A nonsense TMEM43 variant leads to disruption of connexin-linked function and autosomal dominant auditory neuropathy spectrum disorder

Genes that are primarily expressed in cochlear glia-like supporting cells (GLSs) have not been clearly associated with progressive deafness. Herein, we present a deafness locus mapped to chromosome 3p25.1 and an auditory neuropathy spectrum disorder (ANSD) gene, TMEM43, mainly expressed in GLSs. We identify p.(Arg372Ter) of TMEM43 by linkage analysis and exome sequencing in two large Asian families segregating ANSD, which is characterized by inability to discriminate speech despite preserved sensitivity to sound. The knock-in mouse with the p.(Arg372Ter) variant recapitulates a progressive hearing loss with histological abnormalities in GLSs. Mechanistically, TMEM43 interacts with the Connexin26 and Connexin30 gap junction channels, disrupting the passive conductance current in GLSs in a dominant-negative fashion when the p.(Arg372Ter) variant is introduced. Based on these mechanistic insights, cochlear implant was performed on three subjects, and speech discrimination was successfully restored. Our study highlights a pathological role of cochlear GLSs by identifying a deafness gene and its causal relationship with ANSD.

Longer Cochlear Implant Experience Leads to Better Production of Mandarin Tones for Early Implanted Children

OBJECTIVES

Children with cochlear implants (CIs) face challenges in acquiring tones, since CIs do not transmit pitch information effectively. It has been suggested that longer CI experience provides additional benefits for children implanted early, enabling them to achieve language abilities similar to that of normal-hearing (NH) children (Colletti 2009). Mandarin is a tonal language with four lexical tones and a neutral tone (T0), characterized by distinct pitch and durational patterns. It has been suggested that early implantation (i.e., before 2 years) greatly benefits the acquisition of Mandarin tones by children with CIs (Tang et al. 2019c). In this study, we extend those findings to investigate the effect of CI experience on the acquisition of Mandarin tones for children implanted early. We asked the extent to which they were able to produce distinct pitch and durational patterns of both lexical tones and T0 as a function of CI experience, and the extent to which their tonal productions were acoustically like that of NH children.

DESIGN

Forty-four NH 3-year olds and 28 children implanted with CIs between 1 and 2 years, aged 3 to 7, were recruited. The children with CIs were grouped according to the length of CI experience: 3 to 6 years, 2 to 3 years, and 1 to 2 years. Lexical tone and T0 productions were elicited using a picture-naming task. Tonal productions from the children with CIs were acoustically analyzed and compared with those from the NH children.

RESULTS

Children with 3 to 6 years of CI experience were able to produce distinct pitch and durational patterns for both lexical tones and T0, with NH-like acoustic realizations. Children with 2 to 3 years of CI experience were also able to produce the expected tonal patterns, although their productions were not yet NH-like. Those with only 1 to 2 years of CI experience, however, were not yet able to produce the distinct acoustic patterns for either lexical tones or T0.

CONCLUSIONS

These results provide acoustic evidence demonstrating that, when Mandarin-speaking children are implanted before the age of 2, only those with 3 to 6 years of experience were able to produce NH-like tones, including both lexical tone and T0. Children with shorter CI experience (less than 3 years) were unable to produce distinct acoustic patterns for the different tones. This suggests that at least 3 years of CI experience is still needed for early implanted children to acquire tonal distinctions similar to those of NH 3-year olds.

Vestibular status: A missing factor in our understanding of brain reorganization in deaf individuals

The brain of deaf people is definitely not just deaf, and we have to reconsider what we know about the impact of hearing loss on brain development in light of comorbid vestibular impairments.

Multisensory perception in Argus II retinal prosthesis patients: Leveraging auditory-visual mappings to enhance prosthesis outcomes

Crossmodal mappings associate features (such as spatial location) between audition and vision, thereby aiding sensory binding and perceptual accuracy. Previously, it has been unclear whether patients with artificial vision will develop crossmodal mappings despite the low spatial and temporal resolution of their visual perception (particularly in light of the remodeling of the retina and visual cortex that takes place during decades of vision loss). To address this question, we studied crossmodal mappings psychophysically in Retinitis Pigmentosa patients with partial visual restoration by means of Argus II retinal prostheses, which incorporate an electrode array implanted on the retinal surface that stimulates still-viable ganglion cells with a video stream from a head-mounted camera. We found that Argus II patients (N = 10) exhibit significant crossmodal mappings between auditory location and visual location, and between auditory pitch and visual elevation, equivalent to those of age-matched sighted controls (N = 10). Furthermore, Argus II patients (N = 6) were able to use crossmodal mappings to locate a visual target more quickly with auditory cueing than without. Overall, restored artificial vision was shown to interact with audition via crossmodal mappings, which implies that the reorganization during blindness and the limitations of artificial vision did not prevent the relearning of crossmodal mappings. In particular, cueing based on crossmodal mappings was shown to improve visual search with a retinal prosthesis. This result represents a key first step toward leveraging crossmodal interactions for improved patient visual functionality.

Switching Tinnitus-On: Maps and source localization of spontaneous EEG

OBJECTIVE

To identify the spectrotemporal changes and sources in patients that could "turn on" tinnitus with multichannel electroencephalography (EEG) system.

METHODS

Multichannel EEG was recorded from six patients during the Tinnitus-On and Tinnitus-Off states. The EEG power spectrum and eLORETA-based sources were measured.

RESULTS

There was a global increase in delta and theta during Tinnitus-On plus large changes in alpha 1 and alpha 2. During the Tinnitus-On state, many new sources in delta, theta, alpha 1 and gamma bands emerged in the opposite hemisphere in the inferior temporal gyrus (Brodmann area, BA 20), middle temporal gyrus (BA 21), lateral perirhinal cortex (BA 36), ventral entorhinal cortex (BA 28) and anterior pole of the temporal gyrus (BA 38).

CONCLUSIONS

The emergence of new delta, theta and gamma band sources in the inferior temporal gyrus (BA 20), middle temporal gyrus (BA 21) and lateral perirhinal cortex (BA 36) plus the appearance of new delta and theta sources in the ventral entorhinal cortex (BA28) and anterior pole of the temporal lobe (BA 38) may comprise a network capable of evoking the phantom sound of tinnitus by simultaneously engaging brain regions involved in memory, sound recognition, and distress which together contribute to tinnitus severity.

SIGNIFICANCE

The sudden appearance of new sources of activity in the opposite hemisphere within the inferior temporal gyrus, middle temporal gyrus and perirhinal cortex may initiate the perception of tinnitus perception.

Music perception and training for pediatric cochlear implant users

INTRODUCTION

Cochlear implants (CIs) are biomedical devices that restore sound perception for people with severe-to-profound sensorineural hearing loss. Most postlingually deafened CI users are able to achieve excellent speech recognition in quiet environments. However, current CI sound processors remain limited in their ability to deliver fine spectrotemporal information, making it difficult for CI users to perceive complex sounds. Limited access to complex acoustic cues such as music, environmental sounds, lexical tones, and voice emotion may have significant ramifications on quality of life, social development, and community interactions.

AREAS COVERED

The purpose of this review article is to summarize the literature on CIs and music perception, with an emphasis on music training in pediatric CI recipients. The findings have implications on our understanding of noninvasive, accessible methods for improving auditory processing and may help advance our ability to improve sound quality and performance for implantees.

EXPERT OPINION

Music training, particularly in the pediatric population, may be able to continue to enhance auditory processing even after performance plateaus. The effects of these training programs appear generalizable to non-trained musical tasks, speech prosody and, emotion perception. Future studies should employ rigorous control groups involving a non-musical acoustic intervention, standardized auditory stimuli, and the provision of feedback.

Cortical reorganization following auditory deprivation predicts cochlear implant performance in postlingually deaf adults

Long‐term hearing loss in postlingually deaf (PD) adults may lead to brain structural changes that affect the outcomes of cochlear implantation. We studied 94 PD patients who underwent cochlear implantation and 37 patients who were MRI‐scanned within 2 weeks after the onset of sudden hearing loss and expected with minimal brain structural changes in relation to deafness. Compared with those with sudden hearing loss, we found lower gray matter (GM) probabilities in bilateral thalami, superior, middle, inferior temporal cortices as well as the central cortical regions corresponding to the movement and sensation of the lips, tongue, and larynx in the PD group. Among these brain areas, the GM in the middle temporal cortex showed negative correlation with disease duration, whereas the other areas displayed positive correlations. Left superior, middle temporal cortical, and bilateral thalamic GMs were the most accurate predictors of post‐cochlear implantation word recognition scores (mean absolute error [MAE] = 10.1, r = .82), which was superior to clinical variables used (MAE: 12.1, p < .05). Using the combined brain morphological and clinical features, we achieved the best prediction of the outcome (MAE: 8.51, r = .90). Our findings suggest that the cross‐modal plasticity allowing the superior temporal cortex and thalamus to process other modal sensory inputs reverses the initially lower volume when deafness becomes persistent. The middle temporal cortex processing higher‐level language comprehension shows persistent negative correlations with disease duration, suggesting this area's association with degraded speech comprehensions due to long‐term deafness. Morphological features combined with clinical variables might play a key role in predicting outcomes of cochlear implantation.

Conductive Hearing Loss Aggravates Memory Decline in Alzheimer Model Mice

The study of cognitive impairment associated with hearing loss has recently garnered considerable interest. Epidemiological data have demonstrated that hearing loss is a risk factor for cognitive decline as a result of aging. However, no previous study has examined the effect of hearing loss in patients with cognitive problems such as Alzheimer’s disease. Therefore, we investigated the effect of conductive hearing loss in an Alzheimer’s mouse model. Positron emission tomography (PET) and magnetic resonance imaging (MRI) were used to evaluate changes in glucose metabolism and gray matter concentrations in the 5xFAD Alzheimer’s Disease (AD) transgenic mouse model with and without conductive hearing loss (HL). Conductive hearing loss was induced using chronic perforation of the tympanic membrane. Behavioral data from the Y-maze and passive avoidance tests revealed greater memory deficits in the AD with HL (AD-HL) group than in the AD group. Following induction of hearing loss, lower cerebral glucose metabolism in the frontal association cortex was observed in the AD-HL group than in the AD group. Although lower glucose metabolism in the hippocampus and cerebellum was found in the AD-HL group than in the AD group at 3 months, the gray matter concentrations in these regions were not significantly different between the groups. Furthermore, the gray matter concentrations in the simple lobule, cingulate/retrosplenial cortex, substantia nigra, retrosigmoid nucleus, medial geniculate nucleus, and anterior pretectal nucleus at 7 months were significantly lower in the AD-HL group than in the AD group. Taken together, these results indicate that even partial hearing loss can aggravate memory impairment in Alzheimer’s disease.

Reorganized Brain White Matter in Early- and Late-Onset Deafness With Diffusion Tensor Imaging

OBJECTIVES

Individuals with early- and late-onset deafness showed different functional and morphological brain changes, but white matter alterations in both deaf groups still need to be elucidated. This study aimed to investigate changes in white matter integrity and white matter anatomical connectivity in both early- and late-onset deaf groups compared with hearing group.

DESIGN

Diffusion tensor imaging data from 7 early-onset deaf (50.7 ± 6.5 years), 11 late-onset deaf (50.9 ± 12.3 years), and 9 hearing adults (48.9 ± 9.5 years) were preprocessed using FSL software. To find changes in white matter integrity, tract-based spatial statistics was used, which implemented on FSL software. Fractional anisotropy (FA), axial diffusivity (AD) and radial diffusivity (RD) were calculated and compared among the groups with age as a nuisance variable. To find out the effect of onset age or duration of deafness to the white matter integrity, onset-age or duration of deafness was treated as a variable of interest in the general linear model implemented on tract-based spatial statistics. White matter connectivity was constructed by a deterministic tractography and compared among the groups.

RESULTS

In comparison to the hearing group, the early-onset deaf group did not show any significant changes but the late-onset deaf group showed decreased FA and increased RD in the several white matter areas. AD in the late-onset deaf group was not significantly different compared with the hearing group. The regions included the corpus callosum, posterior and superior corona radiata, internal capsule, posterior thalamic radiation, superior longitudinal fasciculus, and tapetum of the right hemisphere. Increased RD was also additionally observed in the right external capsule, fornix, and cerebral peduncle. The onset age or duration of deafness was not significantly correlated with the white matter integrity in the early-onset deaf group. In contrast, the onset age showed a significantly positive correlation with the RD, and a negative correlation with the FA, in the late-onset deaf group. The correlated white matter areas were also similar to the findings of comparison with the hearing group. In comparison to the hearing group, the early-onset deaf group did not show altered white matter connectivity, while the late-onset deaf group showed decreased white matter connectivity in between the right lingual and hippocampal areas.

CONCLUSIONS

The present results suggest that late-onset deaf adults showed decreased FA and increased RD, and early-onset deaf adults showed no difference compared with the hearing group. In the late-onset deaf adults, onset-age showed a significantly positive correlation with RD and negative correlation with FA. Duration of deafness was not significantly correlated with the changes. Increased RD indicating demyelination occurred in the brain, and the changes were not limited to the auditory cortex but expanded to almost whole brain areas, suggesting significant effect of auditory deprivation on the brain later in life. The altered white matter connectivity in between the right limbic-occipital areas observed in the late-onset deaf group might be caused by altered language functions after auditory deprivation. Future studies are necessary incorporating functional and anatomical aspects of the brain changes in deaf group.

The Benefit of Cross-Modal Reorganization on Speech Perception in Pediatric Cochlear Implant Recipients Revealed Using Functional Near-Infrared Spectroscopy

Cochlear implants (CIs) are the most successful treatment for severe-to-profound deafness in children. However, speech outcomes with a CI often lag behind those of normally-hearing children. Some authors have attributed these deficits to the takeover of the auditory temporal cortex by vision following deafness, which has prompted some clinicians to discourage the rehabilitation of pediatric CI recipients using visual speech. We studied this cross-modal activity in the temporal cortex, along with responses to auditory speech and non-speech stimuli, in experienced CI users and normally-hearing controls of school-age, using functional near-infrared spectroscopy. Strikingly, CI users displayed significantly greater cortical responses to visual speech, compared with controls. Importantly, in the same regions, the processing of auditory speech, compared with non-speech stimuli, did not significantly differ between the groups. This suggests that visual and auditory speech are processed synergistically in the temporal cortex of children with CIs, and they should be encouraged, rather than discouraged, to use visual speech.