Emotional Perception of Music in Children With Bimodal Fitting and Unilateral Cochlear Implant

Emotional abilities in preadolescents and adolescents with long-term cochlear implant use

OBJECTIVES

Emotional abilities (EAs) are particularly important during preadolescence/adolescence, two challenging periods characterized by significant biological, physical, and cognitive changes. The present study attempted to a holistic EA approach in preadolescents/adolescents with cochlear implants (CI) and typical hearing (TH), considering various aspects such as perception, cognitive facilitation, comprehension, and management of emotions. A secondary aim was to identify significant demographic and audiological factors of EA development.

METHODS

CI/TH groups were matched for chronological age, nonverbal IQ, gender, economic income, and maternal level of education. Each group consisted of 43 participants (age range 10-18 years). EAs were evaluated by using the multi-trait/method IE-ACCME test. Auditory-linguistic assessments included participants' lexical skills and Matrix performance as well.

RESULTS

EA performance for perception and cognitive facilitation did not show any statistically significant CI/TH group differences (p > 0.05). Significant CI/TH differences emerged for emotion comprehension and management: CI group performed significantly worse in understanding emotional blends (t = 2.56, p = 0.014) but better in personal emotion management (t = -2.01, p = 0.048). For the CI group, gender showed statistically significant effects on cognitive facilitation in sensations, with males performing better than females (U = 129, p = 0.018). TH preadolescents showed significantly lower scores in understanding emotional changes in comparison to TH adolescents (U = 125.5, p = 0.01). Emotional blends understanding showed a weak negative correlation with Matrix performance (r = - 0.38, p = 0.013) and a moderate positive correlation with lexical skills (r = 0.40, p = 0.008). Relationships management showed various significant correlations: weak negative correlations with age at CI (r = - 0.38, p = 0.011) and Matrix performance (r = - 0.36, p = 0.016) as well as weak positive correlations with nonverbal-IQ (r = 0.38, p = 0.013) and positive moderate correlations with lexical skills (r = 0.49, p < 0.001).

CONCLUSION

Cochlear implantation seems to show significant positive effects on emotional development in children, allowing them to achieve age appropriate EAs as they grow up and become preadolescents/adolescents. EA assessment in CI users may not only support monitorization of EA trajectory, but also early identification of any EA disorders, so that subjects with low EA profiles could be timely and properly intervened.

Emotions and Psychological Mechanisms of Listening to Music in Cochlear Implant Recipients

OBJECTIVES

Music is a multidimensional phenomenon and is classified by its arousal properties, emotional quality, and structural characteristics. Although structural features of music (i.e., pitch, timbre, and tempo) and music emotion recognition in cochlear implant (CI) recipients are popular research topics, music-evoked emotions, and related psychological mechanisms that reflect both the individual and social context of music are largely ignored. Understanding the music-evoked emotions (the "what") and related mechanisms (the "why") can help professionals and CI recipients better comprehend the impact of music on CI recipients' daily lives. Therefore, the purpose of this study is to evaluate these aspects in CI recipients and compare their findings to those of normal hearing (NH) controls.

DESIGN

This study included 50 CI recipients with diverse auditory experiences who were prelingually deafened (deafened at or before 6 years of age)-early implanted (N = 21), prelingually deafened-late implanted (implanted at or after 12 years of age-N = 13), and postlingually deafened (N = 16) as well as 50 age-matched NH controls. All participants completed the same survey, which included 28 emotions and 10 mechanisms (Brainstem reflex, Rhythmic entrainment, Evaluative Conditioning, Contagion, Visual imagery, Episodic memory, Musical expectancy, Aesthetic judgment, Cognitive appraisal, and Lyrics). Data were presented in detail for CI groups and compared between CI groups and between CI and NH groups.

RESULTS

The principal component analysis showed five emotion factors that are explained by 63.4% of the total variance, including anxiety and anger, happiness and pride, sadness and pain, sympathy and tenderness, and serenity and satisfaction in the CI group. Positive emotions such as happiness, tranquility, love, joy, and trust ranked as most often experienced in all groups, whereas negative and complex emotions such as guilt, fear, anger, and anxiety ranked lowest. The CI group ranked lyrics and rhythmic entrainment highest in the emotion mechanism, and there was a statistically significant group difference in the episodic memory mechanism, in which the prelingually deafened, early implanted group scored the lowest.

CONCLUSION

Our findings indicate that music can evoke similar emotions in CI recipients with diverse auditory experiences as it does in NH individuals. However, prelingually deafened and early implanted individuals lack autobiographical memories associated with music, which affects the feelings evoked by music. In addition, the preference for rhythmic entrainment and lyrics as mechanisms of music-elicited emotions suggests that rehabilitation programs should pay particular attention to these cues.

Socio-Emotional Development of Children with Cochlear Implant: A Systematic Review

Background

Attaining socio-emotional competence is challenging for children with hearing impairment. There is wide recognition of children with cochlear implant (CI) indicating significant improvement in their speech and language abilities, however many factors may restrict their chance of having reciprocal social interactions. A significant improvement in speech and language does not automatically affirm the quality of social interactions. This present observation on social-emotional development addressed a more current representative population of children with hearing loss who have benefitted from cochlear implantation.

Methods

The research conducted a systematic review of selected articles from Scopus and PubMed databases, retrieved through three search-process keywords, namely socio-emotional, children and CI. The inclusion criteria only included journal articles published in English with empirical data from the year 2010-2019. The initial search had identified 189 potential abstracts and after removal of duplicates, only 38 eligible studies met the inclusion criteria.

Results

Among 38 studies reviewed, 19 studies showed comparable socio-emotional skills with peers in social interaction, empathy, emotion theory of mind and comprehension skills. Conversely, the other 19 studies presented underprivileged results in socio-emotional functioning mainly in identifying facial expression, regulating emotion and emotional cues in the auditory domain.

Conclusion

This review concluded that the socio-emotional development among children with CI, both at preschool-age and school-age, was not justified due to the heterogeneity in studies across measurement and small sample size. Also, the conclusion recommended extensive cross-referencing, mixed-mode research design, detailed distinguishing of socio-emotional functioning and identification of diverse groups of the population with impaired hearing as an approach to provide empirical evidence on socio-emotional functioning among children with CI in the future.

Emotional Responses to Non-Speech Sounds for Hearing-aid and Bimodal Cochlear-Implant Listeners

The purpose of this project was to evaluate differences between groups and device configurations for emotional responses to non-speech sounds. Three groups of adults participated: 1) listeners with normal hearing with no history of device use, 2) hearing aid candidates with or without hearing aid experience, and 3) bimodal cochlear-implant listeners with at least 6 months of implant use. Participants (n = 18 in each group) rated valence and arousal of pleasant, neutral, and unpleasant non-speech sounds. Listeners with normal hearing rated sounds without hearing devices. Hearing aid candidates rated sounds while using one or two hearing aids. Bimodal cochlear-implant listeners rated sounds while using a hearing aid alone, a cochlear implant alone, or the hearing aid and cochlear implant simultaneously. Analysis revealed significant differences between groups in ratings of pleasant and unpleasant stimuli; ratings from hearing aid candidates and bimodal cochlear-implant listeners were less extreme (less pleasant and less unpleasant) than were ratings from listeners with normal hearing. Hearing aid candidates' ratings were similar with one and two hearing aids. Bimodal cochlear-implant listeners' ratings of valence were higher (more pleasant) in the configuration without a hearing aid (implant only) than in the two configurations with a hearing aid (alone or with an implant). These data support the need for further investigation into hearing device optimization to improve emotional responses to non-speech sounds for adults with hearing loss.

Rehabilitation of children with cochlear implant in Iran: A scoping review

Background: Recovery of children does not appear on its own after cochlear implantation. Coherent, thoughtful, and comprehensive rehabilitation is needed to achieve complete success. The purpose of this study was to identify the types of rehabilitation interventions for children with cochlear implants that have been performed in Iran.

Methods: A scoping review study was conducted. An electronic search was carried out both in English and Persian. In English, the following keywords were used: cochlear implantation, child, cochlear implants, auditory rehabilitation, deaf, hearing loss, comprehensive, interventions, rehabilitation, and telerehabilitation and a combination of them in ProQuest, PubMed, Science Direct, and Scopus databases, Web of Sciences, Medline and Embase. Persian electronic search was conducted in the Scientific Information Database (SID) of Jihad Daneshgahi, Iran Journals Database (MagIran), and Islamic World Science Citation Database (ISC). Searches were done using articles published until September 25, 2020, and a total of 902 articles were found, of which 14 were directly related to the purpose of the study. Interventional studies were included in the study, and the quality of studies was measured using the Structured Effectiveness Quality Evaluation Scale.

Results: The results showed that using music and rehabilitation equipment, different methods of speech therapy and auditory training, story-based instruction, creative play, family-centered instruction, and occupational therapy are interventions in cochlear implant rehabilitation. Speech therapy accounts for 54% of the rehabilitation share. The mean number of rehabilitation sessions was 26. These interventions were all somehow effective in children with cochlear implantation; the longer the training duration, the better the results.

Conclusion: The process of cochlear implant rehabilitation in children is multi-professional; auditory training and speech therapy possesses the highest share of rehabilitation. Therefore, it is recommended to develop speech therapy centers in Iran.

Rapid Assessment of Non-Verbal Auditory Perception in Normal-Hearing Participants and Cochlear Implant Users

In the case of hearing loss, cochlear implants (CI) allow for the restoration of hearing. Despite the advantages of CIs for speech perception, CI users still complain about their poor perception of their auditory environment. Aiming to assess non-verbal auditory perception in CI users, we developed five listening tests. These tests measure pitch change detection, pitch direction identification, pitch short-term memory, auditory stream segregation, and emotional prosody recognition, along with perceived intensity ratings. In order to test the potential benefit of visual cues for pitch processing, the three pitch tests included half of the trials with visual indications to perform the task. We tested 10 normal-hearing (NH) participants with material being presented as original and vocoded sounds, and 10 post-lingually deaf CI users. With the vocoded sounds, the NH participants had reduced scores for the detection of small pitch differences, and reduced emotion recognition and streaming abilities compared to the original sounds. Similarly, the CI users had deficits for small differences in the pitch change detection task and emotion recognition, as well as a decreased streaming capacity. Overall, this assessment allows for the rapid detection of specific patterns of non-verbal auditory perception deficits. The current findings also open new perspectives about how to enhance pitch perception capacities using visual cues.

Participation of Acoustic and Electric Hearing in Perceiving Musical Sounds

Introduction: The objective of our study was to evaluate musical perception and its relation to the quality of life in patients with bimodal binaural auditory stimulation.

Materials and Methods: Nineteen adult patients with a cochlear implant (CI) for minimum 6 months, and moderate to severe contralateral hearing loss with a hearing aid (HA), and 21 normal hearing adults were included in this prospective, cross-sectional study. Pure-tone and speech audiometry, musical test evaluating sound perception characteristics and musical listening abilities, Munich questionnaire for musical habits, and the APHAB questionnaire were recoded. Performance in musical perception test with HA, CI, and HA + CI, and potential correlations between music test, audiometry and questionnaires were investigated.

Results: Bimodal stimulation improved musical perception in several features (sound brightness, roughness, and clarity) in comparison to unimodal hearing, but CI did not add to HA performances in texture, polyphony or musical emotion and even appeared to interfere negatively in pitch perception with HA. Musical perception performances (sound clarity, instrument recognition) appeared to be correlated to hearing-related quality of life (APHAB RV and EC subdomains) but not with speech performances suggesting that the exploration of musical perception complements speech understanding evaluation to better describe every-day life hearing handicap.

Conclusion: Testing musical sound perception provides important information on hearing performances as a complement to speech audiometry and appears to be related to hearing-related quality of life.

Bimodal Benefit for Music Perception: Effect of Acoustic Bandwidth

Purpose The challenges associated with cochlear implant (CI)-mediated listening are well documented; however, they can be mitigated through the provision of aided acoustic hearing in the contralateral ear-a configuration termed bimodal hearing. This study extends previous literature to examine the effect of acoustic bandwidth in the non-CI ear for music perception. The primary aim was to determine the minimum and optimum acoustic bandwidth necessary to obtain bimodal benefit for music perception and speech perception. Method Participants included 12 adult bimodal listeners and 12 adult control listeners with normal hearing. Music perception was assessed via measures of timbre perception and subjective sound quality of real-world music samples. Speech perception was assessed via monosyllabic word recognition in quiet. Acoustic stimuli were presented to the non-CI ear in the following filter conditions: < 125, < 250, < 500, and < 750 Hz, and wideband (full bandwidth). Results Generally, performance for all stimuli improved with increasing acoustic bandwidth; however, the bandwidth that is both minimally and optimally beneficial may be dependent upon stimulus type. On average, music sound quality required wideband amplification, whereas speech recognition with a male talker in quiet required a narrower acoustic bandwidth (< 250 Hz) for significant benefit. Still, average speech recognition performance continued to improve with increasing bandwidth. Conclusion Further research is warranted to examine optimal acoustic bandwidth for additional stimulus types; however, these findings indicate that wideband amplification is most appropriate for speech and music perception in individuals with bimodal hearing.

Musical Emotion Perception in Bimodal Patients: Relative Weighting of Musical Mode and Tempo Cues

Several cues are used to convey musical emotion, the two primary being musical mode and musical tempo. Specifically, major and minor modes tend to be associated with positive and negative valence, respectively, and songs at fast tempi have been associated with more positive valence compared to songs at slow tempi (Balkwill and Thompson, 1999; Webster and Weir, 2005). In Experiment I, we examined the relative weighting of musical tempo and musical mode among adult cochlear implant (CI) users combining electric and contralateral acoustic stimulation, or "bimodal" hearing. Our primary hypothesis was that bimodal listeners would utilize both tempo and mode cues in their musical emotion judgments in a manner similar to normal-hearing listeners. Our secondary hypothesis was that low-frequency (LF) spectral resolution in the non-implanted ear, as quantified via psychophysical tuning curves (PTCs) at 262 and 440 Hz, would be significantly correlated with degree of bimodal benefit for musical emotion perception. In Experiment II, we investigated across-channel spectral resolution using a spectral modulation detection (SMD) task and neural representation of temporal fine structure via the frequency following response (FFR) for a 170-ms /da/ stimulus. Results indicate that CI-alone performance was driven almost exclusively by tempo cues, whereas bimodal listening demonstrated use of both tempo and mode. Additionally, bimodal benefit for musical emotion perception may be correlated with spectral resolution in the non-implanted ear via SMD, as well as neural representation of F0 amplitude via FFR - though further study with a larger sample size is warranted. Thus, contralateral acoustic hearing can offer significant benefit for musical emotion perception, and the degree of benefit may be dependent upon spectral resolution of the non-implanted ear.

Effects of Low Frequency Residual Hearing on Music Perception and Psychoacoustic Abilities in Pediatric Cochlear Implant Recipients

Studies have demonstrated the benefits of low frequency residual hearing in music perception and for psychoacoustic abilities of adult cochlear implant (CI) users, but less is known about these effects in the pediatric group. Understanding the contribution of combined electric and acoustic stimulation in this group can help to gain a better perspective on decisions regarding bilateral implantation. We evaluated the performance of six unilaterally implanted children between 9 and 13 years of age with contralateral residual hearing using the Clinical Assessment of Music Perception (CAMP), spectral ripple discrimination (SRD), and temporal modulation transfer function (TMTF) tests and compared findings with previous research. Our study sample performed similarly to normal hearing subjects in pitch direction discrimination (0.81 semitones) and performed well above typical CI users in melody recognition (43.37%). The performance difference was less in timbre recognition (48.61%), SRD (1.47 ripple/octave), and TMTF for four modulation frequencies. These findings suggest that the combination of low frequency acoustic hearing with the broader frequency range of electric hearing can help to increase clinical CI benefit in pediatric users and decisions regarding second-side implantation should consider these factors.

Limiting asymmetric hearing improves benefits of bilateral hearing in children using cochlear implants

Neurodevelopmental changes occur with asymmetric hearing loss, limiting binaural/spatial hearing and putting children at risk for social and educational challenges. These deficits may be mitigated by providing bilateral hearing in children through auditory prostheses. Effects on speech perception and spatial hearing were measured in a large cohort of >450 children who were deaf and used bilateral cochlear implants or bimodal devices (one cochlear implant and a contralateral hearing aid). Results revealed an advantage of bilateral over unilateral device use but this advantage decreased as hearing in the two ears became increasingly asymmetric. Delayed implantation of an ear with severe to profound deafness allowed asymmetric hearing, creating aural preference for the better hearing ear. These findings indicate that bilateral input with the most appropriate device for each ear should be provided early and without delay during development.

The Benefits of Residual Hair Cell Function for Speech and Music Perception in Pediatric Bimodal Cochlear Implant Listeners

Objective

The aim of this study was to investigate the benefits of residual hair cell function for speech and music perception in bimodal pediatric Mandarin-speaking cochlear implant (CI) listeners.

Design

Speech and music performance was measured in 35 Mandarin-speaking pediatric CI users for unilateral (CI-only) and bimodal listening. Mandarin speech perception was measured for vowels, consonants, lexical tones, and sentences in quiet. Music perception was measured for melodic contour identification (MCI).

Results

Combined electric and acoustic hearing significantly improved MCI and Mandarin tone recognition performance, relative to CI-only performance. For MCI, performance was significantly better with bimodal listening for all semitone spacing conditions (p < 0.05 in all cases). For tone recognition, bimodal performance was significantly better only for tone 2 (rising; p < 0.05). There were no significant differences between CI-only and CI + HA for vowel, consonant, or sentence recognition.

Conclusions

The results suggest that combined electric and acoustic hearing can significantly improve perception of music and Mandarin tones in pediatric Mandarin-speaking CI patients. Music and lexical tone perception depends strongly on pitch perception, and the contralateral acoustic hearing coming from residual hair cell function provided pitch cues that are generally not well preserved in electric hearing.

Delayed access to bilateral input alters cortical organization in children with asymmetric hearing

Bilateral hearing in early development protects auditory cortices from reorganizing to prefer the better ear. Yet, such protection could be disrupted by mismatched bilateral input in children with asymmetric hearing who require electric stimulation of the auditory nerve from a cochlear implant in their deaf ear and amplified acoustic sound from a hearing aid in their better ear (bimodal hearing). Cortical responses to bimodal stimulation were measured by electroencephalography in 34 bimodal users and 16 age-matched peers with normal hearing, and compared with the same measures previously reported for 28 age-matched bilateral implant users. Both auditory cortices increasingly favoured the better ear with delay to implanting the deaf ear; the time course mirrored that occurring with delay to bilateral implantation in unilateral implant users. Preference for the implanted ear tended to occur with ongoing implant use when hearing was poor in the non-implanted ear. Speech perception deteriorated with longer deprivation and poorer access to high-frequencies. Thus, cortical preference develops in children with asymmetric hearing but can be avoided by early provision of balanced bimodal stimulation. Although electric and acoustic stimulation differ, these inputs can work sympathetically when used bilaterally given sufficient hearing in the non-implanted ear.

Music perception improves in children with bilateral cochlear implants or bimodal devices

The objectives of this study were to determine if music perception by pediatric cochlear implant users can be improved by (1) providing access to bilateral hearing through two cochlear implants or a cochlear implant and a contralateral hearing aid (bimodal users) and (2) any history of music training. The Montreal Battery of Evaluation of Musical Ability test was presented via soundfield to 26 bilateral cochlear implant users, 8 bimodal users and 16 children with normal hearing. Response accuracy and reaction time were recorded via an iPad application. Bilateral cochlear implant and bimodal users perceived musical characteristics less accurately and more slowly than children with normal hearing. Children who had music training were faster and more accurate, regardless of their hearing status. Reaction time on specific subtests decreased with age, years of musical training and, for implant users, better residual hearing. Despite effects of these factors on reaction time, bimodal and bilateral cochlear implant users' responses were less accurate than those of their normal hearing peers. This means children using bilateral cochlear implants and bimodal devices continue to experience challenges perceiving music that are related to hearing impairment and/or device limitations during development.

Voice emotion perception and production in cochlear implant users

Voice emotion is a fundamental component of human social interaction and social development. Unfortunately, cochlear implant users are often forced to interface with highly degraded prosodic cues as a result of device constraints in extraction, processing, and transmission. As such, individuals with cochlear implants frequently demonstrate significant difficulty in recognizing voice emotions in comparison to their normal hearing counterparts. Cochlear implant-mediated perception and production of voice emotion is an important but relatively understudied area of research. However, a rich understanding of the voice emotion auditory processing offers opportunities to improve upon CI biomedical design and to develop training programs benefiting CI performance. In this review, we will address the issues, current literature, and future directions for improved voice emotion processing in cochlear implant users.