The music perception abilities of prelingually deaf children with cochlear implants

Evaluation of musical emotion perception and language development in children with cochlear implants

OBJECTIVES

While the primary purpose of cochlear implant (CI) fitting is to improve individuals' receptive and expressive skills, musical emotion perception (MEP) is generally ignored. This study assesses the MEP and language skills (LS) of children using CI.

METHODS

26 CI users and 26 matched healthy controls between the ages of 6 and 9 were included in the study. The Test of Language Development (TOLD) was applied to evaluate the LS of the participants, and the Montreal Emotion Identification Test (MEI) was applied to evaluate the MEP.

RESULTS

MEI test scores and all subtests of TOLD were statistically significantly lower in the CI group. Also, there was a statistically significant and moderate correlation between the listening subtest of TOLD and the MEI test.

CONCLUSIONS

MEP and language skills are poor in children with CI. Although language skills are primarily targeted in CI performance, improving MEP should also be included in rehabilitation programs. The relationship between music and the TOLD's listening subtest may provide evidence that listening skills can be improved by paying attention to the MEP, which is frequently ignored in rehabilitation programs.

Development and validation of BATUTA: a test to evaluate the musical perception of people with hearing impairment

PURPOSE

To describe the development and validation of a test, called BATUTA, that assesses the musical perception of people with hearing impairment that are hearing aid (HA) users. BATUTA is a computerized test with 35 subtests, divided into the rhythm, pitch, and timbre modules, and the participants must answer whether the sound samples and/or parts of the songs, presented in pairs, are the same or not.

METHODS

The BATUTA creation process consisted of four stages: test development, submission to the expert committee for content validation; pilot application with 51 normal hearing participants and retest to validate reliability. The process was based on several recommendations for the development and validation of musical assessment instruments. A deep investigation of the guidelines related to sound samples used, musical attributes evaluated, testing environment and the most appropriate response method was undertaken to ensure dependability.

RESULTS

The Content Validity Index (CVI) and expert agreement rates, when analyzed with the committee's recommendations, resulted in corrections and new audio recordings to ensure compliance to the test. The pilot test scores indicated internal consistency and the retest confirmed the reliability of BATUTA.

CONCLUSION

The results demonstrated the viability of BATUTA to assess the musical perception of people with hearing impairment that are HA users.

Vocal singing skills by cochlear implanted children without formal musical training: Familiar versus unfamiliar songs

OBJECTIVES

Vocal singing skills in pediatric CI users are not much known due to the limited number of studies. The principal aim of the present study was to evaluate vocal singing skills in Italian pediatric CI users. A further aim was to investigate factors that may significantly influence their performance.

METHODS

The participants were twenty-two implanted children and twenty-two hearing peers. Their vocal singing skills for familiar ("Happy Birthday to You") and unfamiliar songs ("Baton Twirler" from Pam Pam 2- Tribute to Gordon) were evaluated in relation to their music perception (the Gordon test). Acoustic analysis was performed using Praat and MATLAB software. Nonparametric statistical tests and principal component analysis (PCA) were used to analyze the data.

RESULTS

Hearing children outperformed implanted peers in both music perception and vocal singing tasks (all measures regarding intonation, vocal range, melody, and memory for the familiar song versus measures regarding intonation and overall melody production for the unfamiliar song). Music perception and vocal singing performances revealed strong correlations. For the familiar and unfamiliar songs, age-appropriate vocal singing was observed in 27.3% versus 45.4% of children, all implanted within 24 months of age. Age at implantation and duration of CI experience were moderately correlated with the total score obtained from the Gordon test.

CONCLUSION

Implanted children show limited vocal singing skills in comparison to their hearing peers. However, some children implanted within 24 months of age seem to achieve vocal singing skills as good as their hearing peers. Future research could be useful to better understand the role of brain plasticity to implement specific training programs for both music perception and vocal singing.

Rhythm Perception, Speaking Rate Entrainment, and Conversational Quality: A Mediated Model

PURPOSE

Acoustic-prosodic entrainment, defined as the tendency for individuals to modify their speech behaviors to more closely align with the behaviors of their conversation partner, plays an important role in successful interaction. From a mechanistic perspective, acoustic-prosodic entrainment is, by its very nature, a rhythmic activity. Accordingly, it is highly plausible that an individual's rhythm perception abilities play a role in their ability to successfully entrain. Here, we examine the impact of rhythm perception in speaking rate entrainment and subsequent conversational quality.

METHOD

A round-robin paradigm was used to collect 90 dialogues from neurotypical adults. Additional assessments determined participants' rhythm perception abilities, social competence, and partner familiarity (i.e., whether the conversation partners knew each other prior to the interaction. Mediation analysis was used to examine the relationships between rhythm perception scores, speaking rate entrainment (using a measure of static local synchrony), and a measure of conversational success (i.e., conversational quality) based on third-party listener observations. Findings were compared to the same analysis with three additional predictive factors: participant gender, partner familiarity, and social competence.

RESULTS

Results revealed a relationship between rhythm perception and speaking rate entrainment. In unfamiliar conversation partners, there was a relationship between speaking rate entrainment and conversational quality. The relationships between entrainment and each of the three additional factors (i.e., gender, partner familiarity, and social competence) were nonsignificant.

CONCLUSIONS

In unfamiliar conversation partners, better rhythm perception abilities were indicative of increased conversational quality mediated by higher levels of speaking rate entrainment. These results support theoretical postulations specifying rhythm perception abilities as a component of acoustic-prosodic entrainment, which, in turn, facilitates conversational success. Knowledge of this relationship contributes to the development of a causal framework for considering a mechanism by which rhythm perception deficits in clinical populations may impact conversational success.

Musical Perception Assessment of People With Hearing Impairment: A Systematic Review and Meta-Analysis

Purpose People with hearing impairment (HI) face numerous challenges that can be minimized with the use of hearing aids and cochlear implants. Despite technological advances in these assistive hearing devices, musical perception remains difficult for these people. Tests and protocols developed to assess the musical perception of this audience were the target of this systematic review, whose objective was to investigate how assessments of musical perception in people with HI are carried out. Method Searches for primary articles were carried out in the PubMed/MEDLINE, Scopus, Web of Science, Latin American and Caribbean Health Sciences Literature, and ASHAWire databases. Search results were managed using EndNote X9 software, and analysis was performed according to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) Statement. Results The 16 cross-sectional included studies analyzed music perception data from people with HI compared to a control group of participants with normal hearing. Among these, four studies were selected to be included in a meta-analysis, performed with timbre and melody. Variability was observed in the tests and between the levels of auditory perception skills analyzed in relation to the components of music. With respect to the tests, sound stimuli generated by synthesizers were the most used stimuli; with the exception of timbre evaluation, the most frequent test environment was a booth with sound attenuation, and the average intensity for presenting sound stimuli was 70 dB SPL. The most evaluated sound component was pitch, followed by rhythm and timbre, with a pattern of responses based on adaptive and psychoacoustic methods. Conclusions The heterogeneity of the musical parameters and the auditory abilities evaluated by the tests is a fact that can compromise evidence found in this area of study. It is worth considering the quality of samples that were recorded with real musical instruments and digitized afterward, in comparison with synthesized samples that do not seem to accurately represent real instruments. The need to minimize semantic parallelism that involves the auditory skills and elements of music involved in the assessment of musical perception is highlighted.

Assessment of music experience after cochlear implantation: A review of current tools and their utilization

Objective

To provide an overview of the current available music assessment tools after cochlear implantation (CI); to report on the utilization of music assessments in the literature; to propose potential future directions in music assessment after CI.

Methods

A thorough search was performed in PubMed, Embase, and The Cochrane Library through October 31, 2020. MeSH search terms, keywords, and phrases included “cochlear implant,” “cochlear prosthesis,” “auditory prosthesis,” “music,” “music assessment,” “music questionnaire,” “music perception,” “music enjoyment, and “music experience.” Potentially relevant studies were reviewed for inclusion, with particular focus on assessments developed specifically for the cochlear implant population and intended for widespread use.

Results/conclusions

Six hundred and forty-three studies were screened for relevance to assessment of music experience among cochlear implantees. Eighty-one studies ultimately met criteria for inclusion. There are multiple validated tools for assessment of music experience after cochlear implantation, each of which provide slightly differing insights into the patients’ subjective and/or objective post-activation experience. However, no single assessment tool has been adopted into widespread use and thus, much of the literature pertaining to this topic evaluates outcomes non-uniformly, including single-use assessments designed specifically for the study at hand. The lack of a widely accepted universal tool for assessment of music limits our collective understanding the contributory and mitigating factors applicable to current music experience of cochlear implantees, and limits our ability to uniformly evaluate the success of new implant technologies or music training paradigms.

Action planning and affective states within the auditory peripersonal space in normal hearing and cochlear-implanted listeners

Fast reaction to approaching stimuli is vital for survival. When sounds enter the auditory peripersonal space (PPS), sounds perceived as being nearer elicit higher motor cortex activation. There is a close relationship between motor preparation and the perceptual components of sounds, particularly of highly arousing sounds. Here we compared the ability to recognize, evaluate, and react to affective stimuli entering the PPS between 20 normal-hearing (NH, 7 women) and 10 cochlear-implanted (CI, 3 women) subjects. The subjects were asked to quickly flex their arm in reaction to positive (P), negative (N), and neutral (Nu) affective sounds ending virtually at five distances from their body. Pre-motor reaction time (pm-RT) was detected via electromyography from the postural muscles to measure action anticipation at the sound-stopping distance; the sounds were also evaluated for their perceived level of valence and arousal. While both groups were able to localize sound distance, only the NH group modulated their pm-RT based on the perceived sound distance. Furthermore, when the sound carried no affective components, the pm-RT to the Nu sounds was shorter compared to the P and the N sounds for both groups. Only the NH group perceived the closer sounds as more arousing than the distant sounds, whereas both groups perceived sound valence similarly. Our findings underline the role of emotional states in action preparation and describe the perceptual components essential for prompt reaction to sounds approaching the peripersonal space.

Rhythmic Abilities of Children With Hearing Loss

OBJECTIVES

Children with hearing loss (HL), in spite of early cochlear implantation, often struggle considerably with language acquisition. Previous research has shown a benefit of rhythmic training on linguistic skills in children with HL, suggesting that improving rhythmic capacities could help attenuating language difficulties. However, little is known about general rhythmic skills of children with HL and how they relate to speech perception. The aim of this study is twofold: (1) to assess the abilities of children with HL in different rhythmic sensorimotor synchronization tasks compared to a normal-hearing control group and (2) to investigate a possible relation between sensorimotor synchronization abilities and speech perception abilities in children with HL.

DESIGN

A battery of sensorimotor synchronization tests with stimuli of varying acoustic and temporal complexity was used: a metronome, different musical excerpts, and complex rhythmic patterns. Synchronization abilities were assessed in 32 children (aged from 5 to 10 years) with a severe to profound HL mainly fitted with one or two cochlear implants (n = 28) or with hearing aids (n = 4). Working memory and sentence repetition abilities were also assessed. Performance was compared to an age-matched control group of 24 children with normal hearing. The comparison took into account variability in working memory capacities. For children with HL only, we computed linear regressions on speech, sensorimotor synchronization, and working memory abilities, including device-related variables such as onset of device use, type of device, and duration of use.

RESULTS

Compared to the normal-hearing group, children with HL performed poorly in all sensorimotor synchronization tasks, but the effect size was greater for complex as compared to simple stimuli. Group differences in working memory did not explain this result. Linear regression analysis revealed that working memory, synchronization to complex rhythms performances, age, and duration of device use predicted the number of correct syllables produced in a sentence repetition task.

CONCLUSION

Despite early cochlear implantation or hearing aid use, hearing impairment affects the quality of temporal processing of acoustic stimuli in congenitally deaf children. This deficit seems to be more severe with stimuli of increasing rhythmic complexity highlighting a difficulty in structuring sounds according to a temporal hierarchy.

Beyond Technology: The Interaction of Perceptual Accuracy and Experiential Factors in Pediatric Music Engagement

BACKGROUND

Music engagement (the active making of music, e.g., music lessons and ensembles) is a common part of educational and community experiences. Music making typically involves listening to and production of rapidly changing combinations of pitch, timbre, and rhythm, which can be challenging for cochlear implant (CI) recipients, given that pitch and timbre are poorly conveyed through the CI. Pediatric CI users have variable patterns of music engagement, but some have achieved, sustained participation despite the degraded CI signal. What factors contribute to their persistence in these demanding listening situations? Our study examined a cohort of pediatric CI recipients from our center to better understand those perceptual and experiential factors most influential in relation to music engagement.

METHOD

Regressions and correlations were run for measures of pitch and speech perception, hearing history, familial involvement in music, personal importance of music, and extent of music engagement (years in music lessons; general involvement in music).

RESULTS

Pitch ranking accuracy was a significant predictor of sustained participation in music lessons (p = 0.0019), and sustained involvement in music (p = 0.0038), as well as performance on CNC words (p = -0.0060) and phonemes (p = -0.0174). Extent of familial involvement in music at the time of testing was significantly predictive of the user's musical engagement (p = 0.0007). Personal importance of music was not predicted by or significantly correlated with, any of the variables investigated.

CONCLUSION

Better pitch perception was associated with sustained involvement in music lessons as well as better speech perception. However, familial involvement in music was of greater impact for sustained music engagement. Judicious choice of musical instrument also influenced persistence. The positive impact of familial involvement indicates that perceptual limitations associated with CI processing do not present insurmountable barriers to music engagement. Because music engagement provides normalizing social involvement and challenging auditory practice, the impact of parental involvement has implications for counseling parents of CI users.

Harmony Perception in Prelingually Deaf, Juvenile Cochlear Implant Users

Prelingually deaf children listening through cochlear implants (CIs) face severe limitations on their experience of music, since the hearing device degrades relevant details of the acoustic input. An important parameter of music is harmony, which conveys emotional as well as syntactic information. The present study addresses musical harmony in three psychoacoustic experiments in young, prelingually deaf CI listeners and normal-hearing (NH) peers. The discrimination and preference of typical musical chords were studied, as well as cadence sequences conveying musical syntax. The ability to discriminate chords depended on the hearing age of the CI listeners, and was less accurate than for the NH peers. The groups did not differ with respect to the preference of certain chord types. NH listeners were able to categorize cadences, and performance improved with age at testing. In contrast, CI listeners were largely unable to categorize cadences. This dissociation is in accordance with data found in postlingually deafened adults. Consequently, while musical harmony is available to a limited degree to CI listeners, they are unable to use harmony to interpret musical syntax.

Musical and vocal emotion perception for cochlear implants users

Cochlear implants can successfully restore hearing in profoundly deaf individuals and enable speech comprehension. However, the acoustic signal provided is severely degraded and, as a result, many important acoustic cues for perceiving emotion in voices and music are unavailable. The deficit of cochlear implant users in auditory emotion processing has been clearly established. Yet, the extent to which this deficit and the specific cues that remain available to cochlear implant users are unknown due to several confounding factors. Here we assessed the recognition of the most basic forms of auditory emotion and aimed to identify which acoustic cues are most relevant to recognize emotions through cochlear implants. To do so, we used stimuli that allowed vocal and musical auditory emotions to be comparatively assessed while controlling for confounding factors. These stimuli were used to evaluate emotion perception in cochlear implant users (Experiment 1) and to investigate emotion perception in natural versus cochlear implant hearing in the same participants with a validated cochlear implant simulation approach (Experiment 2). Our results showed that vocal and musical fear was not accurately recognized by cochlear implant users. Interestingly, both experiments found that timbral acoustic cues (energy and roughness) correlate with participant ratings for both vocal and musical emotion bursts in the cochlear implant simulation condition. This suggests that specific attention should be given to these cues in the design of cochlear implant processors and rehabilitation protocols (especially energy, and roughness). For instance, music-based interventions focused on timbre could improve emotion perception and regulation, and thus improve social functioning, in children with cochlear implants during development.

Neural Processing of Musical and Vocal Emotions Through Cochlear Implants Simulation

Cochlear implants (CIs) partially restore the sense of hearing in the deaf. However, the ability to recognize emotions in speech and music is reduced due to the implant's electrical signal limitations and the patient's altered neural pathways. Electrophysiological correlations of these limitations are not yet well established. Here we aimed to characterize the effect of CIs on auditory emotion processing and, for the first time, directly compare vocal and musical emotion processing through a CI-simulator. We recorded 16 normal hearing participants' electroencephalographic activity while listening to vocal and musical emotional bursts in their original form and in a degraded (CI-simulated) condition. We found prolonged P50 latency and reduced N100-P200 complex amplitude in the CI-simulated condition. This points to a limitation in encoding sound signals processed through CI simulation. When comparing the processing of vocal and musical bursts, we found a delay in latency with the musical bursts compared to the vocal bursts in both conditions (original and CI-simulated). This suggests that despite the cochlear implants' limitations, the auditory cortex can distinguish between vocal and musical stimuli. In addition, it adds to the literature supporting the complexity of musical emotion. Replicating this study with actual CI users might lead to characterizing emotional processing in CI users and could ultimately help develop optimal rehabilitation programs or device processing strategies to improve CI users' quality of life.

Boosting syntax training with temporally regular musical primes in children with cochlear implants

OBJECTIVES

Previous research has suggested the use of rhythmic structures (implemented in musical material) to improve linguistic structure processing (i.e., syntax processing), in particular for populations showing deficits in syntax and temporal processing (e.g., children with developmental language disorders). The present study proposes a long-term training program to improve syntax processing in children with cochlear implants, a population showing syntax processing deficits in perception and production.

METHODS

The training program consisted of morphosyntactic training exercises (based on speech processing) that were primed by musical regular primes (8 sessions) or neutral baseline primes (environmental sounds) (8 sessions). A crossover design was used to train 10 deaf children with cochlear implants. Performance in grammatical processing, non-word repetition, attention and memory was assessed before and after training.

RESULTS

Training increased performance for syntax comprehension after both prime types but for grammaticality judgements and non-word repetition only when musical primes were used during training. For the far-transfer tests, some effects were also observed for attention tasks, especially if fast and precise sequential analysis (sequencing) was required, but not for memory tasks.

CONCLUSIONS

The findings extend the previously observed beneficial short-term effects of regular musical primes in the laboratory to long-term training effects. Results suggest that the musical primes improved the processing of the syntactic training material, thus enhancing the training effects on grammatical processing as well as phonological processing and sequencing of speech signals. The findings can be interpreted within the dynamic attending theory (postulating the modulation of attention over time) and associated oscillatory brain activity. Furthermore, the findings encourage the use of rhythmic structures (even in non-verbal materials) in language training programs and outline perspectives for rehabilitation.

Emotional Perception of Music in Children With Bimodal Fitting and Unilateral Cochlear Implant

OBJECTIVE

Biological, structural, and acoustical constraints faced by cochlear implant (CI) users can alter the perception of music. Bimodal fitting not only provides bilateral hearing but can also improve auditory skills. This study was conducted to assess the impact of this amplification style on the emotional perception of music among children with hearing loss (HL).

METHODS

Twenty-five children with congenital severe to profound HL and unilateral CIs, 20 children with bimodal fitting, and 30 children with normal hearing participated in this study. Their emotional perceptions of music were measured using a method where children indicated happy or sad feelings induced by music by pointing to pictures of faces showing these emotions.

RESULTS

Children with bimodal fitting obtained significantly higher mean scores than children with unilateral CIs for both happy and sad music items and in overall test scores (P < .001). Both groups with HL obtained significantly lower scores than children with normal hearing (P < .001).

CONCLUSIONS

Bimodal fitting results in a better emotional perception of music compared to unilateral CI. Given the influence of music in neurological and linguistic development and social interactions, it is important to evaluate the possible benefits of bimodal fitting prescriptions for individuals with unilateral CIs.