Selective tuning of cortical sound-feature processing by language experience

Improved Auditory Function Caused by Music Versus Foreign Language Training at School Age: Is There a Difference?

In adults, music and speech share many neurocognitive functions, but how do they interact in a developing brain? We compared the effects of music and foreign language training on auditory neurocognition in Chinese children aged 8–11 years. We delivered group-based training programs in music and foreign language using a randomized controlled trial. A passive control group was also included. Before and after these year-long extracurricular programs, auditory event-related potentials were recorded (n = 123 and 85 before and after the program, respectively). Through these recordings, we probed early auditory predictive brain processes.

To our surprise, the language program facilitated the children’s early auditory predictive brain processes significantly more than did the music program. This facilitation was most evident in pitch encoding when the experimental paradigm was musically relevant. When these processes were probed by a paradigm more focused on basic sound features, we found early predictive pitch encoding to be facilitated by music training.

Thus, a foreign language program is able to foster auditory and music neurocognition, at least in tonal language speakers, in a manner comparable to that by a music program. Our results support the tight coupling of musical and linguistic brain functions also in the developing brain.

Performance and Function Meet Structure: A White Matter Connection Tuned for Vocal Production

Contemporary imaging techniques have increased the potential for establishing how brain regions interact during spoken language. Some imaging methods report bilateral changes in brain activity during speech, whereas another approach finds that the relationship between individual variability in speech measures and individual variability in brain activity more closely resembles clinical observations. This approach has repeatedly demonstrated that speaking rate for phonological and lexical items can be predicted by an inverse relationship between cerebral blood flow in the left inferior frontal region and the right caudate nucleus. To determine whether morphology contributes to this relationship, we examined ipsilateral and contralateral white matter connections between these structures using diffusion tensor imaging, and we further assessed possible relationships between morphology and selected acoustic measures of participants' vocal productions. The ipsilateral connections between the inferior frontal regions and the caudate nuclei had higher average fractional anisotropy and mean diffusivity values than the contralateral connections. Neither contralateral connection between inferior frontal and caudate regions showed a significant advantage on any of the average morphology measures. However, individual differences in white matter morphology were significantly correlated with individual differences in vocal amplitude and frequency stability in the left frontal–right caudate connection. This cortical–striatal connection may be “tuned” for a role in the coordination of cortical and subcortical activity during speech. The structure–function relationship in this cortical-subcortical pathway supports the previous observation of a predictive pattern of cerebral blood flow during speech and may reflect a mechanism that ensures left-hemisphere control of the vocal expression of propositional language.

Change detection to tone pairs during the first year of life - Predictive longitudinal relationships for EEG-based source and time-frequency measures

Brain responses related to auditory processing show large changes throughout infancy and childhood with some evidence that the two hemispheres might mature at different rates. Differing rates of hemispheric maturation could be linked to the proposed functional specialization of the hemispheres in which the left auditory cortex engages in analysis of precise timing information whereas the right auditory cortex focuses on analysis of sound frequency. Here the auditory change detection process for rapidly presented tone-pairs was examined in a longitudinal sample of infants at the age of 6 and 12 months using EEG. The ERP response related to change detection of a frequency contrast, its estimated source strength in the auditory areas, as well as time-frequency indices showed developmental effects. ERP amplitudes, source strength, spectral power and inter-trial phase locking decreased across age. A differential lateralization pattern emerged between 6 and 12 months as shown by inter-trial phase locking at 2-3 Hz; specifically, a larger developmental change was observed in the right as compared to the left hemisphere. Predictive relationships for the change in source strength from 6 months to 12 months were found. Six-month predictors were source strength and phase locking values at low frequencies. The results show that the infant change detection response in rapidly presented tone pairs is mainly determined by low frequency power and phase-locking with a larger phase-locking response at 6 months predicting greater change at 12 months. The ability of the auditory system to respond systematically across stimuli is suggested as a marker of maturational change that leads to more automatic and fine-tuned cortical responses.

Maturation of Speech-Sound ERPs in 5-6-Year-Old Children: A Longitudinal Study

The maturation of 5-6-year-old children's auditory discrimination - indicated by the development of the auditory event-related-potentials (ERPs) - has not been previously studied in longitudinal settings. For the first time, we present here the results based on extensive dataset collected from 75 children. We followed the 5- to 6-year-olds for 20 months and measured their ERPs four times with the same multifeature paradigm with phonemic stimuli. The amplitude of the mismatch negativity (MMN) response increased during this time for vowel, vowel duration and frequency changes. Furthermore, the P3a component started to mature toward adult-like positivity for the vowel, intensity and frequency deviants and the late discriminative negativity (LDN) component decreased with age for vowel and intensity deviants. All the changes in the components seemed to happen during the second follow-up year, when Finnish children are taught letter symbols and other preliminary academic skills before going to school at the age of seven. Therefore, further studies are needed to clarify if these changes in the auditory discrimination are purely age-related or due to increasing linguistic knowledge of the children.

Behavioral and subcortical signatures of musical expertise in Mandarin Chinese speakers

Both musical training and native language have been shown to have experience-based plastic effects on auditory processing. However, the combined effects within individuals are unclear. Recent research suggests that musical training and tone language speaking are not clearly additive in their effects on processing of auditory features and that there may be a disconnect between perceptual and neural signatures of auditory feature processing. The literature has only recently begun to investigate the effects of musical expertise on basic auditory processing for different linguistic groups. This work provides a profile of primary auditory feature discrimination for Mandarin speaking musicians and nonmusicians. The musicians showed enhanced perceptual discrimination for both frequency and duration as well as enhanced duration discrimination in a multifeature discrimination task, compared to nonmusicians. However, there were no differences between the groups in duration processing of nonspeech sounds at a subcortical level or in subcortical frequency representation of a nonnative tone contour, for f_o or for the first or second formant region. The results indicate that musical expertise provides a cognitive, but not subcortical, advantage in a population of Mandarin speakers.

Perception of American English vowels by sequential Spanish-English bilinguals

Research on American-English (AE) vowel perception by Spanish-English bilinguals has focused on the vowels /i/-/ɪ/ (e.g., in sheep/ship). Other AE vowel contrasts may present perceptual challenges for this population, especially those requiring both spectral and durational discrimination. We used Event-Related Potentials (ERPs), MMN (Mismatch Negativity) and P300, to index discrimination of AE vowels /ɑ/-/ʌ/ by sequential adult Spanish-English bilingual listeners compared to AE monolinguals. Listening tasks were non-attended and attended, and vowels were presented with natural and neutralized durations. Regardless of vowel duration, bilingual listeners showed no MMN to unattended sounds, and P300 responses were elicited to /ɑ/ but not /ʌ/ in the attended condition. Monolingual listeners showed pre-attentive discrimination (MMN) for /ɑ/ only; while both vowels elicited P300 responses when attended. Findings suggest that Spanish-English bilinguals recruit attentional and cognitive resources enabling native-like use of both spectral and durational cues to discriminate between AE vowels /ɑ/ and /ʌ/.

Differences in phonetic discrimination stem from differences in psychoacoustic abilities in learning the sounds of a second language: Evidence from ERP research

The scientific community has been divided as to the origin of individual differences in perceiving the sounds of a second language (L2). There are two alternative explanations: a general psychoacoustic origin vs. a speech-specific one. A previous study showed that such individual variability is linked to the perceivers’ speech-specific capabilities, rather than the perceivers’ psychoacoustic abilities. However, we assume that the selection of participants and parameters of sound stimuli might not appropriate. Therefore, we adjusted the sound stimuli and recorded event-related potentials (ERPs) from two groups of early, proficient Cantonese (L1)-Mandarin (L2) bilinguals who differed in their mastery of the Mandarin (L2) phonetic contrast /in-ing/, to explore whether the individual differences in perceiving L2 stem from participants’ ability to discriminate various pure tones (frequency, duration and pattern). To precisely measure the participants’ acoustic discrimination, mismatch negativity (MMN) elicited by the oddball paradigm was recorded in the experiment. The results showed that significant differences between good perceivers (GPs) and poor perceivers (PPs) were found in the three general acoustic conditions (frequency, duration and pattern), and the MMN amplitude for GP was significantly larger than for PP. Therefore, our results support a general psychoacoustic origin of individual variability in L2 phonetic mastery.

Musical Sophistication and the Effect of Complexity on Auditory Discrimination in Finnish Speakers

Musical experiences and native language are both known to affect auditory processing. The present work aims to disentangle the influences of native language phonology and musicality on behavioral and subcortical sound feature processing in a population of musically diverse Finnish speakers as well as to investigate the specificity of enhancement from musical training. Finnish speakers are highly sensitive to duration cues since in Finnish, vowel and consonant duration determine word meaning. Using a correlational approach with a set of behavioral sound feature discrimination tasks, brainstem recordings, and a musical sophistication questionnaire, we find no evidence for an association between musical sophistication and more precise duration processing in Finnish speakers either in the auditory brainstem response or in behavioral tasks, but they do show an enhanced pitch discrimination compared to Finnish speakers with less musical experience and show greater duration modulation in a complex task. These results are consistent with a ceiling effect set for certain sound features which corresponds to the phonology of the native language, leaving an opportunity for music experience-based enhancement of sound features not explicitly encoded in the language (such as pitch, which is not explicitly encoded in Finnish). Finally, the pattern of duration modulation in more musically sophisticated Finnish speakers suggests integrated feature processing for greater efficiency in a real world musical situation. These results have implications for research into the specificity of plasticity in the auditory system as well as to the effects of interaction of specific language features with musical experiences.

Auditory discrimination predicts linguistic outcome in Italian infants with and without familial risk for language learning impairment

•

Italian infants with familial risk for LLI show deficits in RAP abilities.

•

Early multi-feature RAP skills predict to later expressive language skills.

•

Different acoustical features are critical to normative language acquisition.

•

Early RAP skills represent a stable cross-linguistic risk marker for LLI.

•

Early intervention programs should be implemented based on these results.

Infants’ ability to discriminate between auditory stimuli presented in rapid succession and differing in fundamental frequency (Rapid Auditory Processing [RAP] abilities) has been shown to be anomalous in infants at familial risk for Language Learning Impairment (LLI) and to predict later language outcomes. This study represents the first attempt to investigate RAP in Italian infants at risk for LLI (FH+), examining two critical acoustic features: frequency and duration, both embedded in a rapidly-presented acoustic environment. RAP skills of 24 FH+ and 32 control (FH−) Italian 6-month-old infants were characterized via EEG/ERP using a multi-feature oddball paradigm. Outcome measures of expressive vocabulary were collected at 20 months.

Group differences favoring FH− infants were identified: in FH+ infants, the latency of the N2* peak was delayed and the mean amplitude of the positive mismatch response was reduced, primarily for frequency discrimination and within the right hemisphere. Moreover, both EEG measures were correlated with language scores at 20 months.

Results indicate that RAP abilities are atypical in Italian infants with a first-degree relative affected by LLI and that this impacts later linguistic skills. These findings provide a compelling cross-linguistic comparison with previous research on American infants, supporting the biological unity hypothesis of LLI.

Neural measures of a Japanese consonant length discrimination by Japanese and American English listeners: Effects of attention

This study examined automaticity of discrimination of a Japanese length contrast for consonants (miʃi vs. miʃʃi) in native (Japanese) and non-native (American-English) listeners using behavioral measures and the event-related potential (ERP) mismatch negativity (MMN). Attention to the auditory input was manipulated either away from the auditory input via a visual oddball task (Visual Attend), or to the input by asking the listeners to count auditory deviants (Auditory Attend). Results showed a larger MMN when attention was focused on the consonant contrast than away from it for both groups. The MMN was larger for consonant duration increments than decrements. No difference in MMN between the language groups was observed, but the Japanese listeners did show better behavioral discrimination than the American English listeners. In addition, behavioral responses showed a weak, but significant correlation with MMN amplitude. These findings suggest that both acoustic-phonetic properties and phonological experience affects automaticity of speech processing. This article is part of a Special Issue entitled SI: Prediction and Attention.

Enhancement of brain event-related potentials to speech sounds is associated with compensated reading skills in dyslexic children with familial risk for dyslexia

Specific reading disability, dyslexia, is a prevalent and heritable disorder impairing reading acquisition characterized by a phonological deficit. However, the underlying mechanism of how the impaired phonological processing mediates resulting dyslexia or reading disabilities remains still unclear. Using ERPs we studied speech sound processing of 30 dyslexic children with familial risk for dyslexia, 51 typically reading children with familial risk for dyslexia, and 58 typically reading control children. We found enhanced brain responses to shortening of a phonemic length in pseudo-words (/at:a/ vs. /ata/) in dyslexic children with familial risk as compared to other groups. The enhanced brain responses were associated with better performance in behavioral phonemic length discrimination task, as well as with better reading and writing accuracy. Source analyses revealed that the brain responses of sub-group of dyslexic children with largest responses originated from a more posterior area of the right temporal cortex as compared to the responses of the other participants. This is the first electrophysiological evidence for a possible compensatory speech perception mechanism in dyslexia. The best readers within the dyslexic group have probably developed alternative strategies which employ compensatory mechanisms substituting their possible earlier deficit in phonological processing and might therefore be able to perform better in phonemic length discrimination and reading and writing accuracy tasks. However, we speculate that for reading fluency compensatory mechanisms are not that easily built and dyslexic children remain slow readers during their adult life.

Audiovisual presentation of video-recorded stimuli at a high frame rate

A method for creating and presenting video-recorded synchronized audiovisual stimuli at a high frame rate-which would be highly useful for psychophysical studies on, for example, just-noticeable differences and gating-is presented. Methods for accomplishing this include recording audio and video separately using an exact synchronization signal, editing the recordings and finding exact synchronization points, and presenting the synchronized audiovisual stimuli with a desired frame rate on a cathode ray tube display using MATLAB and Psychophysics Toolbox 3. The methods from an empirical gating study (Moradi, Lidestam, & Rönnberg, Frontiers in Psychology 4:359, 2013) are presented as an example of the implementation of playback at 120 fps.

Differences in sensory processing of German vowels and physically matched non-speech sounds as revealed by the mismatch negativity (MMN) of the human event-related brain potential (ERP)

We compared processing of speech and non-speech by means of the mismatch negativity (MMN). For this purpose, the MMN elicited by vowels was compared to those elicited by two non-speech stimulus types: spectrally rotated vowels, having the same stimulus complexity as the speech stimuli, and sounds based on the bands of formants of the vowels, representing non-speech stimuli of lower complexity as compared to the other stimulus types. This design allows controlling for effects of stimulus complexity when comparing neural correlates of processing speech to non-speech. Deviants within a modified multi-feature design differed either in duration or spectral property. Moreover, the difficulty to discriminate between the standard and the two deviants was controlled for each stimulus type by means of an additional active discrimination task. Vowels elicited a larger MMN compared to both non-speech stimulus types, supporting the concept of language-specific phoneme representations and the role of the participants' prior experience.

The neural basis of sublexical speech and corresponding nonspeech processing: a combined EEG-MEG study

We addressed the neural organization of speech versus nonspeech sound processing by investigating preattentive cortical auditory processing of changes in five features of a consonant-vowel syllable (consonant, vowel, sound duration, frequency, and intensity) and their acoustically matched nonspeech counterparts in a simultaneous EEG-MEG recording of mismatch negativity (MMN/MMNm). Overall, speech-sound processing was enhanced compared to nonspeech sound processing. This effect was strongest for changes which affect word meaning (consonant, vowel, and vowel duration) in the left and for the vowel identity change in the right hemisphere also. Furthermore, in the right hemisphere, speech-sound frequency and intensity changes were processed faster than their nonspeech counterparts, and there was a trend for speech-enhancement in frequency processing. In summary, the results support the proposed existence of long-term memory traces for speech sounds in the auditory cortices, and indicate at least partly distinct neural substrates for speech and nonspeech sound processing.

Pre-attentive sensitivity to vowel duration reveals native phonology and predicts learning of second-language sounds

In some languages (e.g. Czech), changes in vowel duration affect word meaning, while in others (e.g. Spanish) they do not. Yet for other languages (e.g. Dutch), the linguistic role of vowel duration remains unclear. To reveal whether Dutch represents vowel length in its phonology, we compared auditory pre-attentive duration processing in native and non-native vowels across Dutch, Czech, and Spanish. Dutch duration sensitivity patterned with Czech but was larger than Spanish in the native vowel, while it was smaller than Czech and Spanish in the non-native vowel. An interpretation of these findings suggests that in Dutch, duration is used phonemically but it might be relevant for the identity of certain native vowels only. Furthermore, the finding that Spanish listeners are more sensitive to duration in non-native than in native vowels indicates that a lack of duration differences in one's native language could be beneficial for second-language learning.

Speech and music shape the listening brain: evidence for shared domain-general mechanisms

Are there bi-directional influences between speech perception and music perception? An answer to this question is essential for understanding the extent to which the speech and music that we hear are processed by domain-general auditory processes and/or by distinct neural auditory mechanisms. This review summarizes a large body of behavioral and neuroscientific findings which suggest that the musical experience of trained musicians does modulate speech processing, and a sparser set of data, largely on pitch processing, which suggest in addition that linguistic experience, in particular learning a tone language, modulates music processing. Although research has focused mostly on music on speech effects, we argue that both directions of influence need to be studied, and conclude that the picture which thus emerges is one of mutual interaction across domains. In particular, it is not simply that experience with spoken language has some effects on music perception, and vice versa, but that because of shared domain-general subcortical and cortical networks, experiences in both domains influence behavior in both domains.

Children's brain responses to sound changes in pseudo words in a multifeature paradigm

OBJECTIVE

The multifeature mismatch negativity (MMN) paradigm has previously been used to study MMN responses to changes in tones or isolated syllables. We tested 4-12 year old children's MMNs to changes in a naturally produced pseudo word context.

METHODS

We studied preschoolers' (under the age of 7 years, N = 15, mean age 5 years 4 months) and school childrens' (over the age of 7 years, N = 15, mean age 9 years 3 months) MMNs to five types of changes (vowel duration, fundamental frequency, gap, intensity, vowel identity) in the middle syllable of a pseudo word [tɑtɑtɑ] using a multifeature paradigm.

RESULTS

Vowel duration and gap changes elicited larger frontocentral MMN responses than other change types and the vowel identity change also produced an early positive p-MMR. The presence of the MMN was also determined at the individual level, and it was found that vowel duration and gap deviants produced MMNs in most of the participants.

CONCLUSIONS

The current study shows that children's neural speech sound discrimination can be assessed in a word context in a short recording time (30 min) by using the multifeature paradigm.

SIGNIFICANCE

A paradigm which can be used to investigate the discrimination of several change types of speech-sounds in a natural context can be useful for investigating speech development and deficits.

Informal musical activities are linked to auditory discrimination and attention in 2-3-year-old children: an event-related potential study

The relation between informal musical activities at home and electrophysiological indices of neural auditory change detection was investigated in 2-3-year-old children. Auditory event-related potentials were recorded in a multi-feature paradigm that included frequency, duration, intensity, direction, gap deviants and attention-catching novel sounds. Correlations were calculated between these responses and the amount of musical activity at home (i.e. musical play by the child and parental singing) reported by the parents. A higher overall amount of informal musical activity was associated with larger P3as elicited by the gap and duration deviants, and smaller late discriminative negativity responses elicited by all deviant types. Furthermore, more musical activities were linked to smaller P3as elicited by the novel sounds, whereas more paternal singing was associated with smaller reorienting negativity responses to these sounds. These results imply heightened sensitivity to temporal acoustic changes, more mature auditory change detection, and less distractibility in children with more informal musical activities in their home environment. Our results highlight the significance of informal musical experiences in enhancing the development of highly important auditory abilities in early childhood.

Music training enhances the rapid plasticity of P3a/P3b event-related brain potentials for unattended and attended target sounds

Neurocognitive studies have shown that extensive musical training enhances P3a and P3b event-related potentials for infrequent target sounds, which reflects stronger attention switching and stimulus evaluation in musicians than in nonmusicians. However, it is unknown whether the short-term plasticity of P3a and P3b responses is also enhanced in musicians. We compared the short-term plasticity of P3a and P3b responses to infrequent target sounds in musicians and nonmusicians during auditory perceptual learning tasks. Target sounds, deviating in location, pitch, and duration with three difficulty levels, were interspersed among frequently presented standard sounds in an oddball paradigm. We found that during passive exposure to sounds, musicians had habituation of the P3a, while nonmusicians showed enhancement of the P3a between blocks. Between active tasks, P3b amplitudes for duration deviants were reduced (habituated) in musicians only, and showed a more posterior scalp topography for habituation when compared to P3bs of nonmusicians. In both groups, the P3a and P3b latencies were shortened for deviating sounds. Also, musicians were better than nonmusicians at discriminating target deviants. Regardless of musical training, better discrimination was associated with higher working memory capacity. We concluded that music training enhances short-term P3a/P3b plasticity, indicating training-induced changes in attentional skills.

Fast measurement of auditory event-related potential profiles in 2-3-year-olds

Auditory discrimination, memory, and attention-related functions were investigated in healthy 2-3-year-olds by recording event-related potentials (ERPs) to changes in five auditory features and two types of novel sounds using the fast multifeature paradigm (MFP). ERP profiles consisting of the mismatch negativity (MMN), P3a, and prominent late discriminative negativities (LDN) were obtained, for the first time, from this age group in a considerably shorter time compared to the traditional paradigms. Statistically significant responses from individual children were obtained mainly for the novel sounds. Thus, the MFP shows promise as a time-efficient paradigm for investigating central auditory functions in toddlers.

Musicians have fine-tuned neural distinction of speech syllables

One of the benefits musicians derive from their training is an increased ability to detect small differences between sounds. Here, we asked whether musicians' experience discriminating sounds on the basis of small acoustic differences confers advantages in the subcortical differentiation of closely related speech sounds (e.g., /ba/ and /ga/), distinguishable only by their harmonic spectra (i.e., their second formant trajectories). Although the second formant is particularly important for distinguishing stop consonants, auditory brainstem neurons do not phase-lock to its frequency range (above 1000 Hz). Instead, brainstem neurons convert this high-frequency content into neural response timing differences. As such, speech tokens with higher formant frequencies elicit earlier brainstem responses than those with lower formant frequencies. By measuring the degree to which subcortical response timing differs to the speech syllables /ba/, /da/, and /ga/ in adult musicians and nonmusicians, we reveal that musicians demonstrate enhanced subcortical discrimination of closely related speech sounds. Furthermore, the extent of subcortical consonant discrimination correlates with speech-in-noise perception. Taken together, these findings show a musician enhancement for the neural processing of speech and reveal a biological mechanism contributing to musicians' enhanced speech perception in noise.

Linguistic multifeature MMN paradigm for extensive recording of auditory discrimination profiles

We studied whether a multifeature mismatch negativity (MMN) paradigm using naturally produced speech stimuli is feasible for studies of auditory discrimination accuracy of adult participants. A naturally produced trisyllabic pseudoword was used in the paradigm, and MMNs were recorded to changes that were acoustic (changes in fundamental frequency or intensity) or potentially phonological (changes in vowel identity or vowel duration). All the different changes were presented in three different word segments (initial, middle, or final syllable). All changes elicited an MMN response, but the vowel duration change elicited a different response pattern than the other deviant types. Changes in vowel duration and identity also had an effect on MMN lateralization. Our results show that assessing speech sound discrimination of several features in word context is possible in a short recording time (30 min) with the multifeature paradigm.

Music and Speech Listening Enhance the Recovery of Early Sensory Processing after Stroke

Our surrounding auditory environment has a dramatic influence on the development of basic auditory and cognitive skills, but little is known about how it influences the recovery of these skills after neural damage. Here, we studied the long-term effects of daily music and speech listening on auditory sensory memory after middle cerebral artery (MCA) stroke. In the acute recovery phase, 60 patients who had middle cerebral artery stroke were randomly assigned to a music listening group, an audio book listening group, or a control group. Auditory sensory memory, as indexed by the magnetic MMN (MMNm) response to changes in sound frequency and duration, was measured 1 week (baseline), 3 months, and 6 months after the stroke with whole-head magnetoencephalography recordings. Fifty-four patients completed the study. Results showed that the amplitude of the frequency MMNm increased significantly more in both music and audio book groups than in the control group during the 6-month poststroke period. In contrast, the duration MMNm amplitude increased more in the audio book group than in the other groups. Moreover, changes in the frequency MMNm amplitude correlated significantly with the behavioral improvement of verbal memory and focused attention induced by music listening. These findings demonstrate that merely listening to music and speech after neural damage can induce long-term plastic changes in early sensory processing, which, in turn, may facilitate the recovery of higher cognitive functions. The neural mechanisms potentially underlying this effect are discussed.

Categorical perception of lexical tones in Chinese revealed by mismatch negativity

The present study investigated the neurophysiological correlates of categorical perception of Chinese lexical tones in Mandarin Chinese. Relative to standard stimuli, both within- and across-category deviants elicited mismatch negativity (MMN) in bilateral frontal-central recording sites. The MMN elicited in the right sites was marginally larger than in the left sites, which reflects the role of the right hemisphere in acoustic processing. At the same time, relative to within-category deviants, the across-category deviants elicited larger MMN in the left recording sites, reflecting the long-term phonemic traces of lexical tones. These results provide strong neurophysiological evidence in support of categorical perception of lexical tones in Chinese. More important, they demonstrate that acoustic and phonological information is processed in parallel within the MMN time window for the perception of lexical tones. Finally, homologous nonspeech stimuli elicited similar MMN patterns, indicating that lexical tone knowledge influences the perception of nonspeech signals.

Sensory processing of linguistic pitch as reflected by the mismatch negativity

OBJECTIVE

To assess the extent to which acoustic and phonetic change-detection processes contribute to the mismatch negativity (MMN) to linguistic pitch contours.

DESIGN

MMN was elicited from Mandarin and English speakers using a passive oddball paradigm. Two oddball conditions were constructed. In one condition (T1/T2i), the Mandarin high-level tone (T1) was compared with a convex high-rising tone (inverted T2, henceforth referred to as T2i) that occurs as a contextual variant of T1 in running speech. In the other (T2/T2i), the concave high-rising tone (T2) was compared with T2i. Phonetically, T1/T2i represents a within-category contrast for native speakers, whereas T2/T2i represents a between-category contrast. The between-category pair (T2/T2i), however, is more similar acoustically than the within-category pair (T1/T2i). In an attention-demanding behavioral paradigm, the same speakers also performed an auditory discrimination task to determine the perceptual distinctiveness of the two tonal pairs.

RESULTS

Results revealed that the Chinese group, relative to the English, showed larger MMN responses and earlier peak latencies for both conditions, indicating experience-dependent enhancement in representing linguistically relevant pitch contours. At attentive stages of processing, however, the Chinese group was less accurate than the English in discriminating the within-category contrast (T1-T2i).

CONCLUSIONS

These findings demonstrate that experience-dependent neural effects at early preattentive stages of processing may be driven primarily by acoustic features of pitch contours that occur in natural speech. At attentive stages of processing, perception is strongly influenced by tonal categories and their relations to one another. The MMN is a useful index for examining long-term plasticity to linguistically relevant acoustic features.

Top-down modulation of auditory processing: effects of sound context, musical expertise and attentional focus

By recording auditory electrical brain potentials, we investigated whether the basic sound parameters (frequency, duration and intensity) are differentially encoded among speech vs. music sounds by musicians and non-musicians during different attentional demands. To this end, a pseudoword and an instrumental sound of comparable frequency and duration were presented. The accuracy of neural discrimination was tested by manipulations of frequency, duration and intensity. Additionally, the subjects' attentional focus was manipulated by instructions to ignore the sounds while watching a silent movie or to attentively discriminate the different sounds. In both musicians and non-musicians, the pre-attentively evoked mismatch negativity (MMN) component was larger to slight changes in music than in speech sounds. The MMN was also larger to intensity changes in music sounds and to duration changes in speech sounds. During attentional listening, all subjects more readily discriminated changes among speech sounds than among music sounds as indexed by the N2b response strength. Furthermore, during attentional listening, musicians displayed larger MMN and N2b than non-musicians for both music and speech sounds. Taken together, the data indicate that the discriminative abilities in human audition differ between music and speech sounds as a function of the sound-change context and the subjective familiarity of the sound parameters. These findings provide clear evidence for top-down modulatory effects in audition. In other words, the processing of sounds is realized by a dynamically adapting network considering type of sound, expertise and attentional demands, rather than by a strictly modularly organized stimulus-driven system.

The role of musical aptitude and language skills in preattentive duration processing in school-aged children

We examined 10-12-year old elementary school children's ability to preattentively process sound durations in music and speech stimuli. In total, 40 children had either advanced foreign language production skills and higher musical aptitude or less advanced results in both musicality and linguistic tests. Event-related potential (ERP) recordings of the mismatch negativity (MMN) show that the duration changes in musical sounds are more prominently and accurately processed than changes in speech sounds. Moreover, children with advanced pronunciation and musicality skills displayed enhanced MMNs to duration changes in both speech and musical sounds. Thus, our study provides further evidence for the claim that musical aptitude and linguistic skills are interconnected and the musical features of the stimuli could have a preponderant role in preattentive duration processing.

Plasticity in the adult human auditory brainstem following short-term linguistic training

Peripheral and central structures along the auditory pathway contribute to speech processing and learning. However, because speech requires the use of functionally and acoustically complex sounds which necessitates high sensory and cognitive demands, long-term exposure and experience using these sounds is often attributed to the neocortex with little emphasis placed on subcortical structures. The present study examines changes in the auditory brainstem, specifically the frequency following response (FFR), as native English-speaking adults learn to incorporate foreign speech sounds (lexical pitch patterns) in word identification. The FFR presumably originates from the auditory midbrain and can be elicited preattentively. We measured FFRs to the trained pitch patterns before and after training. Measures of pitch tracking were then derived from the FFR signals. We found increased accuracy in pitch tracking after training, including a decrease in the number of pitch-tracking errors and a refinement in the energy devoted to encoding pitch. Most interestingly, this change in pitch-tracking accuracy only occurred in the most acoustically complex pitch contour (dipping contour), which is also the least familiar to our English-speaking subjects. These results not only demonstrate the contribution of the brainstem in language learning and its plasticity in adulthood but also demonstrate the specificity of this contribution (i.e., changes in encoding only occur in specific, least familiar stimuli, not all stimuli). Our findings complement existing data showing cortical changes after second-language learning, and are consistent with models suggesting that brainstem changes resulting from perceptual learning are most apparent when acuity in encoding is most needed.

Musical training influences linguistic abilities in 8-year-old children: more evidence for brain plasticity

We conducted a longitudinal study with 32 nonmusician children over 9 months to determine 1) whether functional differences between musician and nonmusician children reflect specific predispositions for music or result from musical training and 2) whether musical training improves nonmusical brain functions such as reading and linguistic pitch processing. Event-related brain potentials were recorded while 8-year-old children performed tasks designed to test the hypothesis that musical training improves pitch processing not only in music but also in speech. Following the first testing sessions nonmusician children were pseudorandomly assigned to music or to painting training for 6 months and were tested again after training using the same tests. After musical (but not painting) training, children showed enhanced reading and pitch discrimination abilities in speech. Remarkably, 6 months of musical training thus suffices to significantly improve behavior and to influence the development of neural processes as reflected in specific pattern of brain waves. These results reveal positive transfer from music to speech and highlight the influence of musical training. Finally, they demonstrate brain plasticity in showing that relatively short periods of training have strong consequences on the functional organization of the children's brain.

Parameter-specific modulation of the mismatch negativity to duration decrement and increment: evidence for asymmetric processes

OBJECTIVE

The mismatch negativity (MMN) component of event-related potentials (ERPs) reflects a change-detection process in the brain. The present study investigated whether stimulus parameters (sound type and duration) exert a differential influence on the MMN for a duration decrement and increment of an equal magnitude. Some asymmetries were reported in the previous studies; yet no systematical study has been conducted.

METHODS

ERPs were recorded from 16 healthy adults presented with repetitive standard sounds interspersed with duration changes (deviant sounds). In separate sequences, stimuli were vowels, music chord, sinusoid, or band-pass filtered white noise. The stimulus durations (standard/deviant) were either 200/120 ms or 400/240 ms for decrements, and vice versa for increments.

RESULTS

The MMN for the increments was abolished in the 400/240 ms condition, whereas the MMN for decrements was significant irrespective of the sound duration. The amplitude of the increment MMN paralleled with the spectral complexity of the stimulus sound, whereas that of the decrement MMN was larger for natural sounds than artificial sounds.

CONCLUSIONS

The observed interactions demonstrated asymmetries in the MMN for duration increment and decrement.

SIGNIFICANCE

The present findings suggest that the effects of stimulus parameters should be taken into account when comparing different studies, especially where clinical populations are involved, with one another.

Experience-dependent neural plasticity is sensitive to shape of pitch contours

Language experience is known to modulate the preattentive processing of linguistically relevant pitch contours when presented in the speech domain. To assess if experience-dependent effects are specific to speech, we evaluated the mismatch negativity response to nonspeech homologs (iterated rippled noise) of such curvilinear pitch contours (Mandarin: Tone 1, 'high level'; Tone 2, 'high rising') by Chinese and English listeners as well as to a pitch contour that was a linear approximation of Tone 2 ('linear ascending ramp'). Mandarin speakers showed larger mismatch negativity responses than English to the curvilinear pitch contours only. These results suggest that experience-dependent neural plasticity in early cortical processing of linguistically relevant pitch contours is sensitive to naturally occurring pitch dimensions but not specific to speech per se.

The mismatch negativity (MMN) in basic research of central auditory processing: a review

In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.

Mismatch negativity to pitch contours is influenced by language experience

A cross-language study utilizing the mismatch negativity (MMN) evoked response was conducted to explore the influence of language experience on the preattentive cortical processing of linguistically relevant pitch contours. Chinese and English subjects were presented with Mandarin Chinese tones while the mismatch negativity (MMN) response was elicited using a passive oddball paradigm. Two oddball conditions were constructed with a common deviant, a low falling rising contour tone (T3). One condition consisted of two tones that are acoustically similar to one another (T2/T3: T2, high rising contour=standard). The other condition consisted of two tones that are acoustically dissimilar to one another (T1/T3: T1, high level=standard). These tonal pairs enabled us to assess whether different degrees of similarity between pitch movements exert a differential influence on preattentive pitch processing. Results showed that the mean MMN amplitude of the Chinese group was larger than that of the English group for the T1/T3 condition. No group differences were found for the T2/T3 condition. The mean MMN amplitude was larger for the T1/T3 relative to the T2/T3 condition for the Chinese group only. By virtue of these language group differences, we infer that early cortical processing of pitch contours may be shaped by the relative saliency of acoustic dimensions underlying the pitch patterns of a particular language.

Sound processing in amateur musicians and nonmusicians: event-related potential and behavioral indices

To increase our understanding of auditory neurocognition in musicians, we compared nonmusicians with amateur band musicians in their neural and behavioral sound encoding accuracy. Mismatch negativity and P3a components of the auditory event-related potentials were recorded to changes in basic acoustic features (frequency, duration, location, intensity, gap) and abstract features (melodic contour and interval size). Mismatch negativity was larger in musicians than in nonmusicians for location changes whereas no statistically significant group difference was observed in response to other feature changes or in abstract-feature mismatch negativity. P3a was observed only in musicians in response to location changes. This suggests that when compared with nonmusicians, even amateur musicians have neural sound processing advantages with acoustic information most essential to their musical genre.