Brain lateralization for mismatch response to across- and within-category change of vowels

Categorical Perception of Chinese Lexical Tones by Late Second Language Learners With High Proficiency: Behavioral and Electrophysiological Measures

PURPOSE

Although acquisition of Chinese lexical tones by second language (L2) learners has been intensively investigated, very few studies focused on categorical perception (CP) of lexical tones by highly proficient L2 learners. This study was designed to address this issue with behavioral and electrophysiological measures.

METHOD

Behavioral identification and auditory event-related potential (ERP) components for speech discrimination, including mismatch negativity (MMN), N2b, and P3b, were measured in 23 native Korean speakers who were highly proficient late L2 learners of Chinese. For the ERP measures, both passive and active listening tasks were administered to examine the automatic and attention-controlled discriminative responses to within- and across-category differences for carefully chosen stimuli from a lexical tone continuum.

RESULTS

The behavioral task revealed native-like identification function of the tonal continuum. Correspondingly, the active oddball task demonstrated larger P3b amplitudes for the across-category than within-category deviants in the left recording site, indicating clear CP of lexical tones in the attentive condition. By contrast, similar MMN responses in the right recording site were elicited by both the across- and within-category deviants, indicating the absence of CP effect with automatic phonological processing of lexical tones at the pre-attentive stage even in L2 learners with high Chinese proficiency.

CONCLUSION

Although behavioral data showed clear evidence of categorical perception of lexical tones in proficient L2 learners, ERP measures from passive and active listening tasks demonstrated fine-grained sensitivity in terms of response polarity, latency, and laterality in revealing different aspects of auditory versus linguistic processing associated with speech decoding by means of largely implicit native language acquisition versus effortful explicit L2 learning.

The Role of Surface and Underlying Forms When Processing Tonal Alternations in Mandarin Chinese: A Mismatch Negativity Study

Phonological alternation (sound change depending on the phonological environment) poses challenges to spoken word recognition models. Mandarin Chinese T3 sandhi is such a phenomenon in which a tone 3 (T3) changes into a tone 2 (T2) when followed by another T3. In a mismatch negativity (MMN) study examining Mandarin Chinese T3 sandhi, participants passively listened to either a T2 word [tʂu2 je4] /tʂu2 je4/, a T3 word [tʂu3 je4] /tʂu3 je4/, a sandhi word [tʂu2 jen3] /tʂu3 jen3/, or a mix of T3 and sandhi word standards. The deviant in each condition was a T2 word [tʂu2]. Results showed an MMN only in the T2 and T3 conditions but not in the Sandhi or Mix conditions. All conditions also yielded omission MMNs. This pattern cannot be explained based on the surface forms of standards and deviants; rather these data suggest an underspecified or underlying T3 stored linguistic representation used in spoken word processing.

Body representations as indexed by oscillatory EEG activities in the context of tactile novelty processing

Neural oscillatory activities in different frequency bands are known to reflect different cognitive functions. The current study investigates neural oscillations involved in tactile novelty processing, in particular how physically different digits of the hand may be categorized as being more or less similar to one another. Time-frequency analyses were conducted on EEG responses recorded from a somatosensory mismatch protocol involving stimulation of the 1st, 3rd, and 5th digits. The pattern of tactile stimulation leveraged a functional category boundary between the 1st digit (thumb) and the other fingers. This functional category has been hypothesized to derive, in part, from the way that the hand is used to grasp and haptically explore objects. EEG responses to standard stimuli (the 3rd digit, probability of 80%) and two deviant stimuli (1st digit as across-boundary deviant and 5th digit as within-boundary deviant, probability of 10% each) were examined. Analyses of EEG responses examined changes in power as well as phase information. Deviant tactile stimuli evoked significantly greater theta event-related synchronization and greater phase-locking values compared to the corresponding control stimuli. The increase in theta power evoked by the contrast of the 3rd digit and the 1st digit was significantly larger than for the contrast between the 3rd and 5th digits. Desynchronization in the alpha and beta bands was greater for deviant than control stimuli, which may reflect increased local cortical excitation to novel stimuli, modulated by top-down feedback processes as part of a hierarchical novelty detection mechanism. The results are discussed in the context of the growing literature on neural processes involved in the generation and maintenance of body representations.

Effect of blindness on mismatch responses to Mandarin lexical tones, consonants, and vowels

According to the hypothesis of auditory compensation, blind listeners are more sensitive to auditory input than sighted listeners. In the current study, we employed the passive oddball paradigm to investigate the effect of blindness on listeners' mismatch responses to Mandarin lexical tones, consonants, and vowels. Twelve blind and twelve sighted age- and verbal IQ-matched adults with normal hearing participated in this study. Our results indicated that blind listeners possibly had a more efficient pre-attentive processing (shorter MMN peak latency) of lexical tones in the tone-dominant hemisphere (i.e., the right hemisphere); and that they exhibited greater sensitivity (larger MMN amplitude) when processing phonemes (consonants and/or vowels) at the pre-attentive stage in both hemispheres compared with sighted individuals. However, we observed longer MMN and P3a peak latencies during phoneme processing in the blind versus control participants, indicating that blind listeners may be slower in terms of pre-attentive processing and involuntary attention switching when processing phonemes. This could be due to a lack of visual experience in the production and perception of phonemes. In a word, the current study revealed a two-sided influence of blindness on Mandarin speech perception.

Modulation of auditory sensory memory by chronic clinical pain and acute experimental pain: a mismatch negativity study

Pain, especially chronic pain, can lead to cognitive deficits. Mismatch negativity (MMN) is a change-specific component of the auditory event-related brain potential (ERP) that is thought to provide a unique window into sensory memory processes. The present study was designed to determine how chronic and acute pain affects auditory sensory memory. In experiment 1, MMNs elicited by standard and deviant auditory stimuli at short and long inter-stimulus intervals (ISIs) were compared between trigeminal neuralgia (TN) patients and demographically matched healthy controls (HCs). The TN patients were found to have stronger attenuation of the MMN at longer ISIs than HCs. Correlation analysis revealed a significant positive correlation between the sensory subscale of McGill Pain Questionnaire and MMN amplitude reduction across ISI conditions. In experiment 2, MMNs recorded before, during, and after the cold pressor test were compared in healthy subjects. MMN amplitude was significantly reduced during pain exposure and recovered immediately thereafter. These results suggest that both chronic pain and acute pain can interfere with automatic change detection processes in the brain. This study provides the first evidence that chronic pain patients have a faster auditory memory trace decay than HCs.

Neuropsychology of Human Body Parts: Exploring Categorical Boundaries of Tactile Perception Using Somatosensory Mismatch Responses

The focus of the current study is on a particular aspect of tactile perception: categorical segmentation on the body surface into discrete body parts. The MMN has been shown to be sensitive to categorical boundaries and language experience in the auditory modality. Here we recorded the somatosensory MMN (sMMN) using two tactile oddball protocols and compared sMMN amplitudes elicited by within- and across-boundary oddball pairs. Both protocols employed the identity MMN method that controls for responsivity at each body location. In the first protocol, we investigated the categorical segmentation of tactile space at the wrist by presenting pairs of tactile oddball stimuli across equal spatial distances, either across the wrist or within the forearm. Amplitude of the sMMN elicited by stimuli presented across the wrist boundary was significantly greater than for stimuli presented within the forearm, suggesting a categorical effect at an early stage of somatosensory processing. The second protocol was designed to investigate the generality of this MMN effect, and involved three digits on one hand. Amplitude of the sMMN elicited by a contrast of the third digit and the thumb was significantly larger than a contrast between the third and fifth digits, suggesting a functional boundary effect that may derive from the way that objects are typically grasped. These findings demonstrate that the sMMN is a useful index of processing of somatosensory spatial discrimination that can be used to study body part categories.

Lack of correlation between phonetic magnetic mismatch field and plasma d-serine levels in humans

OBJECTIVE

Uncovering molecular bases for auditory language processing in the human brain is a fundamental scientific challenge. The power and latency of the magnetic mismatch field (MMF) elicited by phoneme change, which are magnetoencephalographic indices of language function in its early stage of information processing, are theoretically thought to be modulated by N-methyl-d-aspartate-type glutamate receptor (NMDAR) function, but no study has yet assessed this possibility. We have thus sought to demonstrate an association between phonetic MMF power/latency and levels of plasma d-serine, an intrinsic co-agonist of glycine binding sites on NMDAR, in adults.

METHODS

The MMF response to phoneme changes was recorded using 204-channel magnetoencephalography in 61 healthy, right-handed, Japanese adults. Plasma levels of d- and l-serine were measured for each participant.

RESULTS

We did not find a significant correlation between MMF power/latency and plasma serine levels.

CONCLUSIONS

Despite a sufficient sample size, we failed to find an association between the physiological markers of the early stage of information processing of language in the auditory cortex and biomarkers indexing glutamatergic function.

SIGNIFICANCE

Our study did not indicate that a molecular index of glutamatergic function could be a surrogate marker for the early stage of information processing of language in humans.

Using rotated speech to approximate the acoustic mismatch negativity response to speech

The mismatch negativity (MMN) response is influenced by the magnitude of the acoustic difference between standard and deviant, and the response is typically larger to linguistically relevant changes than to linguistically irrelevant changes. Linguistically relevant changes between standard and deviant typically co-occur with differences between the two acoustic signals. It is therefore not straightforward to determine the contribution of each of those two factors to the MMN response. This study investigated whether spectrally rotated speech can be used to determine the impact of the acoustic difference on the MMN response to a combined linguistic and acoustic change between standard and deviant. Changes between rotated vowels elicited an MMN of comparable amplitude to the one elicited by a within-category vowel change, whereas the between-category vowel change resulted in an MMN amplitude of greater magnitude. A change between rotated vowels resulted in an MMN ampltude more similar to that of a within-vowel change than a complex tone change did. This suggests that the MMN amplitude reflecting the acoustic difference between two speech sounds can be well approximated by the MMN amplitude elicited in response to their rotated counterparts, in turn making it possible to estimate the part of the response specific to the linguistic difference.

Categorical perception of lexical tones by English learners of Mandarin Chinese

Whether native speakers of non-tonal languages can acquire categorical representations of lexical tones remains controversial. This study investigates the acquisition of lexical tone categories by native English speakers learning Mandarin Chinese as a foreign language by comparing the categorical perception (CP) of lexical tones between three groups of listeners: (1) native English speakers who had taken advanced Mandarin courses in colleges; (2) native English speakers with no knowledge of Mandarin Chinese; and (3) native Mandarin speakers. Two tonal continua derived from natural speech within carrier phrases were created through interpolation within two tonal contrasts (tone 1/tone 4, T1/T4; tone 2/tone 3, T2/T3). Results showed categorical-like perception of tones by native Mandarin speakers. The inexperienced English speakers performed near chance on discrimination tasks and showed significantly broader identification boundaries than the other two groups. The learners of Mandarin showed similar pattern of CP to native Mandarin speakers, but with higher overall discrimination scores. Findings suggest that CP of lexical tone may be available to advanced second language learners.

Categorical effects in fricative perception are reflected in cortical source information

Previous research in speech perception has shown that category information affects the discrimination of consonants to a greater extent than vowels. However, there has been little electrophysiological work on the perception of fricative sounds, which are informative for this contrast as they share properties with both consonants and vowels. In the current study we address the relative contribution of phonological and acoustic information to the perception of sibilant fricatives using event-related fields (ERFs) and dipole modeling with magnetoencephalography (MEG). We show that the field strength of neural responses peaking approximately 200 ms after sound onset co-varies with acoustic factors, while the cortical localization of earlier M100 responses suggests a stronger influence of phonological categories. We propose that neural equivalents of categorical perception for fricative sounds are best seen using localization measures, and that spectral cues are spatially coded in human cortex.

Impaired pre-attentive auditory processing in fibromyalgia: A mismatch negativity (MMN) study

OBJECTIVE

Fibromyalgia (FM) patients often show deficits in cognitive functions such as attention and working memory. We assumed that pre-attentive information processing, a crucial element in human perception and cognition, would be altered in FM patients. Thus, the objective of this study was to determine whether FM patients exhibit alterations in pre-attentive processing as assessed by auditory mismatch negativity (MMN).

METHODS

Auditory evoked magnetic fields were recorded in FM patients (n=18) and healthy control subjects (n=21) during a duration-deviant auditory oddball paradigm. The magnetic mismatch negativity (MMNm) was obtained by subtracting responses to standard tones from responses to deviant tones. Pressure pain thresholds over the thenar and trapezius muscles were determined using an algometer.

RESULTS

MMNm peak amplitudes in right hemispheres were attenuated, and the directional asymmetry coefficient of the MMNm amplitude was lower in FM patients, indicating a more leftward asymmetry than in healthy control subjects. Smaller right MMNm amplitude was associated with lower pressure pain thresholds of thenar muscles in FM patients.

CONCLUSIONS

Our results suggested that pre-attentive processing of auditory information is impaired in FM patients.

SIGNIFICANCE

This study provided neurophysiological evidence of impaired pre-attentive sensory change detection in FM.

The neural basis of sublexical speech and corresponding nonspeech processing: a combined EEG-MEG study

We addressed the neural organization of speech versus nonspeech sound processing by investigating preattentive cortical auditory processing of changes in five features of a consonant-vowel syllable (consonant, vowel, sound duration, frequency, and intensity) and their acoustically matched nonspeech counterparts in a simultaneous EEG-MEG recording of mismatch negativity (MMN/MMNm). Overall, speech-sound processing was enhanced compared to nonspeech sound processing. This effect was strongest for changes which affect word meaning (consonant, vowel, and vowel duration) in the left and for the vowel identity change in the right hemisphere also. Furthermore, in the right hemisphere, speech-sound frequency and intensity changes were processed faster than their nonspeech counterparts, and there was a trend for speech-enhancement in frequency processing. In summary, the results support the proposed existence of long-term memory traces for speech sounds in the auditory cortices, and indicate at least partly distinct neural substrates for speech and nonspeech sound processing.

Decoding speech perception by native and non-native speakers using single-trial electrophysiological data

Brain-computer interfaces (BCIs) are systems that use real-time analysis of neuroimaging data to determine the mental state of their user for purposes such as providing neurofeedback. Here, we investigate the feasibility of a BCI based on speech perception. Multivariate pattern classification methods were applied to single-trial EEG data collected during speech perception by native and non-native speakers. Two principal questions were asked: 1) Can differences in the perceived categories of pairs of phonemes be decoded at the single-trial level? 2) Can these same categorical differences be decoded across participants, within or between native-language groups? Results indicated that classification performance progressively increased with respect to the categorical status (within, boundary or across) of the stimulus contrast, and was also influenced by the native language of individual participants. Classifier performance showed strong relationships with traditional event-related potential measures and behavioral responses. The results of the cross-participant analysis indicated an overall increase in average classifier performance when trained on data from all participants (native and non-native). A second cross-participant classifier trained only on data from native speakers led to an overall improvement in performance for native speakers, but a reduction in performance for non-native speakers. We also found that the native language of a given participant could be decoded on the basis of EEG data with accuracy above 80%. These results indicate that electrophysiological responses underlying speech perception can be decoded at the single-trial level, and that decoding performance systematically reflects graded changes in the responses related to the phonological status of the stimuli. This approach could be used in extensions of the BCI paradigm to support perceptual learning during second language acquisition.

Mismatch negativity for speech sounds in temporal lobe epilepsy

The mismatch negativity (MMN) is an electrophysiological trace of change detection, measured by electroencephalography (EEG), and is a reliable marker for pre-attentive auditory sensory memory. We used a phonetic oddball paradigm in patients with temporal lobe epilepsy (TLE) to elicit the MMN response at fronto-central sites and the mismatch positivity (MMP) response at mastoid sites. The MMN in 26 patients was compared with that of 26 age- and gender-matched healthy control participants. Electroencephalography responses were recorded during the presentation of speech sounds: the vowels 'a' and 'o' in alternation. Average waveforms were obtained for standard and deviant trials. We found that the MMP response at bilateral mastoid sites was reduced, whereas the MMN response at fronto-central sites did not change significantly. These results support the view that the MMN is generated by separable sources in the frontal and temporal lobes and that these sources are differentially affected by TLE.

The mismatch negativity (MMN)--a unique window to disturbed central auditory processing in ageing and different clinical conditions

In this article, we review clinical research using the mismatch negativity (MMN), a change-detection response of the brain elicited even in the absence of attention or behavioural task. In these studies, the MMN was usually elicited by employing occasional frequency, duration or speech-sound changes in repetitive background stimulation while the patient was reading or watching videos. It was found that in a large number of different neuropsychiatric, neurological and neurodevelopmental disorders, as well as in normal ageing, the MMN amplitude was attenuated and peak latency prolonged. Besides indexing decreased discrimination accuracy, these effects may also reflect, depending on the specific stimulus paradigm used, decreased sensory-memory duration, abnormal perception or attention control or, most importantly, cognitive decline. In fact, MMN deficiency appears to index cognitive decline irrespective of the specific symptomatologies and aetiologies of the different disorders involved.

Perception of a Japanese vowel length contrast by Japanese and American English listeners: behavioral and electrophysiological measures

This study examined the role of automatic selective perceptual processes in native and non-native listeners' perception of a Japanese vowel length contrast (tado vs. taado), using multiple, natural-speech tokens of each category as stimuli in a "categorial oddball" design. Mismatch negativity (MMN) was used to index discrimination of the temporally-cued vowel contrast by naïve adult American listeners and by a native Japanese-speaking control group in two experiments in which attention to the auditory input was manipulated: in Exp 1 (Visual-Attend), listeners silently counted deviants in a simultaneously-presented visual categorial oddball shape discrimination task; in Exp 2 (Auditory-Attend), listeners attended to the auditory input and implicitly counted target deviants. MMN results showed effects of language experience and attentional focus: MMN amplitudes were smaller for American compared to Japanese listeners in the Visual-Attend Condition and for the American listeners in the Visual compared to Auditory-Attend Condition. Subtle differences in topography were also seen, specifically in that the Japanese group showed more robust responses than the American listeners at left hemisphere scalp sites that probably index activity from the superior temporal gyrus. Follow-up behavioral discrimination tests showed that Americans discriminated the contrast well above chance, but more poorly than did Japanese listeners. This pattern of electrophysiological and behavioral results supports the conclusion that early experience with phonetic contrasts of a language results in changes in neural representations in the auditory cortex that allow for more robust automatic, phonetic processing of native-language speech input.

Neural signatures of phonetic learning in adulthood: a magnetoencephalography study

The present study used magnetoencephalography (MEG) to examine perceptual learning of American English /r/ and /l/ categories by Japanese adults who had limited English exposure. A training software program was developed based on the principles of infant phonetic learning, featuring systematic acoustic exaggeration, multi-talker variability, visible articulation, and adaptive listening. The program was designed to help Japanese listeners utilize an acoustic dimension relevant for phonemic categorization of /r-l/ in English. Although training did not produce native-like phonetic boundary along the /r-l/ synthetic continuum in the second language learners, success was seen in highly significant identification improvement over twelve training sessions and transfer of learning to novel stimuli. Consistent with behavioral results, pre-post MEG measures showed not only enhanced neural sensitivity to the /r-l/ distinction in the left-hemisphere mismatch field (MMF) response but also bilateral decreases in equivalent current dipole (ECD) cluster and duration measures for stimulus coding in the inferior parietal region. The learning-induced increases in neural sensitivity and efficiency were also found in distributed source analysis using Minimum Current Estimates (MCE). Furthermore, the pre-post changes exhibited significant brain-behavior correlations between speech discrimination scores and MMF amplitudes as well as between the behavioral scores and ECD measures of neural efficiency. Together, the data provide corroborating evidence that substantial neural plasticity for second-language learning in adulthood can be induced with adaptive and enriched linguistic exposure. Like the MMF, the ECD cluster and duration measures are sensitive neural markers of phonetic learning.

Right Hemispheric Contributions to Fine Auditory Temporal Discriminations: High-Density Electrical Mapping of the Duration Mismatch Negativity (MMN)

That language processing is primarily a function of the left hemisphere has led to the supposition that auditory temporal discrimination is particularly well-tuned in the left hemisphere, since speech discrimination is thought to rely heavily on the registration of temporal transitions. However, physiological data have not consistently supported this view. Rather, functional imaging studies often show equally strong, if not stronger, contributions from the right hemisphere during temporal processing tasks, suggesting a more complex underlying neural substrate. The mismatch negativity (MMN) component of the human auditory evoked-potential provides a sensitive metric of duration processing in human auditory cortex and lateralization of MMN can be readily assayed when sufficiently dense electrode arrays are employed. Here, the sensitivity of the left and right auditory cortex for temporal processing was measured by recording the MMN to small duration deviants presented to either the left or right ear. We found that duration deviants differing by just 15% (i.e. rare 115 ms tones presented in a stream of 100 ms tones) elicited a significant MMN for tones presented to the left ear (biasing the right hemisphere). However, deviants presented to the right ear elicited no detectable MMN for this separation. Further, participants detected significantly more duration deviants and committed fewer false alarms for tones presented to the left ear during a subsequent psychophysical testing session. In contrast to the prevalent model, these results point to equivalent if not greater right hemisphere contributions to temporal processing of small duration changes.

Mismatch negativity (MMN) evoked by sound duration contrasts: an unexpected major effect of deviance direction on amplitudes

OBJECTIVE

Verify and explore unexpected results suggesting an effect of deviance direction (shorter or longer deviants) on the amplitude of MMNs evoked by sound duration contrasts.

METHODS

MMNs were recorded using the oddball paradigm on ten adults. Four standard stimulus durations (100, 150, 200 and 250ms) were used and deviants were 50% shorter or longer. Behavioral data (hit rates, d', and reaction times) were collected after the electrophysiological sessions.

RESULTS

MMNs were larger for short than for long deviants. There was no effect on MMN latencies. Hit rates and d' data were almost at ceiling level for all conditions even for the longest standard - long deviant combination in which the MMN was abolished.

CONCLUSIONS

We argue that the deviance direction effect on MMN amplitudes can be explained by the delay between the moment of deviance detection and the end of the deviance quantification process.

SIGNIFICANCE

A major effect of deviance direction on amplitudes was confirmed. This effect, which was confined to electrophysiological data, is to be taken into account when using duration contrasts to probe the processing of temporal information.

Neuromagnetic mismatch field (MMF) dependence on the auditory temporal integration window and the existence of categorical boundaries: comparisons between dissyllabic words and their equivalent tones

Previous duration-related auditory mismatch response studies have tested vowels, words, and tones. Recently, the elicitation of strong neuromagnetic mismatch field (MMF) components in response to large (>32%) vowel-duration decrements was clearly observed within dissyllabic words. To date, however, the issues of whether this MMF duration-decrement effect also extends to duration increments, and to what degree these duration decrements and increments are attributed to their corresponding non-speech acoustic properties remainto be resolved. Accordingly, this magnetoencephalographic (MEG) study investigated whether prominent MMF components would be evoked by both duration decrements and increments for dissyllabic word stimuli as well as frequency-band matched tones in order to corroborate the relation between the MMF elicitation and the directions of duration changes in speech and non-speech. Further, the peak latency effectsdepending on stimulus types (words vs. tones) were examined. MEG responses were recorded with a whole-head 148-channel magnetometer, while subjects passively listened to the stimuli presented within an odd-ball paradigm for both shortened duration (180-->100%) and lengthened duration (100-->180%). Prominent MMF components were observed in the shortened and lengthened paradigms for the word stimuli, but only in the shortened paradigm for tones. The MMF peak latency results showed that the words ledtoearlier peak latencies than the tones. These findings suggest that duration lengthening as well as shortening in words produces a salient acoustic MMF response when the divergent point between the long and short durations fallswithin the temporal window ofauditory integration post sound onset (<200 ms), and that theearlier latency of the dissyllabic word stimuli over tones is due to a prominent syllable structure in words which is used to generate temporal categorical boundaries.

The mismatch negativity (MMN) in basic research of central auditory processing: a review

In the present article, the basic research using the mismatch negativity (MMN) and analogous results obtained by using the magnetoencephalography (MEG) and other brain-imaging technologies is reviewed. This response is elicited by any discriminable change in auditory stimulation but recent studies extended the notion of the MMN even to higher-order cognitive processes such as those involving grammar and semantic meaning. Moreover, MMN data also show the presence of automatic intelligent processes such as stimulus anticipation at the level of auditory cortex. In addition, the MMN enables one to establish the brain processes underlying the initiation of attention switch to, conscious perception of, sound change in an unattended stimulus stream.

Comparison between mismatch negativity amplitude and magnetic mismatch field strength in normal adults

The auditory mismatch negativity (MMN) or its magnetic counterpart (magnetic mismatch field, MMF) has been widely used to assess the ability of stimulus-driven change detection process in humans. The authors evaluated the similarity of inter-individual variation of the response strength between MMN and MMF recordings. Three types of MMN or MMF were recorded in ten healthy subjects: change in duration of pure-tone stimuli, change in duration of the Japanese vowel /a/, and difference between the Japanese vowels /a/ and /o/. There was no significant correlation between MMN amplitude and MMF strength under any condition and in either hemisphere. These results suggest that widely used indices of MMN in the two technologies, i.e., EEG-amplitude and MEG-ECD may not be proportional in an individual. To further clarify the differential significance of recording MMN/MMF may be important to establish MMN/MMF as clinical indices of individual ability of preattentive stage of auditory processing.

Preattentive discrimination of across-category and within-category change in consonant–vowel syllable

Event-related potentials to infrequently presented spoken deviant syllables /pi/ and /po/ among repetitive standard [see text] syllables were recorded in Thai study participants who ignored these stimuli while reading books of their choices. The vowel across-category and within-category changes elicited a change-specific mismatch negativity response. The across-category and within-category change discrimination of vowels in consonant-vowel syllable was also assessed using the low-resolution electromagnetic tomography. The results of low-resolution electromagnetic tomography mismatch negativity generator analysis suggest that the within-category change perception of vowels is analyzed as the change in physical features of the stimuli, thus predominantly activating the right temporal cortex. In contrast, the left temporal cortex is predominantly activated in the across-category change perception of vowels, emphasizing the role of the left hemisphere in speech processing already at a preattentive processing level also in consonant-vowel syllables. The results support the hypothesis that a part of the superior temporal gyrus contains neurons specialized for speech perception.

Delayed automatic detection of change in speech sounds in adults with autism: a magnetoencephalographic study

OBJECTIVE

Autism is a form of pervasive developmental disorder in which dysfunction in interpersonal relationships and communication is fundamental. This study evaluated neurophysiological abnormalities at the basic level of language processing, i.e. automatic change detection of speech and non-speech sounds, using magnetoencephalographic recording of mismatch response elicited by change in vowels and tones.

METHODS

The auditory magnetic mismatch field (MMF) was evaluated in 9 adults with autism and 19 control subjects using whole-head magnetoencephalography. The MMF in response to the duration change of a pure tone or vowel /a/ and that in response to across-phoneme change between vowels /a/ and /o/, were recorded.

RESULTS

The groups were not significantly different in MMF power under any conditions. However, the autism group showed a left-biased latency prolongation of the MMF particularly under the across-phoneme change condition, and this latency delay was significantly associated with greater symptom severity.

CONCLUSIONS

These results suggest that adults with autism are associated with delayed processing for automatic change detection of speech sounds. These electrophysiological abnormalities at the earliest level of information processing may contribute to the basis for language deficits observed in autism.

SIGNIFICANCE

These results provide the first evidence for delayed latency of phonetic MMF in adults with autism.

Effects of language experience: Neural commitment to language-specific auditory patterns

Linguistic experience alters an individual's perception of speech. We here provide evidence of the effects of language experience at the neural level from two magnetoencephalography (MEG) studies that compare adult American and Japanese listeners' phonetic processing. The experimental stimuli were American English /ra/ and /la/ syllables, phonemic in English but not in Japanese. In Experiment 1, the control stimuli were /ba/ and /wa/ syllables, phonemic in both languages; in Experiment 2, they were non-speech replicas of /ra/ and /la/. The behavioral and neuromagnetic results showed that Japanese listeners were less sensitive to the phonemic /r-l/ difference than American listeners. Furthermore, processing non-native speech sounds recruited significantly greater brain resources in both hemispheres and required a significantly longer period of brain activation in two regions, the superior temporal area and the inferior parietal area. The control stimuli showed no significant differences except that the duration effect in the superior temporal cortex also applied to the non-speech replicas. We argue that early exposure to a particular language produces a "neural commitment" to the acoustic properties of that language and that this neural commitment interferes with foreign language processing, making it less efficient.

Abnormal association between reduced magnetic mismatch field to speech sounds and smaller left planum temporale volume in schizophrenia

Schizophrenia is associated with language-related dysfunction. A previous study [Schizophr. Res. 59 (2003c) 159] has shown that this abnormality is present at the level of automatic discrimination of change in speech sounds, as revealed by magnetoencephalographic recording of auditory mismatch field in response to across-category change in vowels. Here, we investigated the neuroanatomical substrate for this physiological abnormality. Thirteen patients with schizophrenia and 19 matched control subjects were examined using magnetoencephalography (MEG) and high-resolution magnetic resonance imaging (MRI) to evaluate both mismatch field strengths in response to change between vowel /a/ and /o/, and gray matter volumes of Heschl's gyrus (HG) and planum temporale (PT). The magnetic global field power of mismatch response to change in phonemes showed a bilateral reduction in patients with schizophrenia. The gray matter volume of left planum temporale, but not right planum temporale or bilateral Heschl's gyrus, was significantly smaller in patients with schizophrenia compared with that in control subjects. Furthermore, the phonetic mismatch strength in the left hemisphere was significantly correlated with left planum temporale gray matter volume in patients with schizophrenia only. These results suggest that structural abnormalities of the planum temporale may underlie the functional abnormalities of fundamental language-related processing in schizophrenia.

Hemispheric processing of duration changes in speech and non-speech sounds

Sound duration conveys phonemic information in some languages. The present study, using magnetoencephalography (MEG), examined whether the hemispheric activation associated with the processing of duration is different between speech and non-speech sounds in subjects whose native language uses duration as a phonemic cue. The magnetic mismatch negativity (MMNm) response was recorded for equal-duration decrements in vowel, sinusoidal, and spectrally rich complex sounds. Although the MMNm responses to duration changes were predominant in the right hemisphere, the distribution of this response for the vowel stimuli was significantly displaced leftward compared with that for the other two types of stimuli. The results suggest that the hemispheric distribution of the MMNm response to duration change depends on the linguistic relevance of the change.

Distinctive MMN relative to sound types in adults with intellectual disability

The effect of stimulus characteristics (vowel vs pure tone) upon mismatch negativity (MMN) was compared between adults with intellectual disability and healthy controls. Either vowels (synthesized vowels /e/ and /o/) or pure tones (1940 and 851 Hz corresponding to the F2 frequencies of /e/ and /o/, respectively) were presented using an oddball procedure. Both groups showed identical results in latency (vowel MMN>pure tone MMN) and less amplitudes for vowels. However, the disabled group demonstrated amplitude attenuation regardless of the stimulus type, although the vowel MMN amplitude showed a descending trend with age in both groups. These results suggest that auditory sensory memory in intellectual disability might have an insufficient capacity yet share a property common to controls.

Lateralization of auditory-cortex functions

In the present review, we summarize the most recent findings and current views about the structural and functional basis of human brain lateralization in the auditory modality. Main emphasis is given to hemodynamic and electromagnetic data of healthy adult participants with regard to music- vs. speech-sound encoding. Moreover, a selective set of behavioral dichotic-listening (DL) results and clinical findings (e.g., schizophrenia, dyslexia) are included. It is shown that human brain has a strong predisposition to process speech sounds in the left and music sounds in the right auditory cortex in the temporal lobe. Up to great extent, an auditory area located at the posterior end of the temporal lobe (called planum temporale [PT]) underlies this functional asymmetry. However, the predisposition is not bound to informational sound content but to rapid temporal information more common in speech than in music sounds. Finally, we obtain evidence for the vulnerability of the functional specialization of sound processing. These altered forms of lateralization may be caused by top-down and bottom-up effects inter- and intraindividually In other words, relatively small changes in acoustic sound features or in their familiarity may modify the degree in which the left vs. right auditory areas contribute to sound encoding.

Plastic cortical changes induced by learning to communicate with non-speech sounds

With Morse code, an acoustic message is transmitted using combinations of tone patterns rather than the spectrally and temporally complex speech sounds that constitute the spoken language. Using MEG recordings of the mismatch negativity (MMN, an index of permanent auditory cortical representations of native language speech sounds), we probed the dominant hemisphere for the developing Morse code representations in adult Morse code learners. Initially, the MMN to the Morse coded syllables was, on average, stronger in the hemisphere opposite to the one dominant for the MMN to native language speech sounds. After a training period of 3 months, the pattern reversed, however: the mean Morse code MMN became lateralized to the hemisphere that was predominant for the speech-sound MMN. This suggests that memory traces for the Morse coded acoustic language units develop within the hemisphere that already accommodates the permanent traces for natural speech sounds. These plastic changes manifest, presumably, the close associations formed between the neural representations of the tone patterns and phonemes.

Hemispheric balance in processing attended and non-attended vowels and complex tones

We compared cortical processing of attended and non-attended vowels and complex tones, using a whole-head neuromagnetometer, to test for possible hemispheric differences. Stimuli included vowels [a] and [i], spoken by two female Finnish speakers, and two complex tones, each with two pure tone components corresponding to the first and second formant frequencies (F1-F2) of the vowels spoken by speaker 1. Sequences including both vowels and complex tones were presented to eight Finnish males during passive and active (phoneme/speaker/complex tone identification) listening. Sequences including only vowels were presented to five of the subjects during passive listening and during a phoneme identification task. The vowel [i] spoken by speaker 1 and the corresponding complex tone were frequent, non-target stimuli. Responses evoked by these frequent stimuli were analyzed. Cortical activation at approximately 100 ms was stronger for the complex tone than the vowel in the right hemisphere (RH). Responses were similar during active and passive listening. Hemispheric balance remained the same when the vowel was presented in sequences including only vowels. The reduction of RH activation for vowels as compared with complex tones indicates a relative increase of left hemisphere involvement, possibly reflecting a shift towards more language-specific processing.

Neuromagnetic correlates of impaired automatic categorical perception of speech sounds in schizophrenia

Schizophrenia is associated with dysfunction in language processing. At the earliest stage of language processing, dysfunction of categorical perception of speech sounds in schizophrenia has been demonstrated in a behavioral task. The aim of this study was to assess automatic categorical perception of speech sounds as reflected by event-related changes in magnetic field power in schizophrenia. Using a whole-head magnetoencephalographic recording, the magnetic counterpart of mismatch negativity (MMNm) elicited by a phonetic change was evaluated in 16 right-handed patients with chronic schizophrenia and in 19 age-, sex-, and parental socioeconomic status-matched normal control subjects. Three types of MMNm (MMNm in response to a duration decrement of pure-tone stimuli; a vowel within-category change [duration decrement of Japanese vowel /a/]; vowel across-category change [Japanese vowel /a/ versus /o/]) were recorded. While the schizophrenia group showed an overall reduction in magnetic field power of MMNm, a trend was found toward more distinct abnormalities under the condition of vowel across-category change than under that of duration decrement of a vowel or tone. The patient group did not show abnormal asymmetries of MMNm power under any of the conditions. This study provides physiological evidence for impaired categorical perception of speech sounds in the bilateral auditory cortex in schizophrenia. The language-related dysfunction in schizophrenic patients may be present at the early stage of auditory processing of relatively simple stimuli such as phonemes, and not just at stages involving higher order semantic processes.

Early parallel processing of auditory word and voice information

The present study investigates the relationship of linguistic (phonetic) and extralinguistic (voice) information in preattentive auditory processing. We provide neurophysiological data, which show for the first time that both kinds of information are processed in parallel at an early preattentive stage. In order to establish the temporal and spatial organization of the underlying neuronal processes, we studied the conjunction of voice and word deviations in a mismatch negativity experiment, whereby the listener's brain responses were collected using magnetoencephalography. The stimuli consisted of single spoken words, whereby the deviants manifested a change of the word, of the voice, or both word and voice simultaneously (combined). First, we identified the N100m (overlain by mismatch field, MMF) and localized its generators, analyzing N100 m/MMF latency, dipole localization, and dipole strength. While the responses evoked by deviant stimuli were more anterior than the standard, localization differences between the deviants could not be shown. The dipole strength was larger for deviants than the standard stimulus, but again, no differences between the deviants could be established. There was no difference in the hemispheric lateralization of the responses. However, a difference between the deviants was observed in the latencies. The N100 m/MMF revealed a significantly shorter and less variant latency for the combined stimulus compared to all other experimental conditions. The data suggest an integral parallel processing model, which describes the early extraction of phonetic and voice information from the speech signal as parallel and contingent processes.

Abstract phoneme representations in the left temporal cortex: magnetic mismatch negativity study

We investigated the brain mechanisms enabling one automatically discriminate phoneme category irrespective of the large inter-speaker variability in the acoustic features of the voices. For this purpose, subjects were presented with 450 different speech stimuli, each uttered by a different speaker, belonging to three vowel categories, while a 306-channel magnetoencephalogram (MEG) was obtained to record the magnetic counterpart of the mismatch negativity (MMNm), elicited only when sensory memory traces for repetitive sounds are formed in the auditory cortex. Despite this wide acoustic variation, category changes elicited prominent MMNm responses, which were considerably stronger in the left than in the right hemisphere in the right-handed subjects. These results implicate the presence of long-term memory traces for vowels, which can recognize the vowel-specific invariant code enabling correct vowel percept even in the presence of realistic acoustic variation.

Neuroanatomy and neurophysiology in schizophrenia

Schizophrenia is a major mental disorder, characterized by their set of symptoms, including hallucinatory-delusional symptoms, thought disorder, emotional flattening, and social withdrawal. Since 1980s, advances in neuroimaging and neurophysiological techniques have provided tremendous merits for investigations into schizophrenia as a brain disorder. In this article, we first overviewed neuroanatomical studies using structural magnetic resonance imaging (s-MRI), MR spectroscopy (MRS), and postmortem brains, followed by neurophysiological studies using event-related potentials (ERPs) and magnetoencephalography (MEG), in patients with schizophrenia. Evidences from these studies suggest that schizophrenia is a chronic brain disorder, structurally and functionally affecting various cortical and subcortical regions involved in cognitive, emotional, and motivational aspects of human behavior. Second, we reviewed recent investigations into neurobiological basis for schizophrenic symptoms (auditory hallucinations and thought disorder) using these indices as well as hemodynamic assessments such as positron emission tomography (PET) and functional MRI (f-MRI). Finally, we addressed the issue of the heterogeneity of schizophrenia from the neurobiological perspective, in relation to the neuroanatomical and neurophysiological measures.

Mismatch responses to randomized gradient switching noise as reflected by fMRI and whole-head magnetoencephalography

The central auditory system of the human brain uses a variety of mechanisms to analyze auditory scenes, among others, preattentive detection of sudden changes in the sound environment. Electroencephalography (EEG) and magnetoencephalography (MEG) provide a measure to monitor neuronal cortical currents. The mismatch negativity (MMN) or field (MMNm) reflect preattentive activation in response to deviants within a sequence of homogenous auditory stimuli. Functional magnetic resonance imaging (fMRI) allows for a higher spatial resolution as compared to the extracranial electrophysiological techniques. The image encoding gradients of echo planar imaging (EPI) sequences, however, elicit an interfering background noise. To circumvent this shortcoming, the present study applied multi-echo EPI mimicking an auditory oddball design. The gradient trains (SOA = 800 msec, 94.5 dB SPL, stimulus duration = 152 msec) comprised amplitude (-9 dB) and duration (76 msec) deviants in a randomized sequence. Moreover, the scanner noise was recorded and applied in a whole-head MEG device to validate the properties of this specific material. Robust fMRI activation patterns emerged in response to the deviant gradient switching. Changes in amplitude activated the entire auditory cortex, whereas the duration deviants elicited right-lateralized signal increase in secondary areas. The recorded scanner noise evoked reliably right-lateralized mismatch MEG responses. Source localization was in accordance with activation of secondary auditory cortex. The presented paradigm provides a robust and feasible tool to study the functional anatomy of early cognitive auditory processing in clinical populations such as schizophrenia.

No effect of gender on tonal and phonetic mismatch negativity in normal adults assessed by a high-resolution EEG recording

The auditory mismatch negativity (MMN) of event-related potential components has been widely used to assess the ability of auditory automatic change discrimination of verbal and nonverbal stimuli in healthy individuals and patients with various illnesses. To clarify the role of gender differences in the MMN, we compared the amplitude, latency, and topography of tonal and phonetic MMN between healthy males and females, using a high-density (128 channel) electroencephalography montage. The MMN was evaluated in 18 right-handed male and ten age-matched female adults. The MMN in response to a duration change of pure tone and that in response to a phonetic change (Japanese vowel /a/ versus /o/ with 150-ms duration) were recorded. There were no significant differences in amplitude, latency, or laterality for either tonal or phonetic MMN between male and female subjects. This lack of evidence for effects of gender on MMN in response to duration change of tones or that in response to changes of phonemes with a short duration in normal adults may be of relevance to a growing number of researchers who are studying the MMN in healthy individuals and various clinical groups.

Do high or low doses of anxiolytics and hypnotics affect mismatch negativity in schizophrenic subjects? An EEG and MEG study

OBJECTIVE

Many studies have demonstrated mismatch negativity (MMN) attenuation in schizophrenia. Recently, investigators have shown that GABAergic inhibitory neurons may regulate MMN generation. Considering that a substantial proportion of schizophrenic patients receive anxiolytics and hypnotics that have affinity to GABA(A) receptors to reduce their comorbid symptoms of anxiety and sleep disturbances, we need to assess whether anxiolytics/hypnotics might affect their MMN generation. The aim of this study is to assess the possibility that high or low doses of anxiolytics/hypnotics received by schizophrenic subjects affect their mismatch negativity (MMN), using event-related potentials (ERPs) and magnetoencephalography (MEG).

METHODS

Twenty-three and 16 patients with schizophrenia participated in the ERP and MEG studies, respectively. Three types of MMN (MMN in response to a duration change of pure-tone stimuli, within-category vowel change (Japanese vowel /a/ with short versus long duration), and across-category vowel change (vowel /a/ versus /o/)) were recorded.

RESULTS

High or low doses of benzodiazepine had no significant effects on MMN amplitude/magnetic MMN power, topography/laterality, or latency under any conditions of the ERP or MEG study.

CONCLUSIONS

These results suggest that chronic administration of anxiolytics/hypnotics does not significantly affect MMN in schizophrenia.