A double-dissociation of English past-tense production revealed by event-related potentials and low-resolution electromagnetic tomography (LORETA)

Origins of Dissociations in the English Past Tense: A Synthetic Brain Imaging Model

Brain imaging studies of English past tense inflection have found dissociations between regular and irregular verbs, but no coherent picture has emerged to explain how these dissociations arise. Here we use synthetic brain imaging on a neural network model to provide a mechanistic account of the origins of such dissociations. The model suggests that dissociations between regional activation patterns in verb inflection emerge in an adult processing system that has been shaped through experience-dependent structural brain development. Although these dissociations appear to be between regular and irregular verbs, they arise in the model from a combination of statistical properties including frequency, relationships to other verbs, and phonological complexity, without a causal role for regularity or semantics. These results are consistent with the notion that all inflections are produced in a single associative mechanism. The model generates predictions about the patterning of active brain regions for different verbs that can be tested in future imaging studies.

Functional Connectivity Between Motor and Mid-Frontal Areas During Vicarious Reward Revealed via EEG Time-Frequency Analysis

Vicarious reward is a phenomenon in which an individual feels as if he/she has received a reward as the result of watching someone else receive a reward. In this study, we used electroencephalography to investigate brain activity while participants watched a preferred player win a competitive game (Rock-Paper-Scissors game). In the experimental task, movie clips showed right hand of the two players and played Rock-Paper-Scissors game. We asked participants to explicitly support or “cheer” for a specific player, and then examined brain activity associated with vicarious reward. For the observed hand movement, previous findings showed that the event-related desynchronization of mu band (8–14 Hz) appeared at the contra-lateral central electrode to the observed hand (If someone sees the right-hand movement, the left central electrode shows the event-related desynchronization of mu-band). During observation of the player, we detected event-related desynchronization of mu band activity in the contra-lateral central electrode as well as mid-frontal beta band (15–22 Hz) activation when the preferred player won. Furthermore, functional connectivity analysis revealed a strong phase synchronization between the contra-lateral central electrode and mid-frontal electrode in the mu band when participants received the vicarious reward. Cross-frequency coupling analysis revealed functional integration between the mu and beta bands at mid-frontal electrode. These results indicate the interaction of mu band observed at contra-lateral electrode and beta band observed at mid-frontal electrode coupling, suggesting a link between the mirror neuron system and the reward system during vicarious reward.

Morphological encoding beyond slots and fillers: An ERP study of comparative formation in English

One important organizational property of morphology is competition. Different means of expression are in conflict with each other for encoding the same grammatical function. In the current study, we examined the nature of this control mechanism by testing the formation of comparative adjectives in English during language production. Event-related brain potentials (ERPs) were recorded during cued silent production, the first study of this kind for comparative adjective formation. We specifically examined the ERP correlates of producing synthetic relative to analytic comparatives, e.g. angrier vs. more angry. A frontal, bilaterally distributed, enhanced negative-going waveform for analytic comparatives (vis-a-vis synthetic ones) emerged approximately 300ms after the (silent) production cue. We argue that this ERP effect reflects a control mechanism that constrains grammatically-based computational processes (viz. more comparative formation). We also address the possibility that this particular ERP effect may belong to a family of previously observed negativities reflecting cognitive control monitoring, rather than morphological encoding processes per se.

Morphological encoding in German children's language production: evidence from event-related brain potentials

This study reports developmental changes in morphological encoding across late childhood. We examined event-related brain potentials (ERPs) during the silent production of regularly vs. irregularly inflected verb forms (viz. -t vs. -n participles of German) in groups of eight- to ten-year-olds, eleven- to thirteen-year-olds, and adults. The adult data revealed an enhanced (right-frontal) negativity 300-450 ms after cue onset for the (silent) production of -t relative to -n past participle forms (e.g. geplant vs. gehauen 'planned' vs. 'hit'). For the eleven- to thirteen-year-olds, the same enhanced negativity was found, with a more posterior distribution and a longer duration (=300-550 ms). The eight- to ten-year-olds also showed this negativity, again with a posterior distribution, but with a considerably delayed onset (800-1,000 ms). We suggest that this negativity reflects combinatorial processing required for producing -t participles in both children and adults and that the spatial and temporal modulations of this ERP effect across the three participant groups are due to developmental changes of the brain networks involved in processing morphologically complex words.

Combining Different Tools for EEG Analysis to Study the Distributed Character of Language Processing

Recent studies on language processing indicate that language cognition is better understood if assumed to be supported by a distributed intelligent processing system enrolling neurons located all over the cortex, in contrast to reductionism that proposes to localize cognitive functions to specific cortical structures. Here, brain activity was recorded using electroencephalogram while volunteers were listening or reading small texts and had to select pictures that translate meaning of these texts. Several techniques for EEG analysis were used to show this distributed character of neuronal enrollment associated with the comprehension of oral and written descriptive texts. Low Resolution Tomography identified the many different sets (s_i) of neurons activated in several distinct cortical areas by text understanding. Linear correlation was used to calculate the information H(e_i) provided by each electrode of the 10/20 system about the identified s_i. H(e_i) Principal Component Analysis (PCA) was used to study the temporal and spatial activation of these sources s_i. This analysis evidenced 4 different patterns of H(e_i) covariation that are generated by neurons located at different cortical locations. These results clearly show that the distributed character of language processing is clearly evidenced by combining available EEG technologies.

An ER-fMRI study of Russian inflectional morphology

The generation of regular and irregular past tense verbs has long been a testing ground for different models of inflection in the mental lexicon. Behavioral studies examined a variety of languages, but neuroimaging studies rely almost exclusively on English and German data. In our fMRI experiment, participants inflected Russian verbs and nouns of different types and corresponding nonce stimuli. Irregular real and nonce verbs activated inferior frontal and inferior parietal regions more than regular verbs did, while no areas were more activated in the opposite comparison. We explain this activation pattern by increasing processing load: a parametric contrast revealed that these regions are also more activated for nonce stimuli compared to real stimuli. A very similar pattern is found for nouns. Unlike most previously obtained results, our findings are more readily compatible with the single-system approach to inflection, which does not postulate a categorical difference between regular and irregular forms.

Brain potentials during language production in children and adults: an ERP study of the English past tense

The current study examines the neural correlates of 8-to-12-year-old children and adults producing inflected word forms, specifically regular vs. irregular past-tense forms in English, using a silent production paradigm. ERPs were time-locked to a visual cue for silent production of either a regular or irregular past-tense form or a 3rd person singular present tense form of a given verb (e.g., walked/sang vs. walks/sings). Subsequently, another visual stimulus cued participants for an overt vocalization of their response. ERP results for the adult group revealed a negativity 300-450ms after the silent-production cue for regular compared to irregular past-tense forms. There was no difference in the present form condition. Children's brain potentials revealed developmental changes, with the older children demonstrating more adult-like ERP responses than the younger ones. We interpret the observed ERP responses as reflecting combinatorial processing involved in regular (but not irregular) past-tense formation.

Electrophysiological evidence for the continuous processing of linguistic categories of regular and irregular verb inflection in German

A central question concerning word recognition is whether linguistic categories are processed in continuous or categorical ways, in particular, whether regular and irregular inflection is stored and processed by the same or by distinct systems. Here, we contribute to this issue by contrasting regular (regular stem, regular suffix) with semi-irregular (regular stem, irregular suffix) and irregular (irregular stem, irregular suffix) participle formation in a visual priming experiment on German verb inflection. We measured ERPs and RTs and manipulated the inflectional and meaning relatedness between primes and targets. Inflected verb targets (e.g., leite, "head") were preceded either by themselves, by their participle (geleitet, "headed"), by a semantically related verb in the same inflection as the target (führe, "guide") or in the participle form (geführt, "guided"), or by an unrelated verb in the same inflection (nenne, "name"). Results showed that behavioral and ERP priming effects were gradually affected by verb regularity. Regular participles produced a widely distributed frontal and parietal effect, irregular participles produced a small left parietal effect, and semi-irregular participles yielded an effect in-between these two in terms of amplitude and topography. The behavioral and ERP effects further showed that the priming because of participles differs from that because of semantic associates for all verb types. These findings argue for a single processing system that generates participle priming effects for regular, semi-irregular, and irregular verb inflection. Together, the findings provide evidence that the linguistic categories of verb inflection are processed continuously. We present a single-system model that can adequately account for such graded effects.

Neural correlates of covert and overt production of tense and agreement morphology: Evidence from fMRI

Most neuroimaging studies examining verb morphology have focused on verb tense, with fewer examining agreement morphology, and no previous fMRI studies have investigated distinctions between past and present tense inflection. However, models of language representation and processing suggest differences in where these inflections are instantiated in the phrase structure as well as differences in the linguistic functions they serve, suggesting unique neural networks for these forms. In addition, results of available neuroimaging studies of grammatical morphology vary considerably due to methodological differences. Some studies have used overt production tasks, whereas others have used covert tasks. In the present study we examined brain activation associated with past tense and present tense/agreement morphology under overt and covert production conditions in 13 healthy adults using an event-related functional magnetic resonance imaging (fMRI) design. Production of verbs inflected for past tense (V + -ed) and present tense/agreement (V -s) was elicited using temporal adverbs (i.e. Yesterday, Nowadays). Results showed that in healthy adults inflecting both past tense and agreement morphology (compared to a verb stem production condition) recruited not only left inferior frontal structures, but also motor and premotor cortices, and posterior parietal regions. Activation also was observed in the basal ganglia, thalamus, and the cingulate gyrus. Past tense and present tense/agreement recruited partially overlapping tissue in these regions, with distinctions observed for the two forms in frontal and parietal brain areas. We also found that activation varied with task demands, with more extensive frontal activation noted in the overt compared to the covert verb inflection task. These results are consistent with the hypothesis that the neural signatures for verb inflection differ from that for verb stems alone and involve a distributed frontal and parietal network of brain regions. Further, the neural tissue recruited for instantiation of past tense versus present tense/agreement morphology is distinct, supporting linguistic theories that differentiate the two forms.

FMRI of past tense processing: the effects of phonological complexity and task difficulty

The generation of regular and irregular past tense verbs has been an important issue in cognitive science and has been used to advance different models of the organization of language in the brain. The dual-system view holds that the regular past tense forms are generated by a rule while irregular forms are retrieved from memory. The single-system view, on the other hand, holds that both forms are generated by a single integrated system and differ only in their reliance on factors such as phonology and semantics. We conducted an event-related fMRI study to examine the activation patterns associated with the generation and reading of regular and irregular past tense forms, in addition to the reading of their stems. Regular and irregular past tense generation activated similar brain regions compared to the reading of their respective stems. The areas activated more for irregular generation compared to regular generation included inferior frontal, precentral, and parietal regions bilaterally. This activation can be interpreted as reflecting the greater attentional and response selection demands of irregular generation. Compared to irregular generation, regular generation activated a small region in the left superior temporal gyrus when the regular and irregular past tense forms were mismatched on phonological complexity. No areas were more activated for regulars than irregulars when the past tense forms were matched on this variable. This suggests that the activation specific to regulars was related to the higher phonological complexity of their past tense forms rather than to their generation. A contrast of the reading of regular and irregular past tense forms was consistent with this hypothesis. These results support a single-system account of past tense generation.

Event related potentials and fMRI in neuropsychopharmacology

Event related potentials (ERP) are important clinical and research instruments in neuropsychiatry, particularly due to their strategic role for the investigation of brain function. These techniques are often underutilized in the evaluation of neurological and psychiatric disorders, but nevertheless they can be most useful and highly effective in the diagnostic workup of a wide range of neuropsychiatric disorders as well as in monitoring the course of the disorders and the prediction of treatment responses. ERP are noninvasive instruments that directly reflect cortical neuronal activity. Cortical neuronal dysfunction plays a major role in variable neuropsychiatric disorders, and a change in cortical activity under medication might reflect treatment response and could be useful for monitoring drug effects. ERP are the only methods with a sufficiently high time resolution for the analysis of the dynamic patterns of neuronal brain activity, e.g., synchronization and desynchronization, oscillations, coherence, gamma band activity, latency of event related activity, etc., which are crucial for a deeper understanding of functional (neurophysiological) correlates of cognitive, emotional and behavioral disturbances in neuropsychiatric patients. Methodological advances have further improved and strengthened the position of ERP concerning research and clinical application. The usefulness and applicability of ERP in determining and monitoring clinico-pharmacological effects will be summarized mainly by focussing on the auditory evoked P300 and the N1/P2 component of auditory evoked potentials. Owing to important recent developments in the field of brain functional diagnostics the combination of neurophysiological techniques and functional magnetic resonance imaging (fMRI) will be included.

fMRI of Past Tense Processing: The Effects of Phonological Complexity and Task Difficulty

The generation of regular and irregular past tense verbs has been an important issue in cognitive science and has been used to advance different models of the organization of language in the brain. The dual-system view holds that the regular past tense forms are generated by a rule while irregular forms are retrieved from memory. The single-system view, on the other hand, holds that both forms are generated by a single integrated system and differ only in their reliance on factors such as phonology and semantics. We conducted an event-related fMRI study to examine the activation patterns associated with the generation and reading of regular and irregular past tense forms, in addition to the reading of their stems. Regular and irregular past tense generation activated similar brain regions compared to the reading of their respective stems. The areas activated more for irregular generation compared to regular generation included inferior frontal, precentral, and parietal regions bilaterally. This activation can be interpreted as reflecting the greater attentional and response selection demands of irregular generation. Compared to irregular generation, regular generation activated a small region in the left superior temporal gyrus when the regular and irregular past tense forms were mismatched on phonological complexity. No areas were more activated for regulars than irregulars when the past tense forms were matched on this variable. This suggests that the activation specific to regulars was related to the higher phonological complexity of their past tense forms rather than to their generation. A contrast of the reading of regular and irregular past tense forms was consistent with this hypothesis. These results support a single-system account of past tense generation.

Imaging the past: Neural activation in frontal and temporal regions during regular and irregular past-tense processing

This article presents fMRI evidence bearing on dual-mechanism versus connectionist theories of inflectional morphology. Ten participants were scanned at 4 Tesla as they covertly generated the past tenses of real and nonce (nonword) verbs presented auditorily. Regular past tenses (e.g., walked, wugged) and irregular past tenses (e.g., took, slept) produced similar patterns of activation in the posterior temporal lobe in both hemispheres. In contrast, there was greater activation in left and right inferior frontal gyrus for regular past tenses than for irregular past tenses. Similar previous results have been taken as evidence for the dual-mechanism theory of the past tense (Pinker & Ullman, 2002). However, additional analyses indicated that irregulars that were phonologically similar to regulars (e.g., slept, fled, sold) produced the same level of activation as did regulars, and significantly more activation than did irregulars that were not phonologically similar to regulars (e.g., took, gave). Thus, activation patterns were predicted by phonological characteristics of the past tense rather than by the rule-governed versus exception distinction that is central to the dual-mechanism framework. The results are consistent with a constraint satisfaction model in which phonological, semantic, and other probabilistic constraints jointly determine the past tense, with different degrees of involvement for different verbs.

Comparison of simultaneously recorded [H2(15)O]-PET and LORETA during cognitive and pharmacological activation

The complementary strengths and weaknesses of established functional brain imaging methods (high spatial, low temporal resolution) and EEG-based techniques (low spatial, high temporal resolution) make their combined use a promising avenue for studying brain processes at a more fine-grained level. However, this strategy requires a better understanding of the relationship between hemodynamic/metabolic and neuroelectric measures of brain activity. We investigated possible correspondences between cerebral blood flow (CBF) as measured by [H2O]-PET and intracerebral electric activity computed by Low Resolution Brain Electromagnetic Tomography (LORETA) from scalp-recorded multichannel EEG in healthy human subjects during cognitive and pharmacological stimulation. The two imaging modalities were compared by descriptive, correlational, and variance analyses, the latter carried out using statistical parametric mapping (SPM99). Descriptive visual comparison showed a partial overlap between the sets of active brain regions detected by the two modalities. A number of exclusively positive correlations of neuroelectric activity with regional CBF were found across the whole EEG frequency range, including slow wave activity, the latter finding being in contrast to most previous studies conducted in patients. Analysis of variance revealed an extensive lack of statistically significant correspondences between brain activity changes as measured by PET vs. EEG-LORETA. In general, correspondences, to the extent they were found, were dependent on experimental condition, brain region, and EEG frequency.

Rapid discrimination of visual and multisensory memories revealed by electrical neuroimaging

Though commonly held that multisensory experiences enrich our memories and that memories influence ongoing sensory processes, their neural mechanisms remain unresolved. Here, electrical neuroimaging shows that auditory-visual multisensory experiences alter subsequent processing of unisensory visual stimuli during the same block of trials at early stages poststimulus onset and within visual object recognition areas. We show this with a stepwise analysis of scalp-recorded event-related potentials (ERPs) that statistically tested (1) ERP morphology and amplitude, (2) global electric field power, (3) topographic stability of and changes in the electric field configuration, and (4) intracranial distributed linear source estimations. Subjects performed a continuous recognition task, discriminating repeated vs. initial image presentations. Corresponding, but task-irrelevant, sounds accompanied half of the initial presentations during a given block of trials. On repeated presentations within a block of trials, only images appeared, yielding two situations-the image's prior presentation was only visual or with a sound. Image repetitions that had been accompanied by sounds yielded improved memory performance accuracy (old or new discrimination) and were differentiated as early as approximately 60-136 ms from images that had not been accompanied by sounds through generator changes in areas of the right lateral-occipital complex (LOC). It thus appears that unisensory percepts trigger multisensory representations associated with them. The collective data support the hypothesis that perceptual or memory traces for multisensory auditory-visual events involve a distinct cortical network that is rapidly activated by subsequent repetition of just the unisensory visual component.

Brain electrical dysfunction of the anterior cingulate in schizophrenic patients

The anterior cingulate cortex (ACC) is a key region within the human prefrontal cortex that has been shown to be dysfunctional in schizophrenic patients. Supporting evidence for this notion has been collected with neuroimaging methods during various cognitive activation tasks. Recently, electrophysiological ACC activity has been demonstrated by means of a three-dimensional source location with low resolution electromagnetic tomography (LORETA) in the event-related potentials elicited during the NoGo condition of the Continuous Performance Test (CPT) as compared to its Go condition. Thirty-one schizophrenic patients and 31 age- and gender-matched healthy volunteers were investigated with this newly developed electrophysiological method. LORETA analysis revealed a significantly diminished brain electrical activity in the ACC of schizophrenic patients as compared to controls during the NoGo condition of the CPT. This result supports the assumption of a functional deficit of the ACC during this cognitive task as a central feature in schizophrenias and, thereby, specifies the general concept of hypofrontality. Moreover, this investigation underscores the value of sophisticated electrophysiological methods in combination with unambiguously designed mental tasks for the evaluation of the pathophysiological processes underlying schizophrenic diseases.

High-resolution time course of hemispheric dominance revealed by low-resolution electromagnetic tomography

OBJECTIVE

Auditory event-related brain potentials (ERPs) were recorded during a lexical decision task in response to linguistic and non-linguistic stimuli, to assess the detailed time course of language processing in general, and hemispheric dominance in particular.

METHODS

Young adults (n=17) were presented with pairs of auditory stimuli consisting of words, pseudowords and words played backwards in a lexical decision task. ERPs were recorded from 21 scalp electrodes. Current densities were calculated using low-resolution electromagnetic tomography (LORETA). Statistic non-parametric maps of activity were derived from the calculated current densities and the number of active brain voxels in the left and right hemispheres was compared throughout the processing of each stimulus.

RESULTS

Our results show that hemispheric dominance is highly time dependent, alternating between the right and left hemispheres at different times, and that the right hemisphere's role in language processing follows a different time course for first and second language. The time course of hemispheric dominance for non-linguistic stimuli was highly variable.

CONCLUSIONS

The time course of hemispheric dominance is dynamic, alternating between left and right homologous regions, with different time courses for different stimulus classes.

Spatiotemporal maps of past-tense verb inflection

Does the brain inflect verbs by applying rules, by associative retrieval of the inflected form, or both? We used whole-head magnetoencephalography to spatiotemporally map the brain response underlying verb past-tense inflection. Placing either regular or irregular verbs into the past tense sequentially modulates the bilateral visual, left inferotemporal, posterior superior temporal (Wernicke's area), left inferior prefrontal (Broca's area), and right prefrontal cortices. Although irregular and regular verb inflection evokes similar cortical response patterns, differences in specific frontotemporal regions are observed. At approximately 340 ms, irregular verbs evoke greater response modulation in left occipitotemporal cortex. This modulation occurs when widespread areas are simultaneously active, suggesting that it reflects associative activation necessary for generation of past-tense forms. Subsequently, regular verbs show increased response at approximately 470 ms within left inferior prefrontal regions associated with rule-based inflection. Increased right dorsolateral prefrontal response at approximately 570 ms may represent directed/effortful retrieval of irregular past-tense forms. Thus, the brain inflects verbs by dynamically modulating different functional divisions of an integrated language system.