Task modulation of brain responses in visual word recognition as studied using EEG/MEG and fMRI

Mapping Contributions of the Anterior Temporal Semantic Hub to the Processing of Abstract and Concrete Verbs

Multiple representation theories of semantic processing propose that word meaning is supported by simulated sensorimotor experience in modality-specific neural regions, as well as in cognitive systems that involve processing of linguistic, emotional, and introspective information. According to the hub-and-spoke model of semantic memory, activity from these distributed cortical areas feeds into a primary semantic hub located in the ventral anterior temporal lobe (vATL). In the present pre-registered study, we examined whether different types of abstract verbs (mental, emotional and nonembodied) and concrete (embodied) verbs all engage the vATL, and also whether they differentially recruit a broader set of distributed neurocognitive systems (consistent with multiple representation theories). Finally, we investigated whether there is information about different verb types distributed across the broader ATL region, consistent with a Graded Semantic Hub Hypothesis. We collected data from 30 participants who completed a syntactic classification task (is it a verb? Yes or no) and a numerical judgment task which served as an active but less semantic baseline task. Whole brain univariate analyses revealed consistent BOLD signal throughout the canonical semantic network, including the left inferior frontal gyrus, left middle temporal gyrus, and the vATL. All types of abstract verbs engaged the vATL except for mental state verbs. Finally, a multivariate pattern analysis revealed clusters within the ATL that were differentially engaged when processing each type of abstract verb. Our findings extend previous research and suggest that the hub-and-spoke hypothesis and the graded semantic hub hypothesis provide a neurobiologically constrained model of semantics that can account for abstract verb representation and processing.

The time course of cross-modal representations of conceptual categories

To what extent does language production activate cross-modal conceptual representations? In picture naming, we view specific exemplars of concepts and then name them with a label, like "dog". In overt reading, the written word does not express a specific exemplar. Here we used a decoding approach with magnetoencephalography (MEG) to address whether picture naming and overt word reading involve shared representations of superordinate categories (e.g., animal). This addresses a fundamental question about the modality-generality of conceptual representations and their temporal evolution. Crucially, we do this using a language production task that does not require explicit categorization judgment and that controls for word form properties across semantic categories. We trained our models to classify the animal/tool distinction using MEG data of one modality at each time point and then tested the generalization of those models on the other modality. We obtained evidence for the automatic activation of cross-modal semantic category representations for both pictures and words later than their respective modality-specific representations. Cross-modal representations were activated at 150 ms and lasted until around 450 ms. The time course of lexical activation was also assessed revealing that semantic category is represented before lexical access for pictures but after lexical access for words. Notably, this earlier activation of semantic category in pictures occurred simultaneously with visual representations. We thus show evidence for the spontaneous activation of cross-modal semantic categories in picture naming and word reading. These results serve to anchor a more comprehensive spatio-temporal delineation of the semantic feature space during production planning.

Visual event-related potentials reveal the early whole-word lexical processing of Chinese two-character words

Morphologically complex words are common across different languages, especially in Chinese, because more than 90% of common modern Chinese words are complex words. Many behavioral studies have suggested the whole-word processing of Chinese complex words, but the neural correlates of whole-word processing remain unclear. Previous electrophysiological studies revealed automatic and early (∼250 ms) access to the orthographic forms of monomorphic words in the ventral occipitotemporal area. In this study, we investigated whether there is also automatic and early orthographic recognition of Chinese complex words (as whole units) by recording event-related potentials (ERPs). A total of 150 two-character words and 150 two-character pseudowords composed of the same 300 characters (morphemes) were pseudorandomly presented to proficient Chinese readers. Participants were required to determine the color of each stimulus in the color decision task and to determine whether each stimulus was a word in the lexical decision task. The two constituent characters of each stimulus were horizontally arranged in Experiment 1 and vertically arranged in Experiment 2. The results revealed a significant early ERP difference between words and pseudowords approximately 250-300 ms after stimulus onset in the parieto-occipital scalp region. The early ERP difference was more prominent in the color decision task than in the lexical decision task, more prominent in Experiment 1 than in Experiment 2, and more prominent in the left parieto-occipital scalp region than in the right. Source analysis results showed that the early ERP difference originated from the left ventral occipitotemporal cortex. These results reflected early and automatic access to whole-word orthographic representations of Chinese complex words in the left ventral occipitotemporal cortex.

Early lexical processing of Chinese one-character words and Mongolian words: A comparative study using event-related potentials

Logographic language and alphabetic language differ significantly in orthography. Investigating the commonality and particularity of visual word recognition between the two distinct writing systems is informative for understating the neural mechanisms underlying visual word recognition. In the present study, we compared the chronometry of early lexical processing and the brain regions involved in early lexical processing between Chinese (logographic language) and Mongolian (alphabetic language) by recording event-related potentials (ERPs) using both implicit and explicit reading tasks. Familiar Chinese one-character words (lexical) and unknown Chinese one-character words (non-lexical) were pseudorandomly presented to native Chinese readers in Experiment 1. Mongolian words (lexical) and pseudowords (non-lexical) were pseudorandomly presented to native Mongolian readers in Experiment 2. In the color decision task, participants were asked to decide the color (black or blue) of each stimulus. In the lexical recognition task, participants were asked to report whether they could recognize each stimulus. The results showed that in both experiments and both tasks, ERPs to lexical items differed significantly from those to non-lexical items in the parietooccipital scalp region approximately 250 ms after stimulus onset, reflecting the early lexical processing, which likely originated from the ventral occipitotemporal cortex as revealed by source analysis. These results indicated that although Chinese and Mongolian differed markedly in orthographic features, the neural mechanisms underlying early lexical processing are similar between the two languages.

Multiple functions of the angular gyrus at high temporal resolution

Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.

Task modulation of spatiotemporal dynamics in semantic brain networks: An EEG/MEG study

How does brain activity in distributed semantic brain networks evolve over time, and how do these regions interact to retrieve the meaning of words? We compared spatiotemporal brain dynamics between visual lexical and semantic decision tasks (LD and SD), analysing whole-cortex evoked responses and spectral functional connectivity (coherence) in source-estimated electroencephalography and magnetoencephalography (EEG and MEG) recordings. Our evoked analysis revealed generally larger activation for SD compared to LD, starting in primary visual area (PVA) and angular gyrus (AG), followed by left posterior temporal cortex (PTC) and left anterior temporal lobe (ATL). The earliest activation effects in ATL were significantly left-lateralised. Our functional connectivity results showed significant connectivity between left and right ATL, PTC and right ATL in an early time window, as well as between left ATL and IFG in a later time window. The connectivity of AG was comparatively sparse. We quantified the limited spatial resolution of our source estimates via a leakage index for careful interpretation of our results. Our findings suggest that the different demands on semantic information retrieval in lexical and semantic decision tasks first modulate visual and attentional processes, then multimodal semantic information retrieval in the ATLs and finally control regions (PTC and IFG) in order to extract task-relevant semantic features for response selection. Whilst our evoked analysis suggests a dominance of left ATL for semantic processing, our functional connectivity analysis also revealed significant involvement of right ATL in the more demanding semantic task. Our findings demonstrate the complementarity of evoked and functional connectivity analysis, as well as the importance of dynamic information for both types of analyses.

Visual event-related potentials reveal the early lexical processing of Chinese characters

Logographic scripts such as Chinese differ markedly from alphabetic scripts. The time-course of the lexical processing of alphabetic words was widely studied by recording event-related potentials (ERPs), and the results indicated that alphabetic words are rapidly and automatically processed. This study investigated whether there is also rapid and automatic lexical processing of Chinese characters by recording ERPs. High-frequency (HF) characters and orthographically similar low-frequency (LF) characters were pseudo-randomly presented to proficient Chinese readers. The color of half of the characters was blue and the color of the other half was black. In the color decision task, participants were asked to determine the color of each character. In the lexical recognition task, participants were asked to report whether s/he knew each character (the LF characters in this study were very rare characters which were usually not recognized by proficient Chinese readers). In both tasks, the N170 elicited by HF characters peaked earlier than the N170 elicited by LF characters in the right parieto-occipital area (PO8), and the ERPs to HF characters diverged from the ERPs to LF characters around 210-222 ms after the stimulus onset. These results reflected the rapid and automatic lexical processing of Chinese characters. Source analysis results suggested that the left and the right occipitotemporal cortices and the right visual cortex were the neural origins of the early lexical processing of Chinese characters, and the peak activation was in the right visual cortex.

Early Top-Down Modulation in Visual Word Form Processing: Evidence From an Intracranial SEEG Study

Visual word recognition, at a minimum, involves the processing of word form and lexical information. Opinions diverge on the spatiotemporal distribution of and interaction between the two types of information. Feedforward theory argues that they are processed sequentially, whereas interactive theory advocates that lexical information is processed fast and modulates early word form processing. To distinguish between the two theories, we applied stereoelectroencephalography (SEEG) to 33 human adults with epilepsy (25 males and eight females) during visual lexical decisions. The stimuli included real words (RWs), pseudowords (PWs) with legal radical positions, nonwords (NWs) with illegal radical positions, and stroked-changed words (SWs) in Chinese. Word form and lexical processing were measured by the word form effect (PW versus NW) and lexical effect (RW versus PW), respectively. Gamma-band (60 ∼ 140 Hz) SEEG activity was treated as an electrophysiological measure. A word form effect was found in eight left brain regions (i.e., the inferior parietal lobe, insula, fusiform, inferior temporal, middle temporal, middle occipital, precentral and postcentral gyri) from 50 ms poststimulus onset, whereas a lexical effect was observed in five left brain regions (i.e., the calcarine, middle temporal, superior temporal, precentral, and postcentral gyri) from 100 ms poststimulus onset. The two effects overlapped in the precentral (300 ∼ 500 ms) and postcentral (100 ∼ 200 ms and 250 ∼ 600 ms) gyri. Moreover, high-level regions provide early feedback to word form regions. These results demonstrate that lexical processing occurs early and modulates word form recognition, providing vital supportive evidence for interactive theory.SIGNIFICANCE STATEMENT A pivotal unresolved dispute in the field of word processing is whether word form recognition is obligatorily modulated by high-level lexical top-down information. To address this issue, we applied intracranial SEEG to 33 adults with epilepsy to precisely delineate the spatiotemporal dynamics between processing word form and lexical information during visual word recognition. We observed that lexical processing occurred from 100 ms poststimulus presentation and even spatiotemporally overlapped with word form processing. Moreover, the high-order regions provided feedback to the word form regions in the early stage of word recognition. These results revealed the crucial role of high-level lexical information in word form recognition, deepening our understanding of the functional coupling among brain regions in word processing networks.

Automaticity in the reading circuitry

Skilled reading requires years of practice associating visual symbols with speech sounds. Over the course of the learning process, this association becomes effortless and automatic. Here we test whether automatic activation of spoken-language circuits in response to visual words is a hallmark of skilled reading. Magnetoencephalography was used to measure word-selective responses under multiple cognitive tasks (N = 42, 7-12 years of age). Even when attention was drawn away from the words by performing an attention-demanding fixation task, strong word-selective responses were found in a language region (i.e., superior temporal gyrus) starting at ~300 ms after stimulus onset. Critically, this automatic word-selective response was indicative of reading skill: the magnitude of word-selective responses correlated with individual reading skill. Our results suggest that automatic recruitment of spoken-language circuits is a hallmark of skilled reading; with practice, reading becomes effortless as the brain learns to automatically translate letters into sounds and meaning.

High-density intracranial recordings reveal a distinct site in anterior dorsal precentral cortex that tracks perceived speech

Various brain regions are implicated in speech processing, and the specific function of some of them is better understood than others. In particular, involvement of the dorsal precentral cortex (dPCC) in speech perception remains debated, and attribution of the function of this region is more or less restricted to motor processing. In this study, we investigated high-density intracranial responses to speech fragments of a feature film, aiming to determine whether dPCC is engaged in perception of continuous speech. Our findings show that dPCC exhibited preference to speech over other tested sounds. Moreover, the identified area was involved in tracking of speech auditory properties including speech spectral envelope, its rhythmic phrasal pattern and pitch contour. DPCC also showed the ability to filter out noise from the perceived speech. Comparing these results to data from motor experiments showed that the identified region had a distinct location in dPCC, anterior to the hand motor area and superior to the mouth articulator region. The present findings uncovered with high-density intracranial recordings help elucidate the functional specialization of PCC and demonstrate the unique role of its anterior dorsal region in continuous speech perception.

Distinct fronto-temporal substrates of distributional and taxonomic similarity among words: evidence from RSA of BOLD signals

A class of semantic theories defines concepts in terms of statistical distributions of lexical items, basing meaning on vectors of word co-occurrence frequencies. A different approach emphasizes abstract hierarchical taxonomic relationships among concepts. However, the functional relevance of these different accounts and how they capture information-encoding of lexical meaning in the brain still remains elusive. We investigated to what extent distributional and taxonomic models explained word-elicited neural responses using cross-validated representational similarity analysis (RSA) of functional magnetic resonance imaging (fMRI) and model comparisons. Our findings show that the brain encodes both types of semantic information, but in distinct cortical regions. Posterior middle temporal regions reflected lexical-semantic similarity based on hierarchical taxonomies, in coherence with the action-relatedness of specific semantic word categories. In contrast, distributional semantics best predicted the representational patterns in left inferior frontal gyrus (LIFG, BA 47). Both representations coexisted in the angular gyrus supporting semantic binding and integration. These results reveal that neuronal networks with distinct cortical distributions across higher-order association cortex encode different representational properties of word meanings. Taxonomy may shape long-term lexical-semantic representations in memory consistently with the sensorimotor details of semantic categories, whilst distributional knowledge in the LIFG (BA 47) may enable semantic combinatorics in the context of language use. Our approach helps to elucidate the nature of semantic representations essential for understanding human language.

Interaction of top-down category-level expectation and bottom-up sensory input in early stages of visual-orthographic processing

How and when top-down information modulates visual-orthographic processing is an essential question in reading research. In a previous study, we showed that task modulation of print-tuning started at around 170 ms after stimulus presentation in the N1 offset of the ERP, while the N1 onset was yet unaffected. Here we test how prior category-level expectation affects visual-orthographic processing. Familiar, left/right-structured Chinese characters and stroke number matched, unfamiliar Korean characters were presented, while expectation about the upcoming stimuli was manipulated with green and blue colored frames (high Chinese vs. high Korean expectation). EEG data of 18 native Chinese speakers were recorded while participants performed an expectation judgment task. Results from occipito-temporal and whole map analyses revealed that effects of prior expectation changed throughout the N1. Accordingly in the N1 onset, a print tuning main effect was found, with a stronger N1 to Chinese characters than Korean characters, irrespective of expectation. In the N1 offset, an expectation-by-character interaction was observed at the whole map level, with a more negative N1 to Korean characters than Chinese characters when expecting a Chinese character, but no such difference when expecting a Korean character. Moreover, the expectation-by-character interaction continued to the N250, with similar responses to Chinese and Korean characters under the Chinese expectation condition, while less negative N250 to Korean than Chinese under the Korean expectation condition. Taken together, the current study provides evidence that prior category-level expectation starts to take effect at an early stage even within 200 ms by facilitating the processing of expected stimuli, suggesting that category-level expectation can influence early visual-orthographic processing during word recognition.

Permutation Statistics for Connectivity Analysis between Regions of Interest in EEG and MEG Data

Connectivity estimates based on electroencephalography (EEG) and magnetoencephalography (MEG) are unique in their ability to provide neurophysiologically meaningful spectral and temporal information non-invasively. This multi-dimensional aspect of the MEG/EEG based connectivity increases the challenges of the analysis and interpretation of the data. Many MEG/EEG studies address this complexity by using a hypothesis-driven approach, which focuses on particular regions of interest (ROI). However, if an effect is distributed unevenly over a large ROI and variable across subjects, it may not be detectable using conventional methods. Here, we propose a novel approach, which enhances the statistical power for weak and spatially discontinuous effects. This results in the ability to identify statistically significant connectivity patterns with spectral, temporal, and spatial specificity while correcting for multiple comparisons using nonparametric permutation methods. We call this new approach the Permutation Statistics for Connectivity Analysis between ROI (PeSCAR). We demonstrate the processing steps with simulated and real human data. The open-source Matlab code implementing PeSCAR are provided online.

Steady state visual evoked potentials in reading aloud: Effects of lexicality, frequency and orthographic familiarity

The present study explored the possibility to use Steady-State Visual Evoked Potentials (SSVEPs) as a tool to investigate the core mechanisms in visual word recognition. In particular, we investigated three benchmark effects of reading aloud: lexicality (words vs. pseudowords), frequency (high-frequency vs. low-frequency words), and orthographic familiarity ('familiar' versus 'unfamiliar' pseudowords). We found that words and pseudowords elicited robust SSVEPs. Words showed larger SSVEPs than pseudowords and high-frequency words showed larger SSVEPs than low-frequency words. SSVEPs were not sensitive to orthographic familiarity. We further localized the neural generators of the SSVEP effects. The lexicality effect was located in areas associated with early level of visual processing, i.e. in the right occipital lobe and in the right precuneus. Pseudowords produced more activation than words in left sensorimotor areas, rolandic operculum, insula, supramarginal gyrus and in the right temporal gyrus. These areas are devoted to speech processing and/or spelling-to-sound conversion. The frequency effect involved the left temporal pole and orbitofrontal cortex, areas previously implicated in semantic processing and stimulus-response associations respectively, and the right postcentral and parietal inferior gyri, possibly indicating the involvement of the right attentional network.

Early Brain Sensitivity to Word Frequency and Lexicality During Reading Aloud and Implicit Reading

The present study investigated the influence of lexical word properties on the early stages of visual word processing (<250 ms) and how the dynamics of lexical access interact with task-driven top-down processes. We compared the brain's electrical response (event-related potentials, ERPs) of 39 proficient adult readers for the effects of word frequency and word lexicality during an explicit reading task versus a visual immediate-repetition detection task where no linguistic intention is required. In general, we observed that left-lateralized processes linked to perceptual expertise for reading are task independent. Moreover, there was no hint of a word frequency effect in early ERPs, while there was a lexicality effect which was modulated by task demands: during implicit reading, we observed larger N1 negativity in the ERP to real words compared to pseudowords, but in contrast, this modulation by stimulus type was absent for the explicit reading aloud task (where words yielded the same activation as pseudowords). Thus, data indicate that the brain's response to lexical properties of a word is open to influences from top-down processes according to the representations that are relevant for the task, and this occurs from the earliest stages of visual recognition (within ~200 ms). We conjectured that the loci of these early top-down influences identified for implicit reading are probably restricted to lower levels of processing (such as whole word orthography) rather than the process of lexical access itself.

Is reading automatic? Are the ERP correlates of masked priming really lexical?

Humans have an almost unbounded ability to adapt their behaviour to perform different tasks. In the laboratory, this flexibility is sometimes viewed as a nuisance factor that prevents access to the underlying cognitive mechanisms of interest. For example, in order to study "automatic" lexical processing, psycholinguists have used masked priming or evoked potentials. However, the pattern of masked priming can be radically altered by changing the task. In lexical decision, priming is observed for words but not for nonwords, yet in a same-different matching task, priming is observed for same responses but not for different responses, regardless of whether the target is a word or a nonword [Norris & Kinoshita, 2008. Perception as evidence accumulation and Bayesian inference: Insights from masked priming. Journal of Experimental Psychology: General, 137(3), 434-55. doi:10.1037/a0012799]. Here we show that evoked potentials are equally sensitive to the nature of required decision, with the neural activity normally associated with lexical processing being seen for both words and nonwords on same trials, and for neither on different trials.

The Mental Representation of Polysemy across Word Classes

Experimental studies on polysemy have come to contradictory conclusions on whether words with multiple senses are stored as separate or shared mental representations. The present study examined the semantic relatedness and semantic similarity of literal and non-literal (metonymic and metaphorical) senses of three word classes: nouns, verbs, and adjectives. Two methods were used: a psycholinguistic experiment and a distributional analysis of corpus data. In the experiment, participants were presented with 6-12 short phrases containing a polysemous word in literal, metonymic, or metaphorical senses and were asked to classify them so that phrases with the same perceived sense were grouped together. To investigate the impact of professional background on their decisions, participants were controlled for linguistic vs. non-linguistic education. For nouns and verbs, all participants preferred to group together phrases with literal and metonymic senses, but not any other pairs of senses. For adjectives, two pairs of senses were often grouped together: literal with metonymic, and metonymic with metaphorical. Participants with a linguistic background were more accurate than participants with non-linguistic backgrounds, although both groups shared principal patterns of sense classification. For the distributional analysis of corpus data, we used a semantic vector approach to quantify the similarity of phrases with literal, metonymic, and metaphorical senses in the corpora. We found that phrases with literal and metonymic senses had the highest degree of similarity for the three word classes, and that metonymic and metaphorical senses of adjectives had the highest degree of similarity among all word classes. These findings are in line with the experimental results. Overall, the results suggest that the mental representation of a polysemous word depends on its word class. In nouns and verbs, literal and metonymic senses are stored together, while metaphorical senses are stored separately; in adjectives, metonymic senses significantly overlap with both literal and metaphorical senses.

The consonant/vowel pattern determines the structure of orthographic representations in the left fusiform gyrus

Recent findings demonstrated readers' sensitivity to the distinction between consonant and vowel letters. Especially, the way consonants and vowels are organised within written words determines their perceptual structure. The present work attempted to overcome two limitations of previous studies by examining the neurophysiological correlates of this perceptual structure through magnetoencephalography (MEG). One aim was to establish that the extraction of vowel-centred units takes place during early stages of processing. The second objective was to confirm that the vowel-centred structure pertains to the word recognition system and may constitute one level in a hierarchy of neural detectors coding orthographic strings. Participants performed a cross-case matching task in which they had to judge pairs of stimuli as identical or different. The critical manipulation concerned pairs obtained by transposing two letters, so that the vowel-centred structure was either preserved (FOUVERT-fovuert, two vowel letter clusters) or modified (BOUVRET-bovuret). Mismatches were detected faster when the structure was modified. This effect was associated with a significant difference in evoked neuromagnetic fields extending from 129 to 239 msec after the stimulation. Source localization indicated a significant effect in the visual word form area around 200 msec. The results confirm the hypothesis that the vowel-centred structure is extracted during the early phases of letter string processing and that it is encoded in left fusiform regions devoted to visual word recognition.

Only time will tell - why temporal information is essential for our neuroscientific understanding of semantics

Theoretical developments about the nature of semantic representations and processes should be accompanied by a discussion of how these theories can be validated on the basis of empirical data. Here, I elaborate on the link between theory and empirical research, highlighting the need for temporal information in order to distinguish fundamental aspects of semantics. The generic point that fast cognitive processes demand fast measurement techniques has been made many times before, although arguably more often in the psychophysiological community than in the metabolic neuroimaging community. Many reviews on the neuroscience of semantics mostly or even exclusively focus on metabolic neuroimaging data. Following an analysis of semantics in terms of the representations and processes involved, I argue that fundamental theoretical debates about the neuroscience of semantics can only be concluded on the basis of data with sufficient temporal resolution. Any "semantic effect" may result from a conflation of long-term memory representations, retrieval and working memory processes, mental imagery, and episodic memory. This poses challenges for all neuroimaging modalities, but especially for those with low temporal resolution. It also throws doubt on the usefulness of contrasts between meaningful and meaningless stimuli, which may differ on a number of semantic and non-semantic dimensions. I will discuss the consequences of this analysis for research on the role of convergence zones or hubs and distributed modal brain networks, top-down modulation of task and context as well as interactivity between levels of the processing hierarchy, for example in the framework of predictive coding.

Neural correlates of bilingual language control during interlingual homograph processing in a logogram writing system

Bilingual studies using alphabetic languages have shown parallel activation of two languages during word recognition. However, little is known about the brain mechanisms of language control during word comprehension with a logogram writing system. We manipulated the types of words (interlingual homographs (IH), cognates, and language-specific words) and the types of participants (Chinese (L1)-Japanese (L2) bilinguals vs. Japanese monolinguals). Greater activation was found in the bilateral inferior frontal gyri, supplementary motor area, caudate nucleus and left fusiform gyrus, when the bilinguals processed IH, as compared to cognates. These areas were also commonly activated when the bilinguals processed L2 control words during an L1 lexical decision task. The areas function as the task/decision system that plays a role in cognitive control for resolving response conflict. Furthermore, the anterior cingulate cortex, left thalamus, and left middle temporal gyrus were activated during IH processing, suggesting resolution of the semantic conflict at the stimulus level (i.e., one logographic word having different meanings in the two languages).

The 'when' and 'where' of semantic coding in the anterior temporal lobe: Temporal representational similarity analysis of electrocorticogram data

Electrocorticograms (ECoG) provide a unique opportunity to monitor neural activity directly at the cortical surface. Ten patients with subdural electrodes covering ventral and lateral anterior temporal regions (ATL) performed a picture naming task. Temporal representational similarity analysis (RSA) was used, for the first time, to compare spatio-temporal neural patterns from the ATL surface with pre-defined theoretical models. The results indicate that the neural activity in the ventral subregion of the ATL codes semantic representations from 250 msec after picture onset. The observed activation similarity was not related to the visual similarity of the pictures or the phonological similarity of their names. In keeping with convergent evidence for the importance of the ATL in semantic processing, these results provide the first direct evidence of semantic coding from the surface of the ventral ATL and its time-course.

Perceived communicative context and emotional content amplify visual word processing in the fusiform gyrus

The personal significance of a language statement depends on its communicative context. However, this is rarely taken into account in neuroscience studies. Here, we investigate how the implied source of single word statements alters their cortical processing. Participants' brain event-related potentials were recorded in response to identical word streams consisting of positive, negative, and neutral trait adjectives stated to either represent personal trait feedback from a human or to be randomly generated by a computer. Results showed a strong impact of perceived sender. Regardless of content, the notion of receiving feedback from a human enhanced all components, starting with the P2 and encompassing early posterior negativity (EPN), P3, and the late positive potential (LPP). Moreover, negative feedback by the "human sender" elicited a larger EPN, whereas positive feedback generally induced a larger LPP. Source estimations revealed differences between "senders" in visual areas, particularly the bilateral fusiform gyri. Likewise, emotional content enhanced activity in these areas. These results specify how even implied sender identity changes the processing of single words in seemingly realistic communicative settings, amplifying their processing in the visual brain. This suggests that the concept of motivated attention extends from stimulus significance to simultaneous appraisal of contextual relevance. Finally, consistent with distinct stages of emotional processing, at least in contexts perceived as social, humans are initially alerted to negative content, but later process what is perceived as positive feedback more intensely.

Lexical is as lexical does: computational approaches to lexical representation

In much of neuroimaging and neuropsychology, regions of the brain have been associated with 'lexical representation', with little consideration as to what this cognitive construct actually denotes. Within current computational models of word recognition, there are a number of different approaches to the representation of lexical knowledge. Structural lexical representations, found in original theories of word recognition, have been instantiated in modern localist models. However, such a representational scheme lacks neural plausibility in terms of economy and flexibility. Connectionist models have therefore adopted distributed representations of form and meaning. Semantic representations in connectionist models necessarily encode lexical knowledge. Yet when equipped with recurrent connections, connectionist models can also develop attractors for familiar forms that function as lexical representations. Current behavioural, neuropsychological and neuroimaging evidence shows a clear role for semantic information, but also suggests some modality- and task-specific lexical representations. A variety of connectionist architectures could implement these distributed functional representations, and further experimental and simulation work is required to discriminate between these alternatives. Future conceptualisations of lexical representations will therefore emerge from a synergy between modelling and neuroscience.

Early Visual Word Processing Is Flexible: Evidence from Spatiotemporal Brain Dynamics

Visual word recognition is often described as automatic, but the functional locus of top-down effects is still a matter of debate. Do task demands modulate how information is retrieved, or only how it is used? We used EEG/MEG recordings to assess whether, when, and how task contexts modify early retrieval of specific psycholinguistic information in occipitotemporal cortex, an area likely to contribute to early stages of visual word processing. Using a parametric approach, we analyzed the spatiotemporal response patterns of occipitotemporal cortex for orthographic, lexical, and semantic variables in three psycholinguistic tasks: silent reading, lexical decision, and semantic decision. Task modulation of word frequency and imageability effects occurred simultaneously in ventral occipitotemporal regions-in the vicinity of the putative visual word form area-around 160 msec, following task effects on orthographic typicality around 100 msec. Frequency and typicality also produced task-independent effects in anterior temporal lobe regions after 200 msec. The early task modulation for several specific psycholinguistic variables indicates that occipitotemporal areas integrate perceptual input with prior knowledge in a task-dependent manner. Still, later task-independent effects in anterior temporal lobes suggest that word recognition eventually leads to retrieval of semantic information irrespective of task demands. We conclude that even a highly overlearned visual task like word recognition should be described as flexible rather than automatic.

Seeing the same words differently: the time course of automaticity and top-down intention in reading

We investigated how linguistic intention affects the time course of visual word recognition by comparing the brain's electrophysiological response to a word's lexical frequency, a well-established psycholinguistic marker of lexical access, when participants actively retrieve the meaning of the written input (semantic categorization) versus a situation where no language processing is necessary (ink color categorization). In the semantic task, the ERPs elicited by high-frequency words started to diverge from those elicited by low-frequency words as early as 120 msec after stimulus onset. On the other hand, when categorizing the colored font of the very same words in the color task, word frequency did not modulate ERPs until some 100 msec later (220 msec poststimulus onset) and did so for a shorter period and with a smaller scalp distribution. The results demonstrate that, although written words indeed elicit automatic recognition processes in the brain, the speed and quality of lexical processing critically depends on the top-down intention to engage in a linguistic task.

Task dependence of visual and category representations in prefrontal and inferior temporal cortices

Visual categorization is an essential perceptual and cognitive process for assigning behavioral significance to incoming stimuli. Categorization depends on sensory processing of stimulus features as well as flexible cognitive processing for classifying stimuli according to the current behavioral context. Neurophysiological studies suggest that the prefrontal cortex (PFC) and the inferior temporal cortex (ITC) are involved in visual shape categorization. However, their precise roles in the perceptual and cognitive aspects of the categorization process are unclear, as the two areas have not been directly compared during changing task contexts. To address this, we examined the impact of task relevance on categorization-related activity in PFC and ITC by recording from both areas as monkeys alternated between a shape categorization and passive viewing tasks. As monkeys viewed the same stimuli in both tasks, the impact of task relevance on encoding in each area could be compared. While both areas showed task-dependent modulations of neuronal activity, the patterns of results differed markedly. PFC, but not ITC, neurons showed a modest increase in firing rates when stimuli were task relevant. PFC also showed significantly stronger category selectivity during the task compared with passive viewing, while task-dependent modulations of category selectivity in ITC were weak and occurred with a long latency. Finally, both areas showed an enhancement of stimulus selectivity during the task compared with passive viewing. Together, this suggests that the ITC and PFC show differing degrees of task-dependent flexibility and are preferentially involved in the perceptual and cognitive aspects of the categorization process, respectively.

Nouns, verbs, objects, actions, and abstractions: local fMRI activity indexes semantics, not lexical categories

Noun/verb dissociations in the literature defy interpretation due to the confound between lexical category and semantic meaning; nouns and verbs typically describe concrete objects and actions. Abstract words, pertaining to neither, are a critical test case: dissociations along lexical-grammatical lines would support models purporting lexical category as the principle governing brain organisation, whilst semantic models predict dissociation between concrete words but not abstract items. During fMRI scanning, participants read orthogonalised word categories of nouns and verbs, with or without concrete, sensorimotor meaning. Analysis of inferior frontal/insula, precentral and central areas revealed an interaction between lexical class and semantic factors with clear category differences between concrete nouns and verbs but not abstract ones. Though the brain stores the combinatorial and lexical-grammatical properties of words, our data show that topographical differences in brain activation, especially in the motor system and inferior frontal cortex, are driven by semantics and not by lexical class.

A large N400 but no BOLD effect--comparing source activations of semantic priming in simultaneous EEG-fMRI

Numerous studies have reported neurophysiological effects of semantic priming in electroencephalography (EEG) and in functional magnetic resonance imaging (fMRI). Because of differing methodological constraints, the comparability of the observed effects remains unclear. To directly compare EEG and fMRI effects and neural sources of semantic priming, we conducted a semantic word-picture priming experiment while measuring EEG and fMRI simultaneously. The visually presented primes were pseudowords, words unrelated to the target, semantically related words and the identical names of the target. Distributed source analysis of the event-related potentials (ERPs) successfully revealed a large effect of semantic prime-target relatedness (the N400 effect), which was driven by activations in a left-temporal source region. However, no significantly differing activations between priming conditions were found in the fMRI data. Our results support the notion that, for joint interpretations of existing EEG and fMRI studies of semantic priming, we need to fully appreciate the respective methodological limitations. Second, they show that simultaneous EEG-fMRI, including ERP source localization, is a feasible and promising methodological advancement for the investigation of higher-cognitive processes. Third, they substantiate the finding that, compared to fMRI, ERPs are often more sensitive to subtle cognitive effects.

Distinguishable neural correlates of verbs and nouns: a MEG study on homonyms

The dissociability of nouns and verbs and of their morphosyntactic operations has been firmly established by lesion data. However, the hypothesis that they are processed by distinct neural substrates is inconsistently supported by neuroimaging studies. We tackled this issue in a silent reading experiment during MEG. Participants silently read noun/verb homonyms in minimal syntactic context: article-noun (NPs), pronoun-verb (VPs) (e.g., il ballo/i balli, the dance/the dances; io ballo/tu balli, I dance/you dance). Homonyms allow to rule out prelexical or postlexical nuisance factors-they are orthographically and phonologically identical, but serve different grammatical functions depending on context. Under these experimental conditions, different activity to nouns and verbs can be confidently attributed to representational/processing distinctions. At the sensor level, three components of event-related magnetic fields were observed for the function word and four for the content word, but Global Field Power (GFP) analysis only showed differences between VPs and NPs at several but very short time windows. By contrast, source level analysis based on Minimum Norm Estimates (MNE) yielded significantly greater activity for VPs in left frontal areas and in a left frontoparietal network at late time windows (380-397 and 393-409 ms). These results are fully consistent with lesion data, and show that verbs and nouns are processed differently in the brain. Frontal and parietal activation to verbs might correspond to morphosyntactic processes and to working memory recruitment (or thematic role assignment), respectively. Findings are consistent with the view that nouns and verbs and their morphosyntactic operations involve at least partially distinct neural substrates. However, they do not entirely rule out that nouns and verbs are processed in a shared neural substrate, and that differences result from greater complexity of verbal morphosyntax.