Phonology and orthography in visual word recognition: evidence from masked non-word priming

Modelling orthographic similarity effects in recognition memory reveals support for open bigram representations of letter coding

A variety of letter string representations has been proposed in the reading literature to account for empirically established orthographic similarity effects from masked priming studies. However, these similarity effects have not been explored in episodic memory paradigms and very few memory models have employed orthographic representation of words. In the current work, through two recognition memory experiments employing word and pseudoword stimuli respectively, we empirically established a set of key orthographic similarity effects for the first time in recognition memory - namely the substitution effect, transposition effect and reverse effect in recognition memory of words and pseudowords, and a start-letter importance in recognition memory of words. Subsequently, we compared orthographic representations from the reading literature including slot coding, closed-bigram, open-bigram and the overlap model. Each of these representations was situated in a global matching model and fitted to recognition performance via Luce's choice rule in a hierarchical Bayesian framework. Model selection results showed support for the open-bigram representation in both experiments.

Early lexical processing of Chinese one-character words and Mongolian words: A comparative study using event-related potentials

Logographic language and alphabetic language differ significantly in orthography. Investigating the commonality and particularity of visual word recognition between the two distinct writing systems is informative for understating the neural mechanisms underlying visual word recognition. In the present study, we compared the chronometry of early lexical processing and the brain regions involved in early lexical processing between Chinese (logographic language) and Mongolian (alphabetic language) by recording event-related potentials (ERPs) using both implicit and explicit reading tasks. Familiar Chinese one-character words (lexical) and unknown Chinese one-character words (non-lexical) were pseudorandomly presented to native Chinese readers in Experiment 1. Mongolian words (lexical) and pseudowords (non-lexical) were pseudorandomly presented to native Mongolian readers in Experiment 2. In the color decision task, participants were asked to decide the color (black or blue) of each stimulus. In the lexical recognition task, participants were asked to report whether they could recognize each stimulus. The results showed that in both experiments and both tasks, ERPs to lexical items differed significantly from those to non-lexical items in the parietooccipital scalp region approximately 250 ms after stimulus onset, reflecting the early lexical processing, which likely originated from the ventral occipitotemporal cortex as revealed by source analysis. These results indicated that although Chinese and Mongolian differed markedly in orthographic features, the neural mechanisms underlying early lexical processing are similar between the two languages.

The Role of Orthography and Phonology in Written Word Recognition: Evidence From Eye-Tracking in the Visual World Paradigm

PURPOSE

There is a long-standing debate about how written words are recognized. Central to this debate is the role of phonology. The objective of this study is to contribute to our collective understanding regarding the role of phonology in written word recognition.

METHOD

A total of 30 monolingual adults were tested using a novel written word version of the visual world paradigm (VWP). We compared activation of phonological anadromes (words that are matched for sounds but not letters, e.g., JAB-BADGE) and orthographic anadromes (words that are matched for letters but not sounds, e.g., LEG-GEL) to determine the relative role of phonology and orthography in familiar single-word reading.

RESULTS

We found that activation for phonological anadromes is earlier, more robust, and sustained longer than orthographic anadromes.

CONCLUSIONS

These results are most consistent with strong phonological theories of single-word reading that posit an early and robust role of phonology. This study has broad implications for larger debates regarding reading instruction.

Ongoing Sign Processing Facilitates Written Word Recognition in Deaf Native Signing Children

Signed and written languages are intimately related in proficient signing readers. Here, we tested whether deaf native signing beginning readers are able to make rapid use of ongoing sign language to facilitate recognition of written words. Deaf native signing children (mean 10 years, 7 months) received prime target pairs with sign word onsets as primes and written words as targets. In a control group of hearing children (matched in their reading abilities to the deaf children, mean 8 years, 8 months), spoken word onsets were instead used as primes. Targets (written German words) either were completions of the German signs or of the spoken word onsets. Task of the participants was to decide whether the target word was a possible German word. Sign onsets facilitated processing of written targets in deaf children similarly to spoken word onsets facilitating processing of written targets in hearing children. In both groups, priming elicited similar effects in the simultaneously recorded event related potentials (ERPs), starting as early as 200 ms after the onset of the written target. These results suggest that beginning readers can use ongoing lexical processing in their native language - be it signed or spoken - to facilitate written word recognition. We conclude that intimate interactions between sign and written language might in turn facilitate reading acquisition in deaf beginning readers.

From Lexicon to Flexicon: The Principles of Morphological Transcendence and Lexical Superstates in the Characterization of Words in the Mind

The field of mental lexicon research has benefitted greatly from the founding metaphor of a dictionary in the mind. That metaphor, however, had its origins in a perspective in which the lexicon was seen as a static repository of representations with fixed structural properties. This paper presents a contrasting view. It is a view that highlights that words are activities that we perform, rather than simply representations that we have. It is proposed that lexical representations are best seen as hierarchies of action within a highly interconnected and dynamic system. The paper presents two principles of lexical organization: morphological transcendence and lexical superstates. The former principle claims that through the activities of language comprehension and production, lexical forms can develop variant forms. Thus, the form key may develop into forms such as key- (e.g., keyboard) and -key, (e.g., turnkey). The paper also discusses how transcendence leads to lexical superstates, which do not have a fixed morphological structure. As part of a lexical superstate, alternative morphological structures exist as potential realizations. Which one is actually realized will depend on the specific circumstances of a lexical action. An account is presented in which the effects of semantic transparency are treated in terms of transcendence and superstate interactions. It is claimed that this approach, which highlights the dynamic and flexible nature of the mental lexicon, has implications for how we approach the modeling of language and cognition in general.

New neighbours make bad fences: Form-based semantic shifts in word learning

The meanings of words sometimes shift towards those of similar-sounding words. For example, expunge is etymologically related to puncture but now connotes "wiping away," and according to the Oxford English Dictionary, this shift "is probably influenced by phonetic association with sponge." However, evidence for such form-based semantic shifts is anecdotal. We therefore conducted two experiments where participants learned novel words in sentence contexts (e.g., The boss embraiched the team's proposal, so they had to start over) and applied the inferred meanings to ambiguous sentences by providing ratings on a 7-point scale (e.g., Carol embraiched Gerald. How pleased was Gerald?). The inferred meanings of novel words that are spelt like existing words (e.g., embraich, like embrace) shifted towards the meanings of those existing words, relative to control novel words learned in identical contexts (e.g., fline; participants rated Gerald as more pleased to be embraiched than to be flined). These experiments provide the first evidence that newly learned words can indeed undergo form-based semantic shifts. We propose that shifts like these occur during word learning, when words activate rather than inhibit similar-sounding words, and we discuss why they seem to be more common in low-frequency words.

An ERP Study on the Role of Phonological Processing in Reading Two-Character Compound Chinese Words of High and Low Frequency

Unlike in English, the role of phonology in word recognition in Chinese is unclear. In this event-related potential experiment, we investigated the role of phonology in reading both high- and low-frequency two-character compound Chinese words. Participants executed semantic and homophone judgment tasks of the same precede-target pairs. Each pair of either high- or low-frequency words were either unrelated (control condition) or related semantically or phonologically (homophones). The induced P200 component was greater for low- than for high-frequency word-pairs both in semantic and phonological tasks. Homophones in the semantic judgment task and semantically-related words in the phonology task both elicited a smaller N400 than the control condition, word frequency-independently. However, for low-frequency words in the phonological judgment task, it was found that the semantically related pairs released a significantly larger P200 than the control condition. Thus, the semantic activation of both high- and low-frequency words may be no later than phonological activation.

Phonology and orthography in deaf readers: Evidence from a lateralized ambiguity resolution paradigm

This study explored differences between the two hemispheres in processing written words among deaf readers. The main hypothesis was that impoverished phonological abilities of deaf readers may lead to atypical patterns of hemispheric involvement. To test this, deaf participants completed a metalinguistic awareness test to evaluate their orthographic and phonological awareness. Additionally, they were asked to read biased or neutral target sentences ending with an ambiguous homograph, with each sentence followed by the request to make a rapid lexical decision on a target word presented either to the left (LH) or right hemisphere (RH). Targets were either related to the more frequent, dominant, meaning of the homograph, to the less frequent, subordinate, meaning of the homograph or were not related at all. An Inverse Efficiency Score based on both response latency and accuracy was calculated and revealed that deaf readers' RH perform better than their LH. In contrast to hearing readers who in previous studies manifested left hemisphere dominance when completed the same research design. The apparent divergence of deaf readers' hemisphere lateralization from that of hearing counterparts seems to validate previous findings suggesting greater reliance on RH involvement among deaf individuals during visual word recognition.

Orthographic and phonological contributions to flanker effects

Does phonology contribute to effects of orthographically related flankers in the flankers task? In order to answer this question, we implemented the flanker equivalent of a pseudohomophone priming manipulation that has been widely used to demonstrate automatic phonological processing during visual word recognition. In Experiment 1, central target words were flanked on each side by either a pseudohomophone of the target (e.g., roze rose roze), an orthographic control pseudoword (rone rose rone), or an unrelated pseudoword (mirt rose mirt). Both the pseudohomophone and the orthographic control conditions produced faster and more accurate responses to central targets, but performance in these two conditions did not differ significantly. Experiment 2 tested the same stimuli in a masked priming paradigm and replicated the standard finding in French that pseudohomophone primes produce significantly faster responses to target words than orthographic control primes. Therefore, contrary to its impact on masked priming, phonology does not contribute to effects of flanker relatedness, which would appear to be driven primarily by orthographic overlap.

Activation time-course of phonological code in silent word recognition in adult readers with and without dyslexia

In skilled adult readers, reading words is generally assumed to rapidly and automatically activate the phonological code. In adults with dyslexia, despite the main consensus on their phonological processing deficits, little is known about the activation time course of this code. The present study investigated this issue in both populations. Participants' accuracy and eye movements were recorded while they performed a visual lexical decision task in which phonological consistency of written words was manipulated. Readers with dyslexia were affected by phonological consistency during second fixation duration of visual word recognition suggesting a late activation of the phonological code. Regarding skilled readers, no influence of phonological consistency was found when the participants were considered a homogeneous population. However, a different pattern emerged when they were divided into two subgroups according to their phonological and semantic abilities: Those who showed better decoding than semantic skills were affected by phonological consistency at the earliest stage of visual word recognition while those who showed better semantic than decoding skills were not affected by this factor at any processing stage. Overall, the findings suggest that the presence of phonological deficits in readers with dyslexia is associated with a delayed activation of phonological representations during reading. In skilled readers, the contribution of phonology varies with their reading profile, i.e., being phonologically or semantically oriented.

Phonological priming effects with same-script primes and targets in the masked priming same-different task

Norris, Kinoshita and colleagues (Kinoshita & Norris, Journal of Experimental Psychology: Learning, Memory, and Cognition, 35(1), 1-18, 2009; Journal of Experimental Psychology: General, 137(3), 434-455, 2010; Norris & Kinoshita, Quarterly Journal of Experimental Psychology, 63(1), 194-204, 2008) have suggested that the masked priming same-different task (SDT) is an excellent tool for studying the orthographic coding process because, in most circumstances, performance in that task is driven entirely by orthographic codes. More specifically, although evidence of phonological influences (i.e., phonological priming effects in the SDT) have been reported, Kinoshita, Gayed, and Norris (Journal of Experimental Psychology: Human Perception and Performance, 44(11), 1661-1671, 2018) have claimed that phonological priming does not arise in the SDT when the prime and target are written in the same script and the targets are words, the most typical experimental situation. Indeed, it does appear that no-one has yet reported phonological priming effects in such situations. The question of whether it is possible to observe phonological priming in such situations was more fully examined in the present experiments. Experiment 1 involved a masked priming SDT using Japanese Kanji script in which the primes and targets were homophonic but shared no characters. Experiment 2 was a parallel experiment using Chinese stimuli. In both experiments, phonological priming effects were observed for both one- and two-character words. These experiments indicate that, although the priming effects in masked priming SDTs undoubtedly have a strong orthographic basis, phonological codes also play a role even when the prime and (word) target are written in the same script.

Temporal dynamics of sequential motor activation in a dual-prime paradigm: Insights from conditional accuracy and hazard functions

In response priming experiments, a participant has to respond as quickly and as accurately as possible to a target stimulus preceded by a prime. The prime and the target can either be mapped to the same response (consistent trial) or to different responses (inconsistent trial). Here, we investigate the effects of two sequential primes (each one either consistent or inconsistent) followed by one target in a response priming experiment. We employ discrete-time hazard functions of response occurrence and conditional accuracy functions to explore the temporal dynamics of sequential motor activation. In two experiments (small-N design, 12 participants, 100 trials per cell and subject), we find that (1) the earliest responses are controlled exclusively by the first prime if primes are presented in quick succession, (2) intermediate responses reflect competition between primes, with the second prime increasingly dominating the response as its time of onset is moved forward, and (3) only the slowest responses are clearly controlled by the target. The current study provides evidence that sequential primes meet strict criteria for sequential response activation. Moreover, it suggests that primes can influence responses out of a memory buffer when they are presented so early that participants are forced to delay their responses.

Effects of Repetition Suppression on Sound Induced Flash Illusion With Aging

The sound-induced flash illusion (SiFI) is a classical auditory-dominated multisensory integration phenomenon in which the observer misperceives the number of visual flashes due to the simultaneous presentation of a different number of auditory beeps. Although the SiFI has been documented to correlate with perceptual sensitivity, to date there is no consensus as to how it corresponds to sensitivity with aging. The present study was based on the SiFI paradigm (Shams et al., 2000), adding repeated auditory stimuli prior to the appearance of audiovisual stimuli to investigate the effects of repetition suppression (RS) on the SiFI with aging. The repeated auditory stimuli consisted of one or two of the same auditory stimuli presented twice in succession, which were then followed by the audiovisual stimuli. By comparing the illusions in old and young adults, we aimed to explore the influence of aging on the RS of auditory stimuli on the SiFI. The results showed that both age groups showed SiFI effects, however, the RS performance of the two age groups had different effects on the fusion and fission illusions. The illusion effect in old adults was weaker than in young adults. Specifically, RS only affected fission illusions in the old adults but both fission and fusion illusions in young adults. Thus, the present study indicated that the decreased perceptual sensitivity based on auditory RS could weaken the SiFI effect in multisensory integration and that old adults are more susceptible to RS, showing that old adults perceived the SiFI effect weakly under auditory RS.

The impact of consonant–vowel transpositions on masked priming effects in Italian and English

There are now a number of reports in the literature that transposed letter (TL) priming effects emerge when two consonants are transposed (e.g., caniso-CASINO) but not when two vowels are transposed (e.g., cinaso-CASINO). In the present article, four masked priming lexical decision experiments, two in Italian and two in English, are reported in which TL priming effects involving the transposition of two adjacent consonants (e.g., atnenna-ANTENNA) were contrasted with those involving the transposition of a vowel and an adjacent consonant (e.g., anetnna-ANTENNA), a contrast not directly examined in the previous literature. In none of the experiments was there any indication that the priming effects were different sizes for the two types of transpositions, including Experiment 4 in which a sandwich priming paradigm was used. These results support the assumption of most orthographic coding models that the consonant–vowel status of the letters is not relevant to the nature of the orthographic code. The question of how to reconcile these results with other TL manipulations investigating vowel versus consonant transpositions is discussed.

The impact of concurrent linguistic tasks on participants' identification of spearcons

Spearcons (time-compressed speech) may be a viable auditory display for patient monitoring; however, the impact of concurrent linguistic tasks remains unexamined. We tested whether different concurrent linguistic tasks worsen participants' identification of spearcons. Experiment 1 tested non-clinician participants' identification of multiple-patient spearcons representing 2 vital signs of 5 patients while participants performed no concurrent task, reading, or saying linguistic tasks. Experiment 2 tested non-clinician participants' identification of 48 single-patient spearcons while they performed no concurrent task, reading, listening, and saying linguistic tasks. In Experiment 1 the saying task worsened participants' identification of spearcons compared with no concurrent task or reading. In Experiment 2, the saying and listening tasks reduced participants' accuracy at identifying spearcons, but the reading task did not. Listening affected identification accuracy no differently than the saying task did. Concurrent auditory linguistic tasks worsen participants' identification of spearcons, probably due to auditory modality interference in verbal working memory.

Is holistic processing of written words modulated by phonology?

Holistic processing, a hallmark of face processing, has been shown for written words, signaled by the word composite effect. Fluent readers find it harder to focus on one half of a written word (e.g., the first syllable of a CV.CV word) while ignoring the other half (e.g., the second syllable), especially when the two halves are aligned rather than misaligned. Given the linguistic nature of written words, in the present study, we examined whether the word composite effect is modulated by phonology. In Experiment 1, participants saw two sequentially presented CV.CV words and had to decide if the left half (first syllable) was the same or not, regardless of the right half. The word pairs were either phonologically consistent (univocal orthography to phonology mapping; e.g., TI is always /ti/ in Portuguese) or inconsistent (orthography can map into different phonological representations; e.g., CA can correspond to /ka/ or /kɐ/). The word composite effect was found for phonologically consistent words but not for phonologically inconsistent words. In Experiment 2, timing of trial events was reduced to test whether the influence of phonology was fast and automatic. Similar to what was found in Experiment 1, the word composite effect was found only for phonologically consistent words. The faster trial events in Experiment 2 rendered it less likely that the influence of phonology in word composite effect is merely a result of strategic processing. These findings suggest that holistic processing of visual words is modulated by fast and automatic activation of lexical phonological representations.

EPS mid-career prize lecture 2017: Writing systems, reading, and language

Skilled reading reflects an accumulation of experience with written language. Written language is typically viewed as an expression of spoken language, and this perspective has motivated approaches to understanding reading and reading acquisition. However, in this article, I develop the proposal that written language has diverged from spoken language in important ways that maximise the transmission of meaningful information, and that this divergence has been central to the development of rapid, skilled reading. I use English as an example to show that weaknesses in the relationship between spelling and sound can give rise to strong regularities between spelling and meaning that are critical for the rapid analysis of printed words. I conclude by arguing that the nature of the reading system is a reflection of the writing system and that a deep understanding of reading can be obtained only through a deep understanding of written language.

Time course analyses of orthographic and phonological priming effects in developing readers

It has been assumed that fluent reading requires efficient integration of orthographic and phonological codes. However, it is thus far unclear how this integration process develops when children learn to become fluent readers. Therefore, we used masked priming to investigate time courses of orthographic and phonological code activation in children at incremental levels of reading development (second, fourth and sixth grade). The first study used targets with small phonological differences between phonological and orthographic primes, which are typical in transparent orthographies. The second study manipulated the strength of the phonological difference between prime and target to clarify whether phonological difference influences phonological priming effects. Results in both studies showed that orthographic priming effects became facilitative at increasingly short durations during reading development, but phonological priming was absent. These results are taken to suggest that development of reading fluency is accompanied by increased automatization of orthographic representations. The absence of phonological priming suggests that developing readers cannot yet activate phonological codes automatically.

Integrating Orthographic Information Across Time and Space

Research has suggested that the word recognition process is influenced by the integration of orthographic information across words. The precise nature of this integration process may vary, however, depending on whether words are in temporal or spatial proximity. Here we present a lexical decision experiment, designed to compare temporal and spatial integration processes more directly. Masked priming was used to reveal effects of temporal integration, while the flanker paradigm was used to reveal effects of spatial integration. Primes/flankers were high-frequency orthographic neighbors of the target (blue-blur) or unrelated control words (head-blur). We replicated prior observations of inhibition in trials where the neighbor was used as a masked prime, while facilitation was observed in trials where the neighbor was presented as flanker. We conclude that sub-lexical orthographic information is integrated both temporally and spatially, but that spatial information is used to segregate lexical representations activated by spatially distinct sources.

Electrophysiological dynamics of Chinese phonology during visual word recognition in Chinese-English bilinguals

Silent word reading leads to the activation of orthographic (spelling), semantic (meaning), as well as phonological (sound) information. For bilinguals, native language information can also be activated automatically when they read words in their second language. For example, when Chinese-English bilinguals read words in their second language (English), the phonology of the Chinese translations is automatically activated. Chinese phonology, however, consists of consonants and vowels (segmental) and tonal information. To what extent these two aspects of Chinese phonology are activated is yet unclear. Here, we used behavioural measures, event-related potentials and oscillatory EEG to investigate Chinese segmental and tonal activation during word recognition. Evidence of Chinese segmental activation was found when bilinguals read English words (faster responses, reduced N400, gamma-band power reduction) and when they read Chinese words (increased LPC, gamma-band power reduction). In contrast, evidence for Chinese tonal activation was only found when bilinguals read Chinese words (gamma-band power increase). Together, our converging behavioural and electrophysiological evidence indicates that Chinese segmental information is activated during English word reading, whereas both segmental and tonal information are activated during Chinese word reading. Importantly, gamma-band oscillations are modulated differently by tonal and segmental activation, suggesting independent processing of Chinese tones and segments.

Phonemic feature involvement in lexical access in grades 3 and 5: Evidence from visual and auditory lexical decision tasks

Numerous studies have evidenced the involvement of the phonological code during visual word recognition not only in skilled adult readers but also in child readers. Moreover, in skilled adult readers, visual word processing has been shown to be sensitive to phonetic details such as phonemic features (e.g., manner of articulation, place of articulation, voicing and nasality in French) which are typically involved in phonological lexicon access during speech processing. In contrast, it is not known whether and when visual word recognition is affected by phonemic features during learning to read. The present study investigates this issue in third and fifth graders. A lexical decision task was performed in visual and auditory modalities. Targets were French words (e.g., piano [piano]) and pseudowords created from target words. Mismatching was on the first phoneme. There were one-feature phoneme mismatch pseudowords (e.g., tiano) and multiple-feature phoneme mismatch pseudowords (e.g., liano). The pseudowords were used as a marker of the sensitivity to phonemic features in phonological lexicon access. Phonemic feature effects were found in visual and auditory lexical decision tasks in both grades, indicating that phonological lexicon access involves phonemic features in print processing as in speech processing. In contrast, the absence of difference between both grades seems to indicate that this effect is independent of age or, more precisely, of phonological development and reading performance.

Orthographic processing: A ‘mid-level’ vision of reading: The 44th Sir Frederic Bartlett Lecture

I will describe how orthographic processing acts as a central interface between visual and linguistic processing during reading, and as such can be considered to be the ‘mid-level vision’ of reading research. In order to make this case, I first summarize the evidence in favour of letter-based word recognition before examining work investigating how orthographic similarities among words influence single word reading. I describe how evidence gradually accumulated against traditional measures of orthographic similarity and the associated theories of orthographic processing, forcing a reconsideration of how letter-position information is represented by skilled readers. Then, I present the theoretical framework that was developed to explain these findings, with a focus on the distinction between location-specific and location-invariant orthographic representations. Finally, I describe work extending this theoretical framework in two main directions: first, to the realm of reading development, with the aim to specify the key changes in the processing of letters and letter strings that accompany successful learning to read, and second, to the realm of sentence reading, in order to specify how orthographic information can be processed across several words in parallel, and how skilled readers keep track of which letters belong to which words.

Cues to stress assignment in reading aloud

Research seeking to uncover the mechanisms by which we read aloud has focused almost exclusively on monosyllabic items presented in isolation. Consequently, important challenges that arise when considering polysyllabic word reading, such as stress assignment, have been ignored, while little is known about how important sentence-level stress cues, such as syntax and rhythm, may influence word reading aloud processes. The present study seeks to fill these gaps in the literature by (a) documenting the individual influences of major sublexical cues that readers use to assign stress in single-word reading in English and (b) determining how these cues may interact with contextual stress factors in sentence reading. In Experiments 1, 2, and 3 we investigated the effects of prefixation, orthographic weight (i.e., number of letters in a syllable), and vowel length on stress assignment by asking participants to read aloud carefully-constructed nonwords that varied on the presence of these cues. Results revealed individual effects of all three cues on the assignment of second-syllable stress. In Experiment 4, we tested the effects of these cues on stress assignment in the context of sentence reading. Results showed that sublexical cues influenced stress assignment over and above higher-level syntactic and rhythmic cues. We consider these findings in the framework of extant rule-based, distributed-connectionist, and Bayesian approaches to stress assignment in reading aloud, and we discuss their applications to understanding reading development and acquired and developmental reading disorders. (PsycINFO Database Record

Effects of Phonological and Orthographic Neighbourhood Density Interact in Visual Word Recognition

The present study investigated the role of phonological and orthographic neighbourhood density in visual word recognition. Three mechanisms were identified that predict distinct facilitatory or inhibitory effects of each variable. The lexical competition account predicts overall inhibitory effects of neighbourhood density. The global activation (familiarity) account predicts overall facilitatory effects of neighbourhood density. Finally, the cross-code consistency account predicts an interaction, with inhibition of phonological neighbours in sparse orthographic regions and facilitation of phonological neighbours in dense orthographic regions. In Experiment 1 (lexical decision), a cross-over interaction was indeed found, supporting the prediction of the cross-code consistency account. In Experiment 2, this cross-over interaction was exaggerated by adding pseudohomo-phone stimuli (e.g., brane) among the nonword targets. Finally, in Experiment 3 (progressive demasking), we tried to shift the balance between inhibitory and facilitatory mechanisms by using a perceptual identification task. As predicted, the inhibitory effects of phonological neighbourhood were amplified, whereas the facilitatory effects disappeared. We conclude that the level of compatibility across co-activated orthographic and phonological representations is a major causal factor underlying this pattern of effects.

The use and nature of grapheme coding during sub-lexical processing and lexical access

This work aimed to investigate grapheme coding during sub-lexical processing and lexical access. Using the letter detection task in Experiment 1, we compared letter pairs that could be considered as a grapheme unit or not depending on context (referred to as weakly cohesive complex, e.g., an in chant vs cane) to real two-letter graphemes (highly cohesive complex, e.g., au in chaud) and single-letter graphemes (simple, e.g., a in place). Three experimental conditions were used, one of which was designed to prevent phonological influences. Data revealed that only highly cohesive complex graphemes were processed as units, not the weakly cohesive ones. The same pattern was found across experimental conditions in favor of an orthographic mechanism. In Experiments 2 and 3, a primed lexical decision task was used with two stimulus onset asynchronies (SOAs) and two different ranges of lexical frequency. We manipulated the number of graphemes removed from partial primes ( d**che vs do**he-DOUCHE) and relatedness. In contrast to Experiment 1, no evidence was provided in favor of a role of graphemes during lexical access. We suggest that graphemes can be conceived as sub-lexical orthographic units per se but can only be captured within a sub-lexical route to reading.

When a ROWS is a ROSE: Phonological Effects in Written Word Comprehension

When skilled readers make speeded categorization judgements about printed words, errors occur to homophones of real category exemplars. In Experiments 1 and 2, for example, subjects incorrectly accepted both the word STEAL (as a member of the category A METAL) and the nonword JEAP (as A VEHICLE) significantly more often than incorrect non-homophonic items matched in orthographic similarity to real exemplars. Experiment 3 demonstrated equivalent error rates for homophone targets differing from real exemplars by various types of single-letter change, but reduced error rates, especially for non-word homophones, when subjects were instructed to accept only correctly spelled instances. Experiments 4 and 5 established that the magnitude of the homophone effect is predicted by the degree of orthographic similarity between homophonic mates but not by spelling-sound regularity of the presented homophone. The results suggest that automatic phonological activation plays a major role in the comprehension of written words.

Repetition suppression: a means to index neural representations using BOLD?

Understanding how the human brain gives rise to complex cognitive processes remains one of the biggest challenges of contemporary neuroscience. While invasive recording in animal models can provide insight into neural processes that are conserved across species, our understanding of cognition more broadly relies upon investigation of the human brain itself. There is therefore an imperative to establish non-invasive tools that allow human brain activity to be measured at high spatial and temporal resolution. In recent years, various attempts have been made to refine the coarse signal available in functional magnetic resonance imaging (fMRI), providing a means to investigate neural activity at the meso-scale, i.e. at the level of neural populations. The most widely used techniques include repetition suppression and multivariate pattern analysis. Human neuroscience can now use these techniques to investigate how representations are encoded across neural populations and transformed by relevant computations. Here, we review the physiological basis, applications and limitations of fMRI repetition suppression with a brief comparison to multivariate techniques. By doing so, we show how fMRI repetition suppression holds promise as a tool to reveal complex neural mechanisms that underlie human cognitive function.

This article is part of the themed issue ‘Interpreting BOLD: a dialogue between cognitive and cellular neuroscience’.

Early use of phonological codes in deaf readers: An ERP study

Previous studies suggest that deaf readers use phonological information of words when it is explicitly demanded by the task itself. However, whether phonological encoding is automatic remains controversial. The present experiment examined whether adult congenitally deaf readers show evidence of automatic use of phonological information during visual word recognition. In an ERP masked priming lexical decision experiment, deaf participants responded to target words preceded by a pseudohomophone (koral - CORAL) or an orthographic control prime (toral - CORAL). Responses were faster for the pseudohomophone than for the orthographic control condition. The N250 and N400 amplitudes were reduced for the pseudohomophone when compared to the orthographic control condition. Furthermore, the magnitude of both the behavioral and the ERP pseudohomophone effects in deaf readers was similar to that of a group of well-matched hearing controls. These findings reveal that phonological encoding is available to deaf readers from the early stages of visual word recognition. Finally, the pattern of correlations of phonological priming with reading ability suggested that the amount of sub-lexical use of phonological information could be a main contributor to reading ability for hearing but not for deaf readers.

Opposite ERP effects for conscious and unconscious semantic processing under continuous flash suppression

We examined whether semantic processing occurs without awareness using continuous flash suppression (CFS). In two priming tasks, participants were required to judge whether a target was a word or a non-word, and to report whether the masked prime was visible. Experiment 1 manipulated the lexical congruency between the prime-target pairs and Experiment 2 manipulated their semantic relatedness. Despite the absence of behavioral priming effects (Experiment 1), the ERP results revealed that an N4 component was sensitive to the prime-target lexical congruency (Experiment 1) and semantic relatedness (Experiment 2) when the prime was rendered invisible under CFS. However, these results were reversed with respect to those that emerged when the stimuli were perceived consciously. Our findings suggest that some form of lexical and semantic processing can occur during CFS-induced unawareness, but are associated with different electrophysiological outcomes.

Interactions in the neighborhood: Effects of orthographic and phonological neighbors on N400 amplitude

The present study investigated effects of phonological and orthographic neighborhood density on event-related potentials, with an aim to better specify the factors that determine N400 amplitude in single word reading paradigms. We orthogonally manipulated the number of orthographic and phonological neighbors of words using the Levenshtein Distance metric (OLD20 and PLD20, respectively). The results showed opposite effects of phonological neighborhood density (PND) as a function of orthographic neighborhood density (OND). Larger N400 amplitudes were elicited by words with high PND compared with low PND when OND was high, and smaller N400 amplitudes were observed with high PND compared with low PND words when OND was low. We interpret these findings using the notion of cross-code consistency, according to which the compatibility of orthographic and phonological representations activated by a given word influences the process of recognizing that word. Words with similar numbers of orthographic and phonological neighbors have more consistent spellings and pronunciations across the neighborhood, and generate larger N400 amplitudes.

The Transitive-Unaccusative Alternation: A Cross-Modal Priming Study

The relationship between different linguistic manifestations of an eventuality-denoting concept, referred to in the literature as diatheses or voices, is well-studied in theoretical linguistics. Among researchers studying this phenomenon, it is widely agreed that there is a systematic relationship between the various diatheses of a concept. However, when a specific alternation is addressed, the nature of this relationship, namely, its directionality, is at debate. This research employs the much-debated transitive-unaccusative alternation as a case-study and reports the results of two cross-modal priming experiments designed to explore how Hebrew speakers perceive it. The results reveal an asymmetry between the facilitating effects of transitives and unaccusatives, thus suggesting that the relationship between these diatheses is directional. As a whole, this study demonstrates that theoretical debates regarding derivational relationships can be addressed by means of psycholinguistic research.

Rapid modulation of spoken word recognition by visual primes

In a masked cross-modal priming experiment with ERP recordings, spoken Japanese words were primed with words written in one of the two syllabary scripts of Japanese. An early priming effect, peaking at around 200ms after onset of the spoken word target, was seen in left lateral electrode sites for Katakana primes, and later effects were seen for both Hiragana and Katakana primes on the N400 ERP component. The early effect is thought to reflect the efficiency with which words in Katakana script make contact with sublexical phonological representations involved in spoken language comprehension, due to the particular way this script is used by Japanese readers. This demonstrates fast-acting influences of visual primes on the processing of auditory target words, and suggests that briefly presented visual primes can influence sublexical processing of auditory target words. The later N400 priming effects, on the other hand, most likely reflect cross-modal influences on activity at the level of whole-word phonology and semantics.

On the nature of consonant/vowel differences in letter position coding: Evidence from developing and adult readers

In skilled adult readers, transposed-letter effects (jugde-JUDGE) are greater for consonant than for vowel transpositions. These differences are often attributed to phonological rather than orthographic processing. To examine this issue, we employed a scenario in which phonological involvement varies as a function of reading experience: A masked priming lexical decision task with 50-ms primes in adult and developing readers. Indeed, masked phonological priming at this prime duration has been consistently reported in adults, but not in developing readers (Davis, Castles, & Iakovidis, 1998). Thus, if consonant/vowel asymmetries in letter position coding with adults are due to phonological influences, transposed-letter priming should occur for both consonant and vowel transpositions in developing readers. Results with adults (Experiment 1) replicated the usual consonant/vowel asymmetry in transposed-letter priming. In contrast, no signs of an asymmetry were found with developing readers (Experiments 2-3). However, Experiments 1-3 did not directly test the existence of phonological involvement. To study this question, Experiment 4 manipulated the phonological prime-target relationship in developing readers. As expected, we found no signs of masked phonological priming. Thus, the present data favour an interpretation of the consonant/vowel dissociation in letter position coding as due to phonological rather than orthographic processing.

The Processing of Visual and Phonological Configurations of Chinese One- and Two-Character Words in a Priming Task of Semantic Categorization

To separate the contribution of phonological from that of visual-orthographic information in the recognition of a Chinese word that is composed of one or two Chinese characters, we conducted two experiments in a priming task of semantic categorization (PTSC), in which length (one- or two-character words), relation, prime (related or unrelated prime-target pairs), and SOA (47, 87, or 187 ms) were manipulated. The prime was similar to the target in meaning or in visual configuration in Experiment A and in meaning or in pronunciation in Experiment B. The results indicate that the two-character words were similar to the one-character words but were less demanding of cognitive resources than the one-character words in the processing of phonological, visual-orthographic, and semantic information. The phonological primes had a facilitating effect at the SOA of 47 ms but an inhibitory effect at the SOA of 187 ms on the participants' reaction times; the visual-orthographic primes only had an inhibitory influence on the participants' reaction times at the SOA of 187 ms. The visual configuration of a Chinese word of one or two Chinese characters has its own contribution in helping retrieve the word's meanings; similarly, the phonological configuration of a one- or two-character word plays its own role in triggering activations of the word's semantic representations.

Masked priming by misspellings: Word frequency moderates the effects of SOA and prime-target similarity

University students made lexical decisions to eight- or nine-letter words preceded by masked primes that were the target, an unrelated word, or a typical misspelling of the target. At a stimulus onset asynchrony (SOA) of 47 ms, primes that were misspellings of the target produced a priming benefit for low-, medium-, and high-frequency words, even when the misspelled primes were changed to differ phonologically from their targets. At a longer SOA of 80 ms, misspelled primes facilitated lexical decisions only to medium- and low-frequency targets, and a phonological change attenuated the benefit for medium-frequency targets. The results indicate that orthographic similarity can be preserved over changes in letter position and word length, and that the priming effect of misspelled words at the shorter SOA is orthographically based. Orthographic-priming effects depend on the quality of the orthographic learning of the target word.

Subliminal repetition primes help detection of phonemes in a picture: Evidence for a phonological level of the priming effects

In this research, we combine a cross-form word-picture visual masked priming procedure with an internal phoneme monitoring task to examine repetition priming effects. In this paradigm, participants have to respond to pictures whose names begin with a prespecified target phoneme. This task unambiguously requires retrieving the word-form of the target picture's name and implicitly orients participants' attention towards a phonological level of representation. The experiments were conducted within Spanish, whose highly transparent orthography presumably promotes fast and automatic phonological recoding of subliminal, masked visual word primes. Experiments 1 and 2 show that repetition primes speed up internal phoneme monitoring in the target, compared to primes beginning with a different phoneme from the target, or sharing only their first phoneme with the target. This suggests that repetition primes preactivate the phonological code of the entire target picture's name, hereby speeding up internal monitoring, which is necessarily based on such a code. To further qualify the nature of the phonological code underlying internal phoneme monitoring, a concurrent articulation task was used in Experiment 3. This task did not affect the repetition priming effect. We propose that internal phoneme monitoring is based on an abstract phonological code, prior to its translation into articulation.

Language influences number processing--a quadrilingual study

Reading/writing direction or number word formation influence performance even in basic numerical tasks such as magnitude comparison. However, so far the interaction of these language properties has not been evaluated systematically. In this study we tested English, German, Hebrew, and Arab participants realizing a natural 2 × 2 design of reading/writing direction (left-to-right vs. right-to-left) and number word formation (non-inverted vs. inverted, i.e., forty-seven vs. seven-and-forty). Symbolic number magnitude comparison was specifically influenced by the interaction of reading/writing direction and number word formation: participants from cultures where reading direction and the order of tens and units in number words are incongruent (i.e., German and Hebrew) exhibited more pronounced unit interference in place-value integration. A within-group comparison indicated that this effect was not due to differences in education. Thus, basic cultural differences in numerical cognition were driven by natural language variables and their specific combination.

Time course analyses of orthographic and phonological priming effects during word recognition in a transparent orthography

In opaque orthographies, the activation of orthographic and phonological codes follows distinct time courses during visual word recognition. However, it is unclear how orthography and phonology are accessed in more transparent orthographies. Therefore, we conducted time course analyses of masked priming effects in the transparent Dutch orthography. The first study used targets with small phonological differences between phonological and orthographic primes, which are typical in transparent orthographies. Results showed consistent orthographic priming effects, yet phonological priming effects were absent. The second study explicitly manipulated the strength of the phonological difference and revealed that both orthographic and phonological priming effects became identifiable when phonological differences were strong enough. This suggests that, similar to opaque orthographies, strong phonological differences are a prerequisite to separate orthographic and phonological priming effects in transparent orthographies. Orthographic and phonological priming appeared to follow distinct time courses, with orthographic codes being quickly translated into phonological codes and phonology dominating the remainder of the lexical access phase.

Phonological coding during reading

The exact role that phonological coding (the recoding of written, orthographic information into a sound based code) plays during silent reading has been extensively studied for more than a century. Despite the large body of research surrounding the topic, varying theories as to the time course and function of this recoding still exist. The present review synthesizes this body of research, addressing the topics of time course and function in tandem. The varying theories surrounding the function of phonological coding (e.g., that phonological codes aid lexical access, that phonological codes aid comprehension and bolster short-term memory, or that phonological codes are largely epiphenomenal in skilled readers) are first outlined, and the time courses that each maps onto (e.g., that phonological codes come online early [prelexical] or that phonological codes come online late [postlexical]) are discussed. Next the research relevant to each of these proposed functions is reviewed, discussing the varying methodologies that have been used to investigate phonological coding (e.g., response time methods, reading while eye-tracking or recording EEG and MEG, concurrent articulation) and highlighting the advantages and limitations of each with respect to the study of phonological coding. In response to the view that phonological coding is largely epiphenomenal in skilled readers, research on the use of phonological codes in prelingually, profoundly deaf readers is reviewed. Finally, implications for current models of word identification (activation-verification model, Van Orden, 1987; dual-route model, e.g., M. Coltheart, Rastle, Perry, Langdon, & Ziegler, 2001; parallel distributed processing model, Seidenberg & McClelland, 1989) are discussed.

Neural correlates reveal sub-lexical orthography and phonology during reading aloud: a review

The sub-lexical conversion of graphemes-to-phonemes (GPC) during reading has been investigated extensively with behavioral measures, as well as event-related potentials (ERPs). Most research utilizes silent reading (e.g., lexical decision task) for which phonological activation is not a necessity. However, recent research employed reading aloud to capture sub-lexical GPC. The masked priming paradigm avoids strategic processing and is therefore well suitable for capturing sub-lexical processing instead of lexical effects. By employing ERPs, the on-line time course of sub-lexical GPC can be observed before the overt response. ERPs have revealed that besides phonological activation, as revealed by behavioral studies, there is also early orthographic activation. This review describes studies in one's native language, in one's second language, and in a cross-language situation. We discuss the implications the ERP results have on different (computational) models. First, the ERP results show that computational models should assume an early locus of the GPC. Second, cross-language studies reveal that the phonological representations from both languages of a bilingual become activated automatically and the phonology belonging to the context is selected rapidly. Therefore, it is important to extend the scope of computational models of reading (aloud) to multiple lexicons.

Phonological and orthographic overlap effects in fast and masked priming

We investigated how orthographic and phonological information is activated during reading, using a fast priming task, and during single-word recognition, using masked priming. Specifically, different types of overlap between prime and target were contrasted: high orthographic and high phonological overlap (track-crack), high orthographic and low phonological overlap (bear-gear), or low orthographic and high phonological overlap (fruit-chute). In addition, we examined whether (orthographic) beginning overlap (swoop-swoon) yielded the same priming pattern as end (rhyme) overlap (track-crack). Prime durations were 32 and 50 ms in the fast priming version and 50 ms in the masked priming version, and mode of presentation (prime and target in lower case) was identical. The fast priming experiment showed facilitatory priming effects when both orthography and phonology overlapped, with no apparent differences between beginning and end overlap pairs. Facilitation was also found when prime and target only overlapped orthographically. In contrast, the masked priming experiment showed inhibition for both types of end overlap pairs (with and without phonological overlap) and no difference for begin overlap items. When prime and target only shared principally phonological information, facilitation was only found with a long prime duration in the fast priming experiment, while no differences were found in the masked priming version. These contrasting results suggest that fast priming and masked priming do not necessarily tap into the same type of processing.

Spatio-temporal dynamics of automatic processing of phonological information in visual words

Sensory-specific cortices appear to be sensitive to information from another modality. Here we investigate whether the human brain automatically extracts the phonological information in visual words in early visual processing. We continuously presented native Chinese speakers peripherally with Chinese homophone characters in an oddball paradigm, while they performed a visual detection task presented in the centre of the visual field. We found the lexical tone phonology embedded in the characters is processed automatically by the brain of native speakers, as revealed by whole-head electrical recordings of the mismatch negativity (MMN). Source solution further revealed the MMN involved the neural activations from the visual cortex to the auditory cortex (130–460 ms). The spatial-temporal dynamics indicate a visual-auditory interaction in the early, automatic processing of phonological information in visual words.

Resolving the orthographic ambiguity during visual word recognition in Arabic: an event-related potential investigation

The Arabic alphabetical orthographic system has various unique features that include the existence of emphatic phonemic letters. These represent several pairs of letters that share a phonological similarity and use the same parts of the articulation system. The phonological and articulatory similarities between these letters lead to spelling errors where the subject tends to produce a pseudohomophone (PHw) instead of the correct word. Here, we investigated whether or not the unique orthographic features of the written Arabic words modulate early orthographic processes. For this purpose, we analyzed event-related potentials (ERPs) collected from adult skilled readers during an orthographic decision task on real words and their corresponding PHw. The subjects' reaction times (RTs) were faster in words than in PHw. ERPs analysis revealed significant response differences between words and the PHw starting during the N170 and extending to the P2 component, with no difference during processing steps devoted to phonological and lexico-semantic processing. Amplitude and latency differences were found also during the P6 component which peaked earlier for words and where source localization indicated the involvement of the classical left language areas. Our findings replicate some of the previous findings on PHw processing and extend them to involve early orthographical processes.

Rapid extraction of lexical tone phonology in Chinese characters: a visual mismatch negativity study

Background

In alphabetic languages, emerging evidence from behavioral and neuroimaging studies shows the rapid and automatic activation of phonological information in visual word recognition. In the mapping from orthography to phonology, unlike most alphabetic languages in which there is a natural correspondence between the visual and phonological forms, in logographic Chinese, the mapping between visual and phonological forms is rather arbitrary and depends on learning and experience. The issue of whether the phonological information is rapidly and automatically extracted in Chinese characters by the brain has not yet been thoroughly addressed.

Methodology/Principal Findings

We continuously presented Chinese characters differing in orthography and meaning to adult native Mandarin Chinese speakers to construct a constant varying visual stream. In the stream, most stimuli were homophones of Chinese characters: The phonological features embedded in these visual characters were the same, including consonants, vowels and the lexical tone. Occasionally, the rule of phonology was randomly violated by characters whose phonological features differed in the lexical tone.

Conclusions/Significance

We showed that the violation of the lexical tone phonology evoked an early, robust visual response, as revealed by whole-head electrical recordings of the visual mismatch negativity (vMMN), indicating the rapid extraction of phonological information embedded in Chinese characters. Source analysis revealed that the vMMN was involved in neural activations of the visual cortex, suggesting that the visual sensory memory is sensitive to phonological information embedded in visual words at an early processing stage.