Building a resonance framework for word recognition using design and system principles

Orthography-phonology consistency in English: Theory- and data-driven measures and their impact on auditory vs. visual word recognition

Research on orthographic consistency in English words has selectively identified different sub-syllabic units in isolation (grapheme, onset, vowel, coda, rime), yet there is no comprehensive assessment of how these measures affect word identification when taken together. To study which aspects of consistency are more psychologically relevant, we investigated their independent and composite effects on human reading behavior using large-scale databases. Study 1 found effects on adults' naming responses of both feedforward consistency (orthography to phonology) and feedback consistency (phonology to orthography). Study 2 found feedback but no feedforward consistency effects on visual and auditory lexical decision tasks, with the best predictor being a composite measure of consistency across grapheme, rime, OVC, and word-initial letter-phoneme. In Study 3, we explicitly modeled the reading process with forward and backward flow in a bidirectionally connected neural network. The model captured latent dimensions of quasi-regular mapping that explain additional variance in human reading and spelling behavior, compared to the established measures. Together, the results suggest interactive activation between phonological and orthographic word representations. They also validate the role of computational analyses of language to better understand how print maps to sound, and what properties of natural language affect reading complexity.

Farey Trees Explain Sequential Effects in Choice Response Time

The latencies of successive two-alternative, forced-choice response times display intricately patterned sequential effects, or dependencies. They vary as a function of particular trial-histories, and in terms of the order and identity of previously presented stimuli and registered responses. This article tests a novel hypothesis that sequential effects are governed by dynamic principles, such as those entailed by a discrete sine-circle map adaptation of the Haken Kelso Bunz (HKB) bimanual coordination model. The model explained the sequential effects expressed in two classic sequential dependency data sets. It explained the rise of a repetition advantage, the acceleration of repeated affirmative responses, in tasks with faster paces. Likewise, the model successfully predicted an alternation advantage, the acceleration of interleaved affirmative and negative responses, when a task’s pace slows and becomes more variable. Detailed analyses of five studies established oscillatory influences on sequential effects in the context of balanced and biased trial presentation rates, variable pacing, progressive and differential cognitive loads, and dyadic performance. Overall, the empirical patterns revealed lawful oscillatory constraints governing sequential effects in the time-course and accuracy of performance across a broad continuum of recognition and decision activities.

Effects of Phonological and Orthographic Neighbourhood Density Interact in Visual Word Recognition

The present study investigated the role of phonological and orthographic neighbourhood density in visual word recognition. Three mechanisms were identified that predict distinct facilitatory or inhibitory effects of each variable. The lexical competition account predicts overall inhibitory effects of neighbourhood density. The global activation (familiarity) account predicts overall facilitatory effects of neighbourhood density. Finally, the cross-code consistency account predicts an interaction, with inhibition of phonological neighbours in sparse orthographic regions and facilitation of phonological neighbours in dense orthographic regions. In Experiment 1 (lexical decision), a cross-over interaction was indeed found, supporting the prediction of the cross-code consistency account. In Experiment 2, this cross-over interaction was exaggerated by adding pseudohomo-phone stimuli (e.g., brane) among the nonword targets. Finally, in Experiment 3 (progressive demasking), we tried to shift the balance between inhibitory and facilitatory mechanisms by using a perceptual identification task. As predicted, the inhibitory effects of phonological neighbourhood were amplified, whereas the facilitatory effects disappeared. We conclude that the level of compatibility across co-activated orthographic and phonological representations is a major causal factor underlying this pattern of effects.

Feedforward and Feedback Consistency Effects for High- and Low-Frequency Words in Lexical Decision and Naming

In three experiments, we examined feedforward and feedback consistency effects in word recognition. Feedforward consistency is the degree to which a word's pronunciation is consistent with that of similarly spelled words, and feedback consistency refers to whether there is more than one way to spell a pronunciation. Previously, Stone, Vanhoy, and Van Orden (1997) reported feedforward and feedback consistency effects for low-frequency words in a lexical decision task. We investigated the effect of feedforward and feedback consistency for both high- and low-frequency words in lexical decision and naming. In both tasks, we found that feedforward and feedback inconsistent words were processed more slowly than consistent words, regardless of word frequency. These findings indicate that both types of consistency are involved in visual word recognition.

Comparing nouns and verbs in a lexical task

We analyzed the differential processing of nouns and verbs in a lexical decision task. Moderate and high-frequency nouns and verbs were compared. The characteristics of our material were specified at the formal level (number of letters and syllables, number of homographs, orthographic neighbors, frequency and age of acquisition), and at the semantic level (imagery, number and strength of associations, number of meanings, context dependency). A regression analysis indicated a classical frequency effect and a word-type effect, with latencies for verbs being slower than for nouns. The regression analysis did not permit the conclusion that semantic effects were involved (particularly imageability). Nevertheless, the semantic opposition between nouns as prototypical representations of objects, and verbs as prototypical representation of actions was not tested in this experiment and remains a good candidate explanation of the response time discrepancies between verbs and nouns.

Naming in noise: the contribution of orthographic knowledge to speech repetition

While the influence of orthographic knowledge on lexical and postlexical speech processing tasks has been consistently observed, it is not the case in tasks that can be performed at the prelexical level. The present study re-examined the orthographic consistency effect in such a task, namely in shadowing. Comparing the situation where the acoustic signal was clearly presented to the situation where it was embedded in noise, we observed that the orthographic effect was restricted to the latter situation and only to high-frequency words. This finding supports the lexical account of the orthographic effects in speech recognition tasks and illustrates the ability of the cognitive system to adjust itself as a function of task difficulty by resorting to the appropriate processing mechanism and information in order to maintain a good level of performance.

The Sound of Enemies and Friends in the Neighborhood

Previous studies (e.g., Pecher, Zeelenberg, & Wagenmakers, 2005) found that semantic classification performance is better for target words with orthographic neighbors that are mostly from the same semantic class (e.g., living) compared to target words with orthographic neighbors that are mostly from the opposite semantic class (e.g., nonliving). In the present study we investigated the contribution of phonology to orthographic neighborhood effects by comparing effects of phonologically congruent orthographic neighbors (book-hook) to phonologically incongruent orthographic neighbors (sand-wand). The prior presentation of a semantically congruent word produced larger effects on subsequent animacy decisions when the previously presented word was a phonologically congruent neighbor than when it was a phonologically incongruent neighbor. In a second experiment, performance differences between target words with versus without semantically congruent orthographic neighbors were larger if the orthographic neighbors were also phonologically congruent. These results support models of visual word recognition that assume an important role for phonology in cascaded access to meaning.

Orthographic influences in spoken word recognition: the consistency effect in semantic and gender categorization tasks

According to current models, spoken word recognition is driven by the phonological properties of the speech signal. However, several studies have suggested that orthographic information also influences recognition in adult listeners. In particular, it has been repeatedly shown that, in the lexical decision task, words that include rimes with inconsistent spellings (e.g., /-ip/ spelled -eap or -eep) are disadvantaged, as compared with words with consistent rime spelling. In the present study, we explored whether the orthographic consistency effect extends to tasks requiring people to process words beyond simple lexical access. Two different tasks were used: semantic and gender categorization. Both tasks produced reliable consistency effects. The data are discussed as suggesting that orthographic codes are activated during word recognition, or that the organization of phonological representations of words is affected by orthography during literacy acquisition.

The frequency effect for pseudowords in the lexical decision task

Four experiments were designed to investigate whether the frequency of words used to create pseudowords plays an important role in lexical decision. Computational models of the lexical decision task (e.g., the dual route cascaded model and the multiple read-out model) predict that latencies to low-frequency pseudowords should be faster than latencies to high-frequency pseudowords. Consistent with this prediction, results showed that when the pseudowords were created by replacing one internal letter of the base word (Experiments 1 and 3), high-frequency pseudowords yielded slower latencies than low-frequency pseudowords. However, this effect occurred only in the leading edge of the response time (RT) distributions. When the pseudowords were created by transposing two adjacent internal letters (Experiment 2), high-frequency pseudowords produced slower latencies in the leading edge and in the bulk of the RT distributions. These results suggest that transposed-letter pseudowords may be more similar to their base words than replacement-letter pseudowords. Finally, when participants performed a go/no-go lexical decision task with one-letter different pseudowords (Experiment 4), high-frequency pseudowords yielded substantially faster latencies than low-frequency pseudowords, which suggests that the lexical entries of high-frequency words can be verified earlier than the lexical entries of low-frequency words. The implications of these results for models of word recognition and lexical decision are discussed.

Visual phonology: the effects of orthographic consistency on different auditory word recognition tasks

In this study, we investigated orthographic influences on spoken word recognition. The degree of spelling inconsistency was manipulated while rime phonology was held constant. Inconsistent words with subdominant spellings were processed more slowly than inconsistent words with dominant spellings. This graded consistency effect was obtained in three experiments. However, the effect was strongest in lexical decision, intermediate in rime detection, and weakest in auditory naming. We conclude that (1) orthographic consistency effects are not artifacts of phonological, phonetic, or phonotactic properties of the stimulus material; (2) orthographic effects can be found even when the error rate is extremely low, which rules out the possibility that they result from strategies used to reduce task difficulty; and (3) orthographic effects are not restricted to lexical decision. However, they are stronger in lexical decision than in other tasks. Overall, the study shows that learning about orthography alters the way we process spoken language.

Does "whole-word shape" play a role in visual word recognition?

To analyze the impact of outline shape on visual word recognition, the visual pattern of the stimuli can be distorted by size alternation. Contrary to the predictions of models that rely on outline shape (Allen, Wallace, & Weber, 1995), the effect of size alternation was greater for low-frequency words than for high-frequency words in a lexical decision task (Experiment 1). In Experiment 2, the effect of case type (lowercase vs. UPPERCASE) occurred for low-frequency words, but not for high-frequency words. The effect of neighborhood size was remarkably similar in the two experiments. The results can be readily explained in the framework of a resonance model (Grossberg & Stone, 1986), in which a mismatch between the original sensory pattern and the abstract orthographic code slows down the formation of a stable percept.

Loss of rapid phonological recoding in reading Hanja, the logographic script of Korean

The role that recent experience has in the processing of Korean Hanja characters was investigated in two masked priming experiments. Two groups of Korean native speakers that differed in their recent exposure to Hanja were asked to name single Hanja characters (targets) that were immediately preceded by masked presentations of the same characters (repetition priming), Hanja characters that were homophones of the target (homophone priming), or unrelated characters (baseline). The results showed that the group that had been less recently exposed made more errors and were slower than the group that had been the more recently exposed. Furthermore, there was no character homophone priming for the less recently exposed group, although they did show a robust repetition priming effect. On the other hand, the more recently exposed group showed both strong character repetition and homophone priming effects. We suggest that regular exposure to characters supports their rapid and automatic processing. It is argued that the different patterns of priming for the two groups were due to how rapidly the orthographic and phonological information of the prime could be resolved.

Pseudohomophones and word recognition

Pseudohomophones play an important role in visual word recognition research, but they are not often themselves the object of experimental inquiry. In Experiment 1, we explored whether the status of body rime relations in pseudohomophones-whether their body rime relations exist in actual words-predicts the likelihood of word pronunciations to pseudohomophone spellings. In Experiment 2, we tested whether extant body rime relations modulate performance to pseudohomophones, and their context effect on word trials, in a lexical decision task. Extant body rime relations increase the likelihood that a pseudohomophone will be given a word pronunciation, and they produce slower and more error prone performance to pseudohomophones and words in lexical decision.

The attentional control of lexical processing pathways: reversing the word frequency effect

In two experiments, we investigated the influence of word frequency in speeded word naming and in a relatively novel regularization task in which participants were required to pronounce words on the basis of spelling-to-sound correspondences instead of giving their normal pronunciations (e.g., pronounce pint so that it rhymes with hint). Participants were presented high- and low-frequency regular words and exception words, along with a set of nonwords. The results indicated that there was a normal word frequency effect (i.e., high-frequency words faster than low-frequency words) in the standard speeded naming task, whereas, for the regularization task, the word frequency effect was reversed for regular words, even though the regular words were pronounced in an identical fashion in both the normal naming and the regularization tasks. This reversal of the word frequency effect was not obtained for the exception words. The discussion focuses on the implication of these results for attentional control models of lexical processing.

Do spelling variations affect associative and phonological priming by pseudohomophones?

A nonword prime can sound like a target word or one of the target's associates, and it can look like either without sounding like either. These pseudohomophones and pseudohomographs can vary in the number of letters shared with the target or its associate. In an associative priming experiment in which targets were named and prime duration was 125 msec within a mask-prime-mask-target sequence, pseudohomophones primed and pseudohomographs did not, with the pseudoassociative priming being only weakly affected by spelling differences. In three further experiments, prime homophony and homography were defined in respect to the target. Prime durations were 125 and 21 msec within a mask-prime-mask-target sequence and 57 msec within a mask-prime-target sequence. The superior priming by pseudohomophones was relatively insensitive to spelling. Results are discussed in terms of the phonological coherence hypothesis and the roles for orthographic information implied by the hypothesis.

Testing a computational account of category-specific deficits

Patients displaying mild symptoms of Alzheimer's disease sometimes have more difficulty naming items from an artifact than from a natural kind category; others displaying more severe symptoms almost always have more difficulty naming items from a natural kind than from an artifact category. This paper examined a computational model of this double dissociation (Devlin, Gonnerman, Andersen, & Seidenberg, 1998). Four basic tests of the model were proposed: The model should be able to generalize to new exemplars, the model should be expandable such that training sets of a realistic size can be used, the model's performance should not be unduly affected by small changes in architecture, and the learning algorithm should produce results that are not inconsistent with any major underlying factor of semantic organization. The model was found to be deficient in all four areas. Results reported from the model may therefore have been idiosyncratic to the model and not reflect general properties of a real semantic system.

Automatic activation of phonological information in reading: evidence from the semantic relatedness decision task

A semantic relatedness decision task was used to investigate whether phonological recording occurs automatically and whether it mediates lexical access in visual word recognition and reading. In this task, subjects read a pair of words and decided whether they were related or unrelated in meaning. In Experiment 1, unrelated word-homophone pairs (e.g., LION-BARE) and their visual controls (e.g., LION-BEAN) as well as related word pairs (e.g., FISH-NET) were presented. Homophone pairs were more likely to be judged as related or more slowly rejected as unrelated than their control pairs, suggesting phonological access of word meanings. In Experiment 2, word-pseudohomophone pairs (e.g., TABLE-CHARE) and their visual controls (e.g., TABLE-CHARK) as well as related and unrelated word pairs were presented. Pseudohomophone pairs were more likely to be judged as related or more slowly rejected as unrelated than their control pairs, again suggesting automatic phonological recording in reading.

Simulating individual word identification thresholds and errors in the fragmentation task

This article presents a large-scale study that collected word identification thresholds and errors in the fragmentation task for all four-letter French words. In the first part of this article, we identify some of the variables (e.g., word frequency, neighborhood size, letter confusability) that affect performance in the fragmentation task. In the second part, we analyze individual response performance and identify different response strategies. We demonstrate that the interactive activation model can account for individual response strategies by adapting two of its original parameters: word-letter feedback and letter-word inhibition. In the third part, we demonstrate that the adaptation of the interactive activation model to the fragmentation task makes it possible to successfully simulate a facilitatory frequency effect on identification thresholds, an inhibitory neighborhood size effect on error rates, and an inhibitory letter confusability effect on identification thresholds. When the task-specific processes of the fragmentation task are specified and individual response strategies are considered, the interactive activation model provides a parsimonious architecture for modeling the task-independent processes involved in word perception.

When do nonwords activate semantics? Implications for models of visual word recognition

Three lexical decision experiments examined the conditions in which nonwords activate semantics. Lexical decisions to targets (e.g., CAT) were faster when preceded by semantically related nonword primes (e.g., DEG derived from DOG) when the prime was brief and masked; this nonword priming effect was eliminated when the prime was presented for a longer duration. These results are discussed in the context of both parallel distributed processing models and the idea that the occurrence of nonword priming depends upon subjects being unable to verify the identity of the prime.