Do perceived context pictures automatically activate their phonological code?

Task-Relevant Representations and Cognitive Control Demands Modulate Functional Connectivity from Ventral Occipito-Temporal Cortex During Object Recognition Tasks

The left ventral occipito-temporal cortex (vOTC) supports extraction and processing of visual features. However, it has remained unclear whether left vOTC-based functional connectivity (FC) differs according to task-relevant representations (e.g., lexical, visual) and control demands imposed by the task, even when similar visual-semantic processing is required for object identification. Here, neural responses to the same set of pictures of meaningful objects were measured, while the type of task that participants had to perform (picture naming versus size-judgment task), and the level of cognitive control required by the picture naming task (high versus low interference contexts) were manipulated. Explicit retrieval of lexical representations in the picture naming task facilitated activation of lexical/phonological representations, modulating FC between left vOTC and dorsal anterior-cingulate-cortex/pre-supplementary-motor-area. This effect was not observed in the size-judgment task, which did not require explicit word-retrieval of object names. Furthermore, retrieving the very same lexical/phonological representation in the high versus low interference contexts during picture naming increased FC between left vOTC and left caudate. These findings support the proposal that vOTC functional specialization emerges from interactions with task-relevant brain regions.

Word Identification With Temporally Interleaved Competing Sounds by Younger and Older Adult Listeners

OBJECTIVES

The purpose of this experiment was to contribute to our understanding of the nature of age-related changes in competing speech perception using a temporally interleaved task.

DESIGN

Younger and older adults (n = 16/group) participated in this study. The target was a five-word sentence. The masker was one of the following: another five-word sentence; five brief samples of modulated noise; or five brief samples of environmental sounds. The stimuli were presented in a temporally interleaved manner, where the target and masker alternated in time, always beginning with the target. Word order was manipulated in the target (and in the masker during trials with interleaved words) to compare performance when the five words in each stream did versus did not create a syntactically correct sentence. Talker voice consistency also was examined by contrasting performance when each word in the target was spoken by the same talker or by different talkers; a similar manipulation was used for the masker when it consisted of words. Participants were instructed to repeat back the target words and ignore the intervening words or sounds. Participants also completed a subset of tests from the NIH Cognitive Toolbox.

RESULTS

Performance on this interleaved task was significantly associated with listener age and with a metric of cognitive flexibility, but it was not related to the degree of high-frequency hearing loss. Younger adults' performance on this task was better than that of older adults, especially for words located toward the end of the sentence. Both groups of participants were able to take advantage of correct word order in the target, and both were negatively affected, to a modest extent, when the masker words were in correct syntactic order. The two groups did not differ in how phonetic similarity between target and masker words influenced performance, and interleaved environmental sounds or noise had only a minimal effect for all listeners. The most robust difference between listener groups was found for the use of voice consistency: older adults, as compared with younger adults, were less able to take advantage of a consistent target talker within a trial.

CONCLUSIONS

Younger adults outperformed older adults when masker words were interleaved with target words. Results suggest that this difference was unlikely to be related to energetic masking and/or peripheral hearing loss. Rather, age-related changes in cognitive flexibility and problems encoding voice information appeared to underlie group differences. These results support the contention that, in real-life competing speech situations that produce both energetic and informational masking, older adults' problems are due to both peripheral and nonperipheral changes.

Semantic interference in the picture-word interference task: Is there a pre-lexical, conceptual contribution to the effect?

Picture naming takes longer in the presence of a semantic-categorically related distractor word compared to an unrelated distractor word. This semantic interference effect in the picture-word interference (PWI) task is an empirical cornerstone in speech production research and of central importance in theory development and evaluation. Prominent models locate the effect at an abstract lexical level, yet only few studies have tested for a possible pre-lexical, conceptual contribution. Moreover, those studies that did are not conclusive. We re-explored the locus of semantic interference by contrasting two task versions that were implemented in as parallel a fashion as possible, but differed with respect to the processing stages involved: naming pictures (requiring conceptual processing and lexical processing) and deciding on their natural size (requiring conceptual processing only). We predicted semantic interference in naming, replicating the standard effect. If part of the effect is localized at the conceptual level, we predicted interference in size decision, too. We found semantic effects in both tasks but with different polarity - interference in naming and facilitation in size decision. This pattern supports the view that semantic interference in PWI has its locus at the lexical level and its origin at the conceptual level.

When Sufficiently Processed, Semantically Related Distractor Pictures Hamper Picture Naming

Abstract. Prominent speech production models view lexical access as a competitive process. According to these models, a semantically related distractor picture should interfere with target picture naming more strongly than an unrelated one. However, several studies failed to obtain such an effect. Here, we demonstrate that semantic interference is obtained, when the distractor picture is sufficiently processed. Participants named one of two pictures presented in close temporal succession, with color cueing the target. Experiment 1 induced the prediction that the target appears first. When this prediction was violated (distractor first), semantic interference was observed. Experiment 2 ruled out that the time available for distractor processing was the driving force. These results show that semantically related distractor pictures interfere with the naming response when they are sufficiently processed. The data thus provide further support for models viewing lexical access as a competitive process.

It Is Not Necessary to Retrieve the Phonological Nodes of Context Objects for Chinese Speakers

The issue of how activation is transmitted from semantic to phonological level in spoken production remains controversial. Recent evidences from alphabetic languages support a cascaded view. However, given the different architecture of phonological encoding in non-alphabetic languages, it is not clear whether this view applies in Chinese, as a non-alphabetic script. We therefore investigated whether the not-to-be named pictures activate their phonological properties in Chinese speech production. In Experiment 1, participants were presented a target English word and a context picture (semantically related or unrelated, phonologically related or unrelated to target word in Chinese) and were asked to translate the English word into a Chinese word. The translation latencies were faster in the semantically related condition than in the unrelated condition. By contrast, no difference between phonologically related and unrelated was observed. In Experiment 2, in order to promote participants phonological sensitivity in a word-translation task, we increased the proportion of phonologically related trials from 25 to 50%. In Experiment 3, we employed a word association task that was more sensitive to phonological activation of context objects than a word translation task. The phonological activation of context objects were absent again in Experiments 2 and 3. Bayes Factor analysis suggested that the absence of phonological activation of context pictures was reliable. Results consistently revealed that only target lemma could activate the corresponding phonological node to guide articulation whereas no phonological activation of non-target lemma’s in Chinese. The present findings thus support a discrete model in Chinese spoken word production, which was contrastive with the cascaded view in alphabetic languages production.

Cognitive control during selection and repair in word production

Production of an intended word entails selection processes, in which first the lexical item and then its segments are selected among competitors, as well as processes that covertly or overtly repair dispreferred words. In two experiments, we studied the locus of the control processes involved in selection (selection control) and intercepting errors (post-monitoring control). Selection control was studied by manipulating the overlap (contextual similarity) in either semantics or in segments between two objects that participants repeatedly named. Post-monitoring control was examined by asking participants to reverse, within each block, the name of the two objects that were either semantically- or segmentally-related, thus suppressing a potent, but incorrect, response in favor of an alternative (reversal). Results showed robust costs of both contextual similarity (which increased with the degree of similarity between target and context) and reversal, but the two did not interact with one another. Analysis of individual differences revealed no reliable correlation between the cost of contextual similarity when pairs were semantically- or segmentally-related, suggesting stage-specific selection control processes. On the other hand, the cost of reversal was reliably correlated between semantically- and segmentally-related pairs, implying a different control process that is shared by both stages of production. Collectively, these results support a model in which selection control operates separately at lexical and segmental selection stages, but post-monitoring control operates on the segmentally-encoded outcome.

Investigating the flow of information during speaking: the impact of morpho-phonological, associative, and categorical picture distractors on picture naming

In three experiments, participants named target pictures by means of German compound words (e.g., Gartenstuhl–garden chair), each accompanied by two different distractor pictures (e.g., lawn mower and swimming pool). Targets and distractor pictures were semantically related either associatively (garden chair and lawn mower) or by a shared semantic category (garden chair and wardrobe). Within each type of semantic relation, target and distractor pictures either shared morpho-phonological (word-form) information (Gartenstuhl with Gartenzwerg, garden gnome, and Gartenschlauch, garden hose) or not. A condition with two completely unrelated pictures served as baseline. Target naming was facilitated when distractor and target pictures were morpho-phonologically related. This is clear evidence for the activation of word-form information of distractor pictures. Effects were larger for associatively than for categorically related distractors and targets, which constitute evidence for lexical competition. Mere categorical relatedness, in the absence of morpho-phonological overlap, resulted in null effects (Experiments 1 and 2), and only speeded target naming when effects reflect only conceptual, but not lexical processing (Experiment 3). Given that distractor pictures activate their word forms, the data cannot be easily reconciled with discrete serial models. The results fit well with models that allow information to cascade forward from conceptual to word-form levels.

Cascadedness in Chinese written word production

In written word production, is activation transmitted from lexical-semantic selection to orthographic encoding in a serial or cascaded fashion? Very few previous studies have addressed this issue, and the existing evidence comes from languages with alphabetic orthographic systems. We report a study in which Chinese participants were presented with colored line drawings of objects and were instructed to write the name of the color while attempting to ignore the object. Significant priming was found when on a trial, the written response shared an orthographic radical with the written name of the object. This finding constitutes clear evidence that task-irrelevant lexical codes activate their corresponding orthographic representation, and hence suggests that activation flows in a cascaded fashion within the written production system. Additionally, the results speak to how the time interval between processing of target and distractor dimensions affects and modulates the emergence of orthographic facilitation effects.

Seriality of semantic and phonological processes during overt speech in Mandarin as revealed by event-related brain potentials

How is information transmitted across semantic and phonological levels in spoken word production? Recent evidence from speakers of Western languages such as English and Dutch suggests non-discrete transmission, but it is not clear whether this view can be generalized to other languages such as Mandarin, given potential differences in phonological encoding across languages. The present study used Mandarin speakers and combined a behavioral picture-word interference task with event-related potentials. The design factorially crossed semantic and phonological relatedness. Results showed semantic and phonological effects both in behavioral and electrophysiological measurements, with statistical additivity in latencies, and discrete time signatures (250-450 ms and 450-600 ms after picture onset for the semantic and phonological condition, respectively). Overall, results suggest that in Mandarin spoken production, information is transmitted from semantic to phonological levels in a sequential fashion. Hence, temporal signatures associated with spoken word production might differ depending on target language.

Facilitation and interference in the color-naming task

Two experiments were conducted to evaluate the phonological activation of the name of pictures when participants had to name the color in which these pictures were depicted. In Experiment 1, participants named the color of pictures whose names and color names shared the phonological beginning (phonologically related condition), the color of pictures whose names and color names did not share phonology (phonologically unrelated condition), and the color of abstract forms (neutral condition). A facilitatory effect was obtained, so participants were faster in the related condition than in the unrelated condition. However, naming latencies were similar in the neutral condition and the unrelated condition. In Experiment 2, the unrelated condition was replaced by a phonologically incongruent condition in which the name of the picture was phonologically unrelated to its color name but related to the name of other response color names. The results showed again a facilitatory effect when the related condition was compared with the incongruent condition. Importantly, an interference effect was also observed, so naming latencies were longer in the incongruent condition than in the neutral condition. These results are discussed in terms of language production models.

The “BIG BIRD” of the “YELLOW YOUNG” Man: Do Nontarget Properties Cascade?

This study investigated whether in speech production object properties flow in a cascaded manner or whether cascaded processing is restricted to the object's identity. In Experiments 1 and 2, participants saw pictured objects and had to state either their size (GRAND or PETIT—meaning big and small) or their name. The size of the objects varied as a function of the way they were presented on the computer screen (Experiment 1) or their real size in the world (Experiment 2). In Experiment 3, faces of young and old men were coloured in yellow or in green. The task was to name either the colour (JAUNE or VERT, meaning yellow and green, respectively) or the age (JEUNE or VIEUX, meaning young and old, respectively) of the face. In Experiments 1 and 2, no reliable effects of phonological relatedness (“GORILLE– g rand”—a big gorilla) were found on the object-naming latencies. However, size-naming latencies were shorter when the adjective shared the initial phoneme of the picture name (i.e., “GRAND– gorille”) than when it did not (i.e., “GRAND–dinosaure”—saying “ big” in response to a big dinosaur). In Experiment 3, phonological overlap did not affect colour naming latencies, or age naming latencies. Overall, these findings strongly suggest that cascaded processing is restricted to the object's identity in conceptually driven naming tasks.

Activation of phonological competitors in visual search

Recently, Meyer, Belke, Telling and Humphreys (2007) reported that competitor objects with homophonous names (e.g., boy) interfere with identifying a target object (e.g., buoy) in a visual search task, suggesting that an object name's phonology becomes automatically activated even in situations in which participants do not have the intention to speak. The present study explored the generality of this finding by testing a different phonological relation (rhyming object names, e.g., cat-hat) and by varying details of the experimental procedure. Experiment 1 followed the procedure by Meyer et al. Participants were familiarized with target and competitor objects and their names at the beginning of the experiment and the picture of the target object was presented prior to the search display on each trial. In Experiment 2, the picture of the target object presented prior to the search display was replaced by its name. In Experiment 3, participants were not familiarized with target and competitor objects and their names at the beginning of the experiment. A small interference effect from phonologically related competitors was obtained in Experiments 1 and 2 but not in Experiment 3, suggesting that the way the relevant objects are introduced to participants affects the chances of observing an effect from phonologically related competitors. Implications for the information flow in the conceptual-lexical system are discussed.

Language processing in children with cochlear implants: a preliminary report on lexical access for production and comprehension

In this plenary paper, we present a review of language research in children with cochlear implants along with an outline of a 5-year project designed to examine the lexical access for production and recognition. The project will use auditory priming, picture naming with auditory or visual interfering stimuli (Picture-Word Interference and Picture-Picture Interference, respectively) and eye tracking paradigms to examine the roles of semantic and various phonological factors. Preliminary data are presented from auditory priming, picture-word interference and picture-picture interference tasks. The emergence of group difference is briefly discussed.

Conscious intention to speak proactively facilitates lexical access during overt object naming

The present study explored when and how the top-down intention to speak influences the language production process. We did so by comparing the brain's electrical response for a variable known to affect lexical access, namely word frequency, during overt object naming and non-verbal object categorization. We found that during naming, the event-related brain potentials elicited for objects with low frequency names started to diverge from those with high frequency names as early as 152 ms after stimulus onset, while during non-verbal categorization the same frequency comparison appeared 200 ms later eliciting a qualitatively different brain response. Thus, only when participants had the conscious intention to name an object the brain rapidly engaged in lexical access. The data offer evidence that top-down intention to speak proactively facilitates the activation of words related to perceived objects.

The mechanism underlying lexical selection: evidence from the picture-picture interference paradigm

In two experiments using the picture–picture and picture–word interference paradigms, we compared predictions from the swinging lexical network and the response exclusion hypothesis to determine whether the process of word selection is competitive. Further, we suggest that previous categorical effects in the picture–picture interference paradigm were due to stimuli confounds, thus readdressing the debate concerning categorical effects in the paradigm. Consistent with both hypotheses, in Experiment 1 we found faster picture naming times when distractor pictures were associatively related than when they were unrelated, explained as a result of a spread of activation at the conceptual level with little (swinging lexical network) or no (response exclusion hypothesis) contribution from lexical competition. In Experiment 2, we found a significant categorical interference effect in the picture–word interference paradigm, and this effect significantly decreased but was not facilitatory when distractors were pictures. We discuss how these results are consistent with the swinging lexical network and conclude that the process to select a word is a competitive one.

Congruency effects in conceptualizing for speech

In naming a picture at the basic level, a semantically related distractor word induces interference in comparison to an unrelated word. When the task is changed from basic-level naming to categorization, however, this effect reverses to semantic facilitation. In previous studies, this semantic facilitation effect was attributed to "message congruency" at the conceptual level. The present study examines the nature of this message congruency effect: Is it due to competition between two activated category concepts in the incongruent condition or is it due to convergence of activity on a single category concept in the congruent condition? Two experiments show that neither the strength with which the context stimulus activates an incongruent category concept nor the semantic distance between the category concepts activated by target and distractor affect target categorization speed. We conclude that the message congruency effect is most likely due to convergence on a single category concept in the category-congruent condition.

Parallel object activation and attentional gating of information: evidence from eye movements in the multiple object naming paradigm

Do we access information from any object we can see, or do we access information only from objects that we intend to name? In 3 experiments using a modified multiple object naming paradigm, subjects were required to name several objects in succession when previews appeared briefly and simultaneously in the same location as the target as well as at another location. In Experiment 1, preview benefit-faster processing of the target when the preview was related (a mirror image of the target) compared to unrelated (semantically and phonologically)-was found for the preview in the target location but not a location that was never to be named. In Experiment 2, preview benefit was found if a related preview appeared in either the target location or the third-to-be-named location. Experiment 3 showed the difference between results from the first 2 experiments was not due to the number of objects on the screen. These data suggest that attention serves to gate visual input about objects based on the intention to name them and that information from one intended-to-be-named object can facilitate processing of an object in another location.

Sensitivity to the acoustic correlates of lexical stress and their relationship to reading in skilled readers

The role of suprasegmental information in reading processes is a growing area of interest, and sensitivity to lexical stress has been shown to explain unique variance in reading development. However, less is known about its role in skilled reading. This study aimed to investigate the acoustic features of suprasegmental information using a same/different cross-modal matching task. Sixty-four adult participants completed standardized measures of reading accuracy, reading speed, and comprehension and performed an experimental task. The experimental task required the participants to identify whether non-speech acoustic sequences matched the characteristics of written words. The findings indicated differences in responses depending on where the lexical stress was required for the word. Moreover, evidence was found to support the view that amplitude information is part of the word knowledge retrieval process in skilled reading. The findings are discussed relative to models of reading and the role of lexical stress in lexical access.

Phonological Planning during Sentence Production: Beyond the Verb

The current study addresses the extent of phonological planning during spontaneous sentence production. Previous work shows that at articulation, phonological encoding occurs for entire phrases, but encoding beyond the initial phrase may be due to the syntactic relevance of the verb in planning the utterance. I conducted three experiments to investigate whether phonological planning crosses multiple grammatical phrase boundaries (as defined by the number of lexical heads of phrase) within a single phonological phrase. Using the picture-word interference paradigm, I found in two separate experiments a significant phonological facilitation effect to both the verb and noun of sentences like "He opens the gate." I also altered the frequency of the direct object and found longer utterance initiation times for sentences ending with a low-frequency vs. high-frequency object offering further support that the direct object was phonologically encoded at the time of utterance initiation. That phonological information for post-verbal elements was activated suggests that the grammatical importance of the verb does not restrict the extent of phonological planning. These results suggest that the phonological phrase is unit of planning, where all elements within a phonological phrase are encoded before articulation. Thus, consistent with other action sequencing behavior, there is significant phonological planning ahead in sentence production.

Homophonic context effects when naming Japanese kanji: evidence for processing costs?

The current study investigated the effects of phonologically related context pictures on the naming latencies of target words in Japanese and Chinese. Reading bare words in alphabetic languages has been shown to be rather immune to effects of context stimuli, even when these stimuli are presented in advance of the target word (e.g., Glaser & Düngelhoff, 1984 ; Roelofs, 2003 ). However, recently, semantic context effects of distractor pictures on the naming latencies of Japanese kanji (but not Chinese hànzì) words have been observed (Verdonschot, La Heij, & Schiller, 2010 ). In the present study, we further investigated this issue using phonologically related (i.e., homophonic) context pictures when naming target words in either Chinese or Japanese. We found that pronouncing bare nouns in Japanese is sensitive to phonologically related context pictures, whereas this is not the case in Chinese. The difference between these two languages is attributed to processing costs caused by multiple pronunciations for Japanese kanji.

Phonological Facilitation from Pictures in a Word Association Task: Evidence for Routine Cascaded Processing in Spoken Word Production

While most authors now agree that the language production system is in principle cascaded, the strength with which cascaded lemma-to-phoneme activation typically occurs is debated. Picture naming has been shown to be facilitated by phonologically related distractor pictures, but no such facilitation from pictures has been shown for word reading. Picture–picture paradigms have recently been suggested to represent an attentionally facilitated and unusually strong case of cascaded phonological facilitation, not typical of a more general weakly cascaded production system. We used a novel procedure based on picture–word interference paradigms, where participants made speeded verbal free association responses to presented words, with irrelevant picture distractors that were phonologically related to their predicted high-associate responses. Phonological facilitation effects from related picture names were observed on free associate verbal production latencies. These findings represent a far more general demonstration of routine cascaded language production and suggest that the strength and extent of cascaded activation is more substantial than that suggested by traditional picture–word paradigms.

Semantic relatedness among objects promotes the activation of multiple phonological codes during object naming

In a picture-word interference experiment the authors demonstrate that a semantic-categorical relation between a to-be-named target picture and a context picture promotes the phonological activation of the to-be-ignored context picture. No such phonological activation is observed if the objects are semantically unrelated. This finding gives further insight into the mechanisms that modulate the activation flow in the conceptual-lexical system during speech planning. In contrast to recent picture-picture interference studies, the results provide direct evidence that the phonological activation of a context object is dependent on its semantic processing.