Object substitution masking interferes with semantic processing: evidence from event-related potentials

What was that object? On the role of identity information in the formation of object files and conscious object perception

Object files are a psychological representation that allows the human brain to keep track of objects, as they move and change across time. The question regarding what information is used to individuate versus update object files has been the focus of considerable scientific debate. Historically, the role of an object's spatiotemporal history was emphasised, whereas more recent work has demonstrated a key contribution from surface features, such as colour. The purpose of the present study was to investigate the role of identity-level information in the formation and individuation of object files, and how it compares to the contribution of featural information. Using a modified spatial repetition-blindness paradigm, across four experiments, there was convergent evidence that surface features contribute to the formation of object files, whereas the role of identity information was at best much smaller and less reliable than the clear contribution from surface features, and the most parsimonious explanation is that it was not present at all.

Psychophysical "blinding" methods reveal a functional hierarchy of unconscious visual processing

Numerous non-invasive experimental "blinding" methods exist for suppressing the phenomenal awareness of visual stimuli. Not all of these suppressive methods occur at, and thus index, the same level of unconscious visual processing. This suggests that a functional hierarchy of unconscious visual processing can in principle be established. The empirical results of extant studies that have used a number of different methods and additional reasonable theoretical considerations suggest the following tentative hierarchy. At the highest levels in this hierarchy is unconscious processing indexed by object-substitution masking. The functional levels indexed by crowding, the attentional blink (and other attentional blinding methods), backward pattern masking, metacontrast masking, continuous flash suppression, sandwich masking, and single-flash interocular suppression, fall at progressively lower levels, while unconscious processing at the lowest levels is indexed by eye-based binocular-rivalry suppression. Although unconscious processing levels indexed by additional blinding methods is yet to be determined, a tentative placement at lower levels in the hierarchy is also given for unconscious processing indexed by Troxler fading and adaptation-induced blindness, and at higher levels in the hierarchy indexed by attentional blinding effects in addition to the level indexed by the attentional blink. The full mapping of levels in the functional hierarchy onto cortical activation sites and levels is yet to be determined. The existence of such a hierarchy bears importantly on the search for, and the distinctions between, neural correlates of conscious and unconscious vision.

Substituting objects from consciousness: a review of object substitution masking

Object substitution masking (OSM) occurs when a sparse (e.g., four-dot), temporally trailing mask obscures the visibility of a briefly presented target. Here, we review theories of OSM: those that propose that OSM reflects the interplay between feedforward and feedback/reentrant neural processes, those that predict that feedforward processing alone gives rise to the phenomenon, and theories that focus on cognitive explanations, such as object updating. We discuss how each of these theories accommodates key findings from the OSM literature. In addition, we examine the relationship between OSM and other visual-cognitive phenomena, including object correspondence through occlusion, change blindness, metacontrast masking, backward masking, and visual short-term memory. Finally, we examine the level of processing at which OSM impairs target perception. Collectively, OSM appears to reflect the conditions under which the brain confuses two visual events for one when they are encoded with low spatiotemporal resolution, due to processing resources being otherwise occupied.

Neural processing stages during object-substitution masking and their relationship to perceptual awareness

The extent of visual perceptual processing that occurs in the absence of awareness is as yet unclear. Here we examined event-related-potential (ERP) indices of visual and cognitive processes as awareness was manipulated through object-substitution masking (OSM), an awareness-disrupting effect that has been hypothesized to result from the disruption of reentrant signaling to low-level visual cortical areas. In OSM, a visual stimulus array is briefly presented that includes a parafoveal visual target denoted by a cue, typically consisting of several surrounding dots. When the offset of the target-surrounding cue dots is delayed relative to the rest of the array, a striking reduction in the perception of the target image surrounded by the dots is observed. Using faces and houses as the target stimuli, we found that successful OSM reduced or eliminated all the measured electrophysiological indices of visual processing stages after 130ms post-stimulus. More specifically, when targets were missed within the masked condition (i.e., on trials with effective OSM that disrupted awareness), we observed fully intact early feed-forward processing up through the visual extrastriate P1 ERP component peaking at 100ms, followed by reduced low-level activity over the occipital pole 130-170ms post-stimulus, reduced ERP indices of lateralized shifts of attention toward the parafoveal target, reduced object-generic visual processing, abolished object-category-specific (face-specific) processing, and reduced late visual short-term-memory processing activity. The results provide a comprehensive electrophysiological account of the neurocognitive underpinnings of effective OSM of visual-object images, including evidence for central roles of early reentrant signal disruption and insufficient visual attentional deployment.

Crowded words can be processed semantically: evidence from an ERP study

The term "crowding" refers to impaired peripheral object identification due to the presence of nearby objects. In this study, event-related potentials (ERPs) were used to investigate semantic processing of crowded Chinese words by combining a crowding task with a semantic-priming paradigm. Results showed that the N400 component, an index of semantic processing, was elicited by both crowded and uncrowded words. These results suggest that words were processed semantically despite crowding, and that features of the crowded words were integrated correctly.

Object substitution masking in schizophrenia: an event-related potential analysis

Schizophrenia patients exhibit deficits on visual processing tasks, including visual backward masking, and these impairments are related to deficits in higher-level processes. In the current study we used electroencephalography techniques to examine successive stages and pathways of visual processing in a specialized masking paradigm, four-dot masking, which involves masking by object substitution. Seventy-six schizophrenia patients and 66 healthy controls had event-related potentials (ERPs) recorded during four-dot masking. Target visibility was manipulated by changing stimulus onset asynchrony (SOA) between the target and mask, such that performance decreased with increasing SOA. Three SOAs were used: 0, 50, and 100 ms. The P100 and N100 perceptual ERPs were examined. Additionally, the visual awareness negativity (VAN) to correct vs. incorrect responses, an index of reentrant processing, was examined for SOAs 50 and 100 ms. Results showed that patients performed worse than controls on the behavioral task across all SOAs. The ERP results revealed that patients had significantly smaller P100 and N100 amplitudes, though there was no effect of SOA on either component in either group. In healthy controls, but not patients, N100 amplitude correlated significantly with behavioral performance at SOAs where masking occurred, such that higher accuracy correlated with a larger N100. Healthy controls, but not patients, exhibited a larger VAN to correct vs. incorrect responses. The results indicate that the N100 appears to be related to attentional effort in the task in controls, but not patients. Considering that the VAN is thought to reflect reentrant processing, one interpretation of the findings is that patients' lack of VAN response and poorer performance may be related to dysfunctional reentrant processing.

The N400 and Late Positive Complex (LPC) Effects Reflect Controlled Rather than Automatic Mechanisms of Sentence Processing

This study compared automatic and controlled cognitive processes that underlie event-related potentials (ERPs) effects during speech perception. Sentences were presented to French native speakers, and the final word could be congruent or incongruent, and presented at one of four levels of degradation (using a modulation with pink noise): no degradation, mild degradation (2 levels), or strong degradation. We assumed that degradation impairs controlled more than automatic processes. The N400 and Late Positive Complex (LPC) effects were defined as the differences between the corresponding wave amplitudes to incongruent words minus congruent words. Under mild degradation, where controlled sentence-level processing could still occur (as indicated by behavioral data), both N400 and LPC effects were delayed and the latter effect was reduced. Under strong degradation, where sentence processing was rather automatic (as indicated by behavioral data), no ERP effect remained. These results suggest that ERP effects elicited in complex contexts, such as sentences, reflect controlled rather than automatic mechanisms of speech processing. These results differ from the results of experiments that used word-pair or word-list paradigms.

A pool of pairs of related objects (POPORO) for investigating visual semantic integration: behavioral and electrophysiological validation

Semantic processing of verbal and visual stimuli has been investigated in semantic violation or semantic priming paradigms in which a stimulus is either related or unrelated to a previously established semantic context. A hallmark of semantic priming is the N400 event-related potential (ERP)--a deflection of the ERP that is more negative for semantically unrelated target stimuli. The majority of studies investigating the N400 and semantic integration have used verbal material (words or sentences), and standardized stimulus sets with norms for semantic relatedness have been published for verbal but not for visual material. However, semantic processing of visual objects (as opposed to words) is an important issue in research on visual cognition. In this study, we present a set of 800 pairs of semantically related and unrelated visual objects. The images were rated for semantic relatedness by a sample of 132 participants. Furthermore, we analyzed low-level image properties and matched the two semantic categories according to these features. An ERP study confirmed the suitability of this image set for evoking a robust N400 effect of semantic integration. Additionally, using a general linear modeling approach of single-trial data, we also demonstrate that low-level visual image properties and semantic relatedness are in fact only minimally overlapping. The image set is available for download from the authors' website. We expect that the image set will facilitate studies investigating mechanisms of semantic and contextual processing of visual stimuli.

Semantic analysis does not occur in the absence of awareness induced by interocular suppression

It has been intensely debated whether visual stimuli are processed to the point of semantic analysis in the absence of awareness. In the present study, we measured the extent to which the meaning of a stimulus was registered using the N400 component of human event-related potentials (ERPs), a highly sensitive index of the semantic mismatch between a stimulus and the context in which it is presented. Observers judged the semantic relatedness of a context and target word while ERPs were recorded under continuous flash suppression (Experiments 1 and 2) and binocular rivalry (Experiment 3). Finally, we parametrically manipulated the visibility of the target word by increasing the contrast between the target word and the suppressive stimulus presented to the other eye (Experiment 4). We found that the amplitude of the N400 was attenuated with increasing suppression depth and was absent whenever the observers could not discriminate the meaning of suppressed words. We discuss these findings in the context of single-process models of consciousness, which can account for a large body of empirical evidence obtained from visual masking, attentional manipulations, and, now, interocular suppression paradigms.

Visual masking by object substitution in schizophrenia

BACKGROUND

Schizophrenia patients demonstrate impairment on visual backward masking, a measure of early visual processing. Most visual masking paradigms involve two distinct processes, an early fast-acting component associated with object formation and a later component that acts through object substitution. So far, masking paradigms used in schizophrenia research have been unable to separate these two processes.

METHOD

We administered three visual processing paradigms (location masking with forward and backward masking, four-dot backward masking and a cuing task) to 136 patients with schizophrenia or schizoaffective disorder and 79 healthy controls. A psychophysical procedure was used to match subjects on identification of an unmasked target prior to location masking. Location masking interrupts object formation, four-dot masking task works through masking by object substitution and the cuing task measures iconic decay.

RESULTS

Patients showed impairment on location masking after being matched for input threshold, similar to previous reports. After correcting for age, patients showed lower performance on four-dot masking than controls, but the groups did not differ on the cuing task.

CONCLUSIONS

Patients with schizophrenia showed lower performance when masking was specific to object substitution. The difference in object substitution masking was not due to a difference in rate of iconic decay, which was comparable in the two groups. These results suggest that, despite normal iconic decay rates, individuals with schizophrenia show impairment in a paradigm of masking by object substitution that did not also involve disruption of object formation.

Implicit perception and level of processing in object-substitution masking

Object-substitution masking (OSM) refers to reduced target discrimination when the target is surrounded by a sparse mask that does not overlap with the target in space but trails it in time. In four experiments, we used a novel paradigm to investigate the extent of processing of a masked target in OSM. We measured response-compatibility effects between target and mask, both when the offsets were simultaneous and when the offset of the mask was delayed. Evidence for both OSM and a dissociation between perception and awareness was found when detecting the match between the target and the mask required feature but not categorical analyses. Our results suggest that the locus of disruption in OSM is likely to be beyond feature analysis of the unreported target.

Is conceptual processing in music automatic? An electrophysiological approach

Recent evidence suggests that music perception, much alike language perception, involves the cognitive processing of concepts, that is abstract general ideas. In a previous study (Daltrozzo and Schön, Conceptual processing in music as revealed by N400 effects on words and musical targets. Journal of Cognitive Neuroscience, In Press), we reported the effect of the presentation of a musical excerpt (the context) on the perception of a word, while participants judged the conceptual relatedness between the two stimuli. Event-Related Potentials (ERPs) showed a N400 effect: a larger N400 to words judged unrelated to their context compared to related words. In the present experiment, we decided to test the influence of the relatedness task on the N400 effect by using a more implicit task: lexical decision. We recorded behavioral and ERP data while participants were presented 50 related and 50 unrelated pairs (excerpt context/word target). An N400 effect was again observed. However, the N400 effect found with a lexical decision was more than two times smaller than with a relatedness judgment task and was significant in a later latency range: 500 to 650 ms instead of 300 to 550 ms with a relatedness judgment. These differences are interpreted as reflecting the task-induced modulation of explicit (strategic) mechanisms involved in the N400 effect.

Many ways to awareness: A developmental perspective on cognitive access

Block's target article makes a significant contribution toward sorting the neural bases of phenomenal consciousness from the neural systems that underlie cognitive access to it. However, data from developmental science suggest that cognitive access may be only one of several ways to access phenomenology. These data may also have implications for the visual-cognitive phenomena that Block uses to support his case.