Response effects in the perception of conjunctions of colour and form

Reconsidering Visual Search

The visual search paradigm has had an enormous impact in many fields. A theme running through this literature has been the distinction between preattentive and attentive processing, which I refer to as the two-stage assumption. Under this assumption, slopes of set-size and response time are used to determine whether attention is needed for a given task or not. Even though a lot of findings question this two-stage assumption, it still has enormous influence, determining decisions on whether papers are published or research funded. The results described here show that the two-stage assumption leads to very different conclusions about the operation of attention for identical search tasks based only on changes in response (presence/absence versus Go/No-go responses). Slopes are therefore an ambiguous measure of attentional involvement. Overall, the results suggest that the two-stage model cannot explain all findings on visual search, and they highlight how slopes of response time and set-size should only be used with caution.

The co-occurrence of multisensory competition and facilitation

Previous studies of multisensory integration have often stressed the beneficial effects that may arise when information concerning an event arrives via different sensory modalities at the same time, as, for example, exemplified by research on the redundant target effect (RTE). By contrast, studies of the Colavita visual dominance effect (e.g., [Colavita, F. B. (1974). Human sensory dominance. Perception & Psychophysics, 16, 409-412]) highlight the inhibitory consequences of the competition between signals presented simultaneously in different sensory modalities instead. Although both the RTE and the Colavita effect are thought to occur at early sensory levels and the stimulus conditions under which they are typically observed are very similar, the interplay between these two opposing behavioural phenomena (facilitation vs. competition) has yet to be addressed empirically. We hypothesized that the dissociation may reflect two of the fundamentally different ways in which humans can perceive concurrent auditory and visual stimuli. In Experiment 1, we demonstrated both multisensory facilitation (RTE) and the Colavita visual dominance effect using exactly the same audiovisual displays, by simply changing the task from a speeded detection task to a speeded modality discrimination task. Meanwhile, in Experiment 2, the participants exhibited multisensory facilitation when responding to visual targets and multisensory inhibition when responding to auditory targets while keeping the task constant. These results therefore indicate that both multisensory facilitation and inhibition can be demonstrated in reaction to the same bimodal event.

Perceptual and decisional contributions to audiovisual interactions in the perception of apparent motion: a signal detection study

Motion information available to different sensory modalities can interact at both perceptual and post-perceptual (i.e., decisional) stages of processing. However, to date, researchers have only been able to demonstrate the influence of one of these components at any given time, hence the relationship between them remains uncertain. We addressed the interplay between the perceptual and post-perceptual components of information processing by assessing their influence on performance within the same experimental paradigm. We used signal detection theory to discriminate changes in perceptual sensitivity (d') from shifts in response criterion (c) in performance on a detection (Experiment 1) and a classification (Experiment 2) task regarding the direction of auditory apparent motion streams presented in noise. In the critical conditions, a visual motion distractor moving either leftward or rightward was presented together with the auditory motion. The results demonstrated a significant decrease in sensitivity to the direction of the auditory targets in the crossmodal conditions as compared to the unimodal baseline conditions that was independent of the relative direction of the visual distractor. In addition, we also observed significant shifts in response criterion, which were dependent on the relative direction of the distractor apparent motion. These results support the view that the perceptual and decisional components involved in audiovisual interactions in motion processing can coexist but are largely independent of one another.

Feature integration that routinely occurs without focal attention

To analyze visual scenes, the visual system decomposes the visual scene into features that are processed in parallel by separate subsystems. Certain theories (Treisman, Wolfe) propose that these subsystems function independently before focal attention integrates their output. We describe a new paradigm-the gestalt detection task--that directly assesses the degree of preattentive dependence between any two subsystems. We present five experiments that test whether the subsystems that process form and color function independently in processing brief (and, therefore, preattentively processed) stimuli. Our data show that these two subsystems interact during the preattentive processing of feature-dependent information. They are synergistic when the information they receive is consistent; they are antagonistic when the information they receive is inconsistent.

The eccentricity effect: target eccentricity affects performance on conjunction searches

The serial pattern found for conjunction visual-search tasks has been attributed to covert attentional shifts, even though the possible contributions of target location have not been considered. To investigate the effect of target location on orientation x color conjunction searches, the target's duration and its position in the display were manipulated. The display was present either until observers responded (Experiment 1), for 104 msec (Experiment 2), or for 62 msec (Experiment 3). Target eccentricity critically affected performance: A pronounced eccentricity effect was very similar for all three experiments; as eccentricity increased, reaction times and errors increased gradually. Furthermore, the set-size effect became more pronounced as target eccentricity increased, and the extent of the eccentricity effect increased for larger set sizes. In addition, according to stepwise regressions, target eccentricity as well as its interaction with set size were good predictors of performance. We suggest that these findings could be explained by spatial-resolution and lateral-inhibition factors. The serial self-terminating hypothesis for orientation x color conjunction searches was evaluated and rejected. We compared the eccentricity effect as well as the extent of the orientation asymmetry in these three conjunction experiments with those found in feature experiments (Carrasco & Katz, 1992). The roles of eye movements, spatial resolution, and covert attention in the eccentricity effect, as well as their implications, are discussed.

Illusory conjunctions and the cerebral hemispheres

Two visual half-field experiments tested Moscovitch's (1979) proposition that cerebral asymmetry does not concern the earliest perceptual stages but only later processing. Subjects were briefly shown displays that included one (Experiment 1) or two (Experiment 2) types of forms differing in size and which, according to previous evidence, might lead to opposite laterality effects. Laterality effects were assessed for correct detections and for illusory conjunctions, both in terms of raw detection scores and in terms of perceptual discriminability (d' scores). In Experiment 1, displays included either rectangles or triangles. In the first case, the target was a cross; in the second case, it was a Star of David. A hemifield x size interaction was observed both on correct detections and on associated discriminability. Yet, no such interaction was obtained for illusory conjunctions or for associated d' scores. In Experiment 2, the two types of forms were presented simultaneously, with the small ones either inside or outside the large ones. No laterality effects were observed. Some implications of these data for both hemispheric asymmetry and feature integration issues are discussed. The results suggest that early preattentive processes of feature extraction are not lateralized, whereas some integrative mechanisms, such as Treisman's (1988) focal attention, may operate differently in the two hemispheres.