When irrelevant information helps: Extending the Eriksen-flanker task into a multisensory world

Modality-specific impacts of distractors on visual and auditory categorical decision-making: an evidence accumulation perspective

Our brain constantly processes multisensory inputs to make decisions and guide behaviors, but how goal-relevant processes are influenced by irrelevant information is unclear. Here, we investigated the effects of intermodal and intramodal task-irrelevant information on visual and auditory categorical decision-making. In both visual and auditory tasks, we manipulated the modality of irrelevant inputs (visual vs. auditory vs. none) and used linear discrimination analysis of EEG and hierarchical drift-diffusion modeling (HDDM) to identify when and how task-irrelevant information affected decision-relevant processing. The results revealed modality-specific impacts of irrelevant inputs on visual and auditory categorical decision-making. The distinct effects on the visual task were shown on the neural components, with auditory distractors amplifying the sensory processing whereas visual distractors amplifying the post-sensory process. Conversely, the distinct effects on the auditory task were shown in behavioral performance and underlying cognitive processes. Visual distractors facilitate behavioral performance and affect both stages, but auditory distractors interfere with behavioral performance and impact on the sensory processing rather than the post-sensory decision stage. Overall, these findings suggested that auditory distractors affect the sensory processing stage of both tasks while visual distractors affect the post-sensory decision stage of visual categorical decision-making and both stages of auditory categorical decision-making. This study provides insights into how humans process information from multiple sensory modalities during decision-making by leveraging modality-specific impacts.

Learned cognitive control counteracts value-driven attentional capture

Stimuli formerly associated with monetary reward capture our attention, even if this attraction is contrary to current goals (so-called value-driven attentional capture [VDAC], see Anderson (Ann N Y Acad Sci 1369:24-39, 2016), for a review). Despite the growing literature to this topic, little is known about the boundary conditions for the occurrence of VDAC. In three experiments, we investigated the role of response conflicts and spatial uncertainty regarding the target location during the training and test phase for the emergence of value-driven effects. Thus, we varied the occurrence of a response conflict, search components, and the type of task in both phases. In the training, value-driven effects were rather observed if the location of the value-associated target was not predictable and a response conflict was present. Value-driven effects also only occurred, if participants have not learned to deal with a response conflict, yet. However, the introduction of a response conflict during learning of the color-value association seemed to prevent attention to be distracted by this feature in a subsequent test. The study provides new insights not only into the boundary conditions of the learning of value associations, but also into the learning of cognitive control.

An Exploration of the Effects of Cross-Modal Tasks on Selective Attention

Successful performance of a task relies on selectively attending to the target, while ignoring distractions. Studies on perceptual load theory (PLT), conducted involving independent tasks with visual and auditory modalities, have shown that if a task is low-load, distractors and the target are both processed. If the task is high-load, distractions are not processed. The current study expands these findings by considering the effect of cross-modality (target and distractor from separate modalities) and congruency (similarity of target and distractor) on selective attention, using a word-identification task. Parameters were analysed, including response time, accuracy rates, congruency of distractions, and subjective report of load. In contrast to past studies on PLT, the results of the current study show that modality (congruency of the distractors) had a significant effect and load had no effect on selective attention. This study demonstrates that subjective measurement of load is important when studying perceptual load and selective attention.

Working memory load modulates the processing of audiovisual distractors: A behavioral and event-related potentials study

The interplay between different modalities can help to perceive stimuli more effectively. However, very few studies have focused on how multisensory distractors affect task performance. By adopting behavioral and event-related potentials (ERPs) techniques, the present study examined whether multisensory audiovisual distractors could attract attention more effectively than unisensory distractors. Moreover, we explored whether such a process was modulated by working memory load. Across three experiments, n-back tasks (1-back and 2-back) were adopted with peripheral auditory, visual, or audiovisual distractors. Visual and auditory distractors were white discs and pure tones (Experiments 1 and 2), pictures and sounds of animals (Experiment 3), respectively. Behavioral results in Experiment 1 showed a significant interference effect under high working memory load but not under low load condition. The responses to central letters with audiovisual distractors were significantly slower than those to letters without distractors, while no significant difference was found between unisensory distractor and without distractor conditions. Similarly, ERP results in Experiments 2 and 3 showed that there existed an integration only under high load condition. That is, an early integration for simple audiovisual distractors (240-340 ms) and a late integration for complex audiovisual distractors (440-600 ms). These findings suggest that multisensory distractors can be integrated and effectively attract attention away from the main task, i.e., interference effect. Moreover, this effect is pronounced only under high working memory load condition.

The level of representation of irrelevant stimuli-Distractor-response binding within and between the senses

Binding theories assume that features of stimuli and executed responses can be integrated together in one event file (Hommel, Visual Cognition, 5, 183-216, 1998; Hommel, Cognitive Sciences, 8, 494-500, 2004). Every reencounter with one or more of the stored features leads to an automatic retrieval of the previously constructed event file and hence of the response-even the repetition of a task-irrelevant distractor stimulus can retrieve a previously encoded response. This so-called distractor-response binding effect is typically investigated using a sequential prime-probe design that allows the orthogonal variation of response relation (response repetition vs. resporrevertnse change) and distractor relation (distractor repetition vs. distractor change), while probe response times and error rates are measured as dependent variable. Previous research has shown that task-relevant stimuli can be represented at different levels (e.g., perceptual and conceptual; see Henson et al., Trends in Cognitive Sciences, 18, 376-384, 2014), yet it is not clear at which level of representation distractor stimuli are processed. In the present study, we focused on the level of representation of response-irrelevant distractor stimuli. To this end, a crossmodal distractor-response binding paradigm was used that enables the differentiation between the perceptual and conceptual representation of the distractor by allowing the systematic repetition and change of conceptual distractor features independent of perceptual repetitions. The results suggest that the repetition of perceptual distractor features is indispensable for the initiation of the retrieval process while the sole repetition of conceptual distractor features is not sufficient to start the retrieval process.

Target Amplification and Distractor Inhibition: Theta Oscillatory Dynamics of Selective Attention in a Flanker Task

Selective attention is a key mechanism to monitor conflict-related processing and behaviour, by amplifying task-relevant processing and inhibiting task-irrelevant information. Conflict monitoring and resolution is typically associated with brain oscillatory power increase in the theta frequency range (3-8 Hz), as indexed by increased midfrontal theta power. We expand previous findings of theta power increase related to conflict processing and distractor inhibition by considering attentional target amplification to be represented in theta frequency as well. The present study (N = 41) examined EEG oscillatory activities associated with stimulus and response conflict in a lateralized flanker task. Depending on the perceptual (in)congruency and response (in)compatibility of distractor-target associations, resulting stimulus and response conflicts were examined in behavioural and electrophysiological data analyses. Both response and stimulus conflict emerged in RT analysis. Regarding EEG data, response-locked cluster analysis showed an increase of midfrontal theta power related to response conflict. In addition, stimulus-locked cluster analysis revealed early clusters with increased parietal theta power for nonconflicting compared to conflicting trials, followed by increased midfrontal theta power for both stimulus and response conflict. Our results suggest that conflict resolution in the flanker task relies on a combination of target amplification, depicted by parietal theta power increase, and distractor inhibition, indexed by midfrontal theta power increase, for both stimulus and response conflicts. Attentional amplification of sensory target features is discussed with regard to a domain-general conflict monitoring account.

A bimodal extension of the Eriksen flanker task

The Eriksen flanker task is a traditional conflict paradigm for studying the influence of task-irrelevant information on the processing of task-relevant information. In this task, participants are asked to respond to a visual target item (e.g., a letter) that is flanked by task-irrelevant items (e.g., also letters). Responses are typically faster and more accurate when the task-irrelevant information is response-congruent with the visual target than when it is incongruent. Several researchers have attributed the starting point of this flanker effect to poor selective filtering at a perceptual level (e.g., spotlight models), which subsequently produces response competition at post-perceptual stages. The present study examined whether a flanker-like effect could also be established within a bimodal analog of the flanker task with auditory irrelevant letters and visual target letters, which must be processed along different processing routes. The results of two experiments revealed that a flanker-like effect is also present with bimodal stimuli. In contrast to the unimodal flanker task, however, the effect only emerged when flankers and targets shared the same letter name, but not when they were different letters mapped onto the same response. We conclude that the auditory flankers can influence the time needed to recognize visual targets but do not directly activate their associated responses.