Auditory attentional capture: implicit and explicit approaches

Attention capture by own name decreases with speech compression

Auditory stimuli that are relevant to a listener have the potential to capture focal attention even when unattended, the listener's own name being a particularly effective stimulus. We report two experiments to test the attention-capturing potential of the listener's own name in normal speech and time-compressed speech. In Experiment 1, 39 participants were tested with a visual word categorization task with uncompressed spoken names as background auditory distractors. Participants' word categorization performance was slower when hearing their own name rather than other names, and in a final test, they were faster at detecting their own name than other names. Experiment 2 used the same task paradigm, but the auditory distractors were time-compressed names. Three compression levels were tested with 25 participants in each condition. Participants' word categorization performance was again slower when hearing their own name than when hearing other names; the slowing was strongest with slight compression and weakest with intense compression. Personally relevant time-compressed speech has the potential to capture attention, but the degree of capture depends on the level of compression. Attention capture by time-compressed speech has practical significance and provides partial evidence for the duplex-mechanism account of auditory distraction.

High visual salience of alert signals can lead to a counterintuitive increase of reaction times

It is often assumed that rendering an alert signal more salient yields faster responses to this alert. Yet, there might be a trade-off between attracting attention and distracting from task execution. Here we tested this in four behavioral experiments with eye-tracking using an abstract alert-signal paradigm. Participants performed a visual discrimination task (primary task) while occasional alert signals occurred in the visual periphery accompanied by a congruently lateralized tone. Participants had to respond to the alert before proceeding with the primary task. When visual salience (contrast) or auditory salience (tone intensity) of the alert were increased, participants directed their gaze to the alert more quickly. This confirms that more salient alerts attract attention more efficiently. Increasing auditory salience yielded quicker responses for the alert and primary tasks, apparently confirming faster responses altogether. However, increasing visual salience did not yield similar benefits: instead, it increased the time between fixating the alert and responding, as high-salience alerts interfered with alert-task execution. Such task interference by high-salience alert-signals counteracts their more efficient attentional guidance. The design of alert signals must be adapted to a "sweet spot" that optimizes this stimulus-dependent trade-off between maximally rapid attentional orienting and minimal task interference.

A comparison of the psychological effects of robot motion in physical and virtual environments

A mixed-methods approach was used to assess the fidelity of virtual environments as ergonomic assessment tools for human-robot interaction. Participants performed a visual search task in the physical environment while a nearby collaborative robot repeatedly extended its arm toward them. This scenario was reconstructed in two virtual environments with different levels of graphical detail. Measures of presence, task performance, workload, and anxiety were taken to determine the effect of robot motion in all three environments. Task performance decreased in response to robot motion in the physical environment, while workload and anxiety increased. This simple effect of motion was consistent across environments for measures of task performance and anxiety. However, people performed faster overall in virtual reality, and the effect of motion on workload was greatly reduced in virtual reality. Results in the virtual environments suggest that people were distracted by the sound of the robot, and that presence was affected by manipulations of immersion and coherence.

Loud Auditory Distractors Are More Difficult to Ignore After All

Abstract. Working memory performance is markedly disrupted when task-irrelevant sound is played during item presentation or retention. In a preregistered replication study, we systematically examined the role of intensity in two types of auditory distraction. The first type of distraction is the changing-state effect (i.e., increased disruption by changing-state relative to steady-state sequences). The second type is the auditory deviant effect (i.e., increased disruption by auditory deviant relative to steady-state sequences). In previous experiments, the changing-state effect was independent of intensity. Whether a deviation in intensity leads to an increase in disruption has not yet been examined. We replicated the classic finding that the increased disruption by changing-state relative to steady-state sequences is independent of intensity. Contrary to previous studies, we found an unexpected main effect of intensity. Steady-state and changing-state sequences presented at 75 dB(A) were more disruptive than presented at 45 dB(A), suggesting that intensity plays a more important role than previously assumed in the disruption of working memory performance. Furthermore, we tested the prediction of the violation of expectancy account, according to which deviant distractors at a lower and higher intensity than the rest of the sequence should be equally disruptive. Our results were consistent with this prediction.

Quantifying the Effect of Noise on Cognitive Processes: A Review of Psychophysiological Correlates of Workload

Noise is present in most work environments, including emissions from machines and devices, irrelevant speech from colleagues, and traffic noise. Although it is generally accepted that noise below the permissible exposure limits does not pose a considerable risk for auditory effects like hearing impairments. Yet, noise can have a direct adverse effect on cognitive performance (non-auditory effects like workload or stress). Under certain circumstances, the observable performance for a task carried out in silence compared to noisy surroundings may not differ. One possible explanation for this phenomenon needs further investigation: individuals may invest additional cognitive resources to overcome the distraction from irrelevant auditory stimulation. Recent developments in measurements of psychophysiological correlates and analysis methods of load-related parameters can shed light on this complex interaction. These objective measurements complement subjective self-report of perceived effort by quantifying unnoticed noise-related cognitive workload. In this review, literature databases were searched for peer-reviewed journal articles that deal with an at least partially irrelevant "auditory stimulation" during an ongoing "cognitive task" that is accompanied by "psychophysiological correlates" to quantify the "momentary workload." The spectrum of assessed types of "auditory stimulations" extended from speech stimuli (varying intelligibility), oddball sounds (repeating short tone sequences), and auditory stressors (white noise, task-irrelevant real-life sounds). The type of "auditory stimulation" was related (speech stimuli) or unrelated (oddball, auditory stressor) to the type of primary "cognitive task." The types of "cognitive tasks" include speech-related tasks, fundamental psychological assessment tasks, and real-world/simulated tasks. The "psychophysiological correlates" include pupillometry and eye-tracking, recordings of brain activity (hemodynamic, potentials), cardiovascular markers, skin conductance, endocrinological markers, and behavioral markers. The prevention of negative effects on health by unexpected stressful soundscapes during mental work starts with the continuous estimation of cognitive workload triggered by auditory noise. This review gives a comprehensive overview of methods that were tested for their sensitivity as markers of workload in various auditory settings during cognitive processing.

Investigation of the effects of auditory and visual stimuli on attention

Attentional resources limit our perceptual capacities. One vital point is whether these resources are allotted severally to every sense or shared between them. We addressed this problem via means of topics to carry out a dual-task, both in the same modality or other modalities (visual and auditory). The primary task is to count the number of passes of the participants while watching the video that requires visual and auditory attention. Concurrently, they were also asked to notice the pure tones and visual events in the song during the video while counting their pass numbers. The results show that while the auditory task reduced the detection ability visual events task, the dual-task had a significant effect. Previous studies support that tasks requiring simultaneous auditory and visual attention affect each other. Our results have clear implications for showing that performance decreases in dual-task as the perceptual load increases.

What's in Your Gamma? Activation of the Ventral Fronto-Parietal Attentional Network in Response to Distracting Sounds

Auditory attention operates through top-down (TD) and bottom-up (BU) mechanisms that are supported by dorsal and ventral brain networks, respectively, with the main overlap in the lateral prefrontal cortex (lPFC). A good TD/BU balance is essential to be both task-efficient and aware of our environment, yet it is rarely investigated. Oscillatory activity is a novel method to probe the attentional dynamics with evidence that gamma activity (>30 Hz) could signal BU processing and thus would be a good candidate to support the activation of the ventral BU attention network. Magnetoencephalography data were collected from 21 young adults performing the competitive attention task, which enables simultaneous investigation of BU and TD attentional mechanisms. Distracting sounds elicited an increase in gamma activity in regions of the BU ventral network. TD attention modulated these gamma responses in regions of the inhibitory cognitive control system: the medial prefrontal and anterior cingulate cortices. Finally, distracting-sound-induced gamma activity was synchronous between the auditory cortices and several distant brain regions, notably the lPFC. We provide novel insight into the role of gamma activity 1) in supporting the activation of the ventral BU attention network and 2) in subtending the TD/BU attention balance in the PFC.

Effects of Exogenous Auditory Attention on Temporal and Spectral Resolution

Previous research in the visual domain suggests that exogenous attention in form of peripheral cueing increases spatial but lowers temporal resolution. It is unclear whether this effect transfers to other sensory modalities. Here, we tested the effects of exogenous attention on temporal and spectral resolution in the auditory domain. Eighteen young, normal-hearing adults were tested in both gap and frequency change detection tasks with exogenous cuing. Benefits of valid cuing were only present in the gap detection task while costs of invalid cuing were observed in both tasks. Our results suggest that exogenous attention in the auditory system improves temporal resolution without compromising spectral resolution.

Interactions between top-down and bottom-up attention in barn owls (Tyto alba)

Selective attention, the prioritization of behaviorally relevant stimuli for behavioral control, is commonly divided into two processes: bottom-up, stimulus-driven selection and top-down, task-driven selection. Here, we tested two barn owls in a visual search task that examines attentional capture of the top-down task by bottom-up mechanisms. We trained barn owls to search for a vertical Gabor patch embedded in a circular array of differently oriented Gabor distractors (top-down guided search). To track the point of gaze, a lightweight wireless video camera was mounted on the owl's head. Three experiments were conducted in which the owls were tested in the following conditions: (1) five distractors; (2) nine distractors; (3) five distractors with one distractor surrounded by a red circle; or (4) five distractors with a brief sound at the initiation of the stimulus. Search times and number of head saccades to reach the target were measured and compared between the different conditions. It was found that search time and number of saccades to the target increased when the number of distractors was larger (condition 2) and when an additional irrelevant salient stimulus, auditory or visual, was added to the scene (conditions 3 and 4). These results demonstrate that in barn owls, bottom-up attention interacts with top-down attention to shape behavior in ways similar to human attentional capture. The findings suggest similar attentional principles in taxa that have been evolutionarily separated for 300 million years.

Now hear this: Inattentional deafness depends on task relatedness

Mixed results have been found for the impact of auditory information presented during high-perceptual-load visual search tasks, with some studies showing large effects and others indicating inattentional deafness, with such stimuli going largely undetected. In three experiments, we demonstrated that task relatedness is a key factor in whether extraneous auditory stimuli impact high-load visual searches. Experiment 1 addressed a methodological concern (e.g., Lavie Trends in Cognitive Sciences, 9, 75-82, 2005) regarding the timing of the relative onsets and offsets of task-related, to-be-ignored auditory stimuli and visual search arrays in experiments that have shown auditory distractor effects. Robust auditory distractor effects were found in each timing condition, and no inattentional deafness for high-load searches. Experiments 2 and 3 demonstrated that the relationship between the auditory stimuli and visual targets determined whether attention was captured and whether the response times to identify targets were impacted. Auditory stimuli that named a response-specific category influenced responses to targets mapped exclusively to one response, but not to the same targets mapped nonexclusively. These compatibility effects were larger if the distractors named an actual target item than if they named the category to which the item belonged. This pattern suggests that to-be-ignored auditory information that closely relates to a visual target search task influences the processing of that task, particularly in a high-perceptual-load search.

The effect of distraction on change detection in crowded acoustic scenes

In this series of behavioural experiments we investigated the effect of distraction on the maintenance of acoustic scene information in short-term memory. Stimuli are artificial acoustic ‘scenes’ composed of several (up to twelve) concurrent tone-pip streams (‘sources’). A gap (1000 ms) is inserted partway through the ‘scene’; Changes in the form of an appearance of a new source or disappearance of an existing source, occur after the gap in 50% of the trials. Listeners were instructed to monitor the unfolding ‘soundscapes’ for these events. Distraction was measured by presenting distractor stimuli during the gap. Experiments 1 and 2 used a dual task design where listeners were required to perform a task with varying attentional demands (‘High Demand’ vs. ‘Low Demand’) on brief auditory (Experiment 1a) or visual (Experiment 1b) signals presented during the gap. Experiments 2 and 3 required participants to ignore distractor sounds and focus on the change detection task. Our results demonstrate that the maintenance of scene information in short-term memory is influenced by the availability of attentional and/or processing resources during the gap, and that this dependence appears to be modality specific. We also show that these processes are susceptible to bottom up driven distraction even in situations when the distractors are not novel, but occur on each trial. Change detection performance is systematically linked with the, independently determined, perceptual salience of the distractor sound. The findings also demonstrate that the present task may be a useful objective means for determining relative perceptual salience.

•

Distraction is measured by presenting distractor stimuli during a scene gap.

•

Scene maintenance in memory depends on availability of resources during the gap.

•

This dependence appears to be modality specific.

•

Scene maintenance also prone to bottom up distraction even when distractors not novel.

•

Performance depends on the perceptual salience of the distractor sound.

Attending to auditory memory

Attention to memory describes the process of attending to memory traces when the object is no longer present. It has been studied primarily for representations of visual stimuli with only few studies examining attention to sound object representations in short-term memory. Here, we review the interplay of attention and auditory memory with an emphasis on 1) attending to auditory memory in the absence of related external stimuli (i.e., reflective attention) and 2) effects of existing memory on guiding attention. Attention to auditory memory is discussed in the context of change deafness, and we argue that failures to detect changes in our auditory environments are most likely the result of a faulty comparison system of incoming and stored information. Also, objects are the primary building blocks of auditory attention, but attention can also be directed to individual features (e.g., pitch). We review short-term and long-term memory guided modulation of attention based on characteristic features, location, and/or semantic properties of auditory objects, and propose that auditory attention to memory pathways emerge after sensory memory. A neural model for auditory attention to memory is developed, which comprises two separate pathways in the parietal cortex, one involved in attention to higher-order features and the other involved in attention to sensory information. This article is part of a Special Issue entitled SI: Auditory working memory.

Multitasking: Effects of processing multiple auditory feature patterns

ERPs and behavioral responses were measured to assess how task-irrelevant sounds interact with task processing demands and affect the ability to monitor and track multiple sound events. Participants listened to four-tone sequential frequency patterns, and responded to frequency pattern deviants (reversals of the pattern). Irrelevant tone feature patterns (duration and intensity) and respective pattern deviants were presented together with frequency patterns and frequency pattern deviants in separate conditions. Responses to task-relevant and task-irrelevant feature pattern deviants were used to test processing demands for irrelevant sound input. Behavioral performance was significantly better when there were no distracting feature patterns. Errors primarily occurred in response to the to-be-ignored feature pattern deviants. Task-irrelevant elicitation of ERP components was consistent with the error analysis, indicating a level of processing for the irrelevant features. Task-relevant elicitation of ERP components was consistent with behavioral performance, demonstrating a "cost" of performance when there were two feature patterns presented simultaneously. These results provide evidence that the brain tracked the irrelevant duration and intensity feature patterns, affecting behavioral performance. Overall, our results demonstrate that irrelevant informational streams are processed at a cost, which may be considered a type of multitasking that is an ongoing, automatic processing of task-irrelevant sensory events.