Auditory context-dependent distraction by unexpected visual stimuli

Research findings indicate that when a task-irrelevant stimulus feature deviates from an otherwise predictable pattern, participants performing a categorization task exhibit slower responses (deviance distraction). This deviance distraction effect reflects the violation of the sensory predictions generated by the cognitive system. In this study, we sought to examine for the first time whether these predictions can be incidentally modulated by the auditory environment. Participants categorized the duration (short vs long) of a colored shape (red square or blue circle) while instructed to disregard the stimulus' visual features and the sound played in the background (two distinct chords played by different instruments). While the two visual stimuli shapes were equiprobable across the task, one was highly likely (p=.882) and the other rare (p=.118) in one auditory context and vice versa in the other context. Our results showed that participants were significantly slower in the duration judgement task whenever the stimulus was unexpected within a given auditory context (context-dependent distraction), and that the reset of their sensory predictions was completed upon the trial following a change of context. We conclude that object features and environmental context are processed in relation to each other and that sensory predictions are produced in relation to the environmental context, evidencing the first demonstration of auditory context-dependent modulation of attention.

The effect of mobile phone ringtone on visual recognition during driving: Evidence from laboratory and real-scene eye movement experiments

OBJECTIVE

To determine the effect of mobile phone ringtones on visual recognition during driving, laboratory and real-scene eye movement experiments were conducted with simulated and real driving tasks, respectively. Competition for visual attention during driving increases with the integration of sounds, which is related to driving safety.

METHOD

We manipulated the physical (long exposure duration vs. short exposure duration) and psychological (self-related vs. non-self-related) properties of mobile phone ringtones presented to drivers. Estimates were based on linear mixed models (LMMs) and generalized linear mixed models (GLMMs).

RESULTS

Self-related ringtones had a greater influence on driving attention than non-self-related ones, and the interaction between exposure duration and self-relatedness was significant. Furthermore, the impact of the mobile phone ringtone occurred in real time after the ringtone stopped.

CONCLUSION

These results highlight the importance of considering the impact of ringtones on driving performance and demonstrate that ringtone properties (exposure duration and self-relatedness) can affect cognitive processes.

Distraction by deviant sounds is modulated by the environmental context

Evidence shows that participants performing a continuous visual categorization task respond slower following the presentation of a task-irrelevant sound deviating from an otherwise repetitive or predictable auditory context (deviant sound among standard sounds). Here, for the first time, we explored the role of the environmental context (instrumentalized as a task-irrelevant background picture) in this effect. In two experiments, participants categorized left/right arrows while ignoring irrelevant sounds and background pictures of forest and city scenes. While equiprobable across the task, sounds A and B were presented with probabilities of .882 and .118 in the forest context, respectively, and with the reversed probabilities in the city context. Hence, neither sound constituted a deviant sound at task-level, but each did within a specific context. In Experiment 1, where each environmental context (forest and city scene) consisted of a single picture each, participants were significantly slower in the visual task following the presentation of the sound that was unexpected within the current context (context-dependent distraction). Further analysis showed that the cognitive system reset its sensory predictions even for the first trial of a change in environmental context. In Experiment 2, the two contexts (forest and city) were implemented using sets of 32 pictures each, with the background picture changing on every trial. Here too, context-dependent deviance distraction was observed. However, participants took a trial to fully reset their sensory predictions upon a change in context. We conclude that irrelevant sounds are incidentally processed in association with the environmental context (even though these stimuli belong to different sensory modalities) and that sensory predictions are context-dependent.

Task-specific auditory distraction in serial recall and mental arithmetic

Previous studies suggest that task-irrelevant changing-state sound interferes specifically with the processing of serial order information in the focal task (e.g., serial recall from short-term memory), whereas a deviant sound in the auditory background is supposed to divert central attention, thus producing distraction in various types of cognitive tasks. Much of the evidence for this distinction rests on the observed dissociations in auditory distraction between serial and non-serial short-term memory tasks. In this study, both the changing-state effect and the deviation effect were contrasted between serial digit recall and mental arithmetic tasks. In three experiments (two conducted online), changing-state sound was found to disrupt serial recall, but it did not lead to a general decrement in performance in different mental arithmetic tasks. In contrast, a deviant voice in the stream of irrelevant speech sounds did not cause reliable distraction in serial recall and simple addition/subtraction tasks, but it did disrupt a more demanding mental arithmetic task. Specifically, the evaluation of math equations (multiplication and addition/subtraction), which was combined with a pair-associate memory task to increase the task demand, was found to be susceptible to auditory distraction in participants who did not serially rehearse the pair-associates. Together, the results support the assumption that the interference produced by changing-state sound is highly specific to tasks that require serial-order processing, whereas auditory deviants may cause attentional capture primarily in highly demanding cognitive tasks (e.g., mental arithmetic) that cannot be solved through serial rehearsal.

Distraction by violation of sensory predictions: Functional distinction between deviant sounds and unexpected silences

It has been established that participants performing a continuous categorization task respond significantly slower following the presentation of unexpected, task-irrelevant, auditory stimuli, compared to a repetitive (standard) sound. Evidence indicates that such distraction emerges because of the violation of sensory predictions. This has typically been studied by measuring the impact of replacing the repeated sound by a different sound on rare and unpredictable trials. Here, we examine the impact of a different type of violation: the mere omission of the standard sound. Capitalizing upon the recent finding that deviant sounds exert distinct effects on response times as a function of whether participants produced or withheld a response on the previous trial, we present the results of an experiment seeking to disentangle two potential effects of sound omission: deviance distraction and the removal of an unspecific warning signal. The results indicate that deviant sound and the unexpected omission of the standard sound impact response times through, at least partially, distinct mechanisms. Deviant sounds affect performance by triggering the orienting of attention towards a new sensory input. Sound omissions, in contrast, appear to affect performance in part because responses no longer benefit from an unspecific warning signal to prepare for action.

Aging Increases Cross-Modal Distraction by Unexpected Sounds: Controlling for Response Speed

It is well-established that task-irrelevant sounds deviating from an otherwise predictable auditory sequence capture attention and disrupt ongoing performance by delaying responses in the ongoing task. In visual tasks, larger distraction by unexpected sounds (deviance distraction) has been reported in older than in young adults. However, past studies based this conclusion on the comparisons of absolute response times (RT) and did not control for the general slowing typically observed in older adults. Hence, it remains unclear whether this difference in deviance distraction between the two age groups reflects a genuine effect of aging or a proportional effect of similar size in both groups. We addressed this issue by using a proportional measure of distraction (PMD) to reanalyze the data from four past studies and used Bayesian estimation to generate credible estimates of the age-related difference in deviance distraction and its effect size. The results were unambiguous: older adults exhibited greater deviance distraction than young adults when controlling for baseline response speed (in each individual study and in the combined data set). Bayesian estimation revealed a proportional lengthening of RT by unexpected sounds that was about twice as large in older than in young adults (corresponding to a large statistical effect size). A similar analysis was carried out on the proportion of correct responses (PC) and produced converging results. Finally, an additional Bayesian analysis comparing data from cross-modal and uni-modal studies confirmed the selective effect of aging on distraction in the first and not the second. Overall, our study shows that older adults performing a visual categorization task do exhibit greater distraction by unexpected sounds than young adults and that this effect is not explicable by age-related general slowing.

Distraction by auditory novelty during reading: Evidence for disruption in saccade planning, but not saccade execution

Novel or unexpected sounds that deviate from an otherwise repetitive sequence of the same sound cause behavioural distraction. Recent work has suggested that distraction also occurs during reading as fixation durations increased when a deviant sound was presented at the fixation onset of words. The present study tested the hypothesis that this increase in fixation durations occurs due to saccadic inhibition. This was done by manipulating the temporal onset of sounds relative to the fixation onset of words in the text. If novel sounds cause saccadic inhibition, they should be more distracting when presented during the second half of fixations when saccade programming usually takes place. Participants read single sentences and heard a 120 ms sound when they fixated five target words in the sentence. On most occasions (p = .9), the same sine wave tone was presented (“standard”), while on the remaining occasions (p = .1) a new sound was presented (“novel”). Critically, sounds were played, on average, either during the first half of the fixation (0 ms delay) or during the second half of the fixation (120 ms delay). Consistent with the saccadic inhibition hypothesis (SIH), novel sounds led to longer fixation durations in the 120 ms compared to the 0 ms delay condition. However, novel sounds did not generally influence the execution of the subsequent saccade. These results suggest that unexpected sounds have a rapid influence on saccade planning, but not saccade execution.

Distraction by deviant sounds: disgusting and neutral words capture attention to the same extent

Several studies have argued that words evoking negative emotions, such as disgust, grab attention more than neutral words, and leave traces in memory that are more persistent. However, these conclusions are typically based on tasks requiring participants to process the semantic content of these words in a voluntarily manner. We sought to compare the involuntary attention grabbing power of disgusting and neutral words using them as rare and unexpected auditory distractors in a cross-modal oddball task, and then probing the participants’ memory for these stimuli in a surprise recognition task. Frequentist and Bayesian analyses converged to show that, compared to a standard tone, disgusting and neutral auditory words produced significant but equivalent levels of distraction in a visual categorization task, that they elicited comparable levels of memory discriminability in the incidental recognition task, and that the participants’ individual sensitivity to disgust did not influence the results. Our results suggest that distraction by unexpected words is not modulated by their emotional valence, at least when these words are task-irrelevant and are temporally and perceptually decoupled from the target stimuli.

Fronto-central P3a to distracting sounds: An index of their arousing properties

The P3a observed after novel events is an event-related potential comprising an early fronto-central phase and a late fronto-parietal phase. It has classically been considered to reflect the attention processing of distracting stimuli. However, novel sounds can lead to behavioral facilitation as much as behavioral distraction. This illustrates the duality of the orienting response which includes both an attentional and an arousal component. Using a paradigm with visual or auditory targets to detect and irrelevant unexpected distracting sounds to ignore, we showed that the facilitation effect by distracting sounds is independent of the target modality and endures more than 1500 ms. These results confirm that the behavioral facilitation observed after distracting sounds is related to an increase in unspecific phasic arousal on top of the attentional capture. Moreover, the amplitude of the early phase of the P3a to distracting sounds positively correlated with subjective arousal ratings, contrary to other event-related potentials. We propose that the fronto-central early phase of the P3a would index the arousing properties of distracting sounds and would be linked to the arousal component of the orienting response. Finally, we discuss the relevance of the P3a as a marker of distraction.

Food words distract the hungry: Evidence of involuntary semantic processing of task-irrelevant but biologically-relevant unexpected auditory words

Rare changes in a stream of otherwise repeated task-irrelevant sounds break through selective attention and disrupt performance in an unrelated visual task by triggering shifts of attention to and from the deviant sound (deviance distraction). Evidence indicates that the involuntary orientation of attention to unexpected sounds is followed by their semantic processing. However, past demonstrations relied on tasks in which the meaning of the deviant sounds overlapped with features of the primary task. Here we examine whether such processing is observed when no such overlap is present but sounds carry some relevance to the participants’ biological need to eat when hungry. We report the results of an experiment in which hungry and satiated participants partook in a cross-modal oddball task in which they categorized visual digits (odd/even) while ignoring task-irrelevant sounds. On most trials the irrelevant sound was a sinewave tone (standard sound). On the remaining trials, deviant sounds consisted of spoken words related to food (food deviants) or control words (control deviants). Questionnaire data confirmed state (but not trait) differences between the two groups with respect to food craving, as well as a greater desire to eat the food corresponding to the food-related words in the hungry relative to the satiated participants. The results of the oddball task revealed that food deviants produced greater distraction (longer response times) than control deviants in hungry participants while the reverse effect was observed in satiated participants. This effect was observed in the first block of trials but disappeared thereafter, reflecting semantic saturation. Our results suggest that (1) the semantic content of deviant sounds is involuntarily processed even when sharing no feature with the primary task; and that (2) distraction by deviant sounds can be modulated by the participants’ biological needs.

The effect of distraction on change detection in crowded acoustic scenes

In this series of behavioural experiments we investigated the effect of distraction on the maintenance of acoustic scene information in short-term memory. Stimuli are artificial acoustic ‘scenes’ composed of several (up to twelve) concurrent tone-pip streams (‘sources’). A gap (1000 ms) is inserted partway through the ‘scene’; Changes in the form of an appearance of a new source or disappearance of an existing source, occur after the gap in 50% of the trials. Listeners were instructed to monitor the unfolding ‘soundscapes’ for these events. Distraction was measured by presenting distractor stimuli during the gap. Experiments 1 and 2 used a dual task design where listeners were required to perform a task with varying attentional demands (‘High Demand’ vs. ‘Low Demand’) on brief auditory (Experiment 1a) or visual (Experiment 1b) signals presented during the gap. Experiments 2 and 3 required participants to ignore distractor sounds and focus on the change detection task. Our results demonstrate that the maintenance of scene information in short-term memory is influenced by the availability of attentional and/or processing resources during the gap, and that this dependence appears to be modality specific. We also show that these processes are susceptible to bottom up driven distraction even in situations when the distractors are not novel, but occur on each trial. Change detection performance is systematically linked with the, independently determined, perceptual salience of the distractor sound. The findings also demonstrate that the present task may be a useful objective means for determining relative perceptual salience.

•

Distraction is measured by presenting distractor stimuli during a scene gap.

•

Scene maintenance in memory depends on availability of resources during the gap.

•

This dependence appears to be modality specific.

•

Scene maintenance also prone to bottom up distraction even when distractors not novel.

•

Performance depends on the perceptual salience of the distractor sound.

The semantic aftermath of distraction by deviant sounds: Crosstalk interference is mediated by the predictability of semantic congruency

Rare changes in a stream of otherwise repeated task-irrelevant sounds break through selective attention and disrupt performance in an unrelated visual task. This deviance distraction effect emerges because deviant sounds violate the cognitive system's predictions. In this study we sought to examine whether predictability also mediate the so-called semantic effect whereby behavioral performance suffers from the clash between the involuntary semantic evaluation of irrelevant sounds and the voluntary processing of visual targets (e.g., when participants must categorize a right visual arrow following the presentation of the deviant sound "left"). By manipulating the conditional probabilities of the congruent and incongruent deviant sounds in a left/right arrow categorization task, we elicited implicit predictions about the upcoming target and related response. We observed a linear increase of the semantic effect with the proportion of congruent deviant trials (i.e., as deviant sounds increasingly predicted congruent targets). We conclude that deviant sounds affect response times based on a combination of crosstalk interference and two types of prediction violations: stimulus violations (violations of predictions regarding the identity of upcoming irrelevant sounds) and semantic violations (violations of predictions regarding the target afforded by deviant sounds). We report a three-parameter model that captures all key features of the observed RTs. Overall, our results fit with the view that the brain builds forward models of the environment in order to optimize cognitive processing and that control of one's attention and actions is called upon when predictions are violated. This article is part of a Special Issue entitled SI: Prediction and Attention.

Knowledge of sequence structure prevents auditory distraction: an ERP study

Infrequent, salient stimuli often capture attention despite their task-irrelevancy, and disrupt on-going goal-directed behavior. A number of studies show that presenting cues signaling forthcoming deviants reduces distraction, which may be a "by-product" of cue-processing interference or the result of direct preparatory processes for the forthcoming distracter. In the present study, instead of "bursts" of cue information, information on the temporal structure of the stimulus sequence was provided. Young adults performed a spatial discrimination task where complex tones moving left or right were presented. In the predictable condition, every 7th tone was a pitch-deviant, while in the random condition the position of deviants was random with a probability of 1/7. Whereas the early event-related potential correlates of deviance-processing (N1 and MMN) were unaffected by predictability, P3a amplitude was significantly reduced in the predictable condition, indicating that prevention of distraction was based on the knowledge about the temporal structure of the stimulus sequence.

Plasticity of attentional functions in older adults after non-action video game training: a randomized controlled trial

A major goal of recent research in aging has been to examine cognitive plasticity in older adults and its capacity to counteract cognitive decline. The aim of the present study was to investigate whether older adults could benefit from brain training with video games in a cross-modal oddball task designed to assess distraction and alertness. Twenty-seven healthy older adults participated in the study (15 in the experimental group, 12 in the control group. The experimental group received 20 1-hr video game training sessions using a commercially available brain-training package (Lumosity) involving problem solving, mental calculation, working memory and attention tasks. The control group did not practice this package and, instead, attended meetings with the other members of the study several times along the course of the study. Both groups were evaluated before and after the intervention using a cross-modal oddball task measuring alertness and distraction. The results showed a significant reduction of distraction and an increase of alertness in the experimental group and no variation in the control group. These results suggest neurocognitive plasticity in the old human brain as training enhanced cognitive performance on attentional functions.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02007616.

Auditory attentional capture: implicit and explicit approaches

The extent to which distracting items capture attention despite being irrelevant to the task at hand can be measured either implicitly or explicitly (e.g., Simons, Trends Cogn Sci 4:147-155, 2000). Implicit approaches include the standard attentional capture paradigm in which distraction is measured in terms of reaction time and/or accuracy costs within a focal task in the presence (vs. absence) of a task-irrelevant distractor. Explicit measures include the inattention paradigm in which people are asked directly about their noticing of an unexpected task-irrelevant item. Although the processes of attentional capture have been studied extensively using both approaches in the visual domain, there is much less research on similar processes as they may operate within audition, and the research that does exist in the auditory domain has tended to focus exclusively on either an explicit or an implicit approach. This paper provides an overview of recent research on auditory attentional capture, integrating the key conclusions that may be drawn from both methodological approaches.

Preparation interval and cue utilization in the prevention of distraction

Maintaining a selective attention set allows us to efficiently perform sensory tasks despite the multitude of concurrent sensory stimuli. Unpredictably occurring, rare events nonetheless capture our attention, that is, we get distracted. The present study investigated the efficiency of control over distraction as a function of preparation time available before a forthcoming distracter. A random sequence of short and long tones (100 or 200 ms with 50-50 % probability) was presented. Independently from tone duration, occasionally (13.3 % of the time), the pitch of a tone was changed. Such rare pitch variants (distracters) usually lead to delayed and less precise discrimination responses, and trigger a characteristic series of event-related potentials (ERPs) reflecting the stages of distraction-related processing: starting with negative ERPs signaling the sensory registration of the distracter; a P3a-usually interpreted as a reflection of involuntary attention change and finally the so-called reorienting negativity signaling the restoration of the task-optimal attention set. In separate conditions, 663 or 346 ms before each tone (long or short cue-tone interval), a visual cue was presented, which signaled whether the forthcoming tone was a distracter (rare pitch variant), with 80 % validity. As reflected by reduced reaction time delays and P3a amplitudes, valid cues led to the prevention of distraction, but only in the long cue-tone interval condition. The analyses of the cue-related P3b and contingent negative variation showed that participants made more effort to utilize cue information to prevent distraction in the long cue-tone than in the short cue-tone interval condition.

The role of auditory transient and deviance processing in distraction of task performance: a combined behavioral and event-related brain potential study

Distraction of goal-oriented performance by a sudden change in the auditory environment is an everyday life experience. Different types of changes can be distracting, including a sudden onset of a transient sound and a slight deviation of otherwise regular auditory background stimulation. With regard to deviance detection, it is assumed that slight changes in a continuous sequence of auditory stimuli are detected by a predictive coding mechanisms and it has been demonstrated that this mechanism is capable of distracting ongoing task performance. In contrast, it is open whether transient detection-which does not rely on predictive coding mechanisms-can trigger behavioral distraction, too. In the present study, the effect of rare auditory changes on visual task performance is tested in an auditory-visual cross-modal distraction paradigm. The rare changes are either embedded within a continuous standard stimulation (triggering deviance detection) or are presented within an otherwise silent situation (triggering transient detection). In the event-related brain potentials, deviants elicited the mismatch negativity (MMN) while transients elicited an enhanced N1 component, mirroring pre-attentive change detection in both conditions but on the basis of different neuro-cognitive processes. These sensory components are followed by attention related ERP components including the P3a and the reorienting negativity (RON). This demonstrates that both types of changes trigger switches of attention. Finally, distraction of task performance is observable, too, but the impact of deviants is higher compared to transients. These findings suggest different routes of distraction allowing for the automatic processing of a wide range of potentially relevant changes in the environment as a pre-requisite for adaptive behavior.