Distractor clustering enhances detection speed and accuracy during selective listening

Attention, Musicality, and Familiarity Shape Cortical Speech Tracking at the Musical Cocktail Party

The "cocktail party problem" challenges our ability to understand speech in noisy environments, which often include background music. Here, we explored the role of background music in speech-in-noise listening. Participants listened to an audiobook in familiar and unfamiliar music while tracking keywords in either speech or song lyrics. We used EEG to measure neural tracking of the audiobook. When speech was masked by music, the modeled peak latency at 50 ms (P1TRF) was prolonged compared to unmasked. Additionally, P1TRF amplitude was larger in unfamiliar background music, suggesting improved speech tracking. We observed prolonged latencies at 100 ms (N1TRF) when speech was not the attended stimulus, though only in less musical listeners. Our results suggest early neural representations of speech are enhanced with both attention and concurrent unfamiliar music, indicating familiar music is more distracting. One's ability to perceptually filter "musical noise" at the cocktail party depends on objective musical abilities.

"Unattended, distracting or irrelevant": Theoretical implications of terminological choices in auditory selective attention research

For seventy years, auditory selective attention research has focused on studying the cognitive mechanisms of prioritizing the processing a 'main' task-relevant stimulus, in the presence of 'other' stimuli. However, a closer look at this body of literature reveals deep empirical inconsistencies and theoretical confusion regarding the extent to which this 'other' stimulus is processed. We argue that many key debates regarding attention arise, at least in part, from inappropriate terminological choices for experimental variables that may not accurately map onto the cognitive constructs they are meant to describe. Here we critically review the more common or disruptive terminological ambiguities, differentiate between methodology-based and theory-derived terms, and unpack the theoretical assumptions underlying different terminological choices. Particularly, we offer an in-depth analysis of the terms 'unattended' and 'distractor' and demonstrate how their use can lead to conflicting theoretical inferences. We also offer a framework for thinking about terminology in a more productive and precise way, in hope of fostering more productive debates and promoting more nuanced and accurate cognitive models of selective attention.

Irrelevant Predictions: Distractor Rhythmicity Modulates Neural Encoding in Auditory Cortex

Dynamic attending theory suggests that predicting the timing of upcoming sounds can assist in focusing attention toward them. However, whether similar predictive processes are also applied to background noises and assist in guiding attention “away” from potential distractors, remains an open question. Here we address this question by manipulating the temporal predictability of distractor sounds in a dichotic listening selective attention task. We tested the influence of distractors’ temporal predictability on performance and on the neural encoding of sounds, by comparing the effects of Rhythmic versus Nonrhythmic distractors. Using magnetoencephalography we found that, indeed, the neural responses to both attended and distractor sounds were affected by distractors’ rhythmicity. Baseline activity preceding the onset of Rhythmic distractor sounds was enhanced relative to nonrhythmic distractor sounds, and sensory response to them was suppressed. Moreover, detection of nonmasked targets improved when distractors were Rhythmic, an effect accompanied by stronger lateralization of the neural responses to attended sounds to contralateral auditory cortex. These combined behavioral and neural results suggest that not only are temporal predictions formed for task-irrelevant sounds, but that these predictions bear functional significance for promoting selective attention and reducing distractibility.

Neural correlates of auditory stream segregation: an analysis of onset- and change-related responses

The temporal order discrimination of target tone pairs is hindered by the presence of flanker tones but is improved when the flanker tones are captured by a separate stream of tones that match the flankers in frequency [Bregman and Rudnicky (1975). J. Exp. Psychol. 1, 263-267]. In an event-related potential (ERP) study with these stimuli, listeners' mismatch negativity (MMN) responses were temporally linked to the position of the changing target tones, irrespective of streaming. In contrast, N1 response latency varied as a function of the perceived grouping of flanker tones established by previous behavioral studies, providing a neurophysiological index of auditory stream segregation.

Attention to memory: orienting attention to sound object representations

Despite a growing acceptance that attention and memory interact, and that attention can be focused on an active internal mental representation (i.e., reflective attention), there has been a paucity of work focusing on reflective attention to 'sound objects' (i.e., mental representations of actual sound sources in the environment). Further research on the dynamic interactions between auditory attention and memory, as well as its degree of neuroplasticity, is important for understanding how sound objects are represented, maintained, and accessed in the brain. This knowledge can then guide the development of training programs to help individuals with attention and memory problems. This review article focuses on attention to memory with an emphasis on behavioral and neuroimaging studies that have begun to explore the mechanisms that mediate reflective attentional orienting in vision and more recently, in audition. Reflective attention refers to situations in which attention is oriented toward internal representations rather than focused on external stimuli. We propose four general principles underlying attention to short-term memory. Furthermore, we suggest that mechanisms involved in orienting attention to visual object representations may also apply for orienting attention to sound object representations.

Attention, awareness, and the perception of auditory scenes

Auditory perception and cognition entails both low-level and high-level processes, which are likely to interact with each other to create our rich conscious experience of soundscapes. Recent research that we review has revealed numerous influences of high-level factors, such as attention, intention, and prior experience, on conscious auditory perception. And recently, studies have shown that auditory scene analysis tasks can exhibit multistability in a manner very similar to ambiguous visual stimuli, presenting a unique opportunity to study neural correlates of auditory awareness and the extent to which mechanisms of perception are shared across sensory modalities. Research has also led to a growing number of techniques through which auditory perception can be manipulated and even completely suppressed. Such findings have important consequences for our understanding of the mechanisms of perception and also should allow scientists to precisely distinguish the influences of different higher-level influences.

Selective attention to pitch amid conflicting auditory information: context-coding and filtering strategies

An auditory Eriksen-flanker task was used to study how conflicting information interferes with selective attention to task-relevant differences in pure-tone frequency. Across the observation intervals of the discrimination task, the relevant frequency differences between target tones were positive, but within an observation interval, they could appear to be small or negative relative to conflicting differences in flanker tones leading or trailing the target. Being correct required attending to the between-target and ignoring the target-flanker pitch relation (across and within observation-interval, respectively). The interference index was an elevation of conflict-laden frequency discrimination thresholds (FDTs), relative to no-conflict FDTs. When conflicting differences in frequency or level (but not in duration) trailed the relevant differences, interference (i.e., FDT elevation) was large and persistent, increased with the target-flanker time proximity, but decreased with extensive training. Interference occurs when the target-flanker pitch relation is more prominent than the one between targets, and the physical and/or perceptual effects of relevant and conflicting differences tend to cancel one another, as with the above conflicting differences. With untrained participants, the target-flanker pitch relation is most prominent in conditions fostering both the perceptual grouping of the target and flanker (e.g., close time proximity), and the recency and salience of the conflicting differences (e.g., trailing conflicting difference); conversely, by lessening such grouping and salience, prolonged training decreases or nullifies the interference. The interference observed herein does not arise because the relevant and the conflicting differences each prompt separate decisions or responses that are in mutual conflict; instead, it arises from the early-stage interaction between their perceptual effects.

Masking effects of speech and music: does the masker's hierarchical structure matter?

Speech and music are time-varying signals organized by parallel hierarchical rules. Through a series of four experiments, this study compared the masking effects of single-talker speech and instrumental music on speech perception while manipulating the complexity of hierarchical and temporal structures of the maskers. Listeners' word recognition was found to be similar between hierarchically intact and disrupted speech or classical music maskers (Experiment 1). When sentences served as the signal, significantly greater masking effects were observed with disrupted than intact speech or classical music maskers (Experiment 2), although not with jazz or serial music maskers, which differed from the classical music masker in their hierarchical structures (Experiment 3). Removing the classical music masker's temporal dynamics or partially restoring it affected listeners' sentence recognition; yet, differences in performance between intact and disrupted maskers remained robust (Experiment 4). Hence, the effect of structural expectancy was largely present across maskers when comparing them before and after their hierarchical structure was purposefully disrupted. This effect seemed to lend support to the auditory stream segregation theory.

Spatial selective attention in a complex auditory environment such as polyphonic music

To investigate the influence of spatial information in auditory scene analysis, polyphonic music (three parts in different timbres) was composed and presented in free field. Each part contained large falling interval jumps in the melody and the task of subjects was to detect these events in one part ("target part") while ignoring the other parts. All parts were either presented from the same location (0 degrees; overlap condition) or from different locations (-28 degrees, 0 degrees, and 28 degrees or -56 degrees, 0 degrees, and 56 degrees in the azimuthal plane), with the target part being presented either at 0 degrees or at one of the right-sided locations. Results showed that spatial separation of 28 degrees was sufficient for a significant improvement in target detection (i.e., in the detection of large interval jumps) compared to the overlap condition, irrespective of the position (frontal or right) of the target part. A larger spatial separation of the parts resulted in further improvements only if the target part was lateralized. These data support the notion of improvement in the suppression of interfering signals with spatial sound source separation. Additionally, the data show that the position of the relevant sound source influences auditory performance.

Interaction between attention and bottom-up saliency mediates the representation of foreground and background in an auditory scene

The mechanism by which a complex auditory scene is parsed into coherent objects depends on poorly understood interactions between task-driven and stimulus-driven attentional processes. We illuminate these interactions in a simultaneous behavioral-neurophysiological study in which we manipulate participants' attention to different features of an auditory scene (with a regular target embedded in an irregular background). Our experimental results reveal that attention to the target, rather than to the background, correlates with a sustained (steady-state) increase in the measured neural target representation over the entire stimulus sequence, beyond auditory attention's well-known transient effects on onset responses. This enhancement, in both power and phase coherence, occurs exclusively at the frequency of the target rhythm, and is only revealed when contrasting two attentional states that direct participants' focus to different features of the acoustic stimulus. The enhancement originates in auditory cortex and covaries with both behavioral task and the bottom-up saliency of the target. Furthermore, the target's perceptual detectability improves over time, correlating strongly, within participants, with the target representation's neural buildup. These results have substantial implications for models of foreground/background organization, supporting a role of neuronal temporal synchrony in mediating auditory object formation.

Neurophysiological indices of attention to speech in children with specific language impairment

OBJECTIVE

The aim was to determine whether children with specific language impairment (SLI) differed from children with typical language development (TLD) in their allocation of attention to speech sounds.

METHODS

Event-related potentials were recorded to non-target speech sounds in two tasks (passive-watch a video and attend to target tones among speech sounds) in two experiments, one using 50-ms duration vowels and the second using 250-ms vowels. The difference in ERPs across tasks was examined in the latency range of the early negative difference wave (Nd) found in adults. Analyses of the data using selected superior and inferior sites were compared to those using electrical field power (i.e., global field power or GFP). The topography of the ERP at the maximum GFP was also examined.

RESULTS

A negative difference, comparable to the adult Nd, was observed in the attend compared to the passive task for both types of analysis, suggesting allocation of attentional resources to processing the speech stimuli in the attend task. Children with TLD also showed greater negativity than those with SLI in the passive task for the long vowels, suggesting that they allocated more attentional resources to processing the speech in this task than the SLI group. This effect was only significant using the GFP analysis and was seen as smaller GFP for the TLD than SLI group. The SLI group also showed significantly later latency than the TLD group in reaching the maximum GFP. In addition, a significantly greater proportion of children with SLI compared to those with typical language showed left-greater-than-right frontocentral amplitude at the latency determined from each child's maximum GFP peak.

CONCLUSIONS

Children generally showed greater attention to speech sounds when attention is directed to the auditory modality compared to the visual modality. However, children with TLD, unlike SLI, also appear to devote some attentional resources to speech even in a task in which they are instructed to attend to visual information and ignore the speech.

SIGNIFICANCE

These findings suggest that children with SLI have limited attentional resources, that they are poorer at dividing attention, or that they are less automatic in allocating resources to speech compared to children with typically developing language skills.

Attentional modulation in the detection of irrelevant deviance: a simultaneous ERP/fMRI study

Little is known about the neural mechanisms that control attentional modulation of deviance detection in the auditory modality. In this study, we manipulated the difficulty of a primary task to test the relation between task difficulty and the detection of infrequent, task-irrelevant deviant (D) tones (1,300 Hz) presented among repetitive standard (S) tones (1,000 Hz). Simultaneous functional magnetic resonance imaging (fMRI)/event-related potentials (ERPs) were recorded from 21 subjects performing a two-alternative forced-choice duration discrimination task (short and long tones of equal probability). The duration of the short tone was always 50 msec. The duration of the long tone was 100 msec in the easy task and 60 msec in the difficult task. As expected, response accuracy decreased and response time (RT) increased in the difficult compared with the easy task. Performance was also poorer for D than for S tones, indicating distraction by task-irrelevant frequency information on trials involving D tones. In the difficult task, an amplitude increase was observed in the difference waves for N1 and P3a, ERP components associated with increased attention to deviant sounds. The mismatch negativity (MMN) response, associated with passive deviant detection, was larger in the easy task, demonstrating the susceptibility of this component to attentional manipulations. The fMRI contrast D > S in the difficult task revealed activation on the right superior temporal gyrus (STG) and extending ventrally into the superior temporal sulcus, suggesting this region's involvement in involuntary attention shifting toward unattended, infrequent sounds. Conversely, passive deviance detection, as reflected by the MMN, was associated with more dorsal activation on the STG. These results are consistent with the view that the dorsal STG region is responsive to mismatches between the memory trace of the standard and the incoming deviant sound, whereas the ventral STG region is activated by involuntary shifts of attention to task-irrelevant auditory features.

The effects of attentional load on auditory ERPs recorded from human cortex

Responses to acoustic input were recorded from human temporal cortex using subdural electrodes in order to investigate in greater anatomical detail how attentional load modulates exogenous auditory responses. Four patient-volunteers performed a dichotic listening task in which they listened for rare frequency deviants in a series of tones presented to both ears at interstimulus intervals (ISIs) of 400, 800, and 2000 ms. Across all ISIs, stimuli presented contralateral to electrode location produced the strongest deflections in the averaged ERP at approximately 90 and 170 ms post-stimulus on average (labeled N90stg and P170stg). Maximal recording sites for these peaks most often occurred over the Sylvian fissure or the upper bank of the posterior superior temporal gyrus. Neither ISI nor selective attention exhibited substantial effects on peak latencies. However, as presentation rates increased (decreasing ISI), overall averaged event-related potential (ERP) amplitudes declined significantly, while attending to the contralateral stimulus significantly increased both the N90stg and P170stg peaks for most patients. This effect of attention increased with decreasing ISI for both components most clearly in the difference between the grand-average ERPs for attending to vs. ignoring the contralateral stimulus, and even more dramatically in the percentage ratio of that difference over the mean peak amplitude. This amplifying effect of attention with increasing load, along with its anatomical location, suggests that attention can enhance exogenous sources in auditory cortex.

Event-related potentials, cognition, and behavior: A biological approach

The prevailing cognitive-psychological accounts of event-related brain potentials (ERPs) assume that ERP components manifest information processing operations leading from stimulus to response. Since this view encounters numerous difficulties already analyzed in previous studies, an alternative view is presented here that regards cortical control of behavior as a repetitive sensorimotor cycle consisting of two phases: (i) feedforward anticipation and (ii) feedback cortical performance. This view allows us to interpret in an integrative manner numerous data obtained from very different domains of ERP studies: from biophysics of ERP waves to their relationship to the processing of language, in which verbal behavior is viewed as likewise controlled by the same two basic control processes: feedforward (hypothesis building) and feedback (hypothesis checking). The proposed approach is intentionally simplified, explaining numerous effects on the basis of few assumptions and relating several levels of analysis: neurophysiology, macroelectrical processes (i.e. ERPs), cognition and behavior. It can, therefore, be regarded as a first approximation to a general theory of ERPs.

Auditory Attentional Capture: Effects of Singleton Distractor Sounds

The phenomenon of attentional capture by a unique yet irrelevant singleton distractor has typically been studied in visual search. In this article, the authors examine whether a similar phenomenon occurs in the auditory domain. Participants searched sequences of sounds for targets defined by frequency, intensity, or duration. The presence of a singleton distractor that was unique on an irrelevant dimension (e.g., a low-frequency singleton in search for a target of high intensity) was associated with search costs in both detection and discrimination tasks. However, if the singleton feature coincided with the target item, search was facilitated. These results establish the phenomenon of auditory attentional capture.

Effects of Attentional Load on Auditory Scene Analysis

The effects of attention on the neural processes underlying auditory scene analysis were investigated through the manipulation of auditory task load. Participants were asked to focus their attention on tuned and mistuned stimuli presented to one ear and to ignore similar stimuli presented to the other ear. For both tuned and mistuned sounds, long (standard) and shorter (deviant) duration stimuli were presented in both ears. Auditory task load was manipulated by varying task instructions. In the easier condition, participants were asked to press a button for deviant sounds (target) at the attended location, irrespective of tuning. In the harder condition, participants were further asked to identify whether the targets were tuned or mistuned. Participants were faster in detecting targets defined by duration only than by both duration and tuning. At the unattended location, deviant stimuli generated a mismatch negativity wave at frontocentral sites whose amplitude decreased with increasing task demand. In comparison, standard mistuned stimuli generated an object-related negativity at central sites whose amplitude was not affected by task difficulty. These results show that the processing of sound sequences is differentially affected by attentional load than is the processing of sounds that occur simultaneously (i.e., sequential vs. simultaneous grouping processes), and that they each recruit distinct neural networks.

Auditory distraction: event-related potential and behavioral indices

OBJECTIVE

The aim of this study was to illuminate behavioral and event-related potential (ERP) effects of attentional orienting and reorienting obtained in a newly developed auditory distraction paradigm, to provide more precise indicators about the neural generators of the ERP effects using scalp current density (SCD) analysis, and to evaluate the stability of the distraction effects.

METHODS

In two sessions separated by 25 days, 10 subjects were presented with tones being of short (200 ms) and long (400 ms) duration equiprobably; tones were of high-probability standard or of low-probability deviant frequency. In Distraction condition, subjects had to behaviorally discriminate short from long tones. In Ignore condition, subjects were reading a book. Behavioral performance and multi-channel EEG were recorded.

RESULTS

Task-irrelevant frequency deviations prolonged reaction times in the duration discrimination task by more than 35 ms and elicited the MMN and P3a components of the event-related potential. The P3a was followed by a negative deflection called RON (reorienting negativity). P3a and RON were absent in Ignore condition. All effects were found to be highly stable between sessions (product-moment correlations between 0.76 and 0.90). SCD analysis suggested frontal generators for P3a and for RON.

CONCLUSIONS

It is demonstrated that small frequency deviations may yield distinct distraction effects in a tone duration discrimination task on a behavioral and on an electrophysiological level. Results support the hypothesis that frontal areas are involved in the exogenous orienting of attention (P3a) and in the reorienting of attention (RON). Due to the high stability of the deviance-related behavioral and ERP effects, this distraction paradigm may be utilized for clinical research.

Attentional orienting and reorienting is indicated by human event-related brain potentials

We investigated event-related potential indications for the orienting towards task-irrelevant, distracting aspects of stimulation and for the subsequent reorienting towards task-related aspects of stimulation. An identical experimental protocol was run in three conditions manipulating the task relevance of the sounds. As to be expected, distractors elicited the MMN (reflecting the brain's pre-attentive change detection) in each condition (even when the sounds were ignored) and subsequent N2b and P3 (reflecting orienting towards the distractor) when the sounds were attended. A late negativity was confined to a condition in which subjects discriminating long from short sounds were distracted by task-irrelevant frequency deviations. The 'reorienting negativity' (RON) probably reflects processes in the context of reorienting towards task-relevant aspects of stimulation following distraction.

Behavioral and electrophysiological effects of task-irrelevant sound change: a new distraction paradigm

A distraction paradigm was utilized that is suited to yield reliable auditory distraction on an individual level even with rather small frequency deviances (7%). Distraction to these tiny deviants was achieved by embedding task-relevant aspects and task-irrelevant, distracting aspects of stimulation into the same perceptual object. Event-related potential (ERP) and behavioral effects of this newly developed paradigm were determined. Subjects received tones that could be of short or long duration equiprobably. They were instructed to press a response button to long-duration tones (targets). In oddball blocks, tones could be of standard frequency or of low-probability (p=0.1), deviant frequency. The task-irrelevant frequency deviants elicited MMN, N2b, and P3a components, and caused impoverished behavioral performance to targets. The usage of tiny distractors permits an interpretation of auditory distraction in terms of attention switching due to a particular memory-related change-detection process. On the basis of the results from an additional condition in which tones were of 10 different frequencies (involving those frequencies which served as standard and deviant in oddball blocks), it is argued that one important prerequisite for linking the neural mechanisms reflected in change-related brain waves to behavioral distraction effects may be regarded as fulfilled. The robustness of the distraction effects to tiny deviations was confirmed in two control experiments.

Signal clustering modulates auditory cortical activity in humans

Auditory streaming and its relevance to attentional processing was examined using event-related brain potentials (ERPs) in situations facilitating perception of one or two streams of sounds. Subjects listened to sequences of brief tones of three different frequencies presented in random order. In evenly spaced (ES) conditions, the three frequencies were equidistant on the musical scale. In clustered, easy (CE) conditions, the attended frequency was distinct, while the middle and extreme distractor tones were clustered together. In clustered, hard (CH) conditions, the attended frequency was clustered with one of the distractors. The subjects pressed a button in response to occasional target tones of longer duration at a prespecified frequency. The subjects were faster and more accurate in CE conditions than they were in ES conditions, and ERP attention effects were enhanced in amplitude in CE conditions. Conversely, the subjects were slower and less accurate in CH conditions and ERP attention effects were delayed in latency and decreased in amplitude. Clustering effects suggest that the processing of stimuli belonging to the attended stream was promoted and the processing of those falling outside the stream was inhibited. The timing and scalp distribution of clustering-related changes in ERPs suggest that clustering modulates early sensory processing in auditory cortex.

Processing of auditory stimuli during auditory and visual attention as revealed by event-related potentials

Auditory event-related brain potentials (ERPs) were recorded during auditory and visual selective attention tasks. Auditory stimuli consisted of frequent standard tones (1000 Hz) and infrequent deviant tones (1050 Hz and 1300 Hz) delivered randomly to the left and right ears. Visual stimuli were vertical line gratings randomly presented on a video monitor at mean intervals of 6 s. During auditory attention, the subject attended to the stimuli in a designated ear and responded to the 1300-Hz deviants occurring among the attended tones. During visual attention, the subject responded to the occasional visual stimuli. ERPs for tones delivered to the attended ear were negatively displaced relative to ERPs elicited by tones delivered to the unattended ear and to ERPs elicited by auditory stimuli during visual attention. This attention effect consisted of negative difference waves with early and late components. Mismatch negativities (MMNs) were elicited by 1300-Hz and 1050-Hz deviants irrespective of whether they occurred among attended or unattended tones. MMN amplitudes were unaffected by attention, supporting the proposal that the MMN is generated by an automatic cerebral discrimination process.

Anatomical substrates of auditory selective attention: behavioral and electrophysiological effects of posterior association cortex lesions

Event-related brain potentials (ERPs) and reaction times (RTs) were recorded in an auditory selective attention task in control subjects and two groups of patients with lesions centered in (1) the temporal/parietal junction (T/P, n = 9); and (2) the inferior parietal lobe (IPL, n = 7). High pitched tones were presented to one ear and low pitched tones to the other in random sequences that included infrequent longer-duration tones and occasional novel sounds. Subjects attended to a specified ear and pressed a button to the longer-duration tones in that ear. IPL and T/P lesions slowed reaction times (RTs) and increased error rates, but improved one aspect of performance--patients showed less distraction than controls when targets followed novel sounds. T/P lesions reduced the amplitude of early sensory ERPs, initially over the damaged hemisphere (N1a, 70-110 ms) and then bilaterally (N1b, 110-130 ms, and N1c 130-160 ms). The reduction was accentuated for tones presented contralateral to the lesion, suggesting that N1 generators receive excitatory input primarily from the contralateral ear. IPL lesions reduced N1 amplitudes to both low frequency tones and novel sounds. Nd components associated with attentional selection were diminished over both hemispheres in the T/P group and over the lesioned hemisphere in the IPL group independent of ear of stimulation. Target and novel N2s tended to be diminished by IPL lesions but were unaffected by T/P lesions. The mismatch negativity was unaffected by either T/P or IPL lesions. The results support different roles of T/P and IPL cortex in auditory selective attention.