Conjoining three auditory features: an event-related brain potential study

Target of selective auditory attention can be robustly followed with MEG

Selective auditory attention enables filtering of relevant acoustic information from irrelevant. Specific auditory responses, measurable by magneto- and electroencephalography (MEG/EEG), are known to be modulated by attention to the evoking stimuli. However, such attention effects have typically been studied in unnatural conditions (e.g. during dichotic listening of pure tones) and have been demonstrated mostly in averaged auditory evoked responses. To test how reliably we can detect the attention target from unaveraged brain responses, we recorded MEG data from 15 healthy subjects that were presented with two human speakers uttering continuously the words "Yes" and "No" in an interleaved manner. The subjects were asked to attend to one speaker. To investigate which temporal and spatial aspects of the responses carry the most information about the target of auditory attention, we performed spatially and temporally resolved classification of the unaveraged MEG responses using a support vector machine. Sensor-level decoding of the responses to attended vs. unattended words resulted in a mean accuracy of [Formula: see text] (N = 14) for both stimulus words. The discriminating information was mostly available 200-400 ms after the stimulus onset. Spatially-resolved source-level decoding indicated that the most informative sources were in the auditory cortices, in both the left and right hemisphere. Our result corroborates attention modulation of auditory evoked responses and shows that such modulations are detectable in unaveraged MEG responses at high accuracy, which could be exploited e.g. in an intuitive brain-computer interface.

Slow phase-locked modulations support selective attention to sound

To make sense of complex soundscapes, listeners must select and attend to task-relevant streams while ignoring uninformative sounds. One possible neural mechanism underlying this process is alignment of endogenous oscillations with the temporal structure of the target sound stream. Such a mechanism has been suggested to mediate attentional modulation of neural phase-locking to the rhythms of attended sounds. However, such modulations are compatible with an alternate framework, where attention acts as a filter that enhances exogenously-driven neural auditory responses. Here we attempted to test several predictions arising from the oscillatory account by playing two tone streams varying across conditions in tone duration and presentation rate; participants attended to one stream or listened passively. Attentional modulation of the evoked waveform was roughly sinusoidal and scaled with rate, while the passive response did not. However, there was only limited evidence for continuation of modulations through the silence between sequences. These results suggest that attentionally-driven changes in phase alignment reflect synchronization of slow endogenous activity with the temporal structure of attended stimuli.

Predictability of higher-order temporal structure of musical stimuli is associated with auditory evoked response

Sound predictability resulting from repetitive patterns can be implicitly learned and often neither requires nor captures our conscious attention. Recently, predictive coding theory has been used as a framework to explain how predictable or expected stimuli evoke and gradually attenuate obligatory neural responses over time compared to those elicited by unpredictable events. However, these results were obtained using the repetition of simple auditory objects such as pairs of tones or phonemes. Here we examined whether the same principle would hold for more abstract temporal structures of sounds. If this is the case, we hypothesized that a regular repetition schedule of a set of musical patterns would reduce neural processing over the course of listening compared to stimuli with an irregular repetition schedule (and the same set of musical patterns). Electroencephalography (EEG) was recorded while participants passively listened to 6-8 min stimulus sequences in which five different four-tone patterns with temporally regular or irregular repetition were presented successively in a randomized order. N1 amplitudes in response to the first tone of each musical pattern were significantly less negative at the end of the regular sequence compared to the beginning, while such reduction was absent in the irregular sequence. These results extend previous findings by showing that N1 reflects automatic learning of the predictable higher-order structure of sound sequences, while continuous engagement of preattentive auditory processing is necessary for the unpredictable structure.

Auditory spatial attention modulates the unmasking effect of perceptual separation in a "cocktail party" environment

The perceptual separation between a signal speech and a competing speech (masker), induced by the precedence effect, plays an important role in releasing the signal speech from the masker, especially in a reverberant environment. The perceptual-separation-induced unmasking effect has been suggested to involve multiple cognitive processes, such as selective attention. However, whether listeners' spatial attention modulate the perceptual-separation-induced unmasking effect is not clear. The present study investigated how perceptual separation and auditory spatial attention interact with each other to facilitate speech perception under a simulated noisy and reverberant environment by analyzing the cortical auditory evoked potentials to the signal speech. The results showed that the N1 wave was significantly enhanced by perceptual separation between the signal and masker regardless of whether the participants' spatial attention was directed to the signal or not. However, the P2 wave was significantly enhanced by perceptual separation only when the participants attended to the signal speech. The results indicate that the perceptual-separation-induced facilitation of P2 needs more attentional resource than that of N1. The results also showed that the signal speech caused an enhanced N1 in the contralateral hemisphere regardless of whether participants' attention was directed to the signal or not. In contrast, the signal speech caused an enhanced P2 in the contralateral hemisphere only when the participant attended to the signal. The results indicate that the hemispheric distribution of N1 is mainly affected by the perceptual features of the acoustic stimuli, while that of P2 is affected by the listeners' attentional status.

Auditory perceptual objects as generative models: Setting the stage for communication by sound

Communication by sounds requires that the communication channels (i.e. speech/speakers and other sound sources) had been established. This allows to separate concurrently active sound sources, to track their identity, to assess the type of message arriving from them, and to decide whether and when to react (e.g., reply to the message). We propose that these functions rely on a common generative model of the auditory environment. This model predicts upcoming sounds on the basis of representations describing temporal/sequential regularities. Predictions help to identify the continuation of the previously discovered sound sources to detect the emergence of new sources as well as changes in the behavior of the known ones. It produces auditory event representations which provide a full sensory description of the sounds, including their relation to the auditory context and the current goals of the organism. Event representations can be consciously perceived and serve as objects in various cognitive operations.

The impact of executive capacity and age on mechanisms underlying multidimensional feature selection

This study examined the role of executive capacity (EC) and aging in multidimensional feature selection. ERPs were recorded from healthy young and old adults of either high or average EC based on neuropsychological testing. Participants completed a color selective attention task in which they responded to target letter-forms in a specified color (attend condition) while ignoring letter-forms in a different color (ignore condition). Two selection negativity (SN) components were computed: the SN(Color) (attend-ignore), indexing early color selection, and the SN(Letter) (targets-standards), indexing early letter-form selection. High EC subjects exhibited self-terminating feature selection; the processing of one feature type was reduced if information from the other feature type suggested the stimulus did not contain the task-relevant feature. In contrast, average EC subjects exhaustively selected all features of a stimulus. The self-terminating approach was associated with better task accuracy. Higher EC was also linked to stronger early selection of target letter-forms, but did not modulate the seemingly less demanding task of color selection. Mechanisms utilized for multidimensional feature selection appear to be consistent across the lifespan, although there was age-related slowing of processing speed for early selection of letter features. We conclude that EC is a critical determinant of how multidimensional feature processing is carried out.

Top-down controlled and bottom-up triggered orienting of auditory attention to pitch activate overlapping brain networks

A number of previous studies have suggested segregated networks of brain areas for top-down controlled and bottom-up triggered orienting of visual attention. However, the corresponding networks involved in auditory attention remain less studied. Our participants attended selectively to a tone stream with either a lower pitch or higher pitch in order to respond to infrequent changes in duration of attended tones. The participants were also required to shift their attention from one stream to the other when guided by a visual arrow cue. In addition to these top-down controlled cued attention shifts, infrequent task-irrelevant louder tones occurred in both streams to trigger attention in a bottom-up manner. Both cued shifts and louder tones were associated with enhanced activity in the superior temporal gyrus and sulcus, temporo-parietal junction, superior parietal lobule, inferior and middle frontal gyri, frontal eye field, supplementary motor area, and anterior cingulate gyrus. Thus, the present findings suggest that in the auditory modality, unlike in vision, top-down controlled and bottom-up triggered attention activate largely the same cortical networks. Comparison of the present results with our previous results from a similar experiment on spatial auditory attention suggests that fronto-parietal networks of attention to location or pitch overlap substantially. However, the auditory areas in the anterior superior temporal cortex might have a more important role in attention to the pitch than location of sounds. This article is part of a Special Issue entitled SI: Prediction and Attention.

Attention to memory: orienting attention to sound object representations

Despite a growing acceptance that attention and memory interact, and that attention can be focused on an active internal mental representation (i.e., reflective attention), there has been a paucity of work focusing on reflective attention to 'sound objects' (i.e., mental representations of actual sound sources in the environment). Further research on the dynamic interactions between auditory attention and memory, as well as its degree of neuroplasticity, is important for understanding how sound objects are represented, maintained, and accessed in the brain. This knowledge can then guide the development of training programs to help individuals with attention and memory problems. This review article focuses on attention to memory with an emphasis on behavioral and neuroimaging studies that have begun to explore the mechanisms that mediate reflective attentional orienting in vision and more recently, in audition. Reflective attention refers to situations in which attention is oriented toward internal representations rather than focused on external stimuli. We propose four general principles underlying attention to short-term memory. Furthermore, we suggest that mechanisms involved in orienting attention to visual object representations may also apply for orienting attention to sound object representations.

Attention to natural auditory signals

The challenge of understanding how the brain processes natural signals is compounded by the fact that such signals are often tied closely to specific natural behaviors and natural environments. This added complexity is especially true for auditory communication signals that can carry information at multiple hierarchical levels, and often occur in the context of other competing communication signals. Selective attention provides a mechanism to focus processing resources on specific components of auditory signals, and simultaneously suppress responses to unwanted signals or noise. Although selective auditory attention has been well-studied behaviorally, very little is known about how selective auditory attention shapes the processing on natural auditory signals, and how the mechanisms of auditory attention are implemented in single neurons or neural circuits. Here we review the role of selective attention in modulating auditory responses to complex natural stimuli in humans. We then suggest how the current understanding can be applied to the study of selective auditory attention in the context natural signal processing at the level of single neurons and populations in animal models amenable to invasive neuroscience techniques. This article is part of a Special Issue entitled "Communication Sounds and the Brain: New Directions and Perspectives".

Two-stage processing of sounds explains behavioral performance variations due to changes in stimulus contrast and selective attention: an MEG study

Selectively attending to task-relevant sounds whilst ignoring background noise is one of the most amazing feats performed by the human brain. Here, we studied the underlying neural mechanisms by recording magnetoencephalographic (MEG) responses of 14 healthy human subjects while they performed a near-threshold auditory discrimination task vs. a visual control task of similar difficulty. The auditory stimuli consisted of notch-filtered continuous noise masker sounds, and of 1020-Hz target tones occasionally (p = 0.1) replacing 1000-Hz standard tones of 300-ms duration that were embedded at the center of the notches, the widths of which were parametrically varied. As a control for masker effects, tone-evoked responses were additionally recorded without masker sound. Selective attention to tones significantly increased the amplitude of the onset M100 response at ~100 ms to the standard tones during presence of the masker sounds especially with notches narrower than the critical band. Further, attention modulated sustained response most clearly at 300-400 ms time range from sound onset, with narrower notches than in case of the M100, thus selectively reducing the masker-induced suppression of the tone-evoked response. Our results show evidence of a multiple-stage filtering mechanism of sensory input in the human auditory cortex: 1) one at early (~100 ms) latencies bilaterally in posterior parts of the secondary auditory areas, and 2) adaptive filtering of attended sounds from task-irrelevant background masker at longer latency (~300 ms) in more medial auditory cortical regions, predominantly in the left hemisphere, enhancing processing of near-threshold sounds.

ERP evidence of early cross-modal links between auditory selective attention and visuo-spatial memory

Previous dual-task research pairing complex visual tasks involving non-spatial cognitive processes during dichotic listening have shown effects on the late component (Ndl) of the negative difference selective attention waveform but no effects on the early (Nde) response suggesting that the Ndl, but not the Nde, is affected by non-spatial processing in a dual-task. Thus to further explore the nature of this dissociation and whether the Nd waveform is affected by spatial processing; fourteen adult participants performed auditory dichotic listening in conjunction with visuo-spatial memory in a cross-modal dual-task paradigm. The results showed that the visuo-spatial memory task decreased both the Nde and Ndl waveforms, and also attenuated P300 and increased its latency. This pattern of results suggests that: (1) the Nde reflects a memory trace that is shared with vision when the information is spatial in nature, and (2) P300 latency appears to be influenced by the discriminability of stimuli underlying the Nde and Ndl memory trace.

Event-related potential based evidence of cognitive dysfunction in patients during the first episode of depression using a novelty oddball task

Studies using event-related potentials (ERP) to investigate cognitive dysfunction associated with depression have generated variable findings. The differences among reported results are typically attributed to the disparity of the samples. To eliminate the effects of factors such as medication and comorbidity with other psychiatric disorders, first-episode unmedicated patients suffering from depression were recruited in this study. Both depressed patients and matched controls performed an auditory novelty oddball task and ERPs were recorded. The depression group exhibited an increased P2 to standard tones. For the target tones, depressed subjects showed reduced N2 at anterior regions and reduced target P3 in the right hemisphere. In response to novel stimuli, there was a reduced amplitude of the novelty P3 component at the fronto-central region in depressed patients. Our findings suggest that patients with depression in the initial stages show an impaired ability in voluntary and involuntary attention and exhibit frontal lobe and right-hemisphere dysfunctions.

An initial report of a new biological marker for bipolar disorder: P85 evoked brain potential

OBJECTIVES

Progress toward understanding the neurobiological and genetic underpinnings of bipolar disorder has been limited by the scarcity of potential biological markers that predict its occurrence. A measure of the integrity of brain inhibitory function, sensory gating, measured using the amplitude of the evoked potential at 50 ms to the first of two paired clicks divided by the response to the second, has been characterized as a biological marker for schizophrenia. Currently, no such biological marker exists for bipolar disorder. The goal of this research was to determine how gating of an auditory brain potential at 85 ms (P85), not previously examined in sensory gating studies, differentiated control and patient groups.

METHODS

P50 and P85 auditory evoked potentials were collected from individuals diagnosed with schizoaffective disorder (n = 45), paranoid schizophrenia (n = 66), and bipolar I disorder (n = 42) using DSM-IV criteria and the Structured Clinical Interview for DSM-IV; and from 56 healthy controls.

RESULTS

The P85 gating ratio was significantly larger in the bipolar disorder group compared to each of the other groups (F(3,204) = 5.47, p = 0.001, and post-hoc tests). The P50 gating ratio was significantly larger for the schizoaffective group than for the control group (F(3,204) = 2.81, p = 0.040), but did not differ from the ratio for the schizophrenia, paranoid type (p = 0.08) and bipolar groups.

CONCLUSIONS

The previously unstudied P85 gating ratio may provide a new marker specific to bipolar disorder. The findings will promote further studies to investigate the unique contribution of this measure as an endophenotype.

Interaction between attention and bottom-up saliency mediates the representation of foreground and background in an auditory scene

The mechanism by which a complex auditory scene is parsed into coherent objects depends on poorly understood interactions between task-driven and stimulus-driven attentional processes. We illuminate these interactions in a simultaneous behavioral-neurophysiological study in which we manipulate participants' attention to different features of an auditory scene (with a regular target embedded in an irregular background). Our experimental results reveal that attention to the target, rather than to the background, correlates with a sustained (steady-state) increase in the measured neural target representation over the entire stimulus sequence, beyond auditory attention's well-known transient effects on onset responses. This enhancement, in both power and phase coherence, occurs exclusively at the frequency of the target rhythm, and is only revealed when contrasting two attentional states that direct participants' focus to different features of the acoustic stimulus. The enhancement originates in auditory cortex and covaries with both behavioral task and the bottom-up saliency of the target. Furthermore, the target's perceptual detectability improves over time, correlating strongly, within participants, with the target representation's neural buildup. These results have substantial implications for models of foreground/background organization, supporting a role of neuronal temporal synchrony in mediating auditory object formation.

Selective attention to sound location or pitch studied with event-related brain potentials and magnetic fields

Event-related brain potentials (ERPs) and magnetic fields (ERFs) were used to compare brain activity associated with selective attention to sound location or pitch in humans. Sixteen healthy adults participated in the ERP experiment, and 11 adults in the ERF experiment. In different conditions, the participants focused their attention on a designated sound location or pitch, or pictures presented on a screen, in order to detect target sounds or pictures among the attended stimuli. In the Attend Location condition, the location of sounds varied randomly (left or right), while their pitch (high or low) was kept constant. In the Attend Pitch condition, sounds of varying pitch (high or low) were presented at a constant location (left or right). Consistent with previous ERP results, selective attention to either sound feature produced a negative difference (Nd) between ERPs to attended and unattended sounds. In addition, ERPs showed a more posterior scalp distribution for the location-related Nd than for the pitch-related Nd, suggesting partially different generators for these Nds. The ERF source analyses found no source distribution differences between the pitch-related Ndm (the magnetic counterpart of the Nd) and location-related Ndm in the superior temporal cortex (STC), where the main sources of the Ndm effects are thought to be located. Thus, the ERP scalp distribution differences between the location-related and pitch-related Nd effects may have been caused by activity of areas outside the STC, perhaps in the inferior parietal regions.

Feature- and object-based attentional modulation in the human auditory "where" pathway

Attending to a visual stimulus feature, such as color or motion, enhances the processing of that feature in the visual cortex. Moreover, the processing of the attended object's other, unattended, features is also enhanced. Here, we used functional magnetic resonance imaging to show that attentional modulation in the auditory system may also exhibit such feature- and object-specific effects. Specifically, we found that attending to auditory motion increases activity in nonprimary motion-sensitive areas of the auditory cortical "where" pathway. Moreover, activity in these motion-sensitive areas was also increased when attention was directed to a moving rather than a stationary sound object, even when motion was not the attended feature. An analysis of effective connectivity revealed that the motion-specific attentional modulation was brought about by an increase in connectivity between the primary auditory cortex and nonprimary motion-sensitive areas, which, in turn, may have been mediated by the paracingulate cortex in the frontal lobe. The current results indicate that auditory attention can select both objects and features. The finding of feature-based attentional modulation implies that attending to one feature of a sound object does not necessarily entail an exhaustive processing of the object's unattended features.

Graded cue information in dichotic pitch: effects on event-related potentials

To determine whether electroencephalogram components elicited by dichotic pitch stimuli are all-or-none threshold-like responses or graded responses that depend on the saliency of the stimuli, we recorded electroencephalograms while participants listened to dichotic pitch stimuli constructed with different signal-to-background ratios. The object-related negativity and P400 components were largest when the dichotic pitch was most salient (high signal-to-background ratio), and decreased in amplitude with decreasing signal-to-background ratio. These results are similar to those reported for mistuned harmonics, thereby providing additional evidence that the object-related negativity and P400 components observed for these disparate stimulus types reflect similar processing. They also support the notion that the object-related negativity and P400 amplitudes are dependent on the level of relevant cue-based stimulus information.

Response preferences for "what" and "where" in human non-primary auditory cortex

Primate studies suggest the auditory cortex is organized in at least two anatomically and functionally separate pathways: a ventral pathway specializing in object recognition and a dorsal pathway specializing in object localization. The current experiment assesses the validity of this model in human listeners using fMRI to investigate the neural substrates of spatial and non-spatial temporal pattern information. Targets were differentiated from non-targets on the basis of two levels of pitch information (present vs. absent, fixed vs. varying) and two levels of spatial information (compact vs. diffuse sound source, fixed vs. varying location) in a factorial design. Analyses revealed spatially separate responses to spatial and non-spatial temporal information. The main activation associated with pitch occurred predominantly in Heschl's gyrus (HG) and planum polare, while that associated with changing sound source location occurred posterior to HG, in planum temporale (PT). Activation common to both pitch and changing spatial location was located bilaterally in anterior PT. Apart from this small region of overlap, our data support the anatomical and functional segregation of 'what' and 'where' in human non-primary auditory cortex. Our results also highlight a distinction in the sensitivity of anterior and posterior fields of PT to non-spatial information and specify the type of spatial information that is coded within early areas of the spatial processing stream.

Abnormal asymmetry of N200 and P300 event-related potentials in subclinical depression

Sex differences for depression in prevalence and symptom profile may in part be due to differences between men and women in brain dysfunction associated with the disorder. Changes in event-related potential (ERP) measures similar to those seen in clinical populations are reported in subclinical or premorbid forms of depression. The current study investigates sex differences in ERPs associated with subclinical depression. One-hundred-and-forty healthy, right-handed adults (aged 20-60 years; screened to exclude clinical depression and psychosis) completed an auditory oddball task and the Depression Anxiety and Stress Scale (DASS). Seventy (n = 35 men) subclinically depressed (SD) (i.e. scoring >2 for depression on DASS) participants were matched for age and education with 70 (n = 35 men) participants showing no signs of depression (ND). Repeated measures multivariate analysis of variance was used to test for differences in N200 and P300 amplitude between SD and ND groups. ND, but not SD groups had asymmetry (R > L) of central N200 amplitude. Similar asymmetry was seen in ND, but not SD men at posterior sites. SD groups demonstrated left > right posterior P300 amplitude asymmetry due to P300 enhancement at left temporoparietal sites. Results support involvement of various cognitive mechanisms measured by P300 and N200 in subclinical depressive symptoms some of which may rely on sex.

Orienting Attention to Points in Time Improves Stimulus Processing Both within and across Modalities

Spatial attention affects the processing of stimuli of both a task-relevant and a task-irrelevant modality. The present study investigated if similar cross-modal effects exist when attention is oriented to a point in time. Short (600 msec) and long (1200 msec) empty intervals, marked by a tactile onset and an auditory or a tactile offset marker, were presented. In each block, the participants had to attend one interval and one modality. Event-related potentials (ERPs) to auditory and tactile offset markers of attended as compared to unattended intervals were characterized by an enhancement of early negative deflections of the auditory and somatosensory ERPs (audition, 100–140 msec; touch, 130–180 msec) when audition or touch was task relevant, respectively. Similar effects were found for auditory stimuli when touch was task relevant. An additional reaction time experiment revealed faster responses to both auditory and tactile stimuli at the attended as compared to the unattended point in time, irrespective of which modality was primary. Both behavioral and ERP data show that attention can be focused on a point in time, which results in a more efficient processing of auditory and tactile stimuli. The ERP data further suggest that a relative enhancement at perceptual processing stages contributes to the processing advantage for temporally attended stimuli. The existence of cross-modal effects of temporal attention underlines the importance of time as a feature for binding input across different modalities.

Selective attention to sound location or pitch studied with fMRI

We used 3-T functional magnetic resonance imaging to compare the brain mechanisms underlying selective attention to sound location and pitch. In different tasks, the subjects (N = 10) attended to a designated sound location or pitch or to pictures presented on the screen. In the Attend Location conditions, the sound location varied randomly (left or right), while the pitch was kept constant (high or low). In the Attend Pitch conditions, sounds of randomly varying pitch (high or low) were presented at a constant location (left or right). Both attention to location and attention to pitch produced enhanced activity (in comparison with activation caused by the same sounds when attention was focused on the pictures) in widespread areas of the superior temporal cortex. Attention to either sound feature also activated prefrontal and inferior parietal cortical regions. These activations were stronger during attention to location than during attention to pitch. Attention to location but not to pitch produced a significant increase of activation in the premotor/supplementary motor cortices of both hemispheres and in the right prefrontal cortex, while no area showed activity specifically related to attention to pitch. The present results suggest some differences in the attentional selection of sounds on the basis of their location and pitch consistent with the suggested auditory "what" and "where" processing streams.

Attending points in time and space

Both spatial and temporal attention improves auditory processing and these effects seem to originate at perceptual processing stages. It is not yet known if space and time are used in parallel or sequentially for stimulus selection. To directly compare when temporal and spatial attention affect stimulus processing in the auditory modality, short and long empty intervals (600 and 1,200 ms) were presented. Each interval started with a centrally presented tone (S1) and ended with a second tone (S2) presented either on the left or on the right side. Participants had to attend one point in time (offset of the short or long interval) and one position (left or right side) and had to respond to infrequent, deviant offset markers presented at the attended time point and at the attended position. The N1 of concurrently recorded event-related potentials (ERPs) to the frequent standard stimuli was enhanced by both temporal and spatial attention. The temporal and the spatial N1 attention effect had a similar scalp topography, suggesting common neural generators. By contrast, later effects of temporal and spatial attention, consisting of a posterior positivity and an anterior negativity, markedly differed.

Preattentive representation of feature conjunctions for concurrent spatially distributed auditory objects

The role of attention in conjoining features of an object has been a topic of much debate. Studies using the mismatch negativity (MMN), an index of detecting acoustic deviance, suggested that the conjunctions of auditory features are preattentively represented in the brain. These studies, however, used sequentially presented sounds and thus are not directly comparable with visual studies of feature integration. Therefore, the current study presented an array of spatially distributed sounds to determine whether the auditory features of concurrent sounds are correctly conjoined without focal attention directed to the sounds. Two types of sounds differing from each other in timbre and pitch were repeatedly presented together while subjects were engaged in a visual n-back working-memory task and ignored the sounds. Occasional reversals of the frequent pitch-timbre combinations elicited MMNs of a very similar amplitude and latency irrespective of the task load. This result suggested preattentive integration of auditory features. However, performance in a subsequent target-search task with the same stimuli indicated the occurrence of illusory conjunctions. The discrepancy between the results obtained with and without focal attention suggests that illusory conjunctions may occur during voluntary access to the preattentively encoded object representations.

The late Nd reflects a memory trace containing amodal spatial information

The early Nd reflects the analysis of simple features of selectively attended auditory stimuli, but the precise nature of the more complex processing reflected by the late Nd is unclear. The late but not the early Nd is sensitive to interference from a concurrently presented visual spatial attention switching task. This experiment investigated whether the late Nd is also sensitive to deeper visual attention switching. Twenty-one subjects performed a dichotic listening task concurrently with either visual spatial or visual letter matching attention switching tasks. Late Nd amplitude was reduced by the spatial but not the letter matching task, indicating insensitivity to deeper attention switching. P300 amplitude was reduced by both tasks. Reductions in N100 and P200 were uncorrelated. We propose that, in part, the late Nd reflects an amodal memory trace containing spatial information, possibly involving a "where" rather than a "what" auditory pathway.

Accelerated and amplified neural responses in visual discrimination: Two features are processed faster than one

Psychological and neurophysiological models of visual processing have traditionally emphasized hierarchical models to explain how separate features of visual stimuli are combined. This concept has been challenged recently with the demonstration of simultaneous activation of multiple visual areas and rapid feedback to primary cortices. Here, we show human visual processing may involve similar mechanisms. Subjects discriminated targets from nontargets as a function of shape, color, or the conjunction of these features while event-related brain potentials (ERPs) were recorded. ERP components from 100 to 200 ms across posterior occipital-temporal cortices were fastest and largest for conjunction targets. These enhanced early responses were followed by task-specific sustained posterior activity (300-500 ms). Faster reaction times were correlated with enhanced and faster early processing in the visual ventral areas. These data demonstrate the human visual system conjoins features rapidly, accelerating and amplifying the processing of relevant stimulus dimensions.

Influence of a visual spatial attention task on auditory early and late Nd and P300

Singhal et al. [Psychophysiology 39 (2002) 236] reported that the amplitude of the late negative difference (Nd) and P300 components, generated by a dichotic listening task, were decreased in parallel by a simultaneously performed visual flying task. In contrast, early Nd was unaffected. To investigate the role of covert spatial attention in this pattern of results, we substituted Posner's attention switching paradigm for the flying task. Fourteen subjects performed the dichotic listening and attention tasks alone and in combination. The results showed that only the invalid/valid condition of the Posner task reduced the amplitude of the late Nd, while the early Nd was unaffected. Contrary to the earlier study, P300 dissociated from the late Nd and its amplitude decreased in both the invalid/valid and neutral conditions of the Posner task. We conclude that the late Nd is sensitive to some aspect of attention switching and that the late Nd and P300 share sensitivity to an amodal system to which the early Nd is insensitive. Within this system, the late Nd is differentiated from P300 by its narrow sensitivity to attentional processing whereas P300 is sensitive to a broader range of processing. These similarities and differences are explained in the context of a modified version of Kok's model [Psychophysiology 38 (2001) 557] of the determinants of P300 amplitude.

The effects of memory scanning on the late Nd and P300: An interference study

Singhal and Fowler (2004) showed that the late negative difference (Nd) waveform elicited during dichotic listening was attenuated by concurrent visual short term memory (STM) scanning, but not long term memory (LTM) scanning. P300 was reduced by both tasks. The present study compared the effects of STM load on the late Nd and P300 by combining dichotic listening and visual memory scanning with varying set sizes. The results showed that the late Nd was sensitive to the introduction of the scanning task, but not to an increase in load. Furthermore, both the auditory and visual P300s were reduced when a second task was introduced, but only the visual P300 decreased as a function of memory-set size. These data suggest that (a) the auditory late Nd reflects working memory, but not memory scanning, (b) late Nd and P300 reflect parallel but distinct working memory processes, and (c) stimulus modality is an important determinant of P300 amplitude.

The ‘F-complex’ and MMN tap different aspects of deviance

OBJECTIVE

To compare the 'F(fusion)-complex' with the Mismatch negativity (MMN), both components associated with automatic detection of changes in the acoustic stimulus flow.

METHODS

Ten right-handed adult native Hebrew speakers discriminated vowel-consonant-vowel (V-C-V) sequences /ada/ (deviant) and /aga/ (standard) in an active auditory 'Oddball' task, and the brain potentials associated with performance of the task were recorded from 21 electrodes. Stimuli were generated by fusing the acoustic elements of the V-C-V sequences as follows: base was always presented in front of the subject, and formant transitions were presented to the front, left or right in a virtual reality room. An illusion of a lateralized echo (duplex sensation) accompanied base fusion with the lateralized formant locations. Source current density estimates were derived for the net response to the fusion of the speech elements (F-complex) and for the MMN, using low-resolution electromagnetic tomography (LORETA). Statistical non-parametric mapping was used to estimate the current density differences between the brain sources of the F-complex and the MMN.

RESULTS

Occipito-parietal regions and prefrontal regions were associated with the F-complex in all formant locations, whereas the vicinity of the supratemporal plane was bilaterally associated with the MMN, but only in case of front-fusion (no duplex effect).

CONCLUSIONS

MMN is sensitive to the novelty of the auditory object in relation to other stimuli in a sequence, whereas the F-complex is sensitive to the acoustic features of the auditory object and reflects a process of matching them with target categories.

SIGNIFICANCE

The F-complex and MMN reflect different aspects of auditory processing in a stimulus-rich and changing environment: content analysis of the stimulus and novelty detection, respectively.

Auditory perceptual consolidation in early-onset blindness

Early-onset blindness (EB) produces measurable advantages in auditory perception, attention, memory and language. Neville and Bavelier [Neville, H. J., & Bavelier, D. (2001) Variability of developmental plasticity. In J. L. McClelland, R. S. Siegler (Eds.) Mechanisms of cognitive development: Behavioral andellon symposia on cognition (pp. 271-301)] hypothesized that faster temporal processing underlies many auditory compensatory effects in the blind. We tested this hypothesis by comparing early-onset blind individuals and sighted counterparts (SC) by assessing their rates of perceptual consolidation, the accurate perceptual representation of auditory stimuli. Firstly, we first tested both groups on a temporal-order judgment task (TOJ). EB subjects had significantly lower TOJ thresholds than the SC subjects. Secondly, we assessed perceptual consolidation speed using auditory backward masking tasks, taking into account individual TOJ thresholds. Discrimination performance was unaffected at all mask delays in the EB group while the SC subjects needed a mask delay of 160 ms to perform comparably. A backward masking task using single tone stimuli found no differences between the EB and SC groups any mask delay. A simultaneous masking task demonstrated that the mask effectively impaired discrimination in EB subjects at sensory stages. These results suggest that advantages in perceptual consolidation may reflect a mechanism responsible for the short response times and better performance reported in early blind individuals across a number of complex auditory tasks.

The differential effects of Sternberg short- and long-term memory scanning on the late Nd and P300 in a dual-task paradigm

We previously reported that the late negative difference (Nd) waveform elicited during dichotic listening was reduced in amplitude by a concurrent simulated flying task having a wide variety of cognitive demands (Psychophysiology, 39, 2002, 236). The main purpose of the present study was to determine how tasks involving the specific demands of short-term memory (STM) or long-term memory (LTM) would influence the early and late Nd waveforms. To this end, 16 participants performed dichotic listening alone and in conjunction with the varied-set (STM) and fixed-set (LTM) versions of Sternberg's memory scanning paradigm. Event-related brain potential (ERP) data was collected concurrently from both the auditory and visual tasks. The results showed that the STM task, but not the LTM task, reduced the amplitude of the auditory late Nd. The auditory early Nd component was unaffected by either task. Furthermore, both the auditory and visual P300s were decreased in amplitude by all the dual-task conditions. These data suggest that the auditory late Nd is linked to more specific working memory processes than is P300.

The attentional selection of spatial and non-spatial attributes in touch: ERP evidence for parallel and independent processes

To investigate the functional relationship between spatial and non-spatial attentional selectivity in somatosensory processing, event-related potentials (ERPs) were recorded to mechanical tactile stimuli, which were delivered to the right or left hand, and were low or high in frequency (Experiment 1), or soft or strong in intensity (Experiment 2). Participants' task was to attend to a specific combination of one stimulus location and one non-spatial attribute. Spatial attention was reflected in enhanced N140 components followed by a sustained attentional negativity. ERP effects of non-spatial attention (enhanced negativities to the attended frequency or intensity) were observed in the same latency range, suggesting that the attentional selection of relevant spatial and non-spatial attributes occurs in parallel. Most importantly, ERP correlates of attention directed to stimulus frequency and intensity were unaffected by the current focus of spatial attention. In contrast to vision, where the selective processing of non-spatial attributes is hierarchically dependent on selection by location, but similar to auditory attention, spatial and non-spatial attentional selectivity appear to operate independently in touch.

Attentional modulation of human auditory cortex

Attention powerfully influences auditory perception, but little is understood about the mechanisms whereby attention sharpens responses to unattended sounds. We used high-resolution surface mapping techniques (using functional magnetic resonance imaging, fMRI) to examine activity in human auditory cortex during an intermodal selective attention task. Stimulus-dependent activations (SDAs), evoked by unattended sounds during demanding visual tasks, were maximal over mesial auditory cortex. They were tuned to sound frequency and location, and showed rapid adaptation to repeated sounds. Attention-related modulations (ARMs) were isolated as response enhancements that occurred when subjects performed pitch-discrimination tasks. In contrast to SDAs, ARMs were localized to lateral auditory cortex, showed broad frequency and location tuning, and increased in amplitude with sound repetition. The results suggest a functional dichotomy of auditory cortical fields: stimulus-determined mesial fields that faithfully transmit acoustic information, and attentionally labile lateral fields that analyze acoustic features of behaviorally relevant sounds.

Attention to motion enhances processing of both visual and auditory stimuli: an event-related potential study

The present event-related potential (ERP) study investigated whether attending to a particular direction of motion similarly enhances the processing of auditory and visual stimuli. ERPs were recorded while participants perceived horizontally moving visual and auditory stimuli. Attention was manipulated by asking participants to detect an infrequent target stimulus that was of a specified modality (either visual or auditory) and that moved in a specified direction (either leftward or rightward). Stimuli moving in the attended direction elicited ERPs that were more negative than ERPs to stimuli moving in the unattended direction. This difference started around 140 ms post stimulus onset for visual and around 120 ms for auditory stimuli. The auditory effect had a frontal scalp topography, whereas the visual effect was distributed parieto-occipitally. Later parts of the difference waves were maximal at centro-parietal electrodes for both modalities. Crossmodal effects of attention to motion from one modality to the other could not be detected. The results are discussed with regard to hierarchical models of attention.

Early processing stages are modulated when auditory stimuli are presented at an attended moment in time: an event-related potential study

The present study investigated with event-related potentials whether attending to a moment in time modulates the processing of auditory stimuli at a similar early, perceptual level as attending to a location in space. The participants listened to short (600 ms) and long (1,200 ms) intervals marked by white noise bursts. The task was to attend in alternating runs either to the short or to the long intervals and to respond to rare offset markers that differed in intensity from the frequent standard offset markers. Prior to the to-be-attended moment, a slow negative potential developed over the frontal scalp. Stimuli presented at the attended compared to the unattended moments in time elicited an enhanced N1 and an enhanced posteriorly distributed positivity (300-370 ms). The results show that attention can be flexibly controlled in time and that not only late but also early perceptual processing stages are modulated by attending to a moment in time.

Discrimination of single features and conjunctions by children

Stimuli that are discriminated by a conjunction of features can show more rapid early processing in adults. To determine how this facilitation effect develops, the processing of visual features and their conjunction was examined in 7-12-year-old children. The children completed a series of tasks in which they made a target-non-target judgement as a function of shape only, colour only or shape and colour features, while event-related potentials were recorded. To assess early stages of feature processing the posteriorly distributed P1 and N1 were analysed. Attentional effects were seen for both components. P1 had a shorter latency and P1 and N1 had larger amplitudes to targets than non-targets. Task effects were driven by the conjunction task. P1 amplitude was largest, while N1 amplitude was smallest for the conjunction targets. In contrast to larger left-sided N1 in adults, N1 had a symmetrical distribution in the children. N1 latency was shortest for the conjunction targets in the 9-10-year olds and 11-12-year olds, demonstrating facilitation in children, but which continued to develop over the pre-teen years. These data underline the sensitivity of early stages of processing to both top-down modulations and the parallel binding of non-spatial features in young children. Furthermore, facilitation effects, increased speed of processing when features need to be conjoined, mature in mid-childhood, arguing against a hierarchical model of visual processing, and supporting a rapid, integrated facilitative model.

Effects of Attentional Load on Auditory Scene Analysis

The effects of attention on the neural processes underlying auditory scene analysis were investigated through the manipulation of auditory task load. Participants were asked to focus their attention on tuned and mistuned stimuli presented to one ear and to ignore similar stimuli presented to the other ear. For both tuned and mistuned sounds, long (standard) and shorter (deviant) duration stimuli were presented in both ears. Auditory task load was manipulated by varying task instructions. In the easier condition, participants were asked to press a button for deviant sounds (target) at the attended location, irrespective of tuning. In the harder condition, participants were further asked to identify whether the targets were tuned or mistuned. Participants were faster in detecting targets defined by duration only than by both duration and tuning. At the unattended location, deviant stimuli generated a mismatch negativity wave at frontocentral sites whose amplitude decreased with increasing task demand. In comparison, standard mistuned stimuli generated an object-related negativity at central sites whose amplitude was not affected by task difficulty. These results show that the processing of sound sequences is differentially affected by attentional load than is the processing of sounds that occur simultaneously (i.e., sequential vs. simultaneous grouping processes), and that they each recruit distinct neural networks.

Auditory selective attention in young and elderly adults: the selection of single versus conjoint features

The effects of aging on the behavioral and neurophysiological correlates of auditory selective attention were investigated when selection was between either unidimensional or multidimensional stimuli. Attentional processes were studied by recording event-related brain potentials (ERPs) from 16 young (M = 22 years) and 16 elderly adults (M = 74 years) while they detected target tones based on a single location cue or a conjunction of location and pitch cues. Performance declined from the single- to the conjoint-cue task for both age groups but more so for the elderly. The ERP data showed that both age groups used a hierarchical processing strategy to perform the conjoint-cue task, but processing of the pitch dimension took longer for the elderly than for the young. The ERP data also showed that the scalp distribution of a late aspect of the waveform was more restricted in both anterior and posterior directions for the elderly. This suggests that frontal-lobe dependent attentional processes may be less efficacious with aging.

Listening to polyphonic music recruits domain-general attention and working memory circuits

Polyphonic music combines multiple auditory streams to create complex auditory scenes, thus providing a tool for investigating the neural mechanisms that orient attention in natural auditory contexts. Across two fMRI experiments, we varied stimuli and task demands in order to identify the cortical areas that are activated during attentive listening to real music. In individual experiments and in a conjunction analysis of the two experiments, we found bilateral blood oxygen level dependent (BOLD) signal increases in temporal (the superior temporal gyrus), parietal (the intraparietal sulcus), and frontal (the precentral sulcus, the inferior frontal sulcus and gyrus, and the frontal operculum) areas during selective and global listening, as compared with passive rest without musical stimulation. Direct comparisons of the listening conditions showed significant differences between attending to single timbres (instruments) and attending across multiple instruments, although the patterns that were observed depended on the relative demands of the tasks being compared. The overall pattern of BOLD signal increases indicated that attentive listening to music recruits neural circuits underlying multiple forms of working memory, attention, semantic processing, target detection, and motor imagery. Thus, attentive listening to music appears to be enabled by areas that serve general functions, rather than by music-specific cortical modules.