1
|
Wikman P, Salmela V, Sjöblom E, Leminen M, Laine M, Alho K. Attention to audiovisual speech shapes neural processing through feedback-feedforward loops between different nodes of the speech network. PLoS Biol 2024; 22:e3002534. [PMID: 38466713 PMCID: PMC10957087 DOI: 10.1371/journal.pbio.3002534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 03/21/2024] [Accepted: 01/30/2024] [Indexed: 03/13/2024] Open
Abstract
Selective attention-related top-down modulation plays a significant role in separating relevant speech from irrelevant background speech when vocal attributes separating concurrent speakers are small and continuously evolving. Electrophysiological studies have shown that such top-down modulation enhances neural tracking of attended speech. Yet, the specific cortical regions involved remain unclear due to the limited spatial resolution of most electrophysiological techniques. To overcome such limitations, we collected both electroencephalography (EEG) (high temporal resolution) and functional magnetic resonance imaging (fMRI) (high spatial resolution), while human participants selectively attended to speakers in audiovisual scenes containing overlapping cocktail party speech. To utilise the advantages of the respective techniques, we analysed neural tracking of speech using the EEG data and performed representational dissimilarity-based EEG-fMRI fusion. We observed that attention enhanced neural tracking and modulated EEG correlates throughout the latencies studied. Further, attention-related enhancement of neural tracking fluctuated in predictable temporal profiles. We discuss how such temporal dynamics could arise from a combination of interactions between attention and prediction as well as plastic properties of the auditory cortex. EEG-fMRI fusion revealed attention-related iterative feedforward-feedback loops between hierarchically organised nodes of the ventral auditory object related processing stream. Our findings support models where attention facilitates dynamic neural changes in the auditory cortex, ultimately aiding discrimination of relevant sounds from irrelevant ones while conserving neural resources.
Collapse
Affiliation(s)
- Patrik Wikman
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
- Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University, Espoo, Finland
| | - Viljami Salmela
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
- Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University, Espoo, Finland
| | - Eetu Sjöblom
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
| | - Miika Leminen
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
- AI and Analytics Unit, Helsinki University Hospital, Helsinki, Finland
| | - Matti Laine
- Department of Psychology, Åbo Akademi University, Turku, Finland
| | - Kimmo Alho
- Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland
- Advanced Magnetic Imaging Centre, Aalto NeuroImaging, Aalto University, Espoo, Finland
| |
Collapse
|
2
|
Zhao M, Bonassi G, Guarnieri R, Pelosin E, Nieuwboer A, Avanzino L, Mantini D. A multi-step blind source separation approach for the attenuation of artifacts in mobile high-density electroencephalography data. J Neural Eng 2021; 18. [PMID: 34874319 DOI: 10.1088/1741-2552/ac4084] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Accepted: 12/06/2021] [Indexed: 11/12/2022]
Abstract
Objective.Electroencephalography (EEG) is a widely used technique to address research questions about brain functioning, from controlled laboratorial conditions to naturalistic environments. However, EEG data are affected by biological (e.g. ocular, myogenic) and non-biological (e.g. movement-related) artifacts, which-depending on their extent-may limit the interpretability of the study results. Blind source separation (BSS) approaches have demonstrated to be particularly promising for the attenuation of artifacts in high-density EEG (hdEEG) data. Previous EEG artifact removal studies suggested that it may not be optimal to use the same BSS method for different kinds of artifacts.Approach.In this study, we developed a novel multi-step BSS approach to optimize the attenuation of ocular, movement-related and myogenic artifacts from hdEEG data. For validation purposes, we used hdEEG data collected in a group of healthy participants in standing, slow-walking and fast-walking conditions. During part of the experiment, a series of tone bursts were used to evoke auditory responses. We quantified event-related potentials (ERPs) using hdEEG signals collected during an auditory stimulation, as well as the event-related desynchronization (ERD) by contrasting hdEEG signals collected in walking and standing conditions, without auditory stimulation. We compared the results obtained in terms of auditory ERP and motor-related ERD using the proposed multi-step BSS approach, with respect to two classically used single-step BSS approaches.Main results. The use of our approach yielded the lowest residual noise in the hdEEG data, and permitted to retrieve stronger and more reliable modulations of neural activity than alternative solutions. Overall, our study confirmed that the performance of BSS-based artifact removal can be improved by using specific BSS methods and parameters for different kinds of artifacts.Significance.Our technological solution supports a wider use of hdEEG-based source imaging in movement and rehabilitation studies, and contributes to the further development of mobile brain/body imaging applications.
Collapse
Affiliation(s)
- Mingqi Zhao
- Research Center for Motor Control and Neuroplasticity, KU Leuven, 3001 Leuven, Belgium
| | - Gaia Bonassi
- S.C. Medicina Fisica e Riabilitazione Ospedaliera, Azienda Sanitaria Locale Chiavarese, 16043 Chiavari, Italy
| | - Roberto Guarnieri
- Research Center for Motor Control and Neuroplasticity, KU Leuven, 3001 Leuven, Belgium.,Icometrix, 3012 Leuven, Belgium
| | - Elisa Pelosin
- Department of Neuroscience, Rehabilitation, Ophthalmology, Genetics and Maternal Child Health, University of Genova, 16132 Genova, Italy.,Ospedale Policlinico San Martino, IRCCS, 16132 Genoa, Italy
| | - Alice Nieuwboer
- Department of Rehabilitation Sciences, KU Leuven, 3001 Leuven, Belgium
| | - Laura Avanzino
- Ospedale Policlinico San Martino, IRCCS, 16132 Genoa, Italy.,Department of Experimental Medicine, Section of Human Physiology, University of Genoa, 16132 Genoa, Italy
| | - Dante Mantini
- Research Center for Motor Control and Neuroplasticity, KU Leuven, 3001 Leuven, Belgium.,Brain Imaging and Neural Dynamics Research Group, IRCCS San Camillo Hospital, 30126 Venice, Italy
| |
Collapse
|
3
|
Schröger E, Eimer M. Endogenous Covert Spatial Orienting in Audition Cost-Benefit Analyses of Reaction Times and Event related Potentials. ACTA ACUST UNITED AC 2018. [DOI: 10.1080/713755706] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
Abstract
The present study examines mechanisms of endogenous covert spatial orienting in audition as revealed by event-related brain potentials (ERPs) and reaction times (RTs). In one experimental condition, subjects were instructed to respond to any target tone irrespective of whether it was presented in a valid (spatially predictive cue), neutral (uninformative cue), or invalid (misleading cue) trial. In another experimental condition, only target tones presented at a cued position required a response—that is, subjects could completely ignore tones presented at the uncued ear. Cue validity had an effect on RT, which consisted in benefits for valid trials and in costs for invalid trials relative to the RTs in neutral trials. There were also distinct ERP effects of cue validity in the 100–300 msec time range. These ERP effects were enlarged in the condition in which uncued tones could be ignored. The effects of cue validity on RTs and ERPs demonstrated covert orienting in audition both for stimuli requiring an overt response and also for stimuli that did not require a behavioural response. It is argued that this attentional selection is located at intermediate stages of information processing, rather than at peripheral stages such as basic sensory-specific processing or response selection.
Collapse
|
4
|
Florin E, Vuvan D, Peretz I, Baillet S. Pre-target neural oscillations predict variability in the detection of small pitch changes. PLoS One 2017; 12:e0177836. [PMID: 28542644 PMCID: PMC5436812 DOI: 10.1371/journal.pone.0177836] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2017] [Accepted: 05/03/2017] [Indexed: 11/18/2022] Open
Abstract
Pitch discrimination is important for language or music processing. Previous studies indicate that auditory perception depends on pre-target neural activity. However, so far the pre-target electrophysiological conditions which enable the detection of small pitch changes are not well studied, but might yield important insights into pitch-processing. We used magnetoencephalography (MEG) source imaging to reveal the pre-target effects of successful auditory detection of small pitch deviations from a sequence of standard tones. Participants heard a sequence of four pure tones and had to determine whether the last target tone was different or identical to the first three standard sounds. We found that successful pitch change detection could be predicted from the amplitude of theta (4-8 Hz) oscillatory activity in the right inferior frontal gyrus (IFG) as well as beta (12-30 Hz) oscillatory activity in the right auditory cortex. These findings confirm and extend evidence for the involvement of theta as well as beta-band activity in auditory perception.
Collapse
Affiliation(s)
- Esther Florin
- McConnell Brain Imaging Center, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University Düsseldorf, Düsseldorf, Germany
| | - Dominique Vuvan
- Centre for Research on Brain, Language and Music, Montreal, Quebec, Canada
- Psychology Department, Skidmore College, Saratoga Springs, NY, United States of America
| | - Isabelle Peretz
- Centre for Research on Brain, Language and Music, Montreal, Quebec, Canada
- Department of Psychology, International Laboratory of Brain, Music, and Sound Research, University of Montreal, Montreal, Quebec, Canada
| | - Sylvain Baillet
- McConnell Brain Imaging Center, Montreal Neurological Institute, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
5
|
Source localization of an event-related potential marker of executive attention following mild traumatic brain injury. Neuroreport 2016; 26:903-7. [PMID: 26302255 DOI: 10.1097/wnr.0000000000000445] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Abstract
Recent research suggests that intact performance on an executive attention task after mild traumatic brain injury (mTBI) reflects functional adaptation within neural networks, rather than recovery of premorbid modes of information processing. However, it is unclear whether this compensation includes the recruitment of alternative neural processing resources. The current study used source localization analysis to determine the location and timing of activated brain areas involved in the generation of an event-related potential (ERP) component marker of executive attention in 10 adults with mTBI and in 10 matched healthy controls. In both groups the cerebral sources of the late processing negativity component of the ERP waveform elicited during the Paced Auditory Serial Addition Task were localized to the left ventrolateral prefrontal cortex and right dorsal anterior cingulate cortex. Timing of the dipole moments was consistent with previous reports of the relative contributions of subregions of the frontal cortex critically involved in aspects of executive attention control. Finally, whereas abnormal intensity of ERP activation has recently been related to the achievement of normal levels of performance after mTBI, abnormal sources of cerebral activation do not appear to be a feature of the compensatory response.
Collapse
|
6
|
Fitzroy AB, Sanders LD. Musical Meter Modulates the Allocation of Attention across Time. J Cogn Neurosci 2015; 27:2339-51. [PMID: 26284995 DOI: 10.1162/jocn_a_00862] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Dynamic attending theory predicts that attention is allocated hierarchically across time during processing of hierarchical rhythmic structures such as musical meter. ERP research demonstrates that attention to a moment in time modulates early auditory processing as evidenced by the amplitude of the first negative peak (N1) approximately 100 msec after sound onset. ERPs elicited by tones presented at times of high and low metric strength in short melodies were compared to test the hypothesis that hierarchically structured rhythms direct attention in a manner that modulates early perceptual processing. A more negative N1 was observed for metrically strong beats compared with metrically weak beats; this result provides electrophysiological evidence that hierarchical rhythms direct attention to metrically strong times during engaged listening. The N1 effect was observed only on fast tempo trials, suggesting that listeners more consistently invoke selective processing based on hierarchical rhythms when sounds are presented rapidly. The N1 effect was not modulated by musical expertise, indicating that the allocation of attention to metrically strong times is not dependent on extensive training. Additionally, changes in P2 amplitude and a late negativity were associated with metric strength under some conditions, indicating that multiple cognitive processes are associated with metric perception.
Collapse
Affiliation(s)
- Ahren B Fitzroy
- Northwestern University.,University of Massachusetts, Amherst
| | | |
Collapse
|
7
|
Zinchenko A, Kanske P, Obermeier C, Schröger E, Kotz SA. Emotion and goal-directed behavior: ERP evidence on cognitive and emotional conflict. Soc Cogn Affect Neurosci 2015; 10:1577-87. [PMID: 25925271 DOI: 10.1093/scan/nsv050] [Citation(s) in RCA: 72] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2014] [Accepted: 04/24/2015] [Indexed: 12/29/2022] Open
Abstract
Cognitive control supports goal-directed behavior by resolving conflict among opposing action tendencies. Emotion can trigger cognitive control processes, thus speeding up conflict processing when the target dimension of stimuli is emotional. However, it is unclear what role emotionality of the target dimension plays in the processing of emotional conflict (e.g. in irony). In two EEG experiments, we compared the influence of emotional valence of the target (emotional, neutral) in cognitive and emotional conflict processing. To maximally approximate real-life communication, we used audiovisual stimuli. Participants either categorized spoken vowels (cognitive conflict) or their emotional valence (emotional conflict), while visual information was congruent or incongruent. Emotional target dimension facilitated both cognitive and emotional conflict processing, as shown in a reduced reaction time conflict effect. In contrast, the N100 in the event-related potentials showed a conflict-specific reversal: the conflict effect was larger for emotional compared with neutral trials in cognitive conflict and smaller in emotional conflict. Additionally, domain-general conflict effects were observed in the P200 and N200 responses. The current findings confirm that emotions have a strong influence on cognitive and emotional conflict processing. They also highlight the complexity and heterogeneity of the interaction of emotion with different types of conflict.
Collapse
Affiliation(s)
- Artyom Zinchenko
- International Max Planck Research School on Neuroscience of Communication (IMPRS NeuroCom), Leipzig, Germany, Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany,
| | - Philipp Kanske
- Department of Social Neuroscience, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Christian Obermeier
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | | | - Sonja A Kotz
- Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany, School of Psychological Sciences, University of Manchester, Manchester M13 9PL, UK
| |
Collapse
|
8
|
Schröger E, Marzecová A, SanMiguel I. Attention and prediction in human audition: a lesson from cognitive psychophysiology. Eur J Neurosci 2015; 41:641-64. [PMID: 25728182 PMCID: PMC4402002 DOI: 10.1111/ejn.12816] [Citation(s) in RCA: 147] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2014] [Revised: 11/27/2014] [Accepted: 12/01/2014] [Indexed: 11/30/2022]
Abstract
Attention is a hypothetical mechanism in the service of perception that facilitates the processing of relevant information and inhibits the processing of irrelevant information. Prediction is a hypothetical mechanism in the service of perception that considers prior information when interpreting the sensorial input. Although both (attention and prediction) aid perception, they are rarely considered together. Auditory attention typically yields enhanced brain activity, whereas auditory prediction often results in attenuated brain responses. However, when strongly predicted sounds are omitted, brain responses to silence resemble those elicited by sounds. Studies jointly investigating attention and prediction revealed that these different mechanisms may interact, e.g. attention may magnify the processing differences between predicted and unpredicted sounds. Following the predictive coding theory, we suggest that prediction relates to predictions sent down from predictive models housed in higher levels of the processing hierarchy to lower levels and attention refers to gain modulation of the prediction error signal sent up to the higher level. As predictions encode contents and confidence in the sensory data, and as gain can be modulated by the intention of the listener and by the predictability of the input, various possibilities for interactions between attention and prediction can be unfolded. From this perspective, the traditional distinction between bottom-up/exogenous and top-down/endogenous driven attention can be revisited and the classic concepts of attentional gain and attentional trace can be integrated.
Collapse
Affiliation(s)
- Erich Schröger
- Institute for Psychology, BioCog - Cognitive and Biological Psychology, University of LeipzigNeumarkt 9-19, D-04109, Leipzig, Germany
| | - Anna Marzecová
- Institute for Psychology, BioCog - Cognitive and Biological Psychology, University of LeipzigNeumarkt 9-19, D-04109, Leipzig, Germany
| | - Iria SanMiguel
- Institute for Psychology, BioCog - Cognitive and Biological Psychology, University of LeipzigNeumarkt 9-19, D-04109, Leipzig, Germany
| |
Collapse
|
9
|
Mittag M, Inauri K, Huovilainen T, Leminen M, Salo E, Rinne T, Kujala T, Alho K. Attention effects on the processing of task-relevant and task-irrelevant speech sounds and letters. Front Neurosci 2013; 7:231. [PMID: 24348324 PMCID: PMC3847663 DOI: 10.3389/fnins.2013.00231] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2013] [Accepted: 11/16/2013] [Indexed: 11/21/2022] Open
Abstract
We used event-related brain potentials (ERPs) to study effects of selective attention on the processing of attended and unattended spoken syllables and letters. Participants were presented with syllables randomly occurring in the left or right ear and spoken by different voices and with a concurrent foveal stream of consonant letters written in darker or lighter fonts. During auditory phonological (AP) and non-phonological tasks, they responded to syllables in a designated ear starting with a vowel and spoken by female voices, respectively. These syllables occurred infrequently among standard syllables starting with a consonant and spoken by male voices. During visual phonological and non-phonological tasks, they responded to consonant letters with names starting with a vowel and to letters written in dark fonts, respectively. These letters occurred infrequently among standard letters with names starting with a consonant and written in light fonts. To examine genuine effects of attention and task on ERPs not overlapped by ERPs associated with target processing or deviance detection, these effects were studied only in ERPs to auditory and visual standards. During selective listening to syllables in a designated ear, ERPs to the attended syllables were negatively displaced during both phonological and non-phonological auditory tasks. Selective attention to letters elicited an early negative displacement and a subsequent positive displacement (Pd) of ERPs to attended letters being larger during the visual phonological than non-phonological task suggesting a higher demand for attention during the visual phonological task. Active suppression of unattended speech during the AP and non-phonological tasks and during the visual phonological tasks was suggested by a rejection positivity (RP) to unattended syllables. We also found evidence for suppression of the processing of task-irrelevant visual stimuli in visual ERPs during auditory tasks involving left-ear syllables.
Collapse
Affiliation(s)
- Maria Mittag
- Cognitive Brain Research Unit, Cognitive Science, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland
| | - Karina Inauri
- Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland
| | - Tatu Huovilainen
- Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland
| | - Miika Leminen
- Cognitive Brain Research Unit, Cognitive Science, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland ; Finnish Centre of Excellence in Interdisciplinary Music Research, University of Jyväskylä Jyväskylä, Finland
| | - Emma Salo
- Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland
| | - Teemu Rinne
- Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland
| | - Teija Kujala
- Cognitive Brain Research Unit, Cognitive Science, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland ; Cicero Learning Network, University of Helsinki Helsinki, Finland
| | - Kimmo Alho
- Division of Cognitive Psychology and Neuropsychology, Institute of Behavioural Sciences, University of Helsinki Helsinki, Finland ; Helsinki Collegium for Advanced Studies, University of Helsinki Helsinki, Finland
| |
Collapse
|
10
|
Abstract
The challenge of understanding how the brain processes natural signals is compounded by the fact that such signals are often tied closely to specific natural behaviors and natural environments. This added complexity is especially true for auditory communication signals that can carry information at multiple hierarchical levels, and often occur in the context of other competing communication signals. Selective attention provides a mechanism to focus processing resources on specific components of auditory signals, and simultaneously suppress responses to unwanted signals or noise. Although selective auditory attention has been well-studied behaviorally, very little is known about how selective auditory attention shapes the processing on natural auditory signals, and how the mechanisms of auditory attention are implemented in single neurons or neural circuits. Here we review the role of selective attention in modulating auditory responses to complex natural stimuli in humans. We then suggest how the current understanding can be applied to the study of selective auditory attention in the context natural signal processing at the level of single neurons and populations in animal models amenable to invasive neuroscience techniques. This article is part of a Special Issue entitled "Communication Sounds and the Brain: New Directions and Perspectives".
Collapse
|
11
|
Jones A, Hughes G, Waszak F. The interaction between attention and motor prediction. An ERP study. Neuroimage 2013; 83:533-41. [PMID: 23850467 DOI: 10.1016/j.neuroimage.2013.07.004] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2013] [Revised: 06/07/2013] [Accepted: 07/02/2013] [Indexed: 11/18/2022] Open
Abstract
Performing a voluntary action involves the anticipation of the intended effect of that action. Interaction with the environment also requires the allocation of attention. However, the effects of attention upon motor predictive processes remain unclear. Here we use a novel paradigm to investigate attention and motor prediction orthogonally. In an acquisition phase, high and low tones were associated with left and right key presses. In the following test phase, tones were presented at random and participants attended to only one ear whilst ignoring tones presented in the unattended ear. In the test phase a tone could therefore be presented at the attended or unattended ear, as well as being congruent or incongruent with prior action-effect learning. We demonstrated early and late effects of attention as well as a later independent motor prediction effect with a larger P3a for incongruent tones. Interestingly, we demonstrated an intermediate interaction, showing an action-effect negativity (NAE) for tones which were unattended, whilst no motor prediction effect was found for attended tones. This interaction pattern suggests that attention and motor prediction are not opposing processes but can both operate to modulate prediction, providing valuable new insight into the relationship between attention and the effects of motor prediction.
Collapse
Affiliation(s)
- Alexander Jones
- Université Paris Descartes, Sorbonne Paris Cité, Paris, France; CNRS (Laboratoire Psychologie de la Perception, UMR 8158), Paris, France.
| | | | | |
Collapse
|
12
|
Lange K. The ups and downs of temporal orienting: a review of auditory temporal orienting studies and a model associating the heterogeneous findings on the auditory N1 with opposite effects of attention and prediction. Front Hum Neurosci 2013; 7:263. [PMID: 23781186 PMCID: PMC3678089 DOI: 10.3389/fnhum.2013.00263] [Citation(s) in RCA: 89] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2013] [Accepted: 05/23/2013] [Indexed: 11/13/2022] Open
Abstract
The temporal orienting of attention refers to the process of focusing (neural) resources on a particular time point in order to boost the processing of and the responding to sensory events. Temporal attention is manipulated by varying the task-relevance of events at different time points or by inducing expectations that an event occurs at a particular time point. Notably, the electrophysiological correlates of these manipulations at early processing stages are not identical: Auditory studies operationalizing temporal attention through task-relevance consistently found enhancements of early, sensory processing, as shown in the N1 component of the auditory event-related potential (ERP). By contrast, previous work on temporal orienting based on expectations showed mixed results: early, sensory processing was either enhanced or attenuated or not affected at all. In the present work, I will review existing findings on temporal orienting with a special focus on the auditory modality and present a working model to reconcile the previously heterogeneous results. Specifically, I will suggest that when expectations are used to manipulate attention, this will lead both to an orienting of attention and to the generation of precise predictions about the upcoming event. Attention and prediction are assumed to have opposite effects on early auditory processing, with temporal attention increasing and temporal predictions decreasing the associated ERP correlate, the auditory N1. The heterogeneous findings of studies manipulating temporal orienting by inducing expectations may thus be the consequence of differences in the relative contribution of attention and prediction processes. The model's predictions will be discussed in the context of a functional interpretation of the auditory N1 as an attention call signal, as presented in a recent model on auditory processing.
Collapse
Affiliation(s)
- Kathrin Lange
- Institut für Experimentelle Psychologie, Heinrich-Heine-Universität Düsseldorf Düsseldorf, Germany
| |
Collapse
|
13
|
Timm J, SanMiguel I, Saupe K, Schröger E. The N1-suppression effect for self-initiated sounds is independent of attention. BMC Neurosci 2013; 14:2. [PMID: 23281832 PMCID: PMC3573961 DOI: 10.1186/1471-2202-14-2] [Citation(s) in RCA: 77] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2012] [Accepted: 12/29/2012] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND If we initiate a sound by our own motor behavior, the N1 component of the auditory event-related brain potential (ERP) that the sound elicits is attenuated compared to the N1 elicited by the same sound when it is initiated externally. It has been suggested that this N1 suppression results from an internal predictive mechanism that is in the service of discriminating the sensory consequences of one's own actions from other sensory input. As the N1-suppression effect is becoming a popular approach to investigate predictive processing in cognitive and social neuroscience, it is important to exclude an alternative interpretation not related to prediction. According to the attentional account, the N1 suppression is due to a difference in the allocation of attention between self- and externally-initiated sounds. To test this hypothesis, we manipulated the allocation of attention to the sounds in different blocks: Attention was directed either to the sounds, to the own motor acts or to visual stimuli. If attention causes the N1-suppression effect, then manipulating attention should affect the effect for self-initiated sounds. RESULTS We found N1 suppression in all conditions. The N1 per se was affected by attention, but there was no interaction between attention and self-initiation effects. This implies that self-initiation N1 effects are not caused by attention. CONCLUSIONS The present results support the assumption that the N1-suppression effect for self-initiated sounds indicates the operation of an internal predictive mechanism. Furthermore, while attention had an influence on the N1a, N1b, and N1c components, the N1-suppression effect was confined to the N1b and N1c subcomponents suggesting that the major contribution to the auditory N1-suppression effect is circumscribed to late N1 components.
Collapse
Affiliation(s)
- Jana Timm
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| | - Iria SanMiguel
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| | - Katja Saupe
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| | - Erich Schröger
- Institute of Psychology, University of Leipzig, Seeburgstr. 14-20, Leipzig, D-04103, Germany
| |
Collapse
|
14
|
Lange K. The N1 effect of temporal attention is independent of sound location and intensity: implications for possible mechanisms of temporal attention. Psychophysiology 2012; 49:1468-80. [PMID: 23046461 DOI: 10.1111/j.1469-8986.2012.01460.x] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2012] [Accepted: 07/18/2012] [Indexed: 11/28/2022]
Abstract
It has been repeatedly shown that the auditory N1 is enhanced for sounds presented at an attended time point. The present study investigated the underlying mechanisms using a temporal cuing paradigm. In each trial, an auditory cue indicated at which time point a second sound could be relevant for response selection. Crucially, in addition to temporal attention, two physical sound features with known effects on the sensory N1 were manipulated: location and intensity. Positive evidence for conjoint effects of attention and location or attention and intensity would corroborate the notion that the sensory N1 was modulated by temporal attention, thus supporting a gain mechanism. However, the N1 effect of temporal attention was not similarly lateralized as the sensory N1, and, moreover, it was independent of sound intensity. Thus, the present results do not provide compelling evidence that temporal attention involves an increase in sensory gain.
Collapse
Affiliation(s)
- Kathrin Lange
- Institut für Experimentelle Psychologie, Heinrich Heine Universität Düsseldorf, Düsseldorf, Germany.
| |
Collapse
|
15
|
Stimulus-focused attention speeds up auditory processing. Int J Psychophysiol 2012; 84:155-63. [PMID: 22326595 DOI: 10.1016/j.ijpsycho.2012.02.001] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2011] [Revised: 01/31/2012] [Accepted: 02/01/2012] [Indexed: 11/23/2022]
|
16
|
|
17
|
|
18
|
|
19
|
|
20
|
|
21
|
|
22
|
|
23
|
|
24
|
|
25
|
|
26
|
|
27
|
|
28
|
The role of attention in auditory information processing as revealed by event-related potentials and other brain measures of cognitive function. Behav Brain Sci 2011. [DOI: 10.1017/s0140525x00078407] [Citation(s) in RCA: 1195] [Impact Index Per Article: 91.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
AbstractThis article examines the role of attention and automaticity in auditory processing as revealed by event-related potential (ERP) research. An ERP component called the mismatch negativity, generated by the brain's automatic response to changes in repetitive auditory input, reveals that physical features of auditory stimuli are fully processed whether or not they are attended. It also suggests that there exist precise neuronal representations of the physical features of recent auditory stimuli, perhaps the traces underlying acoustic sensory (“echoic”) memory. A mechanism of passive attention switching in response to changes in repetitive input is also implicated.Conscious perception of discrete acoustic stimuli might be mediated by some of the mechanisms underlying another ERP component (NI), one sensitive to stimulus onset and offset. Frequent passive attentional shifts might accountforthe effect cognitive psychologists describe as “the breakthrough of the unattended” (Broadbent 1982), that is, that even unattended stimuli may be semantically processed, without assuming automatic semantic processing or late selection in selective attention.The processing negativity supports the early-selection theory and may arise from a mechanism for selectively attending to stimuli defined by certain features. This stimulus selection occurs in the form ofa matching process in which each input is compared with the “attentional trace,” a voluntarily maintained representation of the task-relevant features of the stimulus to be attended. The attentional mechanism described might underlie the stimulus-set mode of attention proposed by Broadbent. Finally, a model of automatic and attentional processing in audition is proposed that is based mainly on the aforementioned ERP components and some other physiological measures.
Collapse
|
29
|
|
30
|
|
31
|
|
32
|
|
33
|
|
34
|
|
35
|
|
36
|
|
37
|
|
38
|
|
39
|
|
40
|
|
41
|
|
42
|
Effects of temporal trial-by-trial cuing on early and late stages of auditory processing: Evidence from event-related potentials. Atten Percept Psychophys 2011; 73:1916-33. [DOI: 10.3758/s13414-011-0149-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
43
|
Bomba MD, Singhal A. ERP evidence of early cross-modal links between auditory selective attention and visuo-spatial memory. Brain Cogn 2010; 74:273-80. [PMID: 20950919 DOI: 10.1016/j.bandc.2010.08.007] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2009] [Revised: 08/10/2010] [Accepted: 08/20/2010] [Indexed: 10/18/2022]
Abstract
Previous dual-task research pairing complex visual tasks involving non-spatial cognitive processes during dichotic listening have shown effects on the late component (Ndl) of the negative difference selective attention waveform but no effects on the early (Nde) response suggesting that the Ndl, but not the Nde, is affected by non-spatial processing in a dual-task. Thus to further explore the nature of this dissociation and whether the Nd waveform is affected by spatial processing; fourteen adult participants performed auditory dichotic listening in conjunction with visuo-spatial memory in a cross-modal dual-task paradigm. The results showed that the visuo-spatial memory task decreased both the Nde and Ndl waveforms, and also attenuated P300 and increased its latency. This pattern of results suggests that: (1) the Nde reflects a memory trace that is shared with vision when the information is spatial in nature, and (2) P300 latency appears to be influenced by the discriminability of stimuli underlying the Nde and Ndl memory trace.
Collapse
Affiliation(s)
- Marie D Bomba
- Neurosciences and Mental Health Program, The Hospital for Sick Children, Canada
| | | |
Collapse
|
44
|
Chait M, de Cheveigné A, Poeppel D, Simon JZ. Neural dynamics of attending and ignoring in human auditory cortex. Neuropsychologia 2010; 48:3262-71. [PMID: 20633569 DOI: 10.1016/j.neuropsychologia.2010.07.007] [Citation(s) in RCA: 40] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2010] [Revised: 06/03/2010] [Accepted: 07/02/2010] [Indexed: 10/19/2022]
Abstract
Studies in all sensory modalities have demonstrated amplification of early brain responses to attended signals, but less is known about the processes by which listeners selectively ignore stimuli. Here we use MEG and a new paradigm to dissociate the effects of selectively attending, and ignoring in time. Two different tasks were performed successively on the same acoustic stimuli: triplets of tones (A, B, C) with noise-bursts interspersed between the triplets. In the COMPARE task subjects were instructed to respond when tones A and C were of same frequency. In the PASSIVE task they were instructed to respond as fast as possible to noise-bursts. COMPARE requires attending to A and C and actively ignoring tone B, but PASSIVE involves neither attending to nor ignoring the tones. The data were analyzed separately for frontal and auditory-cortical channels to independently address attentional effects on low-level sensory versus putative control processing. We observe the earliest attend/ignore effects as early as 100 ms post-stimulus onset in auditory cortex. These appear to be generated by modulation of exogenous (stimulus-driven) sensory evoked activity. Specifically related to ignoring, we demonstrate that active-ignoring-induced input inhibition involves early selection. We identified a sequence of early (<200 ms post-onset) auditory cortical effects, comprised of onset response attenuation and the emergence of an inhibitory response, and provide new, direct evidence that listeners actively ignoring a sound can reduce their stimulus related activity in auditory cortex by 100 ms after onset when this is required to execute specific behavioral objectives.
Collapse
|
45
|
Rimmele J, Jolsvai H, Sussman E. Auditory target detection is affected by implicit temporal and spatial expectations. J Cogn Neurosci 2010; 23:1136-47. [PMID: 20146603 DOI: 10.1162/jocn.2010.21437] [Citation(s) in RCA: 65] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Mechanisms of implicit spatial and temporal orienting were investigated by using a moving auditory stimulus. Expectations were set up implicitly, using the information inherent in the movement of a sound, directing attention to a specific moment in time with respect to a specific location. There were four conditions of expectation: temporal and spatial expectation; temporal expectation only; spatial expectation only; and no expectation. Event-related brain potentials were recorded while participants performed a go/no-go task, set up by anticipation of the reappearance of a target tone through a white noise band. Results showed that (1) temporal expectations alone speeded reaction time and increased response accuracy; and (2) implicit temporal expectations alone independently enhanced target detection at early processing stages, prior to motor response. This was reflected at stages of perceptual analysis, indexed by P1 and N1 components, as well as in task-related stages indexed by N2; and (3) spatial expectations had an effect at later response-related processing stages but only in combination with temporal expectations, indexed by the P3 component. Thus, the results, in addition to indicating a primary role for temporal orienting in audition, suggest that multiple mechanisms of attention interact in different phases of auditory target detection. Our results are consistent with the view from vision research that spatial and temporal attentional control is based on the activity of partly overlapping, and partly functionally specialized neural networks.
Collapse
|
46
|
Bidet-Caulet A, Mikyska C, Knight RT. Load effects in auditory selective attention: evidence for distinct facilitation and inhibition mechanisms. Neuroimage 2009; 50:277-84. [PMID: 20026231 DOI: 10.1016/j.neuroimage.2009.12.039] [Citation(s) in RCA: 29] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2009] [Revised: 12/02/2009] [Accepted: 12/08/2009] [Indexed: 10/20/2022] Open
Abstract
It is unknown whether facilitation and inhibition of stimulus processing represent one or two mechanisms in auditory attention. We performed electrophysiological experiments in humans to address these two competing hypothesis. Participants performed an attention task under low or high memory load. Facilitation and inhibition were measured by recording electrophysiological responses to attended and ignored sounds and comparing them to responses to these same sounds when attention was considered to be equally distributed towards all sounds. We observed two late frontally distributed components: a negative one in response to attended sounds, and a positive one to ignored sounds. These two frontally distributed responses had distinct timing and scalp topographies and were differentially affected by memory load. Taken together these results provide evidence that attention-mediated top-down control reflects the activity of distinct facilitation and inhibition mechanisms.
Collapse
Affiliation(s)
- Aurélie Bidet-Caulet
- Helen Wills Neuroscience Institute, University of California, Berkeley, 132 Barker Hall, Berkeley, CA 94720, USA.
| | | | | |
Collapse
|
47
|
Nahum M, Renvall H, Ahissar M. Dynamics of cortical responses to tone pairs in relation to task difficulty: a MEG study. Hum Brain Mapp 2009; 30:1592-604. [PMID: 18711706 DOI: 10.1002/hbm.20629] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022] Open
Abstract
We investigated the effect of task difficulty on the dynamics of auditory cortical responses. Whole-scalp magnetoencephalographic (MEG) signals were recorded while subjects performed a same/different frequency discrimination task on equiprobable tone pairs applied in blocks of five, which were separated by a 10 s intertrial interval. Task difficulty was manipulated by the interpair frequency difference. The manipulation of task difficulty affected the amplitude of the N100m response to the first tone and the latency of the N100m response to the second tone in each pair. The N100m responses were smaller and peaked significantly later in the difficult than in the easy condition. The later processing field (PF) responses were longer in duration in the difficult condition. In both conditions, the duration of the PF response was negatively correlated with the subject's performance in the task, and was longer in the less successful subjects. The PF response may thus reflect the subjects' effort to resolve the task. The N100m and the PF responses did not differ between the tone pairs along the five-pair trial as a function of task difficulty, suggesting that changes in response along the five-pair trial are not easily affected by high-level manipulations.
Collapse
Affiliation(s)
- Mor Nahum
- Interdisciplinary Center for Neural Computation, Hebrew University, Mt. Scopus, Jerusalem, Israel.
| | | | | |
Collapse
|
48
|
Saupe K, Widmann A, Bendixen A, Müller MM, Schröger E. Effects of intermodal attention on the auditory steady-state response and the event-related potential. Psychophysiology 2009; 46:321-7. [PMID: 19207194 DOI: 10.1111/j.1469-8986.2008.00765.x] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
The aim of the present study was to simultaneously measure and compare intermodal attention effects in event-related brain potentials (ERPs) and auditory steady-state responses (ASSRs). For this purpose, 40-Hz amplitude modulated tones and a visual fixation cross were presented concurrently. By means of target detection tasks either on the sounds or on the fixation cross, participants' attention was directed to the respective modality. Attended sounds elicited a negative difference (Nd) in the ERP relative to unattended sounds. Nd was divided into an early and a late part as often observed for intramodal attention. Moreover, attention to the sounds led to a significant enhancement of the ASSR. This modulation of the ASSR by intermodal attention is demonstrated for the first time in the EEG. The present data suggest that ASSRs could provide a useful tool for the investigation of the neural dynamics of intermodal attentional processes.
Collapse
Affiliation(s)
- Katja Saupe
- Institute of Psychology I, University of Leipzig, Leipzig, Germany.
| | | | | | | | | |
Collapse
|
49
|
Degerman A, Rinne T, Särkkä AK, Salmi J, Alho K. Selective attention to sound location or pitch studied with event-related brain potentials and magnetic fields. Eur J Neurosci 2008; 27:3329-41. [PMID: 18598270 DOI: 10.1111/j.1460-9568.2008.06286.x] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Event-related brain potentials (ERPs) and magnetic fields (ERFs) were used to compare brain activity associated with selective attention to sound location or pitch in humans. Sixteen healthy adults participated in the ERP experiment, and 11 adults in the ERF experiment. In different conditions, the participants focused their attention on a designated sound location or pitch, or pictures presented on a screen, in order to detect target sounds or pictures among the attended stimuli. In the Attend Location condition, the location of sounds varied randomly (left or right), while their pitch (high or low) was kept constant. In the Attend Pitch condition, sounds of varying pitch (high or low) were presented at a constant location (left or right). Consistent with previous ERP results, selective attention to either sound feature produced a negative difference (Nd) between ERPs to attended and unattended sounds. In addition, ERPs showed a more posterior scalp distribution for the location-related Nd than for the pitch-related Nd, suggesting partially different generators for these Nds. The ERF source analyses found no source distribution differences between the pitch-related Ndm (the magnetic counterpart of the Nd) and location-related Ndm in the superior temporal cortex (STC), where the main sources of the Ndm effects are thought to be located. Thus, the ERP scalp distribution differences between the location-related and pitch-related Nd effects may have been caused by activity of areas outside the STC, perhaps in the inferior parietal regions.
Collapse
|
50
|
Salmi J, Rinne T, Degerman A, Alho K. Orienting and maintenance of spatial attention in audition and vision: an event-related brain potential study. Eur J Neurosci 2007; 25:3725-33. [PMID: 17610592 DOI: 10.1111/j.1460-9568.2007.05616.x] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
We examined the effects of orienting and maintenance of attention on performance and event-related brain potentials (ERPs) in audition and vision. Our subjects selectively attended to sounds or pictures in one location (Maintenance of attention) or alternated the focus of their auditory or visual attention between left and right locations (Orienting of attention) in order to detect and press a response button to infrequent targets among the attended stimuli. Reaction times were longer in the Auditory Orienting condition and hit rates were lower and false alarm rates higher in the Visual Orienting condition than in the corresponding Maintenance conditions. Comparison of ERPs to the attended and unattended stimuli in the Auditory and Visual Orienting and Maintenance conditions revealed attention-related modulations of ERPs. In each modality, ERPs to attended stimuli were negatively displaced in relation to unattended stimuli at 100-250 ms from stimulus onset. These negative differences (Nds) showed modality-specific distributions and they were larger over the hemisphere contralateral to the attended sounds and pictures than over the ipsilateral hemisphere. Moreover, the Nd was larger in the Auditory Orienting condition than in the Auditory Maintenance condition, while no such difference was observed in the visual modality. In addition to the Nd, attended visual stimuli elicited a late positive response (LPR) in both Orienting and Maintenance conditions. In contrast to our recent functional magnetic resonance imaging (fMRI) study employing the same experimental paradigm and indicating orienting-related activity in the frontal and parietal cortices, no ERP responses specifically related to orienting were found in either modality.
Collapse
Affiliation(s)
- Juha Salmi
- Department of Psychology, University of Helsinki, Finland.
| | | | | | | |
Collapse
|