1
|
Maack MC, Ostrowski J, Rose M. The order of multisensory associative sequences is reinstated as context feature during successful recognition. Sci Rep 2025; 15:18120. [PMID: 40413194 PMCID: PMC12103560 DOI: 10.1038/s41598-025-02553-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Accepted: 05/14/2025] [Indexed: 05/27/2025] Open
Abstract
The ability of the human brain to encode and recognize sequential information from different sensory modalities is key to memory formation. The sequence in which these modalities are presented during encoding critically affects recognition. This study investigates the encoding of sensory modality sequences and its neural impact on recognition using multivariate pattern analysis (MVPA) of oscillatory EEG activity. We examined the reinstatement of multisensory episode-specific sequences in n = 32 participants who encoded sound-image associations (e.g., the image of a ship with the sound of a frog). Images and sounds were natural scenes and 2-second real-life sounds, presented sequentially during encoding. During recognition, stimulus pairs were presented simultaneously, and classification was used to test whether the modality sequence order could be decoded as a contextual feature in memory. Oscillatory results identified a distinct neural signature during successful retrieval, associated with the original modality sequence. Furthermore, MVPA successfully decoded neural patterns of different modality sequences, hinting at specific memory traces. These findings suggest that the sequence in which sensory modalities are encoded forms a neural signature, affecting later recognition. This study provides novel insights into the relationship between modality encoding and recognition, with broad implications for cognitive neuroscience and memory research.
Collapse
Affiliation(s)
- Marike Christiane Maack
- Department of Systems Neuroscience, University Medical Center Hamburg‑Eppendorf, Martinistr. 52, Building W34, 20248, Hamburg, Germany
| | - Jan Ostrowski
- Department of Systems Neuroscience, University Medical Center Hamburg‑Eppendorf, Martinistr. 52, Building W34, 20248, Hamburg, Germany
| | - Michael Rose
- Department of Systems Neuroscience, University Medical Center Hamburg‑Eppendorf, Martinistr. 52, Building W34, 20248, Hamburg, Germany.
| |
Collapse
|
2
|
Koenig L, He BJ. Spontaneous slow cortical potentials and brain oscillations independently influence conscious visual perception. PLoS Biol 2025; 23:e3002964. [PMID: 39820589 PMCID: PMC11737857 DOI: 10.1371/journal.pbio.3002964] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 12/03/2024] [Indexed: 01/19/2025] Open
Abstract
Perceptual awareness results from an intricate interaction between external sensory input and the brain's spontaneous activity. Pre-stimulus ongoing activity influencing conscious perception includes both brain oscillations in the alpha (7 to 14 Hz) and beta (14 to 30 Hz) frequency ranges and aperiodic activity in the slow cortical potential (SCP, <5 Hz) range. However, whether brain oscillations and SCPs independently influence conscious perception or do so through shared mechanisms remains unknown. Here, we addressed this question in 2 independent magnetoencephalography (MEG) data sets involving near-threshold visual perception tasks in humans using low-level (Gabor patches) and high-level (objects, faces, houses, animals) stimuli, respectively. We found that oscillatory power and large-scale SCP activity influence conscious perception through independent mechanisms that do not have shared variance. In addition, through mediation analysis, we show that pre-stimulus oscillatory power and SCP activity have different relations to pupil size-an index of arousal-in their influences on conscious perception. Together, these findings suggest that oscillatory power and SCPs independently contribute to perceptual awareness, with distinct relations to pupil-linked arousal.
Collapse
Affiliation(s)
- Lua Koenig
- Neuroscience Institute, New York University Grossman School of Medicine, New York, New York, United States of America
| | - Biyu J. He
- Neuroscience Institute, New York University Grossman School of Medicine, New York, New York, United States of America
- Departments of Neurology, Neuroscience & Physiology, Radiology, New York University Grossman School of Medicine, New York, New York, United States of America
- Department of Biomedical Engineering, New York University Tandon School of Engineering, New York, New York, United States of America
| |
Collapse
|
3
|
Mäki-Marttunen V, Velinov A, Nieuwenhuis S. Strength of Low-Frequency EEG Phase Entrainment to External Stimuli Is Associated with Fluctuations in the Brain's Internal State. eNeuro 2025; 12:ENEURO.0064-24.2024. [PMID: 39779324 PMCID: PMC11772043 DOI: 10.1523/eneuro.0064-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2024] [Revised: 09/05/2024] [Accepted: 11/15/2024] [Indexed: 01/11/2025] Open
Abstract
The brain attends to environmental rhythms by aligning the phase of internal oscillations. However, the factors underlying fluctuations in the strength of this phase entrainment remain largely unknown. In the present study, we examined whether the strength of low-frequency electroencephalography (EEG) phase entrainment to rhythmic stimulus sequences varied with the pupil size and posterior alpha-band power, thought to reflect the arousal level and excitability of posterior cortical brain areas, respectively. We recorded the pupil size and scalp EEG while participants carried out an intermodal selective attention task, in which they were instructed to attend to a rhythmic sequence of visual or auditory stimuli and ignore the other perceptual modality. As expected, intertrial phase coherence (ITC), a measure of entrainment strength, was larger for the task-relevant than for the task-irrelevant modality. Across the experiment, the pupil size and posterior alpha power were strongly linked with each other. Interestingly, ITC tracked both variables: larger pupil size was associated with a selective increase in entrainment to the task-relevant stimulus sequence, whereas larger posterior alpha power was associated with a decrease in phase entrainment to both the task-relevant and task-irrelevant stimulus sequences. Exploratory analyses showed that a temporal relation between ITC and posterior alpha power emerged in the time periods around pupil maxima and pupil minima. These results indicate that endogenous sources contribute distinctly to the fluctuations of EEG phase entrainment.
Collapse
Affiliation(s)
- Verónica Mäki-Marttunen
- Cognitive Psychology Unit, Faculty of Social Sciences, Leiden University, Leiden, Alaska 2333, The Netherlands
| | - Alexandra Velinov
- Cognitive Psychology Unit, Faculty of Social Sciences, Leiden University, Leiden, Alaska 2333, The Netherlands
| | - Sander Nieuwenhuis
- Cognitive Psychology Unit, Faculty of Social Sciences, Leiden University, Leiden, Alaska 2333, The Netherlands
| |
Collapse
|
4
|
Williams JG, Harrison WJ, Beale HA, Mattingley JB, Harris AM. Effects of neural oscillation power and phase on discrimination performance in a visual tilt illusion. Curr Biol 2024; 34:1801-1809.e4. [PMID: 38569544 DOI: 10.1016/j.cub.2024.03.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2023] [Revised: 01/25/2024] [Accepted: 03/12/2024] [Indexed: 04/05/2024]
Abstract
Neural oscillations reflect fluctuations in the relative excitation/inhibition of neural systems1,2,3,4,5 and are theorized to play a critical role in canonical neural computations6,7,8,9 and cognitive processes.10,11,12,13,14 These theories have been supported by findings that detection of visual stimuli fluctuates with the phase of oscillations prior to stimulus onset.15,16,17,18,19,20,21,22,23 However, null results have emerged in studies seeking to demonstrate these effects in visual discrimination tasks,24,25,26,27 raising questions about the generalizability of these phenomena to wider neural processes. Recently, we suggested that methodological limitations may mask effects of phase in higher-level sensory processing.28 To test the generality of phasic influences on perception requires a task that involves stimulus discrimination while also depending on early sensory processing. Here, we examined the influence of oscillation phase on the visual tilt illusion, in which a center grating has its perceived orientation biased away from the orientation of a surround grating29 due to lateral inhibitory interactions in early visual processing.30,31,32 We presented center gratings at participants' subjective vertical angle and had participants report whether the grating appeared tilted clockwise or counterclockwise from vertical on each trial while measuring their brain activity with electroencephalography (EEG). In addition to effects of alpha power and aperiodic slope, we observed robust associations between orientation perception and alpha and theta phase, consistent with fluctuating illusion magnitude across the oscillatory cycle. These results confirm that oscillation phase affects the complex processing involved in stimulus discrimination, consistent with its purported role in canonical computations that underpin cognition.
Collapse
Affiliation(s)
- Jessica G Williams
- Queensland Brain Institute, The University of Queensland, Building 79, Upland Road, St Lucia, Brisbane, QLD 4072, Australia; School of Psychology, The University of Queensland, McElwain Building, Campbell Road, St Lucia, Brisbane, QLD 4072, Australia
| | - William J Harrison
- Queensland Brain Institute, The University of Queensland, Building 79, Upland Road, St Lucia, Brisbane, QLD 4072, Australia; School of Psychology, The University of Queensland, McElwain Building, Campbell Road, St Lucia, Brisbane, QLD 4072, Australia; School of Health, University of the Sunshine Coast, 90 Sippy Downs Drive, Sippy Downs, QLD 4556, Australia
| | - Henry A Beale
- Queensland Brain Institute, The University of Queensland, Building 79, Upland Road, St Lucia, Brisbane, QLD 4072, Australia
| | - Jason B Mattingley
- Queensland Brain Institute, The University of Queensland, Building 79, Upland Road, St Lucia, Brisbane, QLD 4072, Australia; School of Psychology, The University of Queensland, McElwain Building, Campbell Road, St Lucia, Brisbane, QLD 4072, Australia; Canadian Institute for Advanced Research (CIFAR), MaRS Centre, West Tower, 661 University Ave., Suite 505, Toronto, ON M5G 1M1, Canada
| | - Anthony M Harris
- Queensland Brain Institute, The University of Queensland, Building 79, Upland Road, St Lucia, Brisbane, QLD 4072, Australia.
| |
Collapse
|