1
|
Virk T, Letendre T, Pathman T. The convergence of naturalistic paradigms and cognitive neuroscience methods to investigate memory and its development. Neuropsychologia 2024; 196:108779. [PMID: 38154592 DOI: 10.1016/j.neuropsychologia.2023.108779] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 12/12/2023] [Accepted: 12/23/2023] [Indexed: 12/30/2023]
Abstract
Studies that involve lab-based stimuli (e.g., words, pictures) are fundamental in the memory literature. At the same time, there is growing acknowledgment that memory processes assessed in the lab may not be analogous to how memory operates in the real world. Naturalistic paradigms can bridge this gap and over the decades a growing proportion of memory research has involved more naturalistic events. However, there is significant variation in the types of naturalistic studies used to study memory and its development, each with various advantages and limitations. Further, there are notable gaps in how often different types of naturalistic approaches have been combined with cognitive neuroscience methods (e.g., fMRI, EEG) to elucidate the neural processes and substrates involved in memory encoding and retrieval in the real world. Here we summarize and discuss what we identify as progressively more naturalistic methodologies used in the memory literature (movie, virtual reality, staged-events inside and outside of the lab, photo-taking, and naturally occurring event studies). Our goal is to describe each approach's benefits (e.g., naturalistic quality, feasibility), limitations (e.g., viability of neuroimaging method for event encoding versus event retrieval), and discuss possible future directions with each approach. We focus on child studies, when available, but also highlight past adult studies. Although there is a growing body of child memory research, naturalistic approaches combined with cognitive neuroscience methodologies in this domain remain sparse. Overall, this viewpoint article reviews how we can study memory through the lens of developmental cognitive neuroscience, while utilizing naturalistic and real-world events.
Collapse
|
2
|
Areces-Gonzalez A, Paz-Linares D, Riaz U, Wang Y, Li M, Razzaq FA, Bosch-Bayard JF, Gonzalez-Moreira E, Ontivero-Ortega M, Galan-Garcia L, Martínez-Montes E, Minati L, Valdes-Sosa MJ, Bringas-Vega ML, Valdes-Sosa PA. CiftiStorm pipeline: facilitating reproducible EEG/MEG source connectomics. Front Neurosci 2024; 18:1237245. [PMID: 38680452 PMCID: PMC11047451 DOI: 10.3389/fnins.2024.1237245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Accepted: 02/22/2024] [Indexed: 05/01/2024] Open
Abstract
We present CiftiStorm, an electrophysiological source imaging (ESI) pipeline incorporating recently developed methods to improve forward and inverse solutions. The CiftiStorm pipeline produces Human Connectome Project (HCP) and megconnectome-compliant outputs from dataset inputs with varying degrees of spatial resolution. The input data can range from low-sensor-density electroencephalogram (EEG) or magnetoencephalogram (MEG) recordings without structural magnetic resonance imaging (sMRI) to high-density EEG/MEG recordings with an HCP multimodal sMRI compliant protocol. CiftiStorm introduces a numerical quality control of the lead field and geometrical corrections to the head and source models for forward modeling. For the inverse modeling, we present a Bayesian estimation of the cross-spectrum of sources based on multiple priors. We facilitate ESI in the T1w/FSAverage32k high-resolution space obtained from individual sMRI. We validate this feature by comparing CiftiStorm outputs for EEG and MRI data from the Cuban Human Brain Mapping Project (CHBMP) acquired with technologies a decade before the HCP MEG and MRI standardized dataset.
Collapse
Affiliation(s)
- Ariosky Areces-Gonzalez
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
- School of Technical Sciences, University “Hermanos Saiz Montes de Oca” of Pinar del Río, Pinar del Rio, Cuba
| | - Deirel Paz-Linares
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
- Department of Neuroinformatics, Cuban Neurosciences Center, Havana, Cuba
| | - Usama Riaz
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Ying Wang
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Min Li
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
- Hangzhou Dianzi University, Hangzhou, Zhejiang, China
| | - Fuleah A. Razzaq
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Jorge F. Bosch-Bayard
- McGill Centre for Integrative Neurosciences MCIN, LudmerCentre for Mental Health, Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Eduardo Gonzalez-Moreira
- Center for Biomedical Imaging and Neuromodulation, Nathan Kline Institute for Psychiatric Research, Orangeburg, NY, United States
| | | | | | | | - Marlis Ontivero-Ortega
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
- Department of Neuroinformatics, Cuban Neurosciences Center, Havana, Cuba
| | | | | | - Ludovico Minati
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy
| | | | - Maria L. Bringas-Vega
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
- Department of Neuroinformatics, Cuban Neurosciences Center, Havana, Cuba
| | - Pedro A. Valdes-Sosa
- The Clinical Hospital of Chengdu Brain Sciences Institute, School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
- Department of Neuroinformatics, Cuban Neurosciences Center, Havana, Cuba
| |
Collapse
|
3
|
Kluge A, Somila N, Lankinen K, Levy J. Neural alignment during outgroup intervention predicts future change of affect towards outgroup. Cereb Cortex 2024; 34:bhae125. [PMID: 38566512 PMCID: PMC10988024 DOI: 10.1093/cercor/bhae125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Revised: 03/08/2024] [Accepted: 03/09/2024] [Indexed: 04/04/2024] Open
Abstract
While social psychology studies have shown that paradoxical thinking intervention has a moderating effect on negative attitudes toward members from rival social groups (i.e. outgroup), the neural underpinnings of the intervention have not been studied. Here, we investigate this by examining neural alignment across individuals at different phases during the intervention regarding Covid-19 vaccine-supporters' attitudes against vaccine-opposers. We raise two questions: Whether neural alignment varies during the intervention, and whether it predicts a change in outgroup attitudes measured via a survey 2 days after the intervention and compared to baseline. We test the neural alignment using magnetoencephalography-recorded neural oscillations and multiset canonical correlation analysis. We find a build-up of neural alignment which emerges at the final phase of the paradoxical thinking intervention in the precuneus-a hub of mentalizing; there was no such effect in the control conditions. In parallel, we find a behavioral build-up of dissent to the interventional stimuli. These neural and behavioral patterns predict a prosocial future change in affect and actions toward the outgroup. Together, these findings reveal a new operational pattern of mentalizing on the outgroup, which can change the way individuals may feel and behave toward members of that outgroup.
Collapse
Affiliation(s)
- Annika Kluge
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo 02150, Finland
| | - Niko Somila
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo 02150, Finland
| | - Kaisu Lankinen
- Athinoula A. Martinos Center for Biomedical Imaging, Department of Radiology, Massachusetts General Hospital, Boston, MA 02114, USA
- Department of Radiology, Harvard Medical School, Boston, MA 02115, USA
| | - Jonathan Levy
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo 02150, Finland
- Department of Criminology and Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan 5290002, Israel
| |
Collapse
|
4
|
Türker B, Belloli L, Owen AM, Naci L, Sitt JD. Processing of the same narrative stimuli elicits common functional connectivity dynamics between individuals. Sci Rep 2023; 13:21260. [PMID: 38040845 PMCID: PMC10692174 DOI: 10.1038/s41598-023-48656-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2023] [Accepted: 11/29/2023] [Indexed: 12/03/2023] Open
Abstract
It has been suggested that conscious experience is linked to the richness of brain state repertories, which change in response to environmental and internal stimuli. High-level sensory stimulation has been shown to alter local brain activity and induce neural synchrony across participants. However, the dynamic interplay of cognitive processes underlying moment-to-moment information processing remains poorly understood. Using naturalistic movies as an ecological laboratory model of the real world, here we investigate how the processing of complex naturalistic stimuli alters the dynamics of brain network interactions and how these in turn support information processing. Participants underwent fMRI recordings during movie watching, scrambled movie watching, and resting. By measuring the phase-synchrony between different brain networks, we analyzed whole-brain connectivity patterns. Our finding revealed distinct connectivity patterns associated with each experimental condition. We found higher synchronization of brain patterns across participants during movie watching compared to rest and scrambled movie conditions. Furthermore, synchronization levels increased during the most engaging parts of the movie. The synchronization dynamics among participants were associated with suspense; scenes with higher levels of suspense induced greater synchronization. These results suggest that processing the same high-level information elicits common neural dynamics across individuals, and that whole-brain functional connectivity tracks variations in processed information and subjective experience.
Collapse
Affiliation(s)
- Başak Türker
- Institut du Cerveau - Paris Brain Institute - ICM, Inserm, CNRS, Sorbonne Université, 75013, Paris, France.
| | - Laouen Belloli
- Institut du Cerveau - Paris Brain Institute - ICM, Inserm, CNRS, Sorbonne Université, 75013, Paris, France
- Instituto de Ciencias de la Computacion, CONICET-UBA, Buenos Aires, Argentina
| | - Adrian M Owen
- The Western Institute for Neuroscience, Western Interdisciplinary Research Building, University of Western Ontario, London, ON, N6A 5B7, Canada
| | - Lorina Naci
- Trinity College Institute of Neuroscience, School of Psychology, Trinity College Dublin, Lloyd Building, Dublin, Ireland
| | - Jacobo D Sitt
- Institut du Cerveau - Paris Brain Institute - ICM, Inserm, CNRS, Sorbonne Université, 75013, Paris, France.
| |
Collapse
|
5
|
Jangraw DC, Finn ES, Bandettini PA, Landi N, Sun H, Hoeft F, Chen G, Pugh KR, Molfese PJ. Inter-subject correlation during long narratives reveals widespread neural correlates of reading ability. Neuroimage 2023; 282:120390. [PMID: 37751811 PMCID: PMC10783814 DOI: 10.1016/j.neuroimage.2023.120390] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 09/19/2023] [Accepted: 09/23/2023] [Indexed: 09/28/2023] Open
Abstract
Recent work using fMRI inter-subject correlation analysis has provided new information about the brain's response to video and audio narratives, particularly in frontal regions not typically activated by single words. This approach is very well suited to the study of reading, where narrative is central to natural experience. But since past reading paradigms have primarily presented single words or phrases, the influence of narrative on semantic processing in the brain - and how that influence might change with reading ability - remains largely unexplored. In this study, we presented coherent stories to adolescents and young adults with a wide range of reading abilities. The stories were presented in alternating visual and auditory blocks. We used a dimensional inter-subject correlation analysis to identify regions in which better and worse readers had varying levels of consistency with other readers. This analysis identified a widespread set of brain regions in which activity timecourses were more similar among better readers than among worse readers. These differences were not detected with standard block activation analyses. Worse readers had higher correlation with better readers than with other worse readers, suggesting that the worse readers had "idiosyncratic" responses rather than using a single compensatory mechanism. Close inspection confirmed that these differences were not explained by differences in IQ or motion. These results suggest an expansion of the current view of where and how reading ability is reflected in the brain, and in doing so, they establish inter-subject correlation as a sensitive tool for future studies of reading disorders.
Collapse
Affiliation(s)
- David C Jangraw
- Section on Functional Imaging Methods, NIMH, Bethesda, MD, United States; Emotion and Development Branch, NIMH, Bethesda, MD, United States; Department of Electrical and Biomedical Engineering, University of Vermont, Burlington, VT, United States.
| | - Emily S Finn
- Section on Functional Imaging Methods, NIMH, Bethesda, MD, United States; Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, United States
| | - Peter A Bandettini
- Section on Functional Imaging Methods, NIMH, Bethesda, MD, United States; Center for Multimodal Neuroimaging, NIMH, Bethesda, MD, United States
| | - Nicole Landi
- Haskins Laboratories, New Haven, CT, United States
| | - Haorui Sun
- Department of Electrical and Biomedical Engineering, University of Vermont, Burlington, VT, United States
| | - Fumiko Hoeft
- Haskins Laboratories, New Haven, CT, United States; Department of Psychological Sciences, University of Connecticut, Hartford, CT, United States
| | - Gang Chen
- Statistical Computing Core, NIMH, Bethesda, MD, United States
| | - Kenneth R Pugh
- Haskins Laboratories, New Haven, CT, United States; Department of Pediatrics, Yale University School of Medicine, New Haven, CT, United States
| | - Peter J Molfese
- Center for Multimodal Neuroimaging, NIMH, Bethesda, MD, United States; Haskins Laboratories, New Haven, CT, United States
| |
Collapse
|
6
|
Kauttonen J, Paekivi S, Kauramäki J, Tikka P. Unraveling dyadic psycho-physiology of social presence between strangers during an audio drama - a signal-analysis approach. Front Psychol 2023; 14:1153968. [PMID: 37928563 PMCID: PMC10622809 DOI: 10.3389/fpsyg.2023.1153968] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Accepted: 10/04/2023] [Indexed: 11/07/2023] Open
Abstract
A mere co-presence of an unfamiliar person may modulate an individual's attentive engagement with specific events or situations to a significant degree. To understand better how such social presence affects experiences, we recorded a set of parallel multimodal facial and psychophysiological data with subjects (N = 36) who listened to dramatic audio scenes alone or when facing an unfamiliar person. Both a selection of 6 s affective sound clips (IADS-2) followed by a 27 min soundtrack extracted from a Finnish episode film depicted familiar and often intense social situations familiar from the everyday world. Considering the systemic complexity of both the chosen naturalistic stimuli and expected variations in the experimental social situation, we applied a novel combination of signal analysis methods using inter-subject correlation (ISC) analysis, Representational Similarity Analysis (RSA) and Recurrence Quantification Analysis (RQA) followed by gradient boosting classification. We report our findings concerning three facial signals, gaze, eyebrow and smile that can be linked to socially motivated facial movements. We found that ISC values of pairs, whether calculated on true pairs or any two individuals who had a partner, were lower than the group with single individuals. Thus, audio stimuli induced more unique responses in those subjects who were listening to it in the presence of another person, while individual listeners tended to yield a more uniform response as it was driven by dramatized audio stimulus alone. Furthermore, our classifiers models trained using recurrence properties of gaze, eyebrows and smile signals demonstrated distinctive differences in the recurrence dynamics of signals from paired subjects and revealed the impact of individual differences on the latter. We showed that the presence of an unfamiliar co-listener that modifies social dynamics of dyadic listening tasks can be detected reliably from visible facial modalities. By applying our analysis framework to a broader range of psycho-physiological data, together with annotations of the content, and subjective reports of participants, we expected more detailed dyadic dependencies to be revealed. Our work contributes towards modeling and predicting human social behaviors to specific types of audio-visually mediated, virtual, and live social situations.
Collapse
Affiliation(s)
- Janne Kauttonen
- Competences, RDI and Digitalization, Haaga-Helia University of Applied Sciences, Helsinki, Finland
- School of Arts, Design and Architecture, Aalto University, Espoo, Finland
- Aalto NeuroImaging, Aalto University, Espoo, Finland
| | - Sander Paekivi
- Max Planck Institute for the Physics of Complex Systems, Dresden, Germany
| | - Jaakko Kauramäki
- School of Arts, Design and Architecture, Aalto University, Espoo, Finland
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, Helsinki, Finland
- Cognitive Brain Research Unit, Faculty of Medicine, University of Helsinki, Helsinki, Finland
| | - Pia Tikka
- School of Arts, Design and Architecture, Aalto University, Espoo, Finland
- Enactive Virtuality Lab, Baltic Film, Media and Arts School (BFM), Centre of Excellence in Media Innovation and Digital Culture (MEDIT), Tallinn University, Tallinn, Estonia
| |
Collapse
|
7
|
de la Fuente LA, Zamberlan F, Bocaccio H, Kringelbach M, Deco G, Perl YS, Pallavicini C, Tagliazucchi E. Temporal irreversibility of neural dynamics as a signature of consciousness. Cereb Cortex 2023; 33:1856-1865. [PMID: 35512291 DOI: 10.1093/cercor/bhac177] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/19/2022] [Revised: 04/16/2022] [Accepted: 04/18/2022] [Indexed: 11/14/2022] Open
Abstract
Dissipative systems evolve in the preferred temporal direction indicated by the thermodynamic arrow of time. The fundamental nature of this temporal asymmetry led us to hypothesize its presence in the neural activity evoked by conscious perception of the physical world, and thus its covariance with the level of conscious awareness. We implemented a data-driven deep learning framework to decode the temporal inversion of electrocorticography signals acquired from non-human primates. Brain activity time series recorded during conscious wakefulness could be distinguished from their inverted counterparts with high accuracy, both using frequency and phase information. However, classification accuracy was reduced for data acquired during deep sleep and under ketamine-induced anesthesia; moreover, the predictions obtained from multiple independent neural networks were less consistent for sleep and anesthesia than for conscious wakefulness. Finally, the analysis of feature importance scores highlighted transitions between slow ($\approx$20 Hz) and fast frequencies (>40 Hz) as the main contributors to the temporal asymmetry observed during conscious wakefulness. Our results show that a preferred temporal direction is manifest in the neural activity evoked by conscious mentation and in the phenomenology of the passage of time, establishing common ground to tackle the relationship between brain and subjective experience.
Collapse
Affiliation(s)
- Laura Alethia de la Fuente
- Department of Physics, University of Buenos Aires 1428, Argentina.,Institute of Cognitive and Translational Neuroscience, INECO Foundation, Favaloro University, Buenos Aires 1058, Argentina.,National Scientific and Technical Research Council, Buenos Aires 1425, Argentina
| | - Federico Zamberlan
- Department of Physics, University of Buenos Aires 1428, Argentina.,National Scientific and Technical Research Council, Buenos Aires 1425, Argentina.,Cognitive Science and Artificial Intelligence Department, Tilburg University, Tilburg 5000, The Netherlands
| | - Hernán Bocaccio
- Department of Physics, University of Buenos Aires 1428, Argentina.,National Scientific and Technical Research Council, Buenos Aires 1425, Argentina
| | - Morten Kringelbach
- Centre for Eudaimonia and Human Flourishing, Linacre College, University of Oxford OX1, UK.,Department of Psychiatry, University of Oxford, Oxford OX3, UK.,Center for Music in the Brain, Department of Clinical Medicine, Aarhus University 8000, DK
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona 08018, Spain.,Institució Catalana de la Recerca i Estudis Avançats (ICREA), Barcelona 08010, Spain.,Department of Neuropsychology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig 04103, Germany.,School of Psychological Sciences, Monash University, Melbourne, Clayton VIC 3800, Australia
| | - Yonatan Sanz Perl
- Department of Physics, University of Buenos Aires 1428, Argentina.,Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Barcelona 08018, Spain
| | - Carla Pallavicini
- Department of Physics, University of Buenos Aires 1428, Argentina.,National Scientific and Technical Research Council, Buenos Aires 1425, Argentina
| | - Enzo Tagliazucchi
- Department of Physics, University of Buenos Aires 1428, Argentina.,National Scientific and Technical Research Council, Buenos Aires 1425, Argentina.,Latin American Brain Health Institute (BrainLat), Universidad Adolfo Ibanez, Santiago 7910000, Chile
| |
Collapse
|
8
|
Mononen T, Kujala J, Liljeström M, Leppäaho E, Kaski S, Salmelin R. The relationship between electrophysiological and hemodynamic measures of neural activity varies across picture naming tasks: A multimodal magnetoencephalography-functional magnetic resonance imaging study. Front Neurosci 2022; 16:1019572. [PMID: 36408411 PMCID: PMC9669574 DOI: 10.3389/fnins.2022.1019572] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 10/06/2022] [Indexed: 11/06/2022] Open
Abstract
Different neuroimaging methods can yield different views of task-dependent neural engagement. Studies examining the relationship between electromagnetic and hemodynamic measures have revealed correlated patterns across brain regions but the role of the applied stimulation or experimental tasks in these correlation patterns is still poorly understood. Here, we evaluated the across-tasks variability of MEG-fMRI relationship using data recorded during three distinct naming tasks (naming objects and actions from action images, and objects from object images), from the same set of participants. Our results demonstrate that the MEG-fMRI correlation pattern varies according to the performed task, and that this variability shows distinct spectral profiles across brain regions. Notably, analysis of the MEG data alone did not reveal modulations across the examined tasks in the time-frequency windows emerging from the MEG-fMRI correlation analysis. Our results suggest that the electromagnetic-hemodynamic correlation could serve as a more sensitive proxy for task-dependent neural engagement in cognitive tasks than isolated within-modality measures.
Collapse
Affiliation(s)
- Tommi Mononen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- Aalto NeuroImaging, Aalto University, Espoo, Finland
- Department of Computer Science, Aalto University, Espoo, Finland
- Faculty of Biological and Environmental Sciences, University of Helsinki, Helsinki, Finland
- *Correspondence: Tommi Mononen,
| | - Jan Kujala
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Mia Liljeström
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- Aalto NeuroImaging, Aalto University, Espoo, Finland
- BioMag Laboratory, Helsinki University Hospital, Helsinki, Finland
| | - Eemeli Leppäaho
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Samuel Kaski
- Department of Computer Science, Aalto University, Espoo, Finland
| | - Riitta Salmelin
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, Espoo, Finland
- Aalto NeuroImaging, Aalto University, Espoo, Finland
| |
Collapse
|
9
|
A studyforrest extension, MEG recordings while watching the audio-visual movie "Forrest Gump". Sci Data 2022; 9:206. [PMID: 35562378 PMCID: PMC9106652 DOI: 10.1038/s41597-022-01299-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 03/30/2022] [Indexed: 01/01/2023] Open
Abstract
Naturalistic stimuli, such as movies, are being increasingly used to map brain function because of their high ecological validity. The pioneering studyforrest and other naturalistic neuroimaging projects have provided free access to multiple movie-watching functional magnetic resonance imaging (fMRI) datasets to prompt the community for naturalistic experimental paradigms. However, sluggish blood-oxygenation-level-dependent fMRI signals are incapable of resolving neuronal activity with the temporal resolution at which it unfolds. Instead, magnetoencephalography (MEG) measures changes in the magnetic field produced by neuronal activity and is able to capture rich dynamics of the brain at the millisecond level while watching naturalistic movies. Herein, we present the first public prolonged MEG dataset collected from 11 participants while watching the 2 h long audio-visual movie “Forrest Gump”. Minimally preprocessed data was also provided to facilitate the use of the dataset. As a studyforrest extension, we envision that this dataset, together with fMRI data from the studyforrest project, will serve as a foundation for exploring the neural dynamics of various cognitive functions in real-world contexts. Measurement(s) | Brain activity measurement • Brain structure | Technology Type(s) | Magnetoencephalography • Magnetic Resonance Imaging | Factor Type(s) | Audiovisual movie | Sample Characteristic - Organism | Homo sapiens |
Collapse
|
10
|
Hu R, Peng Z, Zhu X, Gan J, Zhu Y, Ma J, Wu G. Multi-Band Brain Network Analysis for Functional Neuroimaging Biomarker Identification. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:3843-3855. [PMID: 34310294 PMCID: PMC8931676 DOI: 10.1109/tmi.2021.3099641] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
The functional connectomic profile is one of the non-invasive imaging biomarkers in the computer-assisted diagnostic system for many neuro-diseases. However, the diagnostic power of functional connectivity is challenged by mixed frequency-specific neuronal oscillations in the brain, which makes the single Functional Connectivity Network (FCN) often underpowered to capture the disease-related functional patterns. To address this challenge, we propose a novel functional connectivity analysis framework to conduct joint feature learning and personalized disease diagnosis, in a semi-supervised manner, aiming at focusing on putative multi-band functional connectivity biomarkers from functional neuroimaging data. Specifically, we first decompose the Blood Oxygenation Level Dependent (BOLD) signals into multiple frequency bands by the discrete wavelet transform, and then cast the alignment of all fully-connected FCNs derived from multiple frequency bands into a parameter-free multi-band fusion model. The proposed fusion model fuses all fully-connected FCNs to obtain a sparsely-connected FCN (sparse FCN for short) for each individual subject, as well as lets each sparse FCN be close to its neighbored sparse FCNs and be far away from its furthest sparse FCNs. Furthermore, we employ the l1 -SVM to conduct joint brain region selection and disease diagnosis. Finally, we evaluate the effectiveness of our proposed framework on various neuro-diseases, i.e., Fronto-Temporal Dementia (FTD), Obsessive-Compulsive Disorder (OCD), and Alzheimer's Disease (AD), and the experimental results demonstrate that our framework shows more reasonable results, compared to state-of-the-art methods, in terms of classification performance and the selected brain regions. The source code can be visited by the url https://github.com/reynard-hu/mbbna.
Collapse
|
11
|
Wu Z, Sabel BA. Spacetime in the brain: rapid brain network reorganization in visual processing and recovery. Sci Rep 2021; 11:17940. [PMID: 34504129 PMCID: PMC8429559 DOI: 10.1038/s41598-021-96971-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Accepted: 08/13/2021] [Indexed: 11/14/2022] Open
Abstract
Functional connectivity networks (FCN) are the physiological basis of brain synchronization to integrating neural activity. They are not rigid but can reorganize under pathological conditions or during mental or behavioral states. However, because mental acts can be very fast, like the blink of an eye, we now used the visual system as a model to explore rapid FCN reorganization and its functional impact in normal, abnormal and post treatment vision. EEG-recordings were time-locked to visual stimulus presentation; graph analysis of neurophysiological oscillations were used to characterize millisecond FCN dynamics in healthy subjects and in patients with optic nerve damage before and after neuromodulation with alternating currents stimulation and were correlated with visual performance. We showed that rapid and transient FCN synchronization patterns in humans can evolve and dissolve in millisecond speed during visual processing. This rapid FCN reorganization is functionally relevant because disruption and recovery after treatment in optic nerve patients correlated with impaired and recovered visual performance, respectively. Because FCN hub and node interactions can evolve and dissolve in millisecond speed to manage spatial and temporal neural synchronization during visual processing and recovery, we propose “Brain Spacetime” as a fundamental principle of the human mind not only in visual cognition but also in vision restoration.
Collapse
Affiliation(s)
- Zheng Wu
- Institute of Medical Psychology, Medical Faculty, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany.,Data and Knowledge Engineering Group, Faculty of Computer Science, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany
| | - Bernhard A Sabel
- Institute of Medical Psychology, Medical Faculty, Otto-von-Guericke University of Magdeburg, Magdeburg, Germany.
| |
Collapse
|
12
|
Li X, Zhu Y, Vuoriainen E, Ye C, Astikainen P. Decreased intersubject synchrony in dynamic valence ratings of sad movie contents in dysphoric individuals. Sci Rep 2021; 11:14419. [PMID: 34257384 PMCID: PMC8277793 DOI: 10.1038/s41598-021-93825-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Accepted: 06/30/2021] [Indexed: 02/06/2023] Open
Abstract
Emotional reactions to movies are typically similar between people. However, depressive symptoms decrease synchrony in brain responses. Less is known about the effect of depressive symptoms on intersubject synchrony in conscious stimulus-related processing. In this study, we presented amusing, sad and fearful movie clips to dysphoric individuals (those with elevated depressive symptoms) and control participants to dynamically rate the clips' valences (positive vs. negative). We analysed both the valence ratings' mean values and intersubject correlation (ISC). We used electrodermal activity (EDA) to complement the measurement in a separate session. There were no group differences in either the EDA or mean valence rating values for each movie type. As expected, the valence ratings' ISC was lower in the dysphoric than the control group, specifically for the sad movie clips. In addition, there was a negative relationship between the valence ratings' ISC and depressive symptoms for sad movie clips in the full sample. The results are discussed in the context of the negative attentional bias in depression. The findings extend previous brain activity results of ISC by showing that depressive symptoms also increase variance in conscious ratings of valence of stimuli in a mood-congruent manner.
Collapse
Affiliation(s)
- Xueqiao Li
- grid.9681.60000 0001 1013 7965Department of Psychology, University of Jyvaskyla, P.O. Box 35, 40014 Jyväskylä, Finland
| | - Yongjie Zhu
- grid.7737.40000 0004 0410 2071Department of Computer Science, University of Helsinki, 00014 Helsinki, Finland
| | - Elisa Vuoriainen
- grid.502801.e0000 0001 2314 6254Human Information Processing Laboratory, Faculty of Social Sciences/Psychology, Tampere University, 33014 Tampere, Finland
| | - Chaoxiong Ye
- grid.9681.60000 0001 1013 7965Department of Psychology, University of Jyvaskyla, P.O. Box 35, 40014 Jyväskylä, Finland ,grid.412600.10000 0000 9479 9538Institute of Brain and Psychological Sciences, Sichuan Normal University, Chengdu, 610000 China
| | - Piia Astikainen
- grid.9681.60000 0001 1013 7965Department of Psychology, University of Jyvaskyla, P.O. Box 35, 40014 Jyväskylä, Finland
| |
Collapse
|
13
|
Sareen E, Zahar S, Ville DVD, Gupta A, Griffa A, Amico E. Exploring MEG brain fingerprints: Evaluation, pitfalls, and interpretations. Neuroimage 2021; 240:118331. [PMID: 34237444 DOI: 10.1016/j.neuroimage.2021.118331] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2021] [Revised: 06/22/2021] [Accepted: 07/01/2021] [Indexed: 12/16/2022] Open
Abstract
Individual characterization of subjects based on their functional connectome (FC), termed "FC fingerprinting", has become a highly sought-after goal in contemporary neuroscience research. Recent functional magnetic resonance imaging (fMRI) studies have demonstrated unique characterization and accurate identification of individuals as an accomplished task. However, FC fingerprinting in magnetoencephalography (MEG) data is still widely unexplored. Here, we study resting-state MEG data from the Human Connectome Project to assess the MEG FC fingerprinting and its relationship with several factors including amplitude- and phase-coupling functional connectivity measures, spatial leakage correction, frequency bands, and behavioral significance. To this end, we first employ two identification scoring methods, differential identifiability and success rate, to provide quantitative fingerprint scores for each FC measurement. Secondly, we explore the edgewise and nodal MEG fingerprinting patterns across the different frequency bands (delta, theta, alpha, beta, and gamma). Finally, we investigate the cross-modality fingerprinting patterns obtained from MEG and fMRI recordings from the same subjects. We assess the behavioral significance of FC across connectivity measures and imaging modalities using partial least square correlation analyses. Our results suggest that fingerprinting performance is heavily dependent on the functional connectivity measure, frequency band, identification scoring method, and spatial leakage correction. We report higher MEG fingerprinting performances in phase-coupling methods, central frequency bands (alpha and beta), and in the visual, frontoparietal, dorsal-attention, and default-mode networks. Furthermore, cross-modality comparisons reveal a certain degree of spatial concordance in fingerprinting patterns between the MEG and fMRI data, especially in the visual system. Finally, the multivariate correlation analyses show that MEG connectomes have strong behavioral significance, which however depends on the considered connectivity measure and temporal scale. This comprehensive, albeit preliminary investigation of MEG connectome test-retest identifiability offers a first characterization of MEG fingerprinting in relation to different methodological and electrophysiological factors and contributes to the understanding of fingerprinting cross-modal relationships. We hope that this first investigation will contribute to setting the grounds for MEG connectome identification.
Collapse
Affiliation(s)
- Ekansh Sareen
- Signal Processing and Biomedical Imaging, Dept. of Electronics and Communication Engineering, IIIT-Delhi, New Delhi, India
| | - Sélima Zahar
- Institute of Bioengineering, Center for Neuroprosthetics, École Polytechnique Fédérale De Lausanne (EPFL), Geneva, Switzerland
| | - Dimitri Van De Ville
- Institute of Bioengineering, Center for Neuroprosthetics, École Polytechnique Fédérale De Lausanne (EPFL), Geneva, Switzerland; Department of Radiology and Medical Informatics, University of Geneva (UNIGE), Geneva, Switzerland
| | - Anubha Gupta
- Signal Processing and Biomedical Imaging, Dept. of Electronics and Communication Engineering, IIIT-Delhi, New Delhi, India
| | - Alessandra Griffa
- Institute of Bioengineering, Center for Neuroprosthetics, École Polytechnique Fédérale De Lausanne (EPFL), Geneva, Switzerland; Department of Clinical Neurosciences, Division of Neurology, Geneva University Hospitals and Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - Enrico Amico
- Institute of Bioengineering, Center for Neuroprosthetics, École Polytechnique Fédérale De Lausanne (EPFL), Geneva, Switzerland; Department of Radiology and Medical Informatics, University of Geneva (UNIGE), Geneva, Switzerland.
| |
Collapse
|
14
|
Hiraishi H, Ikeda T, Saito DN, Hasegawa C, Kitagawa S, Takahashi T, Kikuchi M, Ouchi Y. Regional and Temporal Differences in Brain Activity With Morally Good or Bad Judgments in Men: A Magnetoencephalography Study. Front Neurosci 2021; 15:596711. [PMID: 33911998 PMCID: PMC8072487 DOI: 10.3389/fnins.2021.596711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2020] [Accepted: 03/19/2021] [Indexed: 12/02/2022] Open
Abstract
Many neuroimaging studies on morality focus on functional brain areas that relate to moral judgment specifically in morally negative situations. To date, there have been few studies on differences in brain activity under conditions of being morally good and bad along a continuum. To explore not only the brain regions involved but also their functional connections during moral judgments, we used magnetoencephalography (MEG), which is superior to other imaging modalities for analyzing time-dependent brain activities; only men were recruited because sex differences might be a confounding factor. While analyses showed that general patterns of brain activation and connectivity were similar between morally good judgments (MGJs) and morally bad judgments (MBJs), activation in brain areas that subserve emotion and “theory of mind” on the right hemisphere was larger in MGJ than MBJ conditions. In the left local temporal region, the connectivity between brain areas related to emotion and reward/punishment was stronger in MBJ than MGJ conditions. The time-frequency analysis showed distinct laterality (left hemisphere dominant) occurring during early moral information processing in MBJ conditions compared to MGJ conditions and phase-dependent differences in the appearance of theta waves between MBJ and MGJ conditions. During MBJs, connections within the hemispheric regions were more robust than those between hemispheric regions. These results suggested that the local temporal region on the left hemisphere is more important in the execution of MBJs during early moral valence processing than in that with MGJs. Shorter neuronal connections within the hemisphere may allow to make MBJs punctual.
Collapse
Affiliation(s)
- Hirotoshi Hiraishi
- Department of Biofunctional Imaging, Preeminent Medical Photonics Education and Research Center, Hamamatsu University School of Medicine, Hamamatsu, Japan.,Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan
| | - Takashi Ikeda
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan.,United Graduate School of Child Development, Osaka University, Kanazawa University, Hamamatsu University School of Medicine, Chiba University and University of Fukui, Fukui, Japan
| | - Daisuke N Saito
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan.,Department of Psychology, Yasuda Women's University, Hiroshima, Japan
| | - Chiaki Hasegawa
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan
| | - Sachiko Kitagawa
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan
| | - Tetsuya Takahashi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan
| | - Mitsuru Kikuchi
- Research Center for Child Mental Development, Kanazawa University, Kanazawa, Japan.,United Graduate School of Child Development, Osaka University, Kanazawa University, Hamamatsu University School of Medicine, Chiba University and University of Fukui, Fukui, Japan.,Department of Psychiatry and Behavioral Science, Kanazawa University, Kanazawa, Japan
| | - Yasuomi Ouchi
- Department of Biofunctional Imaging, Preeminent Medical Photonics Education and Research Center, Hamamatsu University School of Medicine, Hamamatsu, Japan
| |
Collapse
|
15
|
MEG Intersubject Phase Locking of Stimulus-Driven Activity during Naturalistic Speech Listening Correlates with Musical Training. J Neurosci 2021; 41:2713-2722. [PMID: 33536196 DOI: 10.1523/jneurosci.0932-20.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Revised: 11/13/2020] [Accepted: 11/17/2020] [Indexed: 12/26/2022] Open
Abstract
Musical training is associated with increased structural and functional connectivity between auditory sensory areas and higher-order brain networks involved in speech and motor processing. Whether such changed connectivity patterns facilitate the cortical propagation of speech information in musicians remains poorly understood. We here used magnetoencephalography (MEG) source imaging and a novel seed-based intersubject phase-locking approach to investigate the effects of musical training on the interregional synchronization of stimulus-driven neural responses during listening to naturalistic continuous speech presented in silence. MEG data were obtained from 20 young human subjects (both sexes) with different degrees of musical training. Our data show robust bilateral patterns of stimulus-driven interregional phase synchronization between auditory cortex and frontotemporal brain regions previously associated with speech processing. Stimulus-driven phase locking was maximal in the delta band, but was also observed in the theta and alpha bands. The individual duration of musical training was positively associated with the magnitude of stimulus-driven alpha-band phase locking between auditory cortex and parts of the dorsal and ventral auditory processing streams. These findings provide evidence for a positive relationship between musical training and the propagation of speech-related information between auditory sensory areas and higher-order processing networks, even when speech is presented in silence. We suggest that the increased synchronization of higher-order cortical regions to auditory cortex may contribute to the previously described musician advantage in processing speech in background noise.SIGNIFICANCE STATEMENT Musical training has been associated with widespread structural and functional brain plasticity. It has been suggested that these changes benefit the production and perception of music but can also translate to other domains of auditory processing, such as speech. We developed a new magnetoencephalography intersubject analysis approach to study the cortical synchronization of stimulus-driven neural responses during the perception of continuous natural speech and its relationship to individual musical training. Our results provide evidence that musical training is associated with higher synchronization of stimulus-driven activity between brain regions involved in early auditory sensory and higher-order processing. We suggest that the increased synchronized propagation of speech information may contribute to the previously described musician advantage in processing speech in background noise.
Collapse
|
16
|
Levy J, Lankinen K, Hakonen M, Feldman R. The integration of social and neural synchrony: a case for ecologically valid research using MEG neuroimaging. Soc Cogn Affect Neurosci 2021; 16:143-152. [PMID: 32382751 PMCID: PMC7812634 DOI: 10.1093/scan/nsaa061] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Revised: 04/06/2020] [Accepted: 04/27/2020] [Indexed: 12/19/2022] Open
Abstract
The recent decade has seen a shift from artificial and environmentally deprived experiments in neuroscience to real-life studies on multiple brains in interaction, coordination and synchrony. In these new interpersonal synchrony experiments, there has been a growing trend to employ naturalistic social interactions to evaluate mechanisms underlying synchronous neuronal communication. Here, we emphasize the importance of integrating the assessment of neural synchrony with measurement of nonverbal behavioral synchrony as expressed in various social contexts: relaxed social interactions, planning a joint pleasurable activity, conflict discussion, invocation of trauma, or support giving and assess the integration of neural and behavioral synchrony across developmental stages and psychopathological conditions. We also showcase the advantages of magnetoencephalography neuroimaging as a promising tool for studying interactive neural synchrony and consider the challenge of ecological validity at the expense of experimental rigor. We review recent evidence of rhythmic information flow between brains in interaction and conclude with addressing state-of-the-art developments that may contribute to advance research on brain-to-brain coordination to the next level.
Collapse
Affiliation(s)
- Jonathan Levy
- Department of Neuroscience and Biomedical Engineering, Aalto University, 02150 Espoo, Finland
- Interdisciplinary Center, Baruch Ivcher School of Psychology, Herzliya 46150, Israel
| | - Kaisu Lankinen
- Department of Radiology, Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
- Department of Radiology, Harvard Medical School, Boston, MA, USA
| | - Maria Hakonen
- Department of Neuroscience and Biomedical Engineering, Aalto University, 02150 Espoo, Finland
- Faculty of Sport and Health Sciences, University of Jyväskylä, Jyväskylä, Finland
| | - Ruth Feldman
- Interdisciplinary Center, Baruch Ivcher School of Psychology, Herzliya 46150, Israel
- Yale University, Child Study Center, New Haven, CT 06520, USA
| |
Collapse
|
17
|
Kotila A, Hyvärinen A, Mäkinen L, Leinonen E, Hurtig T, Ebeling H, Korhonen V, Kiviniemi VJ, Loukusa S. Processing of pragmatic communication in ASD: a video-based brain imaging study. Sci Rep 2020; 10:21739. [PMID: 33303942 PMCID: PMC7729953 DOI: 10.1038/s41598-020-78874-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2020] [Accepted: 11/30/2020] [Indexed: 01/24/2023] Open
Abstract
Social and pragmatic difficulties in autism spectrum disorder (ASD) are widely recognized, although their underlying neural level processing is not well understood. The aim of this study was to examine the activity of the brain network components linked to social and pragmatic understanding in order to reveal whether complex socio-pragmatic events evoke differences in brain activity between the ASD and control groups. Nineteen young adults (mean age 23.6 years) with ASD and 19 controls (mean age 22.7 years) were recruited for the study. The stimulus data consisted of video clips showing complex social events that demanded processing of pragmatic communication. In the analysis, the functional magnetic resonance imaging signal responses of the selected brain network components linked to social and pragmatic information processing were compared. Although the processing of the young adults with ASD was similar to that of the control group during the majority of the social scenes, differences between the groups were found in the activity of the social brain network components when the participants were observing situations with concurrent verbal and non-verbal communication events. The results suggest that the ASD group had challenges in processing concurrent multimodal cues in complex pragmatic communication situations.
Collapse
Affiliation(s)
- Aija Kotila
- Research Unit of Logopedics, Faculty of Humanities, University of Oulu, Oulu, Finland.
| | - Aapo Hyvärinen
- Department of Computer Science, University of Helsinki, Helsinki, Finland
| | - Leena Mäkinen
- Research Unit of Logopedics, Faculty of Humanities, University of Oulu, Oulu, Finland
| | - Eeva Leinonen
- Office of the Vice Chancellor, Murdoch University, Murdoch, WA, Australia
| | - Tuula Hurtig
- Research Unit of Clinical Neuroscience, Psychiatry, University of Oulu, Oulu, Finland
- PEDEGO Research Unit, The Faculty of Medicine, University of Oulu, Oulu, Finland
- Department of Child Psychiatry, Faculty of Medicine, Institute of Clinical Medicine, Oulu University Hospital, Oulu, Finland
| | - Hanna Ebeling
- PEDEGO Research Unit, The Faculty of Medicine, University of Oulu, Oulu, Finland
- Department of Child Psychiatry, Faculty of Medicine, Institute of Clinical Medicine, Oulu University Hospital, Oulu, Finland
| | - Vesa Korhonen
- Department of Diagnostic Radiology, Medical Research Center (MRC), University and University Hospital of Oulu, Oulu, Finland
- Research Unit of Medical Imaging, Physics and Technology, The Faculty of Medicine, University of Oulu, Oulu, Finland
| | - Vesa J Kiviniemi
- Department of Diagnostic Radiology, Medical Research Center (MRC), University and University Hospital of Oulu, Oulu, Finland
- Research Unit of Medical Imaging, Physics and Technology, The Faculty of Medicine, University of Oulu, Oulu, Finland
| | - Soile Loukusa
- Research Unit of Logopedics, Faculty of Humanities, University of Oulu, Oulu, Finland
| |
Collapse
|
18
|
Vandewouw MM, Dunkley BT, Lerch JP, Anagnostou E, Taylor MJ. Characterizing Inscapes and resting-state in MEG: Effects in typical and atypical development. Neuroimage 2020; 225:117524. [PMID: 33147510 DOI: 10.1016/j.neuroimage.2020.117524] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2020] [Revised: 10/26/2020] [Accepted: 10/28/2020] [Indexed: 12/12/2022] Open
Abstract
Examining the brain at rest is a powerful approach used to understand the intrinsic properties of typical and disordered human brain function, yet task-free paradigms are associated with greater head motion, particularly in young and/or clinical populations such as autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder (ADHD). Inscapes, a non-social and non-verbal movie paradigm, has been introduced to increase attention, thus mitigating head motion, while reducing the task-induced activations found during typical movie watching. Inscapes has not yet been validated for use in magnetoencephalography (MEG), and it has yet to be shown whether its effects are stable in clinical populations. Across typically developing (N = 32) children and adolescents and those with ASD (N = 46) and ADHD (N = 42), we demonstrate that head motion is reduced during Inscapes. Due to the task state evoked by movie paradigms, we also expectedly observed concomitant modulations in local neural activity (oscillatory power) and functional connectivity (phase and envelope coupling) in intrinsic resting-state networks and across the frequency spectra compared to a fixation cross resting-state. Increases in local activity were accompanied by decreases in low-frequency connectivity within and between resting-state networks, primarily the visual network, suggesting that task-state evoked by Inscapes moderates ongoing and spontaneous cortical inhibition that forms the idling intrinsic networks found during a fixation cross resting-state. Importantly, these effects were similar in ASD and ADHD, making Inscapes a well-suited advancement for investigations of resting brain function in young and clinical populations.
Collapse
Affiliation(s)
- Marlee M Vandewouw
- Department of Diagnostic Imaging, Hospital for Sick Children, 555 University Ave, Toronto, ON M5G 1X8, Canada; Program in Neurosciences and Mental Health, Hospital for Sick Children, Toronto, Canada; Autism Research Centre, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada; Institute of Biomedical Engineering, University of Toronto, Toronto, Canada.
| | - Benjamin T Dunkley
- Department of Diagnostic Imaging, Hospital for Sick Children, 555 University Ave, Toronto, ON M5G 1X8, Canada; Program in Neurosciences and Mental Health, Hospital for Sick Children, Toronto, Canada; Department of Medical Imaging, University of Toronto, Toronto, Canada
| | - Jason P Lerch
- Program in Neurosciences and Mental Health, Hospital for Sick Children, Toronto, Canada; Department of Medical Biophysics, University of Toronto, Toronto, Canada; Wellcome Centre for Integrative Neuroimaging, FMRIB, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Evdokia Anagnostou
- Program in Neurosciences and Mental Health, Hospital for Sick Children, Toronto, Canada; Autism Research Centre, Bloorview Research Institute, Holland Bloorview Kids Rehabilitation Hospital, Toronto, ON, Canada
| | - Margot J Taylor
- Department of Diagnostic Imaging, Hospital for Sick Children, 555 University Ave, Toronto, ON M5G 1X8, Canada; Program in Neurosciences and Mental Health, Hospital for Sick Children, Toronto, Canada; Department of Medical Imaging, University of Toronto, Toronto, Canada; Department of Psychology, University of Toronto, Toronto, Canada
| |
Collapse
|
19
|
Zhuang X, Yang Z, Cordes D. A technical review of canonical correlation analysis for neuroscience applications. Hum Brain Mapp 2020; 41:3807-3833. [PMID: 32592530 PMCID: PMC7416047 DOI: 10.1002/hbm.25090] [Citation(s) in RCA: 63] [Impact Index Per Article: 15.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2020] [Accepted: 05/23/2020] [Indexed: 12/11/2022] Open
Abstract
Collecting comprehensive data sets of the same subject has become a standard in neuroscience research and uncovering multivariate relationships among collected data sets have gained significant attentions in recent years. Canonical correlation analysis (CCA) is one of the powerful multivariate tools to jointly investigate relationships among multiple data sets, which can uncover disease or environmental effects in various modalities simultaneously and characterize changes during development, aging, and disease progressions comprehensively. In the past 10 years, despite an increasing number of studies have utilized CCA in multivariate analysis, simple conventional CCA dominates these applications. Multiple CCA-variant techniques have been proposed to improve the model performance; however, the complicated multivariate formulations and not well-known capabilities have delayed their wide applications. Therefore, in this study, a comprehensive review of CCA and its variant techniques is provided. Detailed technical formulation with analytical and numerical solutions, current applications in neuroscience research, and advantages and limitations of each CCA-related technique are discussed. Finally, a general guideline in how to select the most appropriate CCA-related technique based on the properties of available data sets and particularly targeted neuroscience questions is provided.
Collapse
Affiliation(s)
- Xiaowei Zhuang
- Cleveland Clinic Lou Ruvo Center for Brain HealthLas VegasNevadaUSA
| | - Zhengshi Yang
- Cleveland Clinic Lou Ruvo Center for Brain HealthLas VegasNevadaUSA
| | - Dietmar Cordes
- Cleveland Clinic Lou Ruvo Center for Brain HealthLas VegasNevadaUSA
- University of ColoradoBoulderColoradoUSA
- Department of Brain HealthUniversity of NevadaLas VegasNevadaUSA
| |
Collapse
|
20
|
Nunes AS, Kozhemiako N, Moiseev A, Seymour RA, Cheung TPL, Ribary U, Doesburg SM. Neuromagnetic activation and oscillatory dynamics of stimulus-locked processing during naturalistic viewing. Neuroimage 2019; 216:116414. [PMID: 31794854 DOI: 10.1016/j.neuroimage.2019.116414] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2019] [Revised: 10/21/2019] [Accepted: 11/27/2019] [Indexed: 10/25/2022] Open
Abstract
Naturalistic stimuli such as watching a movie while in the scanner provide an ecologically valid paradigm that has the potential of extracting valuable information on how the brain processes complex stimuli in realistic visual and auditory contexts. Naturalistic viewing is also easier to conduct with challenging participant groups including patients and children. Given the high temporal resolution of MEG, in the present study, we demonstrate how a short movie clip can be used to map distinguishable activation and connectivity dynamics underlying the processing of specific classes of visual stimuli such as face and hand manipulations, as well as contrasting activation dynamics for auditory words and non-words. MEG data were collected from 22 healthy volunteers (6 females, 3 left handed, mean age - 27.7 ± 5.28 years) during the presentation of naturalistic audiovisual stimuli. The MEG data were split into trials with the onset of the stimuli belonging to classes of interest (words, non-words, faces, hand manipulations). Based on the components of the averaged sensor ERFs time-locked to the visual and auditory stimulus onset, four and three time-windows, respectively, were defined to explore brain activation dynamics. Pseudo-Z, defined as the ratio of the source-projected time-locked power to the projected noise power for each vertex, was computed and used as a proxy of time-locked brain activation. Statistical testing using the mean-centered Partial Least Squares analysis indicated periods where a given visual or auditory stimuli had higher activation. Based on peak pseudo-Z differences between the visual conditions, time-frequency resolved analyses were performed to assess beta band desynchronization in motor-related areas, and inter-trial phase synchronization between face processing areas. Our results provide the first evidence that activation and connectivity dynamics in canonical brain regions associated with the processing of particular classes of visual and auditory stimuli can be reliably mapped using MEG during presentation of naturalistic stimuli. Given the strength of MEG for brain mapping in temporal and frequency domains, the use of naturalistic stimuli may open new techniques in analyzing brain dynamics during ecologically valid sensation and perception.
Collapse
Affiliation(s)
- Adonay S Nunes
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada.
| | - Nataliia Kozhemiako
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada
| | - Alexander Moiseev
- Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada
| | - Robert A Seymour
- Aston Brain Centre, School of Life and Health Sciences, Aston University, Birmingham, UK; Department of Cognitive Science, Macquarie University, Sydney, Australia
| | - Teresa P L Cheung
- School of Engineering Science, Simon Fraser University, Burnaby, BC, Canada
| | - Urs Ribary
- Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada; Department Pediatrics and Psychiatry, University of British Columbia, Vancouver, BC, Canada; B.C. Children's Hospital Research Institute, Vancouver, BC, Canada; Department of Psychology, Simon Fraser University, Burnaby, BC, Canada
| | - Sam M Doesburg
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada; Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada
| |
Collapse
|
21
|
Fishell AK, Burns-Yocum TM, Bergonzi KM, Eggebrecht AT, Culver JP. Mapping brain function during naturalistic viewing using high-density diffuse optical tomography. Sci Rep 2019; 9:11115. [PMID: 31366956 PMCID: PMC6668456 DOI: 10.1038/s41598-019-45555-8] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2019] [Accepted: 06/05/2019] [Indexed: 01/01/2023] Open
Abstract
Naturalistic stimuli, such as movies, more closely recapitulate "real life" sensory processing and behavioral demands relative to paradigms that rely on highly distilled and repetitive stimulus presentations. The rich complexity inherent in naturalistic stimuli demands an imaging system capable of measuring spatially distributed brain responses, and analysis tools optimized for unmixing responses to concurrently presented features. In this work, the combination of passive movie viewing with high-density diffuse optical tomography (HD-DOT) is developed as a platform for naturalistic brain mapping. We imaged healthy young adults during free viewing of a feature film using HD-DOT and observed reproducible, synchronized cortical responses across a majority of the field-of-view, most prominently in hierarchical cortical areas related to visual and auditory processing, both within and between individuals. In order to more precisely interpret broad patterns of cortical synchronization, we extracted visual and auditory features from the movie stimulus and mapped the cortical responses to the features. The results demonstrate the sensitivity of HD-DOT to evoked responses during naturalistic viewing, and that feature-based decomposition strategies enable functional mapping of naturalistic stimulus processing, including human-generated speech.
Collapse
Affiliation(s)
- Andrew K Fishell
- Washington University School of Medicine, Division of Biology and Biomedical Sciences, St. Louis, USA
- Washington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, USA
| | - Tracy M Burns-Yocum
- Indiana University, Department of Psychological and Brain Sciences, Bloomington, USA
| | - Karla M Bergonzi
- University of Pennsylvania, Department of Anesthesia and Critical Care, Philadelphia, USA
- University of Pennsylvania, Department of Physics, Philadelphia, USA
| | - Adam T Eggebrecht
- Washington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, USA
| | - Joseph P Culver
- Washington University School of Medicine, Mallinckrodt Institute of Radiology, St. Louis, USA.
- Washington University, Department of Physics, St. Louis, USA.
- Washington University, Department of Biomedical Engineering, St. Louis, USA.
| |
Collapse
|
22
|
Naturalistic Stimuli in Neuroscience: Critically Acclaimed. Trends Cogn Sci 2019; 23:699-714. [PMID: 31257145 DOI: 10.1016/j.tics.2019.05.004] [Citation(s) in RCA: 209] [Impact Index Per Article: 41.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2019] [Revised: 05/08/2019] [Accepted: 05/21/2019] [Indexed: 01/12/2023]
Abstract
Cognitive neuroscience has traditionally focused on simple tasks, presented sparsely and using abstract stimuli. While this approach has yielded fundamental insights into functional specialisation in the brain, its ecological validity remains uncertain. Do these tasks capture how brains function 'in the wild', where stimuli are dynamic, multimodal, and crowded? Ecologically valid paradigms that approximate real life scenarios, using stimuli such as films, spoken narratives, music, and multiperson games emerged in response to these concerns over a decade ago. We critically appraise whether this approach has delivered on its promise to deliver new insights into brain function. We highlight the challenges, technological innovations, and clinical opportunities that are required should this field meet its full potential.
Collapse
|
23
|
Chan HY, Smidts A, Schoots VC, Dietvorst RC, Boksem MAS. Neural similarity at temporal lobe and cerebellum predicts out-of-sample preference and recall for video stimuli. Neuroimage 2019; 197:391-401. [PMID: 31051296 DOI: 10.1016/j.neuroimage.2019.04.076] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2018] [Revised: 04/24/2019] [Accepted: 04/29/2019] [Indexed: 10/26/2022] Open
Abstract
The extent to which brains respond similarly to a specific stimulus, across a small group of individuals, has been previously found to predict out-of-sample aggregate preference for that stimulus. However, the location in the brain where neural similarity predicts out-of-sample preference remains unclear. In this article, we attempt to identify the neural substrates in three functional magnetic resonance imaging (fMRI) studies. Two fMRI studies (N = 40 and 20), using previously broadcasted TV commercials, show that spatiotemporal neural similarity at temporal lobe and cerebellum predict out-of-sample preference and recall. A follow-up fMRI study (N = 28) with previously unseen movie-trailers replicated the predictive effect of neural similarity. Moreover, neural similarity provided unique information on out-of-sample preference above and beyond in-sample preference. Overall, the findings suggest that neural similarity at temporal lobe and cerebellum - traditionally associated with sensory integration and emotional processing - may reflect the level of engagement with video stimuli.
Collapse
Affiliation(s)
- Hang-Yee Chan
- Department of Marketing Management, Rotterdam School of Management, Erasmus University Rotterdam, the Netherlands.
| | - Ale Smidts
- Department of Marketing Management, Rotterdam School of Management, Erasmus University Rotterdam, the Netherlands
| | - Vincent C Schoots
- Department of Marketing Management, Rotterdam School of Management, Erasmus University Rotterdam, the Netherlands
| | | | - Maarten A S Boksem
- Department of Marketing Management, Rotterdam School of Management, Erasmus University Rotterdam, the Netherlands
| |
Collapse
|
24
|
de Cheveigné A, Di Liberto GM, Arzounian D, Wong DDE, Hjortkjær J, Fuglsang S, Parra LC. Multiway canonical correlation analysis of brain data. Neuroimage 2018; 186:728-740. [PMID: 30496819 DOI: 10.1016/j.neuroimage.2018.11.026] [Citation(s) in RCA: 34] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2018] [Revised: 10/11/2018] [Accepted: 11/16/2018] [Indexed: 01/12/2023] Open
Abstract
Brain data recorded with electroencephalography (EEG), magnetoencephalography (MEG) and related techniques often have poor signal-to-noise ratios due to the presence of multiple competing sources and artifacts. A common remedy is to average responses over repeats of the same stimulus, but this is not applicable for temporally extended stimuli that are presented only once (speech, music, movies, natural sound). An alternative is to average responses over multiple subjects that were presented with identical stimuli, but differences in geometry of brain sources and sensors reduce the effectiveness of this solution. Multiway canonical correlation analysis (MCCA) brings a solution to this problem by allowing data from multiple subjects to be fused in such a way as to extract components common to all. This paper reviews the method, offers application examples that illustrate its effectiveness, and outlines the caveats and risks entailed by the method.
Collapse
Affiliation(s)
- Alain de Cheveigné
- Laboratoire des Systèmes Perceptifs, UMR 8248, CNRS, France; Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France; UCL Ear Institute, London, United Kingdom.
| | - Giovanni M Di Liberto
- Laboratoire des Systèmes Perceptifs, UMR 8248, CNRS, France; Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France
| | - Dorothée Arzounian
- Laboratoire des Systèmes Perceptifs, UMR 8248, CNRS, France; Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France
| | - Daniel D E Wong
- Laboratoire des Systèmes Perceptifs, UMR 8248, CNRS, France; Département d'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France
| | - Jens Hjortkjær
- Hearing Systems Group, Department of Electrical Engineering, Technical University of Denmark, Denmark; Danish Research Centre for Magnetic Resonance, Centre for Functional and Diagnostic Imaging and Research, Copenhagen University Hospital Hvidovre, Denmark
| | - Søren Fuglsang
- Hearing Systems Group, Department of Electrical Engineering, Technical University of Denmark, Denmark
| | | |
Collapse
|
25
|
Haufe S, DeGuzman P, Henin S, Arcaro M, Honey CJ, Hasson U, Parra LC. Elucidating relations between fMRI, ECoG, and EEG through a common natural stimulus. Neuroimage 2018; 179:79-91. [PMID: 29902585 PMCID: PMC6063527 DOI: 10.1016/j.neuroimage.2018.06.016] [Citation(s) in RCA: 36] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2018] [Revised: 05/21/2018] [Accepted: 06/05/2018] [Indexed: 12/31/2022] Open
Abstract
Human brain mapping relies heavily on fMRI, ECoG and EEG, which capture different physiological signals. Relationships between these signals have been established in the context of specific tasks or during resting state, often using spatially confined concurrent recordings in animals. But it is not certain whether these correlations generalize to other contexts relevant for human cognitive neuroscience. Here, we address the case of complex naturalistic stimuli and ask two basic questions. First, how reliable are the responses evoked by a naturalistic audio-visual stimulus in each of these imaging methods, and second, how similar are stimulus-related responses across methods? To this end, we investigated a wide range of brain regions and frequency bands. We presented the same movie clip twice to three different cohorts of subjects (NEEG = 45, NfMRI = 11, NECoG = 5) and assessed stimulus-driven correlations across viewings and between imaging methods, thereby ruling out task-irrelevant confounds. All three imaging methods had similar repeat-reliability across viewings when fMRI and EEG data were averaged across subjects, highlighting the potential to achieve large signal-to-noise ratio by leveraging large sample sizes. The fMRI signal correlated positively with high-frequency ECoG power across multiple task-related cortical structures but positively with low-frequency EEG and ECoG power. In contrast to previous studies, these correlations were as strong for low-frequency as for high frequency ECoG. We also observed links between fMRI and infra-slow EEG voltage fluctuations. These results extend previous findings to the case of natural stimulus processing.
Collapse
Affiliation(s)
- Stefan Haufe
- Technische Universität Berlin, Berlin, Germany; City College New York, New York, NY, USA; Columbia University, New York, NY, USA.
| | | | - Simon Henin
- NYU Langone Medical Center, New York, NY, USA
| | | | | | - Uri Hasson
- Princeton University, Princeton, NJ, USA
| | - Lucas C Parra
- City College New York, New York, NY, USA; Neuromatters LLC, New York, NY, USA.
| |
Collapse
|
26
|
Nummenmaa L, Lahnakoski JM, Glerean E. Sharing the social world via intersubject neural synchronisation. Curr Opin Psychol 2018; 24:7-14. [PMID: 29550395 DOI: 10.1016/j.copsyc.2018.02.021] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2018] [Revised: 02/27/2018] [Accepted: 02/28/2018] [Indexed: 11/30/2022]
Abstract
Sociability and capability of shared mental states are hallmarks of the human species, and pursuing shared goals oftentimes requires coordinating both behaviour and mental states. Here we review recent work using indices of intersubject neural synchronisation for measuring similarity of mental states across individuals. We discuss the methodological advances and limitations in the analyses based on intersubject synchrony, and discuss how these kinds of model-free analysis techniques enable the investigation of the brain basis of complex social processes. We argue that similarity of brain activity across individuals can be used, under certain conditions, to index the similarity of their subjective states of consciousness, and thus be used for investigating brain basis of mutual understanding and cooperation.
Collapse
Affiliation(s)
- Lauri Nummenmaa
- Turku PET Centre, University of Turku, 20520 Turku, Finland; Department of Psychology, University of Turku, Finland.
| | - Juha M Lahnakoski
- Independent Max Planck Research Group for Social Neuroscience, Max Planck Institute of Psychiatry, 80804 Munich, Germany
| | - Enrico Glerean
- Turku PET Centre, University of Turku, 20520 Turku, Finland; Department of Neuroscience and Biomedical Engineering, Aalto University, Finland
| |
Collapse
|