1
|
Morgenroth E, Moia S, Vilaclara L, Fournier R, Muszynski M, Ploumitsakou M, Almató-Bellavista M, Vuilleumier P, Van De Ville D. Emo-FilM: A multimodal dataset for affective neuroscience using naturalistic stimuli. Sci Data 2025; 12:684. [PMID: 40268934 PMCID: PMC12019557 DOI: 10.1038/s41597-025-04803-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2024] [Accepted: 03/12/2025] [Indexed: 04/25/2025] Open
Abstract
The Emo-FilM dataset stands for Emotion research using Films and fMRI in healthy participants. This dataset includes emotion annotations by 44 raters for 14 short films with a combined duration of over 2½ hours and recordings of respiration, heart rate, and functional magnetic resonance imaging (fMRI) from a sample of 30 individuals watching the same films. 50 items were annotated including discrete emotions and emotion components from the domains of appraisal, motivation, motor expression, physiological response, and feeling. The ratings had a mean inter-rater agreement of 0.38. The fMRI data acquired at 3 Tesla is includes high-resolution structural and resting state fMRI for each participant. Physiological recordings included heart rate, respiration, and electrodermal activity. This dataset is designed, but not limited, to studying the dynamic neural processes involved in emotion experience. It has a high temporal resolution of annotations, and includes validations of annotations by the fMRI sample. The Emo-FilM dataset is a treasure trove for researching emotion in response to naturalistic stimulation in a multimodal framework.
Collapse
Affiliation(s)
- Elenor Morgenroth
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva, 1202, Switzerland.
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, 1202, Switzerland.
- Swiss Center for Affective Sciences, University of Geneva, Geneva, 1202, Switzerland.
| | - Stefano Moia
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva, 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, 1202, Switzerland
| | - Laura Vilaclara
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva, 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, 1202, Switzerland
| | - Raphael Fournier
- Department of Basic Neurosciences, University of Geneva, Geneva, 1202, Switzerland
| | - Michal Muszynski
- Department of Basic Neurosciences, University of Geneva, Geneva, 1202, Switzerland
| | - Maria Ploumitsakou
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva, 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, 1202, Switzerland
| | - Marina Almató-Bellavista
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva, 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, 1202, Switzerland
| | - Patrik Vuilleumier
- Swiss Center for Affective Sciences, University of Geneva, Geneva, 1202, Switzerland
- Department of Basic Neurosciences, University of Geneva, Geneva, 1202, Switzerland
- CIBM Center for Biomedical Imaging, Geneva, 1202, Switzerland
| | - Dimitri Van De Ville
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Geneva, 1202, Switzerland
- Department of Radiology and Medical Informatics, University of Geneva, Geneva, 1202, Switzerland
- CIBM Center for Biomedical Imaging, Geneva, 1202, Switzerland
| |
Collapse
|
2
|
Wang K, Song L, Li Z, Wang L, He X, Ren Y, Lv J. Unveiling complex brain dynamics during movie viewing via deep recurrent autoencoder model. Neuroimage 2025; 310:121177. [PMID: 40157466 DOI: 10.1016/j.neuroimage.2025.121177] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2024] [Revised: 03/17/2025] [Accepted: 03/26/2025] [Indexed: 04/01/2025] Open
Abstract
Naturalistic stimuli have become an effective tool to uncover the dynamic functional brain networks triggered by cognitive and emotional real-life experiences through multimodal and dynamic stimuli. However, current research predominantly focused on exploring dynamic functional connectivity generated via chosen templates under resting-state paradigm, with relatively limited investigation into the dynamic functional interactions among large-scale brain networks. Moreover, these studies might overlook the longer time-scale adaptability and information transmission that occur over extended periods during naturalistic stimuli. In this study, we introduced an unsupervised deep recurrent autoencoder (DRAE) model combined with a sliding window approach, effectively capturing the brain's long-term temporal dependencies, as measured in functional magnetic resonance imaging (fMRI), when subjects viewing a long-duration and emotional film. The experimental results revealed that naturalistic stimuli can induce dynamic large-scale brain networks, of which functional interactions covary with the development of the film's narrative. Furthermore, the dynamic interactions among brain networks were temporally synchronized with specific features of the movie, especially with the emotional arousal and valence. Our study provided novel insight to the underlying neural mechanisms of dynamic functional interactions among brain regions in an ecologically valid sensory experience.
Collapse
Affiliation(s)
- Kexin Wang
- School of Information Science and Technology, Northwest University, No.1 Xuefu Street, Chang'an Zone, Xi'an, Shaanxi, 710127, China; School of Network and Data Center, Northwest University, Xi'an, China
| | - Limei Song
- School of Information Science and Technology, Northwest University, No.1 Xuefu Street, Chang'an Zone, Xi'an, Shaanxi, 710127, China
| | - Zhaowei Li
- School of Information Science and Technology, Northwest University, No.1 Xuefu Street, Chang'an Zone, Xi'an, Shaanxi, 710127, China
| | - Liting Wang
- School of Automation, Northwestern Polytechnical University, Xi'an, China
| | - Xiaowei He
- School of Information Science and Technology, Northwest University, No.1 Xuefu Street, Chang'an Zone, Xi'an, Shaanxi, 710127, China; School of Network and Data Center, Northwest University, Xi'an, China
| | - Yudan Ren
- School of Information Science and Technology, Northwest University, No.1 Xuefu Street, Chang'an Zone, Xi'an, Shaanxi, 710127, China.
| | - Jinglei Lv
- School of Biomedical Engineering & Brain and Mind Center, University of Sydney, Sydney, NSW, Australia
| |
Collapse
|
3
|
Ke J, Song H, Bai Z, Rosenberg MD, Leong YC. Dynamic brain connectivity predicts emotional arousal during naturalistic movie-watching. PLoS Comput Biol 2025; 21:e1012994. [PMID: 40215238 PMCID: PMC12058195 DOI: 10.1371/journal.pcbi.1012994] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2024] [Revised: 05/07/2025] [Accepted: 03/25/2025] [Indexed: 05/09/2025] Open
Abstract
Human affective experience varies along the dimensions of valence (positivity or negativity) and arousal (high or low activation). It remains unclear how these dimensions are represented in the brain and whether the representations are shared across different individuals and diverse situational contexts. In this study, we first utilized two publicly available functional MRI datasets of participants watching movies to build predictive models of moment-to-moment emotional arousal and valence from dynamic functional brain connectivity. We tested the models by predicting emotional arousal and valence both within and across datasets. Our results revealed a generalizable arousal representation characterized by the interactions between multiple large-scale functional networks. The arousal representation generalized to two additional movie-watching datasets with different participants viewing different movies. In contrast, we did not find evidence of a generalizable valence representation. Taken together, our findings reveal a generalizable representation of emotional arousal embedded in patterns of dynamic functional connectivity, suggesting a common underlying neural signature of emotional arousal across individuals and situational contexts. We have made our model and analysis scripts publicly available to facilitate its use by other researchers in decoding moment-to-moment emotional arousal in novel datasets, providing a new tool to probe affective experience using fMRI.
Collapse
Affiliation(s)
- Jin Ke
- Department of Psychology, Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
- Department of Psychology, Yale University, New Haven, Connecticut, United States of America
| | - Hayoung Song
- Department of Psychology, Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
- Department of Neuroscience, Washington University School of Medicine, St Louis, Missouri, United States of America
| | - Zihan Bai
- Department of Psychology, Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
- Department of Psychiatry, Yale School of Medicine, New Haven, Connecticut, United States of America
| | - Monica D. Rosenberg
- Department of Psychology, Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
- Institute of Mind and Biology, Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
- Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
| | - Yuan Chang Leong
- Department of Psychology, Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
- Institute of Mind and Biology, Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
- Neuroscience Institute, The University of Chicago, Chicago, Illinois, United States of America
| |
Collapse
|
4
|
Sun L, Li S, Ren P, Liu Q, Li Z, Liang X. Pattern Separation and Pattern Completion Within the Hippocampal Circuit During Naturalistic Stimuli. Hum Brain Mapp 2025; 46:e70150. [PMID: 39878229 PMCID: PMC11775762 DOI: 10.1002/hbm.70150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2023] [Revised: 12/05/2024] [Accepted: 01/17/2025] [Indexed: 01/31/2025] Open
Abstract
Pattern separation and pattern completion in the hippocampus play a critical role in episodic learning and memory. However, there is limited empirical evidence supporting the role of the hippocampal circuit in these processes during complex continuous experiences. In this study, we analyzed high-resolution fMRI data from the "Forrest Gump" open-access dataset (16 participants) using a sliding-window temporal autocorrelation approach to investigate whether the canonical hippocampal circuit (DG-CA3-CA1-SUB) shows evidence consistent with the occurrence of pattern separation or pattern completion during a naturalistic audio movie task. Our results revealed that when processing continuous naturalistic stimuli, the DG-CA3 pair exhibited evidence consistent with the occurrence of the pattern separation process, whereas both the CA3-CA1 and CA1-SUB pairs showed evidence consistent with pattern completion. Moreover, during the latter half of the audio movie, we observed evidence consistent with a reduction in pattern completion in the CA3-CA1 pair and an increase in pattern completion in the CA1-SUB pair. Overall, these findings improve our understanding of the evidence related to the occurrence of pattern separation and pattern completion processes during natural experiences.
Collapse
Affiliation(s)
- Lili Sun
- School of Life Science and Technology, HIT Faculty of Life Science and MedicineHarbin Institute of TechnologyHarbinChina
- Research Center for Social Computing and Information RetrievalHarbin Institute of TechnologyHarbinChina
| | | | - Peng Ren
- Institute of Science and Technology for Brain‐Inspired Intelligence and Department of Neurology, Huashan HospitalFudan UniversityShanghaiChina
| | - Qiuyi Liu
- School of Life Science and Technology, HIT Faculty of Life Science and MedicineHarbin Institute of TechnologyHarbinChina
- Research Center for Social Computing and Information RetrievalHarbin Institute of TechnologyHarbinChina
| | - Zhipeng Li
- School of Life Science and Technology, HIT Faculty of Life Science and MedicineHarbin Institute of TechnologyHarbinChina
- Research Center for Social Computing and Information RetrievalHarbin Institute of TechnologyHarbinChina
| | - Xia Liang
- Research Center for Social Computing and Information RetrievalHarbin Institute of TechnologyHarbinChina
- Frontiers Science Center for Matter Behave in Space EnvironmentHarbin Institute of TechnologyHarbinChina
| |
Collapse
|
5
|
Rampinini A, Balboni I, Kepinska O, Berthele R, Golestani N. NEBULA101: an open dataset for the study of language aptitude in behaviour, brain structure and function. Sci Data 2025; 12:19. [PMID: 39762267 PMCID: PMC11704325 DOI: 10.1038/s41597-024-04357-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Accepted: 12/20/2024] [Indexed: 01/11/2025] Open
Abstract
This paper introduces the "NEBULA101 - Neuro-behavioural Understanding of Language Aptitude" dataset, which comprises behavioural and brain imaging data from 101 healthy adults to examine individual differences in language and cognition. Human language, a multifaceted behaviour, varies significantly among individuals, at different processing levels. Recent advances in cognitive science have embraced an integrated approach, combining behavioural and brain studies to explore these differences comprehensively. The NEBULA101 dataset offers brain structural, diffusion-weighted, task-based and resting-state MRI data, alongside extensive linguistic and non-linguistic behavioural measures to explore the complex interaction of language and cognition in a highly multilingual sample. By sharing this multimodal dataset, we hope to promote research on the neuroscience of language, cognition and multilingualism, enabling the field to deepen its understanding of the multivariate panorama of individual differences and ultimately contributing to open science.
Collapse
Affiliation(s)
- Alessandra Rampinini
- Brain and Language Lab, Department of Psychology, Faculty of Psychology and Education Science, University of Geneva, Geneva, Switzerland.
- National Centre of Competence in Research Evolving Language, Swiss National Science Foundation, Switzerland.
| | - Irene Balboni
- Brain and Language Lab, Department of Psychology, Faculty of Psychology and Education Science, University of Geneva, Geneva, Switzerland
- National Centre of Competence in Research Evolving Language, Swiss National Science Foundation, Switzerland
- Brain and Language Lab, Vienna Cognitive Science Hub, University of Vienna, Vienna, Austria
- Department of Behavioural and Cognitive Biology, Faculty of Life Sciences, University of Vienna, Vienna, Austria
- Institute of Multilingualism, University of Fribourg, Fribourg, Switzerland
| | - Olga Kepinska
- Brain and Language Lab, Vienna Cognitive Science Hub, University of Vienna, Vienna, Austria
- Department of Behavioural and Cognitive Biology, Faculty of Life Sciences, University of Vienna, Vienna, Austria
| | - Raphael Berthele
- National Centre of Competence in Research Evolving Language, Swiss National Science Foundation, Switzerland
- Institute of Multilingualism, University of Fribourg, Fribourg, Switzerland
| | - Narly Golestani
- Brain and Language Lab, Department of Psychology, Faculty of Psychology and Education Science, University of Geneva, Geneva, Switzerland
- National Centre of Competence in Research Evolving Language, Swiss National Science Foundation, Switzerland
- Brain and Language Lab, Vienna Cognitive Science Hub, University of Vienna, Vienna, Austria
- Department of Behavioural and Cognitive Biology, Faculty of Life Sciences, University of Vienna, Vienna, Austria
| |
Collapse
|
6
|
Kupers ER, Knapen T, Merriam EP, Kay KN. Principles of intensive human neuroimaging. Trends Neurosci 2024; 47:856-864. [PMID: 39455343 PMCID: PMC11563852 DOI: 10.1016/j.tins.2024.09.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2024] [Revised: 08/28/2024] [Accepted: 09/27/2024] [Indexed: 10/28/2024]
Abstract
The rise of large, publicly shared functional magnetic resonance imaging (fMRI) data sets in human neuroscience has focused on acquiring either a few hours of data on many individuals ('wide' fMRI) or many hours of data on a few individuals ('deep' fMRI). In this opinion article, we highlight an emerging approach within deep fMRI, which we refer to as 'intensive' fMRI: one that strives for extensive sampling of cognitive phenomena to support computational modeling and detailed investigation of brain function at the single voxel level. We discuss the fundamental principles, trade-offs, and practical considerations of intensive fMRI. We also emphasize that intensive fMRI does not simply mean collecting more data: it requires careful design of experiments to enable a rich hypothesis space, optimizing data quality, and strategically curating public resources to maximize community impact.
Collapse
Affiliation(s)
- Eline R Kupers
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN, USA; Department of Psychology, Stanford University, Stanford, CA, USA.
| | - Tomas Knapen
- Spinoza Centre for Neuroimaging, Amsterdam, the Netherlands; Netherlands Institute for Neuroscience, Royal Netherlands Academy of Sciences, Amsterdam, the Netherlands; Cognitive Psychology, Faculty of Behavioural and Movement Sciences, Vrije Universiteit, Amsterdam, the Netherlands
| | - Elisha P Merriam
- Laboratory of Brain and Cognition, National Institute of Mental Health, NIH, Bethesda, MD, USA
| | - Kendrick N Kay
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, MN, USA.
| |
Collapse
|
7
|
Mochalski LN, Friedrich P, Li X, Kröll J, Eickhoff SB, Weis S. Inter- and intra-subject similarity in network functional connectivity across a full narrative movie. Hum Brain Mapp 2024; 45:e26802. [PMID: 39086203 PMCID: PMC11291869 DOI: 10.1002/hbm.26802] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 07/11/2024] [Accepted: 07/17/2024] [Indexed: 08/02/2024] Open
Abstract
Naturalistic paradigms, such as watching movies during functional magnetic resonance imaging, are thought to prompt the emotional and cognitive processes typically elicited in real life situations. Therefore, naturalistic viewing (NV) holds great potential for studying individual differences. Previous studies have primarily focused on using shorter movie clips, geared toward eliciting specific and often isolated emotions, while the potential behind using full narratives depicted in commercial movies as a proxy for real-life experiences has barely been explored. Here, we offer preliminary evidence that a full narrative movie (FNM), that is, a movie covering a complete narrative arc, can capture complex socio-affective dynamics and their links to individual differences. Using the studyforrest dataset, we investigated inter- and intra-subject similarity in network functional connectivity (NFC) of 14 meta-analytically defined networks across a full narrative, audio-visual movie split into eight consecutive movie segments. We characterized the movie segments by valence and arousal portrayed within the sequences, before utilizing a linear mixed model to analyze which factors explain inter- and intra-subject similarity. Our results show that the model best explaining inter-subject similarity comprised network, movie segment, valence and a movie segment by valence interaction. Intra-subject similarity was influenced significantly by the same factors and an additional three-way interaction between movie segment, valence and arousal. Overall, inter- and intra-subject similarity in NFC were sensitive to the ongoing narrative and emotions in the movie. We conclude that FNMs offer complex content and dynamics that might be particularly valuable for studying individual differences. Further characterization of movie features, such as the overarching narratives, that enhance individual differences is needed for advancing the potential of NV research.
Collapse
Affiliation(s)
- Lisa N. Mochalski
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM‐7)Research Centre JülichJülichGermany
- Institute of Systems Neuroscience, Medical FacultyHeinrich Heine University DüsseldorfDüsseldorfGermany
| | - Patrick Friedrich
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM‐7)Research Centre JülichJülichGermany
| | - Xuan Li
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM‐7)Research Centre JülichJülichGermany
| | - Jean‐Philippe Kröll
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM‐7)Research Centre JülichJülichGermany
| | - Simon B. Eickhoff
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM‐7)Research Centre JülichJülichGermany
- Institute of Systems Neuroscience, Medical FacultyHeinrich Heine University DüsseldorfDüsseldorfGermany
| | - Susanne Weis
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM‐7)Research Centre JülichJülichGermany
- Institute of Systems Neuroscience, Medical FacultyHeinrich Heine University DüsseldorfDüsseldorfGermany
| |
Collapse
|
8
|
Brignol A, Paas A, Sotelo-Castro L, St-Onge D, Beltrame G, Coffey EBJ. Overcoming boundaries: Interdisciplinary challenges and opportunities in cognitive neuroscience. Neuropsychologia 2024; 200:108903. [PMID: 38750788 DOI: 10.1016/j.neuropsychologia.2024.108903] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 03/13/2024] [Accepted: 05/06/2024] [Indexed: 05/26/2024]
Abstract
Cognitive neuroscience has considerable untapped potential to translate our understanding of brain function into applications that maintain, restore, or enhance human cognition. Complex, real-world phenomena encountered in daily life, professional contexts, and in the arts, can also be a rich source of information for better understanding cognition, which in turn can lead to advances in knowledge and health outcomes. Interdisciplinary work is needed for these bi-directional benefits to be realized. Our cognitive neuroscience team has been collaborating on several interdisciplinary projects: hardware and software development for brain stimulation, measuring human operator state in safety-critical robotics environments, and exploring emotional regulation in actors who perform traumatic narratives. Our approach is to study research questions of mutual interest in the contexts of domain-specific applications, using (and sometimes improving) the experimental tools and techniques of cognitive neuroscience. These interdisciplinary attempts are described as case studies in the present work to illustrate non-trivial challenges that come from working across traditional disciplinary boundaries. We reflect on how obstacles to interdisciplinary work can be overcome, with the goals of enriching our understanding of human cognition and amplifying the positive effects cognitive neuroscientists have on society and innovation.
Collapse
Affiliation(s)
- Arnaud Brignol
- Department of Psychology, Concordia University, Montreal, QC, Canada; Department of Computer and Software Engineering, Polytechnique Montreal, Montreal, QC, Canada.
| | - Anita Paas
- Department of Psychology, Concordia University, Montreal, QC, Canada; Department of Mechanical Engineering, Ecole de Technologie Supérieure (ETS), Montreal, QC, Canada
| | | | - David St-Onge
- Department of Mechanical Engineering, Ecole de Technologie Supérieure (ETS), Montreal, QC, Canada
| | - Giovanni Beltrame
- Department of Computer and Software Engineering, Polytechnique Montreal, Montreal, QC, Canada
| | - Emily B J Coffey
- Department of Psychology, Concordia University, Montreal, QC, Canada
| |
Collapse
|
9
|
Halchenko YO, Goncalves M, Ghosh S, Velasco P, Visconti di Oleggio Castello M, Salo T, Wodder JT, Hanke M, Sadil P, Gorgolewski KJ, Ioanas HI, Rorden C, Hendrickson TJ, Dayan M, Houlihan SD, Kent J, Strauss T, Lee J, To I, Markiewicz CJ, Lukas D, Butler ER, Thompson T, Termenon M, Smith DV, Macdonald A, Kennedy DN. HeuDiConv - flexible DICOM conversion into structured directory layouts. JOURNAL OF OPEN SOURCE SOFTWARE 2024; 9:5839. [PMID: 39323511 PMCID: PMC11423922 DOI: 10.21105/joss.05839] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 09/27/2024]
Affiliation(s)
- Yaroslav O Halchenko
- Center for Open Neuroscience, Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | | | - Satrajit Ghosh
- McGovern Institute, Massachusetts Institute of Technology, Cambridge, MA, USA
| | | | | | - Taylor Salo
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, USA
| | - John T Wodder
- Center for Open Neuroscience, Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Michael Hanke
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Patrick Sadil
- Department of Biostatistics, Johns Hopkins Bloomberg School of Public Health, Baltimore, MD, USA
| | | | - Horea-Ioan Ioanas
- Center for Open Neuroscience, Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Chris Rorden
- Department of Psychology, University of South Carolina, Columbia, SC, USA
| | - Timothy J Hendrickson
- Masonic Institute for the Developing Brain, University of Minnesota, Minneapolis, MN, USA
- Minnesota Supercomputing Institute, University of Minnesota, Minneapolis, MN, USA
| | - Michael Dayan
- Human Neuroscience Platform, Fondation Campus Biotech Geneva, Geneva, Switzerland
| | - Sean Dae Houlihan
- Center for Open Neuroscience, Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - James Kent
- Department of Psychology, University of Texas at Austin, Austin, TX, USA
| | - Ted Strauss
- McConnell Brain Imaging Centre, McGill University, Montreal, QC, Canada
| | - John Lee
- Data Science and Sharing Team, National Institute of Mental Health, Bethesda, MD, USA
| | - Isaac To
- Center for Open Neuroscience, Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | | | - Darren Lukas
- Institute for Glycomics, Griffith University, QLD, Australia
| | - Ellyn R Butler
- Department of Psychology, Northwestern University, Evanston, IL, USA
| | - Todd Thompson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Maite Termenon
- Biomedical Engineering Department, Faculty of Engineering, Mondragon University, Mondragon, Spain
- BCBL, Basque center on Cognition, Brain and Language, San Sebastian, Spain
| | - David V Smith
- Department of Psychology and Neuroscience, Temple University, Philadelphia, PA, USA
| | - Austin Macdonald
- Center for Open Neuroscience, Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - David N Kennedy
- Departments of Psychiatry and Radiology, University of Massachusetts Chan Medical School, Worcester, MA, USA
| |
Collapse
|
10
|
Pinho AL, Richard H, Ponce AF, Eickenberg M, Amadon A, Dohmatob E, Denghien I, Torre JJ, Shankar S, Aggarwal H, Thual A, Chapalain T, Ginisty C, Becuwe-Desmidt S, Roger S, Lecomte Y, Berland V, Laurier L, Joly-Testault V, Médiouni-Cloarec G, Doublé C, Martins B, Varoquaux G, Dehaene S, Hertz-Pannier L, Thirion B. Individual Brain Charting dataset extension, third release for movie watching and retinotopy data. Sci Data 2024; 11:590. [PMID: 38839770 PMCID: PMC11153490 DOI: 10.1038/s41597-024-03390-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 05/20/2024] [Indexed: 06/07/2024] Open
Abstract
The Individual Brain Charting (IBC) is a multi-task functional Magnetic Resonance Imaging dataset acquired at high spatial-resolution and dedicated to the cognitive mapping of the human brain. It consists in the deep phenotyping of twelve individuals, covering a broad range of psychological domains suitable for functional-atlasing applications. Here, we present the inclusion of task data from both naturalistic stimuli and trial-based designs, to uncover structures of brain activation. We rely on the Fast Shared Response Model (FastSRM) to provide a data-driven solution for modelling naturalistic stimuli, typically containing many features. We show that data from left-out runs can be reconstructed using FastSRM, enabling the extraction of networks from the visual, auditory and language systems. We also present the topographic organization of the visual system through retinotopy. In total, six new tasks were added to IBC, wherein four trial-based retinotopic tasks contributed with a mapping of the visual field to the cortex. IBC is open access: source plus derivatives imaging data and meta-data are available in public repositories.
Collapse
Affiliation(s)
- Ana Luísa Pinho
- Université Paris-Saclay, Inria, CEA, Palaiseau, 91120, France.
- Department of Computer Science, Western University, London, Ontario, Canada.
- Western Centre for Brain and Mind, Western University, London, Ontario, Canada.
| | - Hugo Richard
- Université Paris-Saclay, Inria, CEA, Palaiseau, 91120, France
- Criteo AI Labs, Paris, France
- FAIRPLAY - IA coopérative: équité, vie privée, incitations, Paris, France
| | | | - Michael Eickenberg
- Université Paris-Saclay, Inria, CEA, Palaiseau, 91120, France
- Flatiron Institute, New York, USA
| | - Alexis Amadon
- Université Paris-Saclay, CEA, CNRS, BAOBAB, NeuroSpin, 91191, Gif-sur-Yvette, France
| | - Elvis Dohmatob
- Université Paris-Saclay, Inria, CEA, Palaiseau, 91120, France
- Meta FAIR, Paris, France
| | - Isabelle Denghien
- Cognitive Neuroimaging Unit, INSERM, CEA, Université Paris-Saclay, NeuroSpin center, 91191, Gif-sur-Yvette, France
| | | | - Swetha Shankar
- Université Paris-Saclay, Inria, CEA, Palaiseau, 91120, France
| | | | - Alexis Thual
- Université Paris-Saclay, Inria, CEA, Palaiseau, 91120, France
- Cognitive Neuroimaging Unit, INSERM, CEA, Université Paris-Saclay, NeuroSpin center, 91191, Gif-sur-Yvette, France
- Collège de France, Paris, France
| | | | | | | | | | - Yann Lecomte
- CEA Saclay/DRF/IFJ/NeuroSpin/UNIACT, Paris, France
| | | | | | | | | | | | | | - Gaël Varoquaux
- Université Paris-Saclay, Inria, CEA, Palaiseau, 91120, France
| | - Stanislas Dehaene
- Cognitive Neuroimaging Unit, INSERM, CEA, Université Paris-Saclay, NeuroSpin center, 91191, Gif-sur-Yvette, France
- Collège de France, Paris, France
| | - Lucie Hertz-Pannier
- CEA Saclay/DRF/IFJ/NeuroSpin/UNIACT, Paris, France
- UMR 1141, NeuroDiderot, Université de Paris, Paris, France
| | | |
Collapse
|
11
|
Xu M, Ribeiro FL, Barth M, Bernier M, Bollmann S, Chatterjee S, Cognolato F, Gulban OF, Itkyal V, Liu S, Mattern H, Polimeni JR, Shaw TB, Speck O, Bollmann S. VesselBoost: A Python Toolbox for Small Blood Vessel Segmentation in Human Magnetic Resonance Angiography Data. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.05.22.595251. [PMID: 38826408 PMCID: PMC11142164 DOI: 10.1101/2024.05.22.595251] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2024]
Abstract
Magnetic resonance angiography (MRA) performed at ultra-high magnetic field provides a unique opportunity to study the arteries of the living human brain at the mesoscopic level. From this, we can gain new insights into the brain's blood supply and vascular disease affecting small vessels. However, for quantitative characterization and precise representation of human angioarchitecture to, for example, inform blood-flow simulations, detailed segmentations of the smallest vessels are required. Given the success of deep learning-based methods in many segmentation tasks, we here explore their application to high-resolution MRA data, and address the difficulty of obtaining large data sets of correctly and comprehensively labelled data. We introduce VesselBoost, a vessel segmentation package, which utilizes deep learning and imperfect training labels for accurate vasculature segmentation. Combined with an innovative data augmentation technique, which leverages the resemblance of vascular structures, VesselBoost enables detailed vascular segmentations.
Collapse
Affiliation(s)
- Marshall Xu
- School of Electrical Engineering and Computer Science, The University of Queensland, Brisbane, QLD, Australia
| | - Fernanda L Ribeiro
- School of Electrical Engineering and Computer Science, The University of Queensland, Brisbane, QLD, Australia
| | - Markus Barth
- School of Electrical Engineering and Computer Science, The University of Queensland, Brisbane, QLD, Australia
| | - Michaël Bernier
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
- Department of Radiology, Harvard Medical School, Boston, MA, USA
| | - Steffen Bollmann
- School of Electrical Engineering and Computer Science, The University of Queensland, Brisbane, QLD, Australia
- Queensland Digital Health Centre, The University of Queensland, Brisbane, QLD, Australia
| | - Soumick Chatterjee
- Department of Biomedical Magnetic Resonance, Institute of Experimental Physics, Otto-von-Guericke-University, Magdeburg, ST, Germany
- Data and Knowledge Engineering Group, Faculty of Computer Science, Otto von Guericke University Magdeburg, ST, Germany
- Genomics Research Centre, Human Technopole, Milan, LOM, Italy
| | - Francesco Cognolato
- Centre for Advanced Imaging, The University of Queensland, Brisbane, QLD, Australia
- ARC Training Centre for Innovation in Biomedical Imaging Technology, The University of Queensland, Brisbane, QLD, Australia
| | - Omer Faruk Gulban
- Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, LI, Netherlands
- Brain Innovation, Maastricht, LI, Netherlands
| | - Vaibhavi Itkyal
- Department of Biotechnology, Indian Institute of Technology, Madras, TN, India
| | - Siyu Liu
- School of Electrical Engineering and Computer Science, The University of Queensland, Brisbane, QLD, Australia
- Australian eHealth Research Centre, CSIRO, Herston, QLD, Australia
| | - Hendrik Mattern
- Department of Biomedical Magnetic Resonance, Institute of Experimental Physics, Otto-von-Guericke-University, Magdeburg, ST, Germany
- German Center for Neurodegenerative Diseases, Magdeburg, ST, Germany
- Center for Behavioral Brain Sciences, Magdeburg, ST, Germany
| | - Jonathan R Polimeni
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, USA
- Department of Radiology, Harvard Medical School, Boston, MA, USA
- Harvard-MIT Program Health Sciences and Technology, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Thomas B Shaw
- School of Electrical Engineering and Computer Science, The University of Queensland, Brisbane, QLD, Australia
| | - Oliver Speck
- Department of Biomedical Magnetic Resonance, Institute of Experimental Physics, Otto-von-Guericke-University, Magdeburg, ST, Germany
- German Center for Neurodegenerative Diseases, Magdeburg, ST, Germany
- Center for Behavioral Brain Sciences, Magdeburg, ST, Germany
| | - Saskia Bollmann
- School of Electrical Engineering and Computer Science, The University of Queensland, Brisbane, QLD, Australia
| |
Collapse
|
12
|
Niyogi PG, Lindquist MA, Maiti T. A tensor based varying-coefficient model for multi-modal neuroimaging data analysis. IEEE TRANSACTIONS ON SIGNAL PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2024; 72:1607-1619. [PMID: 39479188 PMCID: PMC11521373 DOI: 10.1109/tsp.2024.3375768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/02/2024]
Abstract
All neuroimaging modalities have their own strengths and limitations. A current trend is toward interdisciplinary approaches that use multiple imaging methods to overcome limitations of each method in isolation. At the same time neuroimaging data is increasingly being combined with other non-imaging modalities, such as behavioral and genetic data. The data structure of many of these modalities can be expressed as time-varying multidimensional arrays (tensors), collected at different time-points on multiple subjects. Here, we consider a new approach for the study of neural correlates in the presence of tensor-valued brain images and tensor-valued covariates, where both data types are collected over the same set of time points. We propose a time-varying tensor regression model with an inherent structural composition of responses and covariates. Regression coefficients are expressed using the B-spline technique, and the basis function coefficients are estimated using CP-decomposition by minimizing a penalized loss function. We develop a varying-coefficient model for the tensor-valued regression model, where both covariates and responses are modeled as tensors. This development is a non-trivial extension of function-on-function concurrent linear models for complex and large structural data, where the inherent structures are preserved. In addition to the methodological and theoretical development, the efficacy of the proposed method based on both simulated and real data analysis (e.g., the combination of eye-tracking data and functional magnetic resonance imaging (fMRI) data) is also discussed.
Collapse
Affiliation(s)
- Pratim Guha Niyogi
- Department of Biostatistics at Johns Hopkins Bloomberg School of Public Health
| | | | - Tapabrata Maiti
- Department of Statistics and Probability, Division of Mathematical Sciences, National Science Foundation (NSF)
| |
Collapse
|
13
|
Watson DM, Andrews TJ. Mapping the functional and structural connectivity of the scene network. Hum Brain Mapp 2024; 45:e26628. [PMID: 38376190 PMCID: PMC10878195 DOI: 10.1002/hbm.26628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 01/19/2024] [Accepted: 02/05/2024] [Indexed: 02/21/2024] Open
Abstract
The recognition and perception of places has been linked to a network of scene-selective regions in the human brain. While previous studies have focussed on functional connectivity between scene-selective regions themselves, less is known about their connectivity with other cortical and subcortical regions in the brain. Here, we determine the functional and structural connectivity profile of the scene network. We used fMRI to examine functional connectivity between scene regions and across the whole brain during rest and movie-watching. Connectivity within the scene network revealed a bias between posterior and anterior scene regions implicated in perceptual and mnemonic aspects of scene perception respectively. Differences between posterior and anterior scene regions were also evident in the connectivity with cortical and subcortical regions across the brain. For example, the Occipital Place Area (OPA) and posterior Parahippocampal Place Area (PPA) showed greater connectivity with visual and dorsal attention networks, while anterior PPA and Retrosplenial Complex showed preferential connectivity with default mode and frontoparietal control networks and the hippocampus. We further measured the structural connectivity of the scene network using diffusion tractography. This indicated both similarities and differences with the functional connectivity, highlighting biases between posterior and anterior regions, but also between ventral and dorsal scene regions. Finally, we quantified the structural connectivity between the scene network and major white matter tracts throughout the brain. These findings provide a map of the functional and structural connectivity of scene-selective regions to each other and the rest of the brain.
Collapse
Affiliation(s)
- David M. Watson
- Department of Psychology and York Neuroimaging CentreUniversity of YorkYorkUK
| | - Timothy J. Andrews
- Department of Psychology and York Neuroimaging CentreUniversity of YorkYorkUK
| |
Collapse
|
14
|
Jiahui G, Feilong M, Nastase SA, Haxby JV, Gobbini MI. Cross-movie prediction of individualized functional topography. eLife 2023; 12:e86037. [PMID: 37994909 PMCID: PMC10666932 DOI: 10.7554/elife.86037] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2023] [Accepted: 11/09/2023] [Indexed: 11/24/2023] Open
Abstract
Participant-specific, functionally defined brain areas are usually mapped with functional localizers and estimated by making contrasts between responses to single categories of input. Naturalistic stimuli engage multiple brain systems in parallel, provide more ecologically plausible estimates of real-world statistics, and are friendly to special populations. The current study shows that cortical functional topographies in individual participants can be estimated with high fidelity from naturalistic stimuli. Importantly, we demonstrate that robust, individualized estimates can be obtained even when participants watched different movies, were scanned with different parameters/scanners, and were sampled from different institutes across the world. Our results create a foundation for future studies that allow researchers to estimate a broad range of functional topographies based on naturalistic movies and a normative database, making it possible to integrate high-level cognitive functions across datasets from laboratories worldwide.
Collapse
Affiliation(s)
- Guo Jiahui
- Center for Cognitive Neuroscience, Dartmouth CollegeHanoverUnited States
| | - Ma Feilong
- Center for Cognitive Neuroscience, Dartmouth CollegeHanoverUnited States
| | - Samuel A Nastase
- Princeton Neuroscience Institute, Princeton UniversityPrincetonUnited States
| | - James V Haxby
- Center for Cognitive Neuroscience, Dartmouth CollegeHanoverUnited States
| | - M Ida Gobbini
- Department of Medical and Surgical Sciences (DIMEC), University of BolognaBolognaItaly
- IRCCS, Istituto delle Scienze Neurologiche di BolognaBolognaItaly
| |
Collapse
|
15
|
Feilong M, Nastase SA, Jiahui G, Halchenko YO, Gobbini MI, Haxby JV. The individualized neural tuning model: Precise and generalizable cartography of functional architecture in individual brains. IMAGING NEUROSCIENCE (CAMBRIDGE, MASS.) 2023; 1:10.1162/imag_a_00032. [PMID: 39449717 PMCID: PMC11501089 DOI: 10.1162/imag_a_00032] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 10/26/2024]
Abstract
Quantifying how brain functional architecture differs from person to person is a key challenge in human neuroscience. Current individualized models of brain functional organization are based on brain regions and networks, limiting their use in studying fine-grained vertex-level differences. In this work, we present the individualized neural tuning (INT) model, a fine-grained individualized model of brain functional organization. The INT model is designed to have vertex-level granularity, to capture both representational and topographic differences, and to model stimulus-general neural tuning. Through a series of analyses, we demonstrate that (a) our INT model provides a reliable individualized measure of fine-grained brain functional organization, (b) it accurately predicts individualized brain response patterns to new stimuli, and (c) for many benchmarks, it requires only 10-20 minutes of data for good performance. The high reliability, specificity, precision, and generalizability of our INT model affords new opportunities for building brain-based biomarkers based on naturalistic neuroimaging paradigms.
Collapse
Affiliation(s)
- Ma Feilong
- Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH, United States
| | - Samuel A. Nastase
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, United States
| | - Guo Jiahui
- Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH, United States
| | | | - M. Ida Gobbini
- Department of Medical and Surgical Sciences, University of Bologna, Bologna, Italy
- IRCCS Istituto delle Scienze Neurologiche di Bologna, Bologna, Italy
| | - James V. Haxby
- Center for Cognitive Neuroscience, Dartmouth College, Hanover, NH, United States
| |
Collapse
|
16
|
Gong Z, Zhou M, Dai Y, Wen Y, Liu Y, Zhen Z. A large-scale fMRI dataset for the visual processing of naturalistic scenes. Sci Data 2023; 10:559. [PMID: 37612327 PMCID: PMC10447576 DOI: 10.1038/s41597-023-02471-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Accepted: 08/14/2023] [Indexed: 08/25/2023] Open
Abstract
One ultimate goal of visual neuroscience is to understand how the brain processes visual stimuli encountered in the natural environment. Achieving this goal requires records of brain responses under massive amounts of naturalistic stimuli. Although the scientific community has put a lot of effort into collecting large-scale functional magnetic resonance imaging (fMRI) data under naturalistic stimuli, more naturalistic fMRI datasets are still urgently needed. We present here the Natural Object Dataset (NOD), a large-scale fMRI dataset containing responses to 57,120 naturalistic images from 30 participants. NOD strives for a balance between sampling variation between individuals and sampling variation between stimuli. This enables NOD to be utilized not only for determining whether an observation is generalizable across many individuals, but also for testing whether a response pattern is generalized to a variety of naturalistic stimuli. We anticipate that the NOD together with existing naturalistic neuroimaging datasets will serve as a new impetus for our understanding of the visual processing of naturalistic stimuli.
Collapse
Affiliation(s)
- Zhengxin Gong
- Beijing Key Laboratory of Applied Experimental Psychology, Faculty of Psychology, Beijing Normal University, Beijing, 100875, China
| | - Ming Zhou
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China
| | - Yuxuan Dai
- Beijing Key Laboratory of Applied Experimental Psychology, Faculty of Psychology, Beijing Normal University, Beijing, 100875, China
| | - Yushan Wen
- Beijing Key Laboratory of Applied Experimental Psychology, Faculty of Psychology, Beijing Normal University, Beijing, 100875, China
| | - Youyi Liu
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China.
| | - Zonglei Zhen
- Beijing Key Laboratory of Applied Experimental Psychology, Faculty of Psychology, Beijing Normal University, Beijing, 100875, China.
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, 100875, China.
| |
Collapse
|
17
|
Clark IA, Maguire EA. Release of cognitive and multimodal MRI data including real-world tasks and hippocampal subfield segmentations. Sci Data 2023; 10:540. [PMID: 37587129 PMCID: PMC10432478 DOI: 10.1038/s41597-023-02449-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 08/07/2023] [Indexed: 08/18/2023] Open
Abstract
We share data from N = 217 healthy adults (mean age 29 years, range 20-41; 109 females, 108 males) who underwent extensive cognitive assessment and neuroimaging to examine the neural basis of individual differences, with a particular focus on a brain structure called the hippocampus. Cognitive data were collected using a wide array of questionnaires, naturalistic tests that examined imagination, autobiographical memory recall and spatial navigation, traditional laboratory-based tests such as recalling word pairs, and comprehensive characterisation of the strategies used to perform the cognitive tests. 3 Tesla MRI data were also acquired and include multi-parameter mapping to examine tissue microstructure, diffusion-weighted MRI, T2-weighted high-resolution partial volume structural MRI scans (with the masks of hippocampal subfields manually segmented from these scans), whole brain resting state functional MRI scans and partial volume high resolution resting state functional MRI scans. This rich dataset will be of value to cognitive and clinical neuroscientists researching individual differences, real-world cognition, brain-behaviour associations, hippocampal subfields and more. All data are freely available on Dryad.
Collapse
Affiliation(s)
- Ian A Clark
- Wellcome Centre for Human Neuroimaging, Department of Imaging Neuroscience, UCL Queen Square Institute of Neurology, University College London, London, UK
| | - Eleanor A Maguire
- Wellcome Centre for Human Neuroimaging, Department of Imaging Neuroscience, UCL Queen Square Institute of Neurology, University College London, London, UK.
| |
Collapse
|
18
|
Mizrahi T, Axelrod V. Naturalistic auditory stimuli with fNIRS prefrontal cortex imaging: A potential paradigm for disorder of consciousness diagnostics (a study with healthy participants). Neuropsychologia 2023; 187:108604. [PMID: 37271305 DOI: 10.1016/j.neuropsychologia.2023.108604] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 06/01/2023] [Accepted: 06/02/2023] [Indexed: 06/06/2023]
Abstract
Disorder of consciousness (DOC) is a devastating condition due to brain damage. A patient in this condition is non-responsive, but nevertheless might be conscious at least at some level. Determining the conscious level of DOC patients is important for both medical and ethical reasons, but reliably achieving this has been a major challenge. Naturalistic stimuli in combination with neuroimaging have been proposed as a promising approach for DOC patient diagnosis. Capitalizing on and extending this proposal, the goal of the present study conducted with healthy participants was to develop a new paradigm with naturalistic auditory stimuli and functional near-infrared spectroscopy (fNIRS) - an approach that can be used at the bedside. Twenty-four healthy participants passively listened to 9 min of auditory story, scrambled auditory story, classical music, and scrambled classical music segments while their prefrontal cortex activity was recorded using fNIRS. We found much higher intersubject correlation (ISC) during story compared to scrambled story conditions both at the group level and in the majority of individual subjects, suggesting that fNIRS imaging of the prefrontal cortex might be a sensitive method to capture neural changes associated with narrative comprehension. In contrast, the ISC during the classical music segment did not differ reliably from scrambled classical music and was also much lower than the story condition. Our main result is that naturalistic auditory stories with fNIRS might be used in a clinical setup to identify high-level processing and potential consciousness in DOC patients.
Collapse
Affiliation(s)
- Tamar Mizrahi
- The Gonda Multidisciplinary Brain Research Center, Bar Ilan University, Ramat Gan, Israel; Head Injuries Rehabilitation Department, Sheba Medical Center, Ramat Gan, Israel
| | - Vadim Axelrod
- The Gonda Multidisciplinary Brain Research Center, Bar Ilan University, Ramat Gan, Israel.
| |
Collapse
|
19
|
Yang E, Milisav F, Kopal J, Holmes AJ, Mitsis GD, Misic B, Finn ES, Bzdok D. The default network dominates neural responses to evolving movie stories. Nat Commun 2023; 14:4197. [PMID: 37452058 PMCID: PMC10349102 DOI: 10.1038/s41467-023-39862-y] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2022] [Accepted: 06/27/2023] [Indexed: 07/18/2023] Open
Abstract
Neuroscientific studies exploring real-world dynamic perception often overlook the influence of continuous changes in narrative content. In our research, we utilize machine learning tools for natural language processing to examine the relationship between movie narratives and neural responses. By analyzing over 50,000 brain images of participants watching Forrest Gump from the studyforrest dataset, we find distinct brain states that capture unique semantic aspects of the unfolding story. The default network, associated with semantic information integration, is the most engaged during movie watching. Furthermore, we identify two mechanisms that underlie how the default network liaises with the amygdala and hippocampus. Our findings demonstrate effective approaches to understanding neural processes in everyday situations and their relation to conscious awareness.
Collapse
Affiliation(s)
- Enning Yang
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
- Mila-Quebec Artificial Intelligence Institute, Montreal, QC, Canada
| | - Filip Milisav
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
| | - Jakub Kopal
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
- Mila-Quebec Artificial Intelligence Institute, Montreal, QC, Canada
| | - Avram J Holmes
- Department of Psychology and Psychiatry, Yale University, New Haven, CT, USA
| | - Georgios D Mitsis
- Department of Bioengineering, McGill University, Montreal, QC, Canada
| | - Bratislav Misic
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada
| | - Emily S Finn
- Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, USA
| | - Danilo Bzdok
- Department of Biomedical Engineering, TheNeuro-Montreal Neurological Institute (MNI), McConnell Brain Imaging Centre (BIC), McGill University, Montreal, QC, Canada.
- Mila-Quebec Artificial Intelligence Institute, Montreal, QC, Canada.
| |
Collapse
|
20
|
Watson DM, Andrews TJ. Connectopic mapping techniques do not reflect functional gradients in the brain. Neuroimage 2023:120228. [PMID: 37339700 DOI: 10.1016/j.neuroimage.2023.120228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 06/08/2023] [Accepted: 06/12/2023] [Indexed: 06/22/2023] Open
Abstract
Functional gradients, in which response properties change gradually across a brain region, have been proposed as a key organising principle of the brain. Recent studies using both resting-state and natural viewing paradigms have indicated that these gradients may be reconstructed from functional connectivity patterns via "connectopic mapping" analyses. However, local connectivity patterns may be confounded by spatial autocorrelations artificially introduced during data analysis, for instance by spatial smoothing or interpolation between coordinate spaces. Here, we investigate whether such confounds can produce illusory connectopic gradients. We generated datasets comprising random white noise in subjects' functional volume spaces, then optionally applied spatial smoothing and/or interpolated the data to a different volume or surface space. Both smoothing and interpolation induced spatial autocorrelations sufficient for connectopic mapping to produce both volume- and surface-based local gradients in numerous brain regions. Furthermore, these gradients appeared highly similar to those obtained from real natural viewing data, although gradients generated from real and random data were statistically different in certain scenarios. We also reconstructed global gradients across the whole-brain - while these appeared less susceptible to artificial spatial autocorrelations, the ability to reproduce previously reported gradients was closely linked to specific features of the analysis pipeline. These results indicate that previously reported gradients identified by connectopic mapping techniques may be confounded by artificial spatial autocorrelations introduced during the analysis, and in some cases may reproduce poorly across different analysis pipelines. These findings imply that connectopic gradients need to be interpreted with caution.
Collapse
Affiliation(s)
- David M Watson
- Department of Psychology and York Neuroimaging Centre, University of York, York, UK, YO10 5DD.
| | - Timothy J Andrews
- Department of Psychology and York Neuroimaging Centre, University of York, York, UK, YO10 5DD
| |
Collapse
|
21
|
Porter A, Nielsen A, Dorn M, Dworetsky A, Edmonds D, Gratton C. Masked features of task states found in individual brain networks. Cereb Cortex 2023; 33:2879-2900. [PMID: 35802477 PMCID: PMC10016040 DOI: 10.1093/cercor/bhac247] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2021] [Revised: 05/24/2022] [Accepted: 05/24/2022] [Indexed: 11/14/2022] Open
Abstract
Completing complex tasks requires that we flexibly integrate information across brain areas. While studies have shown how functional networks are altered during different tasks, this work has generally focused on a cross-subject approach, emphasizing features that are common across people. Here we used extended sampling "precision" fMRI data to test the extent to which task states generalize across people or are individually specific. We trained classifiers to decode state using functional network data in single-person datasets across 5 diverse task states. Classifiers were then tested on either independent data from the same person or new individuals. Individualized classifiers were able to generalize to new participants. However, classification performance was significantly higher within a person, a pattern consistent across model types, people, tasks, feature subsets, and even for decoding very similar task conditions. Notably, these findings also replicated in a new independent dataset. These results suggest that individual-focused approaches can uncover robust features of brain states, including features obscured in cross-subject analyses. Individual-focused approaches have the potential to deepen our understanding of brain interactions during complex cognition.
Collapse
Affiliation(s)
- Alexis Porter
- Department of Psychology, Northwestern University, 633 Clark St, Evanston, IL 60208, United States
| | - Ashley Nielsen
- Department of Neurology, Washington University in St. Louis, 1 Brookings Dr, St. Louis, MO 63130, United States
| | - Megan Dorn
- Department of Psychology, Northwestern University, 633 Clark St, Evanston, IL 60208, United States
| | - Ally Dworetsky
- Department of Psychology, Northwestern University, 633 Clark St, Evanston, IL 60208, United States
| | - Donnisa Edmonds
- Department of Psychology, Northwestern University, 633 Clark St, Evanston, IL 60208, United States
| | - Caterina Gratton
- Department of Psychology, Northwestern University, 633 Clark St, Evanston, IL 60208, United States
- Department of Neurology, Northwestern University, 633 Clark St, Evanston, IL 60208, United States
| |
Collapse
|
22
|
Prediction of the Topography of the Corticospinal Tract on T1-Weighted MR Images Using Deep-Learning-Based Segmentation. Diagnostics (Basel) 2023; 13:diagnostics13050911. [PMID: 36900055 PMCID: PMC10000710 DOI: 10.3390/diagnostics13050911] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Revised: 02/23/2023] [Accepted: 02/27/2023] [Indexed: 03/04/2023] Open
Abstract
INTRODUCTION Tractography is an invaluable tool in the planning of tumor surgery in the vicinity of functionally eloquent areas of the brain as well as in the research of normal development or of various diseases. The aim of our study was to compare the performance of a deep-learning-based image segmentation for the prediction of the topography of white matter tracts on T1-weighted MR images to the performance of a manual segmentation. METHODS T1-weighted MR images of 190 healthy subjects from 6 different datasets were utilized in this study. Using deterministic diffusion tensor imaging, we first reconstructed the corticospinal tract on both sides. After training a segmentation model on 90 subjects of the PIOP2 dataset using the nnU-Net in a cloud-based environment with graphical processing unit (Google Colab), we evaluated its performance using 100 subjects from 6 different datasets. RESULTS Our algorithm created a segmentation model that predicted the topography of the corticospinal pathway on T1-weighted images in healthy subjects. The average dice score was 0.5479 (0.3513-0.7184) on the validation dataset. CONCLUSIONS Deep-learning-based segmentation could be applicable in the future to predict the location of white matter pathways in T1-weighted scans.
Collapse
|
23
|
Wang S, Zhang X, Zhang J, Zong C. A synchronized multimodal neuroimaging dataset for studying brain language processing. Sci Data 2022; 9:590. [PMID: 36180444 PMCID: PMC9525723 DOI: 10.1038/s41597-022-01708-5] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 08/22/2022] [Indexed: 11/15/2022] Open
Abstract
We present a synchronized multimodal neuroimaging dataset for studying brain language processing (SMN4Lang) that contains functional magnetic resonance imaging (fMRI) and magnetoencephalography (MEG) data on the same 12 healthy volunteers while the volunteers listened to 6 hours of naturalistic stories, as well as high-resolution structural (T1, T2), diffusion MRI and resting-state fMRI data for each participant. We also provide rich linguistic annotations for the stimuli, including word frequencies, syntactic tree structures, time-aligned characters and words, and various types of word and character embeddings. Quality assessment indicators verify that this is a high-quality neuroimaging dataset. Such synchronized data is separately collected by the same group of participants first listening to story materials in fMRI and then in MEG which are well suited to studying the dynamic processing of language comprehension, such as the time and location of different linguistic features encoded in the brain. In addition, this dataset, comprising a large vocabulary from stories with various topics, can serve as a brain benchmark to evaluate and improve computational language models. Measurement(s) | functional brain measurement • Magnetoencephalography | Technology Type(s) | Functional Magnetic Resonance Imaging • Magnetoencephalography | Factor Type(s) | naturalistic stimuli listening | Sample Characteristic - Organism | humanbeings |
Collapse
Affiliation(s)
- Shaonan Wang
- National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China. .,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China.
| | - Xiaohan Zhang
- National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Jiajun Zhang
- National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| | - Chengqing Zong
- National Laboratory of Pattern Recognition, Institute of Automation, CAS, Beijing, China.,School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
24
|
An evaluation of how connectopic mapping reveals visual field maps in V1. Sci Rep 2022; 12:16249. [PMID: 36171242 PMCID: PMC9519585 DOI: 10.1038/s41598-022-20322-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2022] [Accepted: 09/09/2022] [Indexed: 11/25/2022] Open
Abstract
Abstract Functional gradients, in which response properties change gradually across the cortical surface, have been proposed as a key organising principle of the brain. However, the presence of these gradients remains undetermined in many brain regions. Resting-state neuroimaging studies have suggested these gradients can be reconstructed from patterns of functional connectivity. Here we investigate the accuracy of these reconstructions and establish whether it is connectivity or the functional properties within a region that determine these “connectopic maps”. Different manifold learning techniques were used to recover visual field maps while participants were at rest or engaged in natural viewing. We benchmarked these reconstructions against maps measured by traditional visual field mapping. We report an initial exploratory experiment of a publicly available naturalistic imaging dataset, followed by a preregistered replication using larger resting-state and naturalistic imaging datasets from the Human Connectome Project. Connectopic mapping accurately predicted visual field maps in primary visual cortex, with better predictions for eccentricity than polar angle maps. Non-linear manifold learning methods outperformed simpler linear embeddings. We also found more accurate predictions during natural viewing compared to resting-state. Varying the source of the connectivity estimates had minimal impact on the connectopic maps, suggesting the key factor is the functional topography within a brain region. The application of these standardised methods for connectopic mapping will allow the discovery of functional gradients across the brain. Protocol registration The stage 1 protocol for this Registered Report was accepted in
principle on 19 April 2022. The protocol, as accepted by the journal, can be found at 10.6084/m9.figshare.19771717.
Collapse
|
25
|
Keles U, Kliemann D, Byrge L, Saarimäki H, Paul LK, Kennedy DP, Adolphs R. Atypical gaze patterns in autistic adults are heterogeneous across but reliable within individuals. Mol Autism 2022; 13:39. [PMID: 36153629 PMCID: PMC9508778 DOI: 10.1186/s13229-022-00517-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 09/16/2022] [Indexed: 11/18/2022] Open
Abstract
BACKGROUND Across behavioral studies, autistic individuals show greater variability than typically developing individuals. However, it remains unknown to what extent this variability arises from heterogeneity across individuals, or from unreliability within individuals. Here, we focus on eye tracking, which provides rich dependent measures that have been used extensively in studies of autism. Autistic individuals have an atypical gaze onto both static visual images and dynamic videos that could be leveraged for diagnostic purposes if the above open question could be addressed. METHODS We tested three competing hypotheses: (1) that gaze patterns of autistic individuals are less reliable or noisier than those of controls, (2) that atypical gaze patterns are individually reliable but heterogeneous across autistic individuals, or (3) that atypical gaze patterns are individually reliable and also homogeneous among autistic individuals. We collected desktop-based eye tracking data from two different full-length television sitcom episodes, at two independent sites (Caltech and Indiana University), in a total of over 150 adult participants (N = 48 autistic individuals with IQ in the normal range, 105 controls) and quantified gaze onto features of the videos using automated computer vision-based feature extraction. RESULTS We found support for the second of these hypotheses. Autistic people and controls showed equivalently reliable gaze onto specific features of videos, such as faces, so much so that individuals could be identified significantly above chance using a fingerprinting approach from video epochs as short as 2 min. However, classification of participants into diagnostic groups based on their eye tracking data failed to produce clear group classifications, due to heterogeneity in the autistic group. LIMITATIONS Three limitations are the relatively small sample size, assessment across only two videos (from the same television series), and the absence of other dependent measures (e.g., neuroimaging or genetics) that might have revealed individual-level variability that was not evident with eye tracking. Future studies should expand to larger samples across longer longitudinal epochs, an aim that is now becoming feasible with Internet- and phone-based eye tracking. CONCLUSIONS These findings pave the way for the investigation of autism subtypes, and for elucidating the specific visual features that best discriminate gaze patterns-directions that will also combine with and inform neuroimaging and genetic studies of this complex disorder.
Collapse
Affiliation(s)
- Umit Keles
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, USA.
| | - Dorit Kliemann
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, USA.,Department of Psychological and Brain Sciences, The University of Iowa, Iowa City, USA
| | - Lisa Byrge
- Department of Psychology, University of North Florida, Jacksonville, USA
| | - Heini Saarimäki
- Faculty of Social Sciences, Tampere University, Tampere, Finland
| | - Lynn K Paul
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, USA
| | - Daniel P Kennedy
- Department of Psychological and Brain Sciences, Indiana University, Bloomington, USA
| | - Ralph Adolphs
- Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, USA.,Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, USA.,Chen Neuroscience Institute, California Institute of Technology, Pasadena, USA
| |
Collapse
|
26
|
Kim SG. On the encoding of natural music in computational models and human brains. Front Neurosci 2022; 16:928841. [PMID: 36203808 PMCID: PMC9531138 DOI: 10.3389/fnins.2022.928841] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2022] [Accepted: 08/15/2022] [Indexed: 11/13/2022] Open
Abstract
This article discusses recent developments and advances in the neuroscience of music to understand the nature of musical emotion. In particular, it highlights how system identification techniques and computational models of music have advanced our understanding of how the human brain processes the textures and structures of music and how the processed information evokes emotions. Musical models relate physical properties of stimuli to internal representations called features, and predictive models relate features to neural or behavioral responses and test their predictions against independent unseen data. The new frameworks do not require orthogonalized stimuli in controlled experiments to establish reproducible knowledge, which has opened up a new wave of naturalistic neuroscience. The current review focuses on how this trend has transformed the domain of the neuroscience of music.
Collapse
|
27
|
de la Vega A, Rocca R, Blair RW, Markiewicz CJ, Mentch J, Kent JD, Herholz P, Ghosh SS, Poldrack RA, Yarkoni T. Neuroscout, a unified platform for generalizable and reproducible fMRI research. eLife 2022; 11:e79277. [PMID: 36040302 PMCID: PMC9489206 DOI: 10.7554/elife.79277] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 08/27/2022] [Indexed: 11/28/2022] Open
Abstract
Functional magnetic resonance imaging (fMRI) has revolutionized cognitive neuroscience, but methodological barriers limit the generalizability of findings from the lab to the real world. Here, we present Neuroscout, an end-to-end platform for analysis of naturalistic fMRI data designed to facilitate the adoption of robust and generalizable research practices. Neuroscout leverages state-of-the-art machine learning models to automatically annotate stimuli from dozens of fMRI studies using naturalistic stimuli-such as movies and narratives-allowing researchers to easily test neuroscientific hypotheses across multiple ecologically-valid datasets. In addition, Neuroscout builds on a robust ecosystem of open tools and standards to provide an easy-to-use analysis builder and a fully automated execution engine that reduce the burden of reproducible research. Through a series of meta-analytic case studies, we validate the automatic feature extraction approach and demonstrate its potential to support more robust fMRI research. Owing to its ease of use and a high degree of automation, Neuroscout makes it possible to overcome modeling challenges commonly arising in naturalistic analysis and to easily scale analyses within and across datasets, democratizing generalizable fMRI research.
Collapse
Affiliation(s)
| | - Roberta Rocca
- Department of Psychology, The University of Texas at AustinAustinUnited States
- Interacting Minds Centre, Aarhus UniversityAarhusDenmark
| | - Ross W Blair
- Department of Psychology, Stanford UniversityStanfordUnited States
| | | | - Jeff Mentch
- Program in Speech and Hearing Bioscience and Technology, Harvard UniversityCambridgeUnited States
- McGovern Institute for Brain Research, Massachusetts Institute of TechnologyCambridgeUnited States
| | - James D Kent
- Department of Psychology, The University of Texas at AustinAustinUnited States
| | - Peer Herholz
- McConnell Brain Imaging Centre, Montreal Neurological Institute, McGill UniversityMontrealCanada
| | - Satrajit S Ghosh
- McGovern Institute for Brain Research, Massachusetts Institute of TechnologyCambridgeUnited States
- Department of Otolaryngology, Harvard Medical SchoolBostonUnited States
| | | | - Tal Yarkoni
- Department of Psychology, The University of Texas at AustinAustinUnited States
| |
Collapse
|
28
|
Hoogerbrugge AJ, Strauch C, Oláh ZA, Dalmaijer ES, Nijboer TCW, Van der Stigchel S. Seeing the Forrest through the trees: Oculomotor metrics are linked to heart rate. PLoS One 2022; 17:e0272349. [PMID: 35917377 PMCID: PMC9345484 DOI: 10.1371/journal.pone.0272349] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Accepted: 07/19/2022] [Indexed: 11/18/2022] Open
Abstract
Fluctuations in a person’s arousal accompany mental states such as drowsiness, mental effort, or motivation, and have a profound effect on task performance. Here, we investigated the link between two central instances affected by arousal levels, heart rate and eye movements. In contrast to heart rate, eye movements can be inferred remotely and unobtrusively, and there is evidence that oculomotor metrics (i.e., fixations and saccades) are indicators for aspects of arousal going hand in hand with changes in mental effort, motivation, or task type. Gaze data and heart rate of 14 participants during film viewing were used in Random Forest models, the results of which show that blink rate and duration, and the movement aspect of oculomotor metrics (i.e., velocities and amplitudes) link to heart rate–more so than the amount or duration of fixations and saccades. We discuss that eye movements are not only linked to heart rate, but they may both be similarly influenced by the common underlying arousal system. These findings provide new pathways for the remote measurement of arousal, and its link to psychophysiological features.
Collapse
Affiliation(s)
- Alex J. Hoogerbrugge
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
- * E-mail:
| | - Christoph Strauch
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
| | - Zoril A. Oláh
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
| | - Edwin S. Dalmaijer
- School of Psychological Science, University of Bristol, Bristol, United Kingdom
| | - Tanja C. W. Nijboer
- Experimental Psychology, Helmholtz Institute, Utrecht University, Utrecht, Netherlands
- Center of Excellence for Rehabilitation Medicine, UMC Utrecht Brain Center, University Medical Center Utrecht, De Hoogstraat Rehabilitation, Utrecht, Netherlands
- Department of Rehabilitation, Physical Therapy Science & Sports, UMC Utrecht Brain Center, University Medical Center Utrecht, Utrecht, Netherlands
| | | |
Collapse
|
29
|
Smits FM, Geuze E, de Kort GJ, Kouwer K, Geerlings L, van Honk J, Schutter DJ. Effects of Multisession Transcranial Direct Current Stimulation on Stress Regulation and Emotional Working Memory: A Randomized Controlled Trial in Healthy Military Personnel. Neuromodulation 2022:S1094-7159(22)00721-8. [DOI: 10.1016/j.neurom.2022.05.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2022] [Revised: 05/02/2022] [Accepted: 05/02/2022] [Indexed: 10/16/2022]
|
30
|
Liu X, Dai Y, Xie H, Zhen Z. A studyforrest extension, MEG recordings while watching the audio-visual movie "Forrest Gump". Sci Data 2022; 9:206. [PMID: 35562378 PMCID: PMC9106652 DOI: 10.1038/s41597-022-01299-1] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2021] [Accepted: 03/30/2022] [Indexed: 01/01/2023] Open
Abstract
Naturalistic stimuli, such as movies, are being increasingly used to map brain function because of their high ecological validity. The pioneering studyforrest and other naturalistic neuroimaging projects have provided free access to multiple movie-watching functional magnetic resonance imaging (fMRI) datasets to prompt the community for naturalistic experimental paradigms. However, sluggish blood-oxygenation-level-dependent fMRI signals are incapable of resolving neuronal activity with the temporal resolution at which it unfolds. Instead, magnetoencephalography (MEG) measures changes in the magnetic field produced by neuronal activity and is able to capture rich dynamics of the brain at the millisecond level while watching naturalistic movies. Herein, we present the first public prolonged MEG dataset collected from 11 participants while watching the 2 h long audio-visual movie "Forrest Gump". Minimally preprocessed data was also provided to facilitate the use of the dataset. As a studyforrest extension, we envision that this dataset, together with fMRI data from the studyforrest project, will serve as a foundation for exploring the neural dynamics of various cognitive functions in real-world contexts.
Collapse
Affiliation(s)
- Xingyu Liu
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education, Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Yuxuan Dai
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education, Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Hailun Xie
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education, Faculty of Psychology, Beijing Normal University, Beijing, China
| | - Zonglei Zhen
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education, Faculty of Psychology, Beijing Normal University, Beijing, China.
- State Key Laboratory of Cognitive Neuroscience and Learning & IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China.
| |
Collapse
|
31
|
BTN: Neuroanatomical aligning between visual object tracking in deep neural network and smooth pursuit in brain. Neurocomputing 2022. [DOI: 10.1016/j.neucom.2022.02.031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
32
|
May L, Halpern AR, Paulsen SD, Casey MA. Imagined Musical Scale Relationships Decoded from Auditory Cortex. J Cogn Neurosci 2022; 34:1326-1339. [PMID: 35554552 DOI: 10.1162/jocn_a_01858] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Notes in a musical scale convey different levels of stability or incompleteness, forming what is known as a tonal hierarchy. Levels of stability conveyed by these scale degrees are partly responsible for generating expectations as a melody proceeds, for emotions deriving from fulfillment (or not) of those expectations, and for judgments of overall melodic well-formedness. These functions can be extracted even during imagined music. We investigated whether patterns of neural activity in fMRI could be used to identify heard and imagined notes, and if patterns associated with heard notes could identify notes that were merely imagined. We presented trained musicians with the beginning of a scale (key and timbre were varied). The next note in the scale was either heard or imagined. A probe tone task assessed sensitivity to the tonal hierarchy, and state and trait measures of imagery were included as predictors. Multivoxel classification yielded above-chance results in primary auditory cortex (Heschl's gyrus) for heard scale-degree decoding. Imagined scale-degree decoding was successful in multiple cortical regions spanning bilateral superior temporal, inferior parietal, precentral, and inferior frontal areas. The right superior temporal gyrus yielded successful cross-decoding of heard-to-imagined scale-degree, indicating a shared pathway between tonal-hierarchy perception and imagery. Decoding in right and left superior temporal gyrus and right inferior frontal gyrus was more successful in people with more differentiated tonal hierarchies and in left inferior frontal gyrus among people with higher self-reported auditory imagery vividness, providing a link between behavioral traits and success of neural decoding. These results point to the neural specificity of imagined auditory experiences-even of such functional knowledge-but also document informative individual differences in the precision of that neural response.
Collapse
|
33
|
Häusler CO, Eickhoff SB, Hanke M. Processing of visual and non-visual naturalistic spatial information in the "parahippocampal place area". Sci Data 2022; 9:147. [PMID: 35365659 PMCID: PMC8975992 DOI: 10.1038/s41597-022-01250-4] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2021] [Accepted: 02/14/2022] [Indexed: 11/09/2022] Open
Abstract
The "parahippocampal place area" (PPA) in the human ventral visual stream exhibits increased hemodynamic activity correlated with the perception of landscape photos compared to faces or objects. Here, we investigate the perception of scene-related, spatial information embedded in two naturalistic stimuli. The same 14 participants were watching a Hollywood movie and listening to its audio-description as part of the open-data resource studyforrest.org. We model hemodynamic activity based on annotations of selected stimulus features, and compare results to a block-design visual localizer. On a group level, increased activation correlating with visual spatial information occurring in the movie is overlapping with a traditionally localized PPA. Activation correlating with semantic spatial information occurring in the audio-description is more restricted to the anterior PPA. On an individual level, we find significant bilateral activity in the PPA of nine individuals and unilateral activity in one individual. Results suggest that activation in the PPA generalizes to spatial information embedded in a movie and an auditory narrative, and may call for considering a functional subdivision of the PPA.
Collapse
Affiliation(s)
- Christian O Häusler
- Psychoinformatics Lab, Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany. .,Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University, Düsseldorf, Germany.
| | - Simon B Eickhoff
- Psychoinformatics Lab, Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.,Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University, Düsseldorf, Germany
| | - Michael Hanke
- Psychoinformatics Lab, Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Centre Jülich, Jülich, Germany.,Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University, Düsseldorf, Germany
| |
Collapse
|
34
|
Berezutskaya J, Vansteensel MJ, Aarnoutse EJ, Freudenburg ZV, Piantoni G, Branco MP, Ramsey NF. Open multimodal iEEG-fMRI dataset from naturalistic stimulation with a short audiovisual film. Sci Data 2022; 9:91. [PMID: 35314718 PMCID: PMC8938409 DOI: 10.1038/s41597-022-01173-0] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Accepted: 01/24/2022] [Indexed: 12/19/2022] Open
Abstract
Intracranial human recordings are a valuable and rare resource of information about the brain. Making such data publicly available not only helps tackle reproducibility issues in science, it helps make more use of these valuable data. This is especially true for data collected using naturalistic tasks. Here, we describe a dataset collected from a large group of human subjects while they watched a short audiovisual film. The dataset has several unique features. First, it includes a large amount of intracranial electroencephalography (iEEG) data (51 participants, age range of 5-55 years, who all performed the same task). Second, it includes functional magnetic resonance imaging (fMRI) recordings (30 participants, age range of 7-47) during the same task. Eighteen participants performed both iEEG and fMRI versions of the task, non-simultaneously. Third, the data were acquired using a rich audiovisual stimulus, for which we provide detailed speech and video annotations. This dataset can be used to study neural mechanisms of multimodal perception and language comprehension, and similarity of neural signals across brain recording modalities.
Collapse
Affiliation(s)
- Julia Berezutskaya
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands.
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, the Netherlands.
| | - Mariska J Vansteensel
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Erik J Aarnoutse
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Zachary V Freudenburg
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Giovanni Piantoni
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Mariana P Branco
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Nick F Ramsey
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, the Netherlands
| |
Collapse
|
35
|
Wagner AS, Waite LK, Wierzba M, Hoffstaedter F, Waite AQ, Poldrack B, Eickhoff SB, Hanke M. FAIRly big: A framework for computationally reproducible processing of large-scale data. Sci Data 2022; 9:80. [PMID: 35277501 PMCID: PMC8917149 DOI: 10.1038/s41597-022-01163-2] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2021] [Accepted: 02/11/2022] [Indexed: 11/30/2022] Open
Abstract
Large-scale datasets present unique opportunities to perform scientific investigations with unprecedented breadth. However, they also pose considerable challenges for the findability, accessibility, interoperability, and reusability (FAIR) of research outcomes due to infrastructure limitations, data usage constraints, or software license restrictions. Here we introduce a DataLad-based, domain-agnostic framework suitable for reproducible data processing in compliance with open science mandates. The framework attempts to minimize platform idiosyncrasies and performance-related complexities. It affords the capture of machine-actionable computational provenance records that can be used to retrace and verify the origins of research outcomes, as well as be re-executed independent of the original computing infrastructure. We demonstrate the framework's performance using two showcases: one highlighting data sharing and transparency (using the studyforrest.org dataset) and another highlighting scalability (using the largest public brain imaging dataset available: the UK Biobank dataset).
Collapse
Affiliation(s)
- Adina S Wagner
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany.
| | - Laura K Waite
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
| | - Małgorzata Wierzba
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
- Laboratory of Brain Imaging, Nencki Institute of Experimental Biology, Polish Academy of Sciences, Warsaw, Poland
| | - Felix Hoffstaedter
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
| | - Alexander Q Waite
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
| | - Benjamin Poldrack
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
| | - Simon B Eickhoff
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| | - Michael Hanke
- Institute of Neuroscience and Medicine, Brain & Behaviour (INM-7), Research Center Jülich, Jülich, Germany
- Institute of Systems Neuroscience, Medical Faculty, Heinrich Heine University Düsseldorf, Düsseldorf, Germany
| |
Collapse
|
36
|
Rosenfeld DL, Balcetis E, Bastian B, Berkman ET, Bosson JK, Brannon TN, Burrow AL, Cameron CD, Chen S, Cook JE, Crandall C, Davidai S, Dhont K, Eastwick PW, Gaither SE, Gangestad SW, Gilovich T, Gray K, Haines EL, Haselton MG, Haslam N, Hodson G, Hogg MA, Hornsey MJ, Huo YJ, Joel S, Kachanoff FJ, Kraft-Todd G, Leary MR, Ledgerwood A, Lee RT, Loughnan S, MacInnis CC, Mann T, Murray DR, Parkinson C, Pérez EO, Pyszczynski T, Ratner K, Rothgerber H, Rounds JD, Schaller M, Silver RC, Spellman BA, Strohminger N, Swim JK, Thoemmes F, Urganci B, Vandello JA, Volz S, Zayas V, Tomiyama AJ. Psychological Science in the Wake of COVID-19: Social, Methodological, and Metascientific Considerations. PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2022; 17:311-333. [PMID: 34597198 PMCID: PMC8901450 DOI: 10.1177/1745691621999374] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023]
Abstract
The COVID-19 pandemic has extensively changed the state of psychological science from what research questions psychologists can ask to which methodologies psychologists can use to investigate them. In this article, we offer a perspective on how to optimize new research in the pandemic's wake. Because this pandemic is inherently a social phenomenon-an event that hinges on human-to-human contact-we focus on socially relevant subfields of psychology. We highlight specific psychological phenomena that have likely shifted as a result of the pandemic and discuss theoretical, methodological, and practical considerations of conducting research on these phenomena. After this discussion, we evaluate metascientific issues that have been amplified by the pandemic. We aim to demonstrate how theoretically grounded views on the COVID-19 pandemic can help make psychological science stronger-not weaker-in its wake.
Collapse
Affiliation(s)
| | | | - Brock Bastian
- Melbourne School of Psychological Sciences, University of Melbourne
| | - Elliot T. Berkman
- Department of Psychology, University of Oregon
- Center for Translational Neuroscience, University of Oregon
| | | | | | | | - C. Daryl Cameron
- Department of Psychology, The Pennsylvania State University
- Rock Ethics Institute, The Pennsylvania State University
| | - Serena Chen
- Department of Psychology, University of California, Berkeley
| | | | | | | | | | | | | | | | | | - Kurt Gray
- Department of Psychology and Neuroscience, University of North Carolina, Chapel Hill
| | | | - Martie G. Haselton
- Department of Psychology, University of California, Los Angeles
- Department of Communication, University of California, Los Angeles
- Institute for Society and Genetics, University of California, Los Angeles
| | - Nick Haslam
- Melbourne School of Psychological Sciences, University of Melbourne
| | | | | | | | - Yuen J. Huo
- Department of Psychology, University of California, Los Angeles
| | | | - Frank J. Kachanoff
- Department of Psychology and Neuroscience, University of North Carolina, Chapel Hill
| | | | - Mark R. Leary
- Department of Psychology and Neuroscience, Duke University
| | | | | | - Steve Loughnan
- School of Philosophy, Psychology, and Language Sciences, The University of Edinburgh
| | | | - Traci Mann
- Department of Psychology, University of Minnesota
| | | | | | - Efrén O. Pérez
- Department of Psychology, University of California, Los Angeles
- Department of Political Science, University of California, Los Angeles
| | - Tom Pyszczynski
- Department of Psychology, University of Colorado at Colorado Springs
| | | | | | | | - Mark Schaller
- Department of Psychology, University of British Columbia
| | - Roxane Cohen Silver
- Department of Psychological Science, University of California, Irvine
- Department of Medicine, University of California, Irvine
- Program in Public Health, University of California, Irvine
| | | | - Nina Strohminger
- Department of Legal Studies and Business Ethics, Wharton School of Business, University of Pennsylvania
- Department of Psychology, University of Pennsylvania
| | - Janet K. Swim
- Department of Psychology, The Pennsylvania State University
| | - Felix Thoemmes
- Department of Human Development, Cornell University
- Department of Psychology, Cornell University
| | | | | | - Sarah Volz
- Department of Psychology, University of Minnesota
| | | | | |
Collapse
|
37
|
Scan Once, Analyse Many: Using Large Open-Access Neuroimaging Datasets to Understand the Brain. Neuroinformatics 2022; 20:109-137. [PMID: 33974213 PMCID: PMC8111663 DOI: 10.1007/s12021-021-09519-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/07/2021] [Indexed: 02/06/2023]
Abstract
We are now in a time of readily available brain imaging data. Not only are researchers now sharing data more than ever before, but additionally large-scale data collecting initiatives are underway with the vision that many future researchers will use the data for secondary analyses. Here I provide an overview of available datasets and some example use cases. Example use cases include examining individual differences, more robust findings, reproducibility-both in public input data and availability as a replication sample, and methods development. I further discuss a variety of considerations associated with using existing data and the opportunities associated with large datasets. Suggestions for further readings on general neuroimaging and topic-specific discussions are also provided.
Collapse
|
38
|
Moerel M, Yacoub E, Gulban OF, Lage-Castellanos A, De Martino F. Using high spatial resolution fMRI to understand representation in the auditory network. Prog Neurobiol 2021; 207:101887. [PMID: 32745500 PMCID: PMC7854960 DOI: 10.1016/j.pneurobio.2020.101887] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2020] [Revised: 05/27/2020] [Accepted: 07/15/2020] [Indexed: 12/23/2022]
Abstract
Following rapid methodological advances, ultra-high field (UHF) functional and anatomical magnetic resonance imaging (MRI) has been repeatedly and successfully used for the investigation of the human auditory system in recent years. Here, we review this work and argue that UHF MRI is uniquely suited to shed light on how sounds are represented throughout the network of auditory brain regions. That is, the provided gain in spatial resolution at UHF can be used to study the functional role of the small subcortical auditory processing stages and details of cortical processing. Further, by combining high spatial resolution with the versatility of MRI contrasts, UHF MRI has the potential to localize the primary auditory cortex in individual hemispheres. This is a prerequisite to study how sound representation in higher-level auditory cortex evolves from that in early (primary) auditory cortex. Finally, the access to independent signals across auditory cortical depths, as afforded by UHF, may reveal the computations that underlie the emergence of an abstract, categorical sound representation based on low-level acoustic feature processing. Efforts on these research topics are underway. Here we discuss promises as well as challenges that come with studying these research questions using UHF MRI, and provide a future outlook.
Collapse
Affiliation(s)
- Michelle Moerel
- Maastricht Centre for Systems Biology, Maastricht University, Maastricht, the Netherlands; Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands; Maastricht Brain Imaging Center (MBIC), Maastricht, the Netherlands.
| | - Essa Yacoub
- Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, USA.
| | - Omer Faruk Gulban
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands; Maastricht Brain Imaging Center (MBIC), Maastricht, the Netherlands; Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, USA; Brain Innovation B.V., Maastricht, the Netherlands.
| | - Agustin Lage-Castellanos
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands; Maastricht Brain Imaging Center (MBIC), Maastricht, the Netherlands; Department of NeuroInformatics, Cuban Center for Neuroscience, Cuba.
| | - Federico De Martino
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, the Netherlands; Maastricht Brain Imaging Center (MBIC), Maastricht, the Netherlands; Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota, Minneapolis, USA.
| |
Collapse
|
39
|
Large, open datasets for human connectomics research: Considerations for reproducible and responsible data use. Neuroimage 2021; 244:118579. [PMID: 34536537 DOI: 10.1016/j.neuroimage.2021.118579] [Citation(s) in RCA: 33] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2021] [Revised: 08/27/2021] [Accepted: 09/14/2021] [Indexed: 12/19/2022] Open
Abstract
Large, open datasets have emerged as important resources in the field of human connectomics. In this review, the evolution of data sharing involving magnetic resonance imaging is described. A summary of the challenges and progress in conducting reproducible data analyses is provided, including description of recent progress made in the development of community guidelines and recommendations, software and data management tools, and initiatives to enhance training and education. Finally, this review concludes with a discussion of ethical conduct relevant to analyses of large, open datasets and a researcher's responsibility to prevent further stigmatization of historically marginalized racial and ethnic groups. Moving forward, future work should include an enhanced emphasis on the social determinants of health, which may further contextualize findings among diverse population-based samples. Leveraging the progress to date and guided by interdisciplinary collaborations, the future of connectomics promises to be an impressive era of innovative research, yielding a more inclusive understanding of brain structure and function.
Collapse
|
40
|
Lee KM, Ferreira-Santos F, Satpute AB. Predictive processing models and affective neuroscience. Neurosci Biobehav Rev 2021; 131:211-228. [PMID: 34517035 PMCID: PMC9074371 DOI: 10.1016/j.neubiorev.2021.09.009] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2019] [Revised: 02/10/2021] [Accepted: 09/07/2021] [Indexed: 01/17/2023]
Abstract
The neural bases of affective experience remain elusive. Early neuroscience models of affect searched for specific brain regions that uniquely carried out the computations that underlie dimensions of valence and arousal. However, a growing body of work has failed to identify these circuits. Research turned to multivariate analyses, but these strategies, too, have made limited progress. Predictive processing models offer exciting new directions to address this problem. Here, we use predictive processing models as a lens to critique prevailing functional neuroimaging research practices in affective neuroscience. Our review highlights how much work relies on rigid assumptions that are inconsistent with a predictive processing approach. We outline the central aspects of a predictive processing model and draw out their implications for research in affective and cognitive neuroscience. Predictive models motivate a reformulation of "reverse inference" in cognitive neuroscience, and placing a greater emphasis on external validity in experimental design.
Collapse
Affiliation(s)
- Kent M Lee
- Northeastern University, 360 Huntington Ave, 125 NI, Boston, MA 02118, USA.
| | - Fernando Ferreira-Santos
- Laboratory of Neuropsychophysiology, Faculty of Psychology and Education Sciences, University of Porto, Portugal
| | - Ajay B Satpute
- Northeastern University, 360 Huntington Ave, 125 NI, Boston, MA 02118, USA
| |
Collapse
|
41
|
Electrode montage-dependent intracranial variability in electric fields induced by cerebellar transcranial direct current stimulation. Sci Rep 2021; 11:22183. [PMID: 34773062 PMCID: PMC8589967 DOI: 10.1038/s41598-021-01755-9] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Accepted: 10/28/2021] [Indexed: 11/17/2022] Open
Abstract
Transcranial direct current stimulation (tDCS) is an increasingly popular tool to investigate the involvement of the cerebellum in a variety of brain functions and pathologies. However, heterogeneity and small effect sizes remain a common issue. One potential cause may be interindividual variability of the electric fields induced by tDCS. Here, we compared electric field distributions and directions between two conventionally used electrode montages (i.e., one placing the return electrode over the ipsilateral buccinator muscle and one placing the return electrode [25 and 35 cm2 surface area, respectively] over the contralateral supraorbital area; Experiment 1) and six alternative montages (electrode size: 9 cm2; Experiment 2) targeting the right posterior cerebellar hemisphere at 2 mA. Interindividual and montage differences in the achieved maximum field strength, focality, and direction of current flow were evaluated in 20 head models and the effects of individual differences in scalp–cortex distance were examined. Results showed that while maximum field strength was comparable for all montages, focality was substantially improved for the alternative montages over inferior occipital positions. Our findings suggest that compared to several conventional montages extracerebellar electric fields are significantly reduced by placing smaller electrodes in closer vicinity of the targeted area.
Collapse
|
42
|
Arkhipova A, Hok P, Valošek J, Trnečková M, Všetičková G, Coufalová G, Synek J, Zouhar V, Hluštík P. Changes in Brain Responses to Music and Non-music Sounds Following Creativity Training Within the "Different Hearing" Program. Front Neurosci 2021; 15:703620. [PMID: 34658759 PMCID: PMC8517178 DOI: 10.3389/fnins.2021.703620] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2021] [Accepted: 09/06/2021] [Indexed: 11/13/2022] Open
Abstract
The "Different Hearing" program (DHP) is an educational activity aimed at stimulating musical creativity of children and adults by group composing in the classroom, alternative to the mainstream model of music education in Czechia. Composing in the classroom in the DHP context does not use traditional musical instruments or notation, instead, the participants use their bodies, sounds originating from common objects as well as environmental sounds as the "elements" for music composition by the participants' team, with the teacher initiating and then participating and coordinating the creative process, which ends with writing down a graphical score and then performing the composition in front of an audience. The DHP methodology works with a wide definition of musical composition. We hypothesized that the DHP short-term (2 days) intense workshop would induce changes in subjective appreciation of different classes of music and sound (including typical samples of music composed in the DHP course), as well as plastic changes of the brain systems engaged in creative thinking and music perception, in their response to diverse auditory stimuli. In our study, 22 healthy university students participated in the workshop over 2 days and underwent fMRI examinations before and after the workshop, meanwhile 24 students were also scanned twice as a control group. During fMRI, each subject was listening to musical and non-musical sound samples, indicating their esthetic impression with a button press after each sample. As a result, participants' favorable feelings toward non-musical sound samples were significantly increased only in the active group. fMRI data analyzed using ANOVA with post hoc ROI analysis showed significant group-by-time interaction (opposing trends in the two groups) in the bilateral posterior cingulate cortex/precuneus, which are functional hubs of the default mode network (DMN) and in parts of the executive, motor, and auditory networks. The findings suggest that DHP training modified the behavioral and brain response to diverse sound samples, differentially changing the engagement of functional networks known to be related to creative thinking, namely, increasing DMN activation and decreasing activation of the executive network.
Collapse
Affiliation(s)
- Anna Arkhipova
- Department of Neurology, Faculty of Medicine and Dentistry and University Hospital Olomouc, Olomouc, Czechia
| | - Pavel Hok
- Department of Neurology, Faculty of Medicine and Dentistry and University Hospital Olomouc, Olomouc, Czechia
| | - Jan Valošek
- Department of Neurology, Faculty of Medicine and Dentistry and University Hospital Olomouc, Olomouc, Czechia.,Department of Biomedical Engineering, University Hospital Olomouc, Olomouc, Czechia
| | - Markéta Trnečková
- Department of Neurology, Faculty of Medicine and Dentistry and University Hospital Olomouc, Olomouc, Czechia.,Department of Computer Science, Faculty of Science, Palacký University Olomouc, Olomouc, Czechia
| | - Gabriela Všetičková
- Department of Music Education, Faculty of Education, Palacký University Olomouc, Olomouc, Czechia
| | - Gabriela Coufalová
- Department of Music Education, Faculty of Education, Palacký University Olomouc, Olomouc, Czechia
| | - Jaromír Synek
- Department of Music Education, Faculty of Education, Palacký University Olomouc, Olomouc, Czechia
| | - Vít Zouhar
- Department of Music Education, Faculty of Education, Palacký University Olomouc, Olomouc, Czechia
| | - Petr Hluštík
- Department of Neurology, Faculty of Medicine and Dentistry and University Hospital Olomouc, Olomouc, Czechia
| |
Collapse
|
43
|
Beliveau V, Nørgaard M, Birkl C, Seppi K, Scherfler C. Automated segmentation of deep brain nuclei using convolutional neural networks and susceptibility weighted imaging. Hum Brain Mapp 2021; 42:4809-4822. [PMID: 34322940 PMCID: PMC8449109 DOI: 10.1002/hbm.25604] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Revised: 07/08/2021] [Accepted: 07/13/2021] [Indexed: 01/10/2023] Open
Abstract
The advent of susceptibility-sensitive MRI techniques, such as susceptibility weighted imaging (SWI), has enabled accurate in vivo visualization and quantification of iron deposition within the human brain. Although previous approaches have been introduced to segment iron-rich brain regions, such as the substantia nigra, subthalamic nucleus, red nucleus, and dentate nucleus, these methods are largely unavailable and manual annotation remains the most used approach to label these regions. Furthermore, given their recent success in outperforming other segmentation approaches, convolutional neural networks (CNN) promise better performances. The aim of this study was thus to evaluate state-of-the-art CNN architectures for the labeling of deep brain nuclei from SW images. We implemented five CNN architectures and considered ensembles of these models. Furthermore, a multi-atlas segmentation model was included to provide a comparison not based on CNN. We evaluated two prediction strategies: individual prediction, where a model is trained independently for each region, and combined prediction, which simultaneously predicts multiple closely located regions. In the training dataset, all models performed with high accuracy with Dice coefficients ranging from 0.80 to 0.95. The regional SWI intensities and volumes from the models' labels were strongly correlated with those obtained from manual labels. Performances were reduced on the external dataset, but were higher or comparable to the intrarater reliability and most models achieved significantly better results compared to multi-atlas segmentation. CNNs can accurately capture the individual variability of deep brain nuclei and represent a highly useful tool for their segmentation from SW images.
Collapse
Affiliation(s)
- Vincent Beliveau
- Department of NeurologyMedical University of InnsbruckInnsbruckAustria
- Neuroimaging Research Core FacilityMedical University of InnsbruckInnsbruckAustria
| | - Martin Nørgaard
- Neurobiology Research Unit & CIMBICopenhagen University HospitalCopenhagenDenmark
- Center for Reproducible Neuroscience, Department of PsychologyStanford UniversityStanfordCaliforniaUSA
| | - Christoph Birkl
- Department of NeuroradiologyMedical University of InnsbruckInnsbruckAustria
| | - Klaus Seppi
- Department of NeurologyMedical University of InnsbruckInnsbruckAustria
- Neuroimaging Research Core FacilityMedical University of InnsbruckInnsbruckAustria
| | - Christoph Scherfler
- Department of NeurologyMedical University of InnsbruckInnsbruckAustria
- Neuroimaging Research Core FacilityMedical University of InnsbruckInnsbruckAustria
| |
Collapse
|
44
|
Caldinelli C, Cusack R. The fronto-parietal network is not a flexible hub during naturalistic cognition. Hum Brain Mapp 2021; 43:750-759. [PMID: 34652872 PMCID: PMC8720185 DOI: 10.1002/hbm.25684] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2021] [Revised: 09/17/2021] [Accepted: 09/20/2021] [Indexed: 11/12/2022] Open
Abstract
The fronto‐parietal network (FPN) is crucial for cognitively demanding tasks as it selectively represents task‐relevant information and controls other brain regions. To implement these functions, it has been argued that it is a flexible hub that reconfigures its functional connectivity with other networks. This was supported by a study in which a set of demanding tasks were presented, that varied in their sensory features, comparison rules, and response mappings, and the FPN showed greater reconfiguration of functional connectivity between tasks than any other network. However, this task set was designed to engage the FPN, and therefore it remains an open question whether the FPN is in a flexible hub in general or only for such task sets. Using two freely available datasets (Experiment 1, N = 15, Experiment 2, N = 644), we examined dynamic functional connectivity during naturalistic cognition, while participants watched a movie. Many differences in the flexibility were found across networks but the FPN was not the most flexible hub in the brain, during either movie for any of two measures, using a regression model or a correlation model and across five timescales. We, therefore, conclude that the FPN does not have the trait of being a flexible hub, although it may adopt this state for particular task sets.
Collapse
Affiliation(s)
- Chiara Caldinelli
- Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin
| | - Rhodri Cusack
- Trinity College Institute of Neuroscience, Trinity College Dublin, Dublin
| |
Collapse
|
45
|
Nastase SA, Liu YF, Hillman H, Zadbood A, Hasenfratz L, Keshavarzian N, Chen J, Honey CJ, Yeshurun Y, Regev M, Nguyen M, Chang CHC, Baldassano C, Lositsky O, Simony E, Chow MA, Leong YC, Brooks PP, Micciche E, Choe G, Goldstein A, Vanderwal T, Halchenko YO, Norman KA, Hasson U. The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension. Sci Data 2021; 8:250. [PMID: 34584100 PMCID: PMC8479122 DOI: 10.1038/s41597-021-01033-3] [Citation(s) in RCA: 52] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 08/18/2021] [Indexed: 02/08/2023] Open
Abstract
The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.
Collapse
Affiliation(s)
- Samuel A Nastase
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA.
| | - Yun-Fei Liu
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Hanna Hillman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Asieh Zadbood
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Liat Hasenfratz
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Neggin Keshavarzian
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Janice Chen
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Christopher J Honey
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD, USA
| | - Yaara Yeshurun
- School of Psychological Sciences, Tel Aviv University, Tel Aviv, Israel
| | - Mor Regev
- Montreal Neurological Institute, McGill University, Montreal, QC, Canada
| | - Mai Nguyen
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Claire H C Chang
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | | | - Olga Lositsky
- Department of Cognitive, Linguistic and Psychological Sciences, Brown University, Providence, RI, USA
| | - Erez Simony
- Faculty of Electrical Engineering, Holon Institute of Technology, Holon, Israel
- Department of Neurobiology, Weizmann Institute of Science, Rehovot, Israel
| | | | - Yuan Chang Leong
- Helen Wills Neuroscience Institute, University of California, Berkeley, CA, USA
| | - Paula P Brooks
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Emily Micciche
- Peabody College, Vanderbilt University, Nashville, TN, USA
| | - Gina Choe
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Ariel Goldstein
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Tamara Vanderwal
- Department of Psychiatry, University of British Columbia, and BC Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Yaroslav O Halchenko
- Department of Psychological and Brain Sciences and Department of Computer Science, Dartmouth College, Hanover, NH, USA
| | - Kenneth A Norman
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| | - Uri Hasson
- Princeton Neuroscience Institute and Department of Psychology, Princeton University, Princeton, NJ, USA
| |
Collapse
|
46
|
|
47
|
|
48
|
Song H, Rosenberg MD. Predicting attention across time and contexts with functional brain connectivity. Curr Opin Behav Sci 2021. [DOI: 10.1016/j.cobeha.2020.12.007] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
49
|
Boos M, Lücke J, Rieger JW. Generalizable dimensions of human cortical auditory processing of speech in natural soundscapes: A data-driven ultra high field fMRI approach. Neuroimage 2021; 237:118106. [PMID: 33991696 DOI: 10.1016/j.neuroimage.2021.118106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2021] [Accepted: 04/25/2021] [Indexed: 11/27/2022] Open
Abstract
Speech comprehension in natural soundscapes rests on the ability of the auditory system to extract speech information from a complex acoustic signal with overlapping contributions from many sound sources. Here we reveal the canonical processing of speech in natural soundscapes on multiple scales by using data-driven modeling approaches to characterize sounds to analyze ultra high field fMRI recorded while participants listened to the audio soundtrack of a movie. We show that at the functional level the neuronal processing of speech in natural soundscapes can be surprisingly low dimensional in the human cortex, highlighting the functional efficiency of the auditory system for a seemingly complex task. Particularly, we find that a model comprising three functional dimensions of auditory processing in the temporal lobes is shared across participants' fMRI activity. We further demonstrate that the three functional dimensions are implemented in anatomically overlapping networks that process different aspects of speech in natural soundscapes. One is most sensitive to complex auditory features present in speech, another to complex auditory features and fast temporal modulations, that are not specific to speech, and one codes mainly sound level. These results were derived with few a-priori assumptions and provide a detailed and computationally reproducible account of the cortical activity in the temporal lobe elicited by the processing of speech in natural soundscapes.
Collapse
Affiliation(s)
- Moritz Boos
- Applied Neurocognitive Psychology Lab, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence "Hearing4all", University of Oldenburg, Oldenburg, Germany.
| | - Jörg Lücke
- Machine Learning Division, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence "Hearing4all", University of Oldenburg, Oldenburg, Germany
| | - Jochem W Rieger
- Applied Neurocognitive Psychology Lab, University of Oldenburg, Oldenburg, Germany; Cluster of Excellence "Hearing4all", University of Oldenburg, Oldenburg, Germany
| |
Collapse
|
50
|
Isherwood SJS, Bazin PL, Alkemade A, Forstmann BU. Quantity and quality: Normative open-access neuroimaging databases. PLoS One 2021; 16:e0248341. [PMID: 33705468 PMCID: PMC7951909 DOI: 10.1371/journal.pone.0248341] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2020] [Accepted: 02/24/2021] [Indexed: 11/19/2022] Open
Abstract
The focus of this article is to compare twenty normative and open-access neuroimaging databases based on quantitative measures of image quality, namely, signal-to-noise (SNR) and contrast-to-noise ratios (CNR). We further the analysis through discussing to what extent these databases can be used for the visualization of deeper regions of the brain, such as the subcortex, as well as provide an overview of the types of inferences that can be drawn. A quantitative comparison of contrasts including T1-weighted (T1w) and T2-weighted (T2w) images are summarized, providing evidence for the benefit of ultra-high field MRI. Our analysis suggests a decline in SNR in the caudate nuclei with increasing age, in T1w, T2w, qT1 and qT2* contrasts, potentially indicative of complex structural age-dependent changes. A similar decline was found in the corpus callosum of the T1w, qT1 and qT2* contrasts, though this relationship is not as extensive as within the caudate nuclei. These declines were accompanied by a declining CNR over age in all image contrasts. A positive correlation was found between scan time and the estimated SNR as well as a negative correlation between scan time and spatial resolution. Image quality as well as the number and types of contrasts acquired by these databases are important factors to take into account when selecting structural data for reuse. This article highlights the opportunities and pitfalls associated with sampling existing databases, and provides a quantitative backing for their usage.
Collapse
Affiliation(s)
- Scott Jie Shen Isherwood
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
| | - Pierre-Louis Bazin
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
- Department of Neurophysics, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Anneke Alkemade
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
| | - Birte Uta Forstmann
- Integrative Model-Based Cognitive Neuroscience Research Unit, University of Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|