Brainhack: Developing a culture of open, inclusive, community-driven neuroscience

Hands-On Neuroinformatics Education at the Crossroads of Online and In-Person: Lessons Learned from NeuroHackademy

NeuroHackademy ( https://neurohackademy.org ) is a two-week event designed to train early-career neuroscience researchers in data science methods and their application to neuroimaging. The event seeks to bridge the big data skills gap by introducing participants to data science methods and skills that are often ignored in traditional curricula. Such skills are needed for the analysis and interpretation of the kinds of large and complex datasets that have become increasingly important to neuroimaging research due to concerted data collection efforts. In 2020, the event rapidly pivoted from an in-person event to an online event that included hundreds of participants from all over the world. This experience and those of the participants substantially changed our valuation of large online-accessible events. In subsequent events held in 2022 and 2023, we have developed a "hybrid" format that includes both online and in-person participants. We discuss the technical and sociotechnical elements of hybrid events and discuss some of the lessons we have learned while organizing them. We emphasize in particular the role that these events can play in creating a global and inclusive community of practice in the intersection of neuroimaging and data science.

Neurodesk: an accessible, flexible and portable data analysis environment for reproducible neuroimaging

Neuroimaging research requires purpose-built analysis software, which is challenging to install and may produce different results across computing environments. The community-oriented, open-source Neurodesk platform ( https://www.neurodesk.org/ ) harnesses a comprehensive and growing suite of neuroimaging software containers. Neurodesk includes a browser-accessible virtual desktop, command-line interface and computational notebook compatibility, allowing for accessible, flexible, portable and fully reproducible neuroimaging analysis on personal workstations, high-performance computers and the cloud.

A comparative review on neuroethical issues in neuroscientific and neuroethical journals

This study is a pilot literature review that compares the interest of neuroethicists and neuroscientists. It aims to determine whether there is a significant gap between the neuroethical issues addressed in philosophical neuroethics journals and neuroscience journals. We retrieved 614 articles from two specialist neuroethics journals (Neuroethics and AJOB Neuroscience) and 82 neuroethics-focused articles from three specialist neuroscience journals (Neuron, Nature Neuroscience, and Nature Reviews Neuroscience). We classified these articles in light of the neuroethical issue in question before we compared the neuroethical issues addressed in philosophical neuroethics with those addressed by neuroscientists. A notable result is a parallelism between them as a general tendency. Neuroscientific articles cover most neuroethical issues discussed by philosophical ethicists and vice versa. Subsequently, there are notable discrepancies between the two bodies of neuroethics literature. For instance, theoretical questions, such as the ethics of moral enhancement and the philosophical implications of neuroscientific findings on our conception of personhood, are more intensely discussed in philosophical-neuroethical articles. Conversely, neuroscientific articles tend to emphasize practical questions, such as how to successfully integrate ethical perspectives into scientific research projects and justifiable practices of animal-involving neuroscientific research. These observations will help us settle the common starting point of the attempt at "ethics integration" in emerging neuroscience, contributing to better governance design and neuroethical practice.

brainlife.io: A decentralized and open source cloud platform to support neuroscience research

Neuroscience research has expanded dramatically over the past 30 years by advancing standardization and tool development to support rigor and transparency. Consequently, the complexity of the data pipeline has also increased, hindering access to FAIR data analysis to portions of the worldwide research community. brainlife.io was developed to reduce these burdens and democratize modern neuroscience research across institutions and career levels. Using community software and hardware infrastructure, the platform provides open-source data standardization, management, visualization, and processing and simplifies the data pipeline. brainlife.io automatically tracks the provenance history of thousands of data objects, supporting simplicity, efficiency, and transparency in neuroscience research. Here brainlife.io's technology and data services are described and evaluated for validity, reliability, reproducibility, replicability, and scientific utility. Using data from 4 modalities and 3,200 participants, we demonstrate that brainlife.io's services produce outputs that adhere to best practices in modern neuroscience research.

Neurodesk: An accessible, flexible, and portable data analysis environment for reproducible neuroimaging

Neuroimaging data analysis often requires purpose-built software, which can be challenging to install and may produce different results across computing environments. Beyond being a roadblock to neuroscientists, these issues of accessibility and portability can hamper the reproducibility of neuroimaging data analysis pipelines. Here, we introduce the Neurodesk platform, which harnesses software containers to support a comprehensive and growing suite of neuroimaging software (https://www.neurodesk.org/). Neurodesk includes a browser-accessible virtual desktop environment and a command line interface, mediating access to containerized neuroimaging software libraries on various computing platforms, including personal and high-performance computers, cloud computing and Jupyter Notebooks. This community-oriented, open-source platform enables a paradigm shift for neuroimaging data analysis, allowing for accessible, flexible, fully reproducible, and portable data analysis pipelines.

The Chinese Open Science Network (COSN): Building an Open Science Community From Scratch

Open Science is becoming a mainstream scientific ideology in psychology and related fields. However, researchers, especially early-career researchers (ECRs) in developing countries, are facing significant hurdles in engaging in Open Science and moving it forward. In China, various societal and cultural factors discourage ECRs from participating in Open Science, such as the lack of dedicated communication channels and the norm of modesty. To make the voice of Open Science heard by Chinese-speaking ECRs and scholars at large, the Chinese Open Science Network (COSN) was initiated in 2016. With its core values being grassroots-oriented, diversity, and inclusivity, COSN has grown from a small Open Science interest group to a recognized network both in the Chinese-speaking research community and the international Open Science community. So far, COSN has organized three in-person workshops, 12 tutorials, 48 talks, and 55 journal club sessions and translated 15 Open Science-related articles and blogs from English to Chinese. Currently, the main social media account of COSN (i.e., the WeChat Official Account) has more than 23,000 subscribers, and more than 1,000 researchers/students actively participate in the discussions on Open Science. In this article, we share our experience in building such a network to encourage ECRs in developing countries to start their own Open Science initiatives and engage in the global Open Science movement. We foresee great collaborative efforts of COSN together with all other local and international networks to further accelerate the Open Science movement.

Open and reproducible neuroimaging: From study inception to publication

Empirical observations of how labs conduct research indicate that the adoption rate of open practices for transparent, reproducible, and collaborative science remains in its infancy. This is at odds with the overwhelming evidence for the necessity of these practices and their benefits for individual researchers, scientific progress, and society in general. To date, information required for implementing open science practices throughout the different steps of a research project is scattered among many different sources. Even experienced researchers in the topic find it hard to navigate the ecosystem of tools and to make sustainable choices. Here, we provide an integrated overview of community-developed resources that can support collaborative, open, reproducible, replicable, robust and generalizable neuroimaging throughout the entire research cycle from inception to publication and across different neuroimaging modalities. We review tools and practices supporting study inception and planning, data acquisition, research data management, data processing and analysis, and research dissemination. An online version of this resource can be found at https://oreoni.github.io. We believe it will prove helpful for researchers and institutions to make a successful and sustainable move towards open and reproducible science and to eventually take an active role in its future development.

The normative modeling framework for computational psychiatry

Normative modeling is an emerging and innovative framework for mapping individual differences at the level of a single subject or observation in relation to a reference model. It involves charting centiles of variation across a population in terms of mappings between biology and behavior, which can then be used to make statistical inferences at the level of the individual. The fields of computational psychiatry and clinical neuroscience have been slow to transition away from patient versus 'healthy' control analytic approaches, probably owing to a lack of tools designed to properly model biological heterogeneity of mental disorders. Normative modeling provides a solution to address this issue and moves analysis away from case-control comparisons that rely on potentially noisy clinical labels. Here we define a standardized protocol to guide users through, from start to finish, normative modeling analysis using the Predictive Clinical Neuroscience toolkit (PCNtoolkit). We describe the input data selection process, provide intuition behind the various modeling choices and conclude by demonstrating several examples of downstream analyses that the normative model may facilitate, such as stratification of high-risk individuals, subtyping and behavioral predictive modeling. The protocol takes ~1-3 h to complete.

A large, curated, open-source stroke neuroimaging dataset to improve lesion segmentation algorithms

Accurate lesion segmentation is critical in stroke rehabilitation research for the quantification of lesion burden and accurate image processing. Current automated lesion segmentation methods for T1-weighted (T1w) MRIs, commonly used in stroke research, lack accuracy and reliability. Manual segmentation remains the gold standard, but it is time-consuming, subjective, and requires neuroanatomical expertise. We previously released an open-source dataset of stroke T1w MRIs and manually-segmented lesion masks (ATLAS v1.2, N = 304) to encourage the development of better algorithms. However, many methods developed with ATLAS v1.2 report low accuracy, are not publicly accessible or are improperly validated, limiting their utility to the field. Here we present ATLAS v2.0 (N = 1271), a larger dataset of T1w MRIs and manually segmented lesion masks that includes training (n = 655), test (hidden masks, n = 300), and generalizability (hidden MRIs and masks, n = 316) datasets. Algorithm development using this larger sample should lead to more robust solutions; the hidden datasets allow for unbiased performance evaluation via segmentation challenges. We anticipate that ATLAS v2.0 will lead to improved algorithms, facilitating large-scale stroke research.

Group-level inference of information-based measures for the analyses of cognitive brain networks from neurophysiological data

The reproducibility crisis in neuroimaging and in particular in the case of underpowered studies has introduced doubts on our ability to reproduce, replicate and generalize findings. As a response, we have seen the emergence of suggested guidelines and principles for neuroscientists known as Good Scientific Practice for conducting more reliable research. Still, every study remains almost unique in its combination of analytical and statistical approaches. While it is understandable considering the diversity of designs and brain data recording, it also represents a striking point against reproducibility. Here, we propose a non-parametric permutation-based statistical framework, primarily designed for neurophysiological data, in order to perform group-level inferences on non-negative measures of information encompassing metrics from information-theory, machine-learning or measures of distances. The framework supports both fixed- and random-effect models to adapt to inter-individuals and inter-sessions variability. Using numerical simulations, we compared the accuracy in ground-truth retrieving of both group models, such as test- and cluster-wise corrections for multiple comparisons. We then reproduced and extended existing results using both spatially uniform MEG and non-uniform intracranial neurophysiological data. We showed how the framework can be used to extract stereotypical task- and behavior-related effects across the population covering scales from the local level of brain regions, inter-areal functional connectivity to measures summarizing network properties. We also present an open-source Python toolbox called Frites¹ that includes the proposed statistical pipeline using information-theoretic metrics such as single-trial functional connectivity estimations for the extraction of cognitive brain networks. Taken together, we believe that this framework deserves careful attention as its robustness and flexibility could be the starting point toward the uniformization of statistical approaches.

Cross disorder comparisons of brain structure in schizophrenia, bipolar disorder, major depressive disorder, and 22q11.2 deletion syndrome: A review of ENIGMA findings

This review compares the main brain abnormalities in schizophrenia (SZ), bipolar disorder (BD), major depressive disorder (MDD), and 22q11.2 Deletion Syndrome (22q11DS) determined by ENIGMA (Enhancing Neuro Imaging Genetics through Meta Analysis) consortium investigations. We obtained ranked effect sizes for subcortical volumes, regional cortical thickness, cortical surface area, and diffusion tensor imaging abnormalities, comparing each of these disorders relative to healthy controls. In addition, the studies report on significant associations between brain imaging metrics and disorder-related factors such as symptom severity and treatments. Visual comparison of effect size profiles shows that effect sizes are generally in the same direction and scale in severity with the disorders (in the order SZ > BD > MDD). The effect sizes for 22q11DS, a rare genetic syndrome that increases the risk for psychiatric disorders, appear to be much larger than for either of the complex psychiatric disorders. This is consistent with the idea of generally larger effects on the brain of rare compared to common genetic variants. Cortical thickness and surface area effect sizes for 22q11DS with psychosis compared to 22q11DS without psychosis are more similar to those of SZ and BD than those of MDD; a pattern not observed for subcortical brain structures and fractional anisotropy effect sizes. The observed similarities in effect size profiles for cortical measures across the psychiatric disorders mimic those observed for shared genetic variance between these disorders reported based on family and genetic studies and are consistent with shared genetic risk for SZ and BD and structural brain phenotypes.

Recent Technical Advances in Accelerating the Clinical Translation of Small Animal Brain Imaging: Hybrid Imaging, Deep Learning, and Transcriptomics

Small animal models play a fundamental role in brain research by deepening the understanding of the physiological functions and mechanisms underlying brain disorders and are thus essential in the development of therapeutic and diagnostic imaging tracers targeting the central nervous system. Advances in structural, functional, and molecular imaging using MRI, PET, fluorescence imaging, and optoacoustic imaging have enabled the interrogation of the rodent brain across a large temporal and spatial resolution scale in a non-invasively manner. However, there are still several major gaps in translating from preclinical brain imaging to the clinical setting. The hindering factors include the following: (1) intrinsic differences between biological species regarding brain size, cell type, protein expression level, and metabolism level and (2) imaging technical barriers regarding the interpretation of image contrast and limited spatiotemporal resolution. To mitigate these factors, single-cell transcriptomics and measures to identify the cellular source of PET tracers have been developed. Meanwhile, hybrid imaging techniques that provide highly complementary anatomical and molecular information are emerging. Furthermore, deep learning-based image analysis has been developed to enhance the quantification and optimization of the imaging protocol. In this mini-review, we summarize the recent developments in small animal neuroimaging toward improved translational power, with a focus on technical improvement including hybrid imaging, data processing, transcriptomics, awake animal imaging, and on-chip pharmacokinetics. We also discuss outstanding challenges in standardization and considerations toward increasing translational power and propose future outlooks.

A protocol for working with open-source neuroimaging datasets

Large, publicly available neuroimaging datasets are becoming increasingly common, but their use presents challenges because of insufficient knowledge of the tool options for data processing and proper data organization. Here, we describe a protocol to lessen these barriers. We describe the steps for the search and download of the open-source dataset. We detail the steps for proper data management and practical guidelines for data analysis. Finally, we give instructions for data and result sharing on public repositories and preprint services. For complete details on the use and execution of this profile, please refer to Horien et al. (2021).

Large, open datasets for human connectomics research: Considerations for reproducible and responsible data use

Large, open datasets have emerged as important resources in the field of human connectomics. In this review, the evolution of data sharing involving magnetic resonance imaging is described. A summary of the challenges and progress in conducting reproducible data analyses is provided, including description of recent progress made in the development of community guidelines and recommendations, software and data management tools, and initiatives to enhance training and education. Finally, this review concludes with a discussion of ethical conduct relevant to analyses of large, open datasets and a researcher's responsibility to prevent further stigmatization of historically marginalized racial and ethnic groups. Moving forward, future work should include an enhanced emphasis on the social determinants of health, which may further contextualize findings among diverse population-based samples. Leveraging the progress to date and guided by interdisciplinary collaborations, the future of connectomics promises to be an impressive era of innovative research, yielding a more inclusive understanding of brain structure and function.

Transcriptional characterization of the glial response due to chronic neural implantation of flexible microprobes

Long term implantation of (micro-)probes into neural tissue causes unique and disruptive responses. In this study, we investigate the transcriptional trajectory of glial cells responding to chronic implantation of 380 μm flexible micro-probes for up to 18 weeks. Transcriptomic analysis shows a rapid activation of microglial cells and a strong reactive astrocytic polarization, both of which are lost over the chronic of the implant duration. Animals that were implanted for 18 weeks show a transcriptional profile similar to non-implanted controls, with increased expression of genes associated with wound healing and angiogenesis, which raises hope of a normalization of the neuropil to the pre-injury state when using flexible probes. Nevertheless, our data shows that a subset of genes upregulated after 18 weeks belong to the family of immediate early genes, which indicates that structural and functional remodeling is not complete at this time point. Our results confirm and extend previous work on the molecular changes resulting from the presence of neural probes and provide a rational basis for developing interventional strategies to control them.

The Normative Modeling Framework for Computational Psychiatry.. [PMID: 35650452 PMCID: PMC7613648 DOI: 10.1101/2021.08.08.455583]

Normative modeling is an emerging and innovative framework for mapping individual differences at the level of a single subject or observation in relation to a reference model. It involves charting centiles of variation across a population in terms of mappings between biology and behavior which can then be used to make statistical inferences at the level of the individual. The fields of computational psychiatry and clinical neuroscience have been slow to transition away from patient versus “healthy” control analytic approaches, likely due to a lack of tools designed to properly model biological heterogeneity of mental disorders. Normative modeling provides a solution to address this issue and moves analysis away from case-control comparisons that rely on potentially noisy clinical labels. In this article, we define a standardized protocol to guide users through, from start to finish, normative modeling analysis using the Predictive Clinical Neuroscience toolkit (PCNtoolkit). We describe the input data selection process, provide intuition behind the various modeling choices, and conclude by demonstrating several examples of down-stream analyses the normative model results may facilitate, such as stratification of high-risk individuals, subtyping, and behavioral predictive modeling. The protocol takes approximately 1-3 hours to complete.