Questionable Research Practices, Low Statistical Power, and Other Obstacles to Replicability: Why Preclinical Neuroscience Research Would Benefit from Registered Reports

How Transparent and Reproducible Are Studies That Use Animal Models of Opioid Addiction?

The reproducibility crisis in psychology has caused various fields to consider the reliability of their own findings. Many of the unfortunate aspects of research design that undermine reproducibility also threaten translation potential. In preclinical addiction research, the rates of translation have been disappointing. We tallied indices of transparency and accurate and thorough reporting in animal models of opioid addiction from 2019 to 2023. By examining the prevalence of these practices, we aimed to understand whether efforts to improve reproducibility are relevant to this field. For 255 articles, we report the prevalence of transparency measures such as preregistration, registered reports, open data and open code, as well as compliance to the Animal Research: Reporting of In Vivo Experiments (ARRIVE) guidelines. We also report rates of bias minimization practices (randomization, masking and data exclusion), sample size calculations and multiple corrections adjustments. Lastly, we estimated the accuracy of test statistic reporting using a version of StatCheck. All the transparency measures and the ARRIVE guideline items had low prevalence, including no cases of study preregistration and no cases where authors shared their analysis code. Similarly, the levels of bias minimization practices and sample size calculations were unsatisfactory. In contrast, adjustments for multiple comparisons were implemented in most articles (76.5%). Lastly, p-value inconsistencies with test statistics were detected in about half of papers, and 11% contained statistical significance errors. We recommend that researchers, journal editors and others take steps to improve study reporting and to facilitate both replication and translation.

How will developmental neuroimaging contribute to the prediction of neurodevelopmental or psychiatric disorders? Challenges and opportunities

Successful developmental neuroimaging efforts require interdisciplinary expertise to ground scientific questions in knowledge of human development, modify and create technologies and data processing pipelines suited to the young brain, and ensure research procedures meet the needs and protect the interests of young children and their caregivers. This paper brings together four interdisciplinary perspectives to tackle a set of questions that are central for the field to address as we imagine a future role for developmental neuroimaging in the prediction of neurodevelopmental or psychiatric disorders: 1) How do we generate a strong evidence base for causality and clinical relevance? 2) How do we ensure the integrity of the data and support fair and wide access? 3) How can these technologies be implemented in the clinic? 4) What are the ethical obligations for neuroimaging researchers working with infants and young children?

Depressive symptoms during the transition to adolescence: Left hippocampal volume as a marker of social context sensitivity

The transition to adolescence is a critical period for mental health development. Socio-experiential environments play an important role in the emergence of depressive symptoms with some adolescents showing more sensitivity to social contexts than others. Drawing on recent developmental neuroscience advances, we examined whether hippocampal volume amplifies social context effects in the transition to adolescence. We analyzed 2-y longitudinal data from the Adolescent Brain Cognitive Development (ABCD®) study in a diverse sample of 11,832 youth (mean age: 9.914 y; range: 8.917 to 11.083 y; 47.8% girls) from 21 sites across the United States. Socio-experiential environments (i.e., family conflict, primary caregiver's depressive symptoms, parental warmth, peer victimization, and prosocial school environment), hippocampal volume, and a wide range of demographic characteristics were measured at baseline. Youth's symptoms of major depressive disorder were assessed at both baseline and 2 y later. Multilevel mixed-effects linear regression analyses showed that negative social environments (i.e., family conflict, primary caregiver's depressive symptoms, and peer victimization) and the absence of positive social environments (i.e., parental warmth and prosocial school environment) predicted greater increases in youth's depressive symptoms over 2 y. Importantly, left hippocampal volume amplified social context effects such that youth with larger left hippocampal volume experienced greater increases in depressive symptoms in more negative and less positive social environments. Consistent with brain-environment interaction models of mental health, these findings underscore the importance of families, peers, and schools in the development of depression during the transition to adolescence and show how neural structure amplifies social context sensitivity.

Selective in vitro Synergistic Evaluation of Probiotic Tolerant morpholinyl- and 4-ethylpiperazinyl-Imidazole-chalcone Derivatives on Gastrointestinal System Pathogens

Imidazole-chalcone compounds are recognised for their broad-spectrum antimicrobial properties. Probiotic-friendly, selective new-generation antimicrobials prove to be more efficient in combating gastrointestinal system pathogens. The aim of this study is to identify imidazole-chalcone derivatives that probiotics tolerate and evaluate their in vitro synergistic antimicrobial effects on pathogens. In this study, fifteen previously identified imidazole-chalcone derivatives were analyzed for their in vitro antimicrobial properties against gastrointestinal microorganisms. Initially, the antimicrobial activity of pathogens was measured using the agar well diffusion method, while the susceptibility of probiotics was determined by microdilution. The chosen imidazole-chalcone derivatives were assessed for synergistic effects using the checkerboard method. Four imidazole-chalcone derivatives to which probiotic bacteria were tolerant exhibited antibacterial and antifungal activity against the human pathogens tested. To our knowledge, this study is the first to reveal the fractional inhibitory concentration (FIC) of combinations of imidazole-chalcone derivatives. Indeed, the minimum inhibitory concentrations (MIC) for morpholinyl- (ZDO-3f) and 4-ethylpiperazinyl- (ZDO-3 m) imidazole-chalcones were notably low when tested against E. coli and B. subtilis, with values of 31.25 μg/mL and 125 μg/mL, respectively. The combination of morpholinyl- and 4-ethylpiperazinyl derivatives demonstrated an indifferent effect against E. coli, but an additive effect was observed for B. subtilis. Additionally, it was observed that imidazole-chalcone derivatives did not exhibit any inhibitory effects on probiotic organisms like Lactobacillus fermentum (CECT-5716), Lactobacillus rhamnosus (GG), and Lactobacillus casei (RSSK-591). This study demonstrates that imidazole-chalcone derivatives that are well tolerated by probiotics can potentially exert a synergistic effect against gastrointestinal system pathogens.

Measuring the replicability of our own research

In the study of transgenic mouse models of neurodevelopmental and neurodegenerative disorders, we use batteries of tests to measure deficits in behaviour and from the results of these tests, we make inferences about the mental states of the mice that we interpret as deficits in "learning", "memory", "anxiety", "depression", etc. This paper discusses the problems of determining whether a particular transgenic mouse is a valid mouse model of disease X, the problem of background strains, and the question of whether our behavioural tests are measuring what we say they are. The problem of the reliability of results is then discussed: are they replicable between labs and can we replicate our results in our own lab? This involves the study of intra- and inter- experimenter reliability. The variables that influence replicability and the importance of conducting a complete behavioural phenotype: sensory, motor, cognitive and social emotional behaviour are discussed. Then the thorny question of failure to replicate is examined: Is it a curse or a blessing? Finally, the role of failure in research and what it tells us about our research paradigms is examined.

Current Best Practices for Analysis of Dendritic Spine Morphology and Number in Neurodevelopmental Disorder Research

Quantitative methods for assessing neural anatomy have rapidly evolved in neuroscience and provide important insights into brain health and function. However, as new techniques develop, it is not always clear when and how each may be used to answer specific scientific questions posed. Dendritic spines, which are often indicative of synapse formation and neural plasticity, have been implicated across many brain regions in neurodevelopmental disorders as a marker for neural changes reflecting neural dysfunction or alterations. In this Perspective we highlight several techniques for staining, imaging, and quantifying dendritic spines as well as provide a framework for avoiding potential issues related to pseudoreplication. This framework illustrates how others may apply the most rigorous approaches. We consider the cost-benefit analysis of the varied techniques, recognizing that the most sophisticated equipment may not always be necessary for answering some research questions. Together, we hope this piece will help researchers determine the best strategy toward using the ever-growing number of techniques available to determine neural changes underlying dendritic spine morphology in health and neurodevelopmental disorders.

The Chinese Open Science Network (COSN): Building an Open Science Community From Scratch

Open Science is becoming a mainstream scientific ideology in psychology and related fields. However, researchers, especially early-career researchers (ECRs) in developing countries, are facing significant hurdles in engaging in Open Science and moving it forward. In China, various societal and cultural factors discourage ECRs from participating in Open Science, such as the lack of dedicated communication channels and the norm of modesty. To make the voice of Open Science heard by Chinese-speaking ECRs and scholars at large, the Chinese Open Science Network (COSN) was initiated in 2016. With its core values being grassroots-oriented, diversity, and inclusivity, COSN has grown from a small Open Science interest group to a recognized network both in the Chinese-speaking research community and the international Open Science community. So far, COSN has organized three in-person workshops, 12 tutorials, 48 talks, and 55 journal club sessions and translated 15 Open Science-related articles and blogs from English to Chinese. Currently, the main social media account of COSN (i.e., the WeChat Official Account) has more than 23,000 subscribers, and more than 1,000 researchers/students actively participate in the discussions on Open Science. In this article, we share our experience in building such a network to encourage ECRs in developing countries to start their own Open Science initiatives and engage in the global Open Science movement. We foresee great collaborative efforts of COSN together with all other local and international networks to further accelerate the Open Science movement.