Psychology's Replication Crisis and Clinical Psychological Science

Brief online negative affect focused functional imagery training (FIT) improves four-week drinking outcomes in hazardous student drinkers: A pilot randomised controlled trial replication in South Africa

Background

Previous study has shown that functional imagery training (FIT) to utilise positive mental imagery in response to negative affect could improve alcohol-related outcomes. The current study aimed to replicate whether this negative affect focused FIT would improve alcohol-related outcomes in hazardous student drinkers in South Africa at four-week follow-up.

Methods

50 hazardous student drinkers who reported drinking to cope with negative affect were randomised into two groups. The active group (n = 25) was trained online over two weeks to respond to personalised negative drinking triggers by retrieving a personalised adaptive strategy they might use to mitigate negative affect, whereas the control group (n = 25) received standard risk information about binge drinking. Outcome measures including alcohol consumption, drinking motives, anxiety and depression, self-efficacy and use of protective behavioural strategies were obtained at baseline and four-week follow-up.

Results

FIT effects were revealed by three significant group-by-timepoint interactions in a per-protocol analysis: there was a significant decrease in depressive symptoms, drinking to cope and drinking for social reasons from baseline to follow-up in the active group, but not the control group. No effects were observed on alcohol consumption, self-efficacy, protective behaviour strategies and anxiety.

Conclusions

Preliminary evidence supports that online negative affect focused FIT can improve depression as well as coping and social drinking motives in South African hazardous student drinkers who drank to cope, at four-week follow-up, suggesting that the principles of this FIT approach might be adapted and incorporated into a clinical intervention to test for efficacy in mitigating substance use problems.

Campbell's Law Explains the Replication Crisis: Pre-Registration Badges Are History Repeating

Campbell's Law explains the replication crisis. In brief, useful tools such as hypotheses, p-values, and multi-study designs came to be viewed as indicators of strong science, and thus goals in and of themselves. Consequently, their use became distorted in unanticipated ways (e.g., hypothesizing after results were known [HARKing], p-Hacking, misuses of researcher degrees of freedom), and fragile findings proliferated. Pre-registration mandates are positioned as an antidote. However, I argue that such efforts, perhaps best exemplified by pre-registration badges (PRBs), are history repeating: Another useful tool has been converted into an indicator of strong science and a goal in and of itself. This, too, will distort its use and harm psychological science in unanticipated ways. For example, there is already evidence that papers seeking PRBs routinely violate the rules and spirit of pre-registration. I suggest that pre-registration mandates will (a) discourage optimal scientific practice, (b) exacerbate the file drawer problem, (c) encourage pre-registering after results are known (PRARKing), and (d) create false trust in fragile findings. I conclude that multiple design features can help support replicability (e.g., adequate sample size, valid measurement, robustness checks, pre-registration), none should be canonized, replication is the only arbiter of replicability, and the most important solution is sociocultural: to foster a field that reveres and reinforces robust science-just as we once revered and reinforced flashy but fragile science.

Vulnerabilities in social anxiety: Integrating intra- and interpersonal perspectives

What are the major vulnerabilities in people with social anxiety? What are the most promising directions for translational research pertaining to this condition? The present paper provides an integrative summary of basic and applied translational research on social anxiety, emphasizing vulnerability factors. It is divided into two subsections: intrapersonal and interpersonal. The intrapersonal section synthesizes research relating to (a) self-representations and self-referential processes; (b) emotions and their regulation; and (c) cognitive biases: attention, interpretation and judgment, and memory. The interpersonal section summarizes findings regarding the systems of (a) approach and avoidance, (b) affiliation and social rank, and their implications for interpersonal impairments. Our review suggests that the science of social anxiety and, more generally, psychopathology may be advanced by examining processes and their underlying content within broad psychological systems. Increased interaction between basic and applied researchers to diversify and elaborate different perspectives on social anxiety is necessary for progress.

Benchmarking Mental Health Status Using Passive Sensor Data: Protocol for a Prospective Observational Study

BACKGROUND

Computational psychiatry has the potential to advance the diagnosis, mechanistic understanding, and treatment of mental health conditions. Promising results from clinical samples have led to calls to extend these methods to mental health risk assessment in the general public; however, data typically used with clinical samples are neither available nor scalable for research in the general population. Digital phenotyping addresses this by capitalizing on the multimodal and widely available data created by sensors embedded in personal digital devices (eg, smartphones) and is a promising approach to extending computational psychiatry methods to improve mental health risk assessment in the general population.

OBJECTIVE

Building on recommendations from existing computational psychiatry and digital phenotyping work, we aim to create the first computational psychiatry data set that is tailored to studying mental health risk in the general population; includes multimodal, sensor-based behavioral features; and is designed to be widely shared across academia, industry, and government using gold standard methods for privacy, confidentiality, and data integrity.

METHODS

We are using a stratified, random sampling design with 2 crossed factors (difficulties with emotion regulation and perceived life stress) to recruit a sample of 400 community-dwelling adults balanced across high- and low-risk for episodic mental health conditions. Participants first complete self-report questionnaires assessing current and lifetime psychiatric and medical diagnoses and treatment, and current psychosocial functioning. Participants then complete a 7-day in situ data collection phase that includes providing daily audio recordings, passive sensor data collected from smartphones, self-reports of daily mood and significant events, and a verbal description of the significant daily events during a nightly phone call. Participants complete the same baseline questionnaires 6 and 12 months after this phase. Self-report questionnaires will be scored using standard methods. Raw audio and passive sensor data will be processed to create a suite of daily summary features (eg, time spent at home).

RESULTS

Data collection began in June 2022 and is expected to conclude by July 2024. To date, 310 participants have consented to the study; 149 have completed the baseline questionnaire and 7-day intensive data collection phase; and 61 and 31 have completed the 6- and 12-month follow-up questionnaires, respectively. Once completed, the proposed data set will be made available to academic researchers, industry, and the government using a stepped approach to maximize data privacy.

CONCLUSIONS

This data set is designed as a complementary approach to current computational psychiatry and digital phenotyping research, with the goal of advancing mental health risk assessment within the general population. This data set aims to support the field's move away from siloed research laboratories collecting proprietary data and toward interdisciplinary collaborations that incorporate clinical, technical, and quantitative expertise at all stages of the research process.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/53857.

Affective Contributions to Instrumental and Reactive Aggression in Middle Childhood: Variable- and Person-Centered Approaches

OBJECTIVE

Research on the role of affect in childhood aggression motives has largely focused on domain-level affective traits. Lower-order affective facets may show more distinct relationships with instrumental and reactive aggression - at both the variable and individual levels - and offer unique insights into whether and how several forms of affect are involved in aggression motives.

METHOD

Caregivers (98% mothers) of 342 children (Mage = 9.81 years, 182 girls, 31% White) reported on children's aggression and affect-relevant personality traits, personality pathology, and callous-unemotional traits.

RESULTS

Both reactive and instrumental aggressions were characterized by higher levels of trait irritability, fear, withdrawal, sadness, and callous-unemotional traits in zero-order analyses. Instrumental aggression was characterized by low trait positive emotions. Reactive aggression was uniquely associated with irritability, fear, withdrawal, and sadness, whereas instrumental aggression was uniquely associated with callous-unemotional traits and (low) positive emotions. Groups identified by latent profile analyses were differentiated only by aggression severity.

CONCLUSIONS

The findings support both the similarity and distinction of reactive and instrumental aggression vis-à-vis their affective phenomenology. Consistent with existing theories, reactive aggression was linked to multiple forms of negative emotionality, whereas instrumental aggression was linked to higher levels of callous-unemotional traits. In a novel finding, instrumental aggression was uniquely characterized by lower positive emotions. The findings highlight the utility of pre-registered approaches employing comprehensive personality-based affective frameworks to organize and understand similarities and differences between aggression functions.

Increasing Value and Reducing Waste of Research on Neurofeedback Effects in Post-traumatic Stress Disorder: A State-of-the-Art-Review

Post-Traumatic Stress Disorder (PTSD) is often considered challenging to treat due to factors that contribute to its complexity. In the last decade, more attention has been paid to non-pharmacological or non-psychological therapies for PTSD, including neurofeedback (NFB). NFB is a promising non-invasive technique targeting specific brainwave patterns associated with psychiatric symptomatology. By learning to regulate brain activity in a closed-loop paradigm, individuals can improve their functionality while reducing symptom severity. However, owing to its lax regulation and heterogeneous legal status across different countries, the degree to which it has scientific support as a psychiatric treatment remains controversial. In this state-of-the-art review, we searched PubMed, Cochrane Central, Web of Science, Scopus, and MEDLINE and identified meta-analyses and systematic reviews exploring the efficacy of NFB for PTSD. We included seven systematic reviews, out of which three included meta-analyses (32 studies and 669 participants) that targeted NFB as an intervention while addressing a single condition-PTSD. We used the MeaSurement Tool to Assess systematic Reviews (AMSTAR) 2 and the criteria described by Cristea and Naudet (Behav Res Therapy 123:103479, 2019, https://doi.org/10.1016/j.brat.2019.103479 ) to identify sources of research waste and increasing value in biomedical research. The seven assessed reviews had an overall extremely poor quality score (5 critically low, one low, one moderate, and none high) and multiple sources of waste while opening opportunities for increasing value in the NFB literature. Our research shows that it remains unclear whether NFB training is significantly beneficial in treating PTSD. The quality of the investigated literature is low and maintains a persistent uncertainty over numerous points, which are highly important for deciding whether an intervention has clinical efficacy. Just as importantly, none of the reviews we appraised explored the statistical power, referred to open data of the included studies, or adjusted their pooled effect sizes for publication bias and risk of bias. Based on the obtained results, we identified some recurrent sources of waste (such as a lack of research decisions based on sound questions or using an appropriate methodology in a fully transparent, unbiased, and useable manner) and proposed some directions for increasing value (homogeneity and consensus) in designing and reporting research on NFB interventions in PTSD.

Which Symptoms Bridge Symptoms of Depression and Symptoms of Eating Disorders?: A Network Analysis

ABSTRACT

Depression is a common comorbid mental illness in eating disorders (EDs). Network theory focuses on interactions between symptoms, but findings from network analyses of EDs and depression need to be replicated to make reliable claims about the nature of symptomatic interplay. We used cross-sectional data of 366 online-recruited participants with clinically elevated ED symptomatology and constructed a regularized partial correlation network with ED and depression symptoms. To determine each symptom's influence, we calculated expected influence (EI) and bridge EI to identify symptoms that bridged symptoms of depression and ED. Concerns that others see one eat, fear of weight gain, and fear of loss of control over eating were especially important among the ED symptoms. Loss of interest and feeling sad were the key depression symptoms. Eating in secret and low self-esteem emerged as potential bridge symptoms between clusters. These findings regarding bridge symptoms partially overlap with prior network analyses in nonclinical and clinical samples. Future studies that investigate symptom interplay via a longitudinal design to deduce causality are needed.

Adapting Open Science and Pre-registration to Longitudinal Research

Open science practices, such as pre-registration and data sharing, increase transparency and may improve the replicability of developmental science. However, developmental science has lagged behind other fields in implementing open science practices. This lag may arise from unique challenges and considerations of longitudinal research. In this paper, preliminary guidelines are provided for adapting open science practices to longitudinal research to facilitate researchers' use of these practices. The guidelines propose a serial and modular approach to registration that includes an initial pre-registration of the methods and focal hypotheses of the longitudinal study, along with subsequent pre- or co-registered questions, hypotheses, and analysis plans associated with specific papers. Researchers are encouraged to share their research materials and relevant data with associated papers, and to report sufficient information for replicability. In addition, there should be careful consideration about requirements regarding the timing of data sharing, to avoid disincentivizing longitudinal research.

Designing daily-life research combining experience sampling method with parallel data

BACKGROUND

Ambulatory monitoring is gaining popularity in mental and somatic health care to capture an individual's wellbeing or treatment course in daily-life. Experience sampling method collects subjective time-series data of patients' experiences, behavior, and context. At the same time, digital devices allow for less intrusive collection of more objective time-series data with higher sampling frequencies and for prolonged sampling periods. We refer to these data as parallel data. Combining these two data types holds the promise to revolutionize health care. However, existing ambulatory monitoring guidelines are too specific to each data type, and lack overall directions on how to effectively combine them.

METHODS

Literature and expert opinions were integrated to formulate relevant guiding principles.

RESULTS

Experience sampling and parallel data must be approached as one holistic time series right from the start, at the study design stage. The fluctuation pattern and volatility of the different variables of interest must be well understood to ensure that these data are compatible. Data have to be collected and operationalized in a manner that the minimal common denominator is able to answer the research question with regard to temporal and disease severity resolution. Furthermore, recommendations are provided for device selection, data management, and analysis. Open science practices are also highlighted throughout. Finally, we provide a practical checklist with the delineated considerations and an open-source example demonstrating how to apply it.

CONCLUSIONS

The provided considerations aim to structure and support researchers as they undertake the new challenges presented by this exciting multidisciplinary research field.

Left-dominance for resting-state temporal low-gamma power in children with impaired word-decoding and without comorbid ADHD

One theory of the origins of reading disorders (i.e., dyslexia) is a language network which cannot effectively 'entrain' to speech, with cascading effects on the development of phonological skills. Low-gamma (low-γ, 30-45 Hz) neural activity, particularly in the left hemisphere, is thought to correspond to tracking at phonemic rates in speech. The main goals of the current study were to investigate temporal low-γ band-power during rest in a sample of children and adolescents with and without reading disorder (RD). Using a Bayesian statistical approach to analyze the power spectral density of EEG data, we examined whether (1) resting-state temporal low-γ power was attenuated in the left temporal region in RD; (2) low-γ power covaried with individual reading performance; (3) low-γ temporal lateralization was atypical in RD. Contrary to our expectations, results did not support the hypothesized effects of RD status and poor decoding ability on left hemisphere low-γ power or lateralization: post-hoc tests revealed that the lack of atypicality in the RD group was not due to the inclusion of those with comorbid attentional deficits. However, post-hoc tests also revealed a specific left-dominance for low-γ rhythms in children with reading deficits only, when participants with comorbid attentional deficits were excluded. We also observed an inverse relationship between decoding and left-lateralization in the controls, such that those with better decoding skills were less likely to show left-lateralization. We discuss these unexpected findings in the context of prior theoretical frameworks on temporal sampling. These results may reflect the importance of real-time language processing to evoke gamma rhythms in the phonemic range during childhood and adolescence.

Comparing self-harming intentions underlying eating disordered behaviors and nonsuicidal self-injury: Replication and extension in adolescents

OBJECTIVE

Eating disorder (ED) behaviors are often characterized as indirect forms of self-harm. However, recent research has found less clear demarcations between direct self-harming behaviors (e.g., nonsuicidal self-injury [NSSI], suicidal behaviors) than previously assumed. The aim of this study was to replicate findings of this prior research on adult populations in adolescents with a history of restrictive eating.

METHOD

A total of 117 adolescents between ages 12-14 were included in the study. Participants reported the presence and frequency of binge eating, compensatory, restrictive eating, and NSSI. Participants also reported thoughts of and intentions to hurt and kill themselves when engaging in each behavior on average. The t-tests and linear effects models were conducted to compare self-harming thoughts and intentions across behaviors.

RESULTS

Participants reported at least some intent to hurt themselves physically in the moment and in the long-term when engaging in all ED behaviors and NSSI, and reported engaging in these behaviors while thinking about suicide. Direct self-harming knowledge and intentions were most frequently reported with NSSI and longer-term knowledge and intentions via NSSI and restrictive eating. Additionally, participants reported some suicidal thoughts and intentions across behaviors.

DISCUSSION

This study replicates prior research, suggesting that adolescents engage in ED behaviors and NSSI with non-zero self-harming and suicidal thoughts and intentions. ED behaviors and NSSI may better be explained on a continuum. Implications include the recommendation of safety planning during ED treatment.

PUBLIC SIGNIFICANCE STATEMENT

This study highlights the overlap between eating disorder (ED) behaviors, nonsuicidal self-injury (NSSI), and suicide. Though clear distinctions typically exist for motives of self-harming behavior between ED behaviors (i.e., indirect, in the long run) and NSSI (i.e., direct, in the moment), this research suggests that intentions for self-harming and suicide may exist on a continuum. Clinical ED treatment should consider safety planning as part of routine interventions.

A Metascientific Review of the Evidential Value of Acceptance and Commitment Therapy for Depression

In the past three-and-a-half decades, nearly 500 randomized controlled trials (RCTs) have examined Acceptance and Commitment Therapy (ACT) for a range of health problems, including depression. However, emerging concerns regarding the replicability of scientific findings across psychology and mental health treatment outcome research highlight a need to re-examine the strength of evidence for treatment efficacy. Therefore, we conducted a metascientific review of the evidential value of ACT in treating depression. Whereas reporting accuracy was generally high across all trials, we found important differences in evidential value metrics corresponding to the types of control conditions used. RCTs of ACT compared to weaker controls (e.g., no treatment, waitlist) were well-powered, with sample sizes appropriate for detecting plausible effect sizes. They typically yielded stronger Bayesian evidence for (and larger posterior estimates of) ACT efficacy, though there was some evidence of significance inflation among these effects. RCTs of ACT against stronger controls (e.g., other psychotherapies), meanwhile, were poorly powered, designed to detect implausibly large effect sizes, and yielded ambiguous-if not contradicting-Bayesian evidence and estimates of efficacy. Although our review supports a view of ACT as efficacious for treating depression compared to weaker controls, future RCTs must provide more transparent reporting with larger groups of participants to properly assess the difference between ACT and competitor treatments such as behavioral activation and other forms of cognitive behavioral therapy. Clinicians and health organizations should reassess the use of ACT for depression if costs and resources are higher than for other efficacious treatments. Clinical trials contributing effects to our synthesis can be found at https://osf.io/qky35.

Differing Perceptions of Criminal Justice and Views of Law Enforcement: A Cluster-Analytic Approach to Racial-Ethnic Identities

Race and ethnicity within psycholegal research have often been treated as nominal variables which ignores their rich within-cultural diversity and can sometimes lead to sweeping pejorative conclusions (e.g., higher prevalence of arrests). The development of several salient measures of racial-ethnic attitudes-such as the CERIS-A and MEIM-has sparked a refocusing on dimensional perspectives of race and ethnicity. This refocus becomes especially important when examining views of law enforcement and criminal justice in light of unwarranted deaths of minoritized groups while in police custody. The current study recruited a juror-eligible, online community sample (i.e., MTurk) to study their views of justice and police. Using the seven subscales of the CERIS-A, four cluster groups were identified that spanned participants' race and ethnicity. Unique patterns emerged when comparing the four groups. For example, the cluster high on both multiculturalism and their own racial-ethnic identity had far more negative views of police conduct regarding its lawfulness and fairness. Further differences emerged for views of criminal justice including the death penalty. The research implications of these findings were discussed.

Predicting adolescent depression and anxiety from multi-wave longitudinal data using machine learning

BACKGROUND

This study leveraged machine learning to evaluate the contribution of information from multiple developmental stages to prospective prediction of depression and anxiety in mid-adolescence.

METHODS

A community sample (N = 374; 53.5% male) of children and their families completed tri-annual assessments across ages 3-15. The feature set included several important risk factors spanning psychopathology, temperament/personality, family environment, life stress, interpersonal relationships, neurocognitive, hormonal, and neural functioning, and parental psychopathology and personality. We used canonical correlation analysis (CCA) to reduce the large feature set to a lower dimensional space while preserving the longitudinal structure of the data. Ablation analysis was conducted to evaluate the relative contributions to prediction of information gathered at different developmental periods and relative to previous disorder status (i.e. age 12 depression or anxiety) and demographics (sex, race, ethnicity).

RESULTS

CCA components from individual waves predicted age 15 disorder status better than chance across ages 3, 6, 9, and 12 for anxiety and 9 and 12 for depression. Only the components from age 12 for depression, and ages 9 and 12 for anxiety, improved prediction over prior disorder status and demographics.

CONCLUSIONS

These findings suggest that screening for risk of adolescent depression can be successful as early as age 9, while screening for risk of adolescent anxiety can be successful as early as age 3. Assessing additional risk factors at age 12 for depression, and going back to age 9 for anxiety, can improve screening for risk at age 15 beyond knowing standard demographics and disorder history.

On the association between personality, fear of missing out (FoMO) and problematic social media use tendencies in European and Arabian samples

Recent meta-analytical evidence indicates a mild association between higher neuroticism and lower conscientiousness scores and a tendency towards problematic social media use (PSMU). However, fear of missing out (FoMO) has emerged as a critical variable in understanding the positive link between neuroticism and PSMU. Given the replication crisis in psychology, this study aimed to reinvestigate personality-PSMU associations and, crucially, the less-studied FoMO mediation effect. To ensure generalizability of the findings, we recruited two diverse samples with European and Arabian backgrounds. The results revealed a significant total effect of neuroticism on PSMU for both cultural groups, with the European sample demonstrating a fully mediated effect via FoMO, whereas the Arab sample showed a partially mediated effect via FoMO, along with a significant direct effect. This study contributes to the existing literature by highlighting the importance of FoMO as a mediator between neuroticism and PSMU and some minor potential cultural differences in this association.

Improving the stability of bivariate correlations using informative Bayesian priors: a Monte Carlo simulation study

Objective

Much of psychological research has suffered from small sample sizes and low statistical power, resulting in unstable parameter estimates. The Bayesian approach offers a promising solution by incorporating prior knowledge into statistical models, which may lead to improved stability compared to a frequentist approach.

Methods

Simulated data from four populations with known bivariate correlations (ρ = 0.1, 0.2, 0.3, 0.4) was used to estimate the sample correlation as samples were sequentially added from the population, from n = 10 to n = 500. The impact of three different, subjectively defined prior distributions (weakly, moderately, and highly informative) was investigated and compared to a frequentist model.

Results

The results show that bivariate correlation estimates are unstable, and that the risk of obtaining an estimate that is exaggerated or in the wrong direction is relatively high, for sample sizes for below 100, and considerably so for sample sizes below 50. However, this instability can be constrained by informative Bayesian priors.

Conclusion

Informative Bayesian priors have the potential to significantly reduce sample size requirements and help ensure that obtained estimates are in line with realistic expectations. The combined stabilizing and regularizing effect of a weakly informative prior is particularly useful when conducting research with small samples. The impact of more informative Bayesian priors depends on one's threshold for probability and whether one's goal is to obtain an estimate merely in the correct direction, or to obtain a high precision estimate whose associated interval falls within a narrow range. Implications for sample size requirements and directions for future research are discussed.

Identifying active ingredients in cognitive-behavioral therapies: What if we didn't?

Identifying active ingredients of psychological interventions is a major goal of psychotherapy researchers that is often justified by the promise that it will lead to improved patient outcomes. Much of this "active ingredients" research is conducted within randomized controlled trials (RCTs) with patient populations, putting it in Phase T2 of the clinical-translational spectrum. I argue that RCTs in patient populations are very "messy laboratories" in which to conduct active ingredient work and that T0 and T1 research provide more controlled contexts. However, I call attention to the long road from identifying active ingredients of CBTs, whether in T0, T1, or T2 research, to improving outcomes. Dissemination and implementation research (T3 and T4 approaches) may be conceptually closer to improving outcomes. Given how common and disabling mental health symptoms are, I argue that if researchers want to improve patient outcomes, these research programs must receive more attention including work on the uptake of psychological interventions as well as work on optimal ordering of existing interventions.

Cortisol levels are related to neonatal pain exposure in children born very preterm at age 18 months in two independent cohorts

Exposure to pain-related stress from frequent invasive procedures in the neonatal intensive care unit (NICU) has been associated with altered physiological stress regulation, neurodevelopment, and behavior in children born very preterm (≤32 weeks gestation). Previously, in a cohort born 2003-2006 (Cohort 1), we found that, at 18 months corrected age (CA), children born extremely low gestational age (ELGA; 24-28 weeks) and very low gestational age (VLGA; 29-32 weeks), had higher pre-test cortisol levels and a different pattern of cortisol output across a developmental assessment involving cognitive challenge compared to children born full-term (FT; 39-41 weeks). Also, greater neonatal pain-related stress exposure among the preterm children was related to higher pre-test cortisol levels. Given the adverse long-term effects of neonatal pain in preterm infants and the ensuing rise in clinical concerns to appropriately manage pain in the NICU in recent years, we aimed to examine whether our findings from Cohort 1 would still be evident in an independent cohort (Cohort 2) born 2006-2011 and recruited from the same tertiary NICU in Vancouver, Canada. We also compared the cortisol patterns, clinical and socio-demographic factors, and their interrelationships between the two cohorts. In Cohort 2, our findings using multi-level modeling support and extend our earlier findings in Cohort 1, demonstrating that children born ELGA display higher pre-test cortisol levels than FT. As well, greater cortisol output across assessment was related to more anxiety/depressive behaviors in children born VLGA. Importantly, children born ELGA were exposed to less neonatal pain/stress, mechanical ventilation, and morphine in Cohort 2 than Cohort 1. In both cohorts, however, cortisol levels and patterns were related to neonatal pain/stress and clinical factors (days on mechanical ventilation, overall morphine exposure). Despite less exposure to pain/stress and adverse clinical factors in Cohort 2 compared to Cohort 1, cortisol levels and patterns across cognitive challenge in preterm children at 18-month CA were consistent across the two independent cohorts. These findings highlight that, despite improvements to neonatal care, children born extremely preterm continue to display altered HPA axis activity, which is associated with their poorer neurodevelopmental and behavioral outcomes.

Open Science in eating disorders: Using current evidence to inspire a plan for increasing the transparency of our research

OBJECTIVE

There is increasing consensus that open science practices improve the transparency and quality of clinical science. However, several barriers impede the implementation of these practices at the individual, institutional, and field levels; understanding and addressing these barriers is critical to promoting targeted efforts in increasing effective uptake of open science.

METHODS

Within this research forum, we drew from publicly available online information sources to identify initial characterizations of researchers engaged in several types of open science practices in the field of eating disorders. We use these observations to discuss potential barriers and recommendations for next steps in the promotion of these practices.

RESULTS

Data from online open science repositories suggest that individuals using these publishing approaches with pre-prints and articles with eating-disorder-relevant content are predominantly non-male gender identifying, early to mid-career stage, and are more likely to be European-, United States-, or Canada-based.

DISCUSSION

We outline recommendations for tangible ways that the eating disorder field can support broad, increased uptake of open science practices, including supporting initiatives to increase knowledge and correct misconceptions; and prioritizing the development and accessibility of open science resources.

PUBLIC SIGNIFICANCE STATEMENT

The use of open science practices has the potential to increase the transparency and quality of clinical science. This Forum uses publicly sourced online data to characterize researchers engaged in open science practices in the field of eating disorders. These observations provide an important framework from which to discuss potential barriers to open science and recommendations for next steps in the promotion of these practices.

Measuring the suicidal mind: The 'open source' Suicidality Scale, for adolescents and adults

Clinicians are expected to provide accurate and useful mental health assessments, sometimes in emergency settings. The most urgent challenge may be in calculating suicide risk. Unfortunately, existing instruments often fail to meet requirements. To address this situation, we used a sustainable scale development approach to create a publicly available Suicidality Scale (SS). Following a critical review of current measures, community input, and panel discussions, an international item pool survey included 5,115 English-speaking participants aged 13-82 years. Revisions were tested with two follow-up cross-sectional surveys (Ns = 814 and 626). Pool items and SS versions were critically examined through item response theory, hierarchical cluster, factor and bifactor analyses, resulting in a unidimensional eight-item scale. Psychometric properties were high (loadings > .77; discrimination > 2.2; test-retest r = .87; internal consistency, ω = .96). Invariance checks were satisfied for age, gender, ethnicity, rural/urban residence, first language, self-reported psychiatric diagnosis and suicide attempt history. The SS showed stronger psychometric properties, and significant differences in bivariate associations with depressive symptoms, compared with included suicide measures. The 'open source' Suicidality Scale represents a significant step forward in accurate assessment for people aged 13+, and diverse populations. This study provides an example of sustainable scale development utilizing community input, emphasis on strong psychometric evidence from diverse samples, and a free-to-use license allowing instrument revisions. These methods can be used to develop a wide variety of psychosocial instruments that can benefit clinicians, researchers, and the public.

Fenfluramine treatment for Dravet syndrome: Caregiver- and clinician-reported benefits on the quality of life of patients, caregivers, and families living in Germany, Spain, Italy, and the United Kingdom

OBJECTIVE

Clinical trial data and prior preliminary research indicate that fenfluramine (FFA) provides meaningful improvements in seizure-related and quality of life (QOL) outcomes for individuals with Dravet syndrome (DS), their caregivers, and their families. This study sought to replicate and extend these preliminary findings in a new sample of individuals with DS and their families who live in European countries.

METHODS

Study participants were European clinicians and parents caring for individuals with DS who had participated in an EU FFA Early Access Program. Participants completed one-on-one semi-structured interviews and were asked the extent to which they noticed changes in a number of the child's seizure- and non-seizure-related QOL domains after starting FFA treatment. Participants were also asked about the benefits of FFA treatment to the caregivers' lives and for the family unit.

RESULTS

25 parent caregivers and 16 clinicians participated. The caregivers and clinicians reported improvements in both seizure-related (i.e., reductions in seizure activity, improvements in the frequency or type of seizure triggers and post-ictal recovery times, and improved post-seizure function) and non-seizure-related (e.g., cognition, focus, alertness, speech, academic performance, behavior, sleep, motor function) QOL domains after FFA treatment in individuals with DS. Caregivers also reported improved mood and more time for things they enjoyed, felt less overwhelmed, reported better sleep quality, and had less personal and family stress; clinicians corroborated most of these reports. All clinicians (100%) and most (96%) caregivers said they would "very likely" or "quite likely" recommend FFA to others with DS.

CONCLUSIONS

Real-world experience in Europe with FFA treatment is associated with meaningful improvements in many QOL domains for individuals with DS and their families; replicating findings from a previous study of DS patients and their families from the USA. Caregivers and clinicians provided specific examples of the benefits of FFA for people with DS, caregivers, and their families and are very likely to recommend FFA to others with DS.

A 'Limitations' section should be mandatory in all scientific papers

It is unusual, and can be difficult, for scientists to reflect in their publications on any limitations their research had. This is a consequence of the extreme pressure that scientists are under to 'publish or perish'. The inevitable consequence is that much published research is not as good as it could, and should, be, leading to the current 'reproducibility crisis'. Approaches to address this crisis are required. Our suggestion is to include a 'Limitations' section in all scientific papers. Evidence is provided showing that such a section must be mandatory. Adding a 'Limitations' section to scientific papers would greatly increase honesty, openness and transparency, to the considerable benefit of both the scientific community and society in general. This suggestion is applicable to all scientific disciplines. Finally, we apologise if our suggestion has already been made by others.

Workplace Deceptions During the Pandemic: Differences in Conspiracy Beliefs, Psychological Functioning, and Covid-19 Experiences

The global pandemic has disrupted virtually all countries on health, psychological functioning, and economies, to name a few. Accurate information has also fallen victim to the pandemic, which has been rife with misinformation and conspiracy theories. The current study investigated Covid-19 deceptions related to employment. With complete anonymity via MTurk, 389 participants from the United States rated their likelihood of deception regarding hypothetical four workplace scenarios. The first set of analyses examined differences between high and low risk of deceptions for each scenario based on participants' self-appraisals. The largest differences were found for general conspiracy beliefs and affective disorders, specifically major depression and generalized anxiety. The second set of analyses focused across the workplace scenarios on two operationalized groups with Likely-Deceptive (n = 189) vastly outnumbering Likely-Genuine (n = 55). Personal experiences with Covid-19 dramatically increased deceptions. Testing positive for Covid-19 increased the odds of being in the Likely-Deceptive by twelve-fold. Two discriminant models examined cognitive misbeliefs and psychological functioning. When both were combined, depression and Covid-19 misinformation produced the strongest structure coefficients followed closely by general conspiracy beliefs and generalized anxiety. The far-ranging implications of these findings are discussed.

Generalized network psychometrics of eating-disorder psychopathology

OBJECTIVE

As network models of eating disorder (ED) psychopathology become increasingly popular in modeling symptom interconnectedness and identifying potential treatment targets, it is necessary to contextualize their performance against other methods of modeling ED psychopathology and to evaluate potential ways to optimize and capitalize on their use. To accomplish these goals, we used generalized network psychometrics to estimate and compare latent variable models and network models, as well as hybrid models.

METHOD

We tested the structure of the Eating Pathology Symptoms Inventory (EPSI) and Eating Disorder Examination-Questionnaire (EDE-Q) in Recovery Record, Inc. mobile phone application users (N = 6856).

RESULTS

Although all models fit well, results favored a hybrid latent variable and network framework, which showed that ED symptoms fit best when modeled as higher-order constructs, rather than direct symptom-to-symptom connections, and when the relationships between those constructs are described as a network. Hybrid models in which latent factors were modeled as nodes within a network showed that EPSI Purging, Binge Eating, Cognitive Restraint, Body Dissatisfaction, and Excessive Exercise had high importance in the network. EDE-Q Eating Concern and Shape Concern were also important nodes. Results showed that the EPSI network was highly stable and replicable, whereas the EDE-Q network was not.

DISCUSSION

Integrating latent variable and network model frameworks enables tests of centrality to identify important latent variables, such as purging, that may promote the spread of ED psychopathology throughout a network, allowing for the identification of future treatment targets.

The Artificial Intelligence System for the Generation of Sports Education Guidance Model and Physical Fitness Evaluation Under Deep Learning

In recent years, China's achievements in artificial intelligence (AI) have attracted the attention of the world, and AI technology has penetrated into all walks of life. In particular, the in-depth integration of AI technology with sports education guidance and physical fitness evaluation has achieved very significant progress and results, which has improved the quality of life of people and provided more high-quality, customized, and personalized health management services for human beings. This study aimed to explore the application model of deep learning in sports education and guidance and in the analysis of the residents' physical fitness, so as to formulate a personalized and intelligent exercise program. The residents of A and B units are selected as the research object to evaluate the physical fitness. Subsequently, the self-designed questionnaire is used to survey the chronic disease online, and the acquired data are put into a deep learning model for the analysis to obtain the physique scoring results and exercise guidance. According to the results of physical fitness evaluation, the proportion of overweight was the highest (40.4%), followed by fatty liver (24.3%) and hyperlipidemia (20.4%), showing high incidence in people aged 41-50 years. The highest incidence of female gynecological diseases was gout (23.0%) and hyperlipidemia (20.6%). After exercise therapy, the scores were excellent and good. Conclusions: The database SQL Server 2005 was a platform for storing all kinds of data and knowledge-based rule information. The user's access service was provided by the remote server via the browser. Therefore, building a rule-based reasoning mechanism can realize physical test data collection, physical fitness evaluation, and information management for improving physical fitness.

Factors Distinguishing Reciprocal Versus Nonreciprocal Intimate Partner Violence Across Time and Reporter

Although intimate partner violence (IPV) is often conceptualized as occurring unilaterally, reciprocal or bidirectional violence is actually the most prevalent form of IPV. The current study assessed physical IPV experiences in couples and evaluated risk and protective factors that may be differentially associated with reciprocal and nonreciprocal IPV concurrently and over time. As part of a multi-wave longitudinal study, women and men reported on the frequency of their IPV perpetration and victimization three times across the transition to parenthood. Participants also reported on risk factors related to personal adjustment, psychosocial resources, attitudes toward gender role egalitarianism, and sociodemographic characteristics at each wave. Participants were classified into one of four IPV groups (reciprocal violence, male perpetrators only, female perpetrators only, and no violence) based on their self-report and based on a combined report, which incorporated both partners' reports of IPV for a maximum estimate of violence. Women and men were analyzed separately, as both can be perpetrators and/or victims of IPV. Cross-sectional analyses using self-reported IPV data indicated that IPV groups were most consistently distinguished by their levels of couple satisfaction, across gender; psychological distress also appeared to differentiate IPV groups, although somewhat less consistently. When combined reports of IPV were used, sociodemographic risk markers (i.e., age, income, and education) in addition to couple functioning were among the most robust factors differentiating IPV groups concurrently, across gender. In longitudinal analyses, sociodemographic vulnerabilities were again among the most consistent factors differentiating subsequent IPV groups over time. Several gender differences were also found, suggesting that different risk factors (e.g., women's social support and men's emotion regulation abilities) may need to be targeted in interventions to identify, prevent, and treat IPV among women and men.

Psychedelic resting-state neuroimaging: A review and perspective on balancing replication and novel analyses

Clinical research into serotonergic psychedelics is expanding rapidly, showing promising efficacy across myriad disorders. Resting-state functional magnetic resonance imaging (rs-fMRI) is a commonly used strategy to identify psychedelic-induced changes in neural pathways in clinical and healthy populations. Here we, a large group of psychedelic imaging researchers, review the 42 research articles published to date, based on the 17 unique studies evaluating psychedelic effects on rs-fMRI, focusing on methodological variation. Prominently, we observe that nearly all studies vary in data processing and analysis methodology, two datasets are the foundation of over half of the published literature, and there is lexical ambiguity in common outcome metric terminology. We offer guidelines for future studies that encourage coherence in the field. Psychedelic rs-fMRI will benefit from the development of novel methods that expand our understanding of the brain mechanisms mediating its intriguing effects; yet, this field is at a crossroads where we must also consider the critical importance of consistency and replicability to effectively converge on stable representations of the neural effects of psychedelics.

Large-scale societal dynamics are reflected in human mood and brain

The stock market is a bellwether of socio-economic changes that may directly affect individual well-being. Using large-scale UK-biobank data generated over 14 years, we applied specification curve analysis to rigorously identify significant associations between the local stock market index (FTSE100) and 479,791 UK residents' mood, as well as their alcohol intake and blood pressure adjusting the results for a large number of potential confounders, including age, sex, linear and non-linear effects of time, research site, other stock market indexes. Furthermore, we found similar associations between FTSE100 and volumetric measures of affective brain regions in a subsample (n = 39,755; measurements performed over 5.5 years), which were particularly strong around phase transitions characterized by maximum volatility in the market. The main findings did not depend on applied effect-size estimation criteria (linear methods or mutual information criterion) and were replicated in two independent US-based studies (Parkinson's Progression Markers Initiative; n = 424; performed over 2.5 years and MyConnectome; n = 1; 81 measurements over 1.5 years). Our results suggest that phase transitions in the society, indexed by stock market, exhibit close relationships with human mood, health and the affective brain from an individual to population level.

Measurement practices in hallucinations research

Introduction: In several sub-fields of psychology, there has been a renewed focus on measurement practices. As far as we are aware, this has been absent in hallucinations research. Thus, we investigated (a) cross-study variation in how hallucinatory experiences are measured and (b) the reliability of measurements obtained using two tasks that are widely employed in hallucinations research.Method: In Study 1, we investigated to what extent there was variation in how the Launay-Slade Hallucination Scale (LSHS) has been used across 100 studies. In Study 2, we investigated the reliability of the measurements obtained through source monitoring and signal detection tasks, using data from four recent publications. Materials/data are available at doi: 10.17605/osf.io/d3gnk/.Results: In Study 1, we found substantial variation in how hallucinatory experiences were assessed using the LSHS and that descriptions of the LSHS were often incomplete in important ways. In Study 2, we reported a range of reliability estimates for the measurements obtained using source monitoring and signal discrimination tasks. Some measurements obtained using source monitoring tasks had unacceptably low levels of reliability.Conclusions: Our findings suggest that suboptimal measurement practices are common in hallucinations research and we suggest steps researchers could take to improve measurement practices.

Replication and Reproduction: Crises in Psychology and Academic Labour

Discussions of the replication crisis in psychology require more substantive analysis of the crisis of academic labour and of social reproduction in the university. Both the replication crisis and the crisis of social reproduction in the university describe a failure in processes of reproducing something. The financial crisis of 2007–8 shortly preceded the emergence of the replication crisis, as well as exacerbated ongoing tendencies in the organisation and practices of university research (particularly the use of precarious contracts and the adjunctification of research). These provide two reasons to address these two named crises together. But many analyses of and responses to the replication crisis turn to research culture, often at the expense of adequate investigations of research labour. Today’s psychological sciences are made through multiple forms of labour: these include researchers, who range from senior principal investigators to sub-contracted, and exploited, research assistants; research participants/subjects, who include those providing labour for experiments via exploitative platforms including Amazon Mechanical Turk; and workers providing heterogeneous technical and administrative labour. Through understanding what is at stake for these multiple forms of labour, psychology might better analyse problems besetting psychology today, as well as develop different imaginaries and practices for how to address them.

Large, open datasets for human connectomics research: Considerations for reproducible and responsible data use

Large, open datasets have emerged as important resources in the field of human connectomics. In this review, the evolution of data sharing involving magnetic resonance imaging is described. A summary of the challenges and progress in conducting reproducible data analyses is provided, including description of recent progress made in the development of community guidelines and recommendations, software and data management tools, and initiatives to enhance training and education. Finally, this review concludes with a discussion of ethical conduct relevant to analyses of large, open datasets and a researcher's responsibility to prevent further stigmatization of historically marginalized racial and ethnic groups. Moving forward, future work should include an enhanced emphasis on the social determinants of health, which may further contextualize findings among diverse population-based samples. Leveraging the progress to date and guided by interdisciplinary collaborations, the future of connectomics promises to be an impressive era of innovative research, yielding a more inclusive understanding of brain structure and function.

Open science practices for eating disorders research

This editorial seeks to encourage the increased application of three open science practices in eating disorders research: Preregistration, Registered Reports, and the sharing of materials, data, and code. For each of these practices, we introduce updated International Journal of Eating Disorders author and reviewer guidance. Updates include the introduction of open science badges; specific instructions about how to improve transparency; and the introduction of Registered Reports of systematic or meta-analytical reviews. The editorial also seeks to encourage the study of open science practices. Open science practices pose considerable time and other resource burdens. Therefore, research is needed to help determine the value of these added burdens and to identify efficient strategies for implementing open science practices.

On Blurry Boundaries When Defining Digital Biomarkers: How Much Biology Needs to Be in a Digital Biomarker?

Recent years have seen a rise in research where so called "digital biomarkers" represent the focal study interest. Many researchers understand that digital biomarkers describe digital footprints providing insights into healthy and pathological human (neuro-)biology. Beyond that the term digital biomarker is also used at times to describe more general concepts such as linking digital footprints to human behavior (which itself can be described as the result of a biological system). Given the lack of consensus on how to define a digital biomarker, the present short mini-review provides i) an overview on various definitions and ii) distinguishes between direct (narrow) or indirect (broad) concepts of digital biomarkers. From our perspective, digital biomarkers meant as a more direct (or narrow) concept describe digital footprints being directly linked to biological variables, such as stemming from molecular genetics, epigenetics, endocrinology, immunology or brain imaging, to name a few. More indirect concepts of digital biomarkers encompass digital footprints being linked to human behavior that may act as latent variables indirectly linked to biological variables.

Age of First Exposure to Contact and Collision Sports and Later in Life Brain Health: A Narrative Review

A controversial theory proposes that playing tackle football before the age of 12 causes later in life brain health problems. This theory arose from a small study of 42 retired National Football League (NFL) players, which reported that those who started playing tackle football at a younger age performed worse on selected neuropsychological tests and a word reading test. The authors concluded that these differences were likely due to greater exposure to repetitive neurotrauma during a developmentally sensitive maturational period in their lives. Several subsequent studies of current high school and collegiate contact/collision sports athletes, and former high school, collegiate, and professional tackle football players have not replicated these findings. This narrative review aims to (i) discuss the fundamental concepts, issues, and controversies surrounding existing research on age of first exposure (AFE) to contact/collision sport, and (ii) provide a balanced interpretation, including risk of bias assessment findings, of this body of evidence. Among 21 studies, 11 studies examined former athletes, 8 studies examined current athletes, and 2 studies examined both former and current athletes. Although the literature on whether younger AFE to tackle football is associated with later in life cognitive, neurobehavioral, or mental health problems in former NFL players is mixed, the largest study of retired NFL players (N = 3,506) suggested there was not a significant association between earlier AFE to organized tackle football and worse subjectively experienced cognitive functioning, depression, or anxiety. Furthermore, no published studies of current athletes show a significant association between playing tackle football (or other contact/collision sports) before the age of 12 and cognitive, neurobehavioral, or mental health problems. It is important to note that all studies were judged to be at high overall risk of bias, indicating that more methodologically rigorous research is needed to understand whether there is an association between AFE to contact/collision sports and later in life brain health. The accumulated research to date suggests that earlier AFE to contact/collision sports is not associated with worse cognitive functioning or mental health in (i) current high school athletes, (ii) current collegiate athletes, or (iii) middle-aged men who played high school football. The literature on former NFL players is mixed and does not, at present, clearly support the theory that exposure to tackle football before age 12 is associated with later in life cognitive impairment or mental health problems.

Daily-Life Social Experiences as a Potential Mediator of the Relationship Between Parenting and Psychopathology in Adolescence

Adolescence is a vulnerable period for psychopathology development, and certain parenting styles are consistent and robust predictors of a broad range of mental health outcomes. The mechanisms through which maladaptive parenting styles affect the development of psychopathology are assumed to be largely social in nature. Yet, the social mechanisms linking parenting to psychopathology are unexplored at arguably the most important level of functioning: daily life. This study aims to identify the associations between three parenting styles, and the experience of daily-life social interactions. Furthermore, we aim to explore the extent to which these parenting styles and altered daily-life social experiences are associated with psychopathology. In this study, we recruited a sample of N = 1,913 adolescents (63.3% girls; mean age = 13.7, age range = 11 to 20) as part of the first wave of the longitudinal cohort study "SIGMA". Parenting styles (psychological control, responsiveness, and autonomy support) and psychopathology symptoms were assessed using a retrospective questionnaire battery. The experienced quality of social interactions in different types of company was assessed using the experience sampling method, ten times per day for 6 days. Direct associations between parenting styles and general quality of daily-life social experiences were tested using a three-level linear model, revealing significant associations between social experiences and different parenting styles. When interaction effects were added to this model, we found that maternal responsiveness and paternal psychological control mainly related to altered qualities of social interactions with parents, while paternal autonomy support was associated with better experiences of non-family social interactions. Finally, an exploratory path analysis highlighted how both paternal autonomy support and altered quality of non-family interactions are uniquely associated with psychopathology levels. These findings demonstrate the general and pervasive effects of maladaptive parenting styles, as parenting seems to broadly affect adolescents' interactions with different types of social partners in everyday life. Moreover, they illustrate a potential mediated relationship in which altered daily-life social interactions could drive the development of psychopathology. A stronger focus may be required on the role of altered day-to-day social experiences in the prevention and potentially, the treatment, of adolescent psychopathology.

The Potential of Digital Phenotyping and Mobile Sensing for Psycho-Diagnostics of Internet Use Disorders

Purpose of Review

The present paper provides an accessible overview on the potential of digital phenotyping and mobile sensing not only shedding light on the nature of Internet Use Disorders (IUD), but also to provide new ideas on how to improve psycho-diagnostics of mental processes linked to IUD.

Recent Findings

In detail, the psycho-diagnostic areas of prevention, treatment, and aftercare in the realm of IUDs are focused upon in this work. Before each of these areas is presented in more specificity, the terms digital phenotyping and mobile sensing are introduced against the background of an interdisciplinary research endeavor called Psychoinformatics. Obstacles to overcome problems in this emerging research endeavor—sensing psychological traits/states from digital footprints—are discussed together with risks and chances, which arise from the administration of online-tracking technologies in the field of IUDs.

Summary

Given the limited validity and reliability of traditional assessment via questionnaires or diagnostic interviews with respect to recall bias and tendencies to answer towards social desirability, digital phenotyping and mobile sensing offer a novel approach overcoming recall bias and other limitations of usual assessment approaches. This will not only set new standards in precisely mapping behavior, but it will also offer scientists and practitioners opportunities to detect risky Internet use patterns in a timely manner and to establish tailored feedback as a means of intervention.

Is There a Replication Crisis in Medical Education Research?

Scholars are increasingly aware that studies-across many disciplines-cannot be replicated by independent researchers. Here, the authors describe how medical education research may be vulnerable to this "replication crisis," explain how researchers can act together to reduce risks, and discuss the positive steps that can increase confidence in research findings. Medical education research contributes to policy and influences practitioner behavior. Findings that cannot be replicated suggest that the original research was not credible. This risk raises the possibility that unhelpful or even harmful changes to medical education have been implemented as a result of research that appeared defensible but was not. By considering these risk factors, researchers can increase the likelihood that studies are generating credible results. The authors discuss and provide examples of 6 factors that may endanger the replicability of medical education research: (1) small sample sizes, (2) small effect sizes, (3) exploratory designs, (4) flexibility in design choices, analysis strategy, and outcome measures, (5) conflicts of interest, and (6) very active fields with many competing research teams. Importantly, medical education researchers can adopt techniques used successfully elsewhere to improve the rigor of their investigations. Researchers can improve their work through better planning in the development stage, carefully considering design choices, and using sensible data analysis. The wider medical education community can help by encouraging higher levels of collaboration among medical educators, by routinely evaluating existing educational innovations, and by raising the prestige of replication and collaborative medical education research. Medical education journals should adopt new approaches to publishing. As medical education research improves, so too will the quality of medical education and patient care.

Perspectives on Recruitment and Representativeness in Forensic Psychiatric Research

Participant representativeness and statistical power are crucial elements of robust research with human participants, both of which relate to the successful recruitment of research participants. Nevertheless, such core features may often not be fully reported or duly considered in psychiatric research. Building on our experiences of collecting data in the context of forensic mental health services, we discuss issues regarding participant recruitment and representativeness in our field with its particular characteristics. A quick sampling and brief overview of the literature in four specialized forensic mental health journals is presented, demonstrating that published manuscripts rarely describe the data in sufficient detail for the reader to assess sample representativeness and statistical power. This lack of transparency leads not only to difficulties in interpreting the research; it also entails risks relating to the already meager evidence base of forensic mental health services being relevant only to a subset of patients. Accordingly, we provide suggestions for increased transparency in reporting and improved recruitment of research participants. We also discuss the balance of ethical considerations pertinent to the pursuit of increased participation rates in forensic mental health research.

Correlates of Hallucinatory Experiences in the General Population: An International Multisite Replication Study

Hallucinatory experiences can occur in both clinical and nonclinical groups. However, in previous studies of the general population, investigations of the cognitive mechanisms underlying hallucinatory experiences have yielded inconsistent results. We ran a large-scale preregistered multisite study, in which general-population participants (N = 1,394 across 11 data-collection sites and online) completed assessments of hallucinatory experiences, a measure of adverse childhood experiences, and four tasks: source memory, dichotic listening, backward digit span, and auditory signal detection. We found that hallucinatory experiences were associated with a higher false-alarm rate on the signal detection task and a greater number of reported adverse childhood experiences but not with any of the other cognitive measures employed. These findings are an important step in improving reproducibility in hallucinations research and suggest that the replicability of some findings regarding cognition in clinical samples needs to be investigated.

Replicating extensive brain structural heterogeneity in individuals with schizophrenia and bipolar disorder

Identifying brain processes involved in the risk and development of mental disorders is a major aim. We recently reported substantial interindividual heterogeneity in brain structural aberrations among patients with schizophrenia and bipolar disorder. Estimating the normative range of voxel-based morphometry (VBM) data among healthy individuals using a Gaussian process regression (GPR) enables us to map individual deviations from the healthy range in unseen datasets. Here, we aim to replicate our previous results in two independent samples of patients with schizophrenia (n1 = 94; n2 = 105), bipolar disorder (n1 = 116; n2 = 61), and healthy individuals (n1 = 400; n2 = 312). In line with previous findings with exception of the cerebellum our results revealed robust group level differences between patients and healthy individuals, yet only a small proportion of patients with schizophrenia or bipolar disorder exhibited extreme negative deviations from normality in the same brain regions. These direct replications support that group level-differences in brain structure disguise considerable individual differences in brain aberrations, with important implications for the interpretation and generalization of group-level brain imaging findings to the individual with a mental disorder.

Brain markers predicting response to cognitive-behavioral therapy for social anxiety disorder: an independent replication of Whitfield-Gabrieli et al. 2015

Predictive brain markers promise a number of important scientific, clinical, and societal applications. Over 600 predictive brain markers have been described in published reports, but very few have been tested in independent replication attempts. Here, we conducted an independent replication of a previously published marker predicting treatment response to cognitive-behavioral therapy for social anxiety disorder from patterns of resting-state fMRI amygdala connectivity1. The replication attempt was conducted in an existing dataset similar to the dataset used in the original report, by a team of independent investigators in consultation with the original authors. The precise model described in the original report positively predicted treatment outcomes in the replication dataset, but with marginal statistical significance, permutation test p = 0.1. The effect size was substantially smaller in the replication dataset, with the model explaining 2% of the variance in treatment outcomes, as compared to 21% in the original report. Several lines of evidence, including the current replication attempt, suggest that features of amygdala function or structure may be able to predict treatment response in anxiety disorders. However, predictive models that explain a substantial amount of variance in independent datasets will be needed for scientific and clinical applications.

Sample size, sample size planning, and the impact of study context: systematic review and recommendations by the example of psychological depression treatment

BACKGROUND

Sample size planning (SSP) is vital for efficient studies that yield reliable outcomes. Hence, guidelines, emphasize the importance of SSP. The present study investigates the practice of SSP in current trials for depression.

METHODS

Seventy-eight randomized controlled trials published between 2013 and 2017 were examined. Impact of study design (e.g. number of randomized conditions) and study context (e.g. funding) on sample size was analyzed using multiple regression.

RESULTS

Overall, sample size during pre-registration, during SSP, and in published articles was highly correlated (r's ≥ 0.887). Simultaneously, only 7-18% of explained variance related to study design (p = 0.055-0.155). This proportion increased to 30-42% by adding study context (p = 0.002-0.005). The median sample size was N = 106, with higher numbers for internet interventions (N = 181; p = 0.021) compared to face-to-face therapy. In total, 59% of studies included SSP, with 28% providing basic determinants and 8-10% providing information for comprehensible SSP. Expected effect sizes exhibited a sharp peak at d = 0.5. Depending on the definition, 10.2-20.4% implemented intense assessment to improve statistical power.

CONCLUSIONS

Findings suggest that investigators achieve their determined sample size and pre-registration rates are increasing. During study planning, however, study context appears more important than study design. Study context, therefore, needs to be emphasized in the present discussion, as it can help understand the relatively stable trial numbers of the past decades. Acknowledging this situation, indications exist that digital psychiatry (e.g. Internet interventions or intense assessment) can help to mitigate the challenge of underpowered studies. The article includes a short guide for efficient study planning.

Reliability of Differential Item Functioning in Alcohol Use Disorder: Bayesian Meta-Analysis of Criteria Discrimination Estimates

Numerous studies leverage item response theory (IRT) methods to examine measurement characteristics of alcohol use disorder (AUD) diagnostic criteria. Less work has examined the consistency of AUD IRT parameter estimates, an essential step for establishing measurement invariance, making statements about symptom diagnosticity, and validating the theoretical construct. A Bayesian meta-analysis of IRT discrimination values for AUD criteria across 33 independent samples (Total N = 321,998) revealed that overall consistency of AUD criteria discriminations was low (generalized intraclass correlation range = .105-.249). However, specific study characteristics accounted for substantial variability, suggesting that the unreliability is partially systematic. We replicated evidence of differential item functioning (DIF) via established factors (e.g., age, gender), but the magnitudes were small compared with DIF associated with assessment instrument. These results offer practical recommendations regarding which instruments to use when specific AUD criteria are of interest and which criteria are most sensitive when comparing demographic groups.