Trends in Children's Mental Health Services Research Funding by the National Institute of Mental Health From 2005 to 2015: A 42% Reduction

Research Domain Criteria in NIMH Grants Characterized Using Large Language Models

Importance

Over the past decade, the leadership of the National Institute of Mental Health (NIMH) has emphasized the importance of a transdiagnostic approach to psychiatric investigation using Research Domain Criteria (RDoC) mapping more closely to neurobiology.

Objective

To investigate whether research support from the NIMH for individual RDoC domains and for transdiagnostic investigation has changed over time and has had differential impact in terms of publication, citations, or patent filings.

Design, Setting, and Participants

In this longitudinal cohort study, all R01, R21, and R03 studies funded by the NIMH between January 2003 and December 2023 were identified via the National Institutes of Health RePORTER database. Their abstracts were characterized in terms of RDoC domains (negative valence, positive valence, cognition, social, arousal, and sensorimotor) using a large language model.

Main Outcomes and Measures

Primary outcomes were publications, citation impact estimated at 5 years from the index year of funding, and patents, examined using regression models adjusted for other grant characteristics.

Results

Among 8897 R01, R03, and R21 projects, reflecting $17.7 billion of investment, abstracts of 3141 (35.3%) reflected negative valence; 1344 (15.1%), positive valence; 2781 (31.3%), cognition; 1607 (18.1%), social; 343 (3.9%), arousal; and 571 (6.4%), sensorimotor domains. A total of 1793 (20.2%) incorporated a transdiagnostic perspective. Positive and social domains were associated with fewer publications (difference, -1.13 [95% CI, -2.11 to -0.15] and -2.23 [95% CI, -3.15 to -1.30], respectively) and lesser citation impact (difference, -0.47 [95% CI, -0.75 to -0.18] and -1.19 [95% CI, -1.46 to -0.91], respectively) at 5 years. Social (adjusted odds ratio [AOR], 0.11; 95% CI, 0.04-0.23) and cognitive (AOR, 0.66; 95% CI, 0.48-0.89) domains and transdiagnostic proposals (AOR, 0.37; 95% CI, 0.21-0.60) were associated with lower likelihood of patent filing.

Conclusions and Relevance

In this study of NIMH funding, grants reflecting different RDoC domains differed substantially in their scientific impact in terms of publications, citations, and patent generation. The findings suggest that large language models represent a promising approach to characterizing research proposals at scale, which may be useful in guiding resource allocation to maximize scientific return on investment.

Implementation Feasibility and Hidden Costs of Statewide Scaling of Evidence-Based Therapies for Children and Adolescents

OBJECTIVE

State mental health systems are retraining their workforces to deliver services supported by research. Knowledge about evidence-based therapies (EBTs) for child and adolescent disorders is robust, but the feasibility of their statewide scaling has not been examined. The authors reviewed implementation feasibility for 12 commonly used EBTs, defining feasibility for statewide scaling as an EBT having at least one study documenting acceptability, facilitators and barriers, or fidelity; at least one study with a racially and ethnically diverse sample; an entity for training, certification, or licensing; and fiscal data reflecting the costs of implementation.

METHODS

The authors reviewed materials for 12 EBTs being scaled in New York State and conducted a literature review with search terms relevant to their implementation. Costs and certification information were supplemented by discussions with treatment developers and implementers.

RESULTS

All 12 EBTs had been examined for implementation feasibility, but only three had been examined for statewide scaling. Eleven had been studied in populations reflecting racial-ethnic diversity, but few had sufficient power for subgroup analyses to demonstrate effectiveness with these samples. All had certifying or licensing entities. The per-clinician costs of implementation ranged from $500 to $3,500, with overall ongoing costs ranging from $100 to $6,000. A fiscal analysis of three EBTs revealed hidden costs ranging from $5,000 to $24,000 per clinician, potentially limiting sustainability.

CONCLUSIONS

The evidence necessary for embedding EBTs in state systems has notable gaps that may hinder sustainability. Research-funding agencies should prioritize studies that focus on the practical aspects of scaling to assist states as they retrain their workforces.

Disparities in Youth and Family Experiences of System-of-Care Principles by Level of Youth Need

The extent to which mental health services for youths embody system-of-care (SOC) principles is an important quality indicator. This study tested whether youth and family experiences of SOC principles varied depending on youths' level of need after adjusting for sociodemographic and treatment factors. The relationship to caregiver-reported clinical outcomes was also examined. Using administrative data and cross-sectional surveys from a stratified random sample of 1124 caregivers of youths ages 5-20 within a statewide system, adjusted analyses indicated caregivers of youths with the most intensive needs were significantly less likely to report receiving care that embodied SOC principles, with deficits on six of nine items. Youths whose services embodied SOC principles experienced significantly greater improvement in caregiver-reported functioning even after adjusting for level of need. Results highlight disparities in SOC principles for youths with intensive needs and the need for policy and intervention development to improve care for this population.

Unpacking Inequities in ADHD Diagnosis: Examining Individual-Level Race/Ethnicity and State-Level Online Information-Seeking Patterns

Attention-deficit/hyperactivity disorder (ADHD) is a prevalent, persistent, and costly mental health condition. The internet is an increasingly popular source for information related to ADHD. With a nationally representative sample (2018 NSCH), we aimed to separate individual- and state-level effects to examine inequities in ADHD diagnoses. We extracted state-level relative search volumes using "ADHD," "ADHD treatment," "ADHD medication," and "ADHD therapy" from Google Trends, and sociodemographic and clinical variables from the 2018 National Survey of Children's Health (N = 26,835). We examined state variation in ADHD-related information-seeking and applied multilevel modeling to examine associations among individual-level race/ethnicity, state-level information-seeking patterns, and ADHD diagnoses. Online information seeking related to ADHD varies by state and search term. Individual-level racial/ethnic background and state-level information-seeking patterns were associated with ADHD diagnoses; however, their cross-level interaction was not significant. This study adds to the strong body of evidence documenting geographical variation and diagnostic disparity in mental health and the growing literature on the impact of the digital divide on population health, indicating an urgent need for addressing inequities in mental health care. Increasing public interest in and access to empirically supported online information may increase access to care, especially among people of color.

Future Directions in Youth and Family Treatment Engagement: Finishing the Bridge Between Science and Service

The field has spent more than 50 years investing in the quality of youth mental healthcare, with intervention science yielding roughly 1,300 efficacious treatments. In the latter half of this period, concurrent efforts in implementation science have developed effective methods for supporting front-line service organizations and therapists to begin to bridge the science to service gap. However, many youths and families still do not benefit fully from these strategic investments due to low treatment engagement: nearly half of youths in need of services pursue them, and among those who do, roughly another half terminate prematurely. The negative impact of low engagement is substantial, and is disproportionally and inequitably so for many. We contend that to build a robust and "finished" bridge connecting science and service, the field must go beyond its two historical foci of designing interventions and preparing therapists to deliver them, to include an intentional focus on the youths and families who participate in these interventions and who work with those therapists. In this paper, we highlight the significance of treatment engagement in youth mental healthcare and discuss the current state of the literature related to four priorities: conceptualization, theory, measurement, and interventions. Next, we offer an example from our own program of research as one illustration for advancing these priorities. Finally, we propose recommendations to act on these priorities.

Review: Structural Racism, Children's Mental Health Service Systems, and Recommendations for Policy and Practice Change

OBJECTIVE

Racism is a public health crisis that impacts on children's mental health, yet mental health service systems are insufficiently focused on addressing racism. Moreover, a focus on interpersonal racism and on individual coping with the impacts of racism has been prioritized over addressing structural racism at the level of the service system and associated institutions. In this paper, we examine strategies to address structural racism via policies affecting children's mental health services.

METHOD

First, we identify and analyze federal and state policies focused on racism and mental health equity. Second, we evaluate areas of focus in these policies and discuss the evidence base informing their implementation. Finally, we provide recommendations for what states, counties, cities, and mental health systems can do to promote antiracist evidence-based practices in children's mental health.

RESULTS

Our analysis highlights gaps and opportunities in the evidence base for policy implementation strategies, including the following: mental health services for youth of color, interventions addressing interpersonal racism and bias in the mental health service system, interventions addressing structural racism, changes to provider licensure and license renewal, and development of the community health workforce.

CONCLUSION

Recommendations are provided both within and across systems to catalyze broader systems transformation.

Associations Between School Mental Health Team Membership and Impact on Service Provision

Schools are the most common venue in which children and youth receive mental health services. To organize delivery of mental health care to such a large number of children, use of school teams is often recommended. Yet, there is limited empirical literature about the composition of school mental health teams or teams’ relations to service provision. This study investigated team composition, including team multidisciplinarity (number of different types of professionals) and the presence of a community provider, and the relations of these two variables to service provision at Tier 1 (mental health promotion), Tier 2 (early intervention) and Tier 3 (intensive treatment) for 386 schools representing different school sizes, locations, and urbanicity. Results suggested team multidisciplinarity and the presence of a community provider were related to more frequent endorsement of service provision at schools. Practice and research implications are discussed including possible application to hiring decisions and further research with longitudinal data and information on service quality.

Translating and Implementing Evidence-Based Mental Health Services in Child Welfare

Children in the child welfare system with mental health difficulties seldom receive evidence-based treatment (EBT) despite the abundance of validated interventions that exist. This manuscript describes two projects aimed at increasing access to EBTs. The first is a completed field trial of an adapted parent-child interaction therapy intervention with foster-parent child dyads. New findings are presented from variable- and person-centered analyses of impact on diverse symptom profiles. The second is an ongoing statewide initiative that is increasing access to multiple EBTs while navigating implementation barriers. Lessons learned for bridging gaps between children's mental health research, services, and policy are discussed.

Trends in US pediatric mental health clinical trials: An analysis of ClinicalTrials.gov from 2007-2018

Whereas time trends in the epidemiologic burden of US pediatric mental health disorders are well described, little is known about trends in how these disorders are studied through clinical research. We identified how funding source, disorders studied, treatments studied, and trial design changed over the past decade in US pediatric mental health clinical trials. We identified all US pediatric interventional mental health trials submitted to ClinicalTrials.gov between October 1, 2007 and April 30, 2018 (n = 1,019) and manually characterized disorders and treatments studied. We assessed trial growth and design characteristics by funding source, treatments, and disorders. US pediatric mental health trials grew over the past decade (compound annual growth rate [CAGR] 4.1%). The number of studies funded by industry and US government remained unchanged, whereas studies funded by other sources (e.g., academic medical centers) grew (CAGR 11.3%). Neurodevelopmental disorders comprised the largest proportion of disorders studied, and Non-DSM-5 (Diagnostic and Statistical Manual-5) conditions was the only disorder category to grow (14.5% to 24.6%; first half to second half of decade). There was significant growth of trials studying non-psycho/pharmacotherapy treatments (33.8% to 49.0%) and a decline in trials studying pharmacotherapies (31.7% to 20.6%), though these trends differed by funding source. There were also notable differences in funding sources and treatments studied within each disorder category. Trials using double blinding declined (26.2% to 18.0%). Limitations include that ClinicalTrials.gov is not an exhaustive list of US clinical trials, and trends identified may in part reflect changes in trial registration rather than changes in clinical research. Nevertheless, ClinicalTrials.gov is among the largest databases available for evaluating trends and patterns in pediatric mental health research that might otherwise remain unassessable. Understanding these trends can guide researchers and funding bodies when considering the trajectory of the field.

Developing a Structure of Essential Services for a Child and Adolescent Mental Health System

Policy Points That child and adolescent mental health services needs are frequently unmet has been known for many decades, yet few systemic solutions have been sought and fewer have been implemented at scale. Key among the barriers to improving child and adolescent mental health services has been the lack of well-organized primary mental health care. Such care is a mutual but uncoordinated responsibility of multiple disciplines and agencies. Achieving consensus on the essential structures and processes of mental health services is a feasible first step toward creating an organized system.

Economic Evaluations of Mental Health Programs for Children and Adolescents in the United States: A Systematic Review

The United States (US) spent 201 billion dollars on mental health-related concerns in 2016, ranking mental illness as the leading cause of disability and the single largest source of economic burden worldwide. With mental health-related treatment costs and economic burden only projected to rise, there is an increasing need for cost-inclusive evaluations of mental health interventions in the US. This systematic review evaluated the intervention characteristics and the quality of 9 economic evaluation studies (e.g., cost-effectiveness, cost-benefit) of youth mental health services conducted in the US from 2003 to 2019. Existing evaluations suggest that certain mental health interventions for youth, among the few that have been formally evaluated, may be cost-effective and cost-beneficial. However, intervention characteristics were generally homogenous, a majority of studies did not adhere to the standard of economic evaluations of the CHEERS checklist, and outcome measures were not consistently clinically useful, limiting the utility of such youth mental health economic evaluations to policymakers. By adhering to standards of economic evaluations and diversifying the characteristics of interventions subject to economic evaluations, intervention researchers can increase confidence in conclusions about which youth mental health interventions are cost-effective or cost-beneficial and more meaningfully inform evidence-based mental health policy.

How Do Urban Environments Affect Young People's Mental Health? A Novel Conceptual Framework to Bridge Public Health, Planning, and Neurourbanism

Childhood and adolescence are crucial periods for mental and social development. Currently, mental illness among young people is a global epidemic, and rates of disorders such as depression and anxiety are rising. Urban living, compared with rural living, is linked with a higher risk of serious mental illness, which is important because the world is urbanizing faster than ever before. Urban environments and their landscapes, designs, and features influence mental health and well-being. However, no conceptual frameworks to date have detailed the effect of urban environments on young people's mental health, and few studies have considered the growing role of digital and social media in this relationship, leading to calls for the development of holistic approaches to describe this relationship. This article synthesizes existing knowledge on urban places (both built and natural environments) and mental health in the public health and urban planning literature and examines the emerging field of neurourbanism (a multidisciplinary study of the effect of urban environments on mental health and brain activity) to enhance current practice and research. We developed 2 novel conceptual frameworks (1 research-oriented, 1 practice-oriented), adapted from Bronfenbrenner's socioecological model, that focus on the relationship between urban environments and young people's mental health. We added a digital and social media contextual level to the socioecological model, and we applied a multilayer concept to highlight potential cross-field interactions and collaborations. The proposed frameworks can help to guide future practice and research in this area.

Acceptance and Commitment Therapy: A Systematic Literature Review of Prevention and Intervention Programs for Mental Health Difficulties in Children and Young People

BACKGROUND

Acceptance and commitment therapy (ACT) is increasingly being used to treat mental health difficulties, however there is a paucity of reviews concerning ACT with children.

AIM

To examine the literature about ACT interventions for child and adolescent mental well-being.

METHODS

Searches for articles reporting on ACT interventions to prevent/reduce child mental health difficulties were undertaken. Methodological quality was assessed and a narrative synthesis was used to summarize findings about mental health symptoms and psychological flexibility.

RESULTS

Ten articles were identified focusing on prevention and intervention for anxiety, depression, obsessive compulsive disorder, anorexia nervosa, and trichotillomania. Most studies found that mental health symptoms reduced following an ACT intervention and psychological flexibility increased. However, findings indicate that other active interventions also led to the same changes.

CONCLUSIONS

ACT is a promising intervention for adolescent mental health, although further research is needed to establish whether reductions in mental health symptoms are due to an increase in psychological flexibility.

Trends Over a Decade in NIH Funding for Autism Spectrum Disorder Services Research

Investments in autism spectrum disorder (ASD) research, guided by the Interagency Autism Coordinating Committee (IACC), have focused disproportionately on etiology over a well-established stakeholder priority area: research to improve accessibility and quality of community-based services. This study analyzed National Institutes of Health ASD services research funding from 2008 to 2018 to examine funding patterns, evaluate the impact of IACC objectives, and identify future directions. Approximately 9% of total funds were allocated to services research. This investment remained relatively stable across time and lacked diversity across domains (e.g., area of focus, ages sampled, implementation strategies used). While advancements were observed, including increased prevalence of projects focused on adult samples and on dissemination/implementation and prevention areas, greater investment in service research is critically needed.

Rates of Mental Health Service Utilization by Children and Adolescents in Schools and Other Common Service Settings: A Systematic Review and Meta-Analysis

A meta-analysis was conducted to examine the relative rates of youth mental health service utilization across settings among the general population and among those with elevated mental health symptoms or clinical diagnoses. Rates of school-based mental health were compared to outpatient, primary care, child welfare, juvenile justice, and inpatient. Nine studies presented rates of mental health service use for general-population youth in the U.S., and 14 studies presented rates for youth with elevated symptoms or clinical diagnoses. Random effects meta-analysis was used to calculate mean proportions of youth receiving care in each sector. Of general population youth, 7.28% received school mental health services. Rates for other sectors are as follows: 7.26% in outpatient settings, 1.76% in primary care, 1.80% in inpatient, 1.35% in child welfare, and 0.90% juvenile justice. For youth with elevated mental health symptoms or diagnoses, 22.10% of youth were served by school-based mental health services, 20.56% outpatient settings, 9.93% primary care, 9.05% inpatient, 7.90% child welfare, and 4.50% juvenile justice. Schools and outpatient settings are the most common loci of mental health care for both the general population and samples of youth with elevated symptoms or clinical diagnoses, although substantial amounts of care are also provided in a range of other settings. Results hold potential for informing resource allocation, legislation and policy, intervention development, and research. Given that mental health services are delivered across many settings, findings also point to the need for interconnection across child-serving sectors, particularly schools and outpatient clinics.

Exploring the Alignment of Behavior Screening Policies and Practices in US Public School Districts

BACKGROUND

Although recent studies provide information regarding state-level policies and district-level practices regarding social, emotional, and behavioral screening, the degree to which these policies influence screening practices is unknown. As such, the purpose of this exploratory study was to compare state- and district-level policies and reported practices around school-based social, emotional, and behavioral screening.

METHODS

We obtained data for the present study from three sources: (1) a recent systematic review of state department of education websites; (2) a national survey of 1330 US school districts; and (3) a Web search and review of policy manuals published by the 1330 school districts. Comparative analyses were used to identify similarities and differences across state and district policies and practices.

RESULTS

Of the 1330 districts searched, 911 had policy manuals available for review; 87 of these policy manuals, which represented 10 states, met inclusion criteria, and thus, were included in analyses. Discrepancies were found across state and district policies and across state social, emotional, and behavioral screening guidance and district practices, but consistencies did exist across district policies within the same state.

CONCLUSION

District-level guidance around social, emotional, and behavioral screening appears to be limited. Our findings suggest a disconnect between state- and district-level social, emotional, and behavioral screening guidance and district reported practices, which signifies the need to identify the main influences on district- and school-level screening practices.

Trends in Children's Mental Health Services Research Funding: Response to Hoagwood and Colleagues' Commentary

In their recent JAACAP Commentary, Hoagwood et al.¹ examined data extracted from the National Institutes of Health Research Portfolio Online Reporting Tools (RePORT) and concluded there has been a decrease in National Institute of Mental Health (NIMH) funding for child and adolescent services and intervention research during the 10-year period from 2005 to 2015. They eloquently argued for the importance of research that can guide practice and inform the organization and delivery of children's mental health services in the current context of unmet need and the state of mental health service delivery.