Quantifying Potential Bias Resulting From Child Age on Screening for Hyperactive/Impulsive Presentations of ADHD

OBJECTIVE

This study aims to quantify the potential age bias in screening of hyperactive/impulsive presentations of ADHD in children ages 5 to 12 through comparison of age-based and overall percentiles in screening.

METHOD

A referred clinical sample of 307 children ages 5 to 12 with behavioral concerns completed the Vanderbilt Attention Deficit-Hyperactivity Disorder Diagnostic Parent Rating Scale (VADPRS) and were formally evaluated for ADHD with a diagnostic interview. Analysis utilizing logistic regression and receiver operating characteristic (ROC) curves was performed to compare the screening performance of agebased and overall percentiles.

RESULTS

The age-based percentiles demonstrated no improvement in the analyzed models compared to overall percentiles in hyperactive presentation ADHD screening. This finding was present in the overall sample and in the sub analysis of the 5 to 6 year old children.

CONCLUSIONS

This study identifies no improvement in modeling of hyperactive/impulsive ADHD screening when considering a child's age using age-based percentiles.

An Exposure-Based Video Game (Dr. Zoo) to Reduce Needle Phobia in Children Aged 3 to 6 Years: Development and Mixed Methods Pilot Study

BACKGROUND

Needle phobia, which affects 19% of children aged 4 to 6 years, prevents many children from receiving necessary or preventive medical treatments. Digital interventions have been made to target needle phobia but currently rely on distraction rather than evidence-based exposure.

OBJECTIVE

We designed and evaluated a serious exposure-based mobile game called Dr. Zoo to reduce the fear of needles in children aged 3 to 6 years, where players administered shots to cartoon animals.

METHODS

We conducted a mixed methods study with 30 parents (mean age 35.87, SD 4.39 years) and their 36 children (mean age 4.44, SD 1.11 years) who played the game for 5 days leading to a scheduled appointment that included an injection (eg, influenza vaccination). After the study, parents completed exit surveys and participated in semistructured interviews to evaluate ease of use, acceptability, and preliminary effectiveness of the game and to provide insights on their experience with the game to inform future developments. Interview transcripts were analyzed by 3 independent coders following an open coding process and subsequently coded and discussed to reach consensus.

RESULTS

Parents rated their child's difficulty in completing the game as very low on average (scale 1-5; mean 1.76, SD 0.82) and were highly likely to recommend Dr. Zoo to other parents (scale 1-5; mean 4.41, SD 0.87), suggesting Dr. Zoo's strong ease of use and high acceptability. In the exit survey, parents rated their child's fear as significantly lower after participating in the study (scale 1-5; mean 3.09, SD 1.17) compared with that before participating (scale 1-5; mean 4.37, SD 0.81; z score=-4.638; P<.001). Furthermore, 74% (26/35) of the parents reported that the game had a positive impact on their child's fear or perception of needles (only 2 parents reported a negative impact). Qualitative analysis of the interview transcripts revealed potentially important features of the game in this positive impact, such as the game's interactive design, as observed in 69% (24/35) of our participants.

CONCLUSIONS

The results suggest that an evidence-based serious mobile game can be an easy-to-use, acceptable, and potentially effective intervention for changing young children's fear and perceptions of needles. Leveraging digital interventions may be a potential solution to needle anxiety as a public health concern.

National Norms and Percentiles for the Pediatric Emotional Distress Scale

We estimated norms and percentiles for the Pediatric Emotional Distress Scale (PEDS) in order to enhance its utility as a screening tool for emotional and behavioral distress following a major. The PEDS was administered to a nationally representative sample of parents of children ages 5-12 from all 50 states (N = 1,570). Approximately 15% of the parents reported a trauma/stress in the past 12 months. Results showed good internal consistency (α = .92) and concurrent validity, with significantly higher scores for the trauma/stress subsample compared to the no trauma/stress subsample. PEDS scores were also significantly higher in younger children (age 5-6) compared to older children (7-12), pointing to the need for separate clinical cut-off scores for younger versus older children. Finally, we examined the factor structure of the PEDS with results supporting a four factor solution in the trauma/stress subsample. For screening purposes, we recommend cut-off scores of 39 (ages 5-6) and 35 (ages 7-12) which correspond to the 90th percentile.

Meta-analysis of associations between childhood adversity and diurnal cortisol regulation

Childhood adversity has been associated with hypothalamic-pituitary-adrenal axis dysregulation, which is associated with mental and physical health consequences. However, associations between childhood adversity and cortisol regulation in the current literature vary in magnitude and direction. This multilevel meta-analysis examines the association between childhood adversity and diurnal cortisol measures, as well as potential moderators of these effects (adversity timing and type, study or sample characteristics). A search was conducted in online databases PsycINFO and PubMed for papers written in English. After screening for exclusion criteria (papers examining animals, pregnant women, people receiving hormonal treatment, people with endocrine disorders, cortisol before age 2 months, or cortisol after an intervention), 303 papers were identified for inclusion. In total, 441 effect sizes were extracted from 156 manuscripts representing 104 studies. A significant overall effect was found between childhood adversity and bedtime cortisol, r = 0.047, 95% CI [0.005, 0.089], t = 2.231, p = 0.028. All other overall and moderation effects were not significant. The lack of overall effects may reflect the importance of the timing and nature of childhood adversity to adversity's impact on cortisol regulation. Thus, we offer concrete recommendations for testing theoretical models linking early adversity and stress physiology.

Deficits in Parent Knowledge of Behavior Management Skills is Strongly Associated with CD Symptoms but Not ODD Symptoms

We conducted secondary analyses of existing data to examine the association between parent scores on the Knowledge of Effective Parenting Test (KEPT) and child symptoms of Conduct Disorder (CD) and Oppositional Defiant Disorder (ODD). Parent knowledge of behavior management skills and child behavior symptoms were assessed in a nationally representative sample of parents/guardians (N = 1,570) of children aged 5-12 from all 50 states. Results showed consistent and robust correlations between parent knowledge of behavior management skills and CD symptoms but not ODD symptoms. These findings suggest that parent knowledge of behavior management may be a greater risk factor for CD than ODD, with implications for taxonomy and understanding the etiology of these two disorders. We also discuss the implications of these findings for the prevention and treatment of these two disorders which are often grouped together in treatment trials.

National Norms for the Vanderbilt ADHD Diagnostic Parent Rating Scale in Children

OBJECTIVE

To provide national norms and percentiles for both research and clinical scoring modalities of the Vanderbilt Attention Deficit/Hyperactivity Disorder (ADHD) Diagnostic Parent Rating Scale (VADPRS) for a representative sample of children ages 5-12 in the United States.

METHOD

The five clinical subscales of the VADPRS were completed by 1,570 caregivers of children ages 5-12 in the United States, with children representative of the national population on key demographic variables including race, sex, ethnicity, family income, and family educational level. Descriptive statistics and measures of internal consistency of both dimensional and symptom count scoring were provided for each of the five clinical subscales of the inventory, as well as percentiles and group comparisons for select dimensional scoring subscales based on age and child sex.

RESULTS

Measures of internal consistency for each subscale using both scoring modalities of the VADPRS ranged from high to acceptable. There were statistically significant differences among the different subscales for both age (ADHD hyperactivity, anxiety/depression) and sex [both presentations of ADHD, oppositional defiant disorder (ODD)] for the total sample. These differences, however, were modest in magnitude and unlikely to be clinically meaningful.

CONCLUSIONS

This study enhances the research and clinical utility of the VADPRS by providing national norms and percentiles for each of its subscales. Differences between age and sex across the sample were statistically significant for two of the subscales (Hyperactivity and Anxiety/Depression) with additional subscales significant for sex alone (Inattentive and ODD), but these differences were not substantial enough to indicate a need for separate cut-offs for screening purposes.

Objective Measurement of Hyperactivity Using Mobile Sensing and Machine Learning: A Pilot Study (Preprint)

Background

Although hyperactivity is a core symptom of attention-deficit/hyperactivity disorder (ADHD), there are no objective measures that are widely used in clinical settings.

Objective

We describe the development of a smartwatch app to measure hyperactivity in school-age children. The LemurDx prototype is a software system for smartwatches that uses wearable sensor technology and machine learning to measure hyperactivity. The goal is to differentiate children with ADHD combined presentation (a combination of inattentive and hyperactive/impulsive presentations) or predominantly hyperactive/impulsive presentation from children with typical levels of activity.

Methods

In this pilot study, we recruited 30 children, aged 6 to 11 years, to wear a smartwatch with the LemurDx app for 2 days. Parents also provided activity labels for 30-minute intervals to help train the algorithm. Half of the participants had ADHD combined presentation or predominantly hyperactive/impulsive presentation (n=15), and half were in the healthy control group (n=15).

Results

The results indicated high usability scores and an overall diagnostic accuracy of 0.89 (sensitivity=0.93; specificity=0.86) when the motion sensor output was paired with the activity labels.

Conclusions

State-of-the-art sensors and machine learning may provide a promising avenue for the objective measurement of hyperactivity.

Perceived Facilitators of and Barriers to Implementation of a Decision Support Tool for Adolescent Depression and Suicidality Screening: Focus Group and Interview Study

BACKGROUND

Screening Wizard (SW) is a technology-based decision support tool aimed at guiding primary care providers (PCPs) to respond to depression and suicidality screens in adolescents. Separate screens assess adolescents' and parents' reports on mental health symptoms, treatment preferences, and potential treatment barriers. A detailed summary is provided to PCPs, also identifying adolescent-parent discrepancies. The goal of SW is to enhance decision-making to increase the utilization of evidence-based treatments.

OBJECTIVE

This qualitative study aims to describe multi-stakeholder perspectives of adolescents, parents, and providers to understand the potential barriers to the implementation of SW.

METHODS

We interviewed 11 parents and 11 adolescents and conducted two focus groups with 18 health care providers (PCPs, nurses, therapists, and staff) across 2 pediatric practices. Participants described previous experiences with screening for depression and were shown a mock-up of SW and asked for feedback. Interviews and focus groups were transcribed verbatim, and codebooks were inductively developed based on content. Transcripts were double coded, and disagreements were adjudicated to full agreement. Completed coding was used to produce thematic analyses of the interviews and focus groups.

RESULTS

We identified five main themes across the interviews and focus groups: parents, adolescents, and pediatric PCPs agree that depression screening should occur in pediatric primary care; there is concern that accurate self-disclosure does not always occur during depression screening; SW is viewed as a tool that could facilitate depression screening and that might encourage more honesty in screening responses; parents, adolescents, and providers do not want SW to replace mental health discussions with providers; and providers want to maintain autonomy in treatment decisions.

CONCLUSIONS

We identified that providers, parents, and adolescents are all concerned with current screening practices, mainly regarding inaccurate self-disclosure. They recognized value in SW as a computerized tool that may elicit more honest responses and identify adolescent-parent discrepancies. Surprisingly, providers did not want the SW report to include treatment recommendations, and all groups did not want the SW report to replace conversations with the PCP about depression. Although SW was originally developed as a treatment decision algorithm, this qualitative study has led us to remove this component, and instead, SW focuses on aspects identified as most useful by all groups. We hope that this initial qualitative work will improve the future implementation of SW.

National Norms and Correlates of the PHQ-8 and GAD-7 in Parents of School-age Children

Anxiety and depressive disorders are global public health concerns, and research suggests that these disorders are common in parents and can adversely influence family functioning. However, little is known about normative levels of anxiety and depressive symptoms in parents of school-age children. The present study reports on generalized anxiety and depressive symptoms in 1570 parents and guardians of a nationally representative sample of children ages five to twelve years using two widely used and validated questionnaires: the eight-item variant of the Patient Health Questionnaire depression scale (PHQ-8) and the seven-item Generalized Anxiety Disorder scale (GAD-7). Moderate to severe levels of generalized anxiety symptoms were reported in 12.7% of the total sample and moderate to severe levels of depressive symptoms were reported in 14.1% of the sample; 17.7% of the sample reported moderate to severe levels of either generalized anxiety or depressive symptoms. This percentage was higher for females, younger parents and guardians, and parents and guardians reporting lower household incomes. These data, collected online in early 2018, may be useful for researchers and clinicians studying and treating anxiety and depression in parents. Further, these data provide a baseline for researchers currently studying the impact of changes related to the novel coronavirus (COVID-19) pandemic (e.g., school closures) on the mental health of parents of school-age children.

A Computer Adaptive Test (CAT) for knowledge of parent management skills: Prototype development and preliminary psychometrics

The Knowledge of Effective Parenting Test (KEPT) is a measure of parent management skills that was developed as an outcome measure for clinical trials of psychosocial treatments for disruptive behavior disorders. In the current study, we developed a computer adaptive test (CAT; KEPT-CAT) prototype and compared it to the full item bank (21 items; KEPT-Full) and to a brief static version (10 items; KEPT-Brief) using simulations from a large (N = 1,570) nationally representative dataset. Results showed that the KEPT-CAT prototype (median = 8 items) was slightly more efficient than the KEPT-Brief and had a significantly higher (p < .001) correlation with scores from the full item bank (r = .97) than the KEPT-Brief (r = .94). The KEPT-CAT prototype has additional advantages over the static KEPT-Brief, including the potential selection of different items from one administration to the next. This flexibility can reduce practice effects that might result from repeated administration of the same fixed items. (PsycInfo Database Record (c) 2020 APA, all rights reserved).

Development and Validation of the Parenting Skill Use Diary (PSUD) in a Nationally Representative Sample

Objective: We describe the development and psychometric properties of an instrument designed to assess the use of effective parenting skills reported with a daily diary. The Parenting Skill Use Diary (PSUD) was developed iteratively relying on a "common elements" approach to quantify the use of evidence-based parenting techniques for responding to child misbehaviors and positive behaviors.Method: The PSUD was administered online daily for seven days to parents/guardians of children aged 5-12. The nationally representative sample (N = 1,570) was selected to match the US population of such parents/guardians on key demographic variables.Results: The instrument demonstrated the ability to capture significant between person variability in the appropriate use of parent management skills. A weekly summary score discriminated between parents/guardians whose children screened positive versus negative for Conduct Disorder (AUC = .72) and Oppositional Defiant Disorder (AUC = .70).Conclusions: The results supported the reliability of validity of the diary as a research tool for examining mean differences.

Using a Smartphone App and Clinician Portal to Enhance Brief Cognitive Behavioral Therapy for Childhood Anxiety Disorders

Cognitive behavioral therapy (CBT) is an efficacious treatment for child anxiety disorders, but 40%-50% of youth do not respond fully to treatment, and time commitments for standard CBT can be prohibitive for some families and lead to long waiting lists for trained CBT therapists in the community. SmartCAT 2.0 is an adjunctive mobile health program designed to improve and shorten CBT treatment for anxiety disorders in youth by providing them with the opportunity to practice CBT skills outside of session using an interactive and gamified interface. It consists of an app and an integrated clinician portal connected to the app for secure 2-way communication with the therapist. The goal of the present study was to evaluate SmartCAT 2.0 in an open trial to establish usability, feasibility, acceptability, and preliminary efficacy of brief (8 sessions) CBT combined with SmartCAT. We also explored changes in CBT skills targeted by the app. Participants were 34 youth (ages 9-14) who met DSM-5 criteria for generalized, separation, and/or social anxiety disorder. Results demonstrated strong feasibility and usability of the app/portal and high satisfaction with the intervention. Youth used the app an average of 12 times between each therapy session (M = 5.8 mins per day). At posttreatment, 67% of youth no longer met diagnostic criteria for an anxiety disorder, with this percentage increasing to 86% at 2-month follow-up. Youth showed reduced symptom severity over time across raters and also improved from pre- to posttreatment in CBT skills targeted by the app, demonstrating better emotion identification and thought challenging and reductions in avoidance. Findings support the feasibility of combining brief CBT with SmartCAT. Although not a controlled trial, when benchmarked against the literature, the current findings suggest that SmartCAT may enhance the utility of brief CBT for childhood anxiety disorders.

Development and validation of the Knowledge of Effective Parenting Test (KEPT) in a nationally representative sample

We report on the development and psychometric properties of an instrument for the assessment of knowledge of effective parenting skills specific to conduct problems using an item response theory (IRT) framework. The initial item pool (36 items) for the Knowledge of Effective Parenting Test (KEPT) was administered online to a national sample (N = 1,570) selected to match the U.S. population on key demographic variables. Items with strong psychometric properties and without significant differential item functioning (DIF) by race/ethnicity were retained, resulting in a 21-item version of the KEPT with excellent reliability and validity. We also created a brief 10-item version of the KEPT to reduce respondent burden and to enhance its utility for repeated measurement in longitudinal and intervention research. We report norms and percentiles for both the 21-item version (KEPT-Full) and the 10-item version (KEPT-Brief). (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Psychometric Properties of the SCARED in a Nationally Representative U.S. Sample of 5-12-Year-Olds

OBJECTIVE

To examine the factor structure of the Screen for Child Anxiety Related Emotional Disorders - Parent Report (SCARED-P) in young children and elucidate normative levels of parent-reported anxiety using a nationally representative sample of parents of children ages 5-12 years living in the United States.

METHOD

The 41-item SCARED-P was administered to parents of 1,570 youth who were selected to match the U.S. population on key demographic variables. SCARED-P model fit and mean score differences by age, race/ethnicity, and sex were assessed.

RESULTS

SCARED-P model fit and subscale reliability appeared almost identical in younger children (ages 5-8) and older children (ages 9-12), although model fit for a five-factor model was poor in both groups. Symptoms of generalized anxiety increased from age 5 to 12, while symptoms of separation anxiety disorder decreased. Parents reported significantly more symptoms of social anxiety in females than males. No significant differences by race/ethnicity were found for mean levels of anxiety or model fit.

CONCLUSIONS

The SCARED-P shows some utility as an anxiety screening instrument in a representative sample of U.S. youth as young as 5-years-old, but caution should be used when interpreting subscale scores.

Using Mobile Health Gamification to Facilitate Cognitive Behavioral Therapy Skills Practice in Child Anxiety Treatment: Open Clinical Trial

Background

Cognitive behavioral therapy is an efficacious treatment for child anxiety disorders. Although efficacious, many children (40%-50%) do not show a significant reduction in symptoms or full recovery from primary anxiety diagnoses. One possibility is that they are unwilling to learn and practice cognitive behavioral therapy skills beyond therapy sessions. This can occur for a variety of reasons, including a lack of motivation, forgetfulness, and a lack of cognitive behavioral therapy skills understanding. Mobile health (mHealth) gamification provides a potential solution to improve cognitive behavioral therapy efficacy by delivering more engaging and interactive strategies to facilitate cognitive behavioral therapy skills practice in everyday lives (in vivo).

Objective

The goal of this project was to redesign an existing mHealth system called SmartCAT (Smartphone-enhanced Child Anxiety Treatment) so as to increase user engagement, retention, and learning facilitation by integrating gamification techniques and interactive features. Furthermore, this project assessed the effectiveness of gamification in improving user engagement and retention throughout posttreatment.

Methods

We redesigned and implemented the SmartCAT system consisting of a smartphone app for children and an integrated clinician portal. The gamified app contains (1) a series of interactive games and activities to reinforce skill understanding, (2) an in vivo skills coach that cues the participant to use cognitive behavioral therapy skills during real-world emotional experiences, (3) a home challenge module to encourage home-based exposure tasks, (4) a digital reward system that contains digital points and trophies, and (5) a therapist-patient messaging interface. Therapists used a secure Web-based portal connected to the app to set up required activities for each session, receive or send messages, manage participant rewards and challenges, and view data and figures summarizing the app usage. The system was implemented as an adjunctive component to brief cognitive behavioral therapy in an open clinical trial. To evaluate the effectiveness of gamification, we compared the app usage data at posttreatment with the earlier version of SmartCAT without gamification.

Results

Gamified SmartCAT was used frequently throughout treatment. On average, patients spent 35.59 min on the app (SD 64.18) completing 13.00 activities between each therapy session (SD 12.61). At the 0.10 significance level, the app usage of the gamified system (median 68.00) was higher than that of the earlier, nongamified SmartCAT version (median 37.00, U=76.00, P<.01). The amount of time spent on the gamified system (median 173.15) was significantly different from that of the earlier version (median 120.73, U=173.00, P=.06).

Conclusions

The gamified system showed good acceptability, usefulness, and engagement among anxious children receiving brief cognitive behavioral therapy treatment. Integrating an mHealth gamification platform within treatment for anxious children seems to increase involvement in shorter treatment. Further study is needed to evaluate increase in involvement in full-length treatment.

Evidence-Based Assessment from Simple Clinical Judgments to Statistical Learning: Evaluating a Range of Options Using Pediatric Bipolar Disorder as a Diagnostic Challenge

Reliability of clinical diagnoses is often low. There are many algorithms that could improve diagnostic accuracy, and statistical learning is becoming popular. Using pediatric bipolar disorder as a clinically challenging example, we evaluated a series of increasingly complex models ranging from simple screening to a supervised LASSO regression in a large (N=550) academic clinic sample. We then externally validated models in a community clinic (N=511) with the same candidate predictors and semi-structured interview diagnoses, providing high methodological consistency; the clinics also had substantially different demography and referral patterns. Models performed well according to internal validation metrics. Complex models degraded rapidly when externally validated. Naïve Bayesian and logistic models concentrating on predictors identified in prior meta-analyses tied or bettered LASSO models when externally validated. Implementing these methods would improve clinical diagnostic performance. Statistical learning research should continue to invest in high quality indicators and diagnoses to supervise model training.

The Importance of Calibration in Clinical Psychology

Accuracy has several elements, not all of which have received equal attention in the field of clinical psychology. Calibration, the degree to which a probabilistic estimate of an event reflects the true underlying probability of the event, has largely been neglected in the field of clinical psychology in favor of other components of accuracy such as discrimination (e.g., sensitivity, specificity, area under the receiver operating characteristic curve). Although it is frequently overlooked, calibration is a critical component of accuracy with particular relevance for prognostic models and risk-assessment tools. With advances in personalized medicine and the increasing use of probabilistic (0% to 100%) estimates and predictions in mental health research, the need for careful attention to calibration has become increasingly important.

Association between maternal depression and maternal sensitivity from birth to 12 months: a meta-analysis

Maternal sensitivity plays a central role in shaping children's development across a number of domains, and may be disrupted by depression. The current meta-analysis quantified the magnitude of the association between depression and maternal sensitivity, defined broadly as timely, contingent, and appropriate responding to infants' cues, from birth to 12 months. Across k = 48 studies and n = 4,934 mother-infant dyads, the aggregate effect size between depression and maternal sensitivity was r = -.16, p < .0001, indicating that mothers with higher depression levels were less sensitive than mothers with lower depression levels. Studies that compared a depressed group with a nondepressed/control group had larger effect sizes (r = -.35, p < .0001) than studies that examined depression within a single sample of either unselected cases or clinical-only cases (r = -.11, p < .001), suggesting that clinical levels of depression may pose a particular threat to sensitive parenting. Clinical implications (e.g. screening, prevention) are discussed.

Analyzing Proportion Scores as Outcomes for Prevention Trials: a Statistical Primer

In prevention trials, outcomes of interest frequently include data that are best quantified as proportion scores. In some cases, however, proportion scores may violate the statistical assumptions underlying common analytic methods. In this paper, we provide guidelines for analyzing frequency and proportion data as primary outcomes. We describe standard methods including generalized linear regression models to compare mean proportion scores and examine tools for testing normality and other assumptions for each model. Recommendations are made for instances when the assumptions are not met, including transformations for proportion scores that are non-normal. We also discuss more sophisticated analytical tools to model change in proportion scores over time. The guidelines provide ready-to-use analytical strategies for frequency and proportion data that are commonly encountered in prevention science.

Treatment Effects of a Primary Care Intervention on Parenting Behaviors: Sometimes It's Relative

The goal of this brief report is to demonstrate the utility of quantifying parental discipline practices as relative frequencies in measuring changes in parenting behavior and relations to child behavior following intervention. We explored comparisons across methodological approaches of assessing parenting behavior via absolute and relative frequencies in measuring improvements in parent-reported disciplinary practices (increases in positive parenting practices in response to child behavior; decreases in inconsistent discipline and use of corporal punishment) and child behavior problems. The current study was conducted as part of a larger clinical trial to evaluate the efficacy of a collaborative care intervention for behavior problems, ADHD, and anxiety in pediatric primary care practices (Doctor Office Collaborative Care; DOCC). Participants were 321 parent-child dyads (M child age = 8.00, 65 % male children) from eight pediatric practices that were cluster randomized to DOCC or enhanced usual care (EUC). Parents reported on their own discipline behaviors and child behavior problems. While treatment-related decreases in negative parenting were found using both the absolute and relative frequencies of parenting behaviors, results were different for positive parenting behaviors, which showed decreases when measured as absolute frequencies but increases when measured as relative frequencies. In addition, positive parenting was negatively correlated with child behavior problems when using relative frequencies, but not absolute frequencies, and relative frequencies of positive parenting mediated relations between treatment condition and outcomes. Our findings indicate that the methods used to measure treatment-related change warrant careful consideration.

Introduction to the Special Series: Current Directions for Measuring Parenting Constructs to Inform Prevention Science

Parenting behaviors are multifaceted and dynamic and therefore challenging to quantify. Measurement methods have critical implications for study results, particularly for prevention trials designed to modify parenting behaviors. Although multiple approaches can complement one another and contribute to a more complete understanding of prevention trials, the assumptions and implications of each approach are not always clearly addressed. Greater attention to the measurement of complex constructs such as parenting is needed to advance the field of prevention science. This series examines the challenges of measuring changes in parenting behaviors in the context of prevention trials. All manuscripts in the special series address measurement issues and make practical recommendations for prevention researchers. Manuscripts in this special series include (1) empirical studies that demonstrate novel measurement approaches, (2) re-analyses of prevention trial outcome data directly comparing and contrasting two or more methods, and (3) a statistical primer and practical guide to analyzing proportion data.

Development of internalizing problems from adolescence to emerging adulthood: Accounting for heterotypic continuity with vertical scaling

Manifestations of internalizing problems, such as specific symptoms of anxiety and depression, can change across development, even if individuals show strong continuity in rank-order levels of internalizing problems. This illustrates the concept of heterotypic continuity, and raises the question of whether common measures might be construct-valid for one age but not another. This study examines mean-level changes in internalizing problems across a long span of development at the same time as accounting for heterotypic continuity by using age-appropriate, changing measures. Internalizing problems from age 14-24 were studied longitudinally in a community sample (N = 585), using Achenbach's Youth Self-Report (YSR) and Young Adult Self-Report (YASR). Heterotypic continuity was evaluated with an item response theory (IRT) approach to vertical scaling, linking different measures over time to be on the same scale, as well as with a Thurstone scaling approach. With vertical scaling, internalizing problems peaked in mid-to-late adolescence and showed a group-level decrease from adolescence to early adulthood, a change that would not have been seen with the approach of using only age-common items. Individuals' trajectories were sometimes different than would have been seen with the common-items approach. Findings support the importance of considering heterotypic continuity when examining development and vertical scaling to account for heterotypic continuity with changing measures. (PsycINFO Database Record

Development and Preliminary Feasibility Testing of a Decision Support Tool for Childhood Anxiety Treatment

In this practical application, we describe the steps to build a decision-support tool using GeNIe 2.1 software. The method incorporates principles of decision analyses and allows for a systematic strategy to balance treatment efficacy data with patient preferences. We illustrate the utility for helping clinicians and patients choose between two or more efficacious treatment options (CBT, medication, or their combination). Preliminary pilot data from families (n = 5) seeking services at a specialty clinic for childhood anxiety disorders support the usability of the tool and high patient satisfaction. We use case examples and sample graphical output to illustrate how the decision-support system can be used to integrate data on, 1) baseline symptom severity 2) the relative effectiveness of two or more treatment options, and 3) patient preferences and values, to arrive at a personalized treatment recommendation. The decision-support tool enabled child and parent preferences to be explicitly stated and facilitated discussions about how best to incorporate their preferences into an evidenced-based treatment strategy.

Maltreatment and diurnal cortisol regulation: A meta-analysis

Childhood maltreatment leads to a host of negative physical and mental health outcomes, with cortisol dysregulation implicated as a possible mechanism. Given inconsistencies across in the literature regarding the direction and magnitude of the association between maltreatment and diurnal cortisol regulation, the current meta-analysis of 27 studies aimed to examine the association between maltreatment and at least one of 3 indicators of diurnal cortisol regulation: wake-up cortisol levels, the cortisol awakening response (CAR), and/or the diurnal cortisol slope. Effect sizes were calculated using Hedges' g formula and were pooled using a random effects model. For the association between maltreatment and wake-up cortisol level, the aggregate effect size was g=0.08, p=0.26. Notably, effect sizes between maltreatment and wake-up cortisol were significantly larger (Q_between=5.18, p=0.02) for studies of agency-referred samples, g=0.24, p=0.006, than studies for which maltreatment status was based on self-report, g=0.00, p=0.97, with maltreatment associated with reduced wake-up cortisol levels. For the association between maltreatment and the CAR and diurnal cortisol slope, the aggregate effect sizes were non-significant and none of the moderator variables were significant. Although results did not indicate a large and robust association between maltreatment and various indicators of diurnal cortisol, studies with more rigorous designs (i.e., agency-referred samples) showed a small, significant association between maltreatment and blunted wake-up cortisol levels, suggesting a pattern of hypocortisolism.

Beyond Symptom Counts for Diagnosing Oppositional Defiant Disorder and Conduct Disorder?

Conduct Disorder (CD) and Oppositional Defiant Disorder (ODD) are among the most commonly diagnosed childhood behavioral health disorders. Although there is substantial evidence of heterogeneity of symptom presentations, DSM diagnoses of CD and ODD are formally diagnosed on the basis of symptom counts without regard to individual symptom patterns. We used unidimensional item response theory (IRT) two-parameter logistic (2PL) models to examine item parameters for the individual symptoms of CD and ODD using data on 6,491 adolescents (ages 13-17) from the National Comorbidity Study: Adolescent Supplement (NCS-A). For each disorder, the symptoms differed in terms of severity and discrimination parameters. As a result, some adolescents who were above DSM diagnostic thresholds for disruptive behavior disorders exhibited lower levels of the underlying construct than others below the thresholds, based on their unique symptom profile. In terms of incremental benefit, our results suggested an advantage of latent trait scores for CD but not ODD.

A Patient-Centered Decision-Support Tool Informed by History of Interpersonal Violence: "Will This Treatment Work for Me?"

The Probability of Treatment Benefit (PTB) chart is a decision-support tool that quantifies, in absolute terms, the probability that an individual patient will benefit from a psychological treatment based on the individual's pre-treatment characteristics. The demand for such a tool has increased with the growing emphasis on personalized medicine and the need for selecting a treatment from an expanding list of evidence-based models. This method has the potential to provide clinicians and mental health consumers with a practical and interpretable means of comparing treatment options for individuals whose benefit from a particular treatment may differ substantially. We provide a practice update and demonstrate how to develop a PTB chart using data from a randomized controlled trial examining the efficacy of two approaches for treating posttraumatic stress disorder based on patients' pre-treatment exposure to multiple types of interpersonal violence. Step-by-step instructions for applying the PTB method are provided.

Mobile technology boosts the effectiveness of psychotherapy and behavioral interventions: a meta-analysis

We conducted a meta-analysis on the effects of mobile technology on treatment outcome for psychotherapy and other behavioral interventions. Our search of the literature resulted in 26 empirical articles describing 25 clinical trials testing the benefits of smartphone applications, personal digital assistants (PDAs), or text messaging systems either to supplement treatment or substitute for direct contact with a clinician. Overall, mobile technology use was associated with superior treatment outcome across all study designs and control conditions, effect size (ES) = .34, p < .0001. For the subset of 10 studies that looked specifically at the added benefit of mobile technology using a rigorous "Treatment" versus "Treatment + Mobile" design, effect sizes were only slightly more modest (ES = .27) and still significant (p < .05). Overall, the results support the role of mobile technology for the delivery of psychotherapy and other behavioral interventions.

A Meta-Analysis of Personalized Treatment Goals in Psychotherapy: A Preliminary Report and Call for More Studies

The aim of this study was to explore the hypothesis that psychotherapy has larger effect sizes for personalized treatment goals than for symptom checklists. We conducted a meta-analysis of clinical trials that measured treatment success both in terms of symptom checklists and personalized treatment goals. Our search of the literature yielded 12 studies that met our inclusion criteria. Effect sizes were substantially larger for personalized treatment goals (ES = .86, p < .0001) than for symptom checklists (ES = .32, p = .003). The magnitude of this difference was significant (p < .05). Our results suggest that psychotherapy is perhaps more effective in helping patients with individual goals than reducing scores on broad measures of symptoms. Estimates of the effectiveness of psychotherapy that are based on symptom checklists perhaps underestimate the true benefit of psychotherapy. We discuss the implications for research and clinical practice.

Skill acquisition and utilization during evidence-based psychosocial treatments for childhood disruptive behavior problems: a review and meta-analysis

We review 85 empirical articles published since 2000 that measured the acquisition and/or utilization of parent management skills and/or child cognitive-behavioral skills in the context of an evidence-based treatment (EBT) for childhood behavior problems. Results showed that: (1) there are no standardized measures of skill acquisition or skill utilization that are used across treatments, (2) little is known about predictors, correlates, or outcomes associated with skill acquisition and utilization, and (3) few studies systematically examined techniques to enhance the acquisition and utilization of specific skills. Meta-analytic results from a subset of 68 articles (59 studies) showed an overall treatment-control ES = .31, p < .01 for skill acquisition and ES = .20, p = ns for skill utilization. We recommend that future research focus on the following three areas: (1) development of standardized measures of skill acquisition and utilization from a "common elements" perspective that can used across EBTs; (2) assessment of the predictors, correlates, and outcomes associated with skill acquisition and utilization; and (3) development of innovative interventions to enhance the acquisition and utilization of cognitive-behavioral and parent management skills.

Adapting the posterior probability of diagnosis index to enhance evidence-based screening: an application to ADHD in primary care

This study adapts the Posterior Probability of Diagnosis (PPOD) Index for use with screening data. The original PPOD Index, designed for use in the context of comprehensive diagnostic assessments, is overconfident when applied to screening data. To correct for this overconfidence, we describe a simple method for adjusting the PPOD Index to improve its calibration when used for screening. Specifically, we compare the adjusted PPOD Index to the original index and naïve Bayes probability estimates on two dimensions of accuracy, discrimination and calibration, using a clinical sample of children and adolescents (N = 321) whose caregivers completed the Vanderbilt Assessment Scale to screen for attention-deficit/hyperactivity disorder and who subsequently completed a comprehensive diagnostic assessment. Results indicated that the adjusted PPOD Index, original PPOD Index, and naïve Bayes probability estimates are comparable using traditional measures of accuracy (sensitivity, specificity, and area under the curve), but the adjusted PPOD Index showed superior calibration. We discuss the importance of calibration for screening and diagnostic support tools when applied to individual patients.

Client preferences affect treatment satisfaction, completion, and clinical outcome: a meta-analysis

We conducted a meta-analysis on the effects of client preferences on treatment satisfaction, completion, and clinical outcome. Our search of the literature resulted in 34 empirical articles describing 32 unique clinical trials that either randomized some clients to an active choice condition (shared decision making condition or choice of treatment) or assessed client preferences. Clients who were involved in shared decision making, chose a treatment condition, or otherwise received their preferred treatment evidenced higher treatment satisfaction (ESd=.34; p<.001), increased completion rates (ESOR=1.37; ESd=.17; p<.001), and superior clinical outcome (ESd=.15; p<.0001), compared to clients who were not involved in shared decision making, did not choose a treatment condition, or otherwise did not receive their preferred treatment. Although the effect sizes are modest in magnitude, they were generally consistent across several potential moderating variables including study design (preference versus active choice), psychoeducation (informed versus uninformed), setting (inpatient versus outpatient), client diagnosis (mental health versus other), and unit of randomization (client versus provider). Our findings highlight the clinical benefit of assessing client preferences, providing treatment choices when two or more efficacious options are available, and involving clients in treatment-related decisions when treatment options are not available.

A probabilistic and individualized approach for predicting treatment gains: an extension and application to anxiety disordered youth

The objective of this study was to extend the probability of treatment benefit method by adding treatment condition as a stratifying variable, and illustrate this extension of the methodology using the Child and Adolescent Anxiety Multimodal Study data. The probability of treatment benefit method produces a simple and practical way to predict individualized treatment benefit based on pretreatment patient characteristics. Two pretreatment patient characteristics were selected in the production of the probability of treatment benefit charts: baseline anxiety severity, measured by the Pediatric Anxiety Rating Scale, and treatment condition (cognitive-behavioral therapy, sertraline, their combination, and placebo). We produced two charts as exemplars which provide individualized and probabilistic information for treatment response and outcome to treatments for child anxiety. We discuss the implications of the use of the probability of treatment benefit method, particularly with regard to patient-centered outcomes and individualized decision-making in psychology and psychiatry.

Quantifying discipline practices using absolute versus relative frequencies: clinical and research implications for child welfare

In the parent intervention outcome literatures, discipline practices are generally quantified as absolute frequencies or, less commonly, as relative frequencies. These differences in methodology warrant direct comparison as they have critical implications for study results and conclusions among treatments targeted at reducing parental aggression and harsh discipline. In this study, we directly compared the absolute frequency method and the relative frequency method for quantifying physically aggressive, psychologically aggressive, and nonaggressive discipline practices. Longitudinal data over a 3-year period came from an existing data set of a clinical trial examining the effectiveness of a psychosocial treatment in reducing parental physical and psychological aggression and improving child behavior (N = 139). Discipline practices (aggressive and nonaggressive) were assessed using the Conflict Tactics Scale. The two methods yielded different patterns of results, particularly for nonaggressive discipline strategies. We suggest that each method makes its own unique contribution to a more complete understanding of the association between parental aggression and intervention effects.

Evaluation of a booster intervention three years after acute treatment for early-onset disruptive behavior disorders

This study examines the impact of a brief booster treatment administered 3 years after the delivery of an acute treatment in a group (n = 118) of clinically referred boys and girls (ages 6 to 11) originally diagnosed with Oppositional Defiant Disorder (ODD) or Conduct Disorder (CD). At the conclusion of the acute treatment and three-year follow-up period (i.e., study month 42), the sample was re-randomized into Booster treatment or Enhanced Usual Care and then assessed at four later timepoints (i.e., post-booster, and 6-, 12- and 24-month booster follow-up). Booster treatment was directed towards addressing individualized problems and some unique developmental issues of adolescence based on the same original protocol content and treatment setting, whereas the Enhanced Usual Care condition involved providing clinical recommendations based on the assessment and an outside referral for services. HLM analyses identified no significant group differences and few time effects across child, parent, and teacher reports on a broad range of child functioning and impairment outcomes. Analyses examining the role of putative moderators or predictors (e.g., severity of externalizing behavior, dose of treatment) were likewise non-significant. We discuss the nature and implications of these novel findings regarding the role and timing of booster treatment to address the continuity of DBD over time.

Bidirectional relations between parenting practices and child externalizing behavior: a cross-lagged panel analysis in the context of a psychosocial treatment and 3-year follow-up

In the current study, we examined longitudinal changes in, and bidirectional effects between, parenting practices and child behavior problems in the context of a psychosocial treatment and 3-year follow-up period. The sample comprised 139 parent-child dyads (child ages 6-11) who participated in a modular treatment protocol for early-onset ODD or CD. Parenting practices and child behavior problems were assessed at six time-points using multiple measures and multiple reporters. The data were analyzed using cross-lagged panel analyses. Results indicated robust temporal stabilities of parenting practices and child behavior problems, in the context of treatment-related improvements, but bidirectional effects between parenting practices and child behavior were less frequently detected. Our findings suggest that bidirectional effects are relatively smaller than the temporal stability of each construct for school-age children with ODD/CD and their parents, following a multi-modal clinical intervention that is directed at both parents and children. Implications for treatment and intervention are discussed.

Quantifying diagnostic uncertainty using item response theory: the Posterior Probability of Diagnosis Index

Using traditional Diagnostic and Statistical Manual of Mental Disorders, fourth edition, text revision (American Psychiatric Association, 2000) diagnostic criteria, clinicians are forced to make categorical decisions (diagnosis vs. no diagnosis). This forced choice implies that mental and behavioral health disorders are categorical and does not fully characterize varying degrees of uncertainty associated with a particular diagnosis. Using an item response theory (latent trait model) framework, we describe the development of the Posterior Probability of Diagnosis (PPOD) Index, which answers the question: What is the likelihood that a patient meets or exceeds the latent trait threshold for a diagnosis? The PPOD Index is based on the posterior distribution of θ (latent trait score) for each patient's profile of symptoms. The PPOD Index allows clinicians to quantify and communicate the degree of uncertainty associated with each diagnosis in probabilistic terms. We illustrate the advantages of the PPOD Index in a clinical sample (N = 321) of children and adolescents with oppositional defiant disorder.

Predicting psychotherapy benefit: a probabilistic and individualized approach

We describe the development of the probability of treatment benefit (PTB) chart that incorporates, integrates, and extends more recent approaches to describing treatment effects, such as the Reliable Change Index (Jacobson & Truax, 1991) and normative comparisons (Kendall, Marrs-Garcia, Nath, & Sheldrick, 1999), by including parameters that are simultaneously probabilistic and individualized. To illustrate the PTB chart, data are taken from an effectiveness trial (N=139) of a modular treatment for disruptive behavior disorders. The results highlight both individual variability and the probabilistic nature of psychotherapy benefit. Finally, we discuss the utility of the PTB chart in terms of research, policy, and practice implications. Probability tables, such as the PTB chart, have the potential to be used as simple clinical tools to supplement traditional effect sizes and help patients make truly informed decisions about treatment participation.

Enhancing attachment organization among maltreated children: results of a randomized clinical trial

Young children who have experienced early adversity are at risk for developing disorganized attachments. The efficacy of Attachment and Biobehavioral Catch-up (ABC), an intervention targeting nurturing care among parents identified as being at risk for neglecting their young children, was evaluated through a randomized clinical trial. Attachment quality was assessed in the Strange Situation for 120 children between 11.7 and 31.9 months of age (M = 19.1, SD = 5.5). Children in the ABC intervention showed significantly lower rates of disorganized attachment (32%) and higher rates of secure attachment (52%) relative to the control intervention (57% and 33%, respectively). These results support the efficacy of the ABC intervention in enhancing attachment quality among parents at high risk for maltreatment.

Maternal sensitivity: within-person variability and the utility of multiple assessments

In this study, we examined within-person variability in maternal sensitivity among a culturally diverse sample of high-risk mother-infant dyads (N = 25). We also examined incremental increases in effect sizes between maternal sensitivity and two related variables, attachment state of mind and child removal from the home, as a function of increasing observations of maternal sensitivity. The dyads were videotaped during 10 1-hour-long home visits and maternal sensitivity was coded using the abbreviated (25-item) version of the Maternal Behavior Q-Sort (MBQS). Attachment state of mind was assessed using the Adult Attachment Interview (AAI). Within-person variability in maternal sensitivity was greater for nonautonomous mothers compared to autonomous mothers. Mothers who were relatively low in maternal sensitivity were more likely to be nonautonomous and also more likely to have their child removed from their home by child protective services. Results from data sampling trials showed incremental increases in these effect sizes as the number of observations of maternal sensitivity increased. Fewer observations of maternal sensitivity resulted in systematic underestimates of effect sizes between maternal sensitivity and related variables. We discuss the implications for maltreatment researchers and interventionists.

Trajectories of symptom reduction and engagement during treatment for childhood behavior disorders: differences across settings

In this study, we examined trajectories of symptom reduction and family engagement during the modular treatment phase of a clinical trial for early-onset disruptive behavior disorders that was applied either in community settings or a clinic. Participants (N=139) were 6-11 year-old children with diagnoses of Oppositional Defiant Disorder (ODD) or Conduct Disorder (CD). Symptoms of ODD/CD and level of engagement were assessed at every session during the course of treatment. Overall, symptom reduction was characterized by a gradual decline in symptoms over the first 11 sessions followed by a flatter slope beginning with session 12. Clinic participants evidenced a greater decline in symptoms after session 11 compared to participants in community settings. Overall, engagement remained stable during the course of treatment. However, clinic participants had higher levels of engagement throughout treatment compared to participants in the community settings. These setting differences in level of engagement did not account for the differences in trajectories of symptom reduction across the treatment settings.

Effects of a Foster Parent Training Program on Young Children's Attachment Behaviors: Preliminary Evidence from a Randomized Clinical Trial

Young children who enter foster care experience disruptions in care and maltreatment at a point when maintaining attachment relationships is a key, biologically based task. In previous research, we have found that young children experience challenges as they form attachments with new caregivers. They tend to push their new caregivers away, even though such children are especially in need of nurturing care. Further, many caregivers do not respond in nurturing ways when their children are distressed, which we have found is problematic for young children in foster care. We developed an intervention that is designed to help caregivers provide nurturance even when children do not elicit it, and even when it does not come naturally to them. This paper presents preliminary findings of the effectiveness of this intervention on children's attachment behaviors. Forty-six children were randomly assigned to either the experimental intervention or to an educational intervention. For three consecutive days, attachment behaviors were reported across three distress-eliciting situations. Children whose parents had received the experimental intervention showed significantly less avoidance than children whose parents had received the educational intervention. These preliminary results suggest that the intervention is successful in helping children develop trusting relationships with new caregivers.

Caregiver commitment to foster children: the role of child behavior

OBJECTIVE

This study aimed to examine the association between child behavior problems and caregiver commitment to their child in a group of young foster children.

METHOD

The sample consisted of 102 caregiver-child dyads from the greater Baltimore area. Child behavior was assessed using the Child Behavior Checklist [CBCL; Achenbach, T. M. (1991). Manual for the Child Behavior Checklist/4-8 and 1991 profile. Burlington, VT: University of Vermont, Department of Psychiatry; Achenbach, T. M. (1992). Manual for the Child Behavior Checklist/2-3 and 1992 profile. Burlington, VT: University of Vermont, Department of Psychiatry], and caregiver commitment was assessed using a semi-structured interview known as the "This is My Baby" Interview [Bates, B., & Dozier, M. (1998). "This Is My Baby"coding manual. Unpublished manuscript, University of Delaware, Newark]. For a sub-sample of the dyads (N=76), we examined caregiver commitment and parent-reported child behavior at two time points in order to examine the stability of a caregiver's commitment over time and to examine the direction of the association between the two variables.

RESULTS

Overall, caregiver reported child behavior was significantly associated with caregiver commitment. Both caregiver reported child behavior and caregiver commitment were highly stable over an 11-month period. When we examined the data over time, the effect of caregiver reported child behavior at time 1 on caregiver commitment at time 2 was not significantly larger than the effect of caregiver commitment at time 1 on caregiver reported child behavior at time 2. As a result, we were not able to determine the direction of the association between caregiver reported child behavior and caregiver commitment.

CONCLUSIONS

Our results indicate that caregiver reported child behavior is significantly associated with caregiver commitment to their foster children, even after controlling for factors including age of entry into foster care and time in placement.

This is my child: differences among foster parents in commitment to their young children

In this study, the authors examined variables associated with foster mothers' level of commitment to their young foster children, who ranged in age from 5 months to 5 years. Commitment was assessed using a semistructured interview known as the "This Is My Baby" interview (TIMB; Bates & Dozier, 1998). Among 84 foster parent-child dyads, foster mothers who had fostered more children previously showed lower levels of commitment than did foster mothers who had fostered fewer children. Commitment also was associated with child age at placement, with foster parents showing higher levels of commitment to children who were placed at younger ages than to children who were placed at older ages. Commitment predicted the stability of the relationship, with higher levels of commitment associated with a greater likelihood of adoption or long-term placement. These results suggest the importance of designing a child welfare system that will enhance caregivers' ability to commit to the children for whom they provide care.