Empirically defined symptom scales using the DISC 2.3

DISC Predictive Scales (DPS): Factor structure and uniform differential item functioning across gender and three racial/ethnic groups for ADHD, conduct disorder, and oppositional defiant disorder symptoms

The factor structure and potential uniform differential item functioning (DIF) among gender and three racial/ethnic groups of adolescents (African American, Latino, White) were evaluated for attention deficit/hyperactivity disorder (ADHD), conduct disorder (CD), and oppositional defiant disorder (ODD) symptom scores of the DISC Predictive Scales (DPS; Leung et al., 2005; Lucas et al., 2001). Primary caregivers reported on DSM-IV ADHD, CD, and ODD symptoms for a probability sample of 4,491 children from three geographical regions who took part in the Healthy Passages study (mean age = 12.60 years, SD = 0.66). Confirmatory factor analysis indicated that the expected 3-factor structure was tenable for the data. Multiple indicators multiple causes (MIMIC) modeling revealed uniform DIF for three ADHD and 9 ODD item scores, but not for any of the CD item scores. Uniform DIF was observed predominantly as a function of child race/ethnicity, but minimally as a function of child gender. On the positive side, uniform DIF had little impact on latent mean differences of ADHD, CD, and ODD symptomatology among gender and racial/ethnic groups. Implications of the findings for researchers and practitioners are discussed.

Does cognitive behavioral therapy for youth anxiety outperform usual care in community clinics? An initial effectiveness test

OBJECTIVE

Most tests of cognitive behavioral therapy (CBT) for youth anxiety disorders have shown beneficial effects, but these have been efficacy trials with recruited youths treated by researcher-employed therapists. One previous (nonrandomized) trial in community clinics found that CBT did not outperform usual care (UC). The present study used a more stringent effectiveness design to test CBT versus UC in youths referred to community clinics, with all treatment provided by therapists employed in the clinics.

METHOD

A randomized controlled trial methodology was used. Therapists were randomized to training and supervision in the Coping Cat CBT program or UC. Forty-eight youths (56% girls, 8 to 15 years of age, 38% Caucasian, 33% Latino, 15% African-American) diagnosed with DSM-IV anxiety disorders were randomized to CBT or UC.

RESULTS

At the end of treatment more than half the youths no longer met criteria for their primary anxiety disorder, but the groups did not differ significantly on symptom (e.g., parent report, eta-square = 0.0001; child report, eta-square = 0.09; both differences favoring UC) or diagnostic (CBT, 66.7% without primary diagnosis; UC, 73.7%; odds ratio 0.71) outcomes. No differences were found with regard to outcomes of comorbid conditions, treatment duration, or costs. However, youths receiving CBT used fewer additional services than UC youths (χ(2)(1) = 8.82, p = .006).

CONCLUSIONS

CBT did not produce better clinical outcomes than usual community clinic care. This initial test involved a relatively modest sample size; more research is needed to clarify whether there are conditions under which CBT can produce better clinical outcomes than usual clinical care. CLINICAL TRIAL REGISTRY INFORMATION: Community Clinic Test of Youth Anxiety and Depression Study, URL: http://clinicaltrials.gov, unique identifier: NCT01005836.

A Study of the Predictive Validity of the Children’s Depression Inventory for Major Depression Disorder in Puerto Rican Adolescents

This study aims to evaluate the predictive validity of the Children’s Depression Inventory items for major depression disorder (MDD) in an outpatient clinic sample of Puerto Rican adolescents. The sample consisted of 130 adolescents, 13 to 18 years old. The five most frequent symptoms of the Children’s Depression Inventory that best predict the presence of MDD were “I worry about others’ aches and pains,” “I don’t have any friends,” “I have to push myself to do my schoolwork,” “I have trouble sleeping every night,” and “I do very badly in subjects I used to be good in.” Results demonstrated that the symptoms that best predict MDD in Puerto Rican adolescents are not necessarily the ones commonly described as characteristic of the disorder.

Cognitive-behavioral therapy versus usual clinical care for youth depression: an initial test of transportability to community clinics and clinicians

Community clinic therapists were randomized to (a) brief training and supervision in cognitive-behavioral therapy (CBT) for youth depression or (b) usual care (UC). The therapists treated 57 youths (56% girls), ages 8-15, of whom 33% were Caucasian, 26% were African American, and 26% were Latino/Latina. Most youths were from low-income families and all had Diagnostic and Statistical Manual of Mental Disorders (4th ed.; American Psychiatric Association, 1994) depressive disorders (plus multiple comorbidities). All youths were randomized to CBT or UC and treated until normal termination. Session coding showed more use of CBT by CBT therapists and more psychodynamic and family approaches by UC therapists. At posttreatment, depression symptom measures were at subclinical levels, and 75% of youths had no remaining depressive disorder, but CBT and UC groups did not differ on these outcomes. However, compared with UC, CBT was (a) briefer (24 vs. 39 weeks), (b) superior in parent-rated therapeutic alliance, (c) less likely to require additional services (including all psychotropics combined and depression medication in particular), and (d) less costly. The findings showed advantages for CBT in parent engagement, reduced use of medication and other services, overall cost, and possibly speed of improvement--a hypothesis that warrants testing in future research.

The Therapy Process Observational Coding System-Alliance Scale: Measure Characteristics and Prediction of Outcome in Usual Clinical Practice

The authors describe psychometric characteristics of the new Therapy Process Observational Coding System-Alliance scale (TPOCS-A; B. D. McLeod, 2001) and illustrate its use in the study of treatment as usual. The TPOCS-A uses session observation to assess child-therapist and parent-therapist alliance. Both child and parent forms showed acceptable interrater reliability and internal consistency; when applied to cases treated for internalizing disorders, both forms were associated with youth outcomes. Child-therapist alliance during treatment predicted reduced anxiety symptoms at the end of treatment. Parent-therapist alliance during treatment predicted reduced internalizing, anxiety, and depression symptoms at the end of treatment. The findings held up well after confounding variables were controlled, which suggests that both child-therapist and parent-therapist alliance play key (and potentially different) roles in the outcome of treatment as usual.

The DISC Predictive Scales (DPS): efficiently screening for diagnoses

OBJECTIVE

To derive and test a series of brief diagnosis-specific scales to identify subjects who are at high probability of meeting diagnostic criteria and those who may safely be spared more extensive diagnostic inquiry.

METHOD

Secondary data analysis of a large epidemiological data set (n = 1,286) produced a series of gate and contingent items for each diagnosis. Findings were replicated in a second retrospective analysis from a residential care sample (n = 884). The DISC Predictive Scales (DPS) were then used prospectively as a self-report questionnaire in two studies, in which parents (n = 128) and/or adolescents (n = 208) had subsequent diagnostic interviewing with the Diagnostic Interview Schedule for Children or the Schedule for Affective Disorders and Schizophrenia for School-Age Children.

RESULTS

All analyses showed that gate item selection was valid and that any missed cases were due solely to inconsistent reports on the same questions. Screening performance of the full scales was shown to be good, and substantial reductions in scale length were not associated with significant changes in discriminatory power.

CONCLUSIONS

The DPS can accurately determine subjects who can safely be spared further diagnostic inquiry in any diagnostic area. This has the potential to speed up structured diagnostic interviewing considerably. The full DPS can be used to screen accurately for cases of specific DSM-III-R disorders.

The 18-month impact of an emergency room intervention for adolescent female suicide attempters

Following a suicide attempt by female adolescents, the impact of a specialized emergency room (ER) care intervention was evaluated over the subsequent 18 months. Using a quasi-experimental design, this study assigned 140 female adolescent suicide attempters (SA), ages 12-18 years, and their mothers (88% Hispanic) to receive during their ER visit either: (a) specialized ER care aimed at enhancing adherence to outpatient therapy by providing a soap opera video regarding suicidality, a family therapy session, and staff training; or (b) standard ER care. The adjustment of the SA and their mothers was evaluated over 18 months (follow-up, 92%) using linear mixed model regression analyses. SA's adjustment improved over time on most mental health indices. Rates of suicide reattempts (12.4%) and suicidal reideation (29.8%) were lower than anticipated and similar across ER conditions. The specialized ER care condition was associated with significantly lower depression scores by the SA and lower maternal ratings on family cohesion. Significant interactions of intervention condition with the SA's initial level of psychiatric symptomatology indicated that the intervention's impact was greatest on maternal emotional distress and family cohesion among SA who were highly symptomatic. SA's attendance at therapy sessions following the ER visit was significantly associated with only one outcome--family adaptability. Specialized ER interventions may have substantial and sustained impact over time, particularly for the parents of youth with high psychiatric symptomatology.

Parent and child contributions to diagnosis of mental disorder: are both informants always necessary?

OBJECTIVE

To examine the unique cases contributed by parent and child informants to diagnostic classification, with the goal of identifying those diagnoses for which either or both informants are needed.

METHOD

The authors examined survey data from the Methods for the Epidemiology of Child and Adolescent Mental Disorders (MECA) Study, a 4-community epidemiology survey of 9- to 17-year-old children and their parents. Parent-child dyads (1,285 pairs) were independently interviewed by lay persons with the Diagnostic Interview Schedule for Children; a subset of these pairs (n = 247) were also interviewed by clinicians. Agreement between parents and children was examined with respect to levels of impairment, need for/use of services, and clinicians' diagnoses.

RESULTS

Parents and children rarely agreed on the presence of diagnostic conditions, regardless of diagnostic type. Nonetheless, most child-only- and parent-only-identified diagnoses were similarly related to impairment and clinical validation, with 2 exceptions: child-only-identified attention-deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD).

CONCLUSIONS

Overall findings suggest that most "discrepant" diagnoses (those reported by one but not the other informant) reflect meaningful clinical conditions. In some instances, however, diagnoses reported by one but not the other informant should be treated with caution, as they may not reflect the full diagnostic condition (e.g., possibly child-only-identified ADHD or ODD). Further research is needed to determine the salience of child-only- or parent-only-reported cases.

A review of methods and instruments for assessing externalizing disorders: theoretical and practical considerations in rendering a diagnosis

This review addresses the most current and widely used methods of assessing childhood and adolescent externalizing disorders. Interviews, rating scales, and self-report instruments are described, and their strengths and weaknesses are discussed. Direct observational techniques in naturalistic and analogue settings are also reviewed. Throughout the article, commentary is offered regarding the psychometric adequacy and clinical validity of these instruments. It is suggested that, although the instruments presently used to assist in diagnosing externalizing disorders generally possess adequate reliability and representational validity, evidence of elaborative validity is lacking. Clinicians and researchers are encouraged to adopt a broader conceptualization of the diagnostic process, to question existing standards for establishing validity, and to consider alternative means of demonstrating diagnostic utility.

Norms for parental ratings on Conners' Abbreviated Parent-Teacher Questionnaire: implications for the design of behavioral rating inventories and analyses of data derived from them

Despite the wide usage of Conners' 10-item Abbreviated Parent-Teacher Questionnaire (APTQ), normative data for parental ratings on the APTQ are rare. Moreover, its psychometric properties as a "stand alone" behavioral rating instrument have yet to be examined in detail. Using data from parental ratings for 6,841 children aged 5 to 14 years, this paper reports the psychometric properties of the APTQ and provides normative and prevalence estimates for four age cohorts (5 to 6, 7 to 8, 9 to 11, and 12 to 14 years) by gender. In presenting the findings, the paper highlights key methodological issues endemic to the design of behavioral rating inventories like the APTQ and the analysis of data derived from them. These issues are illustrated and discussed in terms of their implications for the measurement and determination of prevalence estimates of problem behaviors in child psychology and child psychiatry. The need to revise the design, content, and response formats of child behavior rating inventories is stressed.

Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators

Using a multimethod multistage screening procedure, the authors interviewed 201 parents and their children with the Diagnostic Interview Schedule for Children (DISC 2.1). In addition, parents completed the Child Behavior Checklist (CBCL) and other survey measures, while their children completed self-report scales. Receiver operating characteristic (ROC) analyses were done to determine optimal cutpoints on the CBCL, referenced to DISC diagnostic "caseness." DISC diagnoses, DISC "stem" symptoms, CBCL scores, and CBCL ROC-outpoints were compared against "external validators," in order to determine the comparative advantages of each approach for assessing child psychopathology. Overall findings suggest that the controversies about "best" assessment strategies may be artificial: When both assessment approaches are compared using similar methods, they are reasonably comparable. However, highly specific diagnostic categories may show fewer relationships with external validators and may therefore need more systematic validational studies.