Associations Among Referral Concerns, Screening Results, and Diagnostic Outcomes of Young Children Assessed in a Statewide Early Autism Evaluation Network

Early detection of neurodevelopmental disorders in paediatric primary care: A scoping review

BACKGROUND

Earlier detection of children at risk for neurodevelopmental disorders is critical and has longstanding repercussions if not addressed early enough.

OBJECTIVES

To explore the supporting or facilitating characteristics of paediatric primary care models of care for early detection in infants and toddlers at risk for neurodevelopmental disorders, identify practitioners involved, and describe how they align with occupational therapy's scope of practice.

METHODS

A scoping review following the Joanna Briggs Institute framework was used. PubMed Central, Cumulative Index to Nursing & Allied Health Literature, and Scopus databases were searched. The search was conducted between January and February 2022. Inclusion criteria were: children aged 0-3 years old; neurodevelopmental disorders including cerebral palsy (CP) and autism spectrum disorder (ASD); models of care used in the paediatric primary care setting and addressing concepts of timing and plasticity; peer-reviewed literature written in English; published between 2010 and 2022. Study protocol registered at https://doi.org/10.17605/OSF.IO/MD4K5.

RESULTS

We identified 1,434 publications, yielding 22 studies that met inclusion criteria. Models of care characteristics included the use of technology, education to parents and staff, funding to utilize innovative models of care, assessment variability, organizational management changes, increased visit length, earlier timeline for neurodevelopmental screening, and collaboration with current office staff or nonphysician practitioners. The top 4 providers were paediatricians, general or family practitioners, nurse/nurse practitioners, and office staff. All studies aligned with occupational therapy health promotion scope of practice and intervention approach yet did not include occupational therapy within the paediatric primary care setting.

CONCLUSIONS

No studies included occupational therapy as a healthcare provider that could be used within the paediatric primary care setting. However, all studies demonstrated models of care facilitating characteristics aligning with occupational therapy practice. Models of care facilitating characteristics identified interdisciplinary staff as a major contributor, which can include occupational therapy, to improve early detection within paediatric primary care.

Role of Primary Care Clinician Concern During Screening for Early Identification of Autism

OBJECTIVE

The aim of this study was to evaluate the added value of primary care clinician (PCC)-indicated concern during primary care universal standardized screening in early identification of autism.

METHODS

Toddlers were screened for autism during primary care checkups (n = 7,039, aged 14.24-22.43 months) in 2 studies. Parents completed the Modified Checklist for Autism in Toddlers, Revised, with Follow-Up. For each participant, PCCs indicated whether they had autism concerns (optional in 1 study-before or after viewing screening results, required before viewing screen results in the other). Children at high likelihood for autism from screen result and/or PCC concern (n = 615) were invited for a diagnostic evaluation; 283 children attended the evaluation.

RESULTS

Rates of PCC-indicated autism concerns were similar whether PCCs were required or encouraged to indicate concerns. High likelihood of autism indication on both screen and PCC concern resulted in the highest positive predictive value for autism and positive predictive value for any developmental disorder, as well as the highest evaluation attendance, with no significant difference between the positive screen-only and PCC concern-only groups. Although the frequency of PCC-indicated autism concern did not differ significantly based on the child's cognitive level, PCCs were more likely to identify children with more obvious autism characteristics compared with more subtle autism characteristics as having autism.

CONCLUSION

The findings support the recommendation of the American Academy of Pediatrics that both screening and surveillance for autism be incorporated into well-child visits. High likelihood of autism on either screen or PCC concern should trigger a referral for an evaluation.

Meta-analysis of the Modified Checklist for Autism in Toddlers, Revised/Follow-up for Screening

CONTEXT

The Modified Checklist for Autism in Toddlers, Revised with Follow-up (M-CHAT-R/F) is used worldwide to screen for autism spectrum disorder (ASD).

OBJECTIVE

To calculate psychometric properties of the M-CHAT-R/F for subsequent diagnosis of ASD.

DATA SOURCES

Systematic searches of Medline, Embase, SCOPUS, and Trip Pro databases from January 2014 to November 2021.

STUDY SELECTION

Studies were included if they (1) used the M-CHAT-R/F (2) applied standard scoring protocol, (3) used a diagnostic assessment for ASD, and (4) reported at least 1 psychometric property of the M-CHAT-R/F.

DATA EXTRACTION

Two independent reviewers completed screening, full-text review, data extraction, and quality assessment, following Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines. A random-effects model was used to derive pooled estimates and assess for between-study heterogeneity.

RESULTS

Of 667 studies identified, 15 with 18 distinct samples from 10 countries (49 841 children) were used in the meta-analysis. Pooled positive predictive value (PPV), was 57.7% (95% confidence interval [CI] 48.6-66.8, τ2 = 0.031). PPV was higher among high-risk (75.6% [95% CI 66.0-85.2]) than low-risk samples (51.2% [95% CI 43.0-59.5]). Pooled negative predictive value was 72.5% (95% CI 62.5-82.4 τ2 = 0.031), sensitivity was 82.6% (95% CI 76.2-88.9) and specificity 45.7% (95% CI 25.0-66.4).

LIMITATIONS

Negative predictive value, sensitivity, and specificity were calculated based on small sample sizes because of limited or no evaluation of screen-negative children.

CONCLUSIONS

These results support use of the M-CHAT-R/F as a screening tool for ASD. Caregiver counseling regarding likelihood of an ASD diagnosis after positive screen should acknowledge the moderate PPV.

Sensitivity and Specificity of the Modified Checklist for Autism in Toddlers (Original and Revised): A Systematic Review and Meta-analysis

Importance

The Modified Checklist for Autism in Toddlers (M-CHAT) and the M-CHAT, Revised With Follow-up (M-CHAT-R/F)-henceforth referred to as M-CHAT(-R/F)-are the most commonly used toddler screeners for autism spectrum disorder (ASD). Their use often differs from that in the original validation studies, resulting in a range of estimates of sensitivity and specificity. Also, given the variability in reports of the clinical utility of the M-CHAT(-R/F), researchers and practitioners lack guidance to inform autism screening protocols.

Objective

To synthesize variability in sensitivity and specificity of M-CHAT(-R/F) across multiple factors, including procedures for identifying missed cases, likelihood level, screening age, and single compared with repeated screenings.

Data Sources

A literature search was conducted with PubMed, Web of Science, and Scopus to identify studies published between January 1, 2001, and August 31, 2022.

Study Selection

Articles were included if the studies used the M-CHAT(-R/F) (ie, original or revised version) to identify new ASD cases, were published in English-language peer-reviewed journals, included at least 10 ASD cases, reported procedures for false-negative case identification, screened children by 48 months, and included information (or had information provided by authors when contacted) needed to conduct the meta-analysis.

Data Extraction and Synthesis

The systematic review and meta-analysis was conducted within the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) reporting guideline. The Quality Assessment of Diagnostic Accuracy Studies-2 tool evaluated bias in sample selection. Data extraction and quality assessment were performed by 2 authors independently. The overall diagnostic accuracy of the M-CHAT(-R/F) was assessed with the hierarchic summary receiver operating characteristic (HSROC) model.

Main Outcomes and Measures

Sensitivity, specificity, diagnostic odds ratios, and HSROC curves of M-CHAT(-R/F).

Results

The review included 50 studies with 51 samples. The pooled sensitivity of M-CHAT(-R/F) was 0.83 (95% CI, 0.77-0.88), and the pooled specificity was 0.94 (95% CI, 0.89-0.97). Heterogeneity analyses revealed greater diagnostic accuracy for low- vs high-likelihood samples, a concurrent vs prospective case confirmation strategy, a large vs small sample size, use of M-CHAT(-R/F) Follow-up, and non-English vs English only.

Conclusions and Relevance

Overall, results of this study suggest the utility of the M-CHAT(-R/F) as an ASD screener. The wide variability in psychometric properties of M-CHAT(-R/F) highlights differences in screener use that should be considered in research and practice.