1
|
Pham G, Choi-Tucci A, Do N, Ebert KD. Optimizing a Vietnamese Sentence Repetition Task Using Item Response Theory. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2025; 34:1176-1192. [PMID: 40106451 DOI: 10.1044/2024_ajslp-24-00381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/22/2025]
Abstract
PURPOSE Sentence repetition can contribute to the identification of developmental language disorder (DLD). However, few studies have attempted to optimize the task for clinical practice. This study uses the item response theory (IRT) to optimize a Vietnamese sentence repetition task for screening and full-assessment purposes and evaluate the diagnostic utility of the new item sets. METHOD We expanded the original task from 28 to 40 items to maximize the chances of having robust final item sets. The 40 items were administered to 196 children in Vietnam, ages 4-6 years. Participants met criteria for DLD (n = 28) or typical development (n = 122), while a subset did not meet criteria for either classification (i.e., Risk, n = 46). Using IRT, we compared different scoring systems and selected item sets with robust parameters and adequate fit to serve two clinical purposes, assessment and screening. We calculated diagnostic accuracy of these item sets using discriminant function analysis and compared results to raw score cut-points. RESULTS The optimal item set for full assessment included 28 items (15 original items) and showed strong diagnostic accuracy, as did a 14-item subset (seven original items) designed for screening. The item set for full assessment also provided a quick characterization of children's grammatical performance. The strongest diagnostic values were derived from discriminant function analysis. CONCLUSIONS This study optimized two sentence repetition tasks for monolingual Vietnamese children for use in a full assessment or screening. Implications are discussed on how to utilize tasks in clinical practice. Future studies need to evaluate sentence repetition in older children and bilingual populations. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.28570475.
Collapse
Affiliation(s)
- Giang Pham
- School of Speech, Language, and Hearing Sciences, San Diego State University, CA
| | | | - Ngoc Do
- School of Speech, Language, and Hearing Sciences, San Diego State University, CA
- Joint Doctoral Program in Language and Communicative Disorders, University of California, San Diego
| | - Kerry Danahy Ebert
- Department of Speech-Language-Hearing Sciences, University of Minnesota, Minneapolis
| |
Collapse
|
2
|
Hu Y, Ngai CSB, Chen S. Automated Approaches to Screening Developmental Language Disorder: A Comprehensive Review and Future Prospects. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2025:1-21. [PMID: 40228046 DOI: 10.1044/2025_jslhr-24-00488] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/16/2025]
Abstract
PURPOSE This study examines existing automatic screening methods for developmental language disorder (DLD), a neurodevelopmental language deficit without known biomedical etiologies, focusing on languages, data sets, extracted features, performance metrics, and classification methods. Additionally, it summarizes the strengths and weaknesses of current systems and explores future research opportunities and challenges. METHOD We conducted a systematic review, searching PubMed, Web of Science, Scopus, and PsycINFO for articles published in English before March 2024. We included studies that developed automated screening systems to classify DLD cases among children. RESULTS A total of 23 studies were thoroughly reviewed. We found that automatic screening models for DLD focused on five languages, namely, Czech, Italian, Mandarin, Spanish, and English, with various data sets employed. Most studies identified and used acoustic, textural, and combination of speech features and nonspeech features for model development. Traditional machine learning, artificial neural networks, convolutional neural networks, long short-term memory, and non-machine-learning classification methods were employed in model training. The need for larger, multilingual data sets and improved system sensitivity is noted. Future research opportunities include exploring the integration of combined features and algorithms; implementing new algorithms; and considering variations in age, gender, severity, and comorbidity differences in DLD. CONCLUSION This systematic review of existing automatic screening methods for DLD highlights significant advancements and suggests potential areas in future research on automatic DLD screening.
Collapse
Affiliation(s)
- Yangna Hu
- The Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hung Hom, Kowloon
| | - Cindy Sing Bik Ngai
- The Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hung Hom, Kowloon
| | - Sihui Chen
- The Department of Chinese and Bilingual Studies, The Hong Kong Polytechnic University, Hung Hom, Kowloon
| |
Collapse
|
3
|
Bao X, Komesidou R, Hogan TP. A Review of Screeners to Identify Risk of Developmental Language Disorder. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2024; 33:1548-1571. [PMID: 38324341 DOI: 10.1044/2023_ajslp-23-00286] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/08/2024]
Abstract
PURPOSE This review aims to comprehensively summarize, compare, and evaluate screeners used to identify risk for developmental language disorder (DLD), a common learning disability that is underidentified. Screening for DLD is a cost-effective way to identify children in need of further assessment and, in turn, provides much needed supports. METHOD We identified 15 commercially available English language DLD screeners in North America. We then characterized each screener on 27 aspects in three domains, including (a) accessibility information (acronym, subtest, website, cost, materials included, publish year, examiner qualification, age range, administration time, and administration format), (b) usability features (dialect compatibility, progress monitoring function, actionable follow-up instruction, group assessment capability, and online administration availability), and (c) technical standards (the availability of a technical manual, conceptual definition, the sample size used in classification accuracy calculation, sample distribution, year of sample collection, outcome measure, sample base rate, cutoff score, sensitivity, specificity, positive predictive value, and negative predictive value). RESULTS We obtained sufficient accessibility information from 14 out of 15 (93%) screeners. In contrast, none of the screeners (0%) included comprehensive usability features. Ten screeners (67%) included a range of classification accuracy (70%-100% sensitivity and 68%-90% specificity). We provided areas of strength and weakness for each screener as a quick reference for users and generated screener recommendations for five practical scenarios. CONCLUSIONS Our findings presented some DLD screeners that meet most standards and highlight numerous areas for improvement, including improving classification accuracy and clarifying follow-up instructions for children who are identified with DLD risk. Screening for DLD is critical to provide timely early identification, intervention, and classroom support, which in turn facilitates student outcomes.
Collapse
Affiliation(s)
- Xue Bao
- School of Health and Rehabilitation Sciences, MGH Institute of Health Professions, Boston, MA
| | - Rouzana Komesidou
- School of Health and Rehabilitation Sciences, MGH Institute of Health Professions, Boston, MA
| | - Tiffany P Hogan
- School of Health and Rehabilitation Sciences, MGH Institute of Health Professions, Boston, MA
| |
Collapse
|
4
|
Auza B A, Murata C, Peñaloza C. "Early detection of Spanish-speaking children with developmental language disorders: Concurrent validity of a short questionnaire and a screening test". JOURNAL OF COMMUNICATION DISORDERS 2023; 104:106339. [PMID: 37247522 DOI: 10.1016/j.jcomdis.2023.106339] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 04/25/2023] [Accepted: 05/11/2023] [Indexed: 05/31/2023]
Abstract
BACKGROUND . Under-identification of Developmental Language Disorder (DLD) is a significant problem in monolingual Latin American Spanish-speaking children. We evaluated the identification utility of the sequential use of two screening tools, the "Parental Questionnaire (PQ)" and the "Screening for Language Problems (TPL)", to identify children who require confirmatory diagnosis of DLD. METHODS Parents of children (4 to 6 years) were contacted in schools and public health centers in Mexico. Monolingual Spanish-speaking children with no auditory and cognitive disorders were eligible. The reference diagnosis of DLD was established using BESA (Bilingual English-Spanish Assessment) or SCELF-4 (Spanish Clinical Evaluation of Language Fundamentals), combined with data from the narrative samples that yielded the percentage of ungrammaticality and the clinical judgment of two Speech-Language Pathologists (SLPs). Responses to the PQ were obtained as a parental report, and the TPL was applied by a trained SLPs. RESULTS . Both PQ and TPL presented a significant difference between the groups of children with DLD and typical language development (TLD). By combining the two instruments, a notable improvement in diagnostic utility was shown. CONCLUSION . The combination of these two procedures provides an efficient method for screening children having the risk of DLD and contributes to resolving the problem of under-identification.
Collapse
Affiliation(s)
- Alejandra Auza B
- Hospital General "Dr. Manuel Gea González", Calzada de Tlalpan 4800, Col. Sección XVI, C.P. 14080, Tlalpan, Mexico City, Mexico
| | - Chiharu Murata
- Instituto Nacional de Pediatría, Av. Insurgentes Sur 3700, Insurgentes Cuicuilco, C.P. 04530, Alcaldía Coyoacán, Mexico City, CDMX, Mexico.
| | - Christian Peñaloza
- Departamento de Fonoaudiología, Universidad de Chile, Independencia 1027, Independencia, Región Metropolitana, Chile.
| |
Collapse
|
5
|
Christopulos TT, Redmond SM. Positive Predictive Values Associated With Adapting the Redmond Sentence Recall Measure Into a Kindergarten Screener for Developmental Language Disorder. Lang Speech Hear Serv Sch 2023; 54:636-647. [PMID: 36780301 DOI: 10.1044/2022_lshss-22-00048] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/14/2023] Open
Abstract
PURPOSE Researchers estimate the prevalence of developmental language disorder (DLD) in 5-year-olds to be between 7% and 12%. Current identification systems in public schools typically favor referral identification formats over targeted or universal screenings. Public schools face unique challenges when assessing the value of screening measures for DLD that include real-world considerations such as administration, time, and resource constraints. This study used the positive predictive value (PPV) of the Redmond Sentence Recall (RSR) to assess its fidelity when administered by special education paraprofessionals. Our obtained PPV was compared across three areas: (a) previous studies that have utilized the RSR, (b) rates extrapolated from the participating school district's preexisting referral system from a previous study, and (c) expectations based on DLD prevalence. METHOD Language screenings were conducted in two elementary schools using the RSR administered by school-based paraprofessionals trained on the screener protocol. One hundred sixty-four kindergarten students (age range: 5-6 years) were screened. Confirmatory testing was completed on all students who failed the screener. RESULTS Of the 164 students screened, 19 failed the RSR (11.5%), and 14 met criteria (8.5%) for DLD (PPV = .74). Our PPV was similar to previously published studies that utilized the RSR using research assistants and was higher than the PPV associated with teacher-based referrals from the participating school district. CONCLUSION The RSR represents a potentially useful screener for identifying children at risk for previously unidentified language disorders in public schools. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.22044479.
Collapse
Affiliation(s)
- Tyler T Christopulos
- Department of Communication Sciences and Disorders, University of Utah, Salt Lake City
| | - Sean M Redmond
- Department of Communication Sciences and Disorders, University of Utah, Salt Lake City
| |
Collapse
|
6
|
Moland CW, Oetting JB. Comparison of the Diagnostic Evaluation of Language Variation-Screening Test Risk Subtest to Two Other Screeners for Low-Income Prekindergartners Who Speak African American English and Live in the Urban South. AMERICAN JOURNAL OF SPEECH-LANGUAGE PATHOLOGY 2021; 30:2528-2541. [PMID: 34582275 PMCID: PMC9132032 DOI: 10.1044/2021_ajslp-20-00270] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
Purpose We compared the Risk subtest of the Diagnostic Evaluation of Language Variation-Screening Test (DELV-Screening Test Risk) with two other screeners when administered to low-income prekindergartners (pre-K) who spoke African American English (AAE) in the urban South. Method Participants were 73 children (six with a communication disorder and 67 without) enrolled in Head Start or a publicly funded pre-K in an urban Southern city. All children completed the DELV-Screening Test Risk, the Fluharty Preschool Speech and Language Screening Test-Second Edition (FLUHARTY-2), and the Washington and Craig Language Screener (WCLS). Test order was counterbalanced across participants. Results DELV-Screening Test Risk error scores were higher than those reported for its standardization sample, and scores on the other screeners were lower than their respective standardization/testing samples. The 52% fail rate of the DELV-Screening Test Risk did not differ significantly from the 48% rate of the WCLS. Fail rates of the FLUHARTY-2 ranged from 34% to 75%, depending on the quotient considered and whether scoring was modified for dialect. Although items and subtests assumed to measure similar constructs were correlated to each other, the three screeners led to inconsistent pass/fail outcomes for 44% of the children. Conclusions Like other screeners, the DELV-Screening Test Risk subtest may lead to high fail rates for low-income pre-K children who speak AAE in the urban South. Inconsistent outcomes across screeners underscore the critical need for more study and development of screeners within the field.
Collapse
|
7
|
Weiler B, Schuele CM. Tense Marking in the Kindergarten Population: Testing the Bimodal Distribution Hypothesis. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2021; 64:593-612. [PMID: 33529048 PMCID: PMC9150687 DOI: 10.1044/2020_jslhr-20-00335] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 08/21/2020] [Accepted: 11/13/2020] [Indexed: 05/02/2023]
Abstract
Purpose The purpose of this study was to explore whether evidence for a bimodal distribution of tense marking, previously documented in clinically referred samples, exists in a population-based sample of kindergarten children from a rural county in Tennessee. Method A measure of tense marking, the Test of Early Grammatical Impairment (TEGI) Screening Test, was individually administered to consented kindergarten students (N = 153) across three elementary schools in a single school district. The consented children constituted 73% of kindergartners in the district. Cluster analysis was used to evaluate the number and composition of latent classes that best fit the distribution of the TEGI Screening Test scores. Results Analysis of the scores revealed a distribution that deviated significantly from normality. Cluster analyses (Ward's, k-means, single linkage) revealed a two-cluster solution as the best fitting model. The very large effect-size difference in mean TEGI Screening Test score between the two clusters (d = 4.77) provides validation of an identifiable boundary delineating typical from atypical tense marking in this sample of kindergartners. The difference in tense marking across the two clusters was not attributable to child chronological age. The percentage of the sample comprising the low-performing cluster aligns with specific language impairment and developmental language disorder prevalence estimates. Conclusion Additional demonstrations of a bimodal distribution of tense marking in future studies with carefully defined samples could strengthen the clinical marker evidence and utility of this linguistic feature.
Collapse
Affiliation(s)
- Brian Weiler
- Department of Communication Sciences and Disorders, Western Kentucky University, Bowling Green
| | | |
Collapse
|
8
|
Billard C, Thiébaut E, Gassama S, Touzin M, Thalabard JC, Mirassou A, Munnich A. The Computerized Adaptable Test Battery (BMT- i) for Rapid Assessment of Children's Academic Skills and Cognitive Functions: A Validation Study. Front Pediatr 2021; 9:656180. [PMID: 34307248 PMCID: PMC8295558 DOI: 10.3389/fped.2021.656180] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/20/2021] [Accepted: 05/24/2021] [Indexed: 11/19/2022] Open
Abstract
Background: Learning disabilities in children are a major public health concern worldwide, having a prevalence of 8%. They are associated with lost social, educational, and ultimately, professional opportunities for individuals. These disabilities are also very costly to governments and raise the issue of the appropriate means of screening. Unfortunately, validated tools for preliminary appraisal of learning and cognitive function in struggling children are presently restricted to specific age ranges and cognitive domains. This study sought to validate a first-line battery for assessment of academic skills and cognitive functions. Materials and Methods: The computerized Adaptable Test Battery, or BMT-i, includes a panel of tests for the first-line assessment of children's academic skills and cognitive functions. The tests reflect expected abilities for the age group in question, exploring academic skills (written language and mathematical cognition) and cognitive domains (verbal, non-verbal, and attentional/executive functions). The authors relied on the results of these tests for a sample of 1,074 Francophone children representative of the mainland French school-age population (522 boys and 552 girls, ages 4-13, from 39 classes at 7 public and 5 private schools). Thirteen speech-language pathologists and neuropsychologists individually administered the tests. Results: The psychometric characteristics of the empirical data obtained showed acceptable to good test homogeneity, internal consistency (Cronbach's alpha: > 0.70), test-retest reliability (intraclass correlation coefficients: ~0.80), and consistency with reference test batteries (r: 0.44-0.96). Conclusion: The BMT-i was validated in a large sample of children in mainstream French schools, paving the way for its use in first-line screening of learning disabilities among children with complaints, whether their learning difficulties have been flagged by their parents or by their teachers.
Collapse
Affiliation(s)
- Catherine Billard
- Association pour la Recherche sur les Troubles des Apprentissages (ARTA), Paris, France
| | - Eric Thiébaut
- Laboratoire Lorrain de Psychologie et Neurosciences de la Dynamique des Comportements (2LPN), Université de Lorraine (EA 7489), Nancy, France
| | - Sahawanatou Gassama
- Association pour la Recherche sur les Troubles des Apprentissages (ARTA), Paris, France.,Centre Ressources sur les Troubles des Apprentissages Paris Santé Réussite, Paris, France
| | - Monique Touzin
- Association pour la Recherche sur les Troubles des Apprentissages (ARTA), Paris, France.,Centre Ressources sur les Troubles des Apprentissages Paris Santé Réussite, Paris, France
| | | | - Anne Mirassou
- Association pour la Recherche sur les Troubles des Apprentissages (ARTA), Paris, France
| | - Arnold Munnich
- Université de Paris-Sorbonne Paris Cité, Imagine Institute, INSERM UMR1163, Paris, France
| |
Collapse
|
9
|
Nitido H, Plante E. Diagnosis of Developmental Language Disorder in Research Studies. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2020; 63:2777-2788. [PMID: 32692602 DOI: 10.1044/2020_jslhr-20-00091] [Citation(s) in RCA: 27] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Purpose The aim of this study was to investigate the extent to which researchers in the field of developmental language disorder are utilizing validated methods to diagnose their research participants. Method We examined 90 research articles published from 2015 to 2019 that included English-speaking participants from the United States who were identified as having a developmental language disorder or specific language impairment. From these articles, we identified the tests and measures used to identify participants and classify them as healthy or impaired. We then consulted the test manuals and the literature to find information on sensitivity and specificity of the test and the evidence-based cut score that maximized identification accuracy. Results Of the 90 articles examined, 38 (42%) were found to reflect validated diagnostic methods, and 51 (58%) did not. Conclusion Our results illustrate that validated methods are used less than half of the time even by those who should have a high level of expertise and despite calls for increasing scientific rigor in research practices.
Collapse
Affiliation(s)
- Hallie Nitido
- Department of Speech, Language, and Hearing Sciences, The University of Arizona, Tucson
| | - Elena Plante
- Department of Speech, Language, and Hearing Sciences, The University of Arizona, Tucson
| |
Collapse
|