1
|
Nam HK, Lea WWI, Yang Z, Noh E, Rhie YJ, Lee KH, Hong SJ. Clinical validation of a deep-learning-based bone age software in healthy Korean children. Ann Pediatr Endocrinol Metab 2024; 29:102-108. [PMID: 38271993 PMCID: PMC11076234 DOI: 10.6065/apem.2346050.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 04/19/2023] [Accepted: 04/28/2023] [Indexed: 01/27/2024] Open
Abstract
PURPOSE Bone age (BA) is needed to assess developmental status and growth disorders. We evaluated the clinical performance of a deep-learning-based BA software to estimate the chronological age (CA) of healthy Korean children. METHODS This retrospective study included 371 healthy children (217 boys, 154 girls), aged between 4 and 17 years, who visited the Department of Pediatrics for health check-ups between January 2017 and December 2018. A total of 553 left-hand radiographs from 371 healthy Korean children were evaluated using a commercial deep-learning-based BA software (BoneAge, Vuno, Seoul, Korea). The clinical performance of the deep learning (DL) software was determined using the concordance rate and Bland-Altman analysis via comparison with the CA. RESULTS A 2-sample t-test (P<0.001) and Fisher exact test (P=0.011) showed a significant difference between the normal CA and the BA estimated by the DL software. There was good correlation between the 2 variables (r=0.96, P<0.001); however, the root mean square error was 15.4 months. With a 12-month cutoff, the concordance rate was 58.8%. The Bland-Altman plot showed that the DL software tended to underestimate the BA compared with the CA, especially in children under the age of 8.3 years. CONCLUSION The DL-based BA software showed a low concordance rate and a tendency to underestimate the BA in healthy Korean children.
Collapse
Affiliation(s)
- Hyo-Kyoung Nam
- Department of Pediatrics, Korea University College of Medicine, Seoul, Korea
| | - Winnah Wu-In Lea
- Department of Radiology, Korea University College of Medicine, Seoul, Korea
| | - Zepa Yang
- Smart Health Care Center, Korea University Guro Hospital, Seoul, Korea
- Korea University Guro Hospital-Medical Image Data Center (KUGH-MIDC), Seoul, Korea
| | - Eunjin Noh
- Smart Health Care Center, Korea University Guro Hospital, Seoul, Korea
| | - Young-Jun Rhie
- Department of Pediatrics, Korea University College of Medicine, Seoul, Korea
| | - Kee-Hyoung Lee
- Department of Pediatrics, Korea University College of Medicine, Seoul, Korea
| | - Suk-Joo Hong
- Department of Radiology, Korea University College of Medicine, Seoul, Korea
- Korea University Guro Hospital-Medical Image Data Center (KUGH-MIDC), Seoul, Korea
| |
Collapse
|
2
|
Charbonnet B, Sieghartsleitner R, Schmid J, Zuber C, Zibung M, Conzelmann A. Maturity-based correction mechanism for talent identification: When is it needed, does it work, and does it help to better predict who will make it to the pros? J Sports Sci Med 2022; 21:640-657. [PMID: 36523901 PMCID: PMC9741715 DOI: 10.52082/jssm.2022.639] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 11/30/2022] [Indexed: 12/30/2022]
Abstract
When identifying talent, the confounding influence of maturity status on motor performances is an acknowledged problem. To solve this problem, correction mechanisms have been proposed to transform maturity-biased test scores into maturity-unbiased ones. Whether or not such corrections also improve predictive validity remains unclear. To address this question, we calculated correlations between maturity indicators and motor performance variables among a sample of 121 fifteen-year-old elite youth football players in Switzerland. We corrected motor performance scores identified as maturity-biased, and we assessed correction procedure efficacy. Subsequently, we examined whether corrected scores better predicted levels of performance achievement 6 years after data collection (47 professionals vs. 74 non-professional players) compared with raw scores using point biserial correlations, binary logistic regression models, and DeLong tests. Expectedly, maturity indicators correlated with raw scores (0.16 ≤ | r | ≤ 0.72; ps < 0.05), yet not with corrected scores. Contrary to expectations, corrected scores were not associated with an additional predictive benefit (univariate: no significant r-change; multivariate: 0.02 ≤ ΔAUC ≤ 0.03, ps > 0.05). We do not interpret raw and corrected score equivalent predictions as a sign of correction mechanism futility (more work for the same output); rather we view them as an invitation to take corrected scores seriously into account (same output, one fewer problem) and to revise correction-related expectations according to initial predictive validity of motor variables, validity of maturity indicators, initial maturity-bias, and selection systems. Recommending maturity-based corrections is legitimate, yet currently based on theoretical rather than empirical (predictive) arguments.
Collapse
Affiliation(s)
- Bryan Charbonnet
- Institute of Sport Science, University of Bern, Bremgartenstrasse 145, CH-3012 Bern, Switzerland
| | | | | | | | | | | |
Collapse
|
3
|
Charbonnet B, Sieghartsleitner R, Schmid J, Zuber C, Zibung M, Conzelmann A. Maturity-based correction mechanism for talent identification: When is it needed, does it work, and does it help to better predict who will make it to the pros? J Sports Sci Med 2022. [DOI: 10.52082/jssm.2022.640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
When identifying talent, the confounding influence of maturity status on motor performances is an acknowledged problem. To solve this problem, correction mechanisms have been proposed to transform maturity-biased test scores into maturity-unbiased ones. Whether or not such corrections also improve predictive validity remains unclear. To address this question, we calculated correlations between maturity indicators and motor performance variables among a sample of 121 fifteen-year-old elite youth football players in Switzerland. We corrected motor performance scores identified as maturity-biased, and we assessed correction procedure efficacy. Subsequently, we examined whether corrected scores better predicted levels of performance achievement 6 years after data collection (47 professionals vs. 74 non-professional players) compared with raw scores using point biserial correlations, binary logistic regression models, and DeLong tests. Expectedly, maturity indicators correlated with raw scores (0.16 ≤ | r | ≤ 0.72; ps < 0.05), yet not with corrected scores. Contrary to expectations, corrected scores were not associated with an additional predictive benefit (univariate: no significant r-change; multivariate: 0.02 ≤ ΔAUC ≤ 0.03, ps > 0.05). We do not interpret raw and corrected score equivalent predictions as a sign of correction mechanism futility (more work for the same output); rather we view them as an invitation to take corrected scores seriously into account (same output, one fewer problem) and to revise correction-related expectations according to initial predictive validity of motor variables, validity of maturity indicators, initial maturity-bias, and selection systems. Recommending maturity-based corrections is legitimate, yet currently based on theoretical rather than empirical (predictive) arguments.
Collapse
|
4
|
Mehlman CT. Assessing Skeletal Maturity: Searching for the Holy Grail: Commentary on an article by Ryan J. Furdock, MD, et al.: "Systematic Isolation of Key Parameters for Estimating Skeletal Maturity on Anteroposterior Wrist Radiographs". J Bone Joint Surg Am 2022; 104:e25. [PMID: 35293894 DOI: 10.2106/jbjs.21.01521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Affiliation(s)
- Charles T Mehlman
- Professor of Pediatric Orthopaedic Surgery, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, Ohio
| |
Collapse
|
5
|
Magalhães MI, Machado V, Mascarenhas P, Botelho J, Mendes JJ, Delgado AS. OUP accepted manuscript. Eur J Orthod 2022; 44:548-555. [PMID: 35258568 PMCID: PMC9486881 DOI: 10.1093/ejo/cjac009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/02/2022]
Abstract
Background The timing of growth is a key factor for correct orthodontic treatment planning. Cervical vertebrae maturation (CVM) is no exception, although the reported chronological ages vary in the literature. Objective We aimed to estimate the average chronological age for each Baccetti’s CVM staging. Search methods Search on MEDLINE-PubMed, Scopus, LILACS, Google Scholar, Cochrane Central Register of Controlled Trials (CENTRAL) was conducted until July 2021. The review was performed according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Selection criteria Observational or interventional studies reporting chronological age classified through Baccetti’s CVM method were included. Data collection and analysis Methodological quality was assessed, and pooled estimates were carried out through random-effects meta-analysis of single means. The impact of sex and continent were also investigated through subgroup analyses. Results Forty-one studies were included (9867 participants, 4151 men, and 5716 women). The average chronological age was 9.7 years old (95% confidence interval [CI]: 9.4 to 10.1) in CS1, 10.8 years old (95% CI: 10.5 to 11.1) in CS2, 12.0 years old (95% CI: 11.7 to 12.2) in CS3, 13.4 years old (95% CI: 13.2 to 13.6) in CS4, 14.7 years old (95% CI: 14.4 to 15.1) in CS5, and 15.8 years old (95% CI: 15.3 to 16.3) in CS6. A significant difference was found between the sexes in all CVM stages. We also found significant differences across continents. Conclusions For each CVM staging a chronological age range was successfully estimated. Girls presented an earlier skeletal maturation compared to boys. The skeletal maturation differs also according to continents, except for CMV stage 1, pointing to the need for personalized ranges according to each region. Registration Registration number: PROSPERO: CRD42021225422
Collapse
Affiliation(s)
- Maria Inês Magalhães
- Clinical Research Unit (CRU), Centro de Investigação Interdisciplinar Egas Moniz (CiiEM), Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
| | - Vanessa Machado
- Correspondence to: Vanessa Machado, Campus Universitário Quinta da Granja, 2829-511 Caparica. E-mail:
| | - Paulo Mascarenhas
- Evidence-Based Hub, CiiEM, Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
| | - João Botelho
- Clinical Research Unit (CRU), Centro de Investigação Interdisciplinar Egas Moniz (CiiEM), Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
- Evidence-Based Hub, CiiEM, Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
| | - José João Mendes
- Clinical Research Unit (CRU), Centro de Investigação Interdisciplinar Egas Moniz (CiiEM), Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
- Evidence-Based Hub, CiiEM, Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
| | - Ana Sintra Delgado
- Clinical Research Unit (CRU), Centro de Investigação Interdisciplinar Egas Moniz (CiiEM), Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
- Orthodontic Department, Egas Moniz Dental Clinic (EMDC), Egas Moniz—Cooperativa de Ensino Superior, Caparica, Almada, Portugal
| |
Collapse
|
6
|
Hardin AM, Knigge RP, Oh HS, Valiathan M, Duren DL, McNulty KP, Middleton KM, Sherwood RJ. Estimating Craniofacial Growth Cessation: Comparison of Asymptote- and Rate-Based Methods. Cleft Palate Craniofac J 2021; 59:230-238. [PMID: 33998905 DOI: 10.1177/10556656211002675] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022] Open
Abstract
OBJECTIVE To identify differences between asymptote- and rate-based methods for estimating age and size at growth cessation in linear craniofacial measurements. DESIGN This is a retrospective, longitudinal study. Five linear measurements were collected from lateral cephalograms as part of the Craniofacial Growth Consortium Study (CGCS). Four estimates of growth cessation, including 2 asymptote- (GCasym, GCerr) and 2 rate-based (GCabs, GC10%) methods, from double logistic models of craniofacial growth were compared. PARTICIPANTS Cephalometric data from participants in 6 historic longitudinal growth studies were included in the CGCS. At least 1749 individuals (870 females, 879 males), unaffected by craniofacial anomalies, were included in all analyses. Individuals were represented by a median of 11 images between 2.5 and 31.3 years of age. RESULTS GCasym consistently occurred before GCerr and GCabs consistently occurred before GC10% within the rate-based approaches. The ordering of the asymptote-based methods compared to the rate-based methods was not consistent across measurements or between males and females. Across the 5 measurements, age at growth cessation ranged from 13.56 (females, nasion-basion, GCasym) to 24.39 (males, sella-gonion, GCerr). CONCLUSIONS Adolescent growth cessation is an important milestone for treatment planning. Based on our findings, we recommend careful consideration of specific definitions of growth cessation in both clinical and research settings since the most appropriate estimation method may differ according to patients' needs. The different methods presented here provide useful estimates of growth cessation that can be applied to raw data and to a variety of statistical models of craniofacial growth.
Collapse
Affiliation(s)
- Anna M Hardin
- Biology Department, Western Oregon University, Monmouth, OR, USA.,Department of Pathology and Anatomical Sciences, University of Missouri School of Medicine, Columbia, MO, USA
| | - Ryan P Knigge
- Department of Pathology and Anatomical Sciences, University of Missouri School of Medicine, Columbia, MO, USA.,Department of Integrative Biology and Physiology, University of Minnesota School of Medicine, Minneapolis, MN, USA
| | - Hee Soo Oh
- Department of Orthodontics, Arthur A. Dugoni School of Dentistry, University of the Pacific, San Francisco, CA, USA
| | - Manish Valiathan
- Department of Orthodontics, School of Dental Medicine, Case Western Reserve University, Cleveland, OH, USA
| | - Dana L Duren
- Department of Pathology and Anatomical Sciences, University of Missouri School of Medicine, Columbia, MO, USA.,Department of Orthopaedic Surgery, University of Missouri School of Medicine, Columbia, MO, USA
| | - Kieran P McNulty
- Department of Anthropology, University of Minnesota, Minneapolis, MN, USA
| | - Kevin M Middleton
- Department of Pathology and Anatomical Sciences, University of Missouri School of Medicine, Columbia, MO, USA
| | - Richard J Sherwood
- Department of Pathology and Anatomical Sciences, University of Missouri School of Medicine, Columbia, MO, USA.,Department of Orthopaedic Surgery, University of Missouri School of Medicine, Columbia, MO, USA
| |
Collapse
|