1
|
Yılmaz İ, Gonca M. Prediction of Skeletal Age Through Cervical Vertebral Measurements Using Different Machine Learning Regression Methods. Turk J Orthod 2025; 38:36-48. [PMID: 40150851 PMCID: PMC11976326 DOI: 10.4274/turkjorthod.2025.2024.30] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2024] [Accepted: 02/09/2025] [Indexed: 03/29/2025]
Abstract
Objective To compare skeletal ages determined using three different regression methods from measurements made on cervical vertebrae from lateral cephalometric radiographs (LCRs) with the skeletal age determined from hand-wrist radiographs (HWRs). Methods LCRs and HWRs of 794 individuals (329 boys, 465 girls) aged 7-18 years were examined. The hand-wrist skeletal age of the participants was determined using the Greulich-Pyle (GP) atlas. Forty-four linear and nine angular morphometric measurements in the C2-C5 vertebrae were made in LCRs. Vertebral skeletal age (VSA) was determined in both sexes using Ridge, the least absolute shrinkage and selection operator (LASSO), and ElasticNet regression methods. The study results were evaluated using R2 (explainability power). Bland-Altman analysis was performed to determine the consistency of chronologic age (CA), GP age, and VSAs. Results LASSO regression showed the highest explainability power for VSA, with boys at 0.783 and girls at 0.741. In both sexes, the vertebral depth of concavities had high beta coefficients, and the posterior height of C3 vertebrae (TVup-TVlp) had the highest beta coefficient in boys in LASSO regression. The width of the limits of agreement in both CA and VSA graphs of GP age was wider in boys than in girls. The width of the limits of agreement of CA-VSAs was wider in girls than in boys. Conclusion Although high R2 values were obtained, VSA showed no superiority over CA in the assessment of skeletal age, and no significant clinical advantage was observed. For the Turkish population, using GP age may be more accurate for determining skeletal age in orthodontic treatment planning.
Collapse
Affiliation(s)
| | - Merve Gonca
- Eskişehir Osmangazi University Faculty of Dentistry, Department of Orthodontics, Eskişehir, Türkiye
| |
Collapse
|
2
|
Jani G, Patel B. Charting the growth through intelligence: A SWOC analysis on AI-assisted radiologic bone age estimation. Int J Legal Med 2025; 139:679-694. [PMID: 39460772 DOI: 10.1007/s00414-024-03356-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2024] [Accepted: 10/21/2024] [Indexed: 10/28/2024]
Abstract
Bone age estimation (BAE) is based on skeletal maturity and degenerative process of the skeleton. The clinical importance of BAE is in understanding the pediatric and growth-related disorders; whereas medicolegally it is important in determining criminal responsibility and establishing identification. Artificial Intelligence (AI) has been used in the field of the field of medicine and specifically in diagnostics using medical images. AI can greatly benefit the BAE techniques by decreasing the intra observer and inter observer variability as well as by reducing the analytical time. The AI techniques rely on object identification, feature extraction and segregation. Bone age assessment is the classical example where the concepts of AI such as object recognition and segregation can be used effectively. The paper describes various AI based algorithms developed for the purpose of radiologic BAE and the performances of the models. In the current paper we have also carried out qualitative analysis using Strength, Weakness, Opportunities and Challenges (SWOC) to examine critical factors that contribute to the application of AI in BAE. To best of our knowledge, the SWOC analysis is being carried out for the first time to assess the applicability of AI in BAE. Based on the SWOC analysis we have provided strategies for successful implementation of AI in BAE in forensic and medicolegal context.
Collapse
Affiliation(s)
- Gargi Jani
- School of Medico-Legal Studies, National Forensic Sciences University, Sector 9, Gandhinagar, 382007, Gujarat, India
| | - Bhoomika Patel
- School of Medico-Legal Studies, National Forensic Sciences University, Sector 9, Gandhinagar, 382007, Gujarat, India.
| |
Collapse
|
3
|
Pape J, Rosolowski M, Pfäffle R, Beeskow AB, Gräfe D. A critical comparative study of the performance of three AI-assisted programs for bone age determination. Eur Radiol 2025; 35:1190-1196. [PMID: 39499301 PMCID: PMC11835896 DOI: 10.1007/s00330-024-11169-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2024] [Revised: 08/14/2024] [Accepted: 09/30/2024] [Indexed: 11/07/2024]
Abstract
OBJECTIVES To date, AI-supported programs for bone age (BA) determination for medical use in Europe have almost only been validated separately, according to Greulich and Pyle (G&P). Therefore, the current study aimed to compare the performance of three programs, namely BoneXpert, PANDA, and BoneView, on a single Central European population. MATERIALS AND METHODS For this retrospective study, hand radiographs of 306 children aged 1-18 years, stratified by gender and age, were included. A subgroup consisting of the age group accounting for 90% of examinations in clinical practice was formed. The G&P BA was estimated by three human experts-as ground truth-and three AI-supported programs. The mean absolute deviation, the root mean squared error (RMSE), and dropouts by the AI were calculated. RESULTS The correlation between all programs and the ground truth was prominent (R2 ≥ 0.98). In the total group, BoneXpert had a lower RMSE than BoneView and PANDA (0.62 vs. 0.65 and 0.75 years) with a dropout rate of 2.3%, 20.3% and 0%, respectively. In the subgroup, there was less difference in RMSE (0.66 vs. 0.68 and 0.65 years, max. 4% dropouts). The standard deviation between the AI readers was lower than that between the human readers (0.54 vs. 0.62 years, p < 0.01). CONCLUSION All three AI programs predict BA after G&P in the main age range with similar high reliability. Differences arise at the boundaries of childhood. KEY POINTS Question There is a lack of comparative, independent validation for artificial intelligence-based bone age estimation in children. Findings Three commercially available programs estimate bone age after Greulich and Pyle with similarly high reliability in a central European cohort. Clinical relevance The comparative study will help the reader choose a software for bone age estimation approved for the European market depending on the targeted age group and economic considerations.
Collapse
Affiliation(s)
- Johanna Pape
- Department of Pediatric Radiology, University Hospital, 04103, Leipzig, Germany
| | - Maciej Rosolowski
- Institute for Medical Informatics, Statistics and Epidemiology, Leipzig University, 04107, Leipzig, Germany
| | - Roland Pfäffle
- Department of Pediatrics, University Hospital, 04103, Leipzig, Germany
| | - Anne B Beeskow
- Department of Diagnostic and Interventional Radiology, University Hospital, 04103, Leipzig, Germany
| | - Daniel Gräfe
- Department of Pediatric Radiology, University Hospital, 04103, Leipzig, Germany.
| |
Collapse
|
4
|
Jeong J, Kim S, Pan L, Hwang D, Kim D, Choi J, Kwon Y, Yi P, Jeong J, Yoo SJ. Reducing the workload of medical diagnosis through artificial intelligence: A narrative review. Medicine (Baltimore) 2025; 104:e41470. [PMID: 39928829 PMCID: PMC11813001 DOI: 10.1097/md.0000000000041470] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Revised: 01/10/2025] [Accepted: 01/17/2025] [Indexed: 02/12/2025] Open
Abstract
Artificial intelligence (AI) has revolutionized medical diagnostics by enhancing efficiency, improving accuracy, and reducing variability. By alleviating the workload of medical staff, AI addresses challenges such as increasing diagnostic demands, workforce shortages, and reliance on subjective interpretation. This review examines the role of AI in reducing diagnostic workload and enhancing efficiency across medical fields from January 2019 to February 2024, identifying limitations and areas for improvement. A comprehensive PubMed search using the keywords "artificial intelligence" or "AI," "efficiency" or "workload," and "patient" or "clinical" identified 2587 articles, of which 51 were reviewed. These studies analyzed the impact of AI on radiology, pathology, and other specialties, focusing on efficiency, accuracy, and workload reduction. The final 51 articles were categorized into 4 groups based on diagnostic efficiency, where category A included studies with supporting material provided, category B consisted of those with reduced data volume, category C focused on independent AI diagnosis, and category D included studies that reported data reduction without changes in diagnostic time. In radiology and pathology, which require skilled techniques and large-scale data processing, AI improved accuracy and reduced diagnostic time by approximately 90% or more. Radiology, in particular, showed a high proportion of category C studies, as digitized data and standardized protocols facilitated independent AI diagnoses. AI has significant potential to optimize workload management, improve diagnostic efficiency, and enhance accuracy. However, challenges remain in standardizing applications and addressing ethical concerns. Integrating AI into healthcare workforce planning is essential for fostering collaboration between technology and clinicians, ultimately improving patient care.
Collapse
Affiliation(s)
- Jinseo Jeong
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Sohyun Kim
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Lian Pan
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Daye Hwang
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Dongseop Kim
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Jeongwon Choi
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Yeongkyo Kwon
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Pyeongro Yi
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Jisoo Jeong
- College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| | - Seok-Ju Yoo
- Department of Preventive Medicine, College of Medicine, Dongguk University, Gyeongju-si, Republic of Korea
| |
Collapse
|
5
|
Gao C, Hu C, Qian Q, Li Y, Xing X, Gong P, Lin M, Ding Z. Artificial intelligence model system for bone age assessment of preschool children. Pediatr Res 2024; 96:1822-1828. [PMID: 38802611 PMCID: PMC11772234 DOI: 10.1038/s41390-024-03282-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/11/2023] [Revised: 05/04/2024] [Accepted: 05/07/2024] [Indexed: 05/29/2024]
Abstract
BACKGROUD Our study aimed to assess the impact of inter- and intra-observer variations when utilizing an artificial intelligence (AI) system for bone age assessment (BAA) of preschool children. METHODS A retrospective study was conducted involving a total sample of 53 female individuals and 41 male individuals aged 3-6 years in China. Radiographs were assessed by four mid-level radiology reviewers using the TW3 and RUS-CHN methods. Bone age (BA) was analyzed in two separate situations, with/without the assistance of AI. Following a 4-week wash-out period, radiographs were reevaluated in the same manner. Accuracy metrics, the correlation coefficient (ICC)and Bland-Altman plots were employed. RESULTS The accuracy of BAA by the reviewers was significantly improved with AI. The results of RMSE and MAE decreased in both methods (p < 0.001). When comparing inter-observer agreement in both methods and intra-observer reproducibility in two interpretations, the ICC results were improved with AI. The ICC values increased in both two interpretations for both methods and exceeded 0.99 with AI. CONCLUSION In the assessment of BA for preschool children, AI was found to be capable of reducing inter-observer variability and enhancing intra-observer reproducibility, which can be considered an important tool for clinical work by radiologists. IMPACT The RUS-CHN method is a special bone age method devised to be suitable for Chinese children. The preschool stage is a critical phase for children, marked by a high degree of variability that renders BA prediction challenging. The accuracy of BAA by the reviewers can be significantly improved with the aid of an AI model system. This study is the first to assess the impact of inter- and intra-observer variations when utilizing an AI model system for BAA of preschool children using both the TW3 and RUS-CHN methods.
Collapse
Affiliation(s)
- Chengcheng Gao
- Department of Radiology, Hangzhou First People's Hospital, Hangzhou, China
| | - Chunfeng Hu
- Department of Radiology, Hangzhou First People's Hospital, Hangzhou, China
- The Fourth School of Clinical Medicine, Zhejiang Chinese Medicine University, Hangzhou, China
| | - Qi Qian
- Department of Radiology, The Third Affiliated Hospital of Zhejiang Chinese Medicine University, Hangzhou, China
| | - Yangsheng Li
- Department of Radiology, Hangzhou First People's Hospital, Hangzhou, China
| | - Xiaowei Xing
- Rehabilitation Medicine Center, Department of Radiology, Zhejiang Provincial People's Hospital, Affiliated People's Hospital, Hangzhou Medical College, Hangzhou, China
| | | | - Min Lin
- Department of Radiology, The Third Affiliated Hospital of Zhejiang Chinese Medicine University, Hangzhou, China.
- College of Humanities and Management, Zhejiang Chinese Medical University, Hangzhou, China.
| | - Zhongxiang Ding
- Department of Radiology, Hangzhou First People's Hospital, Hangzhou, China.
- Key Laboratory of Clinical Cancer Pharmacology and Toxicology Research of Zhejiang Province, Hangzhou, China.
| |
Collapse
|
6
|
Jeong S, Han K, Kang Y, Kim EK, Song K, Vasanawala S, Shin HJ. The Impact of Artificial Intelligence on Radiologists' Reading Time in Bone Age Radiograph Assessment: A Preliminary Retrospective Observational Study. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01323-3. [PMID: 39528879 DOI: 10.1007/s10278-024-01323-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Revised: 10/24/2024] [Accepted: 10/28/2024] [Indexed: 11/16/2024]
Abstract
To evaluate the real-world impact of artificial intelligence (AI) on radiologists' reading time during bone age (BA) radiograph assessments. Patients (<19 year-old) who underwent left-hand BA radiographs between December 2021 and October 2023 were retrospectively included. A commercial AI software was installed from October 2022. Radiologists' reading times, automatically recorded in the PACS log, were compared between the AI-unaided and AI-aided periods using linear regression tests and factors affecting reading time were identified. A total of 3643 radiographs (M:F=1295:2348, mean age 9.12 ± 2.31 years) were included and read by three radiologists, with 2937 radiographs (80.6%) in the AI-aided period. Overall reading times were significantly shorter in the AI-aided period compared to the AI-unaided period (mean 17.2 ± 12.9 seconds vs. mean 22.3 ± 14.7 seconds, p < 0.001). Staff reading times significantly decreased in the AI-aided period (mean 15.9 ± 11.4 seconds vs. mean 19.9 ± 13.4 seconds, p < 0.001), while resident reading times increased (mean 38.3 ± 16.4 seconds vs. 33.6 ± 15.3 seconds, p = 0.013). The use of AI and years of experience in radiology were significant factors affecting reading time (all, p≤0.001). The degree of decrease in reading time as experience increased was larger when utilizing AI (-1.151 for AI-unaided, -1.866 for AI-aided, difference =-0.715, p<0.001). In terms of AI exposure time, the staff's reading time decreased by 0.62 seconds per month (standard error 0.07, p<0.001) during the AI-aided period. The reading time of radiologists for BA assessment was influenced by AI. The time-saving effect of utilizing AI became more pronounced as the radiologists' experience and AI exposure time increased.
Collapse
Affiliation(s)
- Sejin Jeong
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea
| | - Kyunghwa Han
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Severance Hospital, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Yaeseul Kang
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea
| | - Eun-Kyung Kim
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea
| | - Kyungchul Song
- Department of Pediatrics, Yonsei University College of Medicine, Gangnam Severance Hospital, Seoul, Republic of Korea
| | | | - Hyun Joo Shin
- Department of Radiology, Research Institute of Radiological Science and Center for Clinical Imaging Data Science, Yongin Severance Hospital, Yonsei University College of Medicine, 363, Dongbaekjukjeon-daero, Giheung-gu, 16995, Yongin-si, Gyeonggi-do, Republic of Korea.
| |
Collapse
|
7
|
Alaimo D, Terranova MC, Palizzolo E, De Angelis M, Avella V, Paviglianiti G, Lo Re G, Matranga D, Salerno S. Performance of two different artificial intelligence (AI) methods for assessing carpal bone age compared to the standard Greulich and Pyle method. LA RADIOLOGIA MEDICA 2024; 129:1507-1512. [PMID: 39162939 PMCID: PMC11480116 DOI: 10.1007/s11547-024-01871-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Accepted: 08/01/2024] [Indexed: 08/21/2024]
Abstract
PURPOSE Evaluate the agreement between bone age assessments conducted by two distinct machine learning system and standard Greulich and Pyle method. MATERIALS AND METHODS Carpal radiographs of 225 patients (mean age 8 years and 10 months, SD = 3 years and 1 month) were retrospectively analysed at two separate institutions (October 2018 and May 2022) by both expert radiologists and radiologists in training as well as by two distinct AI software programmes, 16-bit AItm and BoneXpert® in a blinded manner. RESULTS The bone age range estimated by the 16-bit AItm system in our sample varied between 1 year and 1 month and 15 years and 8 months (mean bone age 9 years and 5 months SD = 3 years and 3 months). BoneXpert® estimated bone age ranged between 8 months and 15 years and 7 months (mean bone age 8 years and 11 months SD = 3 years and 3 months). The average bone age estimated by the Greulich and Pyle method was between 11 months and 14 years, 9 months (mean bone age 8 years and 4 months SD = 3 years and 3 months). Radiologists' assessments using the Greulich and Pyle method were significantly correlated (Pearson's r > 0.80, p < 0.001). There was no statistical difference between BoneXpert® and 16-bit AItm (mean difference = - 0.19, 95%CI = (- 0.45; 0.08)), and the agreement between two measurements varies between - 3.45 (95%CI = (- 3.95; - 3.03) and 3.07 (95%CI - 3.03; 3.57). CONCLUSIONS Both AI methods and GP provide correlated results, although the measurements made by AI were closer to each other compared to the GP method.
Collapse
Affiliation(s)
- Davide Alaimo
- Dipartimento di Diagnostica per Immagini Policlinico, Università degli Studi di Palermo, Via del Vespro 127, 90127, Palermo, Italy
| | - Maria Chiara Terranova
- UOC Radiologia Pediatrica Dipartimento di Diagnostica per Immagini e Interventistica, ARNAS, Ospedali Civico, Di Cristina Benfratelli, Palermo, Italy
| | - Ettore Palizzolo
- Dipartimento di Diagnostica per Immagini Policlinico, Università degli Studi di Palermo, Via del Vespro 127, 90127, Palermo, Italy
| | - Manfredi De Angelis
- Dipartimento di Diagnostica per Immagini Policlinico, Università degli Studi di Palermo, Via del Vespro 127, 90127, Palermo, Italy
| | - Vittorio Avella
- Dipartimento di Diagnostica per Immagini Policlinico, Università degli Studi di Palermo, Via del Vespro 127, 90127, Palermo, Italy
| | - Giuseppe Paviglianiti
- UOC Radiologia Pediatrica Dipartimento di Diagnostica per Immagini e Interventistica, ARNAS, Ospedali Civico, Di Cristina Benfratelli, Palermo, Italy
| | - Giuseppe Lo Re
- Dipartimento di Diagnostica per Immagini Policlinico, Università degli Studi di Palermo, Via del Vespro 127, 90127, Palermo, Italy
| | - Domenica Matranga
- Dipartimento Promozione della Salute, Materno-Infantile (PROMISE), Università Di Palermo, Palermo, Italy
| | - Sergio Salerno
- Dipartimento di Diagnostica per Immagini Policlinico, Università degli Studi di Palermo, Via del Vespro 127, 90127, Palermo, Italy.
| |
Collapse
|
8
|
Pape J, Rosolowski M, Zimmermann P, Pfäffle R, Hirsch FW, Gräfe D. Acceleration of skeletal maturation in Central Europe over the last two decades: insights from two cohorts of healthy children. Pediatr Radiol 2024; 54:1686-1691. [PMID: 39030392 PMCID: PMC11377632 DOI: 10.1007/s00247-024-05994-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/10/2024] [Revised: 06/27/2024] [Accepted: 06/28/2024] [Indexed: 07/21/2024]
Abstract
BACKGROUND Deviations between the determination of bone age (BA) according to Greulich and Pyle (G&P) and chronological age (CA) are common in Caucasians. Assessing these discrepancies in a population over time requires analysis of large samples and low intra-observer variability in BA estimation, both can be achieved with artificial intelligence-based software. The latest software-based reference curve contrasting the BA determined by G&P to the CA of Central European children dates back over two decades. OBJECTIVE To examine whether the reference curve from a historical cohort from the Netherlands (Rotterdam cohort) between BA determined by G&P and CA still applies to a current Central European cohort and derive a current reference curve. MATERIALS AND METHODS This retrospective single-center study included 1,653 children and adolescents (aged 3-17 years) who had received a radiograph of the hand following trauma. The G&P BA estimated using artificial intelligence-based software was contrasted with the CA, and the deviations were compared with the Rotterdam cohort. RESULTS Among the participants, the mean absolute error between BA and CA was 0.92 years for girls and 0.97 years for boys. For the ages of 8 years (boys) and 11 years (girls) and upward, the mean deviation was significantly greater in the current cohort than in the Rotterdam cohort. The reference curves of both cohorts also differed significantly from each other (P < 0.001 for both boys and girls). CONCLUSION The BA of the current Central European population and that of the curve from the Rotterdam cohort from over two decades ago differ. Whether this effect can be attributed to accelerated bone maturation needs further evaluation.
Collapse
Affiliation(s)
- Johanna Pape
- Department of Pediatric Radiology, University Hospital Leipzig, Liebigstraße 20 a, 04103, Leipzig, Germany.
| | - Maciej Rosolowski
- Institute for Medical Informatics, Statistics and Epidemiology, Leipzig University, Leipzig, Germany
| | - Peter Zimmermann
- Department of Pediatric Surgery, University Hospital, Leipzig, Germany
| | - Roland Pfäffle
- Department of Pediatrics, University Hospital, Leipzig, Germany
| | - Franz W Hirsch
- Department of Pediatric Radiology, University Hospital Leipzig, Liebigstraße 20 a, 04103, Leipzig, Germany
| | - Daniel Gräfe
- Department of Pediatric Radiology, University Hospital Leipzig, Liebigstraße 20 a, 04103, Leipzig, Germany
| |
Collapse
|
9
|
Bhardwaj V, Kumar I, Aggarwal P, Singh PK, Shukla RC, Verma A. Demystifying the Radiography of Age Estimation in Criminal Jurisprudence: A Pictorial Review. Indian J Radiol Imaging 2024; 34:496-510. [PMID: 38912231 PMCID: PMC11188726 DOI: 10.1055/s-0043-1778651] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/25/2024] Open
Abstract
Skeletal radiographs along with dental examination are frequently used for age estimation in medicolegal cases where documentary evidence pertaining to age is not available. Wrist and hand radiographs are the most common skeletal radiograph considered for age estimation. Other parts imaged are elbow, shoulder, knee, and hip according to suspected age categories. Age estimation by wrist radiographs is usually done by the Tanner-Whitehouse method where the maturity level of each bone is categorized into stages and a final total score is calculated that is then transformed into the bone age. Careful assessment and interpretation at multiple joints are needed to minimize the error and categorize into age-group. In this article, we aimed to summarize a suitable radiographic examination and interpretation for bone age estimation in living children, adolescents, young adults, and adults for medicolegal purposes.
Collapse
Affiliation(s)
- Vritika Bhardwaj
- Department of Radiodiagnosis and Imaging, Institute of Medical Sciences, Banaras Hindu University, Varanasi, Uttar Pradesh, India
| | - Ishan Kumar
- Department of Radiodiagnosis and Imaging, Institute of Medical Sciences, Banaras Hindu University, Varanasi, Uttar Pradesh, India
| | - Priyanka Aggarwal
- Department of Pediatrics, Institute of Medical Sciences, Banaras Hindu University, Varanasi, Uttar Pradesh, India
| | - Pramod Kumar Singh
- Department of Radiodiagnosis and Imaging, Institute of Medical Sciences, Banaras Hindu University, Varanasi, Uttar Pradesh, India
| | - Ram C. Shukla
- Department of Radiodiagnosis and Imaging, Institute of Medical Sciences, Banaras Hindu University, Varanasi, Uttar Pradesh, India
| | - Ashish Verma
- Department of Radiodiagnosis and Imaging, Institute of Medical Sciences, Banaras Hindu University, Varanasi, Uttar Pradesh, India
| |
Collapse
|
10
|
Gräfe D, Beeskow AB, Pfäffle R, Rosolowski M, Chung TS, DiFranco MD. Automated bone age assessment in a German pediatric cohort: agreement between an artificial intelligence software and the manual Greulich and Pyle method. Eur Radiol 2024; 34:4407-4413. [PMID: 38151536 PMCID: PMC11213793 DOI: 10.1007/s00330-023-10543-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Revised: 11/12/2023] [Accepted: 12/08/2023] [Indexed: 12/29/2023]
Abstract
OBJECTIVES This study aimed to evaluate the performance of artificial intelligence (AI) software in bone age (BA) assessment, according to the Greulich and Pyle (G&P) method in a German pediatric cohort. MATERIALS AND METHODS Hand radiographs of 306 pediatric patients aged 1-18 years (153 boys, 153 girls, 18 patients per year of life)-including a subgroup of patients in the age group for which the software is declared (243 patients)-were analyzed retrospectively. Two pediatric radiologists and one endocrinologist made independent blinded BA reads. Subsequently, AI software estimated BA from the same images. Both agreements, accuracy, and interchangeability between AI and expert readers were assessed. RESULTS The mean difference between the average of three expert readers and AI software was 0.39 months with a mean absolute difference (MAD) of 6.8 months (1.73 months for the mean difference and 6.0 months for MAD in the intended use subgroup). Performance in boys was slightly worse than in girls (MAD 6.3 months vs. 5.6 months). Regression analyses showed constant bias (slope of 1.01 with a 95% CI 0.99-1.02). The estimated equivalence index for interchangeability was - 14.3 (95% CI -27.6 to - 1.1). CONCLUSION In terms of BA assessment, the new AI software was interchangeable with expert readers using the G&P method. CLINICAL RELEVANCE STATEMENT The use of AI software enables every physician to provide expert reader quality in bone age assessment. KEY POINTS • A novel artificial intelligence-based software for bone age estimation has not yet been clinically validated. • Artificial intelligence showed a good agreement and high accuracy with expert radiologists performing bone age assessment. • Artificial intelligence showed to be interchangeable with expert readers.
Collapse
Affiliation(s)
- Daniel Gräfe
- Department of Pediatric Radiology, University Hospital, Leipzig, Germany.
| | | | - Roland Pfäffle
- Department of Pediatrics, University Hospital, Leipzig, Germany
| | | | | | | |
Collapse
|
11
|
Pape J, Hirsch FW, Deffaa OJ, DiFranco MD, Rosolowski M, Gräfe D. Applicability and robustness of an artificial intelligence-based assessment for Greulich and Pyle bone age in a German cohort. ROFO-FORTSCHR RONTG 2024; 196:600-606. [PMID: 38065542 DOI: 10.1055/a-2203-2997] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/24/2024]
Abstract
PURPOSE The determination of bone age (BA) based on the hand and wrist, using the 70-year-old Greulich and Pyle (G&P) atlas, remains a widely employed practice in various institutions today. However, a more recent approach utilizing artificial intelligence (AI) enables automated BA estimation based on the G&P atlas. Nevertheless, AI-based methods encounter limitations when dealing with images that deviate from the standard hand and wrist projections. Generally, the extent to which BA, as determined by the G&P atlas, corresponds to the chronological age (CA) of a contemporary German population remains a subject of continued discourse. This study aims to address two main objectives. Firstly, it seeks to investigate whether the G&P atlas, as applied by the AI software, is still relevant for healthy children in Germany today. Secondly, the study aims to assess the performance of the AI software in handling non-strict posterior-anterior (p. a.) projections of the hand and wrist. MATERIALS AND METHODS The AI software retrospectively estimated the BA in children who had undergone radiographs of a single hand using posterior-anterior and oblique planes. The primary purpose was to rule out any osseous injuries. The prediction error of BA in relation to CA was calculated for each plane and between the two planes. RESULTS A total of 1253 patients (aged 3 to 16 years, median age 10.8 years, 55.7 % male) were included in the study. The average error of BA in posterior-anterior projections compared to CA was 3.0 (± 13.7) months for boys and 1.7 (± 13.7) months for girls. Interestingly, the deviation from CA tended to be even slightly lower in oblique projections than in posterior-anterior projections. The mean error in the posterior-anterior projection plane was 2.5 (± 13.7) months, while in the oblique plane it was 1.8 (± 13.9) months (p = 0.01). CONCLUSION The AI software for BA generally corresponds to the age of the contemporary German population under study, although there is a noticeable prediction error, particularly in younger children. Notably, the software demonstrates robust performance in oblique projections. KEY POINTS · Bone age, as determined by artificial intelligence, aligns with the chronological age of the contemporary German cohort under study.. · As determined by artificial intelligence, bone age is remarkably robust, even when utilizing oblique X-ray projections.. CITATION FORMAT · Pape J, Hirsch F, Deffaa O et al. Applicability and robustness of an artificial intelligence-based assessment for Greulich and Pyle bone age in a German cohort. Fortschr Röntgenstr 2024; 196: 600 - 606.
Collapse
Affiliation(s)
- Johanna Pape
- Pediatric Radiology, University Hospital Leipzig, Germany
| | | | | | | | - Maciej Rosolowski
- Institute for Medical Informatics, Statistics and Epidemiology, Leipzig University, Leipzig, Germany
| | - Daniel Gräfe
- Pediatric Radiology, University Hospital Leipzig, Germany
| |
Collapse
|
12
|
Bajjad AA, Gupta S, Agarwal S, Pawar RA, Kothawade MU, Singh G. Use of artificial intelligence in determination of bone age of the healthy individuals: A scoping review. J World Fed Orthod 2024; 13:95-102. [PMID: 37968159 DOI: 10.1016/j.ejwf.2023.10.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Revised: 09/25/2023] [Accepted: 10/10/2023] [Indexed: 11/17/2023]
Abstract
BACKGROUND Bone age assessment, as an indicator of biological age, is widely used in orthodontics and pediatric endocrinology. Owing to significant subject variations in the manual method of assessment, artificial intelligence (AI), machine learning (ML), and deep learning (DL) play a significant role in this aspect. A scoping review was conducted to search the existing literature on the role of AI, ML, and DL in skeletal age or bone age assessment in healthy individuals. METHODS A literature search was conducted in PubMed, Scopus, and Web of Science from January 2012 to December 2022 using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses-Extension for Scoping Reviews (PRISMA-ScR) and Joanna Briggs Institute guidelines. Grey literature was searched using Google Scholar and OpenGrey. Hand-searching of the articles in all the reputed orthodontic journals and the references of the included articles were also searched for relevant articles for the present scoping review. RESULTS Nineteen articles that fulfilled the inclusion criteria were included. Ten studies used skeletal maturity indicators based on hand and wrist radiographs, two studies used magnetic resonance imaging and seven studies used cervical vertebrae maturity indicators based on lateral cephalograms to assess the skeletal age of the individuals. Most of these studies were published in non-orthodontic medical journals. BoneXpert automated software was the most commonly used software, followed by DL models, and ML models in the studies for assessment of bone age. The automated method was found to be as reliable as the manual method for assessment. CONCLUSIONS This scoping review validated the use of AI, ML, or DL in bone age assessment of individuals. A more uniform distribution of sufficient samples in different stages of maturation, use of three-dimensional inputs such as magnetic resonance imaging, and cone beam computed tomography is required for better training of the models to generalize the outputs for use in the target population.
Collapse
Affiliation(s)
- Adeel Ahmed Bajjad
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India
| | - Seema Gupta
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India.
| | - Soumitra Agarwal
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India
| | - Rakesh A Pawar
- Department of Orthodontics, JMF ACPM Dental College, Dhule, India
| | | | - Gul Singh
- Department of Orthodontics, Kothiwal Dental College and Research Centre, Moradabad, India
| |
Collapse
|
13
|
Nam HK, Lea WWI, Yang Z, Noh E, Rhie YJ, Lee KH, Hong SJ. Clinical validation of a deep-learning-based bone age software in healthy Korean children. Ann Pediatr Endocrinol Metab 2024; 29:102-108. [PMID: 38271993 PMCID: PMC11076234 DOI: 10.6065/apem.2346050.025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 04/19/2023] [Accepted: 04/28/2023] [Indexed: 01/27/2024] Open
Abstract
PURPOSE Bone age (BA) is needed to assess developmental status and growth disorders. We evaluated the clinical performance of a deep-learning-based BA software to estimate the chronological age (CA) of healthy Korean children. METHODS This retrospective study included 371 healthy children (217 boys, 154 girls), aged between 4 and 17 years, who visited the Department of Pediatrics for health check-ups between January 2017 and December 2018. A total of 553 left-hand radiographs from 371 healthy Korean children were evaluated using a commercial deep-learning-based BA software (BoneAge, Vuno, Seoul, Korea). The clinical performance of the deep learning (DL) software was determined using the concordance rate and Bland-Altman analysis via comparison with the CA. RESULTS A 2-sample t-test (P<0.001) and Fisher exact test (P=0.011) showed a significant difference between the normal CA and the BA estimated by the DL software. There was good correlation between the 2 variables (r=0.96, P<0.001); however, the root mean square error was 15.4 months. With a 12-month cutoff, the concordance rate was 58.8%. The Bland-Altman plot showed that the DL software tended to underestimate the BA compared with the CA, especially in children under the age of 8.3 years. CONCLUSION The DL-based BA software showed a low concordance rate and a tendency to underestimate the BA in healthy Korean children.
Collapse
Affiliation(s)
- Hyo-Kyoung Nam
- Department of Pediatrics, Korea University College of Medicine, Seoul, Korea
| | - Winnah Wu-In Lea
- Department of Radiology, Korea University College of Medicine, Seoul, Korea
| | - Zepa Yang
- Smart Health Care Center, Korea University Guro Hospital, Seoul, Korea
- Korea University Guro Hospital-Medical Image Data Center (KUGH-MIDC), Seoul, Korea
| | - Eunjin Noh
- Smart Health Care Center, Korea University Guro Hospital, Seoul, Korea
| | - Young-Jun Rhie
- Department of Pediatrics, Korea University College of Medicine, Seoul, Korea
| | - Kee-Hyoung Lee
- Department of Pediatrics, Korea University College of Medicine, Seoul, Korea
| | - Suk-Joo Hong
- Department of Radiology, Korea University College of Medicine, Seoul, Korea
- Korea University Guro Hospital-Medical Image Data Center (KUGH-MIDC), Seoul, Korea
| |
Collapse
|
14
|
Alam MK, Alftaikhah SAA, Issrani R, Ronsivalle V, Lo Giudice A, Cicciù M, Minervini G. Applications of artificial intelligence in the utilisation of imaging modalities in dentistry: A systematic review and meta-analysis of in-vitro studies. Heliyon 2024; 10:e24221. [PMID: 38317889 PMCID: PMC10838702 DOI: 10.1016/j.heliyon.2024.e24221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 01/02/2024] [Accepted: 01/04/2024] [Indexed: 02/07/2024] Open
Abstract
Background In the past, dentistry heavily relied on manual image analysis and diagnostic procedures, which could be time-consuming and prone to human error. The advent of artificial intelligence (AI) has brought transformative potential to the field, promising enhanced accuracy and efficiency in various dental imaging tasks. This systematic review and meta-analysis aimed to comprehensively evaluate the applications of AI in dental imaging modalities, focusing on in-vitro studies. Methods A systematic literature search was conducted, in accordance with the PRISMA guidelines. The following databases were systematically searched: PubMed/MEDLINE, Embase, Web of Science, Scopus, IEEE Xplore, Cochrane Library, CINAHL (Cumulative Index to Nursing and Allied Health Literature), and Google Scholar. The meta-analysis employed fixed-effects models to assess AI accuracy, calculating odds ratios (OR) for true positive rate (TPR), true negative rate (TNR), positive predictive value (PPV), and negative predictive value (NPV) with 95 % confidence intervals (CI). Heterogeneity and overall effect tests were applied to ensure the reliability of the findings. Results 9 studies were selected that encompassed various objectives, such as tooth segmentation and classification, caries detection, maxillofacial bone segmentation, and 3D surface model creation. AI techniques included convolutional neural networks (CNNs), deep learning algorithms, and AI-driven tools. Imaging parameters assessed in these studies were specific to the respective dental tasks. The analysis of combined ORs indicated higher odds of accurate dental image assessments, highlighting the potential for AI to improve TPR, TNR, PPV, and NPV. The studies collectively revealed a statistically significant overall effect in favor of AI in dental imaging applications. Conclusion In summary, this systematic review and meta-analysis underscore the transformative impact of AI on dental imaging. AI has the potential to revolutionize the field by enhancing accuracy, efficiency, and time savings in various dental tasks. While further research in clinical settings is needed to validate these findings and address study limitations, the future implications of integrating AI into dental practice hold great promise for advancing patient care and the field of dentistry.
Collapse
Affiliation(s)
- Mohammad Khursheed Alam
- Preventive Dentistry Department, College of Dentistry, Jouf University, Sakaka, 72345, Saudi Arabia
- Department of Dental Research Cell, Saveetha Institute of Medical and Technical Sciences, Saveetha Dental College and Hospitals, Chennai, 600077, India
- Department of Public Health, Faculty of Allied Health Sciences, Daffodil International University, Dhaka, 1207, Bangladesh
| | | | - Rakhi Issrani
- Preventive Dentistry Department, College of Dentistry, Jouf University, Sakaka, 72345, Saudi Arabia
| | - Vincenzo Ronsivalle
- Department of Biomedical and Surgical and Biomedical Sciences, Catania University, 95123, Catania, Italy
| | - Antonino Lo Giudice
- Department of Biomedical and Surgical and Biomedical Sciences, Catania University, 95123, Catania, Italy
| | - Marco Cicciù
- Department of Biomedical and Surgical and Biomedical Sciences, Catania University, 95123, Catania, Italy
| | - Giuseppe Minervini
- Multidisciplinary Department of Medical-Surgical and Odontostomatological Specialties, University of Campania “Luigi Vanvitelli”, 80121, Naples, Italy
- Saveetha Dental College and Hospitals, Saveetha Institute of Medical and Technical Science (SIMATS), Saveetha University, Chennai, Tamil Nadu, India
| |
Collapse
|
15
|
Suh J, Heo J, Kim SJ, Park S, Jung MK, Choi HS, Choi Y, Oh JS, Lee HI, Lee M, Song K, Kwon A, Chae HW, Kim HS. Bone Age Estimation and Prediction of Final Adult Height Using Deep Learning. Yonsei Med J 2023; 64:679-686. [PMID: 37880849 PMCID: PMC10613764 DOI: 10.3349/ymj.2023.0244] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 08/08/2023] [Accepted: 08/14/2023] [Indexed: 10/27/2023] Open
Abstract
PURPOSE The appropriate evaluation of height and accurate estimation of bone age are crucial for proper assessment of the growth status of a child. We developed a bone age estimation program using a deep learning algorithm and established a model to predict the final adult height of Korean children. MATERIALS AND METHODS A total of 1678 radiographs from 866 children, for which the interpretation results were consistent between two pediatric endocrinologists, were used to train and validate the deep learning model. The bone age estimation algorithm was based on the convolutional neural network of the deep learning system. The test set simulation was performed by a deep learning program and two raters using 150 radiographs and final height data for 100 adults. RESULTS There was a statistically significant correlation between bone age interpreted by the artificial intelligence (AI) program and the reference bone age in the test set simulation (r=0.99, p<0.001). In the test set simulation, the AI program showed a mean absolute error (MAE) of 0.59 years and a root mean squared error (RMSE) of 0.55 years, compared with reference bone age, and showed similar accuracy to that of an experienced pediatric endocrinologist (rater 1). Prediction of final adult height by the AI program showed an MAE of 4.62 cm, compared with the actual final adult height. CONCLUSION We developed a bone age estimation program based on a deep learning algorithm. The AI-derived program demonstrated high accuracy in estimating bone age and predicting the final adult height of Korean children and adolescents.
Collapse
Affiliation(s)
- Junghwan Suh
- Department of Pediatrics, Severance Children's Hospital, Endocrine Research Institute, Yonsei University College of Medicine, Seoul, Korea
| | - Jinkyoung Heo
- Department of University Industry Foundation, Yonsei University, Seoul, Korea
| | - Su Jin Kim
- Department of Pediatrics, Severance Children's Hospital, Endocrine Research Institute, Yonsei University College of Medicine, Seoul, Korea
| | - Soyeong Park
- Department of Pediatrics, Severance Children's Hospital, Endocrine Research Institute, Yonsei University College of Medicine, Seoul, Korea
| | - Mo Kyung Jung
- Department of Pediatrics, CHA Bundang Medical Center, CHA University, Seongnam, Korea
| | - Han Saem Choi
- Department of Pediatrics, International St. Mary's Hospital, Catholic Kwandong University, Incheon, Korea
| | - Youngha Choi
- Department of Pediatrics, Kangwon National University Hospital, Chuncheon, Korea
| | - Jun Suk Oh
- Department of Pediatrics, Konyang University College of Medicine, Daejeon, Korea
| | - Hae In Lee
- Department of Pediatrics, CHA Gangnam Medical Center, CHA University, Seoul, Korea
| | - Myeongseob Lee
- Department of Pediatrics, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul, Korea
| | - Kyungchul Song
- Department of Pediatrics, Severance Children's Hospital, Endocrine Research Institute, Yonsei University College of Medicine, Seoul, Korea
| | - Ahreum Kwon
- Department of Pediatrics, Severance Children's Hospital, Endocrine Research Institute, Yonsei University College of Medicine, Seoul, Korea
| | - Hyun Wook Chae
- Department of Pediatrics, Gangnam Severance Hospital, Yonsei University College of Medicine, Seoul, Korea
| | - Ho-Seong Kim
- Department of Pediatrics, Severance Children's Hospital, Endocrine Research Institute, Yonsei University College of Medicine, Seoul, Korea.
| |
Collapse
|
16
|
Kim PH, Yoon HM, Kim JR, Hwang JY, Choi JH, Hwang J, Lee J, Sung J, Jung KH, Bae B, Jung AY, Cho YA, Shim WH, Bak B, Lee JS. Bone Age Assessment Using Artificial Intelligence in Korean Pediatric Population: A Comparison of Deep-Learning Models Trained With Healthy Chronological and Greulich-Pyle Ages as Labels. Korean J Radiol 2023; 24:1151-1163. [PMID: 37899524 PMCID: PMC10613838 DOI: 10.3348/kjr.2023.0092] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 08/01/2023] [Accepted: 08/06/2023] [Indexed: 10/31/2023] Open
Abstract
OBJECTIVE To develop a deep-learning-based bone age prediction model optimized for Korean children and adolescents and evaluate its feasibility by comparing it with a Greulich-Pyle-based deep-learning model. MATERIALS AND METHODS A convolutional neural network was trained to predict age according to the bone development shown on a hand radiograph (bone age) using 21036 hand radiographs of Korean children and adolescents without known bone development-affecting diseases/conditions obtained between 1998 and 2019 (median age [interquartile range {IQR}], 9 [7-12] years; male:female, 11794:9242) and their chronological ages as labels (Korean model). We constructed 2 separate external datasets consisting of Korean children and adolescents with healthy bone development (Institution 1: n = 343; median age [IQR], 10 [4-15] years; male: female, 183:160; Institution 2: n = 321; median age [IQR], 9 [5-14] years; male: female, 164:157) to test the model performance. The mean absolute error (MAE), root mean square error (RMSE), and proportions of bone age predictions within 6, 12, 18, and 24 months of the reference age (chronological age) were compared between the Korean model and a commercial model (VUNO Med-BoneAge version 1.1; VUNO) trained with Greulich-Pyle-based age as the label (GP-based model). RESULTS Compared with the GP-based model, the Korean model showed a lower RMSE (11.2 vs. 13.8 months; P = 0.004) and MAE (8.2 vs. 10.5 months; P = 0.002), a higher proportion of bone age predictions within 18 months of chronological age (88.3% vs. 82.2%; P = 0.031) for Institution 1, and a lower MAE (9.5 vs. 11.0 months; P = 0.022) and higher proportion of bone age predictions within 6 months (44.5% vs. 36.4%; P = 0.044) for Institution 2. CONCLUSION The Korean model trained using the chronological ages of Korean children and adolescents without known bone development-affecting diseases/conditions as labels performed better in bone age assessment than the GP-based model in the Korean pediatric population. Further validation is required to confirm its accuracy.
Collapse
Affiliation(s)
- Pyeong Hwa Kim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Hee Mang Yoon
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
| | - Jeong Rye Kim
- Department of Radiology, Dankook University Hospital, Dankook University College of Medicine, Cheonan, Republic of Korea
| | - Jae-Yeon Hwang
- Department of Radiology, Research Institute for Convergence of Biomedical Science and Technology, Pusan National University Yangsan Hospital, Pusan National University School of Medicine, Yangsan, Republic of Korea
| | - Jin-Ho Choi
- Department of Pediatrics, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Jisun Hwang
- Department of Radiology, Ajou University Hospital, Ajou University School of Medicine, Suwon, Republic of Korea
| | | | | | | | | | - Ah Young Jung
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Young Ah Cho
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Woo Hyun Shim
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
- Department of Medical Science, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Boram Bak
- University of Ulsan Foundation for Industry Cooperation, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Jin Seong Lee
- Department of Radiology and Research Institute of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
17
|
Moassefi M, Faghani S, Khosravi B, Rouzrokh P, Erickson BJ. Artificial Intelligence in Radiology: Overview of Application Types, Design, and Challenges. Semin Roentgenol 2023; 58:170-177. [PMID: 37087137 DOI: 10.1053/j.ro.2023.01.005] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 01/16/2023] [Accepted: 01/18/2023] [Indexed: 02/17/2023]
|
18
|
A Comparison of 2 Abbreviated Methods for Assessing Adolescent Bone Age: The Shorthand Bone Age Method and the SickKids/Columbia Method. J Pediatr Orthop 2023; 43:e80-e85. [PMID: 36155388 DOI: 10.1097/bpo.0000000000002269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
BACKGROUND Radiographic assessment of bone age is critically important to decision-making on the type and timing of operative interventions in pediatric orthopaedics. The current widely accepted method for determining bone age is time and resource-intensive. This study sought to assess the reliability and accuracy of 2 abbreviated methods, the Shorthand Bone Age (SBA) and the SickKids/Columbia (SKC) methods, to the widely accepted Greulich and Pyle (GP) method. METHODS Standard posteroanterior radiographs of the left hand of 125 adolescent males and 125 adolescent females were compiled, with bone ages determined by the GP method ranging from 9 to 16 years for males and 8 to 14 years for females. Blinded to the chronologic age and GP bone age of each child, the bone age for each radiograph was determined using the SBA and SKC methods by an orthopaedic surgery resident, 2 pediatric orthopaedic surgeons, and a musculoskeletal radiologist. Measurements were then repeated 2 weeks later after rerandomization of the radiographs. Intrarater and interrater reliability for the 2 abbreviated methods as well as the agreement between all 3 methods were calculated using weighted κ values. Mean absolute differences between methods were also calculated. RESULTS Both bone age methods demonstrated substantial to almost perfect intrarater reliability, with a weighted κ ranging from 0.79 to 0.93 for the SBA method and from 0.82 to 0.96 for the SKC method. Interrater reliability was moderate to substantial (weighted κ: 0.55 to 0.84) for the SBA method and substantial to almost perfect (weighted κ: 0.67 to 0.92) for the SKC method. Agreement between the 3 methods was substantial for all raters and all comparisons. The mean absolute difference, been GP-derived and SBA-derived bone age, was 7.6±7.8 months, as compared with 8.8±7.4 months between GP-derived and SKC-derived bone ages. CONCLUSIONS The SBA and SKC methods have comparable reliability, and both correlate well to the widely accepted GP methods and to each other. However, they have relatively large absolute differences when compared with the GP method. These methods offer simple, efficient, and affordable estimates for bone age determination, but at best provide an estimate to be used in the appropriate setting. LEVEL OF EVIDENCE Diagnostic study-level III.
Collapse
|
19
|
Combined assisted bone age assessment and adult height prediction methods in Chinese girls with early puberty: analysis of three artificial intelligence systems. Pediatr Radiol 2022; 53:1108-1116. [PMID: 36576515 DOI: 10.1007/s00247-022-05569-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Revised: 11/11/2022] [Accepted: 12/12/2022] [Indexed: 12/29/2022]
Abstract
BACKGROUND The applicability and accuracy of artificial intelligence (AI)-assisted bone age assessment and adult height prediction methods in girls with early puberty are unknown. OBJECTIVE To analyze the performance of AI-assisted bone age assessment methods by comparing the corresponding methods for predicted adult height with actual adult height. MATERIALS AND METHODS This retrospective review included 726 girls with early puberty, 87 of whom had reached adult height at last follow-up. Bone age was evaluated using the Greulich-Pyle (GP), Tanner-Whitehouse (TW3-RUS) and China 05 RUS-CHN (RUS-CHN) methods. Predicted adult height was calculated using the China 05 (CH05), TW3 and Bayley-Pinneau (BP) methods. RESULTS We analyzed 1,663 left-hand radiographs, including 155 from girls who had reached adult height. In the 6-8- and 9-11-years age groups, bone age differences were smaller than those in the 12-14-years group; however, the differences between predicted adult height and actual adult height were larger than those in the 12-14-years group. TW3 overestimated adult height by 0.4±2.8 cm, while CH05 and BP significantly underestimated adult height by 2.9±3.6 cm and 1.3±3.8 cm, respectively. TW3 yielded the highest proportion of predicted adult height within ±5 cm of actual adult height (92.9%), with the highest correlation between predicted and actual adult heights. CONCLUSION The differences in measured bone ages increased with increasing bone age. However, the corresponding method for predicting adult height was more accurate when the bone age was older. TW3 might be more suitable than CH05 and BP for predicting adult height in girls with early puberty. Methods for predicting adult height should be optimized for populations of the same ethnicity and disease.
Collapse
|
20
|
Meshaka R, Pinto Dos Santos D, Arthurs OJ, Sebire NJ, Shelmerdine SC. Artificial intelligence reporting guidelines: what the pediatric radiologist needs to know. Pediatr Radiol 2022; 52:2101-2110. [PMID: 34196729 DOI: 10.1007/s00247-021-05129-1] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2021] [Revised: 05/06/2021] [Accepted: 06/10/2021] [Indexed: 11/28/2022]
Abstract
There has been an exponential rise in artificial intelligence (AI) research in imaging in recent years. While the dissemination of study data that has the potential to improve clinical practice is welcomed, the level of detail included in early AI research reporting has been highly variable and inconsistent, particularly when compared to more traditional clinical research. However, inclusion checklists are now commonly available and accessible to those writing or reviewing clinical research papers. AI-specific reporting guidelines also exist and include distinct requirements, but these can be daunting for radiologists new to the field. Given that pediatric radiology is a specialty faced with workforce shortages and an ever-increasing workload, AI could help by offering solutions to time-consuming tasks, thereby improving workflow efficiency and democratizing access to specialist opinion. As a result, pediatric radiologists are expected to be increasingly leading and contributing to AI imaging research, and researchers and clinicians alike should feel confident that the findings reported are presented in a transparent way, with sufficient detail to understand how they apply to wider clinical practice. In this review, we describe two of the most clinically relevant and available reporting guidelines to help increase awareness and engage the pediatric radiologist in conducting AI imaging research. This guide should also be useful for those reading and reviewing AI imaging research and as a checklist with examples of what to expect.
Collapse
Affiliation(s)
- Riwa Meshaka
- Department of Clinical Radiology, Great Ormond Street Hospital for Children, London, WC1N 3JH, UK.,UCL Great Ormond Street Institute of Child Health, Great Ormond Street Hospital for Children, London, UK.,Great Ormond Street Hospital NIHR Biomedical Research Centre, London, UK
| | | | - Owen J Arthurs
- Department of Clinical Radiology, Great Ormond Street Hospital for Children, London, WC1N 3JH, UK.,UCL Great Ormond Street Institute of Child Health, Great Ormond Street Hospital for Children, London, UK.,Great Ormond Street Hospital NIHR Biomedical Research Centre, London, UK
| | - Neil J Sebire
- UCL Great Ormond Street Institute of Child Health, Great Ormond Street Hospital for Children, London, UK.,Great Ormond Street Hospital NIHR Biomedical Research Centre, London, UK.,Department of Pathology, Great Ormond Street Hospital for Children, London, UK
| | - Susan C Shelmerdine
- Department of Clinical Radiology, Great Ormond Street Hospital for Children, London, WC1N 3JH, UK. .,UCL Great Ormond Street Institute of Child Health, Great Ormond Street Hospital for Children, London, UK. .,Great Ormond Street Hospital NIHR Biomedical Research Centre, London, UK. .,Department of Clinical Radiology, St. George's Hospital, London, UK.
| |
Collapse
|
21
|
Offiah AC. Current and emerging artificial intelligence applications for pediatric musculoskeletal radiology. Pediatr Radiol 2022; 52:2149-2158. [PMID: 34272573 PMCID: PMC9537230 DOI: 10.1007/s00247-021-05130-8] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2021] [Revised: 04/28/2021] [Accepted: 06/10/2021] [Indexed: 12/03/2022]
Abstract
Artificial intelligence (AI) is playing an ever-increasing role in radiology (more so in the adult world than in pediatrics), to the extent that there are unfounded fears it will completely take over the role of the radiologist. In relation to musculoskeletal applications of AI in pediatric radiology, we are far from the time when AI will replace radiologists; even for the commonest application (bone age assessment), AI is more often employed in an AI-assist mode rather than an AI-replace or AI-extend mode. AI for bone age assessment has been in clinical use for more than a decade and is the area in which most research has been conducted. Most other potential indications in children (such as appendicular and vertebral fracture detection) remain largely in the research domain. This article reviews the areas in which AI is most prominent in relation to the pediatric musculoskeletal system, briefly summarizing the current literature and highlighting areas for future research. Pediatric radiologists are encouraged to participate as members of the research teams conducting pediatric radiology artificial intelligence research.
Collapse
Affiliation(s)
- Amaka C Offiah
- Department of Oncology and Metabolism, University of Sheffield, Damer Street Building, Sheffield, S10 2TH, UK.
- Department of Radiology, Sheffield Children's NHS Foundation Trust, Sheffield, UK.
| |
Collapse
|
22
|
Cheng CF, Liao KYK, Lee KJ, Tsai FJ. A Study to Evaluate Accuracy and Validity of the EFAI Computer-Aided Bone Age Diagnosis System Compared With Qualified Physicians. Front Pediatr 2022; 10:829372. [PMID: 35463905 PMCID: PMC9024098 DOI: 10.3389/fped.2022.829372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/05/2021] [Accepted: 02/25/2022] [Indexed: 11/23/2022] Open
Abstract
Study Objectives In previous research, we built a deep neural network model based on Inception-Resnet-v2 to predict bone age (EFAI-BAA). The primary objective of the study was to determine if the EFAI-BAA was substantially concordant with the qualified physicians in assessing bone ages. The secondary objective of the study was to determine if the EFAI-BAA was no different in the clinical rating (advanced, normal, or delayed) with the qualified physicians. Method This was a retrospective study. The left-hand X-ray images of male subjects aged 3-16 years old and female subjects aged 2-15 years old were collected from China Medical University Hospital (CMUH) and Asia University Hospital (AUH) retrospectively since the trial began until the included image amount reached 368. This was a blinded study. The qualified physicians who ran, read, and interpreted the tests were blinded to the values assessed by the other qualified physicians and the EFAI-BAA. Results The concordance correlation coefficient (CCC) between the EFAI-BAA (EFAI-BAA), the evaluation of bone age by physician in Kaohsiung Veterans General Hospital (KVGH), Taichung Veterans General Hospital (TVGH2), and in Taipei Tzu Chi Hospital (TZUCHI-TP) was 0.9828 (95% CI: 0.9790-0.9859, p-value = 0.6782), 0.9739 (95% CI: 0.9681-0.9786, p-value = 0.0202), and 0.9592 (95% CI: 0.9501-0.9666, p-value = 0.4855), respectively. Conclusion There was a consistency of bone age assessment between the EFAI-BAA and each one of the three qualified physicians (CCC = 0.9). As the significant difference in the clinical rating was only found between the EFAI-BAA and the qualified physician in TVGH2, the performance of the EFAI-BAA was considered similar to the qualified physicians.
Collapse
Affiliation(s)
- Chi-Fung Cheng
- Big Data Center, China Medical University Hospital, Taichung City, Taiwan
| | | | | | - Fuu-Jen Tsai
- Department of Medical Genetics, China Medical University Hospital, Taichung City, Taiwan
| |
Collapse
|
23
|
External validation of deep learning-based bone-age software: a preliminary study with real world data. Sci Rep 2022; 12:1232. [PMID: 35075207 PMCID: PMC8786917 DOI: 10.1038/s41598-022-05282-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Accepted: 01/10/2022] [Indexed: 11/17/2022] Open
Abstract
Artificial intelligence (AI) is increasingly being used in bone-age (BA) assessment due to its complicated and lengthy nature. We aimed to evaluate the clinical performance of a commercially available deep learning (DL)–based software for BA assessment using a real-world data. From Nov. 2018 to Feb. 2019, 474 children (35 boys, 439 girls, age 4–17 years) were enrolled. We compared the BA estimated by DL software (DL-BA) with that independently estimated by 3 reviewers (R1: Musculoskeletal radiologist, R2: Radiology resident, R3: Pediatric endocrinologist) using the traditional Greulich–Pyle atlas, then to his/her chronological age (CA). A paired t-test, Pearson’s correlation coefficient, Bland–Altman plot, mean absolute error (MAE) and root mean square error (RMSE) were used for the statistical analysis. The intraclass correlation coefficient (ICC) was used for inter-rater variation. There were significant differences between DL-BA and each reviewer’s BA (P < 0.025), but the correlation was good with one another (r = 0.983, P < 0.025). RMSE (MAE) values were 10.09 (7.21), 10.76 (7.88) and 13.06 (10.06) months between DL-BA and R1, R2, R3 BA. Compared with the CA, RMSE (MAE) values were 13.54 (11.06), 15.18 (12.11), 16.19 (12.78) and 19.53 (17.71) months for DL-BA, R1, R2, R3 BA, respectively. Bland–Altman plots revealed the software and reviewers’ tendency to overestimate the BA in general. ICC values between 3 reviewers were 0.97, 0.85 and 0.86, and the overall ICC value was 0.93. The BA estimated by DL-based software showed statistically similar, or even better performance than that of reviewers’ compared to the chronological age in the real world clinic.
Collapse
|
24
|
Development of a multi-stage model for intelligent and quantitative appraising of skeletal maturity using cervical vertebras cone-beam CT images of Chinese girls. Int J Comput Assist Radiol Surg 2022; 17:761-773. [PMID: 34982398 DOI: 10.1007/s11548-021-02550-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2021] [Accepted: 12/17/2021] [Indexed: 11/05/2022]
Abstract
PURPOSE Nowadays, the integration of Artificial intelligence algorithms and quantified radiographic imaging-based diagnostic procedures is hailing amplified deliberation particularly in assessment of skeletal maturity. So we intend to formulate a logistic regression model for intelligent and quantitative estimation of Fishman skeletal maturation index (SMI) based on the parameters attained from the cervical vertebrae CBCT images of Chinese girls. METHODS From 709 hand wrist radiographs and CBCT images, 447 samples were randomly selected (called as G1) to build a logistic regression model. The reliability and reproducibility were assessed by the intraclass correlation coefficient (ICC) and weighted Cohen's kappa, followed by Spearman's rank correlation coefficient to identify the parameters significantly associated with the SMI. Two hundred and sixty-two other subjects (named G2) were recruited for external examination of the models by direct visual comparison and the receiver operating characteristic (ROC) curve. In cases of confusion and mispredictions, the model was modified to improve the consistency. RESULTS Five significant parameters (Chronological age, C3 height (H3)[Formula: see text], C4 upper width (UW4), C4 lower width (LW4), and the ratio of posterior height to lower width of C4 ([Formula: see text]) were administered into logistic regression model. Despite total agreement percentage which was 84% (total AUC = 0.92), unsatisfactory performance was noticed for the 6th and 8th stages which were confused with their neighboring stages. After adjustments of the models, the total agreement percentage and AUC were upgraded to 88% and 0.96, respectively. CONCLUSION Consistency and fitness evaluation of our models demonstrated adequate prediction percentage and reliability for automated classification of skeletal maturation. The presented constructed logistic regression model has the potential to serve as a maturity evaluation index in clinical craniofacial orthopedics in Chinese girls. The proposed model in this study showed promising strength for being expended in the event of other clinical multi-stage conditions.
Collapse
|
25
|
Wang X, Zhou B, Gong P, Zhang T, Mo Y, Tang J, Shi X, Wang J, Yuan X, Bai F, Wang L, Xu Q, Tian Y, Ha Q, Huang C, Yu Y, Wang L. Artificial Intelligence-Assisted Bone Age Assessment to Improve the Accuracy and Consistency of Physicians With Different Levels of Experience. Front Pediatr 2022; 10:818061. [PMID: 35281250 PMCID: PMC8908427 DOI: 10.3389/fped.2022.818061] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Accepted: 01/26/2022] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND The accuracy and consistency of bone age assessments (BAA) using standard methods can vary with physicians' level of experience. METHODS To assess the impact of information from an artificial intelligence (AI) deep learning convolutional neural network (CNN) model on BAA, specialists with different levels of experience (junior, mid-level, and senior) assessed radiographs from 316 children aged 4-18 years that had been randomly divided into two equal sets-group A and group B. Bone age (BA) was assessed independently by each specialist without additional information (group A) and with information from the model (group B). With the mean assessment of four experts as the reference standard, mean absolute error (MAE), and intraclass correlation coefficient (ICC) were calculated to evaluate accuracy and consistency. Individual assessments of 13 bones (radius, ulna, and short bones) were also compared between group A and group B with the rank-sum test. RESULTS The accuracies of senior, mid-level, and junior physicians were significantly better (all P < 0.001) with AI assistance (MAEs 0.325, 0.344, and 0.370, respectively) than without AI assistance (MAEs 0.403, 0.469, and 0.755, respectively). Moreover, for senior, mid-level, and junior physicians, consistency was significantly higher (all P < 0.001) with AI assistance (ICCs 0.996, 0.996, and 0.992, respectively) than without AI assistance (ICCs 0.987, 0.989, and 0.941, respectively). For all levels of experience, accuracy with AI assistance was significantly better than accuracy without AI assistance for assessments of the first and fifth proximal phalanges. CONCLUSIONS Information from an AI model improves both the accuracy and the consistency of bone age assessments for physicians of all levels of experience. The first and fifth proximal phalanges are difficult to assess, and they should be paid more attention.
Collapse
Affiliation(s)
- Xi Wang
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Bo Zhou
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | | | - Ting Zhang
- Laboratory of Child Development and Nutriomics, Capital Institute of Pediatrics, Beijing, China
| | - Yan Mo
- Deepwise AI Lab, Beijing, China
| | | | - Xinmiao Shi
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Jianhong Wang
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Xinyu Yuan
- Radiology Department, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Fengsen Bai
- Radiology Department, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Lei Wang
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Qi Xu
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Yu Tian
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| | - Qing Ha
- Deepwise AI Lab, Beijing, China
| | | | | | - Lin Wang
- Department of Child Health Care, Children's Hospital, Capital Institute of Pediatrics, Beijing, China
| |
Collapse
|
26
|
Thodberg HH, Thodberg B, Ahlkvist J, Offiah AC. Autonomous artificial intelligence in pediatric radiology: the use and perception of BoneXpert for bone age assessment. Pediatr Radiol 2022; 52:1338-1346. [PMID: 35224658 PMCID: PMC9192461 DOI: 10.1007/s00247-022-05295-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/15/2021] [Revised: 12/23/2021] [Accepted: 01/19/2022] [Indexed: 11/29/2022]
Abstract
BACKGROUND The autonomous artificial intelligence (AI) system for bone age rating (BoneXpert) was designed to be used in clinical radiology practice as an AI-replace tool, replacing the radiologist completely. OBJECTIVE The aim of this study was to investigate how the tool is used in clinical practice. Are radiologists more inclined to use BoneXpert to assist rather than replace themselves, and how much time is saved? MATERIALS AND METHODS We sent a survey consisting of eight multiple-choice questions to 282 radiologists in departments in Europe already using the software. RESULTS The 97 (34%) respondents came from 18 countries. Their answers revealed that before installing the automated method, 83 (86%) of the respondents took more than 2 min per bone age rating; this fell to 20 (21%) respondents after installation. Only 17/97 (18%) respondents used BoneXpert to completely replace the radiologist; the rest used it to assist radiologists to varying degrees. For instance, 39/97 (40%) never overruled the automated reading, while 9/97 (9%) overruled more than 5% of the automated ratings. The majority 58/97 (60%) of respondents checked the radiographs themselves to exclude features of underlying disease. CONCLUSION BoneXpert significantly reduces reporting times for bone age determination. However, radiographic analysis involves more than just determining bone age. It also involves identification of abnormalities, and for this reason, radiologists cannot be completely replaced. AI systems originally developed to replace the radiologist might be more suitable as AI assist tools, particularly if they have not been validated to work autonomously, including the ability to omit ratings when the image is outside the range of validity.
Collapse
Affiliation(s)
| | | | | | - Amaka C. Offiah
- Department of Radiology, Academic Unit of Child Health, University of Sheffield, Damer Street Building, Western Bank, Sheffield, S10 2TH UK
| |
Collapse
|
27
|
Machine Learning Evaluation of Biliary Atresia Patients to Predict Long-Term Outcome after the Kasai Procedure. Bioengineering (Basel) 2021; 8:bioengineering8110152. [PMID: 34821718 PMCID: PMC8615125 DOI: 10.3390/bioengineering8110152] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Revised: 10/16/2021] [Accepted: 10/19/2021] [Indexed: 11/17/2022] Open
Abstract
Kasai portoenterostomy (KP) represents the first-line treatment for biliary atresia (BA). The purpose was to compare the accuracy of quantitative parameters extracted from laboratory tests, US imaging, and MR imaging studies using machine learning (ML) algorithms to predict the long-term medical outcome in native liver survivor BA patients after KP. Twenty-four patients were evaluated according to clinical and laboratory data at initial evaluation (median follow-up = 9.7 years) after KP as having ideal (n = 15) or non-ideal (n = 9) medical outcomes. Patients were re-evaluated after an additional 4 years and classified in group 1 (n = 12) as stable and group 2 (n = 12) as non-stable in the disease course. Laboratory and quantitative imaging parameters were merged to test ML algorithms. Total and direct bilirubin (TB and DB), as laboratory parameters, and US stiffness, as an imaging parameter, were the only statistically significant parameters between the groups. The best algorithm in terms of accuracy, sensitivity, specificity, and AUCROC was naive Bayes algorithm, selecting only laboratory parameters (TB and DB). This preliminary ML analysis confirms the fundamental role of TB and DB values in predicting the long-term medical outcome for BA patients after KP, even though their values may be within the normal range. Physicians should be alert when TB and DB values change slightly.
Collapse
|
28
|
Kang DS, Lee HJ, Seo YR, Lee CM, Hwang IT. Identifying the role of RUNX2 in bone development through network analysis in girls with central precocious puberty. Mol Cell Toxicol 2021. [DOI: 10.1007/s13273-021-00183-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
29
|
Prokop-Piotrkowska M, Marszałek-Dziuba K, Moszczyńska E, Szalecki M, Jurkiewicz E. Traditional and New Methods of Bone Age Assessment-An Overview. J Clin Res Pediatr Endocrinol 2021; 13:251-262. [PMID: 33099993 PMCID: PMC8388057 DOI: 10.4274/jcrpe.galenos.2020.2020.0091] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
Bone age is one of biological indicators of maturity used in clinical practice and it is a very important parameter of a child’s assessment, especially in paediatric endocrinology. The most widely used method of bone age assessment is by performing a hand and wrist radiograph and its analysis with Greulich-Pyle or Tanner-Whitehouse atlases, although it has been about 60 years since they were published. Due to the progress in the area of Computer-Aided Diagnosis and application of artificial intelligence in medicine, lately, numerous programs for automatic bone age assessment have been created. Most of them have been verified in clinical studies in comparison to traditional methods, showing good precision while eliminating inter- and intra-rater variability and significantly reducing the time of assessment. Additionally, there are available methods for assessment of bone age which avoid X-ray exposure, using modalities such as ultrasound or magnetic resonance imaging.
Collapse
Affiliation(s)
- Monika Prokop-Piotrkowska
- Children’s Memorial Health Institute, Department of Endocrinology and Diabetology, Warsaw, Poland,* Address for Correspondence: Children’s Memorial Health Institute, Department of Endocrinology and Diabetology, Warsaw, Poland Phone: +48 608 523 869 E-mail:
| | - Kamila Marszałek-Dziuba
- Children’s Memorial Health Institute, Department of Endocrinology and Diabetology, Warsaw, Poland
| | - Elżbieta Moszczyńska
- Children’s Memorial Health Institute, Department of Endocrinology and Diabetology, Warsaw, Poland
| | | | - Elżbieta Jurkiewicz
- Children’s Memorial Health Institute, Department of Diagnostic Imaging, Warsaw, Poland
| |
Collapse
|
30
|
Wang ZJ. Probing an AI regression model for hand bone age determination using gradient-based saliency mapping. Sci Rep 2021; 11:10610. [PMID: 34012111 PMCID: PMC8134559 DOI: 10.1038/s41598-021-90157-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2020] [Accepted: 05/04/2021] [Indexed: 11/21/2022] Open
Abstract
Understanding how a neural network makes decisions holds significant value for users. For this reason, gradient-based saliency mapping was tested on an artificial intelligence (AI) regression model for determining hand bone age from X-ray radiographs. The partial derivative (PD) of the inferred age with respect to input image intensity at each pixel served as a saliency marker to find sensitive areas contributing to the outcome. The mean of the absolute PD values was calculated for five anatomical regions of interest, and one hundred test images were evaluated with this procedure. The PD maps suggested that the AI model employed a holistic approach in determining hand bone age, with the wrist area being the most important at early ages. However, this importance decreased with increasing age. The middle section of the metacarpal bones was the least important area for bone age determination. The muscular region between the first and second metacarpal bones also exhibited high PD values but contained no bone age information, suggesting a region of vulnerability in age determination. An end-to-end gradient-based saliency map can be obtained from a black box regression AI model and provide insight into how the model makes decisions.
Collapse
Affiliation(s)
- Zhiyue J Wang
- Department of Radiology, Children's Health and University of Texas Southwestern Medical Center, 1935 Medical District Drive, F1-02, Dallas, TX, 75235, USA.
| |
Collapse
|
31
|
Lee BD, Lee MS. Automated Bone Age Assessment Using Artificial Intelligence: The Future of Bone Age Assessment. Korean J Radiol 2021; 22:792-800. [PMID: 33569930 PMCID: PMC8076828 DOI: 10.3348/kjr.2020.0941] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2020] [Revised: 09/17/2020] [Accepted: 10/19/2020] [Indexed: 12/27/2022] Open
Abstract
Bone age assessments are a complicated and lengthy process, which are prone to inter- and intra-observer variabilities. Despite the great demand for fully automated systems, developing an accurate and robust bone age assessment solution has remained challenging. The rapidly evolving deep learning technology has shown promising results in automated bone age assessment. In this review article, we will provide information regarding the history of automated bone age assessments, discuss the current status, and present a literature review, as well as the future directions of artificial intelligence-based bone age assessments.
Collapse
Affiliation(s)
- Byoung Dai Lee
- Division of Computer Science and Engineering, Kyonggi University, Suwon, Korea
| | - Mu Sook Lee
- Department of Radiology, Keimyung University Dongsan Hospital, Daegu, Korea.
| |
Collapse
|
32
|
Heo MS, Kim JE, Hwang JJ, Han SS, Kim JS, Yi WJ, Park IW. Artificial intelligence in oral and maxillofacial radiology: what is currently possible? Dentomaxillofac Radiol 2021; 50:20200375. [PMID: 33197209 PMCID: PMC7923066 DOI: 10.1259/dmfr.20200375] [Citation(s) in RCA: 73] [Impact Index Per Article: 18.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2020] [Revised: 08/28/2020] [Accepted: 08/28/2020] [Indexed: 12/13/2022] Open
Abstract
Artificial intelligence, which has been actively applied in a broad range of industries in recent years, is an active area of interest for many researchers. Dentistry is no exception to this trend, and the applications of artificial intelligence are particularly promising in the field of oral and maxillofacial (OMF) radiology. Recent researches on artificial intelligence in OMF radiology have mainly used convolutional neural networks, which can perform image classification, detection, segmentation, registration, generation, and refinement. Artificial intelligence systems in this field have been developed for the purposes of radiographic diagnosis, image analysis, forensic dentistry, and image quality improvement. Tremendous amounts of data are needed to achieve good results, and involvement of OMF radiologist is essential for making accurate and consistent data sets, which is a time-consuming task. In order to widely use artificial intelligence in actual clinical practice in the future, there are lots of problems to be solved, such as building up a huge amount of fine-labeled open data set, understanding of the judgment criteria of artificial intelligence, and DICOM hacking threats using artificial intelligence. If solutions to these problems are presented with the development of artificial intelligence, artificial intelligence will develop further in the future and is expected to play an important role in the development of automatic diagnosis systems, the establishment of treatment plans, and the fabrication of treatment tools. OMF radiologists, as professionals who thoroughly understand the characteristics of radiographic images, will play a very important role in the development of artificial intelligence applications in this field.
Collapse
Affiliation(s)
- Min-Suk Heo
- Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Republic of Korea
| | - Jo-Eun Kim
- Department of Oral and Maxillofacial Radiology, Seoul National University Dental Hospital, Seoul, Republic of Korea
| | - Jae-Joon Hwang
- Department of Oral and Maxillofacial Radiology, School of Dentistry, Pusan National University, Yangsan, Republic of Korea
| | - Sang-Sun Han
- Department of Oral and Maxillofacial Radiology, College of Dentistry, Yonsei University, Seoul, Republic of Korea
| | - Jin-Soo Kim
- Department of Oral and Maxillofacial Radiology, College of Dentistry, Chosun University, Gwangju, Republic of Korea
| | - Won-Jin Yi
- Department of Oral and Maxillofacial Radiology and Dental Research Institute, School of Dentistry, Seoul National University, Seoul, Republic of Korea
| | - In-Woo Park
- Department of Oral and Maxillofacial Radiology, College of Dentistry, Gangneung-Wonju National University, Gangneung, Republic of Korea
| |
Collapse
|
33
|
Caffery LJ, Rotemberg V, Weber J, Soyer HP, Malvehy J, Clunie D. The Role of DICOM in Artificial Intelligence for Skin Disease. Front Med (Lausanne) 2021; 7:619787. [PMID: 33644087 PMCID: PMC7902872 DOI: 10.3389/fmed.2020.619787] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2020] [Accepted: 12/31/2020] [Indexed: 01/19/2023] Open
Abstract
There is optimism that artificial intelligence (AI) will result in positive clinical outcomes, which is driving research and investment in the use of AI for skin disease. At present, AI for skin disease is embedded in research and development and not practiced widely in clinical dermatology. Clinical dermatology is also undergoing a technological transformation in terms of the development and adoption of standards that optimizes the quality use of imaging. Digital Imaging and Communications in Medicine (DICOM) is the international standard for medical imaging. DICOM is a continually evolving standard. There is considerable effort being invested in developing dermatology-specific extensions to the DICOM standard. The ability to encode relevant metadata and afford interoperability with the digital health ecosystem (e.g., image repositories, electronic medical records) has driven the initial impetus in the adoption of DICOM for dermatology. DICOM has a dedicated working group whose role is to develop a mechanism to support AI workflows and encode AI artifacts. DICOM can improve AI workflows by encoding derived objects (e.g., secondary images, visual explainability maps, AI algorithm output) and the efficient curation of multi-institutional datasets for machine learning training, testing, and validation. This can be achieved using DICOM mechanisms such as standardized image formats and metadata, metadata-based image retrieval, and de-identification protocols. DICOM can address several important technological and workflow challenges for the implementation of AI. However, many other technological, ethical, regulatory, medicolegal, and workforce barriers will need to be addressed before DICOM and AI can be used effectively in dermatology.
Collapse
Affiliation(s)
- Liam J. Caffery
- Centre for Online, Centre for Health Services Research, The University of Queensland, Brisbane, QLD, Australia
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
| | - Veronica Rotemberg
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - Jochen Weber
- Dermatology Service, Department of Medicine, Memorial Sloan Kettering Cancer Center, New York, NY, United States
| | - H. Peter Soyer
- Dermatology Research Centre, The University of Queensland Diamantina Institute, The University of Queensland, Brisbane, QLD, Australia
- Department of Dermatology, Princess Alexandra Hospital, Brisbane, QLD, Australia
| | - Josep Malvehy
- Department of Dermatology, Institut d'Investigacions Biomèdiques August Pi i Sunyer, Hospital Clinic of Barcelona, University of Barcelona, Barcelona, Spain
| | | |
Collapse
|
34
|
Davendralingam N, Sebire NJ, Arthurs OJ, Shelmerdine SC. Artificial intelligence in paediatric radiology: Future opportunities. Br J Radiol 2021; 94:20200975. [PMID: 32941736 PMCID: PMC7774693 DOI: 10.1259/bjr.20200975] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Accepted: 09/04/2020] [Indexed: 12/13/2022] Open
Abstract
Artificial intelligence (AI) has received widespread and growing interest in healthcare, as a method to save time, cost and improve efficiencies. The high-performance statistics and diagnostic accuracies reported by using AI algorithms (with respect to predefined reference standards), particularly from image pattern recognition studies, have resulted in extensive applications proposed for clinical radiology, especially for enhanced image interpretation. Whilst certain sub-speciality areas in radiology, such as those relating to cancer screening, have received wide-spread attention in the media and scientific community, children's imaging has been hitherto neglected.In this article, we discuss a variety of possible 'use cases' in paediatric radiology from a patient pathway perspective where AI has either been implemented or shown early-stage feasibility, while also taking inspiration from the adult literature to propose potential areas for future development. We aim to demonstrate how a 'future, enhanced paediatric radiology service' could operate and to stimulate further discussion with avenues for research.
Collapse
Affiliation(s)
- Natasha Davendralingam
- Department of Radiology, Great Ormond Street Hospital for Children NHS Foundation Trust, London, UK
| | | | | | | |
Collapse
|
35
|
Diete V, Wabitsch M, Denzer C, Jäger H, Hauth E, Beer M, Vogele D. Applicability of Magnetic Resonance Imaging for Bone Age Estimation in the Context of Medical Issues. ROFO-FORTSCHR RONTG 2020; 193:692-700. [PMID: 33336355 DOI: 10.1055/a-1313-7664] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
Abstract
OBJECTIVE The determination of bone age is a method for analyzing biological age and structural maturity. Bone age estimation is predominantly used in the context of medical issues, for example in endocrine diseases or growth disturbance. As a rule, conventional X-ray images of the left wrist and hand are used for this purpose. The aim of the present study is to investigate the extent to which MRI can be used as a radiation-free alternative for bone age assessment. METHODS In 50 patients, 19 females and 31 males, in addition to conventional left wrist and hand radiographs, MRI was performed with T1-VIBE (n = 50) and T1-TSE (n = 34). The average age was 11.87 years (5.08 to 17.50 years). Bone age assessment was performed by two experienced investigators blinded for chronological age according to the most widely used standard of Greulich and Pyle. This method relies on a subjective comparison of hand radiographs with gender-specific reference images from Caucasian children and adolescents. In addition to interobserver and intraobserver variability, the correlation between conventional radiographs and MRI was determined using the Pearson correlation coefficient. RESULTS Between the bone age determined from the MRI data and the results of the conventional X-ray images, a very good correlation was found for both T1-VIBE with r = 0.986 and T1-TSE with r = 0.982. Gender differences did not arise. The match for the interobserver variability was very good: r = 0.985 (CR), 0.966 (T1-VIBE) and 0.971 (T1-TSE) as well as the match for the intraobserver variability for investigator A (CR = 0.994, T1-VIBE = 0.995, T1-TSE = 0.998) and for investigator B (CR = 0.994, T1-VIBE = 0.993, T1-TSE = 0.994). CONCLUSION The present study shows that MRI of the left wrist and hand can be used as a possible radiation-free alternative to conventional X-ray imaging for bone age estimation in the context of medical issues. KEY POINTS · MRI and X-ray show a very good correlation for bone age determination in medical issues.. · With short examination times, T1 VIBE shows slight advantages over T1 TSE.. · Both investigators show high intra- and interobserver variability.. CITATION FORMAT · Diete V, Wabitsch M, Denzer C et al. Applicability of Magnetic Resonance Imaging for Bone Age Estimation in the Context of Medical Issues. Fortschr Röntgenstr 2021; 193: 692 - 700.
Collapse
Affiliation(s)
- Vera Diete
- Department for Diagnostic and Interventional Radiology, University Ulm Medical Centre, Ulm, Germany
| | - Martin Wabitsch
- Division of Pediatric Endocrinology and Diabetes, University Ulm Medical Centre, Ulm, Germany
| | - Christian Denzer
- Division of Pediatric Endocrinology and Diabetes, University Ulm Medical Centre, Ulm, Germany
| | | | | | - Meinrad Beer
- Department for Diagnostic and Interventional Radiology, University Ulm Medical Centre, Ulm, Germany
| | - Daniel Vogele
- Department for Diagnostic and Interventional Radiology, University Ulm Medical Centre, Ulm, Germany
| |
Collapse
|
36
|
Automated Bone Age Assessment with Image Registration Using Hand X-ray Images. APPLIED SCIENCES-BASEL 2020. [DOI: 10.3390/app10207233] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
Abstract
One of the methods for identifying growth disorder is by assessing the skeletal bone age. A child with a healthy growth rate will have approximately the same chronological and bone ages. It is important to detect any growth disorder as early as possible, so that mitigation treatment can be administered with less negative consequences. Recently, the most popular approach in assessing the discrepancy between bone and chronological ages is through the subjective protocol of Tanner–Whitehouse that assesses selected regions in the hand X-ray images. This approach relies heavily on the medical personnel experience, which produces a high intra-observer bias. Therefore, an automated bone age prediction system with image registration using hand X-ray images is proposed in order to complement the inexperienced doctors by providing the second opinion. The system relies on an optimized regression network using a novel residual separable convolution model. The regressor network requires an input image to be 299 × 299 pixels, which will be mapped to the predicted bone age through three modules of the Xception network. Moreover, the images will be pre-processed or registered first to a standardized and normalized pose using separable convolutional neural networks. Three steps image registration are performed by segmenting the hand regions, which will be rotated using angle calculated from four keypoints of interest, before positional alignment is applied to ensure the region of interest is located in the middle. The hand segmentation is based on DeepLab V3 plus architecture, while keypoints regressor for angle alignment is based on MobileNet V1 architecture, where both of them use separable convolution as the core operators. To avoid the pitfall of underfitting, synthetic data are generated while using various rotation angles, zooming factors, and shearing images in order to augment the training dataset. The experimental results show that the proposed method returns the lowest mean absolute error and mean squared error of 8.200 months and 121.902 months2, respectively. Hence, an error of less than one year is acceptable in predicting the bone age, which can serve as a good supplement tool for providing the second expert opinion. This work does not consider gender information, which is crucial in making a better prediction, as the male and female bone structures are naturally different.
Collapse
|