1
|
Lee A, Wu J, Liu C, Makmur A, Ting YH, Muhamat Nor FE, Tan LY, Ong W, Tan WC, Lee YJ, Huang J, Beh JCY, Lim DSW, Low XZ, Teo EC, Chan YH, Lim JI, Lin S, Tan JH, Kumar N, Ooi BC, Quek ST, Hallinan JTPD. Deep learning model for automated diagnosis of degenerative cervical spondylosis and altered spinal cord signal on MRI. Spine J 2025; 25:255-264. [PMID: 39357744 DOI: 10.1016/j.spinee.2024.09.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Revised: 08/11/2024] [Accepted: 09/14/2024] [Indexed: 10/04/2024]
Abstract
BACKGROUND CONTEXT A deep learning (DL) model for degenerative cervical spondylosis on MRI could enhance reporting consistency and efficiency, addressing a significant global health issue. PURPOSE Create a DL model to detect and classify cervical cord signal abnormalities, spinal canal and neural foraminal stenosis. STUDY DESIGN/SETTING Retrospective study conducted from January 2013 to July 2021, excluding cases with instrumentation. PATIENT SAMPLE Overall, 504 MRI cervical spines were analyzed (504 patients, mean=58 years±13.7[SD]; 202 women) with 454 for training (90%) and 50 (10%) for internal testing. In addition, 100 MRI cervical spines were available for external testing (100 patients, mean=60 years±13.0[SD];26 women). OUTCOME MEASURES Automated detection and classification of spinal canal stenosis, neural foraminal stenosis, and cord signal abnormality using the DL model. Recall(%), inter-rater agreement (Gwet's kappa), sensitivity, and specificity were calculated. METHODS Utilizing axial T2-weighted gradient echo and sagittal T2-weighted images, a transformer-based DL model was trained on data labeled by an experienced musculoskeletal radiologist (12 years of experience). Internal testing involved data labeled in consensus by 2 musculoskeletal radiologists (reference standard, both with 12-years-experience), 2 subspecialist radiologists, and 2 in-training radiologists. External testing was performed. RESULTS The DL model exhibited substantial agreement surpassing all readers in all classes for spinal canal (κ=0.78, p<.001 vs κ range=0.57-0.70 for readers) and neural foraminal stenosis (κ=0.80, p<.001 vs κ range=0.63-0.69 for readers) classification. The DL model's recall for cord signal abnormality (92.3%) was similar to all readers (range: 92.3-100.0%). Nearly perfect agreement was demonstrated for binary classification (grades 0/1 vs 2/3) (κ=0.95, p<.001 for spinal canal; κ=0.90, p<.001 for neural foramina). External testing showed substantial agreement using all classes (κ=0.76, p<.001 for spinal canal; κ=0.66, p<.001 for neural foramina) and high recall for cord signal abnormality (91.9%). The DL model demonstrated high sensitivities (range:83.7%-92.4%) and specificities (range:87.8%-98.3%) on both internal and external datasets for spinal canal and neural foramina classification. CONCLUSIONS Our DL model for degenerative cervical spondylosis on MRI showed good performance, demonstrating substantial agreement with the reference standard. This tool could assist radiologists in improving the efficiency and consistency of MRI cervical spondylosis assessments in clinical practice.
Collapse
Affiliation(s)
- Aric Lee
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - Junran Wu
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive 117417, Singapore
| | - Changshuo Liu
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive 117417, Singapore
| | - Andrew Makmur
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore; Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Yong Han Ting
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore; Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Faimee Erwan Muhamat Nor
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore; Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Loon Ying Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore; Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - Wilson Ong
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - Wei Chuan Tan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - You Jun Lee
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - Juncheng Huang
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - Joey Chan Yiing Beh
- Department of Radiology, Ng Teng Fong General Hospital, 1 Jurong East Street 21 609606, Singapore
| | - Desmond Shi Wei Lim
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - Xi Zhen Low
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - Ee Chin Teo
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore
| | - Yiong Huak Chan
- Biostatistics Unit, Yong Loo Lin School of Medicine, 10 Medical Drive 117597, Singapore
| | - Joshua Ian Lim
- Division of Spine Surgery, Department of Orthopaedic Surgery, Ng Teng Fong General Hospital, 1 Jurong East Street 21 609606, Singapore
| | - Shuxun Lin
- Division of Spine Surgery, Department of Orthopaedic Surgery, Ng Teng Fong General Hospital, 1 Jurong East Street 21 609606, Singapore
| | - Jiong Hao Tan
- University Spine centre, University Orthopaedics, Hand and Reconstructive Microsurgery (UOHC), National University Health System, Singapore
| | - Naresh Kumar
- University Spine centre, University Orthopaedics, Hand and Reconstructive Microsurgery (UOHC), National University Health System, Singapore
| | - Beng Chin Ooi
- Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive 117417, Singapore
| | - Swee Tian Quek
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore; Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore
| | - James Thomas Patrick Decourcy Hallinan
- Department of Diagnostic Imaging, National University Hospital, 5 Lower Kent Ridge Rd 119074, Singapore; Department of Diagnostic Radiology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore.
| |
Collapse
|
2
|
Liawrungrueang W, Han I, Cholamjiak W, Sarasombath P, Riew KD. Artificial Intelligence Detection of Cervical Spine Fractures Using Convolutional Neural Network Models. Neurospine 2024; 21:833-841. [PMID: 39363462 PMCID: PMC11456954 DOI: 10.14245/ns.2448580.290] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2024] [Revised: 07/05/2024] [Accepted: 07/14/2024] [Indexed: 10/05/2024] Open
Abstract
OBJECTIVE To develop and evaluate a technique using convolutional neural networks (CNNs) for the computer-assisted diagnosis of cervical spine fractures from radiographic x-ray images. By leveraging deep learning techniques, the study might potentially lead to improved patient outcomes and clinical decision-making. METHODS This study obtained 500 lateral radiographic cervical spine x-ray images from standard open-source dataset repositories to develop a classification model using CNNs. All the images contained diagnostic information, including normal cervical radiographic images (n=250) and fracture images of the cervical spine fracture (n=250). The model would classify whether the patient had a cervical spine fracture or not. Seventy percent of the images were training data sets used for model training, and 30% were for testing. Konstanz Information Miner (KNIME)'s graphic user interface-based programming enabled class label annotation, data preprocessing, CNNs model training, and performance evaluation. RESULTS The performance evaluation of a model for detecting cervical spine fractures presents compelling results across various metrics. This model exhibits high sensitivity (recall) values of 0.886 for fractures and 0.957 for normal cases, indicating its proficiency in identifying true positives. Precision values of 0.954 for fractures and 0.893 for normal cases highlight the model's ability to minimize false positives. With specificity values of 0.957 for fractures and 0.886 for normal cases, the model effectively identifies true negatives. The overall accuracy of 92.14% highlights its reliability in correctly classifying cases by the area under the receiver operating characteristic curve. CONCLUSION We successfully used deep learning models for computer-assisted diagnosis of cervical spine fractures from radiographic x-ray images. This approach can assist the radiologist in screening, detecting, and diagnosing cervical spine fractures.
Collapse
Affiliation(s)
| | - Inbo Han
- Department of Neurosurgery, CHA Bundang Medical Center, CHA University School of Medicine, Seongnam, Korea
| | | | - Peem Sarasombath
- Department of Orthopaedics, Phramongkutklao Hospital and College of Medicine, Bangkok, Thailand
| | - K. Daniel Riew
- Department of Neurological Surgery, Weill-Cornell Medicine and Department of Orthopedic Surgery, The Och Spine Hospital at New York Presbyterian Hospital, Columbia University, New York, NY, USA
| |
Collapse
|
3
|
Kazimierczak W, Jedliński M, Issa J, Kazimierczak N, Janiszewska-Olszowska J, Dyszkiewicz-Konwińska M, Różyło-Kalinowska I, Serafin Z, Orhan K. Accuracy of Artificial Intelligence for Cervical Vertebral Maturation Assessment-A Systematic Review. J Clin Med 2024; 13:4047. [PMID: 39064087 PMCID: PMC11277636 DOI: 10.3390/jcm13144047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Revised: 07/03/2024] [Accepted: 07/08/2024] [Indexed: 07/28/2024] Open
Abstract
Background/Objectives: To systematically review and summarize the existing scientific evidence on the diagnostic performance of artificial intelligence (AI) in assessing cervical vertebral maturation (CVM). This review aimed to evaluate the accuracy and reliability of AI algorithms in comparison to those of experienced clinicians. Methods: Comprehensive searches were conducted across multiple databases, including PubMed, Scopus, Web of Science, and Embase, using a combination of Boolean operators and MeSH terms. The inclusion criteria were cross-sectional studies with neural network research, reporting diagnostic accuracy, and involving human subjects. Data extraction and quality assessment were performed independently by two reviewers, with a third reviewer resolving any disagreements. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS)-2 tool was used for bias assessment. Results: Eighteen studies met the inclusion criteria, predominantly employing supervised learning techniques, especially convolutional neural networks (CNNs). The diagnostic accuracy of AI models for CVM assessment varied widely, ranging from 57% to 95%. The factors influencing accuracy included the type of AI model, training data, and study methods. Geographic concentration and variability in the experience of radiograph readers also impacted the results. Conclusions: AI has considerable potential for enhancing the accuracy and reliability of CVM assessments in orthodontics. However, the variability in AI performance and the limited number of high-quality studies suggest the need for further research.
Collapse
Affiliation(s)
- Wojciech Kazimierczak
- Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun, Jagiellońska 13-15, 85-067 Bydgoszcz, Poland
- Kazimierczak Private Medical Practice, Dworcowa 13/u6a, 85-009 Bydgoszcz, Poland
| | - Maciej Jedliński
- Department of Interdisciplinary Dentistry, Pomeranian Medical University in Szczecin, 70-111 Szczecin, Poland
| | - Julien Issa
- Chair of Practical Clinical Dentistry, Department of Diagnostics, Poznań University of Medical Sciences, 61-701 Poznań, Poland
| | - Natalia Kazimierczak
- Kazimierczak Private Medical Practice, Dworcowa 13/u6a, 85-009 Bydgoszcz, Poland
| | | | - Marta Dyszkiewicz-Konwińska
- Chair of Practical Clinical Dentistry, Department of Diagnostics, Poznań University of Medical Sciences, 61-701 Poznań, Poland
| | - Ingrid Różyło-Kalinowska
- Department of Dental and Maxillofacial Radiodiagnostics, Medical University of Lublin, 20-093 Lublin, Poland
| | - Zbigniew Serafin
- Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun, Jagiellońska 13-15, 85-067 Bydgoszcz, Poland
| | - Kaan Orhan
- Department of Dentomaxillofacial Radiology, Faculty of Dentistry, Ankara University, Ankara 06500, Turkey
- Medical Design Application and Research Center (MEDITAM), Ankara University, Ankara 06500, Turkey
- Department of Oral Diagnostics, Faculty of Dentistry, Semmelweis University, 1088 Budapest, Hungary
| |
Collapse
|
4
|
Hwang UJ, Kwon OY, Kim JH, Yang S. Machine learning models for classifying non-specific neck pain using craniocervical posture and movement. Musculoskelet Sci Pract 2024; 71:102945. [PMID: 38527390 DOI: 10.1016/j.msksp.2024.102945] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 03/11/2024] [Accepted: 03/17/2024] [Indexed: 03/27/2024]
Abstract
OBJECTIVE Physical therapists and clinicians commonly confirm craniocervical posture (CCP), cervical retraction, and craniocervical flexion as screening tests because they contribute to non-specific neck pain (NSNP). We compared the predictive performance of statistical machine learning (ML) models for classifying individuals with and without NSNP using datasets containing CCP and cervical kinematics during pro- and retraction (CKdPR). DESIGN Exploratory, cross-sectional design. SETTING AND PARTICIPANTS In total, 773 public service office workers (PSOWs) were screened for eligibility (NSNP, 441; without NSNP, 332). METHODS We set up five datasets (CCP, cervical kinematics during the protraction, cervical kinematics during the retraction, CKdPR and combination of the CCP and CKdPR). Four ML algorithms-random forest, logistic regression, Extreme Gradient boosting, and support vector machine-were trained. MAIN OUTCOME MEASURES Model performance were assessed using area under the curve (AUC), accuracy, precision, recall and F1-score. To interpret the predictions, we used Feature permutation importance and SHapley Additive explanation values. RESULTS The random forest model in the CKdPR dataset classified PSOWs with and without NSNP and achieved the best AUC among the five datasets using the test data (AUC, 0.892 [good]; F1, 0.832). The random forest model in the CCP dataset had the worst AUC among the five datasets using the test data [AUC, 0.738 (fair); F1, 0.715]. CONCLUSION ML performance was higher for the CKdPR dataset than for the CCP dataset, suggesting that ML algorithms are more suitable than classical statistical methods for developing robust models for classifying PSOWs with and without NSNP.
Collapse
Affiliation(s)
- Ui-Jae Hwang
- Department of Physical Therapy, College of Health Science, Laboratory of KEMA AI Research (KAIR), Yonsei University, Wonju, 26426, Republic of Korea.
| | - Oh-Yun Kwon
- Department of Physical Therapy, College of Health Science, Laboratory of Kinetic Ergocise Based on Movement Analysis, Yonsei University, Wonju, 26426, Republic of Korea.
| | - Jun-Hee Kim
- Department of Physical Therapy, College of Health Science, Laboratory of KEMA AI Research (KAIR), Yonsei University, Wonju, 26426, Republic of Korea.
| | - Sejung Yang
- Department of Precision Medicine, Yonsei University Wonju College of Medicine, Wonju, 26426, Republic of Korea; Department of Medical Informatics and Biostatistics, Graduate School, Yonsei University, Republic of Korea.
| |
Collapse
|