1
|
Predicting osteoporosis from kidney-ureter-bladder radiographs utilizing deep convolutional neural networks. Bone 2024; 184:117107. [PMID: 38677502 DOI: 10.1016/j.bone.2024.117107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/05/2024] [Revised: 04/10/2024] [Accepted: 04/16/2024] [Indexed: 04/29/2024]
Abstract
Osteoporosis is a common condition that can lead to fractures, mobility issues, and death. Although dual-energy X-ray absorptiometry (DXA) is the gold standard for osteoporosis, it is expensive and not widely available. In contrast, kidney-ureter-bladder (KUB) radiographs are inexpensive and frequently ordered in clinical practice. Thus, it is a potential screening tool for osteoporosis. In this study, we explored the possibility of predicting the bone mineral density (BMD) and classifying high-risk patient groups using KUB radiographs. We proposed DeepDXA-KUB, a deep learning model that predicts the BMD values of the left hip and lumbar vertebrae from an input KUB image. The datasets were obtained from Taiwanese medical centers between 2006 and 2019, using 8913 pairs of KUB radiographs and DXA examinations performed within 6 months. The images were randomly divided into training and validation sets in a 4:1 ratio. To evaluate the model's performance, we computed a confusion matrix and evaluated the sensitivity, specificity, accuracy, precision, positive predictive value, negative predictive value, F1 score, and area under the receiver operating curve (AUROC). Moderate correlations were observed between the predicted and DXA-measured BMD values, with a correlation coefficient of 0.858 for the lumbar vertebrae and 0.87 for the left hip. The model demonstrated an osteoporosis detection accuracy, sensitivity, and specificity of 84.7 %, 81.6 %, and 86.6 % for the lumbar vertebrae and 84.2 %, 91.2 %, and 81 % for the left hip, respectively. The AUROC was 0.939 for the lumbar vertebrae and 0.947 for the left hip, indicating a satisfactory performance in osteoporosis screening. The present study is the first to develop a deep learning model based on KUB radiographs to predict lumbar spine and femoral BMD. Our model demonstrated a promising correlation between the predicted and DXA-measured BMD in both the lumbar vertebrae and hip, showing great potential for the opportunistic screening of osteoporosis.
Collapse
|
2
|
Application of Artificial Intelligence Methods on Osteoporosis Classification with Radiographs-A Systematic Review. Bioengineering (Basel) 2024; 11:484. [PMID: 38790351 PMCID: PMC11117497 DOI: 10.3390/bioengineering11050484] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/23/2024] [Revised: 04/24/2024] [Accepted: 05/07/2024] [Indexed: 05/26/2024] Open
Abstract
Osteoporosis is a complex endocrine disease characterized by a decline in bone mass and microstructural integrity. It constitutes a major global health problem. Recent progress in the field of artificial intelligence (AI) has opened new avenues for the effective diagnosis of osteoporosis via radiographs. This review investigates the application of AI classification of osteoporosis in radiographs. A comprehensive exploration of electronic repositories (ClinicalTrials.gov, Web of Science, PubMed, MEDLINE) was carried out in adherence to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses 2020 statement (PRISMA). A collection of 31 articles was extracted from these repositories and their significant outcomes were consolidated and outlined. This encompassed insights into anatomical regions, the specific machine learning methods employed, the effectiveness in predicting BMD, and categorizing osteoporosis. Through analyzing the respective studies, we evaluated the effectiveness and limitations of AI osteoporosis classification in radiographs. The pooled reported accuracy, sensitivity, and specificity of osteoporosis classification ranges from 66.1% to 97.9%, 67.4% to 100.0%, and 60.0% to 97.5% respectively. This review underscores the potential of AI osteoporosis classification and offers valuable insights for future research endeavors, which should focus on addressing the challenges in technical and clinical integration to facilitate practical implementation of this technology.
Collapse
|
3
|
Utility of Machine Learning Algorithms for Opportunistic Bone Density Screening Using Conventional Radiographs. J Am Coll Radiol 2024; 21:640-641. [PMID: 37722464 DOI: 10.1016/j.jacr.2023.08.043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 08/03/2023] [Indexed: 09/20/2023]
|
4
|
Deep learning in the radiologic diagnosis of osteoporosis: a literature review. J Int Med Res 2024; 52:3000605241244754. [PMID: 38656208 PMCID: PMC11044779 DOI: 10.1177/03000605241244754] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Accepted: 02/26/2024] [Indexed: 04/26/2024] Open
Abstract
OBJECTIVE Osteoporosis is a systemic bone disease characterized by low bone mass, damaged bone microstructure, increased bone fragility, and susceptibility to fractures. With the rapid development of artificial intelligence, a series of studies have reported deep learning applications in the screening and diagnosis of osteoporosis. The aim of this review was to summary the application of deep learning methods in the radiologic diagnosis of osteoporosis. METHODS We conducted a two-step literature search using the PubMed and Web of Science databases. In this review, we focused on routine radiologic methods, such as X-ray, computed tomography, and magnetic resonance imaging, used to opportunistically screen for osteoporosis. RESULTS A total of 40 studies were included in this review. These studies were divided into three categories: osteoporosis screening (n = 20), bone mineral density prediction (n = 13), and osteoporotic fracture risk prediction and detection (n = 7). CONCLUSIONS Deep learning has demonstrated a remarkable capacity for osteoporosis screening. However, clinical commercialization of a diagnostic model for osteoporosis remains a challenge.
Collapse
|
5
|
External validation of a deep learning model for predicting bone mineral density on chest radiographs. Arch Osteoporos 2024; 19:15. [PMID: 38472499 DOI: 10.1007/s11657-024-01372-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/26/2023] [Accepted: 02/27/2024] [Indexed: 03/14/2024]
Abstract
We developed a new model for predicting bone mineral density on chest radiographs and externally validated it using images captured at facilities other than the development environment. The model performed well and showed potential for clinical use. PURPOSE In this study, we performed external validation (EV) of a developed deep learning model for predicting bone mineral density (BMD) of femoral neck on chest radiographs to verify the usefulness of this model in clinical practice. METHODS This study included patients who visited any of the collaborating facilities from 2010 to 2020 and underwent chest radiography and dual-energy X-ray absorptiometry (DXA) at the femoral neck in the year before and after their visit. A total of 50,114 chest radiographs were obtained, and BMD was measured using DXA. We developed the model with 47,150 images from 17 facilities and performed EV with 2914 images from three other facilities (EV dataset). We trained the deep learning model via ensemble learning based on chest radiographs, age, and sex to predict BMD using regression. The outcomes were the correlation of the predicted BMD and measured BMD with diagnoses of osteoporosis and osteopenia using the T-score estimated from the predicted BMD. RESULTS The mean BMD was 0.64±0.14 g/cm2 in the EV dataset. The BMD predicted by the model averaged 0.61±0.08 g/cm2, with a correlation coefficient of 0.68 (p<0.01) when compared with the BMD measured using DXA. The accuracy, sensitivity, and specificity of the model were 79.0%, 96.6%, and 34.1% for T-score < -1 and 79.7%, 77.1%, and 80.4% for T-score ≤ -2.5, respectively. CONCLUSION Our model, which was externally validated using data obtained at facilities other than the development environment, predicted BMD of femoral neck on chest radiographs. The model performed well and showed potential for clinical use.
Collapse
|
6
|
DeepmdQCT: A multitask network with domain invariant features and comprehensive attention mechanism for quantitative computer tomography diagnosis of osteoporosis. Comput Biol Med 2024; 170:107916. [PMID: 38237237 DOI: 10.1016/j.compbiomed.2023.107916] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 12/18/2023] [Accepted: 12/29/2023] [Indexed: 02/28/2024]
Abstract
In the medical field, the application of machine learning technology in the automatic diagnosis and monitoring of osteoporosis often faces challenges related to domain adaptation in drug therapy research. The existing neural networks used for the diagnosis of osteoporosis may experience a decrease in model performance when applied to new data domains due to changes in radiation dose and equipment. To address this issue, in this study, we propose a new method for multi domain diagnostic and quantitative computed tomography (QCT) images, called DeepmdQCT. This method adopts a domain invariant feature strategy and integrates a comprehensive attention mechanism to guide the fusion of global and local features, effectively improving the diagnostic performance of multi domain CT images. We conducted experimental evaluations on a self-created OQCT dataset, and the results showed that for dose domain images, the average accuracy reached 91%, while for device domain images, the accuracy reached 90.5%. our method successfully estimated bone density values, with a fit of 0.95 to the gold standard. Our method not only achieved high accuracy in CT images in the dose and equipment fields, but also successfully estimated key bone density values, which is crucial for evaluating the effectiveness of osteoporosis drug treatment. In addition, we validated the effectiveness of our architecture in feature extraction using three publicly available datasets. We also encourage the application of the DeepmdQCT method to a wider range of medical image analysis fields to improve the performance of multi-domain images.
Collapse
|
7
|
Effectiveness of opportunistic osteoporosis screening on chest CT using the DCNN model. BMC Musculoskelet Disord 2024; 25:176. [PMID: 38413868 PMCID: PMC10898023 DOI: 10.1186/s12891-024-07297-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 02/21/2024] [Indexed: 02/29/2024] Open
Abstract
OBJECTIVE To develop and evaluate a deep learning model based on chest CT that achieves favorable performance on opportunistic osteoporosis screening using the lumbar 1 + lumbar 2 vertebral bodies fusion feature images, and explore the feasibility and effectiveness of the model based on the lumbar 1 vertebral body alone. MATERIALS AND METHODS The chest CT images of 1048 health check subjects from January 2021 to June were retrospectively collected as the internal dataset (the segmentation model: 548 for training, 100 for tuning and 400 for test. The classification model: 530 for training, 100 for validation and 418 for test set). The subjects were divided into three categories according to the quantitative CT measurements, namely, normal, osteopenia and osteoporosis. First, a deep learning-based segmentation model was constructed, and the dice similarity coefficient(DSC) was used to compare the consistency between the model and manual labelling. Then, two classification models were established, namely, (i) model 1 (fusion feature construction of lumbar vertebral bodies 1 and 2) and (ii) model 2 (feature construction of lumbar 1 alone). Receiver operating characteristic curves were used to evaluate the diagnostic efficacy of the models, and the Delong test was used to compare the areas under the curve. RESULTS When the number of images in the training set was 300, the DSC value was 0.951 ± 0.030 in the test set. The results showed that the model 1 diagnosing normal, osteopenia and osteoporosis achieved an AUC of 0.990, 0.952 and 0.980; the model 2 diagnosing normal, osteopenia and osteoporosis achieved an AUC of 0.983, 0.940 and 0.978. The Delong test showed that there was no significant difference in area under the curve (AUC) values between the osteopenia group and osteoporosis group (P = 0.210, 0.546), while the AUC value of normal model 2 was higher than that of model 1 (0.990 vs. 0.983, P = 0.033). CONCLUSION This study proposed a chest CT deep learning model that achieves favorable performance on opportunistic osteoporosis screening using the lumbar 1 + lumbar 2 vertebral bodies fusion feature images. We further constructed the comparable model based on the lumbar 1 vertebra alone which can shorten the scan length, reduce the radiation dose received by patients, and reduce the training cost of technologists.
Collapse
|
8
|
Diagnostic Accuracy of Deep Learning for the Prediction of Osteoporosis Using Plain X-rays: A Systematic Review and Meta-Analysis. Diagnostics (Basel) 2024; 14:207. [PMID: 38248083 PMCID: PMC10814351 DOI: 10.3390/diagnostics14020207] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 01/04/2024] [Accepted: 01/16/2024] [Indexed: 01/23/2024] Open
Abstract
(1) Background: This meta-analysis assessed the diagnostic accuracy of deep learning model-based osteoporosis prediction using plain X-ray images. (2) Methods: We searched PubMed, Web of Science, SCOPUS, and Google Scholar from no set beginning date to 28 February 2023, for eligible studies that applied deep learning methods for diagnosing osteoporosis using X-ray images. The quality of studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 criteria. The area under the receiver operating characteristic curve (AUROC) was used to quantify the predictive performance. Subgroup, meta-regression, and sensitivity analyses were performed to identify the potential sources of study heterogeneity. (3) Results: Six studies were included; the pooled AUROC, sensitivity, and specificity were 0.88 (95% confidence interval [CI] 0.85-0.91), 0.81 (95% CI 0.78-0.84), and 0.87 (95% CI 0.81-0.92), respectively, indicating good performance. Moderate heterogeneity was observed. Mega-regression and subgroup analyses were not performed due to the limited number of studies included. (4) Conclusion: Deep learning methods effectively extract bone density information from plain radiographs, highlighting their potential for opportunistic screening. Nevertheless, additional prospective multicenter studies involving diverse patient populations are required to confirm the applicability of this novel technique.
Collapse
|
9
|
Artificial Intelligence-enabled Chest X-ray Classifies Osteoporosis and Identifies Mortality Risk. J Med Syst 2024; 48:12. [PMID: 38217829 DOI: 10.1007/s10916-023-02030-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Accepted: 12/26/2023] [Indexed: 01/15/2024]
Abstract
A deep learning model was developed to identify osteoporosis from chest X-ray (CXR) features with high accuracy in internal and external validation. It has significant prognostic implications, identifying individuals at higher risk of all-cause mortality. This Artificial Intelligence (AI)-enabled CXR strategy may function as an early detection screening tool for osteoporosis. The aim of this study was to develop a deep learning model (DLM) to identify osteoporosis via CXR features and investigate the performance and clinical implications. This study collected 48,353 CXRs with the corresponding T score according to Dual energy X-ray Absorptiometry (DXA) from the academic medical center. Among these, 35,633 CXRs were used to identify CXR- Osteoporosis (CXR-OP). Another 12,720 CXRs were used to validate the performance, which was evaluated by the area under the receiver operating characteristic curve (AUC). Furthermore, CXR-OP was tested to assess the long-term risks of mortality, which were evaluated by Kaplan‒Meier survival analysis and the Cox proportional hazards model. The DLM utilizing CXR achieved AUCs of 0.930 and 0.892 during internal and external validation, respectively. The group that underwent DXA with CXR-OP had a higher risk of all-cause mortality (hazard ratio [HR] 2.59, 95% CI: 1.83-3.67), and those classified as CXR-OP in the group without DXA also had higher all-cause mortality (HR: 1.67, 95% CI: 1.61-1.72) in the internal validation set. The external validation set produced similar results. Our DLM uses CXRs for early detection of osteoporosis, aiding physicians to identify those at risk. It has significant prognostic implications, improving life quality and reducing mortality. AI-enabled CXR strategy may serve as a screening tool.
Collapse
|
10
|
Development and Validation of a Feature-Based Broad-Learning System for Opportunistic Osteoporosis Screening Using Lumbar Spine Radiographs. Acad Radiol 2024; 31:84-92. [PMID: 37495426 DOI: 10.1016/j.acra.2023.07.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Revised: 07/04/2023] [Accepted: 07/05/2023] [Indexed: 07/28/2023]
Abstract
RATIONALE AND OBJECTIVES Osteoporosis is primarily diagnosed using dual-energy X-ray absorptiometry (DXA); yet, DXA is significantly underutilized, causing osteoporosis, an underdiagnosed condition. We aimed to provide an opportunistic approach to screen for osteoporosis using artificial intelligence based on lumbar spine X-ray radiographs. MATERIALS AND METHODS In this institutional review board-approved retrospective study, female patients aged ≥50 years who received both X-ray scans and DXA of the lumbar vertebrae, in three centers, were included. A total of 1180 cases were used for training and 145 cases were used for testing. We proposed a novel broad-learning system (BLS) and then compared the performance of BLS models using radiomic features and deep features as a source of input. The deep features were extracted using ResNet18 and VGG11, respectively. The diagnostic performances of these BLS models were evaluated with the area under the curve (AUC), sensitivity, and specificity. RESULTS The incidence rate of osteoporosis in the training and test sets was 35.9% and 37.9%, respectively. The radiomic feature-based BLS model achieved higher testing AUC (0.802 vs. 0.654 vs. 0.632, both P = .002), sensitivity (78.2% vs. 56.4% vs. 50.9%), and specificity (82.2% vs. 74,4% vs. 75.6%) than the two deep feature-based BLS models. CONCLUSION Our proposed radiomic feature-based BLS model has the potential to expand osteoporosis screening to a broader population by identifying osteoporosis on lumbar spine X-ray radiographs.
Collapse
|
11
|
Chest radiography as a biomarker of ageing: artificial intelligence-based, multi-institutional model development and validation in Japan. THE LANCET. HEALTHY LONGEVITY 2023; 4:e478-e486. [PMID: 37597530 DOI: 10.1016/s2666-7568(23)00133-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 07/04/2023] [Accepted: 07/05/2023] [Indexed: 08/21/2023] Open
Abstract
BACKGROUND Chest radiographs are widely available and cost-effective; however, their usefulness as a biomarker of ageing using multi-institutional data remains underexplored. The aim of this study was to develop a biomarker of ageing from chest radiography and examine the correlation between the biomarker and diseases. METHODS In this retrospective, multi-institutional study, we trained, tuned, and externally tested an artificial intelligence (AI) model to estimate the age of healthy individuals using chest radiographs as a biomarker. For the biomarker modelling phase of the study, we used healthy chest radiographs consecutively collected between May 22, 2008, and Dec 28, 2021, from three institutions in Japan. Data from two institutions were used for training, tuning, and internal testing, and data from the third institution were used for external testing. To evaluate the performance of the AI model in estimating ages, we calculated the correlation coefficient, mean square error, root mean square error, and mean absolute error. The correlation investigation phase of the study included chest radiographs from individuals with a known disease that were consecutively collected between Jan 1, 2018, and Dec 31, 2021, from an additional two institutions in Japan. We investigated the odds ratios (ORs) for various diseases given the difference between the AI-estimated age and chronological age (ie, the difference-age). FINDINGS We included 101 296 chest radiographs from 70 248 participants across five institutions. In the biomarker modelling phase, the external test dataset from 3467 healthy participants included 8046 radiographs. Between the AI-estimated age and chronological age, the correlation coefficient was 0·95 (99% CI 0·95-0·95), the mean square error was 15·0 years (99% CI 14·0-15·0), the root mean square error was 3·8 years (99% CI 3·8-3·9), and the mean absolute error was 3·0 years (99% CI 3·0-3·1). In the correlation investigation phase, the external test datasets from 34 197 participants with a known disease included 34 197 radiographs. The ORs for difference-age were as follows: 1·04 (99% CI 1·04-1·05) for hypertension; 1·02 (1·01-1·03) for hyperuricaemia; 1·05 (1·03-1·06) for chronic obstructive pulmonary disease; 1·08 (1·06-1·09) for interstitial lung disease; 1·05 (1·03-1·06) for chronic renal failure; 1·04 (1·03-1·06) for atrial fibrillation; 1·03 (1·02-1·04) for osteoporosis; and 1·05 (1·03-1·06) for liver cirrhosis. INTERPRETATION The AI-estimated age using chest radiographs showed a strong correlation with chronological age in the healthy cohorts. Furthermore, in cohorts of individuals with known diseases, the difference between estimated age and chronological age correlated with various chronic diseases. The use of this biomarker might pave the way for enhanced risk stratification methodologies, individualised therapeutic interventions, and innovative early diagnostic and preventive approaches towards age-associated pathologies. FUNDING None. TRANSLATION For the Japanese translation of the abstract see Supplementary Materials section.
Collapse
|
12
|
Using Artificial Intelligence to Diagnose Osteoporotic Vertebral Fractures on Plain Radiographs. J Bone Miner Res 2023; 38:1278-1287. [PMID: 37449775 DOI: 10.1002/jbmr.4879] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Revised: 06/18/2023] [Accepted: 07/06/2023] [Indexed: 07/18/2023]
Abstract
Osteoporotic vertebral fracture (OVF) is a risk factor for morbidity and mortality in elderly population, and accurate diagnosis is important for improving treatment outcomes. OVF diagnosis suffers from high misdiagnosis and underdiagnosis rates, as well as high workload. Deep learning methods applied to plain radiographs, a simple, fast, and inexpensive examination, might solve this problem. We developed and validated a deep-learning-based vertebral fracture diagnostic system using area loss ratio, which assisted a multitasking network to perform skeletal position detection and segmentation and identify and grade vertebral fractures. As the training set and internal validation set, we used 11,397 plain radiographs from six community centers in Shanghai. For the external validation set, 1276 participants were recruited from the outpatient clinic of the Shanghai Sixth People's Hospital (1276 plain radiographs). Radiologists performed all X-ray images and used the Genant semiquantitative tool for fracture diagnosis and grading as the ground truth data. Accuracy, sensitivity, specificity, positive predictive value, and negative predictive value were used to evaluate diagnostic performance. The AI_OVF_SH system demonstrated high accuracy and computational speed in skeletal position detection and segmentation. In the internal validation set, the accuracy, sensitivity, and specificity with the AI_OVF_SH model were 97.41%, 84.08%, and 97.25%, respectively, for all fractures. The sensitivity and specificity for moderate fractures were 88.55% and 99.74%, respectively, and for severe fractures, they were 92.30% and 99.92%. In the external validation set, the accuracy, sensitivity, and specificity for all fractures were 96.85%, 83.35%, and 94.70%, respectively. For moderate fractures, the sensitivity and specificity were 85.61% and 99.85%, respectively, and 93.46% and 99.92% for severe fractures. Therefore, the AI_OVF_SH system is an efficient tool to assist radiologists and clinicians to improve the diagnosing of vertebral fractures. © 2023 The Authors. Journal of Bone and Mineral Research published by Wiley Periodicals LLC on behalf of American Society for Bone and Mineral Research (ASBMR).
Collapse
|
13
|
Deep learning-based detection of patients with bone metastasis from Japanese radiology reports. Jpn J Radiol 2023; 41:900-908. [PMID: 36988827 DOI: 10.1007/s11604-023-01413-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Accepted: 03/07/2023] [Indexed: 03/30/2023]
Abstract
PURPOSE Deep learning (DL) is a state-of-the-art technique for developing artificial intelligence in various domains and it improves the performance of natural language processing (NLP). Therefore, we aimed to develop a DL-based NLP model that classifies the status of bone metastasis (BM) in radiology reports to detect patients with BM. MATERIALS AND METHODS The DL-based NLP model was developed by training long short-term memory using 1,749 free-text radiology reports written in Japanese. We adopted five-fold cross-validation and used 200 reports for testing the five models. The accuracy, sensitivity, specificity, precision, and area under the receiver operating characteristics curve (AUROC) were used for the model evaluation. RESULTS The developed model demonstrated classification performance with mean ± standard deviation of 0.912 ± 0.012, 0.924 ± 0.029, 0.901 ± 0.014, 0.898 ± 0.012, and 0.968 ± 0.004 for accuracy, sensitivity, specificity, precision, and AUROC, respectively. CONCLUSION The proposed DL-based NLP model may help in the early and efficient detection of patients with BM.
Collapse
|
14
|
End to End Multitask Joint Learning Model for Osteoporosis Classification in CT Images. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2023; 2023:3018320. [PMID: 36970245 PMCID: PMC10036193 DOI: 10.1155/2023/3018320] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/10/2022] [Revised: 02/23/2023] [Accepted: 03/01/2023] [Indexed: 03/18/2023]
Abstract
Osteoporosis is a significant global health concern that can be difficult to detect early due to a lack of symptoms. At present, the examination of osteoporosis depends mainly on methods containing dual-energy X-ray, quantitative CT, etc., which are high costs in terms of equipment and human time. Therefore, a more efficient and economical method is urgently needed for diagnosing osteoporosis. With the development of deep learning, automatic diagnosis models for various diseases have been proposed. However, the establishment of these models generally requires images with only lesion areas, and annotating the lesion areas is time-consuming. To address this challenge, we propose a joint learning framework for osteoporosis diagnosis that combines localization, segmentation, and classification to enhance diagnostic accuracy. Our method includes a boundary heat map regression branch for thinning segmentation and a gated convolution module for adjusting context features in the classification module. We also integrate segmentation and classification features and propose a feature fusion module to adjust the weight of different levels of vertebrae. We trained our model on a self-built dataset and achieved an overall accuracy rate of 93.3% for the three label categories (normal, osteopenia, and osteoporosis) in the testing datasets. The area under the curve for the normal category is 0.973; for the osteopenia category, it is 0.965; and for the osteoporosis category, it is 0.985. Our method provides a promising alternative for the diagnosis of osteoporosis at present.
Collapse
|
15
|
Chest X-ray-based opportunistic screening of sarcopenia using deep learning. J Cachexia Sarcopenia Muscle 2023; 14:418-428. [PMID: 36457204 PMCID: PMC9891971 DOI: 10.1002/jcsm.13144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/19/2022] [Revised: 10/26/2022] [Accepted: 10/31/2022] [Indexed: 12/05/2022] Open
Abstract
BACKGROUND Early detection and management of sarcopenia is of clinical importance. We aimed to develop a chest X-ray-based deep learning model to predict presence of sarcopenia. METHODS Data of participants who visited osteoporosis clinic at Severance Hospital, Seoul, South Korea, between January 2020 and June 2021 were used as derivation cohort as split to train, validation and test set (65:15:20). A community-based older adults cohort (KURE) was used as external test set. Sarcopenia was defined based on Asian Working Group 2019 guideline. A deep learning model was trained to predict appendicular lean mass (ALM), handgrip strength (HGS) and chair rise test performance from chest X-ray images; then the machine learning model (SARC-CXR score) was built using the age, sex, body mass index and chest X-ray predicted muscle parameters along with estimation uncertainty values. RESULTS Mean age of the derivation cohort (n = 926; women n = 700, 76%; sarcopenia n = 141, 15%) and the external test (n = 149; women n = 95, 64%; sarcopenia n = 18, 12%) cohort was 61.4 and 71.6 years, respectively. In the internal test set (a hold-out set, n = 189, from the derivation cohort) and the external test set (n = 149), the concordance correlation coefficient for ALM prediction was 0.80 and 0.76, with an average difference of 0.18 ± 2.71 and 0.21 ± 2.28, respectively. Gradient-weight class activation mapping for deep neural network models to predict ALM and HGS commonly showed highly weight pixel values at bilateral lung fields and part of the cardiac contour. SARC-CXR score showed good discriminatory performance for sarcopenia in both internal test set [area under the receiver-operating characteristics curve (AUROC) 0.813, area under the precision-recall curve (AUPRC) 0.380, sensitivity 0.844, specificity 0.739, F1-score 0.540] and external test set (AUROC 0.780, AUPRC 0.440, sensitivity 0.611, specificity 0.855, F1-score 0.458). Among SARC-CXR model features, predicted low ALM from chest X-ray was the most important predictor of sarcopenia based on SHapley Additive exPlanations values. Higher estimation uncertainty of HGS contributed to elevate the predicted risk of sarcopenia. In internal test set, SARC-CXR score showed better discriminatory performance than SARC-F score (AUROC 0.813 vs. 0.691, P = 0.029). CONCLUSIONS Chest X-ray-based deep leaning model improved detection of sarcopenia, which merits further investigation.
Collapse
|
16
|
Interpretable Deep-Learning Approaches for Osteoporosis Risk Screening and Individualized Feature Analysis Using Large Population-Based Data: Model Development and Performance Evaluation. J Med Internet Res 2023; 25:e40179. [PMID: 36482780 PMCID: PMC9883743 DOI: 10.2196/40179] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 08/16/2022] [Accepted: 11/30/2022] [Indexed: 12/13/2022] Open
Abstract
BACKGROUND Osteoporosis is one of the diseases that requires early screening and detection for its management. Common clinical tools and machine-learning (ML) models for screening osteoporosis have been developed, but they show limitations such as low accuracy. Moreover, these methods are confined to limited risk factors and lack individualized explanation. OBJECTIVE The aim of this study was to develop an interpretable deep-learning (DL) model for osteoporosis risk screening with clinical features. Clinical interpretation with individual explanations of feature contributions is provided using an explainable artificial intelligence (XAI) technique. METHODS We used two separate data sets: the National Health and Nutrition Examination Survey data sets from the United States (NHANES) and South Korea (KNHANES) with 8274 and 8680 respondents, respectively. The study population was classified according to the T-score of bone mineral density at the femoral neck or total femur. A DL model for osteoporosis diagnosis was trained on the data sets and significant risk factors were investigated with local interpretable model-agnostic explanations (LIME). The performance of the DL model was compared with that of ML models and conventional clinical tools. Additionally, contribution ranking of risk factors and individualized explanation of feature contribution were examined. RESULTS Our DL model showed area under the curve (AUC) values of 0.851 (95% CI 0.844-0.858) and 0.922 (95% CI 0.916-0.928) for the femoral neck and total femur bone mineral density, respectively, using the NHANES data set. The corresponding AUC values for the KNHANES data set were 0.827 (95% CI 0.821-0.833) and 0.912 (95% CI 0.898-0.927), respectively. Through the LIME method, significant features were induced, and each feature's integrated contribution and interpretation for individual risk were determined. CONCLUSIONS The developed DL model significantly outperforms conventional ML models and clinical tools. Our XAI model produces high-ranked features along with the integrated contributions of each feature, which facilitates the interpretation of individual risk. In summary, our interpretable model for osteoporosis risk screening outperformed state-of-the-art methods.
Collapse
|
17
|
Deep Learning for Bone Mineral Density and T-Score Prediction from Chest X-rays: A Multicenter Study. Biomedicines 2022; 10:biomedicines10092323. [PMID: 36140424 PMCID: PMC9496220 DOI: 10.3390/biomedicines10092323] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 09/13/2022] [Accepted: 09/15/2022] [Indexed: 12/23/2022] Open
Abstract
Although the number of patients with osteoporosis is increasing worldwide, diagnosis and treatment are presently inadequate. In this study, we developed a deep learning model to predict bone mineral density (BMD) and T-score from chest X-rays, which are one of the most common, easily accessible, and low-cost medical imaging examination methods. The dataset used in this study contained patients who underwent dual-energy X-ray absorptiometry (DXA) and chest radiography at six hospitals between 2010 and 2021. We trained the deep learning model through ensemble learning of chest X-rays, age, and sex to predict BMD using regression and T-score for multiclass classification. We assessed the following two metrics to evaluate the performance of the deep learning model: (1) correlation between the predicted and true BMDs and (2) consistency in the T-score between the predicted class and true class. The correlation coefficients for BMD prediction were hip = 0.75 and lumbar spine = 0.63. The areas under the curves for the T-score predictions of normal, osteopenia, and osteoporosis diagnoses were 0.89, 0.70, and 0.84, respectively. These results suggest that the proposed deep learning model may be suitable for screening patients with osteoporosis by predicting BMD and T-score from chest X-rays.
Collapse
|
18
|
Imaging of Metabolic Bone Diseases: The Spine View, Part II. Semin Musculoskelet Radiol 2022; 26:491-500. [PMID: 36103890 DOI: 10.1055/s-0042-1754341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Abstract
Metabolic bone diseases comprise a wide spectrum. Osteoporosis, the most frequent, characteristically involves the spine, with a high impact on health care systems and on the morbidity of patients due to the occurrence of vertebral fractures (VFs).Part II of this review completes an overview of state-of-the-art techniques on the imaging of metabolic bone diseases of the spine, focusing on specific populations and future perspectives. We address the relevance of diagnosis and current status on VF assessment and quantification. We also analyze the diagnostic techniques in the pediatric population and then review the assessment of body composition around the spine and its potential application. We conclude with a discussion of the future of osteoporosis screening, through opportunistic diagnosis and the application of artificial intelligence.
Collapse
|