Opportunistic osteoporosis screening in multi-detector CT images via local classification of textures

CT image-based biomarkers for opportunistic screening of osteoporotic fractures: a systematic review and meta-analysis

The use of opportunistic computed tomography (CT) image-based biomarkers may be a low-cost strategy for screening older individuals at high risk for osteoporotic fractures and populations that are not sufficiently targeted. This review aimed to assess the discriminative ability of image-based biomarkers derived from existing clinical routine CT scans for hip, vertebral, and major osteoporotic fracture prediction. A systematic search in PubMed MEDLINE, Embase, Cochrane, and Web of Science was conducted from the earliest indexing date until July 2023. The evaluation of study quality was carried out using a modified Quality Assessment Tool for Diagnostic Accuracy Studies (QUADAS-2) checklist. The primary outcome of interest was the area under the curve (AUC) and its corresponding 95% confidence intervals (CIs) obtained for four main categories of biomarkers: areal bone mineral density (BMD), image attenuation, volumetric BMD, and finite element (FE)-derived biomarkers. The meta-analyses were performed using random effects models. Sixty-one studies were included in this review, among which 35 were synthesized in a meta-analysis and the remaining articles were qualitatively synthesized. In comparison to the pooled AUC of areal BMD (0.73 [95% CI 0.71-0.75]), the pooled AUC values for predicting osteoporotic fractures for FE-derived parameters (0.77 [95% CI 0.72-0.81]; p < 0.01) and volumetric BMD (0.76 [95% CI 0.71-0.81]; p < 0.01) were significantly higher, but there was no significant difference with the pooled AUC for image attenuation (0.73 [95% CI 0.66-0.79]; p = 0.93). Compared to areal BMD, volumetric BMD and FE-derived parameters may provide a significant improvement in the discrimination of osteoporotic fractures using opportunistic CT assessments.

Artificial intelligence in endocrinology: a comprehensive review

BACKGROUND AND AIM

Artificial intelligence (AI) has emerged as a promising technology in the field of endocrinology, offering significant potential to revolutionize the diagnosis, treatment, and management of endocrine disorders. This comprehensive review aims to provide a concise overview of the current landscape of AI applications in endocrinology and metabolism, focusing on the fundamental concepts of AI, including machine learning algorithms and deep learning models.

METHODS

The review explores various areas of endocrinology where AI has demonstrated its value, encompassing screening and diagnosis, risk prediction, translational research, and "pre-emptive medicine". Within each domain, relevant studies are discussed, offering insights into the methodology and main findings of AI in the treatment of different pathologies, such as diabetes mellitus and related disorders, thyroid disorders, adrenal tumors, and bone and mineral disorders.

RESULTS

Collectively, these studies show the valuable contributions of AI in optimizing healthcare outcomes and unveiling new understandings of the intricate mechanisms underlying endocrine disorders. Furthermore, AI-driven approaches facilitate the development of precision medicine strategies, enabling tailored interventions for patients based on their individual characteristics and needs.

CONCLUSIONS

By embracing AI in endocrinology, a future can be envisioned where medical professionals and AI systems synergistically collaborate, ultimately enhancing the lives of individuals affected by endocrine disorders.

Hybrid transformer convolutional neural network-based radiomics models for osteoporosis screening in routine CT

OBJECTIVE

Early diagnosis of osteoporosis is crucial to prevent osteoporotic vertebral fracture and complications of spine surgery. We aimed to conduct a hybrid transformer convolutional neural network (HTCNN)-based radiomics model for osteoporosis screening in routine CT.

METHODS

To investigate the HTCNN algorithm for vertebrae and trabecular segmentation, 92 training subjects and 45 test subjects were employed. Furthermore, we included 283 vertebral bodies and randomly divided them into the training cohort (n = 204) and test cohort (n = 79) for radiomics analysis. Area receiver operating characteristic curves (AUCs) and decision curve analysis (DCA) were applied to compare the performance and clinical value between radiomics models and Hounsfield Unit (HU) values to detect dual-energy X-ray absorptiometry (DXA) based osteoporosis.

RESULTS

HTCNN algorithm revealed high precision for the segmentation of the vertebral body and trabecular compartment. In test sets, the mean dice scores reach 0.968 and 0.961. 12 features from the trabecular compartment and 15 features from the entire vertebral body were used to calculate the radiomics score (rad score). Compared with HU values and trabecular rad-score, the vertebrae rad-score suggested the best efficacy for osteoporosis and non-osteoporosis discrimination (training group: AUC = 0.95, 95%CI 0.91-0.99; test group: AUC = 0.97, 95%CI 0.93-1.00) and the differences were significant in test group according to the DeLong test (p < 0.05).

CONCLUSIONS

This retrospective study demonstrated the superiority of the HTCNN-based vertebrae radiomics model for osteoporosis discrimination in routine CT.

Machine Learning and Deep Learning in Spinal Injury: A Narrative Review of Algorithms in Diagnosis and Prognosis

Spinal injuries, including cervical and thoracolumbar fractures, continue to be a major public health concern. Recent advancements in machine learning and deep learning technologies offer exciting prospects for improving both diagnostic and prognostic approaches in spinal injury care. This narrative review systematically explores the practical utility of these computational methods, with a focus on their application in imaging techniques such as computed tomography (CT) and magnetic resonance imaging (MRI), as well as in structured clinical data. Of the 39 studies included, 34 were focused on diagnostic applications, chiefly using deep learning to carry out tasks like vertebral fracture identification, differentiation between benign and malignant fractures, and AO fracture classification. The remaining five were prognostic, using machine learning to analyze parameters for predicting outcomes such as vertebral collapse and future fracture risk. This review highlights the potential benefit of machine learning and deep learning in spinal injury care, especially their roles in enhancing diagnostic capabilities, detailed fracture characterization, risk assessments, and individualized treatment planning.

Channel-Boosted and Transfer Learning Convolutional Neural Network-Based Osteoporosis Detection from CT Scan, Dual X-Ray, and X-Ray Images

Osteoporosis is a word used to describe a condition in which bone density has been diminished as a result of inadequate bone tissue development to counteract the elimination of old bone tissue. Osteoporosis diagnosis is made possible by the use of medical imaging technologies such as CT scans, dual X-ray, and X-ray images. In practice, there are various osteoporosis diagnostic methods that may be performed with a single imaging modality to aid in the diagnosis of the disease. The proposed study is to develop a framework, that is, to aid in the diagnosis of osteoporosis which agrees to all of these CT scans, X-ray, and dual X-ray imaging modalities. The framework will be implemented in the near future. The proposed work, CBTCNNOD, is the integration of 3 functional modules. The functional modules are a bilinear filter, grey-level zone length matrix, and CB-CNN. It is constructed in a manner that can provide crisp osteoporosis diagnostic reports based on the images that are fed into the system. All 3 modules work together to improve the performance of the proposed approach, CBTCNNOD, in terms of accuracy by 10.38%, 10.16%, 7.86%, and 14.32%; precision by 11.09%, 9.08%, 10.01%, and 16.51%; sensitivity by 9.77%, 10.74%, 6.20%, and 12.78%; and specificity by 11.01%, 9.52%, 9.5%, and 15.84%, while requiring less processing time of 33.52%, 17.79%, 23.34%, and 10.86%, when compared to the existing techniques of RCETA, BMCOFA, BACBCT, and XSFCV, respectively.

External validation of a convolutional neural network algorithm for opportunistically detecting vertebral fractures in routine CT scans

The Convolutional Neural Network algorithm achieved a sensitivity of 94% and specificity of 93% in identifying scans with vertebral fractures (VFs). The external validation results suggest that the algorithm provides an opportunity to aid radiologists with the early identification of VFs in routine CT scans of abdomen and chest.

PURPOSE

To evaluate the performance of a previously trained Convolutional Neural Network (CNN) model to automatically detect vertebral fractures (VFs) in CT scans in an external validation cohort.

METHODS

Two Chinese studies and clinical data were used to retrospectively select CT scans of the chest, abdomen and thoracolumbar spine in men and women aged ≥50 years. The CT scans were assessed using the semiquantitative (SQ) Genant classification for prevalent VFs in a process blinded to clinical information. The performance of the CNN model was evaluated against reference standard readings by the area under the receiver operating characteristics curve (AUROC), accuracy, Cohen's kappa, sensitivity, and specificity.

RESULTS

A total of 4,810 subjects were included, with a median age of 62 years (IQR 56-67), of which 2,654 (55.2%) were females. The scans were acquired between January 2013 and January 2019 on 16 different CT scanners from three different manufacturers. 2,773 (57.7%) were abdominal CTs. A total of 628 scans (13.1%) had ≥1 VF (grade 2-3), representing 899 fractured vertebrae out of a total of 48,584 (1.9%) visualized vertebral bodies. The CNN's performance in identifying scans with ≥1 moderate or severe fractures achieved an AUROC of 0.94 (95% CI: 0.93-0.95), accuracy of 93% (95% CI: 93%-94%), kappa of 0.75 (95% CI: 0.72-0.77), a sensitivity of 94% (95% CI: 92-96%) and a specificity of 93% (95% CI: 93-94%).

CONCLUSION

The algorithm demonstrated excellent performance in the identification of vertebral fractures in a cohort of chest and abdominal CT scans of Chinese patients ≥50 years.

Towards Improved Identification of Vertebral Fractures in Routine Computed Tomography (CT) Scans: Development and External Validation of a Machine Learning Algorithm

Vertebral fractures (VFs) are the hallmark of osteoporosis, being one of the most frequent types of fragility fracture and an early sign of the disease. They are associated with significant morbidity and mortality. VFs are incidentally found in one out of five imaging studies, however, more than half of the VFs are not identified nor reported in patient computed tomography (CT) scans. Our study aimed to develop a machine learning algorithm to identify VFs in abdominal/chest CT scans and evaluate its performance. We acquired two independent data sets of routine abdominal/chest CT scans of patients aged 50 years or older: a training set of 1011 scans from a non-interventional, prospective proof-of-concept study at the Universitair Ziekenhuis (UZ) Brussel and a validation set of 2000 subjects from an observational cohort study at the Hospital of Holbaek. Both data sets were externally reevaluated to identify reference standard VF readings using the Genant semiquantitative (SQ) grading. Four independent models have been trained in a cross-validation experiment using the training set and an ensemble of four models has been applied to the external validation set. The validation set contained 15.3% scans with one or more VF (SQ2-3), whereas 663 of 24,930 evaluable vertebrae (2.7%) were fractured (SQ2-3) as per reference standard readings. Comparison of the ensemble model with the reference standard readings in identifying subjects with one or more moderate or severe VF resulted in an area under the receiver operating characteristic curve (AUROC) of 0.88 (95% confidence interval [CI], 0.85-0.90), accuracy of 0.92 (95% CI, 0.91-0.93), kappa of 0.72 (95% CI, 0.67-0.76), sensitivity of 0.81 (95% CI, 0.76-0.85), and specificity of 0.95 (95% CI, 0.93-0.96). We demonstrated that a machine learning algorithm trained for VF detection achieved strong performance on an external validation set. It has the potential to support healthcare professionals with the early identification of VFs and prevention of future fragility fractures. © 2023 UCB S.A. and The Authors. Journal of Bone and Mineral Research published by Wiley Periodicals LLC on behalf of American Society for Bone and Mineral Research (ASBMR).

Differentiation of benign and malignant vertebral fractures using a convolutional neural network to extract CT-based texture features

PURPOSE

To assess the diagnostic performance of three-dimensional (3D) CT-based texture features (TFs) using a convolutional neural network (CNN)-based framework to differentiate benign (osteoporotic) and malignant vertebral fractures (VFs).

METHODS

A total of 409 patients who underwent routine thoracolumbar spine CT at two institutions were included. VFs were categorized as benign or malignant using either biopsy or imaging follow-up of at least three months as standard of reference. Automated detection, labelling, and segmentation of the vertebrae were performed using a CNN-based framework ( https://anduin.bonescreen.de ). Eight TFs were extracted: Varianceglobal, Skewnessglobal, energy, entropy, short-run emphasis (SRE), long-run emphasis (LRE), run-length non-uniformity (RLN), and run percentage (RP). Multivariate regression models adjusted for age and sex were used to compare TFs between benign and malignant VFs.

RESULTS

Skewnessglobal showed a significant difference between the two groups when analyzing fractured vertebrae from T1 to L6 (benign fracture group: 0.70 [0.64-0.76]; malignant fracture group: 0.59 [0.56-0.63]; and p = 0.017), suggesting a higher skewness in benign VFs compared to malignant VFs.

CONCLUSION

Three-dimensional CT-based global TF skewness assessed using a CNN-based framework showed significant difference between benign and malignant thoracolumbar VFs and may therefore contribute to the clinical diagnostic work-up of patients with VFs.

Artificial Intelligence Applications for Osteoporosis Classification Using Computed Tomography

Osteoporosis, marked by low bone mineral density (BMD) and a high fracture risk, is a major health issue. Recent progress in medical imaging, especially CT scans, offers new ways of diagnosing and assessing osteoporosis. This review examines the use of AI analysis of CT scans to stratify BMD and diagnose osteoporosis. By summarizing the relevant studies, we aimed to assess the effectiveness, constraints, and potential impact of AI-based osteoporosis classification (severity) via CT. A systematic search of electronic databases (PubMed, MEDLINE, Web of Science, ClinicalTrials.gov) was conducted according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A total of 39 articles were retrieved from the databases, and the key findings were compiled and summarized, including the regions analyzed, the type of CT imaging, and their efficacy in predicting BMD compared with conventional DXA studies. Important considerations and limitations are also discussed. The overall reported accuracy, sensitivity, and specificity of AI in classifying osteoporosis using CT images ranged from 61.8% to 99.4%, 41.0% to 100.0%, and 31.0% to 100.0% respectively, with areas under the curve (AUCs) ranging from 0.582 to 0.994. While additional research is necessary to validate the clinical efficacy and reproducibility of these AI tools before incorporating them into routine clinical practice, these studies demonstrate the promising potential of using CT to opportunistically predict and classify osteoporosis without the need for DEXA.

A diagnostic approach integrated multimodal radiomics with machine learning models based on lumbar spine CT and X-ray for osteoporosis

INTRODUCTION

The aim of this analysis is to construct a combined model that integrates radiomics, clinical risk factors, and machine learning algorithms to diagnose osteoporosis in patients and explore its potential in clinical applications.

MATERIALS AND METHODS

A retrospective analysis was conducted on 616 lumbar spine. Radiomics features were extracted from the computed tomography (CT) scans and anteroposterior and lateral X-ray images of the lumbar spine. Logistic regression (LR), support vector machine (SVM), and random forest (RF) algorithms were used to construct radiomics models. The receiver operating characteristic curve (ROC) was employed to select the best-performing model. Clinical risk factors were identified through univariate logistic regression analysis (ULRA) and multivariate logistic regression analysis (MLRA) and utilized to develop a clinical model. A combined model was then created by merging radiomics and clinical risk factors. The performance of the models was evaluated using ROC curve analysis, and the clinical value of the models was assessed using decision curve analysis (DCA).

RESULTS

A total of 4858 radiomics features were extracted. Among the radiomics models, the SVM model demonstrated the optimal diagnostic capabilities and accuracy, with an area under the curve (AUC) of 0.958 (0.9405-0.9762) in the training cohort and 0.907 (0.8648-0.9492) in the test cohort. Furthermore, the combined model exhibited an AUC of 0.959 (0.9412-0.9763) in the training cohort and 0.910 (0.8690-0.9506) in the test cohort.

CONCLUSION

The combined model displayed outstanding ability in diagnosing osteoporosis, providing a safe and efficient method for clinical decision-making.

Long-term reproducibility of opportunistically assessed vertebral bone mineral density and texture features in routine clinical multi-detector computed tomography using an automated segmentation framework

Background

To investigate reproducibility of texture features and volumetric bone mineral density (vBMD) extracted from trabecular bone in the thoracolumbar spine in routine clinical multi-detector computed tomography (MDCT) data in a single scanner environment.

Methods

Patients who underwent two routine clinical thoraco-abdominal MDCT exams at a single scanner with a time interval of 6 to 26 months (n=203, 131 males; time interval mean, 13 months; median, 12 months) were included in this observational study. Exclusion criteria were metabolic and hematological disorders, bone metastases, use of bone-active medications, and history of osteoporotic vertebral fractures (VFs) or prior diagnosis of osteoporosis. A convolutional neural network (CNN)-based framework was used for automated spine labeling and segmentation (T5-L5), asynchronous Hounsfield unit (HU)-to-BMD calibration, and correction for the intravenous contrast medium phase. Vertebral vBMD and six texture features [varianceglobal, entropy, short-run emphasis (SRE), long-run emphasis (LRE), run-length non-uniformity (RLN), and run percentage (RP)] were extracted for mid- (T5-T8) and lower thoracic (T9-T12), and lumbar vertebrae (L1-L5), respectively. Relative annual changes were calculated in texture features and vBMD for each vertebral level and sorted by sex, and changes were checked for statistical significance (P<0.05) using paired t-tests. Root mean square coefficient of variation (RMSCV) and root mean square error (RMSE) were calculated as measures of variability.

Results

SRE, LRE, RLN, and RP exhibited substantial reproducibility with RMSCV-values below 2%, for both sexes and at all spine levels, while vBMD was less reproducible (RMSCV =11.9-16.2%). Entropy showed highest variability (RMSCV =4.34-7.69%) due to statistically significant increases [range, mean ± standard deviation: (4.40±5.78)% to (8.36±8.66)%, P<0.001]. RMSCV of varianceglobal ranged from 1.60% to 3.03%.

Conclusions

Opportunistic assessment of texture features in a single scanner environment using the presented CNN-based framework yields substantial reproducibility, outperforming vBMD reproducibility. Lowest scan-rescan variability was found for higher-order texture features. Further studies are warranted to determine, whether microarchitectural changes to the trabecular bone may be assessed through texture features.

Opportunistic Computed Tomography Screening for Osteoporosis and Fracture

Osteoporosis is underdiagnosed and undertreated, leading to loss of treatment for the patient and high costs for the health care system. Routine thoracic and/or abdominal computed tomography (CT) performed for other indications can screen opportunistically for osteoporosis with no extra cost, time, or irradiation. Various methods can quantify fracture risk on opportunistic clinical CT: vertebral Hounsfield unit bone mineral density (BMD), usually of L1; BMD measurement with asynchronous or internal calibration; quantitative CT; bone texture assessment; and finite element analysis. Screening for osteoporosis and vertebral fractures on opportunistic CT is a promising approach, providing automated fracture risk scores by means of artificial intelligence, thus enabling earlier management.

Development and validation of a fully automated system using deep learning for opportunistic osteoporosis screening using low-dose computed tomography scans

Background

Bone density measurement is an important examination for the diagnosis and screening of osteoporosis. The aim of this study was to develop a deep learning (DL) system for automatic measurement of bone mineral density (BMD) for osteoporosis screening using low-dose computed tomography (LDCT) images.

Methods

This retrospective study included 500 individuals who underwent LDCT scanning from April 2018 to July 2021. All images were manually annotated by a radiologist for the cancellous bone of target vertebrae and post-processed using quantitative computed tomography (QCT) software to identify osteoporosis. Patients were divided into the training, validation, and testing sets in a ratio of 6:2:2 using a 4-fold cross validation method. A localization model using faster region-based convolutional neural network (R-CNN) was trained to identify and locate the target vertebrae (T12-L2), then a 3-dimensional (3D) AnatomyNet was trained to finely segment the cancellous bone of target vertebrae in the localized image. A 3D DenseNet was applied for calculating BMD. The Dice coefficient was used to evaluate segmentation performance. Linear regression and Bland-Altman (BA) analyses were performed to compare the calculated BMD values using the proposed system with QCT. The diagnostic performance of the system for osteoporosis and osteopenia was evaluated with receiver operating characteristic (ROC) curve analysis.

Results

Our segmentation model achieved a mean Dice coefficient of 0.95, with Dice coefficients greater than 0.9 accounting for 96.6%. The correlation coefficient (R2) and mean errors between the proposed system and QCT in the testing set were 0.967 and 2.21 mg/cm3, respectively. The area under the curve (AUC) of the ROC was 0.984 for detecting osteoporosis and 0.993 for distinguishing abnormal BMD (osteopenia and osteoporosis).

Conclusions

The fully automated DL-based system is able to perform automatic BMD calculation for opportunistic osteoporosis screening with high accuracy using LDCT scans.

CT-based radiomics can identify physiological modifications of bone structure related to subjects' age and sex

PURPOSE

Radiomics of vertebral bone structure is a promising technique for identification of osteoporosis. We aimed at assessing the accuracy of machine learning in identifying physiological changes related to subjects' sex and age through analysis of radiomics features from CT images of lumbar vertebrae, and define its generalizability across different scanners.

MATERIALS AND METHODS

We annotated spherical volumes-of-interest (VOIs) in the center of the vertebral body for each lumbar vertebra in 233 subjects who had undergone lumbar CT for back pain on 3 different scanners, and we evaluated radiomics features from each VOI. Subjects with history of bone metabolism disorders, cancer, and vertebral fractures were excluded. We performed machine learning classification and regression models to identify subjects' sex and age respectively, and we computed a voting model which combined predictions.

RESULTS

The model was trained on 173 subjects and tested on an internal validation dataset of 60. Radiomics was able to identify subjects' sex within single CT scanner (ROC AUC: up to 0.9714), with lower performance on the combined dataset of the 3 scanners (ROC AUC: 0.5545). Higher consistency among different scanners was found in identification of subjects' age (R2 0.568 on all scanners, MAD 7.232 years), with highest results on a single CT scanner (R2 0.667, MAD 3.296 years).

CONCLUSION

Radiomics features are able to extract biometric data from lumbar trabecular bone, and determine bone modifications related to subjects' sex and age with great accuracy. However, acquisition from different CT scanners reduces the accuracy of the analysis.

Differentiation of acute and chronic vertebral compression fractures using conventional CT based on deep transfer learning features and hand-crafted radiomics features

BACKGROUND

We evaluated the diagnostic efficacy of deep learning radiomics (DLR) and hand-crafted radiomics (HCR) features in differentiating acute and chronic vertebral compression fractures (VCFs).

METHODS

A total of 365 patients with VCFs were retrospectively analysed based on their computed tomography (CT) scan data. All patients completed MRI examination within 2 weeks. There were 315 acute VCFs and 205 chronic VCFs. Deep transfer learning (DTL) features and HCR features were extracted from CT images of patients with VCFs using DLR and traditional radiomics, respectively, and feature fusion was performed to establish the least absolute shrinkage and selection operator. The MRI display of vertebral bone marrow oedema was used as the gold standard for acute VCF, and the model performance was evaluated using the receiver operating characteristic (ROC).To separately evaluate the effectiveness of DLR, traditional radiomics and feature fusion in the differential diagnosis of acute and chronic VCFs, we constructed a nomogram based on the clinical baseline data to visualize the classification evaluation. The predictive power of each model was compared using the Delong test, and the clinical value of the nomogram was evaluated using decision curve analysis (DCA).

RESULTS

Fifty DTL features were obtained from DLR, 41 HCR features were obtained from traditional radiomics, and 77 features fusion were obtained after feature screening and fusion of the two. The area under the curve (AUC) of the DLR model in the training cohort and test cohort were 0.992 (95% confidence interval (CI), 0.983-0.999) and 0.871 (95% CI, 0.805-0.938), respectively. While the AUCs of the conventional radiomics model in the training cohort and test cohort were 0.973 (95% CI, 0.955-0.990) and 0.854 (95% CI, 0.773-0.934), respectively. The AUCs of the features fusion model in the training cohort and test cohort were 0.997 (95% CI, 0.994-0.999) and 0.915 (95% CI, 0.855-0.974), respectively. The AUCs of nomogram constructed by the features fusion in combination with clinical baseline data were 0.998 (95% CI, 0.996-0.999) and 0.946 (95% CI, 0.906-0.987) in the training cohort and test cohort, respectively. The Delong test showed that the differences between the features fusion model and the nomogram in the training cohort and the test cohort were not statistically significant (P values were 0.794 and 0.668, respectively), and the differences in the other prediction models in the training cohort and the test cohort were statistically significant (P < 0.05). DCA showed that the nomogram had high clinical value.

CONCLUSION

The features fusion model can be used for the differential diagnosis of acute and chronic VCFs, and its differential diagnosis ability is improved when compared with that when either radiomics is used alone. At the same time, the nomogram has a high predictive value for acute and chronic VCFs and can be a potential decision-making tool to assist clinicians, especially when a patient is unable to undergo spinal MRI examination.

Machine learning applied to HR-pQCT images improves fracture discrimination provided by DXA and clinical risk factors

BACKGROUND

Traditional analysis of High Resolution peripheral Quantitative Computed Tomography (HR-pQCT) images results in a multitude of cortical and trabecular parameters which would be potentially cumbersome to interpret for clinicians compared to user-friendly tools utilising clinical parameters. A computer vision approach (by which the entire scan is 'read' by a computer algorithm) to ascertain fracture risk, would be far simpler. We therefore investigated whether a computer vision and machine learning technique could improve upon selected clinical parameters in assessing fracture risk.

METHODS

Participants of the Hertfordshire Cohort Study (HCS) attended research visits at which height and weight were measured; fracture history was determined via self-report and vertebral fracture assessment. Bone microarchitecture was assessed via HR-pQCT scans of the non-dominant distal tibia (Scanco XtremeCT), and bone mineral density measurement and lateral vertebral assessment were performed using dual-energy X-ray absorptiometry (DXA) (Lunar Prodigy Advanced). Images were cropped, pre-processed and texture analysis was performed using a three-dimensional local binary pattern method. These image data, together with age, sex, height, weight, BMI, dietary calcium and femoral neck BMD, were used in a random-forest classification algorithm. Receiver operating characteristic (ROC) analysis was used to compare fracture risk identification methods.

RESULTS

Overall, 180 males and 165 females were included in this study with a mean age of approximately 76 years and 97 (28 %) participants had sustained a previous fracture. Using clinical risk factors alone resulted in an area under the curve (AUC) of 0.70 (95 % CI: 0.56-0.84), which improved to 0.71 (0.57-0.85) with the addition of DXA-measured BMD. The addition of HR-pQCT image data to the machine learning classifier with clinical risk factors and DXA-measured BMD as inputs led to an improved AUC of 0.90 (0.83-0.96) with a sensitivity of 0.83 and specificity of 0.74.

CONCLUSION

These results suggest that using a three-dimensional computer vision method to HR-pQCT scanning may enhance the identification of those at risk of fracture beyond that afforded by clinical risk factors and DXA-measured BMD. This approach has the potential to make the information offered by HR-pQCT more accessible (and therefore) applicable to healthcare professionals in the clinic if the technology becomes more widely available.

Prediction of osteoporosis using radiomics analysis derived from single source dual energy CT

BACKGROUND

With the aging population of society, the incidence rate of osteoporosis is increasing year by year. Early diagnosis of osteoporosis plays a significant role in the progress of disease prevention. As newly developed technology, computed tomography (CT) radiomics could discover radiomic features difficult to recognize visually, providing convenient, comprehensive and accurate osteoporosis diagnosis. This study aimed to develop and validate a clinical-radiomics model based on the monochromatic imaging of single source dual-energy CT for osteoporosis prediction.

METHODS

One hundred sixty-four participants who underwent both single source dual-energy CT and quantitative computed tomography (QCT) lumbar-spine examination were enrolled in a study cohort including training datasets (n = 114 [30 osteoporosis and 84 non-osteoporosis]) and validation datasets (n = 50 [12 osteoporosis and 38 non-osteoporosis]). One hundred seven radiomics features were extracted from 70-keV monochromatic CT images. With QCT as the reference standard, a radiomics signature was built by using least absolute shrinkage and selection operator (LASSO) regression on the basis of reproducible features. A clinical-radiomics model was constructed by incorporating the radiomics signature and a significant clinical predictor (age) using multivariate logistic regression analysis. Model performance was assessed by its calibration, discrimination and clinical usefulness.

RESULTS

The radiomics signature comprised 14 selected features and showed good calibration and discrimination in both training and validation cohorts. The clinical-radiomics model, which incorporated the radiomics signature and a significant clinical predictor (age), also showed good discrimination, with an area under the receiver operating characteristic curve (AUC) of 0.938 (95% confidence interval, 0.903-0.952) in the training cohort and an AUC of 0.988 (95% confidence interval, 0.967-0.998) in the validation cohort, and good calibration. The clinical-radiomics model stratified participants into groups with osteoporosis and non-osteoporosis with an accuracy of 94.0% in the validation cohort. Decision curve analysis (DCA) demonstrated that the radiomics signature and the clinical-radiomics model were clinically useful.

CONCLUSIONS

The clinical-radiomics model incorporating the radiomics signature and a clinical parameter had a good ability to predict osteoporosis based on dual-energy CT monoenergetic imaging.

Opportunistic Screening Techniques for Analysis of CT Scans

PURPOSE OF REVIEW

Opportunistic screening is a combination of techniques to identify subjects of high risk for osteoporotic fracture using routine clinical CT scans prescribed for diagnoses unrelated to osteoporosis. The two main components are automated detection of vertebral fractures and measurement of bone mineral density (BMD) in CT scans, in which a phantom for calibration of CT to BMD values is not used. This review describes the particular challenges of opportunistic screening and provides an overview and comparison of current techniques used for opportunistic screening. The review further outlines the performance of opportunistic screening.

RECENT FINDINGS

A wide range of technologies for the automatic detection of vertebral fractures have been developed and successfully validated. Most of them are based on artificial intelligence algorithms. The automated differentiation of osteoporotic from traumatic fractures and vertebral deformities unrelated to osteoporosis, the grading of vertebral fracture severity, and the detection of mild vertebral fractures is still problematic. The accuracy of automated fracture detection compared to classical radiological semi-quantitative Genant scoring is about 80%. Accuracy errors of alternative BMD calibration methods compared to simultaneous phantom-based calibration used in standard quantitative CT (QCT) range from below 5% to about 10%. The impact of contrast agents, frequently administered in clinical CT on the determination of BMD and on fracture risk determination is still controversial. Opportunistic screening, the identification of vertebral fracture and the measurement of BMD using clinical routine CT scans, is feasible but corresponding techniques still need to be integrated into the clinical workflow and further validated with respect to the prediction of fracture risk.

Vertebral trabecular bone texture analysis in opportunistic MRI and CT scan can distinguish patients with and without osteoporotic vertebral fracture: A preliminary study

PURPOSE

To investigate the potential of texture parameters from opportunistic MRI and CT for the detection of patients with vertebral fragility fracture, to design a decision tree and to compute a Random Forest analysis for the prediction of fracture risk.

METHODS

One hundred and eighty vertebrae of sixty patients with at least one (30) or without (30) a fragility fracture were retrospectively assessed. Patients had a DXA, an MRI and a CT scan from the three first lumbar vertebrae. Vertebrae texture analysis was performed in routine abdominal or lumbar CT and lumbar MRI using 1st and 2nd order texture parameters. Hounsfield Unit Bone density (HU BD) was also measured on CT-scan images.

RESULTS

Twelve texture parameters, Z-score and HU BD were significantly different between the two groups whereas T score and BMD were not. The inter observer reproducibility was good to excellent. Decision tree showed that age and HU BD were the most relevant factors to predict the fracture risk with a 93 % sensitivity and 56 % specificity. AUC was 0.91 in MRI and 0.92 in CT-scan using the Random Forest analysis. The corresponding sensitivity and specificity were 72 % and 93 % in MRI and 83 and 89 % in CT.

CONCLUSIONS

This study is the first to compare texture indices computed from opportunistic CT and MR images. Age and HU-BD together with selected texture parameters could be used to assess risk fracture. Machine learning algorithm can detect fracture risk in opportunistic CT and MR imaging and might be of high interest for the diagnosis of osteoporosis.

Interpretable vertebral fracture quantification via anchor-free landmarks localization

Vertebral body compression fractures are early signs of osteoporosis. Though these fractures are visible on Computed Tomography (CT) images, they are frequently missed by radiologists in clinical settings. Prior research on automatic methods of vertebral fracture classification proves its reliable quality; however, existing methods provide hard-to-interpret outputs and sometimes fail to process cases with severe abnormalities such as highly pathological vertebrae or scoliosis. We propose a new two-step algorithm to localize the vertebral column in 3D CT images and then detect individual vertebrae and quantify fractures in 2D simultaneously. We train neural networks for both steps using a simple 6-keypoints based annotation scheme, which corresponds precisely to the current clinical recommendation. Our algorithm has no exclusion criteria, processes 3D CT in 2 seconds on a single GPU, and provides an interpretable and verifiable output. The method approaches expert-level performance and demonstrates state-of-the-art results in vertebrae 3D localization (the average error is 1mm), vertebrae 2D detection (precision and recall are 0.99), and fracture identification (ROC AUC at the patient level is up to 0.96). Our anchor-free vertebra detection network shows excellent generalizability on a new domain by achieving ROC AUC 0.95, sensitivity 0.85, specificity 0.9 on a challenging VerSe dataset with many unseen vertebra types.

A computed tomography-based radiomics nomogram for predicting osteoporotic vertebral fractures: A longitudinal study

CONTEXT

Fractures are serious consequence of osteoporosis in old adults. However, few longitudinal studies showed the role of computed tomography (CT)-based radiomics in predicting osteoporotic fractures.

OBJECTIVE

We evaluated the performance of CT radiomics-based model for osteoporotic vertebral fractures (OVF) in a longitudinal study.

METHODS

7906 subjects without OVF who were aged over 50 years, and underwent CT scans between 2016 and 2019 were enrolled and followed up until 2021. Seventy-two cases of new OVF were identified. One hundred and forty-four people without OVF during follow-up were selected as control. Radiomics features were extracted from baseline CT images. CT values of trabecular bone, and area and density of erector spinae were determined. Cox regression analysis was used to identify the independent associated factors. The predictive performance of the nomogram was assessed using the receiver operating characteristic (ROC) curve, calibration curve and decision curve.

RESULTS

CT value of vertebra (adjusted hazard ratio (aHR) = 2.04, 95% confidence interval (CI): 1.07, 3.89), radiomics score (aHR = 6.56, 95%CI:3.47, 12.38) and area of erector spinae (aHR = 1.68, 95%CI: 1.02, 2.78) were independently associated with OVF. Radscore was associated with severe OVF (aHR = 6.00, 95% CI:2.78-12.93). The nomogram showed good discrimination with a C-index of 0.82 (95%CI: 0.77, 0.87). The area under the curve of nomogram and radscore were both higher than osteoporosis + muscle area for 3-year and 4-year risk of fractures (p < 0.05). Decision curve also demonstrated that the radiomics nomogram was useful.

CONCLUSIONS

Bone radiomics is associated with OVF and the nomogram based on radiomics signature and muscle provides a tool for the prediction of OVF.

Current Applications of Machine Learning in Spine: From Clinical View

STUDY DESIGN

Narrative review.

OBJECTIVES

This review aims to present current applications of machine learning (ML) in spine domain to clinicians.

METHODS

We conducted a comprehensive PubMed search of peer-reviewed articles that were published between 2006 and 2020 using terms (spine, spinal, lumbar, cervical, thoracic, machine learning) to examine ML in spine. Then exclude research of other domain, case report, review or meta-analysis, and which without available abstract or full text.

RESULTS

Total 1738 articles were retrieved from database, and 292 studies were finally included. Key findings of current applications were compiled and summarized in this review. Main clinical applications of those techniques including image processing, diagnosis, decision supporting, operative assistance, rehabilitation, surgery outcomes, complications, hospitalization and cost.

CONCLUSIONS

ML had achieved excellent performance and hold immense potential in spine. ML could help clinical staff to improve medical level, enhance work efficiency, and reduce adverse events. However more randomized controlled trials and improvement of interpretability are essential to clinicians accepting models' assistance in real work.

Artificial intelligence-based radiomics on computed tomography of lumbar spine in subjects with fragility vertebral fractures

PURPOSE

There is emerging evidence that radiomics analyses can improve detection of skeletal fragility. In this cross-sectional study, we evaluated radiomics features (RFs) on computed tomography (CT) images of the lumbar spine in subjects with or without fragility vertebral fractures (VFs).

METHODS

Two-hundred-forty consecutive individuals (mean age 60.4 ± 15.4, 130 males) were evaluated by radiomics analyses on opportunistic lumbar spine CT. VFs were diagnosed in 58 subjects by morphometric approach on CT or XR-ray spine (D4-L4) images. DXA measurement of bone mineral density (BMD) was performed on 17 subjects with VFs.

RESULTS

Twenty RFs were used to develop the machine learning model reaching 0.839 and 0.789 of AUROC in the train and test datasets, respectively. After correction for age, VFs were significantly associated with RFs obtained from non-fractured vertebrae indicating altered trabecular microarchitecture, such as low-gray level zone emphasis (LGLZE) [odds ratio (OR) 1.675, 95% confidence interval (CI) 1.215-2.310], gray level non-uniformity (GLN) (OR 1.403, 95% CI 1.023-1.924) and neighboring gray-tone difference matrix (NGTDM) contrast (OR 0.692, 95% CI 0.493-0.971). Noteworthy, no significant differences in LGLZE (p = 0.94), GLN (p = 0.40) and NGDTM contrast (p = 0.54) were found between fractured subjects with BMD T score < - 2.5 SD and those in whom VFs developed in absence of densitometric diagnosis of osteoporosis.

CONCLUSIONS

Artificial intelligence-based analyses on spine CT images identified RFs associated with fragility VFs. Future studies are needed to test the predictive value of RFs on opportunistic CT scans in identifying subjects with primary and secondary osteoporosis at high risk of fracture.

Artificial intelligence in spine care: current applications and future utility

PURPOSE

The field of artificial intelligence is ever growing and the applications of machine learning in spine care are continuously advancing. Given the advent of the intelligence-based spine care model, understanding the evolution of computation as it applies to diagnosis, treatment, and adverse event prediction is of great importance. Therefore, the current review sought to synthesize findings from the literature at the interface of artificial intelligence and spine research.

METHODS

A narrative review was performed based on the literature of three databases (MEDLINE, CINAHL, and Scopus) from January 2015 to March 2021 that examined historical and recent advancements in the understanding of artificial intelligence and machine learning in spine research. Studies were appraised for their role in, or description of, advancements within image recognition and predictive modeling for spinal research. Only English articles that fulfilled inclusion criteria were ultimately incorporated in this review.

RESULTS

This review briefly summarizes the history and applications of artificial intelligence and machine learning in spine. Three basic machine learning training paradigms: supervised learning, unsupervised learning, and reinforced learning are also discussed. Artificial intelligence and machine learning have been utilized in almost every facet of spine ranging from localization and segmentation techniques in spinal imaging to pathology specific algorithms which include but not limited to; preoperative risk assessment of postoperative complications, screening algorithms for patients at risk of osteoporosis and clustering analysis to identify subgroups within adolescent idiopathic scoliosis. The future of artificial intelligence and machine learning in spine surgery is also discussed with focusing on novel algorithms, data collection techniques and increased utilization of automated systems.

CONCLUSION

Improvements to modern-day computing and accessibility to various imaging modalities allow for innovative discoveries that may arise, for example, from management. Given the imminent future of AI in spine surgery, it is of great importance that practitioners continue to inform themselves regarding AI, its goals, use, and progression. In the future, it will be critical for the spine specialist to be able to discern the utility of novel AI research, particularly as it continues to pervade facets of everyday spine surgery.

Radiomic Modeling of Bone Density and Rib Fracture Risk After Stereotactic Body Radiation Therapy for Early-Stage Non-Small Cell Lung Cancer

Purpose

Methods and Materials

Results

Conclusion

Using radiomic features of lumbar spine CT images to differentiate osteoporosis from normal bone density

OBJECTIVE

This study aimed to develop a predictive model to detect osteoporosis using radiomic features from lumbar spine computed tomography (CT) images.

METHODS

A total of 133 patients were included in this retrospective study, 41 men and 92 women, with a mean age of 65.45 ± 9.82 years (range: 31-94 years); 53 had normal bone mineral density, 32 osteopenia, and 48 osteoporosis. For each patient, the L1-L4 vertebrae on the CT images were automatically segmented using SenseCare and defined as regions of interest (ROIs). In total, 1,197 radiomic features were extracted from these ROIs using PyRadiomics. The most significant features were selected using logistic regression and Pearson correlation coefficient matrices. Using these features, we constructed three linear classification models based on the random forest (RF), support vector machine (SVM), and K-nearest neighbor (KNN) algorithms, respectively. The training and test sets were repeatedly selected using fivefold cross-validation. The model performance was evaluated using the area under the receiver operator characteristic curve (AUC) and confusion matrix.

RESULTS

The classification model based on RF had the highest performance, with an AUC of 0.994 (95% confidence interval [CI]: 0.979-1.00) for differentiating normal BMD and osteoporosis, 0.866 (95% CI: 0.779-0.954) for osteopenia versus osteoporosis, and 0.940 (95% CI: 0.891-0.989) for normal BMD versus osteopenia.

CONCLUSIONS

The excellent performance of this radiomic model indicates that lumbar spine CT images can effectively be used to identify osteoporosis and as a tool for opportunistic osteoporosis screening.

The impact of imaging time and contrast agent dose on screening for osteoporosis with contrast-enhanced CT

BACKGROUND

Screening for osteoporosis with contrast-enhanced computed tomography (CT) is promising for identifying high-risk osteoporotic patients. Our aims were (1) to investigate the estimated volume bone mineral density (vBMD) change over time after contrast injection (CT perfusion imaging, CTPI); and (2) to examine the influence of contrast dose on vBMD.

METHODS

Fifteen patients, aged 71 ± 9 years (mean ± standard deviation, range 55-86) underwent a CTPI examination (28 scans within 63 s) of the upper body followed (after a waiting time of 10 min) by a full 4-phase CT examination (4 scans within 4 min). The contrast dose for CTPI was 0.38-0.83 mL/kg, and for 4-phase CT was 0.87-1.29 mL/kg. Vertebrae L1-L3 were analysed totalling 43 vertebrae, using Mindways qCT Pro.

RESULTS

After contrast injection, vBMD showed a near-horizontal line until 17.5 s (non-contrast phase), followed by a steep increase 17.5-41.5 s after contrast injection, i.e., in the arterial phase, which plateaued 41.5 s after, i.e., in the early venous phase. A higher contrast dose per kg yielded significantly higher vBMD increase in both the arterial and venous phase (p < 0.003).

CONCLUSIONS

Both time from contrast administration and contrast dose per kg affected vBMD results. In arterial phase, the steepness of the curve makes vBMD estimation unsure. However, as values plateaued in the venous phase it might be possible to predict the correct vBMD values. Furthermore, contrast dose is a factor that needs to be adjusted for when using such a formula.

A hierarchical opportunistic screening model for osteoporosis using machine learning applied to clinical data and CT images

Background

Osteoporosis is a common metabolic skeletal disease and usually lacks obvious symptoms. Many individuals are not diagnosed until osteoporotic fractures occur. Bone mineral density (BMD) measured by dual-energy X-ray absorptiometry (DXA) is the gold standard for osteoporosis detection. However, only a limited percentage of people with osteoporosis risks undergo the DXA test. As a result, it is vital to develop methods to identify individuals at-risk based on methods other than DXA.

Results

We proposed a hierarchical model with three layers to detect osteoporosis using clinical data (including demographic characteristics and routine laboratory tests data) and CT images covering lumbar vertebral bodies rather than DXA data via machine learning. 2210 individuals over age 40 were collected retrospectively, among which 246 individuals’ clinical data and CT images are both available. Irrelevant and redundant features were removed via statistical analysis. Consequently, 28 features, including 16 clinical data and 12 texture features demonstrated statistically significant differences (p < 0.05) between osteoporosis and normal groups. Six machine learning algorithms including logistic regression (LR), support vector machine with radial-basis function kernel, artificial neural network, random forests, eXtreme Gradient Boosting and Stacking that combined the above five classifiers were employed as classifiers to assess the performances of the model. Furthermore, to diminish the influence of data partitioning, the dataset was randomly split into training and test set with stratified sampling repeated five times. The results demonstrated that the hierarchical model based on LR showed better performances with an area under the receiver operating characteristic curve of 0.818, 0.838, and 0.962 for three layers, respectively in distinguishing individuals with osteoporosis and normal BMD.

Conclusions

The proposed model showed great potential in opportunistic screening for osteoporosis without additional expense. It is hoped that this model could serve to detect osteoporosis as early as possible and thereby prevent serious complications of osteoporosis, such as osteoporosis fractures.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12859-022-04596-z.

Fully automated radiomic screening pipeline for osteoporosis and abnormal bone density with a deep learning-based segmentation using a short lumbar mDixon sequence

BACKGROUND

Although lumbar bone marrow fat fraction (BMFF) has been demonstrated to be predictive of osteoporosis, its utility is limited by the requirement of manual segmentation. Additionally, quantitative features beyond simple BMFF average remain to be explored. In this study, we developed a fully automated radiomic pipeline using deep learning-based segmentation to detect osteoporosis and abnormal bone density (ABD) using a <20 s modified Dixon (mDixon) sequence.

METHODS

In total, 222 subjects underwent quantitative computed tomography (QCT) and lower back magnetic resonance imaging (MRI). Bone mineral density (BMD) were extracted from L1-L3 using QCT as the reference standard; 206 subjects (48.8±14.9 years old, 140 females) were included in the final analysis, and were divided temporally into the training/validation set (142/64 subjects). A deep-learning network was developed to perform automated segmentation. Radiomic models were built using the same training set to predict ABD and osteoporosis using the mDixon maps. The performance was evaluated using the temporal validation set comprised of 64 subjects, along with the automated segmentation. Additional 25 subjects (56.1±8.8 years, 14 females) from another site and a different scanner vendor was included as independent validation to evaluate the performance of the pipeline.

RESULTS

The automated segmentation achieved an outstanding mean dice coefficient of 0.912±0.062 compared to manual in the temporal validation. Task-based evaluation was performed in the temporal validation set, for predicting ABD and osteoporosis, the area under the curve, sensitivity, specificity, and accuracy were 0.925/0.899, 0.923/0.667, 0.789/0.873, 0.844/0.844, respectively. These values were comparable to that of manual segmentation. External validation (cross-vendor) was also performed; the area under the curve, sensitivity, specificity, and accuracy were 0.688/0.913, 0.786/0.857, 0.545/0.944, 0.680/0.920 for ABD and osteoporosis prediction, respectively.

CONCLUSIONS

Our work is the first attempt using radiomics to predict osteoporosis with BMFF map, and the deep-learning based segmentation will further facilitate the clinical utility of the pipeline as a screening tool for early detection of ABD.

Level-Specific Volumetric BMD Threshold Values for the Prediction of Incident Vertebral Fractures Using Opportunistic QCT: A Case-Control Study

PURPOSE

To establish and evaluate the diagnostic accuracy of volumetric bone mineral density (vBMD) threshold values at different spinal levels, derived from opportunistic quantitative computed tomography (QCT), for the prediction of incident vertebral fractures (VF).

MATERIALS AND METHODS

In this case-control study, 35 incident VF cases (23 women, 12 men; mean age: 67 years) and 70 sex- and age-matched controls were included, based on routine multi detector CT (MDCT) scans of the thoracolumbar spine. Trabecular vBMD was measured from routine baseline CT scans of the thoracolumbar spine using an automated pipeline including vertebral segmentation, asynchronous calibration for HU-to-vBMD conversion, and correction of intravenous contrast medium (https://anduin.bonescreen.de). Threshold values at T1-L5 were calculated for the optimal operating point according to the Youden index and for fixed sensitivities (60 - 85%) in receiver operating characteristic (ROC) curves.

RESULTS

vBMD at each single level of the thoracolumbar spine was significantly associated with incident VFs (odds ratio per SD decrease [OR], 95% confidence interval [CI] at T1-T4: 3.28, 1.66-6.49; at T5-T8: 3.28, 1.72-6.26; at T9-T12: 3.37, 1.78-6.36; and at L1-L4: 3.98, 1.97-8.06), independent of adjustment for age, sex, and prevalent VF. AUC showed no significant difference between vertebral levels and was highest at the thoracolumbar junction (AUC = 0.75, 95%-CI = 0.63 - 0.85 for T11-L2). Optimal threshold values increased from lumbar (L1-L4: 52.0 mg/cm³) to upper thoracic spine (T1-T4: 69.3 mg/cm³). At T11-L2, T12-L3 and L1-L4, a threshold of 80.0 mg/cm³ showed sensitivities of 85 - 88%, and specificities of 41 - 49%. To achieve comparable sensitivity (85%) at more superior spinal levels, resulting thresholds were higher: 114.1 mg/cm³ (T1-T4), 92.0 mg/cm³ (T5-T8), 88.2 mg/cm³ (T9-T12).

CONCLUSIONS

At all levels of the thoracolumbar spine, lower vBMD was associated with incident VFs in an elderly, predominantly oncologic patient population. Automated opportunistic osteoporosis screening of vBMD along the entire thoracolumbar spine allows for risk assessment of imminent VFs. We propose level-specific vBMD threshold at the thoracolumbar spine to identify individuals at high fracture risk.

AI MSK clinical applications: spine imaging

Recent investigations have focused on the clinical application of artificial intelligence (AI) for tasks specifically addressing the musculoskeletal imaging routine. Several AI applications have been dedicated to optimizing the radiology value chain in spine imaging, independent from modality or specific application. This review aims to summarize the status quo and future perspective regarding utilization of AI for spine imaging. First, the basics of AI concepts are clarified. Second, the different tasks and use cases for AI applications in spine imaging are discussed and illustrated by examples. Finally, the authors of this review present their personal perception of AI in daily imaging and discuss future chances and challenges that come along with AI-based solutions.

Deep learning for screening primary osteopenia and osteoporosis using spine radiographs and patient clinical covariates in a Chinese population

PURPOSE

Many high-risk osteopenia and osteoporosis patients remain undiagnosed. We proposed to construct a convolutional neural network model for screening primary osteopenia and osteoporosis based on the lumbar radiographs, and to compare the diagnostic performance of the CNN model adding the clinical covariates with the image model alone.

METHODS

A total of 6,908 participants were collected for analysis, including postmenopausal women and men aged 50-95 years, who performed conventional lumbar x-ray examinations and dual-energy x-ray absorptiometry (DXA) examinations within 3 months. All participants were divided into a training set, a validation set, test set 1, and test set 2 at a ratio of 8:1:1:1. The bone mineral density (BMD) values derived from DXA were applied as the reference standard. A three-class CNN model was developed to classify the patients into normal BMD, osteopenia, and osteoporosis. Moreover, we developed the models integrating the images with clinical covariates (age, gender, and BMI), and explored whether adding clinical data improves diagnostic performance over the image mode alone. The receiver operating characteristic curve analysis was performed for assessing the model performance.

RESULTS

As for classifying osteoporosis, the model based on the anteroposterior+lateral channel performed best, with the area under the curve (AUC) range from 0.909 to 0.937 in three test cohorts. The models with images alone achieved moderate sensitivity in classifying osteopenia, in which the highest AUC achieved 0.785. The performance of models integrating images with clinical data shows a slight improvement over models with anteroposterior or lateral images input alone for diagnosing osteoporosis, in which the AUC increased about 2%-4%. Regarding categorizing osteopenia and the normal BMD, the proposed models integrating images with clinical data also outperformed the models with images solely.

CONCLUSION

The deep learning-based approach could screen osteoporosis and osteopenia based on lumbar radiographs.

Radiomics and stacking regression model for measuring bone mineral density using abdominal computed tomography

BACKGROUND

Measurement of bone mineral density (BMD) is the most important method to diagnose osteoporosis. However, current BMD measurement is always performed after a fracture has occurred.

PURPOSE

To explore whether a radiomic model based on abdominal computed tomography (CT) can predict the BMD of lumbar vertebrae.

MATERIAL AND METHODS

A total of 245 patients who underwent both dual-energy X-ray absorptiometry (DXA) and abdominal CT examination (training cohort, n = 196; validation cohort, n = 49) were included in our retrospective study. In total, 1218 image features were extracted from abdominal CT images for each patient. Combined with clinical information, three steps including least absolute shrinkage and selection operator (LASSO) regression were used to select key features. A two-tier stacking regression model with multi-algorithm fusion was used for BMD prediction, which can integrate the advantages of linear model and non-linear model. The prediction results of this model were compared with those using a single regressor. The degree-of-freedom adjusted coefficient of determination (Adjusted-R²), root mean square error (RMSE), and mean absolute error (MAE) were used to evaluate the regression performance.

RESULTS

Compared with other regression methods, the two-tier stacking regression model has a higher regression performance, with Adjusted-R², RMSE, and MAE of 0.830, 0.077, and 0.06, respectively. Pearson correlation analysis and Bland-Altman analysis showed that the BMD predicted by the model had a high correlation with the DXA results (r = 0.932, difference = -0.01 ± 0.1412 mg/cm²).

CONCLUSION

Using radiomics, the BMD of lumbar vertebrae could be predicted from abdominal CT images.

Deep learning takes the pain out of back breaking work - Automatic vertebral segmentation and attenuation measurement for osteoporosis

BACKGROUND

Osteoporosis is an underdiagnosed and undertreated disease worldwide. Recent studies have highlighted the use of simple vertebral trabecular attenuation values for opportunistic osteoporosis screening. Meanwhile, machine learning has been used to accurately segment large parts of the human skeleton.

PURPOSE

To evaluate a fully automated deep learning-based method for lumbar vertebral segmentation and measurement of vertebral volumetric trabecular attenuation values.

MATERIAL AND METHODS

A deep learning-based method for automated segmentation of bones was retrospectively applied to non-contrast CT scans of 1008 patients (mean age 57 years, 472 female, 536 male). Each vertebral segmentation was automatically reduced by 7 mm in all directions in order to avoid cortical bone. The mean and median volumetric attenuation values from Th12 to L4 were obtained and plotted against patient age and sex. L1 values were further analyzed to facilitate comparison with previous studies.

RESULTS

The mean L1 attenuation values decreased linearly with age by -2.2 HU per year (age > 30, 95% CI: -2.4, -2.0, R² = 0.3544). The mean L1 attenuation value of the entire population cohort was 140 HU ± 54.

CONCLUSIONS

With results closely matching those of previous studies, we believe that our fully automated deep learning-based method can be used to obtain lumbar volumetric trabecular attenuation values which can be used for opportunistic screening of osteoporosis in patients undergoing CT scans for other reasons.

Applications of Machine Learning in Bone and Mineral Research

In this unprecedented era of the overwhelming volume of medical data, machine learning can be a promising tool that may shed light on an individualized approach and a better understanding of the disease in the field of osteoporosis research, similar to that in other research fields. This review aimed to provide an overview of the latest studies using machine learning to address issues, mainly focusing on osteoporosis and fractures. Machine learning models for diagnosing and classifying osteoporosis and detecting fractures from images have shown promising performance. Fracture risk prediction is another promising field of research, and studies are being conducted using various data sources. However, these approaches may be biased due to the nature of the techniques or the quality of the data. Therefore, more studies based on the proposed guidelines are needed to improve the technical feasibility and generalizability of artificial intelligence algorithms.

Prediction of incident vertebral fractures in routine MDCT: Comparison of global texture features, 3D finite element parameters and volumetric BMD

PURPOSE

In this case-control study, we evaluated different quantitative parameters derived from routine multi-detector computed tomography (MDCT) scans with respect to their ability to predict incident osteoporotic vertebral fractures of the thoracolumbar spine.

METHODS

16 patients who received baseline and follow-up contrast-enhanced MDCT and were diagnosed with an incident osteoporotic vertebral fracture at follow-up, and 16 age-, sex-, and follow-up-time-matched controls were included in the study. Vertebrae were labelled and segmented using a fully automated pipeline. Volumetric bone mineral density (vBMD), finite element analysis (FEA)-based failure load (FL) and failure displacement (FD), as well as 24 texture features were extracted from L1 - L3 and averaged. Odds ratios (OR) with 95% confidence intervals (CI), expressed per standard deviation decrease, receiver operating characteristic (ROC) area under the curve (AUC), as well as logistic regression models, including all analyzed parameters as independent variables, were used to assess the prediction of incident vertebral fractures.

RESULTS

The texture feature Correlation (AUC = 0.754, p = 0.014; OR = 2.76, CI = 1.16-6.58) and vBMD (AUC = 0.750, p = 0.016; OR = 2.67, CI = 1.12-6.37) classified incident vertebral fractures best, while the best FEA-based parameter FL showed an AUC = 0.719 (p = 0.035). Correlation was the only significant predictor of incident fractures in the logistic regression analysis of all parameters (p = 0.022).

CONCLUSION

MDCT-derived FEA parameters and texture features, averaged from L1 - L3, showed only a moderate, but no statistically significant improvement of incident vertebral fracture prediction beyond BMD, supporting the hypothesis that vertebral-specific parameters may be superior for fracture risk assessment.

Opportunistic application of phantom-less calibration methods for fracture risk prediction using QCT/FEA

OBJECTIVES

Quantitative computed tomography (QCT)-based finite element analysis (FEA) implements a calibration phantom to estimate bone mineral density (BMD) and assign material properties to the models. The objectives of this study were to (1) propose robust phantom-less calibration methods, using subject-specific tissues, to obtain vertebral fracture properties estimations using QCT/FEA; and (2) correlate QCT/FEA predictions to DXA values of areal BMD.

METHODS

Eighty of a cohort of 111 clinical QCT scans were used to obtain subject-specific parameters using a phantom calibration approach and for the development of the phantom-less calibration equations. Equations were developed based on the HU measured from various soft tissues and regions, and using multiple linear regression analyses. Thirty-one additional QCT scans were used for cross-validation of QCT/FEA estimated fracture loads from the L₃ vertebrae based on the phantom and phantom-less equations. Finally, QCT/FEA-predicted fracture loads were correlated with aBMD obtained from DXA.

RESULTS

Overall, 217 QCT/FEA models from 31 subjects (20 females, 11 men) with mean ages of 69.6 (13.1) and 67.3 (14) were used to cross-validate the phantom-less equations and assess bone strength. The proposed phantom-less equations showed high correlations with phantom-based estimates of BMD (99%). Cross-validation of QCT/FEA-predicted fracture loads from phantom-less equations and phantom-specific outcomes resulted in high correlations for all proposed methods (0.94-0.99). QCT/FEA correlation outcomes from the phantom-less equations and DXA-aBMD were moderately high (0.64-0.68).

CONCLUSIONS

The proposed QCT/FEA subject-specific phantom-less calibration methods demonstrated the potential to be applied to both prospective and retrospective applications in the clinical setting.

KEY POINTS

• QCT/FEA overcomes the disadvantages of DXA and improves fracture properties predictions of vertebrae. • QCT/FEA fracture estimates using the phantom-less approach highly correlated to values obtained using a calibration phantom. • QCT/FEA prediction using a phantom-less approach is an accurate alternative over phantom-based methods.

Machine Learning Solutions for Osteoporosis-A Review

Osteoporosis and its clinical consequence, bone fracture, is a multifactorial disease that has been the object of extensive research. Recent advances in machine learning (ML) have enabled the field of artificial intelligence (AI) to make impressive breakthroughs in complex data environments where human capacity to identify high-dimensional relationships is limited. The field of osteoporosis is one such domain, notwithstanding technical and clinical concerns regarding the application of ML methods. This qualitative review is intended to outline some of these concerns and to inform stakeholders interested in applying AI for improved management of osteoporosis. A systemic search in PubMed and Web of Science resulted in 89 studies for inclusion in the review. These covered one or more of four main areas in osteoporosis management: bone properties assessment (n = 13), osteoporosis classification (n = 34), fracture detection (n = 32), and risk prediction (n = 14). Reporting and methodological quality was determined by means of a 12-point checklist. In general, the studies were of moderate quality with a wide range (mode score 6, range 2 to 11). Major limitations were identified in a significant number of studies. Incomplete reporting, especially over model selection, inadequate splitting of data, and the low proportion of studies with external validation were among the most frequent problems. However, the use of images for opportunistic osteoporosis diagnosis or fracture detection emerged as a promising approach and one of the main contributions that ML could bring to the osteoporosis field. Efforts to develop ML-based models for identifying novel fracture risk factors and improving fracture prediction are additional promising lines of research. Some studies also offered insights into the potential for model-based decision-making. Finally, to avoid some of the common pitfalls, the use of standardized checklists in developing and sharing the results of ML models should be encouraged. © 2021 American Society for Bone and Mineral Research (ASBMR).

CNN-based qualitative detection of bone mineral density via diagnostic CT slices for osteoporosis screening

The features extracted from diagnostic computed tomography (CT) slices were used to qualitatively detect bone mineral density (BMD) through neural network models, and the evaluation results indicated that it may be a promising approach to perform osteoporosis screening in clinical practice.

INTRODUCTION

The purpose of this study is to design a novelty diagnostic method for osteoporosis screening by using the convolutional neural network (CNN), which can be incorporated into the procedure of routine CT diagnostic in medical examination thereby improving the osteoporosis diagnosis and reducing the patient burden.

METHODS

The proposed CNN-based method mainly comprises two functional modules to perform qualitative detection of BMD by analyzing the diagnostic 2D CT slice. The first functional module aims to locate and segment the ROI of diagnostic 2D CT slice, called Mark-Segmentation-Network (MS-Net). The second functional module is used to determine the category of BMD by the features of ROI, called BMD-Classification-Network (BMDC-Net). The diagnostic 2D CT slice of pedicle level in lumbar vertebrae (L1) was selected from 3D CT image in our experiments firstly. Then, the trained MS-Net can get the mark image of input original 2D CT slice, thereby obtain the segmentation image. Finally, the trained BMDC-Net can obtain the probability value of normal bone mass, low bone mass, and osteoporosis by inputting the segmentation image. On the basis of network results, the radiologists can provide preliminary qualitative diagnosis results of BMD.

RESULTS

Training of the network was performed on diagnostic 2D CT slices of 150 patients. The network was tested on 63 patients. Each patient corresponds to a 2D CT slice. The proposed MS-Net has an excellent segmentation precision on the shape preservation of different lumbar vertebra. The dice index (DI), pixel accuracy (PA), and intersection over union (IOU) of segmentation results are greater than 0.8. The proposed BMDC-Net achieved an accuracy of 76.65% and an area under the receiver operating characteristic curve of 0.9167.

CONCLUSIONS

This study proposed a novel method for qualitative detection of BMD via diagnostic CT slices and it has great potential in clinical applications for osteoporosis screening. The method can potentially reduce the manual burden to radiologists and diagnostic cost to patients.

Aggregation of Region-based and Boundary-based Knowledge Biased Segmentation for Osteoporosis Detection from X-Ray, Dual X-Ray and CT Images

BACKGROUND

Osteoporosis is a term used to represent the reduced bone density, which is caused by insufficient bone tissue production to balance the old bone tissue removal. Medical Imaging procedures such as X-Ray, Dual X-Ray and Computed Tomography (CT) scans are used widely in osteoporosis diagnosis. There are several existing procedures in practice to assist osteoporosis diagnosis, which can operate using a single imaging method.

OBJECTIVE

The purpose of this proposed work is to introduce a framework to assist the diagnosis of osteoporosis based on consenting all these X-Ray, Dual X-Ray and CT scan imaging techniques. The proposed work named "Aggregation of Region-based and Boundary-based Knowledge biased Segmentation for Osteoporosis Detection from X-Ray, Dual X-Ray and CT images" (ARBKSOD) is the integration of three functional modules.

METHODS

Fuzzy Histogram Medical Image Classifier (FHMIC), Log-Gabor Transform based ANN Training for osteoporosis detection (LGTAT) and Knowledge biased Osteoporosis Analyzer (KOA).

RESULTS

Together, all these three modules make the proposed method ARBKSOD scored the maximum accuracy of 93.11%, the highest precision value of 93.91% while processing the 6th image batch, the highest sensitivity of 92.93%, the highest specificity of 93.79% is observed during the experiment by ARBKSOD while processing the 6th image batch. The best average processing time of 10244 mS is achieved by ARBKSOD while processing the 7th image batch.

CONCLUSION

Together, all these three modules make the proposed method ARBKSOD to produce a better result.

Local Bone Mineral Density, Subcutaneous and Visceral Adipose Tissue Measurements in Routine Multi Detector Computed Tomography-Which Parameter Predicts Incident Vertebral Fractures Best?

In this case-control study the value of bone mineral density (BMD) at different vertebral levels, subcutaneous adipose tissue (SAT), and visceral adipose tissue (VAT) to identify patients with incident osteoporotic vertebral fractures in routine multi-detector computed tomography (MDCT) exams was assessed.

MATERIAL AND METHODS

Seventeen patients who underwent baseline and follow-up routine contrast-enhanced MDCT and had an incident osteoporotic vertebral fracture at follow-up were included. Seventeen age-, sex- and follow-up duration-matched controls were identified. Trabecular BMD (from Th5 to L5) as well as cross-sectional area of SAT and VAT were extracted.

RESULTS

BMD performed best to differentiate patients with an incident fracture from controls at the levels of Th5 (area under the curve [AUC] = 0.781, p = 0.014), Th7 (AUC = 0.877, p = 0.001), and Th9 (AUC = 0.818, p = 0.005). Applying multivariate logistic regression BMD at Th7 level remained the only significant predictor of incident vertebral fractures (Th5-L5) with an odds ratio of 1.07 per BMD SD decrease. VAT and SAT did not show significant differences between the fracture and control group (p > 0.05).

CONCLUSION

The local BMD measurement appears to be more suitable than standard mean BMD from L1-L3 for fracture risk assessment.

Prediction of Incidental Osteoporotic Fractures at Vertebral-Specific Level Using 3D Non-Linear Finite Element Parameters Derived from Routine Abdominal MDCT

To investigate whether finite element (FE) analysis of the spine in routine thoracic/abdominal multi-detector computed tomography (MDCT) can predict incidental osteoporotic fractures at vertebral-specific level; Baseline routine thoracic/abdominal MDCT scans of 16 subjects (8(m), mean age: 66.1 ± 8.2 years and 8(f), mean age: 64.3 ± 9.5 years) who sustained incidental osteoporotic vertebral fractures as confirmed in follow-up MDCTs were included in the current study. Thoracic and lumbar vertebrae (T5-L5) were automatically segmented, and bone mineral density (BMD), finite element (FE)-based failure-load, and failure-displacement were determined. These values of individual vertebrae were normalized globally (g), by dividing the absolute value with the average of L1-3 and locally by dividing the absolute value with the average of T5-12 and L1-5 for thoracic and lumbar vertebrae, respectively. Mean-BMD of L1-3 was determined as reference. Receiver operating characteristics (ROC) and area under the curve (AUC) were calculated for different normalized FE (Kload, Kdisplacement,K(load)g, and K(displacement)g) and BMD (KBMD, and K(BMD)g) ratio parameter combinations for identifying incidental fractures. Kload, K(load)g, KBMD, and K(BMD)g showed significantly higher discriminative power compared to standard mean BMD of L1-3 (BMDStandard) (AUC = 0.67 for Kload; 0.64 for K(load)g; 0.64 for KBMD; 0.61 for K(BMD)g vs. 0.54 for BMDStandard). The combination of Kload, Kdisplacement, and KBMD increased the AUC further up to 0.77 (p < 0.001). The combination of FE with BMD measurements derived from routine thoracic/abdominal MDCT allowed an improved prediction of incidental fractures at vertebral-specific level.

Texture Analysis Using CT and Chemical Shift Encoding-Based Water-Fat MRI Can Improve Differentiation Between Patients With and Without Osteoporotic Vertebral Fractures

PURPOSE

Osteoporosis is a highly prevalent skeletal disease that frequently entails vertebral fractures. Areal bone mineral density (BMD) derived from dual-energy X-ray absorptiometry (DXA) is the reference standard, but has well-known limitations. Texture analysis can provide surrogate markers of tissue microstructure based on computed tomography (CT) or magnetic resonance imaging (MRI) data of the spine, thus potentially improving fracture risk estimation beyond areal BMD. However, it is largely unknown whether MRI-derived texture analysis can predict volumetric BMD (vBMD), or whether a model incorporating texture analysis based on CT and MRI may be capable of differentiating between patients with and without osteoporotic vertebral fractures.

MATERIALS AND METHODS

Twenty-six patients (15 females, median age: 73 years, 11 patients showing at least one osteoporotic vertebral fracture) who had CT and 3-Tesla chemical shift encoding-based water-fat MRI (CSE-MRI) available were analyzed. In total, 171 vertebral bodies of the thoracolumbar spine were segmented using an automatic convolutional neural network (CNN)-based framework, followed by extraction of integral and trabecular vBMD using CT data. For CSE-MRI, manual segmentation of vertebral bodies and consecutive extraction of the mean proton density fat fraction (PDFF) and T2* was performed. First-order, second-order, and higher-order texture features were derived from texture analysis using CT and CSE-MRI data. Stepwise multivariate linear regression models were computed using integral vBMD and fracture status as dependent variables.

RESULTS

Patients with osteoporotic vertebral fractures showed significantly lower integral and trabecular vBMD when compared to patients without fractures (p<0.001). For the model with integral vBMD as the dependent variable, T2* combined with three PDFF-based texture features explained 40% of the variance (adjusted R²[Ra2] = 0.40; p<0.001). Furthermore, regarding the differentiation between patients with and without osteoporotic vertebral fractures, a model including texture features from CT and CSE-MRI data showed better performance than a model based on integral vBMD and PDFF only ( Ra2 = 0.47 vs. Ra2  = 0.81; included texture features in the final model: integral vBMD, CT_Short-run_emphasis, CT_Varianceglobal, and PDFF_Variance).

CONCLUSION

Using texture analysis for spine CT and CSE-MRI can facilitate the differentiation between patients with and without osteoporotic vertebral fractures, implicating that future fracture prediction in osteoporosis may be improved.

Gender-, Age- and Region-Specific Characterization of Vertebral Bone Microstructure Through Automated Segmentation and 3D Texture Analysis of Routine Abdominal CT

PURPOSE

To identify long-term reproducible texture features (TFs) of spinal computed tomography (CT), and characterize variations with regard to gender, age and vertebral level using our automated quantification framework.

METHODS

We performed texture analysis (TA) on baseline and follow-up CT (follow-up duration: 30-90 days) of 21 subjects (8 females, 13 males, age at baseline 61.2 ± 9.2 years) to determine long-term reproducibility. TFs with a long-term reproducibility error Δ_rel<5% were further analyzed for an association with age and vertebral level in a cohort of 376 patients (129 females, 247 males, age 62.5 ± 9.2 years). Automated analysis comprised labeling and segmentation of vertebrae into subregions using a convolutional neural network, calculation of volumetric bone mineral density (vBMD) with asynchronous calibration and TF extraction. Variance_global measures the spread of the gray-level distribution in an image while Entropy reflects the uniformity of gray-levels. Short-run emphasis (SRE), Long-run emphasis (LRE), Run-length non-uniformity (RLN) and Run percentage (RP) contain information on consecutive voxels of a particular grey-level, or grey-level range, in a particular direction. Long runs (LRE) represent coarse texture while short runs (SRE) represent fine texture. RLN reflects similarities in the length of runs while RP reflects distribution and homogeneity of runs with a specific direction.

RESULTS

Six of the 24 extracted TFs had Δ_rel<5% (Variance_global, Entropy, SRE, LRE, RLN, RP), and were analyzed further in 4716 thoracolumbar vertebrae. Five TFs (Variance_global,SRE,LRE, RLN,RP) showed a significant difference between genders (p<0.001), potentially being caused by a finer and more directional vertebral trabecular microstructure in females compared to males. Variance_global and Entropy showed a significant increase from the thoracic to the lumbar spine (p<0.001), indicating a higher degree and earlier initiation of trabecular microstructure deterioration at lower spinal levels. The four higher-order TFs showed significant variations between spine regions without a clear directional gradient (p ≤ 0.001-0.012). No TF showed a clear age dependence. vBMD differed significantly between genders, age groups and spine regions (p ≤ 0.001-0.002).

CONCLUSION

Long-term reproducible CT-based TFs of the thoracolumbar spine were established and characterized in a predominantly older adult study population. The gender-, age- and vertebral-level-specific values may serve as foundation for osteoporosis diagnostics and facilitate future studies investigating vertebral microstructure.

Deep Learning for Osteoporosis Classification Using Hip Radiographs and Patient Clinical Covariates

This study considers the use of deep learning to diagnose osteoporosis from hip radiographs, and whether adding clinical data improves diagnostic performance over the image mode alone. For objective labeling, we collected a dataset containing 1131 images from patients who underwent both skeletal bone mineral density measurement and hip radiography at a single general hospital between 2014 and 2019. Osteoporosis was assessed from the hip radiographs using five convolutional neural network (CNN) models. We also investigated ensemble models with clinical covariates added to each CNN. The accuracy, precision, recall, specificity, negative predictive value (npv), F1 score, and area under the curve (AUC) score were calculated for each network. In the evaluation of the five CNN models using only hip radiographs, GoogleNet and EfficientNet b3 exhibited the best accuracy, precision, and specificity. Among the five ensemble models, EfficientNet b3 exhibited the best accuracy, recall, npv, F1 score, and AUC score when patient variables were included. The CNN models diagnosed osteoporosis from hip radiographs with high accuracy, and their performance improved further with the addition of clinical covariates from patient records.

[Artificial intelligence for diagnosis of vertebral compression fractures using a morphometric analysis model, based on convolutional neural networks]

BACKGROUND

Pathological low-energy (LE) vertebral compression fractures (VFs) are common complications of osteoporosis and predictors of subsequent LE fractures. In 84% of cases, VFs are not reported on chest CT (CCT), which calls for the development of an artificial intelligence-based (AI) assistant that would help radiology specialists to improve the diagnosis of osteoporosis complications and prevent new LE fractures.

AIMS

To develop an AI model for automated diagnosis of compression fractures of the thoracic spine based on chest CT images.

MATERIALS AND METHODS

Between September 2019 and May 2020 the authors performed a retrospective sampling study of ССТ images. The 160 of results were selected and anonymized. The data was labeled by seven readers. Using the morphometric analysis, the investigators received the following metric data: ventral, medial and dorsal dimensions. This was followed by a semiquantitative assessment of VFs degree. The data was used to develop the Comprise-G AI mode based on CNN, which subsequently measured the size of the vertebral bodies and then calculates the compression degree. The model was evaluated with the ROC curve analysis and by calculating sensitivity and specificity values.

RESULTS

Formed data consist of 160 patients (a training group - 100 patients; a test group - 60 patients). The total of 2,066 vertebrae was annotated. When detecting Grade 2 and 3 maximum VFs in patients the Comprise-G model demonstrated sensitivity - 90,7%, specificity - 90,7%, AUC ROC - 0.974 on the 5-FOLD cross-validation data of the training dataset; on the test data - sensitivity - 83,2%, specificity - 90,0%, AUC ROC - 0.956; in vertebrae demonstrated sensitivity - 91,5%, specificity - 95,2%, AUC ROC - 0.981 on the cross-validation data; for the test data sensitivity - 79,3%, specificity - 98,7%, AUC ROC - 0.978.

CONCLUSIONS

The Comprise-G model demonstrated high diagnostic capabilities in detecting the VFs on CCT images and can be recommended for further validation.

Opportunistic osteoporosis screening in multi-detector CT images using deep convolutional neural networks

OBJECTIVE

To explore the application of deep learning in patients with primary osteoporosis, and to develop a fully automatic method based on deep convolutional neural network (DCNN) for vertebral body segmentation and bone mineral density (BMD) calculation in CT images.

MATERIALS AND METHODS

A total of 1449 patients were used for experiments and analysis in this retrospective study, who underwent spinal or abdominal CT scans for other indications between March 2018 and May 2020. All data was gathered from three different CT vendors. Among them, 586 cases were used for training, and other 863 cases were used for testing. A fully convolutional neural network, called U-Net, was employed for automated vertebral body segmentation. The manually sketched region of vertebral body was used as the ground truth for comparison. A convolutional neural network, called DenseNet-121, was applied for BMD calculation. The values post-processed by quantitative computed tomography (QCT) were identified as the standards for analysis.

RESULTS

Based on the diversity of CT vendors, all testing cases were split into three testing cohorts: Test set 1 (n = 463), test set 2 (n = 200), and test set 3 (n = 200). Automated segmentation correlated well with manual segmentation regarding four lumbar vertebral bodies (L1-L4): the minimum average dice coefficients for three testing sets were 0.823, 0.786, and 0.782, respectively. For testing sets from different vendors, the average BMDs calculated by automated regression showed high correlation (r > 0.98) and agreement with those derived from QCT.

CONCLUSIONS

A deep learning-based method could achieve fully automatic identification of osteoporosis, osteopenia, and normal bone mineral density in CT images.

KEY POINTS

• Deep learning can perform accurate fully automated segmentation of lumbar vertebral body in CT images. • The average BMDs obtained by deep learning highly correlates with ones derived from QCT. • The deep learning-based method could be helpful for clinicians in opportunistic osteoporosis screening in spinal or abdominal CT scans.

Prospects and Challenges of Radiomics by Using Nononcologic Routine Chest CT

Chest CT scans are one of the most common medical imaging procedures. The automatic extraction and quantification of imaging features may help in diagnosis, prognosis of, or treatment decision in cardiovascular, pulmonary, and metabolic diseases. However, an adequate sample size as a statistical necessity for radiomics studies is often difficult to achieve in prospective trials. By exploiting imaging data from clinical routine, a much larger amount of data could be used than in clinical trials. Still, there is only little literature on the implementation of radiomics in clinical routine chest CT scans. Reasons are heterogeneous CT scanning protocols and the resulting technical variability (eg, different slice thicknesses, reconstruction kernels or timings after contrast material administration) in routine CT imaging data. This review summarizes the recent state of the art of studies aiming to develop quantifiable imaging biomarkers at chest CT, such as for osteoporosis, chronic obstructive pulmonary disease, interstitial lung disease, and coronary artery disease. This review explains solutions to overcome heterogeneity in routine data such as the use of imaging repositories, the standardization of radiomic features, algorithmic approaches to improve feature stability, test-retest studies, and the evolution of deep learning for modeling radiomics features. Supplemental material is available for this article. © RSNA, 2020 See also the commentary by Kay in this issue.