Automated detection of patellofemoral osteoarthritis from knee lateral view radiographs using deep learning: data from the Multicenter Osteoarthritis Study (MOST)

Identifying who are unlikely to benefit from total knee arthroplasty using machine learning models

Identifying and preventing patients who are not likely to benefit long-term from total knee arthroplasty (TKA) would decrease healthcare expenditure significantly. We trained machine learning (ML) models (image-only, clinical-data only, and multimodal) among 5720 knee OA patients to predict postoperative dissatisfaction at 2 years. Dissatisfaction was defined as not achieving a minimal clinically important difference in postoperative Knee Society knee and function scores (KSS), Short Form-36 Health Survey [SF-36, divided into a physical component score (PCS) and mental component score (MCS)], and Oxford Knee Score (OKS). Compared to image-only models, both clinical-data only and multimodal models achieved superior performance at predicting dissatisfaction measured by AUC, clinical-data only model: KSS 0.888 (0.866-0.909), SF-PCS 0.836 (0.812-0.860), SF-MCS 0.833 (0.812-0.854), and OKS 0.806 (0.753-0.859); multimodal model: KSS 0.891 (0.870-0.911), SF-PCS 0.832 (0.808-0.857), SF-MCS 0.835 (0.811-0.856), and OKS 0.816 (0.768-0.863). Our findings highlighted that ML models using clinical or multimodal data were capable to predict post-TKA dissatisfaction.

Interobserver Agreement and Performance of Concurrent AI Assistance for Radiographic Evaluation of Knee Osteoarthritis

Background Due to conflicting findings in the literature, there are concerns about a lack of objectivity in grading knee osteoarthritis (KOA) on radiographs. Purpose To examine how artificial intelligence (AI) assistance affects the performance and interobserver agreement of radiologists and orthopedists of various experience levels when evaluating KOA on radiographs according to the established Kellgren-Lawrence (KL) grading system. Materials and Methods In this retrospective observer performance study, consecutive standing knee radiographs from patients with suspected KOA were collected from three participating European centers between April 2019 and May 2022. Each center recruited four readers across radiology and orthopedic surgery at in-training and board-certified experience levels. KL grading (KL-0 = no KOA, KL-4 = severe KOA) on the frontal view was assessed by readers with and without assistance from a commercial AI tool. The majority vote of three musculoskeletal radiology consultants established the reference standard. The ordinal receiver operating characteristic method was used to estimate grading performance. Light kappa was used to estimate interrater agreement, and bootstrapped t statistics were used to compare groups. Results Seventy-five studies were included from each center, totaling 225 studies (mean patient age, 55 years ± 15 [SD]; 113 female patients). The KL grades were KL-0, 24.0% (n = 54); KL-1, 28.0% (n = 63); KL-2, 21.8% (n = 49); KL-3, 18.7% (n = 42); and KL-4, 7.6% (n = 17). Eleven readers completed their readings. Three of the six junior readers showed higher KL grading performance with versus without AI assistance (area under the receiver operating characteristic curve, 0.81 ± 0.017 [SEM] vs 0.88 ± 0.011 [P < .001]; 0.76 ± 0.018 vs 0.86 ± 0.013 [P < .001]; and 0.89 ± 0.011 vs 0.91 ± 0.009 [P = .008]). Interobserver agreement for KL grading among all readers was higher with versus without AI assistance (κ = 0.77 ± 0.018 [SEM] vs 0.85 ± 0.013; P < .001). Board-certified radiologists achieved almost perfect agreement for KL grading when assisted by AI (κ = 0.90 ± 0.01), which was higher than that achieved by the reference readers independently (κ = 0.84 ± 0.017; P = .01). Conclusion AI assistance increased junior readers' radiographic KOA grading performance and increased interobserver agreement for osteoarthritis grading across all readers and experience levels. Published under a CC BY 4.0 license. Supplemental material is available for this article.

Deep Learning for Predicting Progression of Patellofemoral Osteoarthritis Based on Lateral Knee Radiographs, Demographic Data, and Symptomatic Assessments

OBJECTIVE

In this study, we propose a novel framework that utilizes deep learning and attention mechanisms to predict the radiographic progression of patellofemoral osteoarthritis (PFOA) over a period of 7 years.

MATERIAL AND METHODS

This study included subjects (1,832 subjects, 3,276 knees) from the baseline of the Multicenter Osteoarthritis Study (MOST). Patellofemoral joint regions of interest were identified using an automated landmark detection tool (BoneFinder) on lateral knee X-rays. An end-to-end deep learning method was developed for predicting PFOA progression based on imaging data in a five-fold cross-validation setting. To evaluate the performance of the models, a set of baselines based on known risk factors were developed and analyzed using gradient boosting machine (GBM). Risk factors included age, sex, body mass index, and Western Ontario and McMaster Universities Arthritis Index score, and the radiographic osteoarthritis stage of the tibiofemoral joint (Kellgren and Lawrence [KL] score). Finally, to increase predictive power, we trained an ensemble model using both imaging and clinical data.

RESULTS

Among the individual models, the performance of our deep convolutional neural network attention model achieved the best performance with an area under the receiver operating characteristic curve (AUC) of 0.856 and average precision (AP) of 0.431, slightly outperforming the deep learning approach without attention (AUC = 0.832, AP = 0.4) and the best performing reference GBM model (AUC = 0.767, AP = 0.334). The inclusion of imaging data and clinical variables in an ensemble model allowed statistically more powerful prediction of PFOA progression (AUC = 0.865, AP = 0.447), although the clinical significance of this minor performance gain remains unknown. The spatial attention module improved the predictive performance of the backbone model, and the visual interpretation of attention maps focused on the joint space and the regions where osteophytes typically occur.

CONCLUSION

This study demonstrated the potential of machine learning models to predict the progression of PFOA using imaging and clinical variables. These models could be used to identify patients who are at high risk of progression and prioritize them for new treatments. However, even though the accuracy of the models were excellent in this study using the MOST dataset, they should be still validated using external patient cohorts in the future.

Automatic measurement of lower limb alignment in portable devices based on deep learning for knee osteoarthritis

BACKGROUND

For knee osteoarthritis patients, analyzing alignment of lower limbs is essential for therapy, which is currently measured from standing long-leg radiographs of anteroposterior X-ray (LLR) manually. To address the time wasting, poor reproducibility and inconvenience of use caused by existing methods, we present an automated measurement model in portable devices for assessing knee alignment from LLRs.

METHOD

We created a model and trained it with 837 conforming LLRs, and tested it using 204 LLRs without duplicates in a portable device. Both manual and model measurements were conducted independently, then we recorded knee alignment parameters such as Hip knee ankle angle (HKA), Joint line convergence angle (JCLA), Anatomical mechanical angle (AMA), mechanical Lateral distal femoral angle (mLDFA), mechanical Medial proximal tibial angle (mMPTA), and the time required. We evaluated the model's performance compared with manual results in various metrics.

RESULT

In both the validation and test sets, the average mean radial errors were 2.778 and 2.447 (P<0.05). The test results for native knee joints showed that 92.22%, 79.38%, 87.94%, 79.82%, and 80.16% of the joints reached angle deviation<1° for HKA, JCLA, AMA, mLDFA, and mMPTA. Additionally, for joints with prostheses, 90.14%, 93.66%, 86.62%, 83.80%, and 85.92% of the joints reached that. The Chi-square test did not reveal any significant differences between the manual and model measurements in subgroups (P>0.05). Furthermore, the Bland-Altman 95% limits of agreement were less than ± 2° for HKA, JCLA, AMA, and mLDFA, and slightly more than ± 2 degrees for mMPTA.

CONCLUSION

The automatic measurement tool can assess the alignment of lower limbs in portable devices for knee osteoarthritis patients. The results are reliable, reproducible, and time-saving.

Artificial intelligence in osteoarthritis detection: A systematic review and meta-analysis

OBJECTIVES

As an increasing number of studies apply artificial intelligence (AI) algorithms in osteoarthritis (OA) detection, we performed a systematic review and meta-analysis to pool the data on diagnostic performance metrics of AI, and to compare them with clinicians' performance.

MATERIALS AND METHODS

A search in PubMed and Scopus was performed to find studies published up to April 2022 that evaluated and/or validated an AI algorithm for the detection or classification of OA. We performed a meta-analysis to pool the data on the metrics of diagnostic performance. Subgroup analysis based on the involved joint and meta-regression based on multiple parameters were performed to find potential sources of heterogeneity. The risk of bias was assessed using Prediction Model Study Risk of Bias Assessment Tool reporting guidelines.

RESULTS

Of the 61 studies included, 27 studies with 91 contingency tables provided sufficient data to enter the meta-analysis. The pooled sensitivities for AI algorithms and clinicians on internal validation test sets were 88% (95% confidence interval [CI]: 86,91) and 80% (95% CI: 68,88) and pooled specificities were 81% (95% CI: 75,85) and 79% (95% CI: 80,85), respectively. At external validation, the pooled sensitivity and specificity for AI algorithms were 94% (95% CI: 90,97) and 91% (95% CI: 77,97), respectively.

CONCLUSION

Although the results of this meta-analysis should be interpreted with caution due to the potential pitfalls in the included studies, the promising role of AI as a diagnostic adjunct to radiologists is indisputable.

MRI radiomics-based decision support tool for a personalized classification of cervical disc degeneration: a two-center study

Objectives: To develop and validate an MRI radiomics-based decision support tool for the automated grading of cervical disc degeneration. Methods: The retrospective study included 2,610 cervical disc samples of 435 patients from two hospitals. The cervical magnetic resonance imaging (MRI) analysis of patients confirmed cervical disc degeneration grades using the Pfirrmann grading system. A training set (1,830 samples of 305 patients) and an independent test set (780 samples of 130 patients) were divided for the construction and validation of the machine learning model, respectively. We provided a fine-tuned MedSAM model for automated cervical disc segmentation. Then, we extracted 924 radiomic features from each segmented disc in T1 and T2 MRI modalities. All features were processed and selected using minimum redundancy maximum relevance (mRMR) and multiple machine learning algorithms. Meanwhile, the radiomics models of various machine learning algorithms and MRI images were constructed and compared. Finally, the combined radiomics model was constructed in the training set and validated in the test set. Radiomic feature mapping was provided for auxiliary diagnosis. Results: Of the 2,610 cervical disc samples, 794 (30.4%) were classified as low grade and 1,816 (69.6%) were classified as high grade. The fine-tuned MedSAM model achieved good segmentation performance, with the mean Dice coefficient of 0.93. Higher-order texture features contributed to the dominant force in the diagnostic task (80%). Among various machine learning models, random forest performed better than the other algorithms (p < 0.01), and the T2 MRI radiomics model showed better results than T1 MRI in the diagnostic performance (p < 0.05). The final combined radiomics model had an area under the receiver operating characteristic curve (AUC) of 0.95, an accuracy of 89.51%, a precision of 87.07%, a recall of 98.83%, and an F1 score of 0.93 in the test set, which were all better than those of other models (p < 0.05). Conclusion: The radiomics-based decision support tool using T1 and T2 MRI modalities can be used for cervical disc degeneration grading, facilitating individualized management.

A multi-branch network to detect post-operative complications following hip arthroplasty on X-ray images

Background: Postoperative complications following total hip arthroplasty (THA) often require revision surgery. X-rays are usually used to detect such complications, but manually identifying the location of the problem and making an accurate assessment can be subjective and time-consuming. Therefore, in this study, we propose a multi-branch network to automatically detect postoperative complications on X-ray images. Methods: We developed a multi-branch network using ResNet as the backbone and two additional branches with a global feature stream and a channel feature stream for extracting features of interest. Additionally, inspired by our domain knowledge, we designed a multi-coefficient class-specific residual attention block to learn the correlations between different complications to improve the performance of the system. Results: Our proposed method achieved state-of-the-art (SOTA) performance in detecting multiple complications, with mean average precision (mAP) and F1 scores of 0.346 and 0.429, respectively. The network also showed excellent performance at identifying aseptic loosening, with recall and precision rates of 0.929 and 0.897, respectively. Ablation experiments were conducted on detecting multiple complications and single complications, as well as internal and external datasets, demonstrating the effectiveness of our proposed modules. Conclusion: Our deep learning method provides an accurate end-to-end solution for detecting postoperative complications following THA.

Deep learning assisted diagnosis system: improving the diagnostic accuracy of distal radius fractures

Objectives

To explore an intelligent detection technology based on deep learning algorithms to assist the clinical diagnosis of distal radius fractures (DRFs), and further compare it with human performance to verify the feasibility of this method.

Methods

A total of 3,240 patients (fracture: n = 1,620, normal: n = 1,620) were included in this study, with a total of 3,276 wrist joint anteroposterior (AP) X-ray films (1,639 fractured, 1,637 normal) and 3,260 wrist joint lateral X-ray films (1,623 fractured, 1,637 normal). We divided the patients into training set, validation set and test set in a ratio of 7:1.5:1.5. The deep learning models were developed using the data from the training and validation sets, and then their effectiveness were evaluated using the data from the test set. Evaluate the diagnostic performance of deep learning models using receiver operating characteristic (ROC) curves and area under the curve (AUC), accuracy, sensitivity, and specificity, and compare them with medical professionals.

Results

The deep learning ensemble model had excellent accuracy (97.03%), sensitivity (95.70%), and specificity (98.37%) in detecting DRFs. Among them, the accuracy of the AP view was 97.75%, the sensitivity 97.13%, and the specificity 98.37%; the accuracy of the lateral view was 96.32%, the sensitivity 94.26%, and the specificity 98.37%. When the wrist joint is counted, the accuracy was 97.55%, the sensitivity 98.36%, and the specificity 96.73%. In terms of these variables, the performance of the ensemble model is superior to that of both the orthopedic attending physician group and the radiology attending physician group.

Conclusion

This deep learning ensemble model has excellent performance in detecting DRFs on plain X-ray films. Using this artificial intelligence model as a second expert to assist clinical diagnosis is expected to improve the accuracy of diagnosing DRFs and enhance clinical work efficiency.

Osteoarthritis year in review 2022: imaging

PURPOSE

This narrative review summarizes original research focusing on imaging in osteoarthritis (OA) published between April 1st 2021 and March 31st 2022. We only considered English publications that were in vivo human studies.

METHODS

The PubMed, Medline, Embase, Scopus, and ISI Web of Science databases were searched for "Osteoarthritis/OA" studies based on the search terms: "Radiography", "Ultrasound/US", "Computed Tomography/CT", "DXA", "Magnetic Resonance Imaging/MRI", "Artificial Intelligence/AI", and "Deep Learning". This review highlights the anatomical focus of research on the structures within the tibiofemoral, patellofemoral, hip, and hand joints. There is also a noted focus on artificial intelligence applications in OA imaging.

RESULTS

Over the last decade, the increasing trend of using open-access large databases has reached a plateau (from 17 to 37). Compositional MRI has had the most prominent use in OA imaging and its biomarkers have been used in the detection of preclinical OA and prediction of OA outcomes. Most noteworthy, there has been an accelerated rate of publications on the implications of artificial intelligence, used in developing prediction models and performing trabecular texture analysis, in OA imaging (from 17 to 154).

CONCLUSIONS

While imaging has maintained its key role in OA research, publication trends have shown an emphasis on the integration of AI. During the past year, MRI has maintained the highest prevalence in usage while US and CT remain as readily available modalities. Finally, there has been a notable uptake in the development and validation of AI techniques used to perform texture analysis and predict OA progression.

The application of machine learning in early diagnosis of osteoarthritis: a narrative review

Osteoarthritis (OA) is the commonest musculoskeletal disease worldwide, with an increasing prevalence due to aging. It causes joint pain and disability, decreased quality of life, and a huge burden on healthcare services for society. However, the current main diagnostic methods are not suitable for early diagnosing patients of OA. The use of machine learning (ML) in OA diagnosis has increased dramatically in the past few years. Hence, in this review article, we describe the research progress in the application of ML in the early diagnosis of OA, discuss the current trends and limitations of ML approaches, and propose future research priorities to apply the tools in the field of OA. Accurate ML-based predictive models with imaging techniques that are sensitive to early changes in OA ahead of the emergence of clinical features are expected to address the current dilemma. The diagnostic ability of the fusion model that combines multidimensional information makes patient-specific early diagnosis and prognosis estimation of OA possible in the future.

Systematic review of artificial intelligence tack in preventive orthopaedics: is the land coming soon?

PURPOSE

This study aims to describe and assess the current stage of the artificial intelligence (AI) technology integration in preventive orthopaedics of the knee and hip joints.

MATERIALS AND METHODS

The study was conducted in strict compliance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. Literature databases were searched for articles describing the development and validation of AI models aimed at diagnosing knee or hip joint pathologies or predicting their development or course in patients. The quality of the included articles was assessed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) and QUADAS-AI tools.

RESULTS

56 articles were found that meet all the inclusion criteria. We identified two problems that block the full integration of AI into the routine of an orthopaedic physician. The first of them is related to the insufficient amount, variety and quality of data for training, and validation and testing of AI models. The second problem is the rarity of rational evaluation of models, which is why their real quality cannot always be evaluated.

CONCLUSION

The vastness and relevance of the studied topic are beyond doubt. Qualitative and optimally validated models exist in all four scopes considered. Additional optimization and confirmation of the models' quality on various datasets are the last technical stumbling blocks for creating usable software and integrating them into the routine of an orthopaedic physician.

Automatic diagnosis and grading of patellofemoral osteoarthritis from the axial radiographic view: a deep learning-based approach

BACKGROUND

Patellofemoral osteoarthritis (PFOA) has a high prevalence and is assessed on axial radiography of the patellofemoral joint (PFJ). A deep learning (DL)-based approach could help radiologists automatically diagnose and grade PFOA via interpreting axial radiographs.

PURPOSE

To develop and assess the performance of a DL-based approach for diagnosing and grading PFOA on axial radiographs.

MATERIAL AND METHODS

A total of 1280 (dataset 1) axial radiographs were retrospectively collected and utilized to develop the high-resolution network (HRNet)-based classification models. The ground truth was the interpretation from two experienced radiologists in consensus according to the K-L grading system. A binary-class model was trained to diagnose the presence (K-L 2∼4) or absence (K-L 0∼1) of PFOA. A multi-class model was used to grade the stage of PFOA, i.e. from K-L 0 to K-L 4. Model performances were evaluated using the receiver operating characteristics (ROC), confusion matrix, and the corresponding evaluation metrics (positive predictive value [PPV], negative predictive value [NPV], F1 score, sensitivity, specificity, accuracy) of the internal test set (n = 129) from dataset 1 and an external validation set (dataset 2, n = 187).

RESULTS

For the binary-class model, the area under the curve (AUC) was 0.91 in the internal test set and 0.90 in the external validation set. For grading PFOA, moderate to severe stage of PFOA exhibited a good performance in these two datasets (AUC = 0.91-0.98, PPV = 0.69-0.90, NPV = 0.92-0.99, F1 score = 0.72-0.87, sensitivity = 0.75-0.87, specificity = 0.90-0.99, accuracy = 0.87-0.98).

CONCLUSION

The HRNet-based approach performed well in diagnosing and grading radiographic PFOA, especially for the moderate to severe cases.

Automatic assessment of knee osteoarthritis severity in portable devices based on deep learning

BACKGROUND

For knee osteoarthritis, the commonly used radiology severity criteria Kellgren-Lawrence lead to variability among surgeons. Most existing diagnosis models require preprocessed radiographs and specific equipment.

METHODS

All enrolled patients diagnosed with KOA who met the criteria were obtained from **** Hospital. This study included 2579 images shot from posterior-anterior X-rays of 2,378 patients. We used RefineDet to train and validate this deep learning-based diagnostic model. After developing the model, 823 images of 697 patients were enrolled as the test set. The whole test set was assessed by up to 5 surgeons and this diagnostic model. To evaluate the model's performance we compared the results of the model with the KOA severity diagnoses of surgeons based on K-L scales.

RESULTS

Compared to the diagnoses of surgeons, the model achieved an overall accuracy of 0.977. Its sensitivity (recall) for K-L 0 to 4 was 1.0, 0.972, 0.979, 0.983 and 0.989, respectively; for these diagnoses, the specificity of this model was 0.992, 0.997, 0.994, 0.991 and 0.995. The precision and F1-score were 0.5 and 0.667 for K-L 0, 0.914 and 0.930 for K-L 1, 0.978 and 0.971 for K-L 2, 0.981 and 0.974 for K-L 3, and 0.988 and 0.985 for K-L 4, respectively. All K-L scales perform AUC > 0.90. The quadratic weighted Kappa coefficient between the diagnostic model and surgeons was 0.815 (P < 0.01, 95% CI 0.727-0.903). The performance of the model is comparable to the clinical diagnosis of KOA. This model improved the efficiency and avoided cumbersome image preprocessing.

CONCLUSION

The deep learning-based diagnostic model can be used to assess the severity of KOA in portable devices according to the Kellgren-Lawrence scale. On the premise of improving diagnostic efficiency, the results are highly reliable and reproducible.