Deep-learning framework and computer assisted fatty infiltration analysis for the supraspinatus muscle in MRI

Automated segmentation and classification of supraspinatus fatty infiltration in shoulder magnetic resonance image using a convolutional neural network

Background

Goutallier's fatty infiltration of the supraspinatus muscle is a critical condition in degenerative shoulder disorders. Deep learning research primarily uses manual segmentation and labeling to detect this condition. Employing unsupervised training with a hybrid framework of segmentation and classification could offer an efficient solution.

Aim

To develop and assess a two-step deep learning model for detecting the region of interest and categorizing the magnetic resonance image (MRI) supraspinatus muscle fatty infiltration according to Goutallier's scale.

Materials and methods

A retrospective study was performed from January 1, 2019 to September 20, 2020, using 900 MRI T2-weighted images with supraspinatus muscle fatty infiltration diagnoses. A model with two sequential neural networks was implemented and trained. The first sub-model automatically detects the region of interest using a U-Net model. The second sub-model performs a binary classification using the VGG-19 architecture. The model's performance was computed as the average of five-fold cross-validation processes. Loss, accuracy, Dice coefficient (CI. 95%), AU-ROC, sensitivity, and specificity (CI. 95%) were reported.

Results

Six hundred and six shoulders MRIs were analyzed. The Goutallier distribution was presented as follows: 0 (66.50%); 1 (18.81%); 2 (8.42%); 3 (3.96%); 4 (2.31%). Segmentation results demonstrate high levels of accuracy (0.9977 ± 0.0002) and Dice score (0.9441 ± 0.0031), while the classification model also results in high levels of accuracy (0.9731 ± 0.0230); sensitivity (0.9000 ± 0.0980); specificity (0.9788 ± 0.0257); and AUROC (0.9903 ± 0.0092).

Conclusion

The two-step training method proposed using a deep learning model demonstrated strong performance in segmentation and classification tasks.

Comprehensive review of deep learning in orthopaedics: Applications, challenges, trustworthiness, and fusion

Deep learning (DL) in orthopaedics has gained significant attention in recent years. Previous studies have shown that DL can be applied to a wide variety of orthopaedic tasks, including fracture detection, bone tumour diagnosis, implant recognition, and evaluation of osteoarthritis severity. The utilisation of DL is expected to increase, owing to its ability to present accurate diagnoses more efficiently than traditional methods in many scenarios. This reduces the time and cost of diagnosis for patients and orthopaedic surgeons. To our knowledge, no exclusive study has comprehensively reviewed all aspects of DL currently used in orthopaedic practice. This review addresses this knowledge gap using articles from Science Direct, Scopus, IEEE Xplore, and Web of Science between 2017 and 2023. The authors begin with the motivation for using DL in orthopaedics, including its ability to enhance diagnosis and treatment planning. The review then covers various applications of DL in orthopaedics, including fracture detection, detection of supraspinatus tears using MRI, osteoarthritis, prediction of types of arthroplasty implants, bone age assessment, and detection of joint-specific soft tissue disease. We also examine the challenges for implementing DL in orthopaedics, including the scarcity of data to train DL and the lack of interpretability, as well as possible solutions to these common pitfalls. Our work highlights the requirements to achieve trustworthiness in the outcomes generated by DL, including the need for accuracy, explainability, and fairness in the DL models. We pay particular attention to fusion techniques as one of the ways to increase trustworthiness, which have also been used to address the common multimodality in orthopaedics. Finally, we have reviewed the approval requirements set forth by the US Food and Drug Administration to enable the use of DL applications. As such, we aim to have this review function as a guide for researchers to develop a reliable DL application for orthopaedic tasks from scratch for use in the market.

Application of Artificial Intelligence in Shoulder Pathology

Artificial intelligence (AI) refers to the science and engineering of creating intelligent machines for imitating and expanding human intelligence. Given the ongoing evolution of the multidisciplinary integration trend in modern medicine, numerous studies have investigated the power of AI to address orthopedic-specific problems. One particular area of investigation focuses on shoulder pathology, which is a range of disorders or abnormalities of the shoulder joint, causing pain, inflammation, stiffness, weakness, and reduced range of motion. There has not yet been a comprehensive review of the recent advancements in this field. Therefore, the purpose of this review is to evaluate current AI applications in shoulder pathology. This review mainly summarizes several crucial stages of the clinical practice, including predictive models and prognosis, diagnosis, treatment, and physical therapy. In addition, the challenges and future development of AI technology are also discussed.

Artificial intelligence powered advancements in upper extremity joint MRI: A review

Magnetic resonance imaging (MRI) is an indispensable medical imaging examination technique in musculoskeletal medicine. Modern MRI techniques achieve superior high-quality multiplanar imaging of soft tissue and skeletal pathologies without the harmful effects of ionizing radiation. Some current limitations of MRI include long acquisition times, artifacts, and noise. In addition, it is often challenging to distinguish abutting or closely applied soft tissue structures with similar signal characteristics. In the past decade, Artificial Intelligence (AI) has been widely employed in musculoskeletal MRI to help reduce the image acquisition time and improve image quality. Apart from being able to reduce medical costs, AI can assist clinicians in diagnosing diseases more accurately. This will effectively help formulate appropriate treatment plans and ultimately improve patient care. This review article intends to summarize AI's current research and application in musculoskeletal MRI, particularly the advancement of DL in identifying the structure and lesions of upper extremity joints in MRI images.

Medical Imaging Applications Developed Using Artificial Intelligence Demonstrate High Internal Validity Yet Are Limited in Scope and Lack External Validation

PURPOSE

To (1) review definitions and concepts necessary to interpret applications of deep learning (DL; a domain of artificial intelligence that leverages neural networks to make predictions on media inputs such as images) and (2) identify knowledge and translational gaps in the literature to provide insight into specific areas for improvement as adoption of this technology continues.

METHODS

A comprehensive search of the literature was performed in December 2023 for articles regarding the use of DL in sports medicine. For each study, information regarding the joint of focus, specific anatomic structure/pathology to which DL was applied, imaging modality utilized, source of images used for model training and testing, data set size, model performance, and whether the DL model was externally validated was recorded. A numerical scale was used to rate each DL model's clinical impact, with 1 corresponding to proof-of-concept studies with little to no direct clinical impact and 5 corresponding to practice-changing clinical impact and ready for clinical deployment.

RESULTS

Fifty-five studies were identified, all of which were published within the past 5 years, while 82% were published within the past 3 years. Of the DL models identified, 84% were developed for classification tasks, 9% for automated measurements, and 7% for segmentation. A total of 62% of studies utilized magnetic resonance imaging as the imaging modality, 25% radiographs, and 7% ultrasound, while 1 study each used computed tomography, arthroscopic images, or arthroscopic video. Sixty-five percent of studies focused on the detection of tears (anterior cruciate ligament [ACL], rotator cuff [RC], and meniscus). The diagnostic performance of ACL tears, as determined by the area under the receiver operator curve (AUROC), ranged from 0.81 to 0.99 for ACL tears (excellent to near perfect), 0.83 to 0.94 for RC tears (excellent), and from 0.75 to 0.96 for meniscus tears (acceptable to excellent). In addition, 3 studies focused on detection of cartilage lesions had AUROC ranging from 0.90 to 0.92 (excellent performance). However, only 4 (7%) studies externally validated their models, suggesting that they may not be generalizable or may not perform well when applied to populations other than that used to develop the model. Finally, the mean clinical impact score was 2 (range, 1-3) on scale of 1 to 5, corresponding to limited clinical applicability.

CONCLUSIONS

DL models in orthopaedic sports medicine show generally excellent performance (high internal validity) but require external validation to facilitate clinical deployment. In addition, current models have low clinical applicability and fail to advance the field due to a focus on routine tasks and a narrow conceptual framework.

LEVEL OF EVIDENCE

Level IV, scoping review of Level I to IV studies.

Artificial Intelligence Aids Detection of Rotator Cuff Pathology: A Systematic Review

PURPOSE

To determine the model performance of artificial intelligence (AI) in detecting rotator cuff pathology using different imaging modalities and to compare capability with physicians in clinical scenarios.

METHODS

The review followed the PRISMA guidelines and was registered on PROSPERO. The criteria were as follows: 1) studies on the application of AI in detecting rotator cuff pathology using medical images, and 2) studies on smart devices for assisting in diagnosis were excluded. The following data were extracted and recorded: statistical characteristics, input features, AI algorithms used, sample sizes of training and testing sets, and model performance. The data extracted from the included studies were narratively reviewed.

RESULTS

A total of 14 articles, comprising 23,119 patients, met the inclusion and exclusion criteria. The pooled mean age of the patients was 56.7 years, and the female rate was 56.1%. The area under the curve (AUC) of the algorithmic model to detect rotator cuff pathology from ultrasound images, MRI images, and radiographic series ranged from 0.789 to 0.950, 0.844 to 0.943, and 0.820 to 0.830, respectively. Notably, 1 of the studies reported that AI models based on ultrasound images demonstrated a diagnostic performance similar to that of radiologists. Another comparative study demonstrated that AI models using MRI images exhibited greater accuracy and specificity compared to orthopedic surgeons in the diagnosis of rotator cuff pathology, albeit not in sensitivity.

CONCLUSIONS

The detection of rotator cuff pathology has been significantly aided by the exceptional performance of AI models. In particular, these models are equally adept as musculoskeletal radiologists in using ultrasound to diagnose rotator cuff pathology. Furthermore, AI models exhibit statistically superior levels of accuracy and specificity when using MRI to diagnose rotator cuff pathology, albeit with no marked difference in sensitivity, in comparison to orthopaedic surgeons.

LEVEL OF EVIDENCE

Level III, systematic review of Level III studies.

Development and Clinical Application of Artificial Intelligence Assistant System for Rotator Cuff Ultrasound Scanning

OBJECTIVE

We developed an intelligent assistance system for shoulder ultrasound imaging, incorporating deep-learning algorithms to facilitate standard plane recognition and automatic tissue segmentation of the rotator cuff and its surrounding structures. We evaluated the system's performance using a dedicated data set of rotator cuff ultrasound images to assess its feasibility in clinical practice.

METHODS

To fulfill the system's primary functions, we designed a standard plane recognition module based on the ResNet50 network and an automatic tissue segmentation module using the Mask R-CNN model. The modules were trained on carefully curated data sets. The standard plane recognition module automatically identifies a specific standard plane based on the ultrasound image characteristics. The automatic tissue segmentation module effectively delineates and segments anatomical structures within the identified standard plane.

RESULTS

With the use of 59,265 shoulder joint ultrasound images, the standard plane recognition model achieved an impressive recognition accuracy of 94.9% in the test set, with an average precision rate of 96.4%, recall rate of 95.4% and F1 score of 95.9%. The automatic tissue segmentation model, tested on 1886 images, exhibited a commendable average intersection over union value of 96.2%, indicating robustness and accuracy. The model achieved mean intersection over union values exceeding 90.0% for all standard planes, indicating its effectiveness in precisely delineating the anatomical structures.

CONCLUSION

Our shoulder joint musculoskeletal intelligence system swiftly and accurately identifies standard planes and performs automatic tissue segmentation.

Supraspinatus extraction from MRI based on attention-dense spatial pyramid UNet network

BACKGROUND

With potential of deep learning in musculoskeletal image interpretation being explored, this paper focuses on the common site of rotator cuff tears, the supraspinatus. It aims to propose and validate a deep learning model to automatically extract the supraspinatus, verifying its superiority through comparison with several classical image segmentation models.

METHOD

Imaging data were retrospectively collected from 60 patients who underwent inpatient treatment for rotator cuff tears at a hospital between March 2021 and May 2023. A dataset of the supraspinatus from MRI was constructed after collecting, filtering, and manually annotating at the pixel level. This paper proposes a novel A-DAsppUnet network that can automatically extract the supraspinatus after training and optimization. The analysis of model performance is based on three evaluation metrics: precision, intersection over union, and Dice coefficient.

RESULTS

The experimental results demonstrate that the precision, intersection over union, and Dice coefficients of the proposed model are 99.20%, 83.38%, and 90.94%, respectively. Furthermore, the proposed model exhibited significant advantages over the compared models.

CONCLUSION

The designed model in this paper accurately extracts the supraspinatus from MRI, and the extraction results are complete and continuous with clear boundaries. The feasibility of using deep learning methods for musculoskeletal extraction and assisting in clinical decision-making was verified. This research holds practical significance and application value in the field of utilizing artificial intelligence for assisting medical decision-making.

Advancements in the diagnosis and management of rotator cuff tears. The role of artificial intelligence

Background

This review examined the role of artificial intelligence (AI) in the diagnosis and management of rotator cuff tears (RCTs).

Methods

A literature search was conducted in October 2023 using PubMed (MEDLINE), SCOPUS, and EMBASE databases, included only peer-reviewed studies. Relevant articles on AI technology in RCTs. A critical analysis of the relevant literature was conducted.

Results

AI is transforming RCTs management through faster and more precise identification and assessment using algorithms that facilitate segmentation, quantification, and classification of the RCTs across various imaging modalities. Precise algorithms focusing on preoperative factors to assess RCTs reparability have been developed for personalized treatment planning and outcome prediction. AI also aids in exercise classification and promotes patient adherence during at-home physiotherapy. Despite promising advancements, challenges in data quality and symptom integration persist. Future research should include refining AI algorithms, expanding their integration into various imaging techniques, and exploring their roles in postoperative care and surgical decision-making.

Conclusions

AI-driven solutions improve diagnostic accuracy and have the potential to influence treatment planning and postoperative outcomes through the automated RCTs analysis of medical imaging. Integration of high-quality datasets and clinical symptoms into AI models can enhance their reliability. Current AI algorithms can also be refined, integrated into other imaging techniques, and explored further in surgical decision-making and postoperative care.

Lumbar Degenerative Disease and Muscle Morphology Before and After Lower Limb Loss in Four Military Patients

INTRODUCTION

Low back pain (LBP) is highly prevalent after lower limb amputation (LLA). Reports describing longitudinal changes in spine health before and after amputation are rare. This study describes lumbar spine pathology, muscle morphology, and the continuum of care for LBP before and after LLA.

MATERIALS AND METHODS

We queried electronic medical records of patients who sought care for LBP before and after unilateral LLA between January 2002 and April 2020 and who had documented lumbar imaging pre- and post-LLA. Patient demographics, muscle morphology, spinal pathology, premorbid and comorbid conditions, self-reported pain, and treatment interventions were assessed.

RESULTS

Four patients with LBP and imaging before and after LLA were identified. Intervertebral disc degeneration progressed after amputation in three patients, whereas facet arthrosis progressed in both female patients. The fat content of lumbar musculature generally increased after amputation. Conservative management of LBP before and after amputation was standard, with progression to steroidal injections.

CONCLUSIONS

Lumbar spine health may degrade after amputation. Here, lumbar muscle size did not change after LLA, yet the fat content increased in combination with increases in facet and intervertebral disc degeneration.

Current clinical applications of artificial intelligence in shoulder surgery: what the busy shoulder surgeon needs to know and what's coming next

Background

Artificial intelligence (AI) is a continuously expanding field with the potential to transform a variety of industries-including health care-by providing automation, efficiency, precision, accuracy, and decision-making support for simple and complex tasks. Basic knowledge of the key features as well as limitations of AI is paramount to understand current developments in this field and to successfully apply them to shoulder surgery. The purpose of the present review is to provide an overview of AI within orthopedics and shoulder surgery exploring current and forthcoming AI applications.

Methods

PubMed and Scopus databases were searched to provide a narrative review of the most relevant literature on AI applications in shoulder surgery.

Results

Despite the enormous clinical and research potential of AI, orthopedic surgery has been a relatively late adopter of AI technologies. Image evaluation, surgical planning, aiding decision-making, and facilitating patient evaluations over time are some of the current areas of development with enormous opportunities to improve surgical practice, research, and education. Furthermore, the advancement of AI-driven strategies has the potential to create a more efficient medical system that may reduce the overall cost of delivering and implementing quality health care for patients with shoulder pathology.

Conclusion

AI is an expanding field with the potential for broad clinical and research applications in orthopedic surgery. Many challenges still need to be addressed to fully leverage the potential of AI to clinical practice and research such as privacy issues, data ownership, and external validation of the proposed models.

Deep-Learning-Based Automated Rotator Cuff Tear Screening in Three Planes of Shoulder MRI

This study aimed to develop a screening model for rotator cuff tear detection in all three planes of routine shoulder MRI using a deep neural network. A total of 794 shoulder MRI scans (374 men and 420 women; aged 59 ± 11 years) were utilized. Three musculoskeletal radiologists labeled the rotator cuff tear. The YOLO v8 rotator cuff tear detection model was then trained; training was performed with all imaging planes simultaneously and with axial, coronal, and sagittal images separately. The performances of the models were evaluated and compared using receiver operating curves and the area under the curve (AUC). The AUC was the highest when using all imaging planes (0.94; p < 0.05). Among a single imaging plane, the axial plane showed the best performance (AUC: 0.71), followed by the sagittal (AUC: 0.70) and coronal (AUC: 0.68) imaging planes. The sensitivity and accuracy were also the highest in the model with all-plane training (0.98 and 0.96, respectively). Thus, deep-learning-based automatic rotator cuff tear detection can be useful for detecting torn areas in various regions of the rotator cuff in all three imaging planes.

Artificial Intelligence and Machine Learning in Rotator Cuff Tears

Rotator cuff tears (RCTs) negatively impacts patient well-being. Artificial intelligence (AI) is emerging as a promising tool in medical decision-making. Within AI, deep learning allows to autonomously solve complex tasks. This review assesses the current and potential applications of AI in the management of RCT, focusing on diagnostic utility, challenges, and future perspectives. AI demonstrates promise in RCT diagnosis, aiding clinicians in interpreting complex imaging data. Deep learning frameworks, particularly convoluted neural networks architectures, exhibit remarkable diagnostic accuracy in detecting RCTs on magnetic resonance imaging. Advanced segmentation algorithms improve anatomic visualization and surgical planning. AI-assisted radiograph interpretation proves effective in ruling out full-thickness tears. Machine learning models predict RCT diagnosis and postoperative outcomes, enhancing personalized patient care. Challenges include small data sets and classification complexities, especially for partial thickness tears. Current applications of AI in RCT management are promising yet experimental. The potential of AI to revolutionize personalized, efficient, and accurate care for RCT patients is evident. The integration of AI with clinical expertise holds potential to redefine treatment strategies and optimize patient outcomes. Further research, larger data sets, and collaborative efforts are essential to unlock the transformative impact of AI in orthopedic surgery and RCT management.

Prediction of Retear After Arthroscopic Rotator Cuff Repair Based on Intraoperative Arthroscopic Images Using Deep Learning

BACKGROUND

It is challenging to predict retear after arthroscopic rotator cuff repair (ARCR). The usefulness of arthroscopic intraoperative images as predictors of the ARCR prognosis has not been analyzed.

PURPOSE

To evaluate the usefulness of arthroscopic images for the prediction of retear after ARCR using deep learning (DL) algorithms.

STUDY DESIGN

Cohort study (Diagnosis); Level of evidence, 2.

METHODS

In total, 1394 arthroscopic intraoperative images were retrospectively obtained from 580 patients. Repaired tendon integrity was evaluated using magnetic resonance imaging performed within 2 years after surgery. Images obtained immediately after ARCR were included. We used 3 DL architectures to predict retear based on arthroscopic images. Three pretrained DL algorithms (VGG16, DenseNet, and Xception) were used for transfer learning. Training and test sets were split into 8:2. Threefold stratified validation was used to fine-tune the hyperparameters using the training data set. The validation results of each fold were evaluated. The performance of each model in the test set was evaluated in terms of accuracy, area under the receiver operating characteristic curve (AUC), F1-score, sensitivity, and specificity.

RESULTS

In total, 1138 and 256 arthroscopic images were obtained from 514 patients and 66 patients in the nonretear and retear groups, respectively. The mean validation accuracy of each model was 83% for VGG16, 89% for Xception, and 91% for DenseNet. The accuracy for the test set was 76% for VGG16, 87% for Xception, and 91% for DenseNet. The AUC was highest for DenseNet (0.92); it was 0.83 for VGG16 and 0.91 for Xception. For the test set, the specificity and sensitivity were 0.93 and 0.84 for DenseNet, 0.89 and 0.84 for Xception, and 0.70 and 0.80 for VGG16, respectively.

CONCLUSION

The application of DL algorithms to intraoperative arthroscopic images has demonstrated a high level of accuracy in predicting retear occurrences.

IMFSegNet: Cost-effective and objective quantification of intramuscular fat in histological sections by deep learning

The assessment of muscle condition is of great importance in various research areas. In particular, evaluating the degree of intramuscular fat (IMF) in tissue sections is a challenging task, which today is still mostly performed qualitatively or quantitatively by a highly subjective and error-prone manual analysis. We here realize the mission to make automated IMF analysis possible that (i) minimizes subjectivity, (ii) provides accurate and quantitative results quickly, and (iii) is cost-effective using standard hematoxylin and eosin (H&E) stained tissue sections. To address all these needs in a deep learning approach, we utilized the convolutional encoder-decoder network SegNet to train the specialized network IMFSegNet allowing to accurately quantify the spatial distribution of IMF in histological sections. Our fully automated analysis was validated on 17 H&E-stained muscle sections from individual sheep and compared to various state-of-the-art approaches. Not only does IMFSegNet outperform all other approaches, but this neural network also provides fully automated and highly accurate results utilizing the most cost-effective procedures of sample preparation and imaging. Furthermore, we shed light on the opacity of black-box approaches such as neural networks by applying an explainable artificial intelligence technique to clarify that the success of IMFSegNet actually lies in identifying the hard-to-detect IMF structures. Embedded in our open-source visual programming language JIPipe that does not require programming skills, it can be expected that IMFSegNet advances muscle condition assessment in basic research across multiple areas as well as in research fields focusing on translational clinical applications.

High-accuracy detection of supraspinatus fatty infiltration in shoulder MRI using convolutional neural network algorithms

Background

The supraspinatus muscle fatty infiltration (SMFI) is a crucial MRI shoulder finding to determine the patient's prognosis. Clinicians have used the Goutallier classification to diagnose it. Deep learning algorithms have been demonstrated to have higher accuracy than traditional methods.

Aim

To train convolutional neural network models to categorize the SMFI as a binary diagnosis based on Goutallier's classification using shoulder MRIs.

Methods

A retrospective study was performed. MRI and medical records from patients with SMFI diagnosis from January 1st, 2019, to September 20th, 2020, were selected. 900 T2-weighted, Y-view shoulder MRIs were evaluated. The supraspinatus fossa was automatically cropped using segmentation masks. A balancing technique was implemented. Five binary classification classes were developed into two as follows, A: 0, 1 v/s 3, 4; B: 0, 1 v/s 2, 3, 4; C: 0, 1 v/s 2; D: 0, 1, 2, v/s 3, 4; E: 2 v/s 3, 4. The VGG-19, ResNet-50, and Inception-v3 architectures were trained as backbone classifiers. An average of three 10-fold cross-validation processes were developed to evaluate model performance. AU-ROC, sensitivity, and specificity with 95% confidence intervals were used.

Results

Overall, 606 shoulders MRIs were analyzed. The Goutallier distribution was presented as follows: 0 = 403; 1 = 114; 2 = 51; 3 = 24; 4 = 14. Case A, VGG-19 model demonstrated an AU-ROC of 0.991 ± 0.003 (accuracy, 0.973 ± 0.006; sensitivity, 0.947 ± 0.039; specificity, 0.975 ± 0.006). B, VGG-19, 0.961 ± 0.013 (0.925 ± 0.010; 0.847 ± 0.041; 0.939 ± 0.011). C, VGG-19, 0.935 ± 0.022 (0.900 ± 0.015; 0.750 ± 0.078; 0.914 ± 0.014). D, VGG-19, 0.977 ± 0.007 (0.942 ± 0.012; 0.925 ± 0.056; 0.942 ± 0.013). E, VGG-19, 0.861 ± 0.050 (0.779 ± 0.054; 0.706 ± 0.088; 0.831 ± 0.061).

Conclusion

Convolutional neural network models demonstrated high accuracy in MRIs SMFI diagnosis.

Deep-Learning-Based Segmentation of the Shoulder from MRI with Inference Accuracy Prediction

Three-dimensional (3D)-image-based anatomical analysis of rotator cuff tear patients has been proposed as a way to improve repair prognosis analysis to reduce the incidence of postoperative retear. However, for application in clinics, an efficient and robust method for the segmentation of anatomy from MRI is required. We present the use of a deep learning network for automatic segmentation of the humerus, scapula, and rotator cuff muscles with integrated automatic result verification. Trained on N = 111 and tested on N = 60 diagnostic T1-weighted MRI of 76 rotator cuff tear patients acquired from 19 centers, a nnU-Net segmented the anatomy with an average Dice coefficient of 0.91 ± 0.06. For the automatic identification of inaccurate segmentations during the inference procedure, the nnU-Net framework was adapted to allow for the estimation of label-specific network uncertainty directly from its subnetworks. The average Dice coefficient of segmentation results from the subnetworks identified labels requiring segmentation correction with an average sensitivity of 1.0 and a specificity of 0.94. The presented automatic methods facilitate the use of 3D diagnosis in clinical routine by eliminating the need for time-consuming manual segmentation and slice-by-slice segmentation verification.

Artificial intelligence-based applications in shoulder surgery leaves much to be desired: a systematic review

Background

Artificial intelligence (AI) aims to simulate human intelligence using automated computer algorithms. There has been a rapid increase in research applying AI to various subspecialties of orthopedic surgery, including shoulder surgery. The purpose of this review is to assess the scope and validity of current clinical AI applications in shoulder surgery literature.

Methods

A systematic literature review was conducted using PubMed for all articles published between January 1, 2010 and June 10, 2022. The search query used the terms as follows: (artificial intelligence OR machine learning OR deep learning) AND (shoulder OR shoulder surgery OR rotator cuff). All studies that examined AI application models in shoulder surgery were included and evaluated for model performance and validation (internal, external, or both).

Results

A total of 45 studies were included in the final analysis. Eighteen studies involved shoulder arthroplasty, 13 rotator cuff, and 14 other areas. Studies applying AI to shoulder surgery primarily involved (1) automated imaging analysis including identifying rotator cuff tears and shoulder implants (2) risk prediction analyses including perioperative complications, functional outcomes, and patient satisfaction. Highest model performance area under the curve ranged from 0.681 (poor) to 1.00 (perfect). Only 2 studies reported external validation.

Conclusion

Applications of AI in the field of shoulder surgery are expanding rapidly and offer patient-specific risk stratification for shared decision-making and process automation for resource preservation. However, model performance is modest and external validation remains to be demonstrated, suggesting increased scientific rigor is warranted prior to deploying AI-based clinical applications.

Assessment of idiopathic inflammatory myopathy using a deep learning method for muscle T2 mapping segmentation

OBJECTIVE

To investigate the utility of an automatic deep learning (DL) method for segmentation of T2 maps in patients with idiopathic inflammatory myopathy (IIM) against healthy controls, and also the association of quantitative T2 values in patients with laboratory and pulmonary findings.

METHODS

Structural MRI and T2 mapping of bilateral thigh muscles from patients with IIM and healthy volunteers were segmented using dedicated software based on a pre-trained convolutional neural network. Incremental and federated learning were implemented for continuous adaptation and improvement. Muscle T2 values derived from DL segmentation were compared between patients and healthy controls, and T2 values of patients were further analyzed with serum muscle enzymes, and interstitial lung disease (ILD) which was diagnosed and graded based on chest HRCT.

RESULTS

Overall, 64 patients (27 patients with dermatomyositis, 29 with polymyositis, and 8 with antisynthetase syndrome (ASS)) and 10 healthy controls were included. By using DL-based muscle segmentation, T2 values generated from T2 maps accurately differentiated patients from those of controls (p < 0.001) with a cutoff value of 36.4 ms (sensitivity 96.9%, and specificity 100%). In patients with IIM, muscle T2 values positively correlated with all the serum muscle enzymes (all p < 0.05). ILD score of patients with ASS was markedly higher than that of those without ASS (p = 0.011), while dissociation between the severity of muscular involvement and ILD was observed (p = 0.080).

CONCLUSION

Automatic DL could be used to segment thigh muscles and help quantitatively assess muscular inflammation of IIM through T2 mapping.

KEY POINTS

• Muscle T2 mapping automatically segmented by deep learning can differentiate IIM from healthy controls. • T2 value, an indicator of active muscle inflammation, positively correlates with serum muscle enzymes. • T2 mapping can detect muscle disease in patients with normal muscle enzyme levels.

Artificial Intelligence in the Management of Rotator Cuff Tears

Technological innovation is a key component of orthopedic surgery. Artificial intelligence (AI), which describes the ability of computers to process massive data and "learn" from it to produce outputs that mirror human cognition and problem solving, may become an important tool for orthopedic surgeons in the future. AI may be able to improve decision making, both clinically and surgically, via integrating additional data-driven problem solving into practice. The aim of this article will be to review the current applications of AI in the management of rotator cuff tears. The article will discuss various stages of the clinical course: predictive models and prognosis, diagnosis, intraoperative applications, and postoperative care and rehabilitation. Throughout the article, which is a review in terms of study design, we will introduce the concept of AI in rotator cuff tears and provide examples of how these tools can impact clinical practice and patient care. Though many advancements in AI have been made regarding evaluating rotator cuff tears-particularly in the realm of diagnostic imaging-further advancements are required before they become a regular facet of daily clinical practice.

Three-Dimensional Software- and MR-Imaging-Based Muscle Volumetry Reveals Overestimation of Supraspinatus Muscle Atrophy Using Occupation Ratios in Full-Thickness Tendon Tears

Supraspinatus muscle atrophy is widely determined from oblique-sagittal MRI by calculating the occupation ratio. This ex vivo and clinical study aimed to validate the accuracy of 3D software- and MR-imaging-based muscle volumetry, as well as to assess the influence of the tear pattern on the occupation ratio. Ten porcine muscle specimens were volumetrized using the physical water displacement volumetry as a standard of reference. A total of 149 individuals with intact supraspinatus tendons, partial tears, and full-thickness tears had 3T MRI. Two radiologists independently determined occupation ratio values. An excellent correlation with a Pearson’s r of 0.95 for the variables physical volumetry using the water displacement method and MR-imaging-based muscle volumetry using the software was found and formed the standard of reference for the patient study. The inter-reader reliability was 0.92 for occupation ratios. The correlation between occupation ratios and software-based muscle volumes was good in patients with intact tendons (0.84) and partial tears (0.93) but considerably lower in patients with full-thickness tears (0.68). Three-dimensional-software- and MR-imaging-based muscle volumetry is reliable and accurate. Compared to 3D muscle volumetry, the occupation ratio method overestimates supraspinatus muscle atrophy in full-thickness tears, which is most likely due to the medial retraction of the myotendinous unit.

Agreement between intraoperative and MRI assessments of rotator cuff pathology and two MRI-based assessments of supraspinatus muscle atrophy

Background

Magnetic resonance imaging (MRI)-based rotator cuff assessment is often qualitative and subjective; few studies have tried to validate such preoperative assessments. This study investigates relationships of preoperative MRI assessments made by conventional approaches to intraoperative findings of tear type, location, and size or MRI-assessed muscle occupation ratio.

Methods

Intraoperatively, surgeons assessed tear type, location, anterior-posterior (AP) width, and medial-lateral length in 102 rotator cuff repair patients. Two musculoskeletal radiologists independently assessed the preoperative MRI scans for these same parameters and supraspinatus muscle atrophy by both Warner classification and quantitative occupation ratio. Exact agreement proportions, kappa statistics, and correlation coefficients were used to quantify agreement relationships.

Results

Agreement between MRI readers’ and surgeons’ observations of tear status averaged 93% with κ = 0.38, and that of tear location averaged 77% with κ = 0.50. Concordance correlations of MRI and intraoperative measures of anterior-posterior and medial-lateral tear length averaged 0.59 and 0.56 across readers, respectively. Despite excellent interrater agreement on Warner classification (exact agreement proportion 0.91) and occupation ratio (concordance correlation 0.93) separately, correlations between these 2 measures were −0.54 and −0.64 for the 2 readers, respectively. Patients with Warner grade 0 had occupation ratios ranging from 0.5 to 1.5.

Conclusion

Correlations of preoperative MRI tear dimensions and muscle atrophy assessed by conventional approaches with intraoperatively measured tear dimensions and quantitative occupation ratio, respectively, were only fair. Since tear size and muscle atrophy are known strong predictors of outcomes following rotator cuff repair that may influence treatment decisions, surgeons need to be aware of the limitations of MRI methods. Continued development and validation of quantitative preoperative imaging methods to accurately assess these parameters are needed to improve surgical planning and prognosis.

Evaluation of a deep learning method for the automated detection of supraspinatus tears on MRI

OBJECTIVE

To evaluate if deep learning is a feasible approach for automated detection of supraspinatus tears on MRI.

MATERIALS AND METHODS

A total of 200 shoulder MRI studies performed between 2015 and 2019 were retrospectively obtained from our institutional database using a balanced random sampling of studies containing a full-thickness tear, partial-thickness tear, or intact supraspinatus tendon. A 3-stage pipeline was developed comprised of a slice selection network based on a pre-trained residual neural network (ResNet); a segmentation network based on an encoder-decoder network (U-Net); and a custom multi-input convolutional neural network (CNN) classifier. Binary reference labels were created following review of radiologist reports and images by a radiology fellow and consensus validation by two musculoskeletal radiologists. Twenty percent of the data was reserved as a holdout test set with the remaining 80% used for training and optimization under a fivefold cross-validation strategy. Classification and segmentation accuracy were evaluated using area under the receiver operating characteristic curve (AUROC) and Dice similarity coefficient, respectively. Baseline characteristics in correctly versus incorrectly classified cases were compared using independent sample t-test and chi-squared.

RESULTS

Test sensitivity and specificity of the classifier at the optimal Youden's index were 85.0% (95% CI: 62.1-96.8%) and 85.0% (95% CI: 62.1-96.8%), respectively. AUROC was 0.943 (95% CI: 0.820-0.991). Dice segmentation accuracy was 0.814 (95% CI: 0.805-0.826). There was no significant difference in AUROC between 1.5 T and 3.0 T studies. Sub-analysis showed superior sensitivity on full-thickness (100%) versus partial-thickness (72.5%) subgroups.

DATA CONCLUSION

Deep learning is a feasible approach to detect supraspinatus tears on MRI.

Deep learning models for screening of high myopia using optical coherence tomography

This study aimed to validate and evaluate deep learning (DL) models for screening of high myopia using spectral-domain optical coherence tomography (OCT). This retrospective cross-sectional study included 690 eyes in 492 patients with OCT images and axial length measurement. Eyes were divided into three groups based on axial length: a “normal group,” a “high myopia group,” and an “other retinal disease” group. The researchers trained and validated three DL models to classify the three groups based on horizontal and vertical OCT images of the 600 eyes. For evaluation, OCT images of 90 eyes were used. Diagnostic agreements of human doctors and DL models were analyzed. The area under the receiver operating characteristic curve of the three DL models was evaluated. Absolute agreement of retina specialists was 99.11% (range: 97.78–100%). Absolute agreement of the DL models with multiple-column model was 100.0% (ResNet 50), 90.0% (Inception V3), and 72.22% (VGG 16). Areas under the receiver operating characteristic curves of the DL models with multiple-column model were 0.99 (ResNet 50), 0.97 (Inception V3), and 0.86 (VGG 16). The DL model based on ResNet 50 showed comparable diagnostic performance with retinal specialists. The DL model using OCT images demonstrated reliable diagnostic performance to identify high myopia.