Differentiation of spinal metastases originated from lung and other cancers using radiomics and deep learning based on DCE-MRI

Artificial intelligence in skeletal metastasis imaging

In the field of metastatic skeletal oncology imaging, the role of artificial intelligence (AI) is becoming more prominent. Bone metastasis typically indicates the terminal stage of various malignant neoplasms. Once identified, it necessitates a comprehensive revision of the initial treatment regime, and palliative care is often the only resort. Given the gravity of the condition, the diagnosis of bone metastasis should be approached with utmost caution. AI techniques are being evaluated for their efficacy in a range of tasks within medical imaging, including object detection, disease classification, region segmentation, and prognosis prediction in medical imaging. These methods offer a standardized solution to the frequently subjective challenge of image interpretation.This subjectivity is most desirable in bone metastasis imaging. This review describes the basic imaging modalities of bone metastasis imaging, along with the recent developments and current applications of AI in the respective imaging studies. These concrete examples emphasize the importance of using computer-aided systems in the clinical setting. The review culminates with an examination of the current limitations and prospects of AI in the realm of bone metastasis imaging. To establish the credibility of AI in this domain, further research efforts are required to enhance the reproducibility and attain robust level of empirical support.

Machine Learning in Spine Oncology: A Narrative Review

STUDY DESIGN

Narrative Review.

OBJECTIVE

Machine learning (ML) is one of the latest advancements in artificial intelligence used in medicine and surgery with the potential to significantly impact the way physicians diagnose, prognose, and treat spine tumors. In the realm of spine oncology, ML is utilized to analyze and interpret medical imaging and classify tumors with incredible accuracy. The authors present a narrative review that specifically addresses the use of machine learning in spine oncology.

METHODS

This study was conducted in accordance with the Preferred Reporting Items of Systematic Reviews and Meta-Analysis (PRISMA) methodology. A systematic review of the literature in the PubMed, EMBASE, Web of Science, Scopus, and Cochrane Library databases since inception was performed to present all clinical studies with the search terms '[[Machine Learning] OR [Artificial Intelligence]] AND [[Spine Oncology] OR [Spine Cancer]]'. Data included studies that were extracted and included algorithms, training and test size, outcomes reported. Studies were separated based on the type of tumor investigated using the machine learning algorithms into primary, metastatic, both, and intradural. A minimum of 2 independent reviewers conducted the study appraisal, data abstraction, and quality assessments of the studies.

RESULTS

Forty-five studies met inclusion criteria out of 480 references screened from the initial search results. Studies were grouped by metastatic, primary, and intradural tumors. The majority of ML studies relevant to spine oncology focused on utilizing a mixture of clinical and imaging features to risk stratify mortality and frailty. Overall, these studies showed that ML is a helpful tool in tumor detection, differentiation, segmentation, predicting survival, predicting readmission rates of patients with either primary, metastatic, or intradural spine tumors.

CONCLUSION

Specialized neural networks and deep learning algorithms have shown to be highly effective at predicting malignant probability and aid in diagnosis. ML algorithms can predict the risk of tumor recurrence or progression based on imaging and clinical features. Additionally, ML can optimize treatment planning, such as predicting radiotherapy dose distribution to the tumor and surrounding normal tissue or in surgical resection planning. It has the potential to significantly enhance the accuracy and efficiency of health care delivery, leading to improved patient outcomes.

A systematic review of brain metastases from lung cancer using magnetic resonance neuroimaging: Clinical and technical aspects

INTRODUCTION

Brain metastases (BMs) are common in lung cancer (LC) and are associated with poor prognosis. Magnetic resonance imaging (MRI) plays a vital role in the detection, diagnosis and management of BMs. This review summarises recent advances in MRI techniques for BMs from LC.

METHODS

This systematic review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. A comprehensive literature search was conducted in three electronic databases: PubMed, Scopus and the Web of Science. The search was limited to studies published between January 2000 and March 2023. The quality of the included studies was evaluated using appropriate tools for different study designs. A narrative synthesis was carried out to describe the key findings of the included studies.

RESULTS

Sixty-five studies were included. Standard MRI sequences such as T1-weighted (T1w), T2-weighted (T2w) and fluid-attenuated inversion recovery (FLAIR) were commonly used. Advanced techniques included perfusion-weighted imaging (PWI), diffusion-weighted imaging (DWI) and radiomics analysis. DWI and PWI parameters could distinguish tumour recurrence from radiation necrosis. Radiomics models predicted genetic mutations and the risk of BMs. Diagnostic accuracy was improved with deep learning (DL) approaches. Prognostic factors such as performance status and concurrent chemotherapy impacted survival.

CONCLUSION

Advanced MRI techniques and specialised MRI methods have emerging roles in managing BMs from LC. PWI and DWI improve diagnostic accuracy in treated BMs. Radiomics and DL facilitate personalised prognosis and treatment. Magnetic resonance imaging plays a key role in the continuum of care for BMs of patients with LC, from screening to treatment monitoring.

Inter- and Intra-Patient Repeatability of Radiomic Features from Multiparametric Whole-Body MRI in Patients with Metastatic Prostate Cancer

(1) Background: We assessed the test-re-test repeatability of radiomics in metastatic castration-resistant prostate cancer (mCPRC) bone disease on whole-body diffusion-weighted (DWI) and T1-weighted Dixon MRI. (2) Methods: In 10 mCRPC patients, 1.5 T MRI, including DWI and T1-weighted gradient-echo Dixon sequences, was performed twice on the same day. Apparent diffusion coefficient (ADC) and relative fat-fraction-percentage (rFF%) maps were calculated. Per study, up to 10 target bone metastases were manually delineated on DWI and Dixon images. All 106 radiomic features included in the Pyradiomics toolbox were derived for each target volume from the ADC and rFF% maps. To account for inter- and intra-patient measurement repeatability, the log-transformed individual target measurements were fitted to a hierarchical model, represented as a Bayesian network. Repeatability measurements, including the intraclass correlation coefficient (ICC), were derived. Feature ICCs were compared with mean ADC and rFF ICCs. (3) Results: A total of 65 DWI and 47 rFF% targets were analysed. There was no significant bias for any features. Pairwise correlation revealed fifteen ADC and fourteen rFF% feature sub-groups, without specific patterns between feature classes. The median intra-patient ICC was generally higher than the inter-patient ICC. Features that describe extremes in voxel values (minimum, maximum, range, skewness, and kurtosis) showed generally lower ICCs. Several mostly shape-based texture features were identified, which showed high inter- and intra-patient ICCs when compared with the mean ADC or mean rFF%, respectively. (4) Conclusions: Pyradiomics texture features of mCRPC bone metastases varied greatly in inter- and intra-patient repeatability. Several features demonstrated good repeatability, allowing for further exploration as diagnostic parameters in mCRPC bone disease.

Radiomics model based on MRI to differentiate spinal multiple myeloma from metastases: A two-center study

Purpose

Spinal multiple myeloma (MM) and metastases are two common cancer types with similar imaging characteristics, for which differential diagnosis is needed to ensure precision therapy. The aim of this study is to establish radiomics models for effective differentiation between them.

Methods

Enrolled in this study were 263 patients from two medical institutions, including 127 with spinal MM and 136 with spinal metastases. Of them, 210 patients from institution I were used as the internal training cohort and 53 patients from Institution II were used as the external validation cohort. Contrast-enhanced T1-weighted imaging (CET1) and T2-weighted imaging (T2WI) sequences were collected and reviewed. Based on the 1037 radiomics features extracted from both CET1 and T2WI images, Logistic Regression (LR), AdaBoost (AB), Support Vector Machines (SVM), Random Forest (RF), and multiple kernel learning based SVM (MKL-SVM) were constructed. Hyper-parameters were tuned by five-fold cross-validation. The diagnostic efficiency among different radiomics models was compared by accuracy (ACC), sensitivity (SEN), specificity (SPE), area under the ROC curve (AUC), YI, positive predictive value (PPV), negative predictive value (NPY), and F1-score.

Results

Based on single-sequence, the RF model outperformed all other models. All models based on T2WI images performed better than those based on CET1. The efficiency of all models was boosted by incorporating CET1 and T2WI sequences, and the MKL-SVM model achieved the best performance with ACC, AUC, and F1-score of 0.862, 0.870, and 0.874, respectively.

Conclusions

The radiomics models constructed based on MRI achieved satisfactory diagnostic performance for differentiation of spinal MM and metastases, demonstrating broad application prospects for individualized diagnosis and treatment.

AI applications in musculoskeletal imaging: a narrative review

This narrative review focuses on clinical applications of artificial intelligence (AI) in musculoskeletal imaging. A range of musculoskeletal disorders are discussed using a clinical-based approach, including trauma, bone age estimation, osteoarthritis, bone and soft-tissue tumors, and orthopedic implant-related pathology. Several AI algorithms have been applied to fracture detection and classification, which are potentially helpful tools for radiologists and clinicians. In bone age assessment, AI methods have been applied to assist radiologists by automatizing workflow, thus reducing workload and inter-observer variability. AI may potentially aid radiologists in identifying and grading abnormal findings of osteoarthritis as well as predicting the onset or progression of this disease. Either alone or combined with radiomics, AI algorithms may potentially improve diagnosis and outcome prediction of bone and soft-tissue tumors. Finally, information regarding appropriate positioning of orthopedic implants and related complications may be obtained using AI algorithms. In conclusion, rather than replacing radiologists, the use of AI should instead help them to optimize workflow, augment diagnostic performance, and keep up with ever-increasing workload.Relevance statement This narrative review provides an overview of AI applications in musculoskeletal imaging. As the number of AI technologies continues to increase, it will be crucial for radiologists to play a role in their selection and application as well as to fully understand their potential value in clinical practice. Key points • AI may potentially assist musculoskeletal radiologists in several interpretative tasks.• AI applications to trauma, age estimation, osteoarthritis, tumors, and orthopedic implants are discussed.• AI should help radiologists to optimize workflow and augment diagnostic performance.

Deep Learning-Assisted Identification of Femoroacetabular Impingement (FAI) on Routine Pelvic Radiographs

To use a novel deep learning system to localize the hip joints and detect findings of cam-type femoroacetabular impingement (FAI). A retrospective search of hip/pelvis radiographs obtained in patients to evaluate for FAI yielded 3050 total studies. Each hip was classified separately by the original interpreting radiologist in the following manner: 724 hips had severe cam-type FAI morphology, 962 moderate cam-type FAI morphology, 846 mild cam-type FAI morphology, and 518 hips were normal. The anteroposterior (AP) view from each study was anonymized and extracted. After localization of the hip joints by a novel convolutional neural network (CNN) based on the focal loss principle, a second CNN classified the images of the hip as cam positive, or no FAI. Accuracy was 74% for diagnosing normal vs. abnormal cam-type FAI morphology, with aggregate sensitivity and specificity of 0.821 and 0.669, respectively, at the chosen operating point. The aggregate AUC was 0.736. A deep learning system can be applied to detect FAI-related changes on single view pelvic radiographs. Deep learning is useful for quickly identifying and categorizing pathology on imaging, which may aid the interpreting radiologist.

Differentiating spinal pathologies by deep learning approach

BACKGROUND CONTEXT

Spinal pathologies are diverse in nature and, excluding trauma and degenerative diseases, includes infectious, neoplastic (either extradural or intradural), and inflammatory conditions. The preoperative diagnosis is made with clinical judgment incorporating lab findings and radiological studies. When the diagnosis is uncertain, a biopsy is almost always mandatory since the treatment is dictated by the type of pathology. This is an invasive, timely, and costly process.

PURPOSE

The aim of this study was to develop a deep learning (DL) algorithm, based on preoperative MRI and post-operative pathological results, to differentiate between leading spinal pathologies.

STUDY DESIGN

We retrospectively collected and analyzed clinical, radiological, and pathological data of patients who underwent spinal surgery or biopsy for various spinal pathologies between 2008 and 2022 at a tertiary center. The patients were stratified according to their pathological reports (the threshold for inclusion was set to 25 patients per diagnosis).

METHODS

Preoperative MRI, clinical data, and pathological results were processed by a deep learning model built on the Fast.ai framework on top of the PyTorch environment.

RESULTS

A total of 231 patients diagnosed with carcinoma (80), infection (57), meningioma (52), or schwannoma (42), were included in our model. The mean overall accuracy was 0.78±0.06 for the validation, and 0.93±0.03 for the test dataset.

CONCLUSION

Deep learning algorithm for differentiation between the aforementioned spinal pathologies, based solely on clinical MRI, proves as a feasible primary diagnostic modality. Larger studies should be performed to validate and improve this algorithm for clinical use.

CLINICAL SIGNIFICANCE

This study provides a proof-of-concept for predicting spinal pathologies solely by MRI based DL technology, allowing for a rapid, targeted, and cost-effective work-up and subsequent treatment.

Artificial Intelligence in Bone Metastasis Imaging: Recent Progresses from Diagnosis to Treatment - A Narrative Review

The introduction of artificial intelligence (AI) represents an actual revolution in the radiological field, including bone lesion imaging. Bone lesions are often detected both in healthy and oncological patients and the differential diagnosis can be challenging but decisive, because it affects the diagnostic and therapeutic process, especially in case of metastases. Several studies have already demonstrated how the integration of AI-based tools in the current clinical workflow could bring benefits to patients and to healthcare workers. AI technologies could help radiologists in early bone metastases detection, increasing the diagnostic accuracy and reducing the overdiagnosis and the number of unnecessary deeper investigations. In addition, radiomics and radiogenomics approaches could go beyond the qualitative features, visible to the human eyes, extrapolating cancer genomic and behavior information from imaging, in order to plan a targeted and personalized treatment. In this article, we want to provide a comprehensive summary of the most promising AI applications in bone metastasis imaging and their role from diagnosis to treatment and prognosis, including the analysis of future challenges and new perspectives.

Development and Validation of a Radiomics Nomogram for Liver Metastases Originating from Gastric and Colorectal Cancer

The origin of metastatic liver tumours (arising from gastric or colorectal sources) is closely linked to treatment choices and survival prospects. However, in some instances, the primary lesion remains elusive even after an exhaustive diagnostic investigation. Consequently, we have devised and validated a radiomics nomogram for ascertaining the primary origin of liver metastases stemming from gastric cancer (GCLMs) and colorectal cancer (CCLMs). This retrospective study encompassed patients diagnosed with either GCLMs or CCLMs, comprising a total of 277 GCLM cases and 278 CCLM cases. Radiomic characteristics were derived from venous phase computed tomography (CT) scans, and a radiomics signature (RS) was computed. Multivariable regression analysis demonstrated that gender (OR = 3.457; 95% CI: 2.102-5.684; p < 0.001), haemoglobin levels (OR = 0.976; 95% CI: 0.967-0.986; p < 0.001), carcinoembryonic antigen (CEA) levels (OR = 0.500; 95% CI: 0.307-0.814; p = 0.005), and RS (OR = 2.147; 95% CI: 1.127-4.091; p = 0.020) exhibited independent associations with GCLMs as compared to CCLMs. The nomogram, combining RS with clinical variables, demonstrated strong discriminatory power in both the training (AUC = 0.71) and validation (AUC = 0.78) cohorts. The calibration curve, decision curve analysis, and clinical impact curves revealed the clinical utility of this nomogram and substantiated its enhanced diagnostic performance.

The promise and limitations of artificial intelligence in musculoskeletal imaging

With the recent developments in deep learning and the rapid growth of convolutional neural networks, artificial intelligence has shown promise as a tool that can transform several aspects of the musculoskeletal imaging cycle. Its applications can involve both interpretive and non-interpretive tasks such as the ordering of imaging, scheduling, protocoling, image acquisition, report generation and communication of findings. However, artificial intelligence tools still face a number of challenges that can hinder effective implementation into clinical practice. The purpose of this review is to explore both the successes and limitations of artificial intelligence applications throughout the muscuskeletal imaging cycle and to highlight how these applications can help enhance the service radiologists deliver to their patients, resulting in increased efficiency as well as improved patient and provider satisfaction.

The role of Artificial intelligence in the assessment of the spine and spinal cord

Artificial intelligence (AI) application development is underway in all areas of radiology where many promising tools are focused on the spine and spinal cord. In the past decade, multiple spine AI algorithms have been created based on radiographs, computed tomography, and magnetic resonance imaging. These algorithms have wide-ranging purposes including automatic labeling of vertebral levels, automated description of disc degenerative changes, detection and classification of spine trauma, identification of osseous lesions, and the assessment of cord pathology. The overarching goals for these algorithms include improved patient throughput, reducing radiologist workload burden, and improving diagnostic accuracy. There are several pre-requisite tasks required in order to achieve these goals, such as automatic image segmentation, facilitating image acquisition and postprocessing. In this narrative review, we discuss some of the important imaging AI solutions that have been developed for the assessment of the spine and spinal cord. We focus on their practical applications and briefly discuss some key requirements for the successful integration of these tools into practice. The potential impact of AI in the imaging assessment of the spine and cord is vast and promises to provide broad reaching improvements for clinicians, radiologists, and patients alike.

Radiomics of Spinal Metastases Originating From Primary Nonsmall Cell Lung Cancer or Breast Cancer and Ability to Predict Epidermal Growth Factor Receptor Mutation/Ki-67 Levels

OBJECTIVES

The aims of the study are to explore spinal magnetic resonance imaging (MRI)-based radiomics to differentiate spinal metastases from primary nonsmall cell lung cancer (NSCLC) or breast cancer (BC) and to further predict the epidermal growth factor receptor (EGFR) mutation and Ki-67 expression level.

METHODS

In total, 268 patients with spinal metastases from primary NSCLC (n = 148) and BC (n = 120) were enrolled between January 2016 and December 2021. All patients underwent spinal contrast-enhanced T1-weighted MRI before treatment. Two- and 3-dimensional radiomics features were extracted from the spinal MRI images of each patient. The least absolute shrinkage and selection operator regression were applied to identify the most important features related to the origin of the metastasis and the EGFR mutation and Ki-67 level. Radiomics signatures (RSs) were established using the selected features and evaluated using receiver operating characteristic curve analysis.

RESULTS

We identified 6, 5, and 4 features from spinal MRI to develop Ori-RS, EGFR-RS, and Ki-67-RS for predicting the metastatic origin, EGFR mutation, and Ki-67 level, respectively. The 3 RSs performed well in the training (area under the receiver operating characteristic curves: Ori-RS vs EGFR-RS vs Ki-67-RS, 0.890 vs 0.793 vs 0.798) and validation (area under the receiver operating characteristic curves: Ori-RS vs EGFR-RS vs Ki-67-RS, 0.881 vs 0.744 vs 0.738) cohorts.

CONCLUSIONS

Our study demonstrated the value of spinal MRI-based radiomics for identifying the metastatic origin and evaluating the EGFR mutation status and Ki-67 level in patients with NSCLC and BC, respectively, which may have the potential to guide subsequent individual treatment planning.

Differentiation of benign and malignant spinal schwannoma using guided attention inference networks on multi-source MRI: comparison with radiomics method and radiologist-based clinical assessment

BACKGROUND

Differentiating diagnosis between the benign schwannoma and the malignant counterparts merely by neuroimaging is not always clear and remains still confounding in many cases because of atypical imaging presentation encountered in clinic and the lack of specific diagnostic markers.

PURPOSE

To construct and validate a novel deep learning model based on multi-source magnetic resonance imaging (MRI) in automatically differentiating malignant spinal schwannoma from benign.

MATERIAL AND METHODS

We retrospectively reviewed MRI imaging data from 119 patients with the initial diagnosis of benign or malignant spinal schwannoma confirmed by postoperative pathology. A novel convolutional neural network (CNN)-based deep learning model named GAIN-CP (Guided Attention Inference Network with Clinical Priors) was constructed. An ablation study for the fivefold cross-validation and cross-source experiments were conducted to validate the novel model. The diagnosis performance among our GAIN-CP model, the conventional radiomics model, and the radiologist-based clinical assessment were compared using the area under the receiver operating characteristic curve (AUC) and balanced accuracy (BAC).

RESULTS

The AUC score of the proposed GAIN method is 0.83, which outperforms the radiomics method (0.65) and the evaluations from the radiologists (0.67). By incorporating both the image data and the clinical prior features, our GAIN-CP achieves an AUC score of 0.95. The GAIN-CP also achieves the best performance on fivefold cross-validation and cross-source experiments.

CONCLUSION

The novel GAIN-CP method can successfully classify malignant spinal schwannoma from benign cases using the provided multi-source MR images exhibiting good prospect in clinical diagnosis.

Machine Learning in Metastatic Cancer Research: Potentials, Possibilities, and Prospects

Cancer has received extensive recognition for its high mortality rate, with metastatic cancer being the top cause of cancer-related deaths. Metastatic cancer involves the spread of the primary tumor to other body organs. As much as the early detection of cancer is essential, the timely detection of metastasis, the identification of biomarkers, and treatment choice are valuable for improving the quality of life for metastatic cancer patients. This study reviews the existing studies on classical machine learning (ML) and deep learning (DL) in metastatic cancer research. Since the majority of metastatic cancer research data are collected in the formats of PET/CT and MRI image data, deep learning techniques are heavily involved. However, its black-box nature and expensive computational cost are notable concerns. Furthermore, existing models could be overestimated for their generality due to the non-diverse population in clinical trial datasets. Therefore, research gaps are itemized; follow-up studies should be carried out on metastatic cancer using machine learning and deep learning tools with data in a symmetric manner.

Value of contrast-enhanced magnetic resonance imaging-T2WI-based radiomic features in distinguishing lung adenocarcinoma from lung squamous cell carcinoma with solid components >8 mm

Background

Radiomics is one of the research frontiers in the field of imaging and has excellent diagnostic performance. However, there is a lack of magnetic resonance imaging (MRI)-based omics studies on identifying pathological subtypes of lung cancer. Here we explored the value of the contrast-enhanced MRI-T2-weighted imaging (T2WI)-based radiomic analysis in distinguishing adenocarcinoma (Ade) from squamous cell carcinoma (Squ) with solid components >8 mm.

Methods

A retrospective analysis was performed of a total of 71 lung cancer patients who undergoing contrast-enhanced MRI and computed tomography (CT) before treatment, and the nodules had solid components ≥8 mm in our center from January 2020 to September 2021. All enrolled patients were divided into Squ and Ade groups according to the pathological results. In addition, the two groups were randomly divided into training set and validation set in a ratio of about 7:3. Radiomics software was used to extract the relevant radiomic features. The least absolute shrinkage and selection operator (Lasso) was used to screen radiomic features that were most relevant to lung cancer subtypes, thus calculating the radiomic scores (Rad-score) and constructing the radiomic models. Multivariate logistic regression was used to combine relevant clinical features with Rad-score to form combined model nomograms. The receiver operating characteristic (ROC) curves. the area under the ROC curve (AUC), the decision curve analysis (DCA) and the DeLong's test were used to evaluate the clinical application potentials.

Results

The sensitivity and specificity of the clinical model based on smoking was 75.0% and 93.8%. The AUC of the constructed magnetic resonance (MR)-Rad model for differentiating the pathological subtypes of lung cancer was 0.8651 in the validation sets. The AUC of the CT-Rad model in the validation set were 0.9286. The combined model constructed by combining clinical features and Rad-score had AUC of 0.8016, for identifying the 2 pathological subtypes of lung cancer in the validation set. There was no significant difference in diagnostic performance between MR-Rad model and CT-Rad model (P>0.05).

Conclusions

The MR-Rad model has a diagnostic performance similar to that of CT-Rad model, while the diagnostic performance of the combined mode was better than the single MR model.

MRI-based radiomics nomogram for differentiation of solitary metastasis and solitary primary tumor in the spine

BACKGROUND

Differentiating between solitary spinal metastasis (SSM) and solitary primary spinal tumor (SPST) is essential for treatment decisions and prognosis. The aim of this study was to develop and validate an MRI-based radiomics nomogram for discriminating SSM from SPST.

METHODS

One hundred and thirty-five patients with solitary spinal tumors were retrospectively studied and the data set was divided into two groups: a training set (n = 98) and a validation set (n = 37). Demographics and MRI characteristic features were evaluated to build a clinical factors model. Radiomics features were extracted from sagittal T1-weighted and fat-saturated T2-weighted images, and a radiomics signature model was constructed. A radiomics nomogram was established by combining radiomics features and significant clinical factors. The diagnostic performance of the three models was evaluated using receiver operator characteristic (ROC) curves on the training and validation sets. The Hosmer-Lemeshow test was performed to assess the calibration capability of radiomics nomogram, and we used decision curve analysis (DCA) to estimate the clinical usefulness.

RESULTS

The age, signal, and boundaries were used to construct the clinical factors model. Twenty-six features from MR images were used to build the radiomics signature. The radiomics nomogram achieved good performance for differentiating SSM from SPST with an area under the curve (AUC) of 0.980 in the training set and an AUC of 0.924 in the validation set. The Hosmer-Lemeshow test and decision curve analysis demonstrated the radiomics nomogram outperformed the clinical factors model.

CONCLUSIONS

A radiomics nomogram as a noninvasive diagnostic method, which combines radiomics features and clinical factors, is helpful in distinguishing between SSM and SPST.

Current Applications of Machine Learning in Spine: From Clinical View

STUDY DESIGN

Narrative review.

OBJECTIVES

This review aims to present current applications of machine learning (ML) in spine domain to clinicians.

METHODS

We conducted a comprehensive PubMed search of peer-reviewed articles that were published between 2006 and 2020 using terms (spine, spinal, lumbar, cervical, thoracic, machine learning) to examine ML in spine. Then exclude research of other domain, case report, review or meta-analysis, and which without available abstract or full text.

RESULTS

Total 1738 articles were retrieved from database, and 292 studies were finally included. Key findings of current applications were compiled and summarized in this review. Main clinical applications of those techniques including image processing, diagnosis, decision supporting, operative assistance, rehabilitation, surgery outcomes, complications, hospitalization and cost.

CONCLUSIONS

ML had achieved excellent performance and hold immense potential in spine. ML could help clinical staff to improve medical level, enhance work efficiency, and reduce adverse events. However more randomized controlled trials and improvement of interpretability are essential to clinicians accepting models' assistance in real work.

Artificial Intelligence in Spinal Imaging: Current Status and Future Directions

Spinal maladies are among the most common causes of pain and disability worldwide. Imaging represents an important diagnostic procedure in spinal care. Imaging investigations can provide information and insights that are not visible through ordinary visual inspection. Multiscale in vivo interrogation has the potential to improve the assessment and monitoring of pathologies thanks to the convergence of imaging, artificial intelligence (AI), and radiomic techniques. AI is revolutionizing computer vision, autonomous driving, natural language processing, and speech recognition. These revolutionary technologies are already impacting radiology, diagnostics, and other fields, where automated solutions can increase precision and reproducibility. In the first section of this narrative review, we provide a brief explanation of the many approaches currently being developed, with a particular emphasis on those employed in spinal imaging studies. The previously documented uses of AI for challenges involving spinal imaging, including imaging appropriateness and protocoling, image acquisition and reconstruction, image presentation, image interpretation, and quantitative image analysis, are then detailed. Finally, the future applications of AI to imaging of the spine are discussed. AI has the potential to significantly affect every step in spinal imaging. AI can make images of the spine more useful to patients and doctors by improving image quality, imaging efficiency, and diagnostic accuracy.

Differentiation between spinal multiple myeloma and metastases originated from lung using multi-view attention-guided network

Purpose

Multiple myeloma (MM) and metastasis originated are the two common malignancy diseases in the spine. They usually show similar imaging patterns and are highly demanded to differentiate for precision diagnosis and treatment planning. The objective of this study is therefore to construct a novel deep-learning-based method for effective differentiation of two diseases, with the comparative study of traditional radiomics analysis.

Methods

We retrospectively enrolled a total of 217 patients with 269 lesions, who were diagnosed with spinal MM (79 cases, 81 lesions) or spinal metastases originated from lung cancer (138 cases, 188 lesions) confirmed by postoperative pathology. Magnetic resonance imaging (MRI) sequences of all patients were collected and reviewed. A novel deep learning model of the Multi-view Attention-Guided Network (MAGN) was constructed based on contrast-enhanced T1WI (CET1) sequences. The constructed model extracts features from three views (sagittal, coronal and axial) and fused them for a more comprehensive differentiation analysis, and the attention guidance strategy is adopted for improving the classification performance, and increasing the interpretability of the method. The diagnostic efficiency among MAGN, radiomics model and the radiologist assessment were compared by the area under the receiver operating characteristic curve (AUC).

Results

Ablation studies were conducted to demonstrate the validity of multi-view fusion and attention guidance strategies: It has shown that the diagnostic model using multi-view fusion achieved higher diagnostic performance [ACC (0.79), AUC (0.77) and F1-score (0.67)] than those using single-view (sagittal, axial and coronal) images. Besides, MAGN incorporating attention guidance strategy further boosted performance as the ACC, AUC and F1-scores reached 0.81, 0.78 and 0.71, respectively. In addition, the MAGN outperforms the radiomics methods and radiologist assessment. The highest ACC, AUC and F1-score for the latter two methods were 0.71, 0.76 & 0.54, and 0.69, 0.71, & 0.65, respectively.

Conclusions

The proposed MAGN can achieve satisfactory performance in differentiating spinal MM between metastases originating from lung cancer, which also outperforms the radiomics method and radiologist assessment.

Application of Artificial Intelligence Methods for Imaging of Spinal Metastasis

Spinal metastasis is the most common malignant disease of the spine. Recently, major advances in machine learning and artificial intelligence technology have led to their increased use in oncological imaging. The purpose of this study is to review and summarise the present evidence for artificial intelligence applications in the detection, classification and management of spinal metastasis, along with their potential integration into clinical practice. A systematic, detailed search of the main electronic medical databases was undertaken in concordance with the PRISMA guidelines. A total of 30 articles were retrieved from the database and reviewed. Key findings of current AI applications were compiled and summarised. The main clinical applications of AI techniques include image processing, diagnosis, decision support, treatment assistance and prognostic outcomes. In the realm of spinal oncology, artificial intelligence technologies have achieved relatively good performance and hold immense potential to aid clinicians, including enhancing work efficiency and reducing adverse events. Further research is required to validate the clinical performance of the AI tools and facilitate their integration into routine clinical practice.

Emerging Applications of Deep Learning in Bone Tumors: Current Advances and Challenges

Deep learning is a subfield of state-of-the-art artificial intelligence (AI) technology, and multiple deep learning-based AI models have been applied to musculoskeletal diseases. Deep learning has shown the capability to assist clinical diagnosis and prognosis prediction in a spectrum of musculoskeletal disorders, including fracture detection, cartilage and spinal lesions identification, and osteoarthritis severity assessment. Meanwhile, deep learning has also been extensively explored in diverse tumors such as prostate, breast, and lung cancers. Recently, the application of deep learning emerges in bone tumors. A growing number of deep learning models have demonstrated good performance in detection, segmentation, classification, volume calculation, grading, and assessment of tumor necrosis rate in primary and metastatic bone tumors based on both radiological (such as X-ray, CT, MRI, SPECT) and pathological images, implicating a potential for diagnosis assistance and prognosis prediction of deep learning in bone tumors. In this review, we first summarized the workflows of deep learning methods in medical images and the current applications of deep learning-based AI for diagnosis and prognosis prediction in bone tumors. Moreover, the current challenges in the implementation of the deep learning method and future perspectives in this field were extensively discussed.

The Potential and Emerging Role of Quantitative Imaging Biomarkers for Cancer Characterization

Simple Summary

Modern, personalized therapy approaches are increasingly changing advanced cancer into a chronic disease. Compared to imaging, novel omics methodologies in molecular biology have already achieved an individual characterization of cancerous lesions. With quantitative imaging biomarkers, analyzed by radiomics or deep learning, an imaging-based assessment of tumoral biology can be brought into clinical practice. Combining these with other non-invasive methods, e.g., liquid profiling, could allow for more individual decision making regarding therapies and applications.

Abstract

Similar to the transformation towards personalized oncology treatment, emerging techniques for evaluating oncologic imaging are fostering a transition from traditional response assessment towards more comprehensive cancer characterization via imaging. This development can be seen as key to the achievement of truly personalized and optimized cancer diagnosis and treatment. This review gives a methodological introduction for clinicians interested in the potential of quantitative imaging biomarkers, treating of radiomics models, texture visualization, convolutional neural networks and automated segmentation, in particular. Based on an introduction to these methods, clinical evidence for the corresponding imaging biomarkers—(i) dignity and etiology assessment; (ii) tumoral heterogeneity; (iii) aggressiveness and response; and (iv) targeting for biopsy and therapy—is summarized. Further requirements for the clinical implementation of these imaging biomarkers and the synergistic potential of personalized molecular cancer diagnostics and liquid profiling are discussed.

Current development and prospects of deep learning in spine image analysis: a literature review

BACKGROUND AND OBJECTIVE

As the spine is pivotal in the support and protection of human bodies, much attention is given to the understanding of spinal diseases. Quick, accurate, and automatic analysis of a spine image greatly enhances the efficiency with which spine conditions can be diagnosed. Deep learning (DL) is a representative artificial intelligence technology that has made encouraging progress in the last 6 years. However, it is still difficult for clinicians and technicians to fully understand this rapidly evolving field due to the diversity of applications, network structures, and evaluation criteria. This study aimed to provide clinicians and technicians with a comprehensive understanding of the development and prospects of DL spine image analysis by reviewing published literature.

METHODS

A systematic literature search was conducted in the PubMed and Web of Science databases using the keywords "deep learning" and "spine". Date ranges used to conduct the search were from 1 January, 2015 to 20 March, 2021. A total of 79 English articles were reviewed.

KEY CONTENT AND FINDINGS

The DL technology has been applied extensively to the segmentation, detection, diagnosis, and quantitative evaluation of spine images. It uses static or dynamic image information, as well as local or non-local information. The high accuracy of analysis is comparable to that achieved manually by doctors. However, further exploration is needed in terms of data sharing, functional information, and network interpretability.

CONCLUSIONS

The DL technique is a powerful method for spine image analysis. We believe that, with the joint efforts of researchers and clinicians, intelligent, interpretable, and reliable DL spine analysis methods will be widely applied in clinical practice in the future.

Radiomics analysis based on multiple parameters MR imaging in the spine: Predicting treatment response of osteolytic bone metastases to chemotherapy in breast cancer patients

PURPOSE

To assess the value of radiomics, apparent diffusion coefficient (ADC), intravoxel incoherent motion (IVIM) and stretched-exponential (SE) MR imaging in prediction of therapeutic response in patients with spinal metastases before chemotherapy.

METHODS

Thirty-six patients with 190 osteolytic metastatic lesions from breast cancer were prospectively enrolled and underwent MR imaging before and after 6 months' treatment on a 1.5 T MRI. According to MDA criteria, 68 lesions were categorized as progressive disease (PD) and 122 lesions were categorized as stable or improvement (non-PD). The regions of interest (ROIs) were manually drawn on DWI, T1WI, T2WI and FS-T2WI by two radiologists with ITK-SNAP. The ADC_all (multiple b-values method), IVIM parameters (D, D* and f) and SE parameters (DDC and α) were generated. The radiomics features were selected from the ROIs.

RESULTS

The mean values of ADC, DDC, and D before treatment were significantly higher in non-PD group than those in PD group (P = 0.001). The radiomics based on ADC_all had the highest AUC value (0.852), followed by that of the T2WI (0.829) and FS-T2WI (0.798). The radiomics model using ADC_all and FS-T2WI showed excellent efficiency in predicting treatment response with AUCs of 0.905 and 0.873 in training and validation cohorts. The radiomics model had better performance than that of ADC_all, D, and DDC for predicting treatment response of bone metastases.

CONCLUSION

Radiomics model based on ADC_all and FS-T2WI could predict the treatment response and contribute to assisting clinicians in accurately choosing appropriated management.

Benign and malignant diagnosis of spinal tumors based on deep learning and weighted fusion framework on MRI

BACKGROUND

The application of deep learning has allowed significant progress in medical imaging. However, few studies have focused on the diagnosis of benign and malignant spinal tumors using medical imaging and age information at the patient level. This study proposes a multi-model weighted fusion framework (WFF) for benign and malignant diagnosis of spinal tumors based on magnetic resonance imaging (MRI) images and age information.

METHODS

The proposed WFF included a tumor detection model, sequence classification model, and age information statistic module based on sagittal MRI sequences obtained from 585 patients with spinal tumors (270 benign, 315 malignant) between January 2006 and December 2019 from the cooperative hospital. The experimental results of the WFF were compared with those of one radiologist (D1) and two spine surgeons (D2 and D3).

RESULTS

In the case of reference age information, the accuracy (ACC) (0.821) of WFF was higher than three doctors' ACC (D1: 0.686; D2: 0.736; D3: 0.636). Without age information, the ACC (0.800) of the WFF was also higher than that of the three doctors (D1: 0.750; D2: 0.664; D3:0.614).

CONCLUSIONS

The proposed WFF is effective in the diagnosis of benign and malignant spinal tumors with complex histological types on MRI.

Automated segmentation of the fractured vertebrae on CT and its applicability in a radiomics model to predict fracture malignancy

Although CT radiomics has shown promising results in the evaluation of vertebral fractures, the need for manual segmentation of fractured vertebrae limited the routine clinical implementation of radiomics. Therefore, automated segmentation of fractured vertebrae is needed for successful clinical use of radiomics. In this study, we aimed to develop and validate an automated algorithm for segmentation of fractured vertebral bodies on CT, and to evaluate the applicability of the algorithm in a radiomics prediction model to differentiate benign and malignant fractures. A convolutional neural network was trained to perform automated segmentation of fractured vertebral bodies using 341 vertebrae with benign or malignant fractures from 158 patients, and was validated on independent test sets (internal test, 86 vertebrae [59 patients]; external test, 102 vertebrae [59 patients]). Then, a radiomics model predicting fracture malignancy on CT was constructed, and the prediction performance was compared between automated and human expert segmentations. The algorithm achieved good agreement with human expert segmentation at testing (Dice similarity coefficient, 0.93-0.94; cross-sectional area error, 2.66-2.97%; average surface distance, 0.40-0.54 mm). The radiomics model demonstrated good performance in the training set (AUC, 0.93). In the test sets, automated and human expert segmentations showed comparable prediction performances (AUC, internal test, 0.80 vs 0.87, p = 0.044; external test, 0.83 vs 0.80, p = 0.37). In summary, we developed and validated an automated segmentation algorithm that showed comparable performance to human expert segmentation in a CT radiomics model to predict fracture malignancy, which may enable more practical clinical utilization of radiomics.

Study on Automatic Multi-Classification of Spine Based on Deep Learning and Postoperative Infection Screening

The preoperative qualitative and hierarchical diagnosis of intervertebral foramen stenosis is very important for clinicians to explore the effect of multimodal analgesia nursing on pain control after spinal fusion and to formulate treatment strategies and patients' health recovery. However, there are still many problems in this aspect, and there is a lack of relevant research and effective methods to assist clinicians in diagnosis. Therefore, to improve the accuracy of computer-aided diagnosis of intervertebral foramen stenosis and the work efficiency of doctors, a deep learning automatic grading algorithm of intervertebral foramen stenosis image is proposed in this study. The image of intervertebral foramen was extracted from the MRI image of sagittal spine, and the image was preprocessed. 86 patients with spinal fusion treated in our hospital, specifically from May 2018 to May 2020, were randomly divided into the control group (routine analgesic nursing) and the multimodal group (multimodal analgesic nursing), with 43 cases in each group. The pain control effect and satisfaction of the two groups were observed. The results after multimodal analgesia nursing show that the VASs of the multimodal group at different time points were significantly lower than those of the control group (P < 0.05); the satisfaction score of pain control in the multimodal group was significantly higher than that in the control group (P < 0.05). Multimodal analgesia nursing for patients undergoing spinal fusion can effectively reduce the degree of postoperative pain and improve the effect of pain control and satisfaction with pain control, which is worthy of promotion.

Diffusion-weighted MRI radiomics of spine bone tumors: feature stability and machine learning-based classification performance

PURPOSE

To evaluate stability and machine learning-based classification performance of radiomic features of spine bone tumors using diffusion- and T2-weighted magnetic resonance imaging (MRI).

MATERIAL AND METHODS

This retrospective study included 101 patients with histology-proven spine bone tumor (22 benign; 38 primary malignant; 41 metastatic). All tumor volumes were manually segmented on morphologic T2-weighted sequences. The same region of interest (ROI) was used to perform radiomic analysis on ADC map. A total of 1702 radiomic features was considered. Feature stability was assessed through small geometrical transformations of the ROIs mimicking multiple manual delineations. Intraclass correlation coefficient (ICC) quantified feature stability. Feature selection consisted of stability-based (ICC > 0.75) and significance-based selections (ranking features by decreasing Mann-Whitney p-value). Class balancing was performed to oversample the minority (i.e., benign) class. Selected features were used to train and test a support vector machine (SVM) to discriminate benign from malignant spine tumors using tenfold cross-validation.

RESULTS

A total of 76.4% radiomic features were stable. The quality metrics for the SVM were evaluated as a function of the number of selected features. The radiomic model with the best performance and the lowest number of features for classifying tumor types included 8 features. The metrics were 78% sensitivity, 68% specificity, 76% accuracy and AUC 0.78.

CONCLUSION

SVM classifiers based on radiomic features extracted from T2- and diffusion-weighted imaging with ADC map are promising for classification of spine bone tumors. Radiomic features of spine bone tumors show good reproducibility rates.

Quantitative Analysis of DCE and DSC-MRI: From Kinetic Modeling to Deep Learning

BACKGROUND

 Perfusion MRI is a well-established imaging modality with a multitude of applications in oncological and cardiovascular imaging. Clinically used processing methods, while stable and robust, have remained largely unchanged in recent years. Despite promising results from novel methods, their relatively minimal improvement compared to established methods did not generally warrant significant changes to clinical perfusion processing.

RESULTS AND CONCLUSION

 Machine learning in general and deep learning in particular, which are currently revolutionizing computer-aided diagnosis, may carry the potential to change this situation and truly capture the potential of perfusion imaging. Recent advances in the training of recurrent neural networks make it possible to predict and classify time series data with high accuracy. Combining physics-based tissue models and deep learning, using either physics-informed neural networks or universal differential equations, simplifies the training process and increases the interpretability of the resulting models. Due to their versatility, these methods will potentially be useful in bridging the gap between microvascular architecture and perfusion parameters, akin to MR fingerprinting in structural MR imaging. Still, further research is urgently needed before these methods may be used in clinical practice.

KEY POINTS

· Machine learning offers promising methods for processing of perfusion data.. · Recurrent neural networks can classify time series with high accuracy.. · Data augmentation is essentially especially when using small datasets..

CITATION FORMAT

· Rotkopf LT, Zhang KS, Tavakoli AA et al. Quantitative Analysis of DCE and DSC-MRI: From Kinetic Modeling to Deep Learning. Fortschr Röntgenstr 2022; DOI: 10.1055/a-1762-5854.

Artificial Intelligence in Bone Metastases: An MRI and CT Imaging Review

(1) Background: The purpose of this review is to study the role of radiomics as a supporting tool in predicting bone disease status, differentiating benign from malignant bone lesions, and characterizing malignant bone lesions. (2) Methods: Two reviewers conducted the literature search independently. Thirteen articles on radiomics as a decision support tool for bone lesions were selected. The quality of the methodology was evaluated according to the radiomics quality score (RQS). (3) Results: All studies were published between 2018 and 2021 and were retrospective in design. Eleven (85%) studies were MRI-based, and two (15%) were CT-based. The sample size was <200 patients for all studies. There is significant heterogeneity in the literature, as evidenced by the relatively low RQS value (average score = 22.6%). There is not a homogeneous protocol used for MRI sequences among the different studies, although the highest predictive ability was always obtained in T2W-FS. Six articles (46%) reported on the potential application of the model in a clinical setting with a decision curve analysis (DCA). (4) Conclusions: Despite the variability in the radiomics method application, the similarity of results and conclusions observed is encouraging. Substantial limits were found; prospective and multicentric studies are needed to affirm the role of radiomics as a supporting tool.

Artificial intelligence applied to musculoskeletal oncology: a systematic review

Developments in artificial intelligence have the potential to improve the care of patients with musculoskeletal tumors. We performed a systematic review of the published scientific literature to identify the current state of the art of artificial intelligence applied to musculoskeletal oncology, including both primary and metastatic tumors, and across the radiology, nuclear medicine, pathology, clinical research, and molecular biology literature. Through this search, we identified 252 primary research articles, of which 58 used deep learning and 194 used other machine learning techniques. Articles involving deep learning have mostly involved bone scintigraphy, histopathology, and radiologic imaging. Articles involving other machine learning techniques have mostly involved transcriptomic analyses, radiomics, and clinical outcome prediction models using medical records. These articles predominantly present proof-of-concept work, other than the automated bone scan index for bone metastasis quantification, which has translated to clinical workflows in some regions. We systematically review and discuss this literature, highlight opportunities for multidisciplinary collaboration, and identify potentially clinically useful topics with a relative paucity of research attention. Musculoskeletal oncology is an inherently multidisciplinary field, and future research will need to integrate and synthesize noisy siloed data from across clinical, imaging, and molecular datasets. Building the data infrastructure for collaboration will help to accelerate progress towards making artificial intelligence truly useful in musculoskeletal oncology.

Artificial intelligence development in pediatric body magnetic resonance imaging: best ideas to adapt from adults

Emerging manifestations of artificial intelligence (AI) have featured prominently in virtually all industries and facets of our lives. Within the radiology literature, AI has shown great promise in improving and augmenting radiologist workflow. In pediatric imaging, while greatest AI inroads have been made in musculoskeletal radiographs, there are certainly opportunities within thoracoabdominal MRI for AI to add significant value. In this paper, we briefly review non-interpretive and interpretive data science, with emphasis on potential avenues for advancement in pediatric body MRI based on similar work in adults. The discussion focuses on MRI image optimization, abdominal organ segmentation, and osseous lesion detection encountered during body MRI in children.

BI-RADS Reading of Non-Mass Lesions on DCE-MRI and Differential Diagnosis Performed by Radiomics and Deep Learning

Background

A wide variety of benign and malignant processes can manifest as non-mass enhancement (NME) in breast MRI. Compared to mass lesions, there are no distinct features that can be used for differential diagnosis. The purpose is to use the BI-RADS descriptors and models developed using radiomics and deep learning to distinguish benign from malignant NME lesions.

Materials and Methods

A total of 150 patients with 104 malignant and 46 benign NME were analyzed. Three radiologists performed reading for morphological distribution and internal enhancement using the 5th BI-RADS lexicon. For each case, the 3D tumor mask was generated using Fuzzy-C-Means segmentation. Three DCE parametric maps related to wash-in, maximum, and wash-out were generated, and PyRadiomics was applied to extract features. The radiomics model was built using five machine learning algorithms. ResNet50 was implemented using three parametric maps as input. Approximately 70% of earlier cases were used for training, and 30% of later cases were held out for testing.

Results

The diagnostic BI-RADS in the original MRI report showed that 104/104 malignant and 36/46 benign lesions had a BI-RADS score of 4A–5. For category reading, the kappa coefficient was 0.83 for morphological distribution (excellent) and 0.52 for internal enhancement (moderate). Segmental and Regional distribution were the most prominent for the malignant group, and focal distribution for the benign group. Eight radiomics features were selected by support vector machine (SVM). Among the five machine learning algorithms, SVM yielded the highest accuracy of 80.4% in training and 77.5% in testing datasets. ResNet50 had a better diagnostic performance, 91.5% in training and 83.3% in testing datasets.

Conclusion

Diagnosis of NME was challenging, and the BI-RADS scores and descriptors showed a substantial overlap. Radiomics and deep learning may provide a useful CAD tool to aid in diagnosis.

T2 -weighted magnetic resonance imaging texture as predictor of low back pain: A texture analysis-based classification pipeline to symptomatic and asymptomatic cases

Low back pain is a very common symptom and the leading cause of disability throughout the world. Several degenerative imaging findings seen on magnetic resonance imaging are associated with low back pain but none of them is specific for the presence of low back pain as abnormal findings are prevalent among asymptomatic subjects as well. The purpose of this population-based study was to investigate if more specific magnetic resonance imaging predictors of low back pain could be found via texture analysis and machine learning. We used this methodology to classify T₂ -weighted magnetic resonance images from the Northern Finland Birth Cohort 1966 data to symptomatic and asymptomatic groups. Lumbar spine magnetic resonance imaging was performed using a fast spin-echo sequence at 1.5 T. Texture analysis pipeline consisting of textural feature extraction, principal component analysis, and logistic regression classifier was applied to the data to classify them into symptomatic (clinically relevant pain with frequency ≥30 days and intensity ≥6/10) and asymptomatic (frequency ≤7 days, intensity ≤3/10, and no previous pain episodes in the follow-up period) groups. Best classification results were observed applying texture analysis to the two lowest intervertebral discs (L4-L5 and L5-S1), with accuracy of 83%, specificity of 83%, sensitivity of 82%, negative predictive value of 94%, precision of 56%, and receiver operating characteristic area-under-curve of 0.91. To conclude, textural features from T₂ -weighted magnetic resonance images can be applied in low back pain classification.

A Primer on the Use of Artificial Intelligence in Spine Surgery

DESIGN

This was a narrative review.

PURPOSE

Summarize artificial intelligence (AI) fundamentals as well as current and potential future uses in spine surgery.

SUMMARY OF BACKGROUND DATA

Although considered futuristic, the field of AI has already had a profound impact on many industries, including health care. Its ability to recognize patterns and self-correct to improve over time mimics human cognitive function, but on a much larger scale.

METHODS

Review of literature on AI fundamentals and uses in spine pathology.

RESULTS

Machine learning (ML), a subset of AI, increases in hierarchy of complexity from classic ML to unsupervised ML to deep leaning, where Language Processing and Computer Vision are possible. AI-based tools have been developed to segment spinal structures, acquire basic spinal measurements, and even identify pathology such as tumor or degeneration. AI algorithms could have use in guiding clinical management through treatment selection, patient-specific prognostication, and even has the potential to power neuroprosthetic devices after spinal cord injury.

CONCLUSION

While the use of AI has pitfalls and should be adopted with caution, future use is promising in the field of spine surgery and medicine as a whole.

LEVEL OF EVIDENCE

Level IV.

Subregional radiomics analysis for the detection of the EGFR mutation on thoracic spinal metastases from lung cancer

The present study intended to use radiomic analysis of spinal metastasis subregions to detect epidermal growth factor receptor (EGFR) mutation. In total, 94 patients with thoracic spinal metastasis originated from primary lung adenocarcinoma (2017-2020) were studied. All patients underwent T1-weighted (T1W) and T2 fat-suppressed (T2FS) MRI scans. The spinal metastases (tumor region) were subdivided into phenotypically consistent subregions based on patient- and population-level clustering: Three subregions, S1, S2 and S3, and the total tumor region. Radiomics features were extracted from each subregion and from the whole tumor region as well. Least shrinkage and selection operator (LASSO) regression were used for feature selection and radiomics signature definition. Detection performance of S3 was better than all other regions using T1W (AUCs, S1 versus S2 versus S3 versus whole tumor, 0.720 versus 0.764 versus 0.786 versus 0.758) and T2FS (AUCs, S1 versus S2 versus S3 versus whole tumor, 0.791 versus 0.708 versus 0.838 versus 0.797) MRI. The multi-regional radiomics signature derived from the joint of inner subregion S3 from T1W and T2FS MRI achieved the best detection capabilities with AUCs of 0.879 (ACC = 0.774, SEN = 0.838, SPE = 0.840) and 0.777 (ACC = 0.688, SEN = 0.947, SPE = 0.615) in the training and test sets, respectively. Our study revealed that MRI-based radiomic analysis of spinal metastasis subregions has the potential to detect the EGFR mutation in patients with primary lung adenocarcinoma.

Predictive effect of DCE-MRI and DWI in brain metastases from NSCLC

Non-small cell lung cancer (NSCLC), a commonly diagnosed lung cancer, is characterized by a high incidence of metastatic spread to the brain, which adversely impacts prognosis. The present study aimed to assess the value of combined dynamic contrast-enhanced MRI (DCE-MRI) and diffusion-weighted imaging (DWI) in predicting the treatment outcomes of whole-brain radiotherapy (WBRT) and gefitinib in brain metastases from non-small cell lung cancer (NSCLC) from the perspectives of response rate and short- and long-term efficacy. These results suggested that the indicators measured by DCE-MRI combined with DWI can be used as key imaging-derived markers that predicted the efficacy of WBRT combined with gefitinib in NSCLC patients with brain metastases. Specifically, patients with higher ΔADC_mid and ΔADC_post values showed better treatment outcomes. ROC curve analysis indicated ADC_post, ΔADC_post, ΔADC_post (%), and tumor regression rate as the best predictors of efficacy of WBRT combined with gefitinib in these patients. The short-term and long-term effects noted were also significant. Taken together, the findings of this study reveal that tumor regression rate, ADC_post, ΔADC_post, and ΔADC_post (%) can be used as important imaging indicators that predict the therapeutic effect of WBRT combined with gefitinib in NSCLC patients with brain metastases.

Vertebral MRI-based radiomics model to differentiate multiple myeloma from metastases: influence of features number on logistic regression model performance

OBJECTIVES

This study aimed to use the most frequent features to establish a vertebral MRI-based radiomics model that could differentiate multiple myeloma (MM) from metastases and compare the model performance with different features number.

METHODS

We retrospectively analyzed conventional MRI (T1WI and fat-suppression T2WI) of 103 MM patients and 138 patients with metastases. The feature selection process included four steps. The first three steps defined as conventional feature selection (CFS), carried out 50 times (ten times with 5-fold cross-validation), included variance threshold, SelectKBest, and least absolute shrinkage and selection operator. The most frequent fixed features were selected for modeling during the last step. The number of events per independent variable (EPV) is the number of patients in a smaller subgroup divided by the number of radiomics features considered in developing the prediction model. The EPV values considered were 5, 10, 15, and 20. Therefore, we constructed four models using the top 16, 8, 6, and 4 most frequent features, respectively. The models constructed with features selected by CFS were also compared.

RESULTS

The AUCs of 20EPV-Model, 15EPV-Model, and CSF-Model (AUC = 0.71, 0.81, and 0.78) were poor than 10EPV-Model (AUC = 0.84, p < 0.001). The AUC of 10EPV-Model was comparable with 5EPV-Model (AUC = 0.85, p = 0.480).

CONCLUSIONS

The radiomics model constructed with an appropriate small number of the most frequent features could well distinguish metastases from MM based on conventional vertebral MRI. Based on our results, we recommend following the 10 EPV as the rule of thumb for feature selection.

KEY POINTS

• The developed radiomics model could distinguish metastases from multiple myeloma based on conventional vertebral MRI. • An accurate model based on just a handful of the most frequent features could be constructed by utilizing multiple feature reduction techniques. • An event per independent variable value of 10 is recommended as a rule of thumb for modeling feature selection.

A predictive model for pain response following radiotherapy for treatment of spinal metastases

To establish a predictive model for pain response following radiotherapy using a combination of radiomic and clinical features of spinal metastasis. This retrospective study enrolled patients with painful spine metastases who received palliative radiation therapy from 2018 to 2019. Pain response was defined using the International Consensus Criteria. The clinical and radiomic features were extracted from medical records and pre-treatment CT images. Feature selection was performed and a random forests ensemble learning method was used to build a predictive model. Area under the curve (AUC) was used as a predictive performance metric. 69 patients were enrolled with 48 patients showing a response. Random forest models built on the radiomic, clinical, and ‘combined’ features achieved an AUC of 0.824, 0.702, 0.848, respectively. The sensitivity and specificity of the combined features model were 85.4% and 76.2%, at the best diagnostic decision point. We built a pain response model in patients with spinal metastases using a combination of clinical and radiomic features. To the best of our knowledge, we are the first to examine pain response using pre-treatment CT radiomic features. Our model showed the potential to predict patients who respond to radiation therapy.

Radiomics in Oncology, Part 2: Thoracic, Genito-Urinary, Breast, Neurological, Hematologic and Musculoskeletal Applications

Simple Summary

This Part II is an overview of the main applications of Radiomics in oncologic imaging with a focus on diagnosis, prognosis prediction and assessment of response to therapy in thoracic, genito-urinary, breast, neurologic, hematologic and musculoskeletal oncology. In this part II we describe the radiomic applications, limitations and future perspectives for each pre-eminent tumor. In the future, Radiomics could have a pivotal role in management of cancer patients as an imaging tool to support clinicians in decision making process. However, further investigations need to obtain some stable results and to standardize radiomic analysis (i.e., image acquisitions, segmentation and model building) in clinical routine.

Abstract

Radiomics has the potential to play a pivotal role in oncological translational imaging, particularly in cancer detection, prognosis prediction and response to therapy evaluation. To date, several studies established Radiomics as a useful tool in oncologic imaging, able to support clinicians in practicing evidence-based medicine, uniquely tailored to each patient and tumor. Mineable data, extracted from medical images could be combined with clinical and survival parameters to develop models useful for the clinicians in cancer patients’ assessment. As such, adding Radiomics to traditional subjective imaging may provide a quantitative and extensive cancer evaluation reflecting histologic architecture. In this Part II, we present an overview of radiomic applications in thoracic, genito-urinary, breast, neurological, hematologic and musculoskeletal oncologic applications.

An update in musculoskeletal tumors: from quantitative imaging to radiomics

In the last two decades, relevant progress has been made in the diagnosis of musculoskeletal tumors due to the development of new imaging tools, such as diffusion-weighted imaging, diffusion kurtosis imaging, magnetic resonance spectroscopy, and diffusion tensor imaging. Another important role has been played by the development of artificial intelligence software based on complex algorithms, which employ computing power in the detection of specific tumor types. The aim of this article is to report the most advanced imaging techniques focusing on their advantages in clinical practice.

Combined radiomics-clinical model to predict malignancy of vertebral compression fractures on CT

OBJECTIVES

To develop and validate a combined radiomics-clinical model to predict malignancy of vertebral compression fractures on CT.

METHODS

One hundred sixty-five patients with vertebral compression fractures were allocated to training (n = 110 [62 acute benign and 48 malignant fractures]) and validation (n = 55 [30 acute benign and 25 malignant fractures]) cohorts. Radiomics features (n = 144) were extracted from non-contrast-enhanced CT images. Radiomics score was constructed by applying least absolute shrinkage and selection operator regression to reproducible features. A combined radiomics-clinical model was constructed by integrating significant clinical parameters with radiomics score using multivariate logistic regression analysis. Model performance was quantified in terms of discrimination and calibration. The model was internally validated on the independent data set.

RESULTS

The combined radiomics-clinical model, composed of two significant clinical predictors (age and history of malignancy) and the radiomics score, showed good calibration (Hosmer-Lemeshow test, p > 0.05) and discrimination in both training (AUC, 0.970) and validation (AUC, 0.948) cohorts. Discrimination performance of the combined model was higher than that of either the radiomics score (AUC, 0.941 in training cohort and 0.852 in validation cohort) or the clinical predictor model (AUC, 0.924 in training cohort and 0.849 in validation cohort). The model stratified patients into groups with low and high risk of malignant fracture with an accuracy of 98.2% in the training cohort and 90.9% in the validation cohort.

CONCLUSIONS

The combined radiomics-clinical model integrating clinical parameters with radiomics score could predict malignancy in vertebral compression fractures on CT with high discriminatory ability.

KEY POINTS

• A combined radiomics-clinical model was constructed to predict malignancy of vertebral compression fractures on CT by combining clinical parameters and radiomics features. • The model showed good calibration and discrimination in both training and validation cohorts. • The model showed high accuracy in the stratification of patients into groups with low and high risk of malignant vertebral compression fractures.

Differentiating Between Multiple Myeloma and Metastasis Subtypes of Lumbar Vertebra Lesions Using Machine Learning-Based Radiomics

Objective

To determine whether machine learning based on conventional magnetic resonance imaging (MRI) sequences have the potential for the differential diagnosis of multiple myeloma (MM), and different tumor metastasis lesions of the lumbar vertebra.

Methods

We retrospectively enrolled 107 patients newly diagnosed with MM and different metastasis of the lumbar vertebra. In total 60 MM lesions and 118 metastasis lesions were selected for training classifiers (70%) and subsequent validation (30%). Following segmentation, 282 texture features were extracted from both T1WI and T2WI images. Following regression analysis using the least absolute shrinkage and selection operator (LASSO) algorithm, the following machine learning models were selected: Support‐Vector Machine (SVM), K-Nearest Neighbor (KNN), Random Forest (RF), Artificial Neural Networks (ANN), and Naïve Bayes (NB) using 10-fold cross validation, and the performances were evaluated using a confusion matrix. Matthews correlation coefficient (MCC), sensitivity, specificity, and accuracy of the models were also calculated.

Results

To differentiate MM and metastasis, 13 features in the T1WI images and 9 features in the T2WI images were obtained. Among the 10 classifiers, the ANN classifier from the T2WI images achieved the best performance (MCC = 0.605) with accuracy, sensitivity, and specificity of 0.815, 0.879, and 0.790, respectively, in the validation cohort. To differentiate MM and metastasis subtypes, eight features in the T1WI images and seven features in the T2WI images were obtained. Among the 10 classifiers, the ANN classifier from the T2WI images achieved the best performance (MCC = 0.560, 0.412, 0.449), respectively, with accuracy = 0.648; sensitivity 0.714, 0.821, 0.897 and specificity 0.775, 0.600, 0.640 for the MM, lung, and other metastases, respectively, in the validation cohort.

Conclusions

Machine learning–based classifiers showed a satisfactory performance in differentiating MM lesions from those of tumor metastasis. While their value for distinguishing myeloma from different metastasis subtypes was moderate.

Radiomic Machine Learning Classifiers in Spine Bone Tumors: A Multi-Software, Multi-Scanner Study

PURPOSE

Spinal lesion differential diagnosis remains challenging even in MRI. Radiomics and machine learning (ML) have proven useful even in absence of a standardized data mining pipeline. We aimed to assess ML diagnostic performance in spinal lesion differential diagnosis, employing radiomic data extracted by different software.

METHODS

Patients undergoing MRI for a vertebral lesion were retrospectively analyzed (n = 146, 67 males, 79 females; mean age 63 ± 16 years, range 8-89 years) and constituted the train (n = 100) and internal test cohorts (n = 46). Part of the latter had additional prior exams which constituted a multi-scanner, external test cohort (n = 35). Lesions were labeled as benign or malignant (2-label classification), and benign, primary malignant or metastases (3-label classification) for classification analyses. Features extracted via 3D Slicer heterogeneityCAD module (hCAD) and PyRadiomics were independently used to compare different combinations of feature selection methods and ML classifiers (n = 19).

RESULTS

In total, 90 and 1548 features were extracted by hCAD and PyRadiomics, respectively. The best feature selection method-ML algorithm combination was selected by 10 iterations of 10-fold cross-validation in the training data. For the 2-label classification ML obtained 94% accuracy in the internal test cohort, using hCAD data, and 86% in the external one. For the 3-label classification, PyRadiomics data allowed for 80% and 69% accuracy in the internal and external test sets, respectively.

CONCLUSIONS

MRI radiomics combined with ML may be useful in spinal lesion assessment. More robust pre-processing led to better consistency despite scanner and protocol heterogeneity.

Machine and Deep Learning Based Radiomics Models for Preoperative Prediction of Benign and Malignant Sacral Tumors

Purpose

To assess the performance of deep neural network (DNN) and machine learning based radiomics on 3D computed tomography (CT) and clinical characteristics to predict benign or malignant sacral tumors.

Materials and methods

This single-center retrospective analysis included 459 patients with pathologically proven sacral tumors. After semi-automatic segmentation, 1,316 hand-crafted radiomics features of each patient were extracted. All models were built on training set (321 patients) and tested on validation set (138 patients). A DNN model and four machine learning classifiers (logistic regression [LR], random forest [RF], support vector machine [SVM] and k-nearest neighbor [KNN]) based on CT features and clinical characteristics were built, respectively. The area under the receiver operating characteristic curve (AUC) and accuracy (ACC) were used to evaluate different models.

Results

In total, 459 patients (255 males, 204 females; mean age of 42.1 ± 17.8 years, range 4–82 years) were enrolled in this study, including 206 cases of benign tumor and 253 cases of malignant tumor. The sex, age and tumor size had significant differences between the benign tumors and malignant tumors (χ²_sex = 10.854, Z_age = −6.616, Z_size = 2.843, P < 0.05). The radscore, sex, and age were important indicators for differentiating benign and malignant sacral tumors (odds ratio [OR]1 = 2.492, OR2 = 2.236, OR3 = 1.037, P < 0.01). Among the four clinical-radiomics models (RMs), clinical-LR had the best performance in the validation set (AUC = 0.84, ACC = 0.81). The clinical-DNN model also achieved a high performance (an AUC of 0.83 and an ACC of 0.76 in the validation set) in identifying benign and malignant sacral tumors.

Conclusions

Both the clinical-LR and clinical-DNN models would have a high impact on assisting radiologists in their clinical diagnosis of sacral tumors.

Prediction of breast cancer molecular subtypes on DCE-MRI using convolutional neural network with transfer learning between two centers

OBJECTIVES

To apply deep learning algorithms using a conventional convolutional neural network (CNN) and a recurrent CNN to differentiate three breast cancer molecular subtypes on MRI.

METHODS

A total of 244 patients were analyzed, 99 in training dataset scanned at 1.5 T and 83 in testing-1 and 62 in testing-2 scanned at 3 T. Patients were classified into 3 subtypes based on hormonal receptor (HR) and HER2 receptor: (HR+/HER2-), HER2+, and triple negative (TN). Only images acquired in the DCE sequence were used in the analysis. The smallest bounding box covering tumor ROI was used as the input for deep learning to develop the model in the training dataset, by using a conventional CNN and the convolutional long short-term memory (CLSTM). Then, transfer learning was applied to re-tune the model using testing-1(2) and evaluated in testing-2(1).

RESULTS

In the training dataset, the mean accuracy evaluated using tenfold cross-validation was higher by using CLSTM (0.91) than by using CNN (0.79). When the developed model was applied to the independent testing datasets, the accuracy was 0.4-0.5. With transfer learning by re-tuning parameters in testing-1, the mean accuracy reached 0.91 by CNN and 0.83 by CLSTM, and improved accuracy in testing-2 from 0.47 to 0.78 by CNN and from 0.39 to 0.74 by CLSTM. Overall, transfer learning could improve the classification accuracy by greater than 30%.

CONCLUSIONS

The recurrent network using CLSTM could track changes in signal intensity during DCE acquisition, and achieved a higher accuracy compared with conventional CNN during training. For datasets acquired using different settings, transfer learning can be applied to re-tune the model and improve accuracy.

KEY POINTS

• Deep learning can be applied to differentiate breast cancer molecular subtypes. • The recurrent neural network using CLSTM could track the change of signal intensity in DCE images, and achieved a higher accuracy compared with conventional CNN during training. • For datasets acquired using different scanners with different imaging protocols, transfer learning provided an efficient method to re-tune the classification model and improve accuracy.

Applications of Artificial Intelligence in Musculoskeletal Imaging: From the Request to the Report

Artificial intelligence (AI) will transform every step in the imaging value chain, including interpretive and noninterpretive components. Radiologists should familiarize themselves with AI developments to become leaders in their clinical implementation. This article explores the impact of AI through the entire imaging cycle of musculoskeletal radiology, from the placement of the requisition to the generation of the report, with an added Canadian perspective. Noninterpretive tasks which may be assisted by AI include the ordering of appropriate imaging tests, automatic exam protocoling, optimized scheduling, shorter magnetic resonance imaging acquisition time, computed tomography imaging with reduced artifact and radiation dose, and new methods of generation and utilization of radiology reports. Applications of AI for image interpretation consist of the determination of bone age, body composition measurements, screening for osteoporosis, identification of fractures, evaluation of segmental spine pathology, detection and temporal monitoring of osseous metastases, diagnosis of primary bone and soft tissue tumors, and grading of osteoarthritis.