Computer-aided diagnostic models to classify lymph node metastasis and lymphoma involvement in enlarged cervical lymph nodes using PET/CT

Prognostic value of combining clinical factors, 18F-FDG PET-based intensity, volumetric features, and deep learning predictor in patients with EGFR-mutated lung adenocarcinoma undergoing targeted therapies: a cross-scanner and temporal validation study

OBJECTIVE

To investigate the prognostic value of 18F-FDG PET-based intensity, volumetric features, and deep learning (DL) across different generations of PET scanners in patients with epidermal growth factor receptor (EGFR)-mutated lung adenocarcinoma receiving tyrosine kinase inhibitor (TKI) treatment.

METHODS

We retrospectively analyzed the pre-treatment 18F-FDG PET of 217 patients with advanced-stage lung adenocarcinoma and actionable EGFR mutations who received TKI as first-line treatment. Patients were separated into analog (n = 166) and digital (n = 51) PET cohorts. 18F-FDG PET-derived intensity, volumetric features, ResNet-50 DL of the primary tumor, and clinical variables were used to predict progression-free survival (PFS). Independent prognosticators were used to develop prediction model. Model was developed and validated in the analog and digital PET cohorts, respectively.

RESULTS

In the analog PET cohort, female sex, stage IVB status, exon 19 deletion, SUVmax, metabolic tumor volume, and positive DL prediction independently predicted PFS. The model devised from these six prognosticators significantly predicted PFS in the analog (HR = 1.319, p < 0.001) and digital PET cohorts (HR = 1.284, p = 0.001). Our model provided incremental prognostic value to staging status (c-indices = 0.738 vs. 0.558 and 0.662 vs. 0.598 in the analog and digital PET cohorts, respectively). Our model also demonstrated a significant prognostic value for overall survival (HR = 1.198, p < 0.001, c-index = 0.708 and HR = 1.256, p = 0.021, c-index = 0.664 in the analog and digital PET cohorts, respectively).

CONCLUSIONS

Combining 18F-FDG PET-based intensity, volumetric features, and DL with clinical variables may improve the survival stratification in patients with advanced EGFR-mutated lung adenocarcinoma receiving TKI treatment. Implementing the prediction model across different generations of PET scanners may be feasible and facilitate tailored therapeutic strategies for these patients.

Application of radiomics and machine learning to thyroid diseases in nuclear medicine: a systematic review

BACKGROUND

In the last years growing evidences on the role of radiomics and machine learning (ML) applied to different nuclear medicine imaging modalities for the assessment of thyroid diseases are starting to emerge. The aim of this systematic review was therefore to analyze the diagnostic performances of these technologies in this setting.

METHODS

A wide literature search of the PubMed/MEDLINE, Scopus and Web of Science databases was made in order to find relevant published articles about the role of radiomics or ML on nuclear medicine imaging for the evaluation of different thyroid diseases.

RESULTS

Seventeen studies were included in the systematic review. Radiomics and ML were applied for assessment of thyroid incidentalomas at 18 F-FDG PET, evaluation of cytologically indeterminate thyroid nodules, assessment of thyroid cancer and classification of thyroid diseases using nuclear medicine techniques.

CONCLUSION

Despite some intrinsic limitations of radiomics and ML may have affect the results of this review, these technologies seem to have a promising role in the assessment of thyroid diseases. Validation of preliminary findings in multicentric studies is needed to translate radiomics and ML approaches in the clinical setting.

Clinical application of 18F-fluorodeoxyglucose positron emission tomography/computed tomography radiomics-based machine learning analyses in the field of oncology

Machine learning (ML) analyses using 18F-fluorodeoxyglucose (18F-FDG) positron emission tomography (PET)/computed tomography (CT) radiomics features have been applied in the field of oncology. The current review aimed to summarize the current clinical articles about 18F-FDG PET/CT radiomics-based ML analyses to solve issues in classifying or constructing prediction models for several types of tumors. In these studies, lung and mediastinal tumors were the most commonly evaluated lesions, followed by lymphatic, abdominal, head and neck, breast, gynecological, and other types of tumors. Previous studies have commonly shown that 18F-FDG PET radiomics-based ML analysis has good performance in differentiating benign from malignant tumors, predicting tumor characteristics and stage, therapeutic response, and prognosis by examining significant differences in the area under the receiver operating characteristic curves, accuracies, or concordance indices (> 0.70). However, these studies have reported several ML algorithms. Moreover, different ML models have been applied for the same purpose. Thus, various procedures were used in 18F-FDG PET/CT radiomics-based ML analysis in oncology, and 18F-FDG PET/CT radiomics-based ML models, which are easy and universally applied in clinical practice, would be expected to be established.

A hybrid few-shot multiple-instance learning model predicting the aggressiveness of lymphoma in PET/CT images

BACKGROUND AND OBJECTIVE

Patients with aggressive non-Hodgkin lymphoma (NHL) undergo distinct therapy strategies compared with indolent NHL patients. However, it is challenging to estimate NHL aggressiveness based on visual inspection of positron emission tomography (PET) or computed tomography (CT) images. Since diffuse large B-cell lymphoma (DLBCL) and Follicular lymphoma (FL) are the most typical and dominant aggressive and indolent NHL, respectively, this study aims to develop an artificial-intelligence-enabled model to distinguish DLBCL from FL in PET/CT images as the first step to tackle this challenge.

METHODS

We propose a hybrid few-shot multiple-instance learning model to predict the aggressiveness of the NHL. First, rotation-based self-supervision learning (SSL) has been employed to train the encoder on a large-scale, publicly available CT image dataset. Second, hybrid instance-level features are obtained for each NHL lesion by combining deep features with the radiomics features from both PET and CT modalities. Third, instance-level features are transformed into bag-level (or patient-level) representations. Finally, bag-level representations are fed into a distance-based classifier through few-shot learning to predict NHL aggressiveness.

RESULTS

Our model achieves an accuracy of 0.751 ± 0.008, a sensitivity of 0.787 ± 0.012, a specificity of 0.715 ± 0.013, an F1-score of 0.753 ± 0.009, and an area under the curve (AUC) of 0.795 ± 0.009 at the bag level. It outperforms the typical counterparts that use the radiomic features, random forest for feature selection, and support vector machines (SVMs) as classifiers. The three counterparts yield accuracies of 0.714 ± 0.023, 0.705 ± 0.008, and 0.698 ± 0.008, respectively. Moreover, settings of the SSL training dataset (Deep lesion) and task (rotation), hybrid CT and radiomic PET features, the pool-layer strategy of maximum, and distance-based classifier generate the best model.

CONCLUSIONS

A hybrid few-shot multiple-instance learning model can predict lymphoma aggressiveness in PET/CT images and could be a potential tool for determining therapy strategies. Hybrid features and the combination of SSL, few-shot learning, and weakly supervised learning are the two powerful pillars of the model, and these can be expanded to other medical applications with limited samples and incomplete annotations.

A comparison of 18 F-FDG PET-based radiomics and deep learning in predicting regional lymph node metastasis in patients with resectable lung adenocarcinoma: a cross-scanner and temporal validation study

OBJECTIVE

The performance of 18 F-FDG PET-based radiomics and deep learning in detecting pathological regional nodal metastasis (pN+) in resectable lung adenocarcinoma varies, and their use across different generations of PET machines has not been thoroughly investigated. We compared handcrafted radiomics and deep learning using different PET scanners to predict pN+ in resectable lung adenocarcinoma.

METHODS

We retrospectively analyzed pretreatment 18 F-FDG PET from 148 lung adenocarcinoma patients who underwent curative surgery. Patients were separated into analog (n = 131) and digital (n = 17) PET cohorts. Handcrafted radiomics and a ResNet-50 deep-learning model of the primary tumor were used to predict pN+ status. Models were trained in the analog PET cohort, and the digital PET cohort was used for cross-scanner validation.

RESULTS

In the analog PET cohort, entropy, a handcrafted radiomics, independently predicted pN+. However, the areas under the receiver-operating-characteristic curves (AUCs) and accuracy for entropy were only 0.676 and 62.6%, respectively. The ResNet-50 model demonstrated a better AUC and accuracy of 0.929 and 94.7%, respectively. In the digital PET validation cohort, the ResNet-50 model also demonstrated better AUC (0.871 versus 0.697) and accuracy (88.2% versus 64.7%) than entropy. The ResNet-50 model achieved comparable specificity to visual interpretation but with superior sensitivity (83.3% versus 66.7%) in the digital PET cohort.

CONCLUSION

Applying deep learning across different generations of PET scanners may be feasible and better predict pN+ than handcrafted radiomics. Deep learning may complement visual interpretation and facilitate tailored therapeutic strategies for resectable lung adenocarcinoma.

Multi-target reconstruction based on subspace decision optimization for bioluminescence tomography

BACKGROUND AND OBJECTIVE

Bioluminescence tomography (BLT) is a noninvasive optical imaging technique that provides qualitative and quantitative information on the spatial distribution of tumors in living animals. Researchers have proposed a list of algorithms and strategies for BLT reconstruction to improve its reconstruction quality. However, multi-target BLT reconstruction remains challenging in practical clinical applications due to the mutual interference of optical signals and difficulty in source separation.

METHODS

To solve this problem, this study proposes the subspace decision optimization (SDO) approach based on the traditional iterative permissible region strategy. The SDO approach transforms a single permissible region into multiple subspaces by clustering analysis. These subspaces are shrunk based on subspace shrinking optimization to achieve spatial continuity of the permissible regions. In addition, these subspaces are merged to construct a new permissible region and then the next iteration of reconstruction is carried out to ensure the stability of the results. Finally, all the iterative results are optimized based on the normal distribution model and the distribution properties of the targets to ensure the sparsity of each target and the non-biasing of the overall results.

RESULTS

Experimental results show that the SDO approach can automatically identify and separate different targets, ensuring the accuracy and quality of multi-target BLT reconstruction results. Meanwhile, SDO can combine various types of reconstruction algorithms and provide stable and high-quality reconstruction results independent of the algorithm parameters.

CONCLUSIONS

The SDO approach provides an integrated solution to the multi-target BLT reconstruction problem, realizing the whole process including target recognition, separation, reconstruction, and result enhancement, which can extend the application domain of BLT.

Enhancing head and neck tumor management with artificial intelligence: Integration and perspectives

Head and neck tumors (HNTs) constitute a multifaceted ensemble of pathologies that primarily involve regions such as the oral cavity, pharynx, and nasal cavity. The intricate anatomical structure of these regions poses considerable challenges to efficacious treatment strategies. Despite the availability of myriad treatment modalities, the overall therapeutic efficacy for HNTs continues to remain subdued. In recent years, the deployment of artificial intelligence (AI) in healthcare practices has garnered noteworthy attention. AI modalities, inclusive of machine learning (ML), neural networks (NNs), and deep learning (DL), when amalgamated into the holistic management of HNTs, promise to augment the precision, safety, and efficacy of treatment regimens. The integration of AI within HNT management is intricately intertwined with domains such as medical imaging, bioinformatics, and medical robotics. This article intends to scrutinize the cutting-edge advancements and prospective applications of AI in the realm of HNTs, elucidating AI's indispensable role in prevention, diagnosis, treatment, prognostication, research, and inter-sectoral integration. The overarching objective is to stimulate scholarly discourse and invigorate insights among medical practitioners and researchers to propel further exploration, thereby facilitating superior therapeutic alternatives for patients.

Hybrid Models Based on Fusion Features of a CNN and Handcrafted Features for Accurate Histopathological Image Analysis for Diagnosing Malignant Lymphomas

Malignant lymphoma is one of the most severe types of disease that leads to death as a result of exposure of lymphocytes to malignant tumors. The transformation of cells from indolent B-cell lymphoma to B-cell lymphoma (DBCL) is life-threatening. Biopsies taken from the patient are the gold standard for lymphoma analysis. Glass slides under a microscope are converted into whole slide images (WSI) to be analyzed by AI techniques through biomedical image processing. Because of the multiplicity of types of malignant lymphomas, manual diagnosis by pathologists is difficult, tedious, and subject to disagreement among physicians. The importance of artificial intelligence (AI) in the early diagnosis of malignant lymphoma is significant and has revolutionized the field of oncology. The use of AI in the early diagnosis of malignant lymphoma offers numerous benefits, including improved accuracy, faster diagnosis, and risk stratification. This study developed several strategies based on hybrid systems to analyze histopathological images of malignant lymphomas. For all proposed models, the images and extraction of malignant lymphocytes were optimized by the gradient vector flow (GVF) algorithm. The first strategy for diagnosing malignant lymphoma images relied on a hybrid system between three types of deep learning (DL) networks, XGBoost algorithms, and decision tree (DT) algorithms based on the GVF algorithm. The second strategy for diagnosing malignant lymphoma images was based on fusing the features of the MobileNet-VGG16, VGG16-AlexNet, and MobileNet-AlexNet models and classifying them by XGBoost and DT algorithms based on the ant colony optimization (ACO) algorithm. The color, shape, and texture features, which are called handcrafted features, were extracted by four traditional feature extraction algorithms. Because of the similarity in the biological characteristics of early-stage malignant lymphomas, the features of the fused MobileNet-VGG16, VGG16-AlexNet, and MobileNet-AlexNet models were combined with the handcrafted features and classified by the XGBoost and DT algorithms based on the ACO algorithm. We concluded that the performance of the two networks XGBoost and DT, with fused features between DL networks and handcrafted, achieved the best performance. The XGBoost network based on the fused features of MobileNet-VGG16 and handcrafted features resulted in an AUC of 99.43%, accuracy of 99.8%, precision of 99.77%, sensitivity of 99.7%, and specificity of 99.8%. This highlights the significant role of AI in the early diagnosis of malignant lymphoma, offering improved accuracy, expedited diagnosis, and enhanced risk stratification. This study highlights leveraging AI techniques and biomedical image processing; the analysis of whole slide images (WSI) converted from biopsies allows for improved accuracy, faster diagnosis, and risk stratification. The developed strategies based on hybrid systems, combining deep learning networks, XGBoost and decision tree algorithms, demonstrated promising results in diagnosing malignant lymphoma images. Furthermore, the fusion of handcrafted features with features extracted from DL networks enhanced the performance of the classification models.

Role of Artificial Intelligence in PET/CT Imaging for Management of Lymphoma

Our review shows that AI-based analysis of lymphoma whole-body FDG-PET/CT can inform all phases of clinical management including staging, prognostication, treatment planning, and treatment response evaluation. We highlight advancements in the role of neural networks for performing automated image segmentation to calculate PET-based imaging biomarkers such as the total metabolic tumor volume (TMTV). AI-based image segmentation methods are at levels where they can be semi-automatically implemented with minimal human inputs and nearing the level of a second-opinion radiologist. Advances in automated segmentation methods are particularly apparent in the discrimination of lymphomatous vs non-lymphomatous FDG-avid regions, which carries through to automated staging. Automated TMTV calculators, in addition to automated calculation of measures such as Dmax are informing robust models of progression-free survival which can then feed into improved treatment planning.