Image-driven classification of functioning and nonfunctioning pituitary adenoma by deep convolutional neural networks

Artificial intelligence in central-peripheral interaction organ crosstalk: the future of drug discovery and clinical trials

Drug discovery before the 20th century often focused on single genes, molecules, cells, or organs, failing to capture the complexity of biological systems. The emergence of protein-protein interaction network studies in 2001 marked a turning point and promoted a holistic approach that considers the human body as an interconnected system. This is particularly evident in the study of bidirectional interactions between the central nervous system (CNS) and peripheral organs, which are critical for understanding health and disease. Understanding these complex interactions requires integrating multi-scale, heterogeneous data from molecular to organ levels, encompassing both omics (e.g., genomics, proteomics, microbiomics) and non-omics data (e.g., imaging, clinical phenotypes). Artificial intelligence (AI), particularly multi-modal models, has demonstrated significant potential in analyzing CNS-peripheral organ interactions by processing vast, heterogeneous datasets. Specifically, AI facilitates the identification of biomarkers, prediction of therapeutic targets, and simulation of drug effects on multi-organ systems, thereby paving the way for novel therapeutic strategies. This review highlights AI's transformative role in CNS-peripheral interaction research, focusing on its applications in unraveling disease mechanisms, discovering drug targets, and optimizing clinical trials through patient stratification and adaptive trial design.

Radiomics of pituitary adenoma using computer vision: a review

Pituitary adenomas (PA) represent the most common type of sellar neoplasm. Extracting relevant information from radiological images is essential for decision support in addressing various objectives related to PA. Given the critical need for an accurate assessment of the natural progression of PA, computer vision (CV) and artificial intelligence (AI) play a pivotal role in automatically extracting features from radiological images. The field of "Radiomics" involves the extraction of high-dimensional features, often referred to as "Radiomic features," from digital radiological images. This survey offers an analysis of the current state of research in PA radiomics. Our work comprises a systematic review of 34 publications focused on PA radiomics and other automated information mining pertaining to PA through the analysis of radiological data using computer vision methods. We begin with a theoretical exploration essential for understanding the theoretical background of radionmics, encompassing traditional approaches from computer vision and machine learning, as well as the latest methodologies in deep radiomics utilizing deep learning (DL). Thirty-four research works under examination are comprehensively compared and evaluated. The overall results achieved in the analyzed papers are high, e.g., the best accuracy is up to 96% and the best achieved AUC is up to 0.99, which establishes optimism for the successful use of radiomic features. Methods based on deep learning seem to be the most promising for the future. In relation to this perspective DL methods, several challenges are remarkable: It is important to create high-quality and sufficiently extensive datasets necessary for training deep neural networks. Interpretability of deep radiomics is also a big open challenge. It is necessary to develop and verify methods that will explain to us how deep radiomic features reflect various physics-explainable aspects.

Artificial Intelligence in Rhinology

Rhinology, allergy, and skull base surgery are fields primed for the integration and implementation of artificial intelligence (AI). The heterogeneity of the disease processes within these fields highlights the opportunity for AI to augment clinical care and promote personalized medicine. Numerous research studies have been published demonstrating the development and clinical potential of AI models within the field. Most describe in silico evaluation models without direct clinical implementation. The major themes of existing studies include diagnostic or clinical decisions support, clustering patients into specific phenotypes or endotypes, predicting post-treatment outcomes, and surgical planning.

The current state of MRI-based radiomics in pituitary adenoma: promising but challenging

In the clinical diagnosis and treatment of pituitary adenomas, MRI plays a crucial role. However, traditional manual interpretations are plagued by inter-observer variability and limitations in recognizing details. Radiomics, based on MRI, facilitates quantitative analysis by extracting high-throughput data from images. This approach elucidates correlations between imaging features and pituitary tumor characteristics, thereby establishing imaging biomarkers. Recent studies have demonstrated the extensive application of radiomics in differential diagnosis, subtype identification, consistency evaluation, invasiveness assessment, and treatment response in pituitary adenomas. This review succinctly presents the general workflow of radiomics, reviews pertinent literature with a summary table, and provides a comparative analysis with traditional methods. We further elucidate the connections between radiological features and biological findings in the field of pituitary adenoma. While promising, the clinical application of radiomics still has a considerable distance to traverse, considering the issues with reproducibility of imaging features and the significant heterogeneity in pituitary adenoma patients.

Current status of artificial intelligence technologies in pituitary adenoma surgery: a scoping review

PURPOSE

Pituitary adenoma surgery is a complex procedure due to critical adjacent neurovascular structures, variations in size and extensions of the lesions, and potential hormonal imbalances. The integration of artificial intelligence (AI) and machine learning (ML) has demonstrated considerable potential in assisting neurosurgeons in decision-making, optimizing surgical outcomes, and providing real-time feedback. This scoping review comprehensively summarizes the current status of AI/ML technologies in pituitary adenoma surgery, highlighting their strengths and limitations.

METHODS

PubMed, Embase, Web of Science, and Scopus were searched following the PRISMA-ScR guidelines. Studies discussing the use of AI/ML in pituitary adenoma surgery were included. Eligible studies were grouped to analyze the different outcomes of interest of current AI/ML technologies.

RESULTS

Among the 2438 identified articles, 44 studies met the inclusion criteria, with a total of seventeen different algorithms utilized across all studies. Studies were divided into two groups based on their input type: clinicopathological and imaging input. The four main outcome variables evaluated in the studies included: outcome (remission, recurrence or progression, gross-total resection, vision improvement, and hormonal recovery), complications (CSF leak, readmission, hyponatremia, and hypopituitarism), cost, and adenoma-related factors (aggressiveness, consistency, and Ki-67 labeling) prediction. Three studies focusing on workflow analysis and real-time navigation were discussed separately.

CONCLUSION

AI/ML modeling holds promise for improving pituitary adenoma surgery by enhancing preoperative planning and optimizing surgical strategies. However, addressing challenges such as algorithm selection, performance evaluation, data heterogeneity, and ethics is essential to establish robust and reliable ML models that can revolutionize neurosurgical practice and benefit patients.

Preoperatively Predicting Ki67 Expression in Pituitary Adenomas Using Deep Segmentation Network and Radiomics Analysis Based on Multiparameter MRI

RATIONALE AND OBJECTIVES

Ki67 proliferation index is associated with more aggressive tumor behavior and recurrence of pituitary adenomas (PAs). Recently, radiomics and deep learning have been introduced into the study of pituitary tumors. The present study aimed to investigate the feasibility of predicting the Ki67 proliferation index of PAs using the deep segmentation network and radiomics analysis based on multiparameter MRI.

MATERIALS AND METHODS

First, the cfVB-Net autosegmentation model was trained; subsequently, its performance was evaluated in terms of the dice similarity coefficient (DSC). In the present study, 1214 patients were classified into the high Ki67 expression group (HG) and the low Ki67 expression group (LG). Analyses of three classification models based on radiomics features were performed to distinguish HG from LG. Clinical factors, imaging features, and Radscores were collectively used to create a nomogram in order to effectively predict Ki67 expression.

RESULTS

The cfVB-Net segmentation model demonstrated good performance (DSC: 0.723-0.930). Overall, 18, 15, and 11 optimal features in contrast-enhanced (CE) T1WI, T1WI, and T2WI were obtained for differentiating between HG and LG, respectively. Notably, the best results were presented in the bagging decision tree when CE T1WI and T1WI were combined (area under the receiver operating characteristic curve: training set, 0.927; validation set, 0.831; and independent testing set, 0.825). In the nomogram, age, Hardy' grade, and Radscores were identified as risk predictors of high Ki67 expression.

CONCLUSION

The deep segmentation network and radiomics analysis based on multiparameter MRI exhibited good performance and clinical application value in predicting the expression of Ki67 in PAs.

Radiomics model and clinical scale for the preoperative diagnosis of silent corticotroph adenomas

OBJECTIVE

Silent corticotroph adenomas (SCAs) are a subtype of nonfunctioning pituitary adenomas that exhibit more aggressive behavior. However, rapid and accurate preoperative diagnostic methods are currently lacking.

DESIGN

The purpose of this study was to examine the differences between SCA and non-SCA features and to establish radiomics models and a clinical scale for rapid and accurate prediction.

METHODS

A total of 260 patients (72 SCAs vs. 188 NSCAs) with nonfunctioning adenomas from Peking Union Medical College Hospital were enrolled in the study as the internal dataset. Thirty-five patients (6 SCAs vs. 29 NSCAs) from Fuzhou General Hospital were enrolled as the external dataset. Radiomics models and an SCA scale to preoperatively diagnose SCAs were established based on MR images and clinical features.

RESULTS

There were more female patients (internal dataset: p < 0.001; external dataset: p = 0.028) and more multiple microcystic changes (internal dataset: p < 0.001; external dataset: p = 0.012) in the SCA group. MRI showed more invasiveness (higher Knosp grades, p ≤ 0.001). The radiomics model achieved AUCs of 0.931 and 0.937 in the internal and external datasets, respectively. The clinical scale achieved an AUC of 0.877 and a sensitivity of 0.952 in the internal dataset and an AUC of 0.899 and a sensitivity of 1.0 in the external dataset.

CONCLUSIONS

Based on clinical information and imaging characteristics, the constructed radiomics model achieved high preoperative diagnostic ability. The SCA scale achieved the purpose of rapidity and practicality while ensuring sensitivity, which is conducive to simplifying clinical work.

Predicting cognitive impairment in chronic kidney disease patients using structural and functional brain network: An application study of artificial intelligence

OBJECTIVE

To develop and validate artificial intelligence models for the prediction of cognitive impairment in chronic kidney disease (CKD) patients using structural and functional brain network.

METHODS

This study retrospectively recruited 621 CKD patients and 625 healthy controls in Jinling hospital and 57 CKD patients in Hainan hospital. These CKD patients were divided into cognitive function impairment (CFI) group and non-CFI group based on diagnostic criteria. All patients underwent brain MRI scan, neuropsychological test and laboratory exam. A deep learning model (Attention MLP) based on structural and functional sub-network (determined by the comparison between the patients and healthy controls) topological properties was developed to generate the MRI signature for the discrimination of CFI. Finally, a clinical-topological logistic regression model was built by combining MRI signature and clinical features. The area under curve (AUC), sensitivity and specificity were calculated to evaluate the model performance. Delong test was used to examine the difference of AUCs between models. The integrated discrimination improvement (IDI) and net reclassification index (NRI) between models were calculated.

RESULTS

Attention MLP model performed well in both internal test set and external test set (AUC = 0.744 and 0.763, respectively). After combining with the clinical features, the model performance was further improved both in the internal (AUC: 0.748) and external test sets (AUC: 0.774), while both IDI and NRI were significant (all p < 0.05) in the external test set. According to the comprehensive comparison, the AUC of the Attention MLP model was significantly or marginal significantly higher than that of traditional machine learning models (logistic regression: AUC = 0.634; support vector machine: AUC = 0.613; decision tree: AUC = 0.539; XGBoost: AUC = 0.639) in internal test set. The results showed that the model built on the combining of structural and functional networks data outperformed those on the single network, as well as the connection matrix.

CONCLUSION

The result indicated that the integration of the clinical information and the MRI signature generated by artificial intelligence model based on structural and functional network topological properties could help to predict the CFI of CKD patients effectively. Our results provided a set of quantifiable imaging biomarkers for CFI which may be beneficial to CKD patients.

Generating novel pituitary datasets from open-source imaging data and deep volumetric segmentation

PURPOSE

The estimated incidence of pituitary adenomas in the general population is 10-30%, yet radiographic diagnosis remains a challenge. Diagnosis is complicated by the heterogeneity of radiographic features in both normal (e.g. complex anatomy, pregnancy) and pathologic states (e.g. primary endocrinopathy, hypophysitis). Clinical symptoms and laboratory testing are often equivocal, which can result in misdiagnosis or unnecessary specialist referrals. Computer vision models can aid in pituitary adenoma diagnosis; however, a major challenge to model development is the lack of dedicated pituitary imaging datasets. We hypothesized that deep volumetric segmentation models trained to extract the sellar and parasellar region from existing whole-brain MRI scans could be used to generate a novel dataset of pituitary imaging.

METHODS

Six open-source whole-brain MRI datasets, created for research purposes, were included for model development. Deep learning-based volumetric segmentation models were trained using 318 manually annotated MRI scans from a single open-source MRI dataset. Out-of-distribution volumetric segmentation performance was then tested on 418 MRIs from five held-out research datasets.

RESULTS

On our annotated images, agreement between manual and model volumetric segmentations was high. Dice scores (a measure of overlap) ranged 0.76-0.82 for both in-distribution and out-of-distribution model testing. In total, 6,755 MRIs from six data sources were included in the final generated pituitary dataset.

CONCLUSIONS

We present the first and largest dataset of pituitary imaging constructed using existing MRI data and deep volumetric segmentation models trained to identify sellar and parasellar anatomy. The model generalizes well across patient populations and MRI scanner types. We hope our pituitary dataset will be an integral part of future machine learning research on pituitary pathologies.

A Convolutional Neural Network Model for Detecting Sellar Floor Destruction of Pituitary Adenoma on Magnetic Resonance Imaging Scans

Objective

Convolutional neural network (CNN) is designed for image classification and recognition with a multi-layer neural network. This study aimed to accurately assess sellar floor invasion (SFI) of pituitary adenoma (PA) using CNN.

Methods

A total of 1413 coronal and sagittal magnetic resonance images were collected from 695 patients with PAs. The enrolled images were divided into the invasive group (n = 530) and the non-invasive group (n = 883) according to the surgical observation of SFI. Before model training, 100 images were randomly selected for the external testing set. The remaining 1313 cases were randomly divided into the training and validation sets at a ratio of 80:20 for model training. Finally, the testing set was imported to evaluate the model performance.

Results

A CNN model with a 10-layer structure (6-layer convolution and 4-layer fully connected neural network) was constructed. After 1000 epoch of training, the model achieved high accuracy in identifying SFI (97.0 and 94.6% in the training and testing sets, respectively). The testing set presented excellent performance, with a model prediction accuracy of 96%, a sensitivity of 0.964, a specificity of 0.958, and an area under the receptor operator curve (AUC-ROC) value of 0.98. Four images in the testing set were misdiagnosed. Three images were misread with SFI (one with conchal type sphenoid sinus), and one image with a relatively intact sellar floor was not identified with SFI.

Conclusion

This study highlights the potential of the CNN model for the efficient assessment of PA invasion.

Deep Learning for Prediction of Progression and Recurrence in Nonfunctioning Pituitary Macroadenomas: Combination of Clinical and MRI Features

Objectives

A subset of non-functioning pituitary macroadenomas (NFMAs) may exhibit early progression/recurrence (P/R) after tumor resection. The purpose of this study was to apply deep learning (DL) algorithms for prediction of P/R in NFMAs.

Methods

From June 2009 to December 2019, 78 patients diagnosed with pathologically confirmed NFMAs, and who had undergone complete preoperative MRI and postoperative MRI follow-up for more than one year, were included. DL classifiers including multi-layer perceptron (MLP) and convolutional neural network (CNN) were used to build predictive models. Categorical and continuous clinical data were fed into the MLP model, and images of preoperative MRI (T2WI and contrast enhanced T1WI) were analyzed by the CNN model. MLP, CNN and multimodal CNN-MLP architectures were performed to predict P/R in NFMAs.

Results

Forty-two (42/78, 53.8%) patients exhibited P/R after surgery. The median follow-up time was 42 months, and the median time to P/R was 25 months. As compared with CNN using MRI (accuracy 83%, precision 87%, and AUC 0.84) or MLP using clinical data (accuracy 73%, precision 73%, and AUC 0.73) alone, the multimodal CNN-MLP model using both clinical and MRI features showed the best performance for prediction of P/R in NFMAs, with accuracy 83%, precision 90%, and AUC 0.85.

Conclusions

DL architecture incorporating clinical and MRI features performs well to predict P/R in NFMAs. Pending more studies to support the findings, the results of this study may provide valuable information for NFMAs treatment planning.