Machine learning-based prediction of outcomes of the endoscopic endonasal approach in Cushing disease: is the future coming?

Current status of artificial intelligence technologies in pituitary adenoma surgery: a scoping review

PURPOSE

Pituitary adenoma surgery is a complex procedure due to critical adjacent neurovascular structures, variations in size and extensions of the lesions, and potential hormonal imbalances. The integration of artificial intelligence (AI) and machine learning (ML) has demonstrated considerable potential in assisting neurosurgeons in decision-making, optimizing surgical outcomes, and providing real-time feedback. This scoping review comprehensively summarizes the current status of AI/ML technologies in pituitary adenoma surgery, highlighting their strengths and limitations.

METHODS

PubMed, Embase, Web of Science, and Scopus were searched following the PRISMA-ScR guidelines. Studies discussing the use of AI/ML in pituitary adenoma surgery were included. Eligible studies were grouped to analyze the different outcomes of interest of current AI/ML technologies.

RESULTS

Among the 2438 identified articles, 44 studies met the inclusion criteria, with a total of seventeen different algorithms utilized across all studies. Studies were divided into two groups based on their input type: clinicopathological and imaging input. The four main outcome variables evaluated in the studies included: outcome (remission, recurrence or progression, gross-total resection, vision improvement, and hormonal recovery), complications (CSF leak, readmission, hyponatremia, and hypopituitarism), cost, and adenoma-related factors (aggressiveness, consistency, and Ki-67 labeling) prediction. Three studies focusing on workflow analysis and real-time navigation were discussed separately.

CONCLUSION

AI/ML modeling holds promise for improving pituitary adenoma surgery by enhancing preoperative planning and optimizing surgical strategies. However, addressing challenges such as algorithm selection, performance evaluation, data heterogeneity, and ethics is essential to establish robust and reliable ML models that can revolutionize neurosurgical practice and benefit patients.

Identifying gray matter alterations in Cushing's disease using machine learning: An interpretable approach

BACKGROUND

Cushing's Disease (CD) is a rare clinical syndrome characterized by excessive secretion of adrenocorticotrophic hormone, leading to significant functional and structural brain alterations as observed in Magnetic Resonance Imaging (MRI). While traditional statistical analysis has been widely employed to investigate these MRI changes in CD, it has lacked the ability to predict individual-level outcomes.

PURPOSE

To address this problem, this paper has proposed an interpretable machine learning (ML) framework, including model-level assessment, feature-level assessment, and biology-level assessment to ensure a comprehensive analysis based on structural MRI of CD.

METHODS

The ML framework has effectively identified the changes in brain regions in the stage of model-level assessment, verified the effectiveness of these altered brain regions to predict CD from normal controls in the stage of feature-level assessment, and carried out a correlation analysis between altered brain regions and clinical symptoms in the stage of biology-level assessment.

RESULTS

The experimental results of this study have demonstrated that the Insula, Fusiform gyrus, Superior frontal gyrus, Precuneus, and the opercular portion of the Inferior frontal gyrus of CD showed significant alterations in brain regions. Furthermore, our study has revealed significant correlations between clinical symptoms and the frontotemporal lobes, insulin, and olfactory cortex, which also have been confirmed by previous studies.

CONCLUSIONS

The ML framework proposed in this study exhibits exceptional potential in uncovering the intricate pathophysiological mechanisms underlying CD, with potential applicability in diagnosing other diseases.

Application of machine learning algorithms in classifying postoperative success in metabolic bariatric surgery: Acomprehensive study

Objectives

Metabolic bariatric surgery is a critical intervention for patients living with obesity and related health issues. Accurate classification and prediction of patient outcomes are vital for optimizing treatment strategies. This study presents a novel machine learning approach to classify patients in the context of metabolic bariatric surgery, providing insights into the efficacy of different models and variable types.

Methods

Various machine learning models, including Gaussian Naive Bayes, Complement Naive Bayes, K-nearest neighbour, Decision Tree, K-nearest neighbour with RandomOverSampler, and K-nearest neighbour with SMOTE, were applied to a dataset of 73 patients. The dataset, comprising psychometric, socioeconomic, and analytical variables, was analyzed to determine the most efficient predictive model. The study also explored the impact of different variable groupings and oversampling techniques.

Results

Experimental results indicate average accuracy values as high as 66.7% for the best model. Enhanced versions of K-nearest neighbour and Decision Tree, along with variations of K-nearest neighbour such as RandomOverSampler and SMOTE, yielded the best results.

Conclusions

The study unveils a promising avenue for classifying patients in the realm of metabolic bariatric surgery. The results underscore the importance of selecting appropriate variables and employing diverse approaches to achieve optimal performance. The developed system holds potential as a tool to assist healthcare professionals in decision-making, thereby enhancing metabolic bariatric surgery outcomes. These findings lay the groundwork for future collaboration between hospitals and healthcare entities to improve patient care through the utilization of machine learning algorithms. Moreover, the findings suggest room for improvement, potentially achievable with a larger dataset and careful parameter tuning.

The State of Machine Learning in Outcomes Prediction of Transsphenoidal Surgery: A Systematic Review

The purpose of this analysis is to assess the use of machine learning (ML) algorithms in the prediction of postoperative outcomes, including complications, recurrence, and death in transsphenoidal surgery. Following Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, we systematically reviewed all papers that used at least one ML algorithm to predict outcomes after transsphenoidal surgery. We searched Scopus, PubMed, and Web of Science databases for studies published prior to May 12, 2021. We identified 13 studies enrolling 5,048 patients. We extracted the general characteristics of each study; the sensitivity, specificity, area under the curve (AUC) of the ML models developed as well as the features identified as important by the ML models. We identified 12 studies with 5,048 patients that included ML algorithms for adenomas, three with 1807 patients specifically for acromegaly, and five with 2105 patients specifically for Cushing's disease. Nearly all were single-institution studies. The studies used a heterogeneous mix of ML algorithms and features to build predictive models. All papers reported an AUC greater than 0.7, which indicates clinical utility. ML algorithms have the potential to predict postoperative outcomes of transsphenoidal surgery and can improve patient care. Ensemble algorithms and neural networks were often top performers when compared with other ML algorithms. Biochemical and preoperative features were most likely to be selected as important by ML models. Inexplicability remains a challenge, but algorithms such as local interpretable model-agnostic explanation or Shapley value can increase explainability of ML algorithms. Our analysis shows that ML algorithms have the potential to greatly assist surgeons in clinical decision making.

An individualized approach to the management of Cushing disease

Cushing disease caused by an adrenocorticotropic hormone (ACTH)-secreting pituitary corticotroph adenoma leads to hypercortisolaemia with high mortality due to metabolic, cardiovascular, immunological, neurocognitive, haematological and infectious conditions. The disorder is challenging to diagnose because of its common and heterogenous presenting features and the biochemical pitfalls of testing levels of hormones in the hypothalamic-pituitary-adrenal axis. Several late-night salivary cortisol and 24-h urinary free cortisol tests are usually required as well as serum levels of cortisol after a dexamethasone suppression test. MRI might only identify an adenoma in 60-75% of patients and many adenomas are small. Therefore, inferior petrosal sinus sampling remains the gold standard for confirmation of ACTH secretion from a pituitary source. Initial treatment is usually transsphenoidal adenoma resection, but preoperative medical therapy is increasingly being used in some countries and regions. Other management approaches are required if Cushing disease persists or recurs following surgery, including medications to modulate ACTH or block cortisol secretion or actions, pituitary radiation, and/or bilateral adrenalectomy. All patients require lifelong surveillance for persistent comorbidities, clinical and biochemical recurrence, and treatment-related adverse effects (including development of treatment-associated hypopituitarism). In this Review, we discuss challenges in the management of Cushing disease in adults and provide information to guide clinicians when planning an integrated and individualized approach for each patient.

Emerging diagnostic methods and imaging modalities in cushing's syndrome

Endogenous Cushing's syndrome (CS) is a rare disease characterized by prolonged glucocorticoid excess. Timely diagnosis is critical to allow prompt treatment and limit long-term disease morbidity and risk for mortality. Traditional biochemical diagnostic modalities each have limitations and sensitivities and specificities that vary significantly with diagnostic cutoff values. Biochemical evaluation is particularly complex in patients whose hypercortisolemia fluctuates daily, often requiring repetition of tests to confirm or exclude disease, and when delineating CS from physiologic, nonneoplastic states of hypercortisolism. Lastly, traditional pituitary MRI may be negative in up to 60% of patients with adrenocorticotropic hormone (ACTH)-secreting pituitary adenomas (termed "Cushing's disease" [CD]) whereas false positive pituitary MRI findings may exist in patients with ectopic ACTH secretion. Thus, differentiating CD from ectopic ACTH secretion may necessitate dynamic testing or even invasive procedures such as bilateral inferior petrosal sinus sampling. Newer methods may relieve some of the diagnostic uncertainty in CS, providing a more definitive diagnosis prior to subjecting patients to additional imaging or invasive procedures. For example, a novel method of cortisol measurement in patients with CS is scalp hair analysis, a non-invasive method yielding cortisol and cortisone values representing long-term glucocorticoid exposure of the past months. Hair cortisol and cortisone have both shown to differentiate between CS patients and controls with a high sensitivity and specificity. Moreover, advances in imaging techniques may enhance detection of ACTH-secreting pituitary adenomas. While conventional pituitary MRI may fail to identify microadenomas in patients with CD, high-resolution 3T-MRI with 3D-spoiled gradient-echo sequence has thinner sections and superior soft-tissue contrast that can detect adenomas as small as 2 mm. Similarly, functional imaging may improve the identification of ACTH-secreting adenomas noninvasively; Gallium-68-tagged corticotropin-releasing hormone (CRH) combined with PET-CT can be used to detect CRH receptors, which are upregulated on corticotroph adenomas. This technique can delineate functionality of adenomas in patients with CD from patients with ectopic ACTH secretion and false positive pituitary lesions on MRI. Here, we review emerging methods and imaging modalities for the diagnosis of CS, discussing their diagnostic accuracy, strengths and limitations, and applicability to clinical practice.

Machine learning models for differential diagnosis of Cushing's disease and ectopic ACTH secretion syndrome

BACKGROUND

Using machine learning (ML) to explore the noninvasive differential diagnosis of Cushing's disease (CD) and ectopic corticotropin (ACTH) secretion (EAS) model is the next hot research topic. This study was to develop and evaluate ML models for differentially diagnosing CD and EAS in ACTH-dependent Cushing's syndrome (CS).

METHODS

Two hundred sixty-four CD and forty-seven EAS were randomly divided into training and validation and test datasets. We applied 8 ML algorithms to select the most suitable model. The diagnostic performance of the optimal model and bilateral petrosal sinus sampling (BIPSS) were compared in the same cohort.

RESULTS

Eleven adopted variables included age, gender, BMI, duration of disease, morning cortisol, serum ACTH, 24-h UFC, serum potassium, HDDST, LDDST, and MRI. After model selection, the Random Forest (RF) model had the most extraordinary diagnostic performance, with a ROC AUC of 0.976 ± 0.03, a sensitivity of 98.9% ± 4.4%, and a specificity of 87.9% ± 3.0%. The serum potassium, MRI, and serum ACTH were the top three most important features in the RF model. In the validation dataset, the RF model had an AUC of 0.932, a sensitivity of 95.0%, and a specificity of 71.4%. In the complete dataset, the ROC AUC of the RF model was 0.984 (95% CI 0.950-0.993), which was significantly higher than HDDST and LDDST (both p < 0.001). There was no significant statistical difference in the comparison of ROC AUC between the RF model and BIPSS (baseline ROC AUC 0.988 95% CI 0.983-1.000, after stimulation ROC AUC 0.992 95% CI 0.983-1.000). This diagnostic model was shared as an open-access website.

CONCLUSIONS

A machine learning-based model could be a practical noninvasive approach to distinguishing CD and EAS. The diagnostic performance might be close to BIPSS.

Machine Learning Models to Forecast Outcomes of Pituitary Surgery: A Systematic Review in Quality of Reporting and Current Evidence

Background: The complex nature and heterogeneity involving pituitary surgery results have increased interest in machine learning (ML) applications for prediction of outcomes over the last decade. This study aims to systematically review the characteristics of ML models involving pituitary surgery outcome prediction and assess their reporting quality. Methods: We searched the PubMed, Scopus, and Web of Knowledge databases for publications on the use of ML to predict pituitary surgery outcomes. We used the Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) to assess report quality. Our search strategy was based on the terms “artificial intelligence”, “machine learning”, and “pituitary”. Results: 20 studies were included in this review. The principal models reported in each article were post-surgical endocrine outcomes (n = 10), tumor management (n = 3), and intra- and postoperative complications (n = 7). Overall, the included studies adhered to a median of 65% (IQR = 60–72%) of TRIPOD criteria, ranging from 43% to 83%. The median reported AUC was 0.84 (IQR = 0.80–0.91). The most popular algorithms were support vector machine (n = 5) and random forest (n = 5). Only two studies reported external validation and adherence to any reporting guideline. Calibration methods were not reported in 15 studies. No model achieved the phase of actual clinical applicability. Conclusion: Applications of ML in the prediction of pituitary outcomes are still nascent, as evidenced by the lack of any model validated for clinical practice. Although studies have demonstrated promising results, greater transparency in model development and reporting is needed to enable their use in clinical practice. Further adherence to reporting guidelines can help increase AI’s real-world utility and improve clinical practice.

Predictors of improvement in quality of life at 12-month follow-up in patients undergoing anterior endoscopic skull base surgery

Background

Patients with pituitary lesions experience decrements in quality of life (QoL) and treatment aims to arrest or improve QoL decline.

Objective

To detect associations with QoL in trans-nasal endoscopic skull base surgery patients and train supervised learning classifiers to predict QoL improvement at 12 months.

Methods

A supervised learning analysis of a prospective multi-institutional dataset (451 patients) was conducted. QoL was measured using the anterior skull base surgery questionnaire (ASBS). Factors associated with QoL at baseline and at 12-month follow-up were identified using multivariate logistic regression. Multiple supervised learning models were trained to predict postoperative QoL improvement with five-fold cross-validation.

Results

ASBS at 12-month follow-up was significantly higher (132.19,SD = 24.87) than preoperative ASBS (121.87,SD = 25.72,p<0.05). High preoperative scores were significantly associated with institution, diabetes and lesions at the planum sphenoidale / tuberculum sella site. Patients with diabetes were five times less likely to report high preoperative QoL. Low preoperative QoL was significantly associated with female gender, a vision-related presentation, diabetes, secreting adenoma and the cavernous sinus site. Top quartile change in postoperative QoL at 12-month follow-up was negatively associated with baseline hypercholesterolemia, acromegaly and intraoperative CSF leak. Positive associations were detected for lesions at the sphenoid sinus site and deficient preoperative endocrine function. AdaBoost, logistic regression and neural network classifiers yielded the strongest predictive performance.

Conclusion

It was possible to predict postoperative positive change in QoL at 12-month follow-up using perioperative data. Further development and implementation of these models may facilitate improvements in informed consent, treatment decision-making and patient QoL.

Machine learning in neuro-oncology: toward novel development fields

PURPOSE

Artificial Intelligence (AI) involves several and different techniques able to elaborate a large amount of data responding to a specific planned outcome. There are several possible applications of this technology in neuro-oncology.

METHODS

We reviewed, according to PRISMA guidelines, available studies adopting AI in different fields of neuro-oncology including neuro-radiology, pathology, surgery, radiation therapy, and systemic treatments.

RESULTS

Neuro-radiology presented the major number of studies assessing AI. However, this technology is being successfully tested also in other operative settings including surgery and radiation therapy. In this context, AI shows to significantly reduce resources and costs maintaining an elevated qualitative standard. Pathological diagnosis and development of novel systemic treatments are other two fields in which AI showed promising preliminary data.

CONCLUSION

It is likely that AI will be quickly included in some aspects of daily clinical practice. Possible applications of these techniques are impressive and cover all aspects of neuro-oncology.

Integrative Clinical, Radiological, and Molecular Analysis for Predicting Remission and Recurrence of Cushing Disease

CONTEXT

Adrenocorticotropin (ACTH)-secreting pituitary tumors (ACTHomas) are associated with severe comorbidities and increased mortality. Current treatments mainly focus on remission and prevention of persistent disease and recurrence. However, there are still no useful biomarkers to accurately predict the clinical outcome after surgery, long-term remission, or disease relapse.

OBJECTIVES

This work aimed to identify clinical, biochemical, and molecular markers for predicting long-term clinical outcome and remission in ACTHomas.

METHODS

A retrospective multicenter study was performed with 60 ACTHomas patients diagnosed between 2004 and 2018 with at least 2 years' follow-up. Clinical/biochemical variables were evaluated yearly. Molecular expression profile of the somatostatin/ghrelin/dopamine regulatory systems components and of key pituitary factors and proliferation markers were evaluated in tumor samples after the first surgery.

RESULTS

Clinical variables including tumor size, time until diagnosis/first surgery, serum prolactin, and postsurgery cortisol levels were associated with tumor remission and relapsed disease. The molecular markers analyzed were distinctly expressed in ACTHomas, with some components (ie, SSTR1, CRHR1, and MKI67) showing instructive associations with recurrence and/or remission. Notably, an integrative model including selected clinical variables (tumor size/postsurgery serum cortisol), and molecular markers (SSTR1/CRHR1) can accurately predict the clinical evolution and remission of patients with ACTHomas, generating a receiver operating characteristic curve with an area under the curve of 1 (P < .001).

CONCLUSION

This study demonstrates that the combination of a set of clinical and molecular biomarkers in ACTHomas is able to accurately predict the clinical evolution and remission of patients. Consequently, the postsurgery molecular profile represents a valuable tool for clinical evaluation and follow-up of patients with ACTHomas.

The Application of Artificial Intelligence and Machine Learning in Pituitary Adenomas

Pituitary adenomas (PAs) are a group of tumors with complex and heterogeneous clinical manifestations. Early accurate diagnosis, individualized management, and precise prediction of the treatment response and prognosis of patients with PA are urgently needed. Artificial intelligence (AI) and machine learning (ML) have garnered increasing attention to quantitatively analyze complex medical data to improve individualized care for patients with PAs. Therefore, we critically examined the current use of AI and ML in the management of patients with PAs, and we propose improvements for future uses of AI and ML in patients with PAs. AI and ML can automatically extract many quantitative features based on massive medical data; moreover, related diagnosis and prediction models can be developed through quantitative analysis. Previous studies have suggested that AI and ML have wide applications in early accurate diagnosis; individualized treatment; predicting the response to treatments, including surgery, medications, and radiotherapy; and predicting the outcomes of patients with PAs. In addition, facial imaging-based AI and ML, pathological picture-based AI and ML, and surgical microscopic video-based AI and ML have also been reported to be useful in assisting the management of patients with PAs. In conclusion, the current use of AI and ML models has the potential to assist doctors and patients in making crucial surgical decisions by providing an accurate diagnosis, response to treatment, and prognosis of PAs. These AI and ML models can improve the quality and safety of medical services for patients with PAs and reduce the complication rates of neurosurgery. Further work is needed to obtain more reliable algorithms with high accuracy, sensitivity, and specificity for the management of PA patients.

Machine Learning in Pituitary Surgery

Machine learning applications in neurosurgery are increasingly reported for diverse tasks such as faster and more accurate preoperative diagnosis, enhanced lesion characterization, as well as surgical outcome, complications and healthcare cost prediction. Even though the pertinent literature in pituitary surgery is less extensive with respect to other neurosurgical diseases, past research attempted to answer clinically relevant questions to better assist surgeons and clinicians. In the present chapter we review reported ML applications in pituitary surgery including differential diagnosis, preoperative lesion characterization (immunohistochemistry, cavernous sinus invasion, tumor consistency), surgical outcome and complication predictions (gross total resection, tumor recurrence, and endocrinological remission, cerebrospinal fluid leak, postoperative hyponatremia). Moreover, we briefly discuss from a practical standpoint the current barriers to clinical translation of machine learning research. On the topic of pituitary surgery, published reports can be considered mostly preliminary, requiring larger training populations and strong external validation. Thoughtful selection of clinically relevant outcomes of interest and transversal application of model development pipeline-together with accurate methodological planning and multicenter collaborations-have the potential to overcome current limitations and ultimately provide additional tools for more informed patient management.

Electronic Medical Records as Input to Predict Postoperative Immediate Remission of Cushing's Disease: Application of Word Embedding

Background

No existing machine learning (ML)-based models use free text from electronic medical records (EMR) as input to predict immediate remission (IR) of Cushing’s disease (CD) after transsphenoidal surgery.

Purpose

The aim of the present study is to develop an ML-based model that uses EMR that include both structured features and free text as input to preoperatively predict IR after transsphenoidal surgery.

Methods

A total of 419 patients with CD from Peking Union Medical College Hospital were enrolled between January 2014 and August 2020. The EMR of the patients were embedded and transformed into low-dimensional dense vectors that can be included in four ML-based models together with structured features. The area under the curve (AUC) of receiver operating characteristic curves was used to evaluate the performance of the models.

Results

The overall remission rate of the 419 patients was 75.7%. From the results of logistic multivariate analysis, operation (p < 0.001), invasion of cavernous sinus from MRI (p = 0.046), and ACTH (p = 0.024) were strongly correlated with IR. The AUC values for the four ML-based models ranged from 0.686 to 0.793. The highest AUC value (0.793) was for logistic regression when 11 structured features and “individual conclusions of the case by doctor” were included.

Conclusion

An ML-based model was developed using both structured and unstructured features (after being processed using a word embedding method) as input to preoperatively predict postoperative IR.

Machine Learning Models for Classification of Cushing's Syndrome Using Retrospective Data

Accurate classification of Cushing's Syndrome (CS) plays a critical role in providing the early and correct diagnosis of CS that may facilitate treatment and improve patient outcomes. Diagnosis of CS is a complex process, which requires careful and concurrent interpretation of signs and symptoms, multiple biochemical test results, and findings of medical imaging by physicians with a high degree of specialty and knowledge to make correct judgments. In this article, we explore the state of the art machine learning algorithms to demonstrate their potential as a clinical decision support system to analyze and classify CS to facilitate the diagnosis, prognosis, and treatment of CS. Prominent algorithms are compared using nested cross-validation and various class comparison strategies including multiclass, one vs. all, and one vs. one binary classification. Our findings show that Random Forest (RF) algorithm is most suitable for the classification of CS. We demonstrate that the proposed approach can classify CS with an average accuracy of 92% and an average F1 score of 91.5%, depending on the class comparison strategy and selected features. RF-based one vs. all binary classification model achieves sensitivity of 97.6%, precision of 91.1%, and specificity of 87.1% to discriminate CS from non-CS on the test dataset. RF-based multiclass classification model achieves average per class sensitivity of 91.8%, average per class specificity of 97.1%, and average per class precision of 92.1% to classify different subtypes of CS on the test dataset. Clinical performance evaluation suggests that the developed models can help improve physicians' judgment in diagnosing CS.

The definition of remission and recurrence of Cushing's disease

Accurate classification of postsurgical remission, and early recognition of recurrence are crucial to timely treat and prevent excess mortality in Cushing's Disease, yet the criteria used to define remission are variable and there is no consensus to define recurrence. Remission is defined as postsurgical hypocortisolemia, but delayed remission may occur. Recurrence is the return of clinical manifestations with biochemical evidence of hypercortisolism. The proper combination of tests and their timing are controversial. Reliable predicting tools may lead to earlier diagnosis upon recurrence. Many factors have been studied independently for prediction with variable performance. Novel artificial intelligence approaches seek to integrate these variables into risk calculators and machine-learning algorithms with an acceptable short-term predictive performance but lack longer-term accuracy. Prospective studies using these approaches are needed. This review summarizes the evidence behind the definitions of remission and recurrence and provide an overview of the available tools to predict and/or diagnose them.