Application of Artificial Intelligence to Gastroenterology and Hepatology

Laboratory variables-based artificial neural network models for predicting fatty liver disease: A retrospective study

Background

The efficacy of artificial neural network (ANN) models employing laboratory variables for predicting fatty liver disease (FLD) remains inadequately established. The study aimed to develop ANN models to precisely predict FLD.

Methods

Of 12,058 participants undergoing the initial FLD screening, 7,990 eligible participants were included. A total of 6,309 participants were divided randomly into the training (4,415 participants, 70%) and validation (1,894 participants, 30%) sets for developing prediction models. The performance of ANNs was additionally tested in the testing set (1,681 participants). The area under the receiver operating characteristic curve (AUROC) was employed to assess the models' performance.

Results

The 18-variable, 11-variable, 3-variable, and 2-variable models each achieved robust FLD prediction performance, with AUROCs over 0.92, 0.91, and 0.89 in the training, validation, and testing, respectively. Although slightly inferior to the other three models in performance (AUROC ranges: 0.89-0.92 vs 0.91-0.95), the 2-variable model showed 80.3% accuracy and 89.7% positive predictive value in the testing. Incorporating age and gender increased the AUROCs of the resulting 20-variable, 13-variable, 5-variable, and 4-variable models each to over 0.93, 0.92, and 0.91 in the training, validation, and testing, respectively.

Conclusions

Implementation of the ANN models could effectively predict FLD, with enhanced predictive performance via the inclusion of age and gender.

Exploring the benefits and challenges of AI-driven large language models in gastroenterology: Think out of the box

Artificial Intelligence (AI) has evolved significantly over the past decades, from its early concepts in the 1950s to the present era of deep learning and natural language processing. Advanced large language models (LLMs), such as Chatbot Generative Pre-Trained Transformer (ChatGPT) is trained to generate human-like text responses. This technology has the potential to revolutionize various aspects of gastroenterology, including diagnosis, treatment, education, and decision-making support. The benefits of using LLMs in gastroenterology could include accelerating diagnosis and treatment, providing personalized care, enhancing education and training, assisting in decision-making, and improving communication with patients. However, drawbacks and challenges such as limited AI capability, training on possibly biased data, data errors, security and privacy concerns, and implementation costs must be addressed to ensure the responsible and effective use of this technology. The future of LLMs in gastroenterology relies on the ability to process and analyse large amounts of data, identify patterns, and summarize information and thus assist physicians in creating personalized treatment plans. As AI advances, LLMs will become more accurate and efficient, allowing for faster diagnosis and treatment of gastroenterological conditions. Ensuring effective collaboration between AI developers, healthcare professionals, and regulatory bodies is essential for the responsible and effective use of this technology. By finding the right balance between AI and human expertise and addressing the limitations and risks associated with its use, LLMs can play an increasingly significant role in gastroenterology, contributing to better patient care and supporting doctors in their work.

Stratifying risk of failure to achieve textbook outcomes among patients undergoing hepatectomy for hepatocellular carcinoma: A multicenter score validation study

BACKGROUND AND AIMS

The concept of textbook outcomes (TOs) has gained increased attention as a critical metric to assess the quality and success of outcomes following complex surgery. A simple yet effective scoring system was developed and validated to predict risk of not achieving textbook outcomes (non-TOs) following hepatectomy for hepatocellular carcinoma (HCC).

METHODS

Using a multicenter prospectively collected database, risk factors associated with non-TO among patients who underwent hepatectomy for HCC were identified. A predictive scoring system based on factors identified from multivariate regression analysis was used to risk stratify patients relative to non-TO. The score was developed using 70 % of the overall cohort and validated in the remaining 30 %.

RESULTS

Among 3681 patients, 1458 (39.6 %) failied to experience a TO. Based on the derivation cohort, obesity, American Society of Anaesthesiologists score(ASA score), Child-Pugh grade, tumor size, and extent of hepatectomy were identified as independent predictors of non-TO. The scoring system ranged from 0 to 10 points. Patients were categorized into low (0-3 points), intermediate (4-6 points), and high risk (7-10 points) of non-TO. In the validation cohort, the predicted risk of developing non-TOs was 39.0 %, which closely matched the observed risk of 39.9 %. There were no differences among the predicted and observed risks within the different risk categories.

CONCLUSIONS

A novel scoring system was able to predict risk of non-TO accurately following hepatectomy for HCC. The score may enable early identification of individuals at risk of adverse outcomes and inform surgical decision-making, and quality improvement initiatives.

Recent advancements to increase success in assisted reproductive technologies in cattle

Assisted reproductive technologies (ART) are fundamental for cattle breeding and sustainable food production. Together with genomic selection, these technologies contribute to reducing the generation interval and accelerating genetic progress. In this paper, we discuss advancements in technologies used in the fertility evaluation of breeding animals, and the collection, processing, and preservation of the gametes. It is of utmost importance for the breeding industry to select dams and sires of the next generation as young as possible, as is the efficient and timely collection of gametes. There is a need for reliable and easily applicable methods to evaluate sexual maturity and fertility. Although gametes processing and preservation have been improved in recent decades, challenges are still encountered. The targeted use of sexed semen and beef semen has obliterated the production of surplus replacement heifers and bull calves from dairy breeds, markedly improving animal welfare and ethical considerations in production practices. Parallel with new technologies, many well-established technologies remain relevant, although with evolving applications. In vitro production (IVP) has become the predominant method of embryo production. Although fundamental improvements in IVP procedures have been established, the quality of IVP embryos remains inferior to their in vivo counterparts. Improvements to facilitate oocyte maturation and development of new culture systems, e.g. microfluidics, are presented in this paper. New non-invasive and objective tools are needed to select embryos for transfer. Cryopreservation of semen and embryos plays a pivotal role in the distribution of genetics, and we discuss the challenges and opportunities in this field. Finally, machine learning (ML) is gaining ground in agriculture and ART. This paper delves into the utilization of emerging technologies in ART, along with the current status, key challenges, and future prospects of ML in both research and practical applications within ART.

Distinguishing between aldosterone-producing adenomas and non-functional adrenocortical adenomas using the YOLOv5 network

BACKGROUND

You Only Look Once version 5 (YOLOv5), a one-stage deep-learning (DL) algorithm for object detection and classification, offers high speed and accuracy for identifying targets.

PURPOSE

To investigate the feasibility of using the YOLOv5 algorithm to non-invasively distinguish between aldosterone-producing adenomas (APAs) and non-functional adrenocortical adenomas (NF-ACAs) on computed tomography (CT) images.

MATERIAL AND METHODS

A total of 235 patients who were diagnosed with ACAs between January 2011 and July 2022 were included in this study. Of the 215 patients, 81 (37.7%) had APAs and 134 (62.3%) had NF-ACAs' they were randomly divided into either the training set or the validation set at a ratio of 9:1. Another 20 patients, including 8 (40.0%) with APA and 12 (60.0%) with NF-ACA, were collected for the testing set. Five submodels (YOLOv5n, YOLOv5s, YOLOv5m, YOLOv5l, and YOLOv5x) of YOLOv5 were trained and evaluated on the datasets.

RESULTS

In the testing set, the mAP_0.5 value for YOLOv5x (0.988) was higher than the values for YOLOv5n (0.969), YOLOv5s (0.965), YOLOv5m (0.974), and YOLOv5l (0.983). The mAP_0.5:0.95 value for YOLOv5x (0.711) was also higher than the values for YOLOv5n (0.587), YOLOv5s (0.674), YOLOv5m (0.671), and YOLOv5l (0.698) in the testing set. The inference speed of YOLOv5n was 2.4 ms in the testing set, which was the fastest among the five submodels.

CONCLUSION

The YOLOv5 algorithm can accurately and efficiently distinguish between APAs and NF-ACAs on CT images, especially YOLOv5x has the best identification performance.

Deep Learning-Based Real-Time Organ Localization and Transit Time Estimation in Wireless Capsule Endoscopy

BACKGROUND

Wireless capsule endoscopy (WCE) has significantly advanced the diagnosis of gastrointestinal (GI) diseases by allowing for the non-invasive visualization of the entire small intestine. However, machine learning-based methods for organ classification in WCE often rely on color information, leading to decreased performance when obstacles such as food debris are present. This study proposes a novel model that integrates convolutional neural networks (CNNs) and long short-term memory (LSTM) networks to analyze multiple frames and incorporate temporal information, ensuring that it performs well even when visual information is limited.

METHODS

We collected data from 126 patients using PillCam™ SB3 (Medtronic, Minneapolis, MN, USA), which comprised 2,395,932 images. Our deep learning model was trained to identify organs (stomach, small intestine, and colon) using data from 44 training and 10 validation cases. We applied calibration using a Gaussian filter to enhance the accuracy of detecting organ boundaries. Additionally, we estimated the transit time of the capsule in the gastric and small intestine regions using a combination of a convolutional neural network (CNN) and a long short-term memory (LSTM) designed to be aware of the sequence information of continuous videos. Finally, we evaluated the model's performance using WCE videos from 72 patients.

RESULTS

Our model demonstrated high performance in organ classification, achieving an accuracy, sensitivity, and specificity of over 95% for each organ (stomach, small intestine, and colon), with an overall accuracy and F1-score of 97.1%. The Matthews Correlation Coefficient (MCC) and Geometric Mean (G-mean) were used to evaluate the model's performance on imbalanced datasets, achieving MCC values of 0.93 for the stomach, 0.91 for the small intestine, and 0.94 for the colon, and G-mean values of 0.96 for the stomach, 0.95 for the small intestine, and 0.97 for the colon. Regarding the estimation of gastric and small intestine transit times, the mean time differences between the model predictions and ground truth were 4.3 ± 9.7 min for the stomach and 24.7 ± 33.8 min for the small intestine. Notably, the model's predictions for gastric transit times were within 15 min of the ground truth for 95.8% of the test dataset (69 out of 72 cases). The proposed model shows overall superior performance compared to a model using only CNN.

CONCLUSIONS

The combination of CNN and LSTM proves to be both accurate and clinically effective for organ classification and transit time estimation in WCE. Our model's ability to integrate temporal information allows it to maintain high performance even in challenging conditions where color information alone is insufficient. Including MCC and G-mean metrics further validates the robustness of our approach in handling imbalanced datasets. These findings suggest that the proposed method can significantly improve the diagnostic accuracy and efficiency of WCE, making it a valuable tool in clinical practice for diagnosing and managing GI diseases.

The Immune Landscape of Pheochromocytoma and Paraganglioma: Current Advances and Perspectives

Pheochromocytomas and paragangliomas (PPGLs) are rare neuroendocrine tumors derived from neural crest cells from adrenal medullary chromaffin tissues and extra-adrenal paraganglia, respectively. Although the current treatment for PPGLs is surgery, optimal treatment options for advanced and metastatic cases have been limited. Hence, understanding the role of the immune system in PPGL tumorigenesis can provide essential knowledge for the development of better therapeutic and tumor management strategies, especially for those with advanced and metastatic PPGLs. The first part of this review outlines the fundamental principles of the immune system and tumor microenvironment, and their role in cancer immunoediting, particularly emphasizing PPGLs. We focus on how the unique pathophysiology of PPGLs, such as their high molecular, biochemical, and imaging heterogeneity and production of several oncometabolites, creates a tumor-specific microenvironment and immunologically "cold" tumors. Thereafter, we discuss recently published studies related to the reclustering of PPGLs based on their immune signature. The second part of this review discusses future perspectives in PPGL management, including immunodiagnostic and promising immunotherapeutic approaches for converting "cold" tumors into immunologically active or "hot" tumors known for their better immunotherapy response and patient outcomes. Special emphasis is placed on potent immune-related imaging strategies and immune signatures that could be used for the reclassification, prognostication, and management of these tumors to improve patient care and prognosis. Furthermore, we introduce currently available immunotherapies and their possible combinations with other available therapies as an emerging treatment for PPGLs that targets hostile tumor environments.

Advances in Noninvasive Molecular Imaging Probes for Liver Fibrosis Diagnosis

Liver fibrosis is a wound-healing response to chronic liver injury, which may lead to cirrhosis and cancer. Early-stage fibrosis is reversible, and it is difficult to precisely diagnose with conventional imaging modalities such as magnetic resonance imaging, positron emission tomography, single-photon emission computed tomography, and ultrasound imaging. In contrast, probe-assisted molecular imaging offers a promising noninvasive approach to visualize early fibrosis changes in vivo, thus facilitating early diagnosis and staging liver fibrosis, and even monitoring of the treatment response. Here, the most recent progress in molecular imaging technologies for liver fibrosis is updated. We start by illustrating pathogenesis for liver fibrosis, which includes capillarization of liver sinusoidal endothelial cells, cellular and molecular processes involved in inflammation and fibrogenesis, as well as processes of collagen synthesis, oxidation, and cross-linking. Furthermore, the biological targets used in molecular imaging of liver fibrosis are summarized, which are composed of receptors on hepatic stellate cells, macrophages, and even liver collagen. Notably, the focus is on insights into the advances in imaging modalities developed for liver fibrosis diagnosis and the update in the corresponding contrast agents. In addition, challenges and opportunities for future research and clinical translation of the molecular imaging modalities and the contrast agents are pointed out. We hope that this review would serve as a guide for scientists and students who are interested in liver fibrosis imaging and treatment, and as well expedite the translation of molecular imaging technologies from bench to bedside.

Machine learning for predicting liver and/or lung metastasis in colorectal cancer: A retrospective study based on the SEER database

OBJECTIVE

This study aims to establish a machine learning (ML) model for predicting the risk of liver and/or lung metastasis in colorectal cancer (CRC).

METHODS

Using the National Institutes of Health (NIH)'s Surveillance, Epidemiology, and End Results (SEER) database, a total of 51265 patients with pathological diagnosis of colorectal cancer from 2010 to 2015 were extracted for model development. On this basis, We have established 7 machine learning algorithm models. Evaluate the model based on accuracy, and AUC of receiver operating characteristics (ROC) and explain the relationship between clinical pathological features and target variables based on the best model. We validated the model among 196 colorectal cancer patients in Beijing Electric Power Hospital of Capital Medical University of China to evaluate its performance and universality. Finally, we have developed a network-based calculator using the best model to predict the risk of liver and/or lung metastasis in colorectal cancer patients.

RESULTS

51265 patients were enrolled in the study, of which 7864 (15.3 %) had distant liver and/or lung metastasis. RF had the best predictive ability, In the internal test set, with an accuracy of 0.895, AUC of 0.956, and AUPR of 0.896. In addition, the RF model was evaluated in the external validation set with an accuracy of 0.913, AUC of 0.912, and AUPR of 0.611.

CONCLUSION

In this study, we constructed an RF algorithm mode to predict the risk of colorectal liver and/or lung metastasis, to assist doctors in making clinical decisions.

Defining and Addressing Research Priorities in Cancer Cachexia through Transdisciplinary Collaboration

For many patients, the cancer continuum includes a syndrome known as cancer-associated cachexia (CAC), which encompasses the unintended loss of body weight and muscle mass, and is often associated with fat loss, decreased appetite, lower tolerance and poorer response to treatment, poor quality of life, and reduced survival. Unfortunately, there are no effective therapeutic interventions to completely reverse cancer cachexia and no FDA-approved pharmacologic agents; hence, new approaches are urgently needed. In May of 2022, researchers and clinicians from Moffitt Cancer Center held an inaugural retreat on CAC that aimed to review the state of the science, identify knowledge gaps and research priorities, and foster transdisciplinary collaborative research projects. This review summarizes research priorities that emerged from the retreat, examples of ongoing collaborations, and opportunities to move science forward. The highest priorities identified include the need to (1) evaluate patient-reported outcome (PRO) measures obtained in clinical practice and assess their use in improving CAC-related outcomes; (2) identify biomarkers (imaging, molecular, and/or behavioral) and novel analytic approaches to accurately predict the early onset of CAC and its progression; and (3) develop and test interventions (pharmacologic, nutritional, exercise-based, and through mathematical modeling) to prevent CAC progression and improve associated symptoms and outcomes.

Impact of artificial intelligence in the management of esophageal, gastric and colorectal malignancies

The incidence of gastrointestinal malignancies has increased over the past decade at an alarming rate. Colorectal and gastric cancers are the third and fifth most commonly diagnosed cancers worldwide but are cited as the second and third leading causes of mortality. Early institution of appropriate therapy from timely diagnosis can optimize patient outcomes. Artificial intelligence (AI)-assisted diagnostic, prognostic, and therapeutic tools can assist in expeditious diagnosis, treatment planning/response prediction, and post-surgical prognostication. AI can intercept neoplastic lesions in their primordial stages, accurately flag suspicious and/or inconspicuous lesions with greater accuracy on radiologic, histopathological, and/or endoscopic analyses, and eliminate over-dependence on clinicians. AI-based models have shown to be on par, and sometimes even outperformed experienced gastroenterologists and radiologists. Convolutional neural networks (state-of-the-art deep learning models) are powerful computational models, invaluable to the field of precision oncology. These models not only reliably classify images, but also accurately predict response to chemotherapy, tumor recurrence, metastasis, and survival rates post-treatment. In this systematic review, we analyze the available evidence about the diagnostic, prognostic, and therapeutic utility of artificial intelligence in gastrointestinal oncology.

Radiomics Analysis of Preprocedural CT Imaging for Outcome Prediction after Transjugular Intrahepatic Portosystemic Shunt Creation

PURPOSE

To evaluate the role of radiomics in preoperative outcome prediction in cirrhotic patients who underwent transjugular intrahepatic portosystemic shunt (TIPS) using "controlled expansion covered stents".

MATERIALS AND METHODS

This retrospective institutional review board-approved study included cirrhotic patients undergoing TIPS with controlled expansion covered stent placement. From preoperative CT images, the whole liver was segmented into Volumes of Interest (VOIs) at the unenhanced and portal venous phase. Radiomics features were extracted, collected, and analyzed. Subsequently, receiver operating characteristic (ROC) curves were drawn to assess which features could predict patients' outcomes. The endpoints studied were 6-month overall survival (OS), development of hepatic encephalopathy (HE), grade II or higher HE according to West Haven Criteria, and clinical response, defined as the absence of rebleeding or ascites. A radiomic model for outcome prediction was then designed.

RESULTS

A total of 76 consecutive cirrhotic patients undergoing TIPS creation were enrolled. The highest performances in terms of the area under the receiver operating characteristic curve (AUROC) were observed for the "clinical response" and "survival at 6 months" outcome with 0.755 and 0.767, at the unenhanced and portal venous phase, respectively. Specifically, on basal scans, accuracy, specificity, and sensitivity were 66.42%, 63.93%, and 73.75%, respectively. At the portal venous phase, an accuracy of 65.34%, a specificity of 62.38%, and a sensitivity of 74.00% were demonstrated.

CONCLUSIONS

A pre-interventional machine learning-based CT radiomics algorithm could be useful in predicting survival and clinical response after TIPS creation in cirrhotic patients.

Machine Learning-Based Integrated Multiomics Characterization of Colorectal Cancer Reveals Distinctive Metabolic Signatures

The metabolic signature identification of colorectal cancer is critical for its early diagnosis and therapeutic approaches that will significantly block cancer progression and improve patient survival. Here, we combined an untargeted metabolic analysis strategy based on internal extractive electrospray ionization mass spectrometry and the machine learning approach to analyze metabolites in 173 pairs of cancer samples and matched normal tissue samples to build robust metabolic signature models for diagnostic purposes. Screening and independent validation of metabolic signatures from colorectal cancers via machine learning methods (Logistic Regression_L1 for feature selection and eXtreme Gradient Boosting for classification) was performed to generate a panel of seven signatures with good diagnostic performance (the accuracy of 87.74%, sensitivity of 85.82%, and specificity of 89.66%). Moreover, seven signatures were evaluated according to their ability to distinguish between cancer and normal tissues, with the metabolic molecule PC (30:0) showing good diagnostic performance. In addition, genes associated with PC (30:0) were identified by multiomics analysis (combining metabolic data with transcriptomic data analysis) and our results showed that PC (30:0) could promote the proliferation of colorectal cancer cell SW480, revealing the correlation between genetic changes and metabolic dysregulation in cancer. Overall, our results reveal potential determinants affecting metabolite dysregulation, paving the way for a mechanistic understanding of altered tissue metabolites in colorectal cancer and design interventions for manipulating the levels of circulating metabolites.

Deep learning and minimally invasive inflammatory activity assessment: a proof-of-concept study for development and score correlation of a panendoscopy convolutional network

Background

Capsule endoscopy (CE) is a valuable tool for assessing inflammation in patients with Crohn's disease (CD). The current standard for evaluating inflammation are validated scores (and clinical laboratory values) like Lewis score (LS), Capsule Endoscopy Crohn's Disease Activity Index (CECDAI), and ELIAKIM. Recent advances in artificial intelligence (AI) have made it possible to automatically select the most relevant frames in CE.

Objectives

In this proof-of-concept study, our objective was to develop an automated scoring system using CE images to objectively grade inflammation.

Design

Pan-enteric CE videos (PillCam Crohn's) performed in CD patients between 09/2020 and 01/2023 were retrospectively reviewed and LS, CECDAI, and ELIAKIM scores were calculated.

Methods

We developed a convolutional neural network-based automated score consisting of the percentage of positive frames selected by the algorithm (for small bowel and colon separately). We correlated clinical data and the validated scores with the artificial intelligence-generated score (AIS).

Results

A total of 61 patients were included. The median LS was 225 (0-6006), CECDAI was 6 (0-33), ELIAKIM was 4 (0-38), and SB_AIS was 0.5659 (0-29.45). We found a strong correlation between SB_AIS and LS, CECDAI, and ELIAKIM scores (Spearman's r = 0.751, r = 0.707, r = 0.655, p = 0.001). We found a strong correlation between LS and ELIAKIM (r = 0.768, p = 0.001) and a very strong correlation between CECDAI and LS (r = 0.854, p = 0.001) and CECDAI and ELIAKIM scores (r = 0.827, p = 0.001).

Conclusion

Our study showed that the AI-generated score had a strong correlation with validated scores indicating that it could serve as an objective and efficient method for evaluating inflammation in CD patients. As a preliminary study, our findings provide a promising basis for future refining of a CE score that may accurately correlate with prognostic factors and aid in the management and treatment of CD patients.

Computer-aided diagnosis system for optical diagnosis of colorectal polyps under white light imaging

OBJECTIVES

This study presents a novel computer-aided diagnosis (CADx) designed for optically diagnosing colorectal polyps using white light imaging (WLI).We aimed to evaluate the effectiveness of the CADx and its auxiliary role among endoscopists with different levels of expertise.

METHODS

We collected 2,324 neoplastic and 3,735 nonneoplastic polyp WLI images for model training, and 838 colorectal polyp images from 740 patients for model validation. We compared the diagnostic accuracy of the CADx with that of 15 endoscopists under WLI and narrow band imaging (NBI). The auxiliary benefits of CADx for endoscopists of different experience levels and for identifying different types of colorectal polyps was also evaluated.

RESULTS

The CADx demonstrated an optical diagnostic accuracy of 84.49%, showing considerable superiority over all endoscopists, irrespective of whether WLI or NBI was used (P < 0.001). Assistance from the CADx significantly improved the diagnostic accuracy of the endoscopists from 68.84% to 77.49% (P = 0.001), with the most significant impact observed among novice endoscopists. Notably, novices using CADx-assisted WLI outperform junior and expert endoscopists without such assistance.

CONCLUSIONS

The CADx demonstrated a crucial role in substantially enhancing the precision of optical diagnosis for colorectal polyps under WLI and showed the greatest auxiliary benefits for novice endoscopists.

The Role of Artificial Intelligence in the Diagnosis and Treatment of Ulcerative Colitis

BACKGROUND AND OBJECTIVES

This review aims to delve into the role of artificial intelligence in medicine. Ulcerative colitis (UC) is a chronic, inflammatory bowel disease (IBD) characterized by superficial mucosal inflammation, rectal bleeding, diarrhoea and abdominal pain. By identifying the challenges inherent in UC diagnosis, we seek to highlight the potential impact of artificial intelligence on enhancing both diagnosis and treatment methodologies for this condition.

METHOD

A targeted, non-systematic review of literature relating to ulcerative colitis was undertaken. The PubMed and Scopus databases were searched to categorize a well-rounded understanding of the field of artificial intelligence and its developing role in the diagnosis and treatment of ulcerative colitis. Articles that were thought to be relevant were included. This paper only included articles published in English.

RESULTS

Artificial intelligence (AI) refers to computer algorithms capable of learning, problem solving and decision-making. Throughout our review, we highlighted the role and importance of artificial intelligence in modern medicine, emphasizing its role in diagnosis through AI-assisted endoscopies and histology analysis and its enhancements in the treatment of ulcerative colitis. Despite these advances, AI is still hindered due to its current lack of adaptability to real-world scenarios and its difficulty in widespread data availability, which hinders the growth of AI-led data analysis.

CONCLUSIONS

When considering the potential of artificial intelligence, its ability to enhance patient care from a diagnostic and therapeutic perspective shows signs of promise. For the true utilization of artificial intelligence, some roadblocks must be addressed. The datasets available to AI may not truly reflect the real-world, which would prevent its impact in all clinical scenarios when dealing with a spectrum of patients with different backgrounds and presenting factors. Considering this, the shift in medical diagnostics and therapeutics is coinciding with evolving technology. With a continuous advancement in artificial intelligence programming and a perpetual surge in patient datasets, these networks can be further enhanced and supplemented with a greater cohort, enabling better outcomes and prediction models for the future of modern medicine.

Deep-learning enabled ultrasound based detection of gallbladder cancer in northern India: a prospective diagnostic study

Background

Gallbladder cancer (GBC) is highly aggressive. Diagnosis of GBC is challenging as benign gallbladder lesions can have similar imaging features. We aim to develop and validate a deep learning (DL) model for the automatic detection of GBC at abdominal ultrasound (US) and compare its diagnostic performance with that of radiologists.

Methods

In this prospective study, a multiscale, second-order pooling-based DL classifier model was trained (training and validation cohorts) using the US data of patients with gallbladder lesions acquired between August 2019 and June 2021 at the Postgraduate Institute of Medical Education and research, a tertiary care hospital in North India. The performance of the DL model to detect GBC was evaluated in a temporally independent test cohort (July 2021-September 2022) and was compared with that of two radiologists.

Findings

The study included 233 patients in the training set (mean age, 48 ± (2SD) 23 years; 142 women), 59 patients in the validation set (mean age, 51.4 ± 19.2 years; 38 women), and 273 patients in the test set (mean age, 50.4 ± 22.1 years; 177 women). In the test set, the DL model had sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) of 92.3% (95% CI, 88.1-95.6), 74.4% (95% CI, 65.3-79.9), and 0.887 (95% CI, 0.844-0.930), respectively for detecting GBC which was comparable to both the radiologists. The DL-based approach showed high sensitivity (89.8-93%) and AUC (0.810-0.890) for detecting GBC in the presence of stones, contracted gallbladders, lesion size <10 mm, and neck lesions, which was comparable to both the radiologists (p = 0.052-0.738 for sensitivity and p = 0.061-0.745 for AUC). The sensitivity for DL-based detection of mural thickening type of GBC was significantly greater than one of the radiologists (87.8% vs. 72.8%, p = 0.012), despite a reduced specificity.

Interpretation

The DL-based approach demonstrated diagnostic performance comparable to experienced radiologists in detecting GBC using US. However, multicentre studies are warranted to explore the potential of DL-based diagnosis of GBC fully.

Funding

None.

Artificial intelligence quantifying endoscopic severity of ulcerative colitis in gradation scale

OBJECTIVES

Existing endoscopic scores for ulcerative colitis (UC) objectively categorize disease severity based on the presence or absence of endoscopic findings; therefore, it may not reflect the range of clinical severity within each category. However, inflammatory bowel disease (IBD) expert endoscopists categorize the severity and diagnose the overall impression of the degree of inflammation. This study aimed to develop an artificial intelligence (AI) system that can accurately represent the assessment of the endoscopic severity of UC by IBD expert endoscopists.

METHODS

A ranking-convolutional neural network (ranking-CNN) was trained using comparative information on the UC severity of 13,826 pairs of endoscopic images created by IBD expert endoscopists. Using the trained ranking-CNN, the UC Endoscopic Gradation Scale (UCEGS) was used to express severity. Correlation coefficients were calculated to ensure that there were no inconsistencies in assessments of severity made using UCEGS diagnosed by the AI and the Mayo Endoscopic Subscore, and the correlation coefficients of the mean for test images assessed using UCEGS by four IBD expert endoscopists and the AI.

RESULTS

Spearman's correlation coefficient between the UCEGS diagnosed by AI and Mayo Endoscopic Subscore was approximately 0.89. The correlation coefficients between IBD expert endoscopists and the AI of the evaluation results were all higher than 0.95 (P < 0.01).

CONCLUSIONS

The AI developed here can diagnose UC severity endoscopically similar to IBD expert endoscopists.

An Automated Video Analysis System for Retrospective Assessment and Real-Time Monitoring of Endoscopic Procedures (with Video)

BACKGROUND AND AIMS

Accurate recognition of endoscopic instruments facilitates quantitative evaluation and quality control of endoscopic procedures. However, no relevant research has been reported. In this study, we aimed to develop a computer-assisted system, EndoAdd, for automated endoscopic surgical video analysis based on our dataset of endoscopic instrument images.

METHODS

Large training and validation datasets containing 45,143 images of 10 different endoscopic instruments and a test dataset of 18,375 images collected from several medical centers were used in this research. Annotated image frames were used to train the state-of-the-art object detection model, YOLO-v5, to identify the instruments. Based on the frame-level prediction results, we further developed a hidden Markov model to perform video analysis and generate heatmaps to summarize the videos.

RESULTS

EndoAdd achieved high accuracy (>97%) on the test dataset for all 10 endoscopic instrument types. The mean average accuracy, precision, recall, and F1-score were 99.1%, 92.0%, 88.8%, and 89.3%, respectively. The area under the curve values exceeded 0.94 for all instrument types. Heatmaps of endoscopic procedures were generated for both retrospective and real-time analyses.

CONCLUSIONS

We successfully developed an automated endoscopic video analysis system, EndoAdd, which supports retrospective assessment and real-time monitoring. It can be used for data analysis and quality control of endoscopic procedures in clinical practice.

Deep Learning Models Capture Histological Disease Activity in Crohn's Disease and Ulcerative Colitis with High Fidelity

BACKGROUND AND AIMS

Histological disease activity in inflammatory bowel disease [IBD] is associated with clinical outcomes and is an important endpoint in drug development. We developed deep learning models for automating histological assessments in IBD.

METHODS

Histology images of intestinal mucosa from phase 2 and phase 3 clinical trials in Crohn's disease [CD] and ulcerative colitis [UC] were used to train artificial intelligence [AI] models to predict the Global Histology Activity Score [GHAS] for CD and Geboes histopathology score for UC. Three AI methods were compared. AI models were evaluated on held-back testing sets, and model predictions were compared against an expert central reader and five independent pathologists.

RESULTS

The model based on multiple instance learning and the attention mechanism [SA-AbMILP] demonstrated the best performance among competing models. AI-modelled GHAS and Geboes subgrades matched central readings with moderate to substantial agreement, with accuracies ranging from 65% to 89%. Furthermore, the model was able to distinguish the presence and absence of pathology across four selected histological features, with accuracies for colon in both CD and UC ranging from 87% to 94% and for CD ileum ranging from 76% to 83%. For both CD and UC and across anatomical compartments [ileum and colon] in CD, comparable accuracies against central readings were found between the model-assigned scores and scores by an independent set of pathologists.

CONCLUSIONS

Deep learning models based upon GHAS and Geboes scoring systems were effective at distinguishing between the presence and absence of IBD microscopic disease activity.

Single-Image-Based Deep Learning for Segmentation of Early Esophageal Cancer Lesions

Accurate segmentation of lesions is crucial for diagnosis and treatment of early esophageal cancer (EEC). However, neither traditional nor deep learning-based methods up to today can meet the clinical requirements, with the mean Dice score - the most important metric in medical image analysis - hardly exceeding 0.75. In this paper, we present a novel deep learning approach for segmenting EEC lesions. Our method stands out for its uniqueness, as it relies solely on a single input image from a patient, forming the so-called "You-Only-Have-One" (YOHO) framework. On one hand, this "one-image-one-network" learning ensures complete patient privacy as it does not use any images from other patients as the training data. On the other hand, it avoids nearly all generalization-related problems since each trained network is applied only to the same input image itself. In particular, we can push the training to "over-fitting" as much as possible to increase the segmentation accuracy. Our technical details include an interaction with clinical doctors to utilize their expertise, a geometry-based data augmentation over a single lesion image to generate the training dataset (the biggest novelty), and an edge-enhanced UNet. We have evaluated YOHO over an EEC dataset collected by ourselves and achieved a mean Dice score of 0.888, which is much higher as compared to the existing deep-learning methods, thus representing a significant advance toward clinical applications. The code and dataset are available at: https://github.com/lhaippp/YOHO.

An artificial intelligence-driven scoring system to measure histological disease activity in ulcerative colitis

BACKGROUND AND AIMS

Assessment and scoring of histological images in Ulcerative colitis (UC) is prone to inter- and intra-observer variability. This study aimed to investigate whether an artificial intelligence (AI) system developed using image processing and machine learning algorithms could measure histological disease activity based on the Nancy index.

METHODS

A total of 200 histological images of patients with UC were used in this study. A novel AI algorithm was developed using state-of-the-art image processing and machine learning algorithms based on deep learning and feature extraction. The cell regions of each image, followed by the Nancy index, were manually annotated and measured independently by four histopathologists. Manual and AI-automated measurements of the Nancy index score were conducted and assessed using the intraclass correlation coefficient (ICC).

RESULTS

The 200-image dataset was divided into two groups (80% was used for training and 20% for testing). Intraclass correlation coefficient statistical analyses were performed to evaluate the AI tool and used as a reference to calculate the accuracy. The average ICC among the histopathologists was 89.3 and the average ICC between histopathologists and the AI tool was 87.2. The AI tool was found to be highly correlated with histopathologists.

CONCLUSIONS

The high correlation of performance of the AI method suggests promising potential for inflammatory bowel disease clinical applications. A standardized automated histological AI-driven scoring system can potentially be used in daily inflammatory bowel disease practice to reduce training needs and resource use, eliminate the subjectivity of the pathologists, and assess disease severity for treatment decisions.

Noninvasive Assessment of HER2 Expression Status in Gastric Cancer Using 18F-FDG Positron Emission Tomography/Computed Tomography-Based Radiomics: A Pilot Study

Purpose: Immunohistochemistry (IHC) is the main method to detect human epidermal growth factor receptor 2 (HER2) expression levels. However, IHC is invasive and cannot reflect HER2 expression status in real time. The aim of this study was to construct and verify three types of radiomics models based on 18F-fuorodeoxyglucose (18F-FDG) positron emission tomography/computed tomography (PET/CT) imaging and to evaluate the predictive ability of these radiomics models for the expression status of HER2 in patients with gastric cancer (GC). Patients and Methods: A total of 118 patients with GC were enrolled in this study. 18F-FDG PET/CT imaging was performed prior to surgery. The LIFEx software package was applied to extract PET and CT radiomics features. The minimum absolute contraction and selection operator (least absolute shrinkage and selection operator [LASSO]) algorithm was used to select the best radiomics features. Three machine learning methods, logistic regression (LR), support vector machine (SVM), and random forest (RF) models, were constructed and verified. The Synthetic Minority Oversampling Technique (SMOTE) was applied to address data imbalance. Results: In the training and test sets, the area under the curve (AUC) values of the LR, SVM, and RF models were 0.809, 0.761, 0.861 and 0.628, 0.993, 0.717, respectively, and the Brier scores were 0.118, 0.214, and 0.143, respectively. Among the three models, the LR and RF models exhibited extremely good prediction performance. The AUC values of the three models significantly improved after SMOTE balanced the data. Conclusions: 18F-FDG PET/CT-based radiomics models, especially LR and RF models, demonstrate good performance in predicting HER2 expression status in patients with GC and can be used to preselect patients who may benefit from HER2-targeted therapy.

Deep Learning in High-Resolution Anoscopy: Assessing the Impact of Staining and Therapeutic Manipulation on Automated Detection of Anal Cancer Precursors

INTRODUCTION

High-resolution anoscopy (HRA) is the gold standard for detecting anal squamous cell carcinoma (ASCC) precursors. Preliminary studies on the application of artificial intelligence (AI) models to this modality have revealed promising results. However, the impact of staining techniques and anal manipulation on the effectiveness of these algorithms has not been evaluated. We aimed to develop a deep learning system for automatic differentiation of high-grade squamous intraepithelial lesion vs low-grade squamous intraepithelial lesion in HRA images in different subsets of patients (nonstained, acetic acid, lugol, and after manipulation).

METHODS

A convolutional neural network was developed to detect and differentiate high-grade and low-grade anal squamous intraepithelial lesions based on 27,770 images from 103 HRA examinations performed in 88 patients. Subanalyses were performed to evaluate the algorithm's performance in subsets of images without staining, acetic acid, lugol, and after manipulation of the anal canal. The sensitivity, specificity, accuracy, positive and negative predictive values, and area under the curve were calculated.

RESULTS

The convolutional neural network achieved an overall accuracy of 98.3%. The algorithm had a sensitivity and specificity of 97.4% and 99.2%, respectively. The accuracy of the algorithm for differentiating high-grade squamous intraepithelial lesion vs low-grade squamous intraepithelial lesion varied between 91.5% (postmanipulation) and 100% (lugol) for the categories at subanalysis. The area under the curve ranged between 0.95 and 1.00.

DISCUSSION

The introduction of AI to HRA may provide an accurate detection and differentiation of ASCC precursors. Our algorithm showed excellent performance at different staining settings. This is extremely important because real-time AI models during HRA examinations can help guide local treatment or detect relapsing disease.

Imaging and endoscopic tools in pediatric inflammatory bowel disease: What's new?

Pediatric inflammatory bowel disease (IBD) is a chronic inflammatory disorder, with increasing incidence and prevalence worldwide. There have been recent advances in imaging and endoscopic technology for disease diagnosis, treatment, and monitoring. Intestinal ultrasound, including transabdominal, transperineal, and endoscopic, has been emerging for the assessment of transmural bowel inflammation and disease complications (e.g., fistula, abscess). Aside from surgery, IBD-related intestinal strictures now have endoscopic treatment options including through-the-scope balloon dilatation, injection, and needle knife stricturotomy and new evaluation tools such as endoscopic functional lumen imaging probe. Unsedated transnasal endoscopy may have a role in patients with upper gastrointestinal Crohn's disease or those with IBD with new upper gastrointestinal symptoms. Improvements to dysplasia screening in pediatric patients with longstanding colonic disease or primary sclerosing cholangitis hold promise with the addition of virtual chromoendoscopy and ongoing research in the field of artificial intelligence-assisted endoscopic detection. Artificial intelligence and machine learning is a rapidly evolving field, with goals of further personalizing IBD diagnosis and treatment selection as well as prognostication. This review summarized these advancements, focusing on pediatric patients with IBD.

Artificial intelligence image-based prediction models in IBD exhibit high risk of bias: A systematic review

BACKGROUND

There has been an increase in the development of both machine learning (ML) and deep learning (DL) prediction models in Inflammatory Bowel Disease. We aim in this systematic review to assess the methodological quality and risk of bias of ML and DL IBD image-based prediction studies.

METHODS

We searched three databases, PubMed, Scopus and Embase, to identify ML and DL diagnostic or prognostic predictive models using imaging data in IBD, to Dec 31, 2022. We restricted our search to include studies that primarily used conventional imaging data, were undertaken in human participants, and published in English. Two reviewers independently reviewed the abstracts. The methodological quality of the studies was determined, and risk of bias evaluated using the prediction risk of bias assessment tool (PROBAST).

RESULTS

Forty studies were included, thirty-nine developed diagnostic models. Seven studies utilized ML approaches, six were retrospective and none used multicenter data for model development. Thirty-three studies utilized DL approaches, ten were prospective, and twelve multicenter studies. Overall, all studies demonstrated high risk of bias. ML studies were evaluated in 4 domains all rated as high risk of bias: participants (6/7), predictors (1/7), outcome (3/7), and analysis (7/7), and DL studies evaluated in 3 domains: participants (24/33), outcome (10/33), and analysis (18/33). The majority of image-based studies used colonoscopy images.

CONCLUSION

The risk of bias was high in AI IBD image-based prediction models, owing to insufficient sample size, unreported missingness and lack of an external validation cohort. Models with a high risk of bias are unlikely to be generalizable and suitable for clinical implementation.

Applications of artificial intelligence in biliary tract cancers

Biliary tract cancers are malignant neoplasms arising from bile duct epithelial cells. They include cholangiocarcinomas and gallbladder cancer. Gallbladder cancer has a marked geographical preference and is one of the most common cancers in women in northern India. Biliary tract cancers are usually diagnosed at an advanced, unresectable stage. Hence, the prognosis is extremely dismal. The five-year survival rate in advanced gallbladder cancer is < 5%. Hence, early detection and radical surgery are critical to improving biliary tract cancer prognoses. Radiological imaging plays an essential role in diagnosing and managing biliary tract cancers. However, the diagnosis is challenging because the biliary tract is affected by many diseases that may have radiological appearances similar to cancer. Artificial intelligence (AI) can improve radiologists' performance in various tasks. Deep learning (DL)-based approaches are increasingly incorporated into medical imaging to improve diagnostic performance. This paper reviews the AI-based strategies in biliary tract cancers to improve the diagnosis and prognosis.

Development of an Artificial Intelligence Model for the Classification of Gastric Carcinoma Stages Using Pathology Slides

This study showcases a novel AI-driven approach to accurately differentiate between stage one and stage two gastric carcinoma based on pathology slide analysis. Gastric carcinoma, a significant contributor to cancer-related mortality globally, necessitates precise staging for optimal treatment planning and patient management. Leveraging a comprehensive dataset of 3540 high-resolution pathology images sourced from Kaggle.com, comprising an equal distribution of stage one and stage two tumors, the developed AI model demonstrates remarkable performance in tumor staging. Through the application of state-of-the-art deep learning techniques on Google's Collaboration platform, the model achieves outstanding accuracy and precision rates of 100%, accompanied by notable sensitivity (97.09%), specificity (100%), and F1-score (98.31%). Additionally, the model exhibits an impressive area under the receiver operating characteristic curve (AUC) of 0.999, indicating superior discriminatory power and robustness. By providing clinicians with an efficient and reliable tool for gastric carcinoma staging, this AI-driven approach has the potential to significantly enhance diagnostic accuracy, inform treatment decisions, and ultimately improve patient outcomes in the management of gastric carcinoma. This research contributes to the ongoing advancement of cancer diagnosis and underscores the transformative potential of artificial intelligence in clinical practice.

Artificial intelligence for discrimination of Crohn's disease and gastrointestinal tuberculosis: A systematic review

BACKGROUND AND AIM

Discrimination of gastrointestinal tuberculosis (GITB) and Crohn's disease (CD) is difficult. Use of artificial intelligence (AI)-based technologies may help in discriminating these two entities.

METHODS

We conducted a systematic review on the use of AI for discrimination of GITB and CD. Electronic databases (PubMed and Embase) were searched on June 6, 2022, to identify relevant studies. We included any study reporting the use of clinical, endoscopic, and radiological information (textual or images) to discriminate GITB and CD using any AI technique. Quality of studies was assessed with MI-CLAIM checklist.

RESULTS

Out of 27 identified results, a total of 9 studies were included. All studies used retrospective databases. There were five studies of only endoscopy-based AI, one of radiology-based AI, and three of multiparameter-based AI. The AI models performed fairly well with high accuracy ranging from 69.6-100%. Text-based convolutional neural network was used in three studies and Classification and regression tree analysis used in two studies. Interestingly, irrespective of the AI method used, the performance of discriminating GITB and CD did not match in discriminating from other diseases (in studies where a third disease was also considered).

CONCLUSION

The use of AI in differentiating GITB and CD seem to have acceptable accuracy but there were no direct comparisons with traditional multiparameter models. The use of multiple parameter-based AI models have the potential for further exploration in search of an ideal tool and improve on the accuracy of traditional models.

The application of artificial intelligence in EUS

Artificial intelligence (AI) is an epoch-making technology, among which the 2 most advanced parts are machine learning and deep learning algorithms that have been further developed by machine learning, and it has been partially applied to assist EUS diagnosis. AI-assisted EUS diagnosis has been reported to have great value in the diagnosis of pancreatic tumors and chronic pancreatitis, gastrointestinal stromal tumors, esophageal early cancer, biliary tract, and liver lesions. The application of AI in EUS diagnosis still has some urgent problems to be solved. First, the development of sensitive AI diagnostic tools requires a large amount of high-quality training data. Second, there is overfitting and bias in the current AI algorithms, leading to poor diagnostic reliability. Third, the value of AI still needs to be determined in prospective studies. Fourth, the ethical risks of AI need to be considered and avoided.

Understanding gut microbiome-based machine learning platforms: A review on therapeutic approaches using deep learning

Human beings possess trillions of microbial cells in a symbiotic relationship. This relationship benefits both partners for a long time. The gut microbiota helps in many bodily functions from harvesting energy from digested food to strengthening biochemical barriers of the gut and intestine. But the changes in microbiota composition and bacteria that can enter the gastrointestinal tract can cause infection. Several approaches like culture-independent techniques such as high-throughput and meta-omics projects targeting 16S ribosomal RNA (rRNA) sequencing are popular methods to investigate the composition of the human gastrointestinal tract microbiota and taxonomically characterizing microbial communities. The microbiota conformation and diversity should be provided by whole-genome shotgun metagenomic sequencing of site-specific community DNA associating genome mapping, gene inventory, and metabolic remodelling and reformation, to ease the functional study of human microbiota. Preliminary examination of the therapeutic potency for dysbiosis-associated diseases permits investigation of pharmacokinetic-pharmacodynamic changes in microbial communities for escalation of treatment and dosage plan. Gut microbiome study is an integration of metagenomics which has influenced the field in the last two decades. And the incorporation of artificial intelligence and deep learning through "omics-based" methods and microfluidic evaluation enhanced the capability of identification of thousands of microbes.

Revolutionizing Women's Health: A Comprehensive Review of Artificial Intelligence Advancements in Gynecology

Artificial intelligence has yielded remarkably promising results in several medical fields, namely those with a strong imaging component. Gynecology relies heavily on imaging since it offers useful visual data on the female reproductive system, leading to a deeper understanding of pathophysiological concepts. The applicability of artificial intelligence technologies has not been as noticeable in gynecologic imaging as in other medical fields so far. However, due to growing interest in this area, some studies have been performed with exciting results. From urogynecology to oncology, artificial intelligence algorithms, particularly machine learning and deep learning, have shown huge potential to revolutionize the overall healthcare experience for women's reproductive health. In this review, we aim to establish the current status of AI in gynecology, the upcoming developments in this area, and discuss the challenges facing its clinical implementation, namely the technological and ethical concerns for technology development, implementation, and accountability.

Current Approaches for Monitoring of Patients with Inflammatory Bowel Diseases: A Narrative Review

BACKGROUND

Patients with inflammatory bowel diseases (IBD) require proactive monitoring both during the active phase to evaluate therapeutic response and during the remission phase to evaluate relapse or colorectal cancer surveillance. However, monitoring may vary between patients with ulcerative colitis (UC) and Crohn's disease (CD), with distinct tools and intervals.

METHODS

This narrative review aims to focus on modern approaches to IBD monitoring, considering international guidelines and expert consensus.

RESULTS

The most recent European diagnostic guidelines advocate a combination of clinical, laboratory, endoscopic, and radiological parameters to evaluate the disease course of patients with IBD. Unfortunately, the conventional symptom-based therapeutic approach does not improve long-term outcomes and there is no single ideal biomarker available. Endoscopy plays a key role in evaluating response to therapy as well as monitoring disease activity. Recently, bedside intestinal ultrasound (IUS) has gained increasing interest and diffusion as it appears to offer several advantages including the monitoring of therapeutic response.

CONCLUSION

In light of growing clinical advances, we present a schematic evidence-based monitoring algorithm that can be easily applied in clinical practice which combines all major monitoring modalities, including noninvasive tools such as IUS and video-capsule endoscopy.

Machine Learning of Histopathological Images Predicts Recurrences of Resected Pancreatic Ductal Adenocarcinoma With Adjuvant Treatment

OBJECTIVES

Pancreatic ductal adenocarcinoma is an intractable disease with frequent recurrence after resection and adjuvant therapy. The present study aimed to clarify whether artificial intelligence-assisted analysis of histopathological images can predict recurrence in patients with pancreatic ductal adenocarcinoma who underwent resection and adjuvant chemotherapy with tegafur/5-chloro-2,4-dihydroxypyridine/potassium oxonate.

MATERIALS AND METHODS

Eighty-nine patients were enrolled in the study. Machine-learning algorithms were applied to 10-billion-scale pixel data of whole-slide histopathological images to generate key features using multiple deep autoencoders. Areas under the curve were calculated from receiver operating characteristic curves using a support vector machine with key features alone and by combining with clinical data (age and carbohydrate antigen 19-9 and carcinoembryonic antigen levels) for predicting recurrence. Supervised learning with pathological annotations was conducted to determine the significant features for predicting recurrence.

RESULTS

Areas under the curves obtained were 0.73 (95% confidence interval, 0.59-0.87) by the histopathological data analysis and 0.84 (95% confidence interval, 0.73-0.94) by the combinatorial analysis of histopathological data and clinical data. Supervised learning model demonstrated that poor tumor differentiation was significantly associated with recurrence.

CONCLUSIONS

Results indicate that machine learning with the integration of artificial intelligence-driven evaluation of histopathological images and conventional clinical data provides relevant prognostic information for patients with pancreatic ductal adenocarcinoma.

Artificial Intelligence in endoscopy: A future poll

Artificial Intelligence [AI] has been a trendy topic in recent years, with many developed medical applications. In gastrointestinal endoscopy, AI systems include computer-assisted detection [CADe] for lesion detection as bleedings and polyps and computer-assisted diagnosis [CADx] for optical biopsy and lesion characterization. The technology behind these systems is based on a computer algorithm that is trained for a specific function. This function could be to recognize or characterize target lesions such as colonic polyps. Moreover, AI systems can offer technical assistance to improve endoscopic performance as scope insertion guidance. Currently, we believe that such technologies still lack legal and regulatory validations as a large sector of doctors and patients have concerns. However, there is no doubt that these technologies will bring significant improvement in the endoscopic management of patients as well as save money and time.

Application of AI on cholangiocarcinoma

Cholangiocarcinoma, classified as intrahepatic, perihilar, and extrahepatic, is considered a deadly malignancy of the hepatobiliary system. Most cases of cholangiocarcinoma are asymptomatic. Therefore, early detection of cholangiocarcinoma is significant but still challenging. The routine screening of a tumor lacks specificity and accuracy. With the application of AI, high-risk patients can be easily found by analyzing their clinical characteristics, serum biomarkers, and medical images. Moreover, AI can be used to predict the prognosis including recurrence risk and metastasis. Although they have some limitations, AI algorithms will still significantly improve many aspects of cholangiocarcinoma in the medical field with the development of computing power and technology.

A computer-aided system improves the performance of endoscopists in detecting colorectal polyps: a multi-center, randomized controlled trial

Background

Up to 45.9% of polyps are missed during colonoscopy, which is the major cause of post-colonoscopy colorectal cancer (CRC). Computer-aided detection (CADe) techniques based on deep learning might improve endoscopists' performance in detecting polyps. We aimed to evaluate the effectiveness of the CADe system in assisting endoscopists in a real-world clinical setting.

Methods

The CADe system was trained to detect colorectal polyps, recognize the ileocecal region, and monitor the speed of withdrawal during colonoscopy in real-time. Between 17 January 2021 and 16 July 2021. We recruited consecutive patients aged 18-75 years from three centers in China. We randomized patients in 1:1 groups to either colonoscopy with the CADe system or unassisted (control). The primary outcomes were the sensitivity and specificity of the endoscopists. We used subgroup analysis to examine the polyp detection rate (PDR) and the miss detection rate of endoscopists.

Results

A total of 1293 patients were included. The sensitivity of the endoscopists in the experimental group was significantly higher than that of the control group (84.97 vs. 72.07%, p < 0.001), and the specificity of the endoscopists in these two groups was comparable (100.00 vs. 100.00%). In a subgroup analysis, the CADe system improved the PDR of the 6-9 mm polyps (18.04 vs. 13.85%, p < 0.05) and reduced the miss detection rate, especially at 10:00-12:00 am (12.5 vs. 39.81%, p < 0.001).

Conclusion

The CADe system can potentially improve the sensitivity of endoscopists in detecting polyps, reduce the missed detection of polyps in colonoscopy, and reduce the risk of CRC.

Registration

This clinical trial was registered with the Chinese Clinical Trial Registry (Trial Registration Number: ChiCTR2100041988).

Clinical trial registration

website www.chictr.org.cn, identifier ChiCTR2100041988.

A newly developed deep learning-based system for automatic detection and classification of small bowel lesions during double-balloon enteroscopy examination

BACKGROUND

Double-balloon enteroscopy (DBE) is a standard method for diagnosing and treating small bowel disease. However, DBE may yield false-negative results due to oversight or inexperience. We aim to develop a computer-aided diagnostic (CAD) system for the automatic detection and classification of small bowel abnormalities in DBE.

DESIGN AND METHODS

A total of 5201 images were collected from Renmin Hospital of Wuhan University to construct a detection model for localizing lesions during DBE, and 3021 images were collected to construct a classification model for classifying lesions into four classes, protruding lesion, diverticulum, erosion & ulcer and angioectasia. The performance of the two models was evaluated using 1318 normal images and 915 abnormal images and 65 videos from independent patients and then compared with that of 8 endoscopists. The standard answer was the expert consensus.

RESULTS

For the image test set, the detection model achieved a sensitivity of 92% (843/915) and an area under the curve (AUC) of 0.947, and the classification model achieved an accuracy of 86%. For the video test set, the accuracy of the system was significantly better than that of the endoscopists (85% vs. 77 ± 6%, p < 0.01). For the video test set, the proposed system was superior to novices and comparable to experts.

CONCLUSIONS

We established a real-time CAD system for detecting and classifying small bowel lesions in DBE with favourable performance. ENDOANGEL-DBE has the potential to help endoscopists, especially novices, in clinical practice and may reduce the miss rate of small bowel lesions.

Deep learning-based anatomical position recognition for gastroscopic examination

BACKGROUND

The gastroscopic examination is a preferred method for the detection of upper gastrointestinal lesions. However, gastroscopic examination has high requirements for doctors, especially for the strict position and quantity of the archived images. These requirements are challenging for the education and training of junior doctors.

OBJECTIVE

The purpose of this study is to use deep learning to develop automatic position recognition technology for gastroscopic examination.

METHODS

A total of 17182 gastroscopic images in eight anatomical position categories are collected. Convolutional neural network model MogaNet is used to identify all the anatomical positions of the stomach for gastroscopic examination The performance of four models is evaluated by sensitivity, precision, and F1 score.

RESULTS

The average sensitivity of the method proposed is 0.963, which is 0.074, 0.066 and 0.065 higher than ResNet, GoogleNet and SqueezeNet, respectively. The average precision of the method proposed is 0.964, which is 0.072, 0.067 and 0.068 higher than ResNet, GoogleNet, and SqueezeNet, respectively. And the average F1-Score of the method proposed is 0.964, which is 0.074, 0.067 and 0.067 higher than ResNet, GoogleNet, and SqueezeNet, respectively. The results of the t-test show that the method proposed is significantly different from other methods (p< 0.05).

CONCLUSION

The method proposed exhibits the best performance for anatomical positions recognition. And the method proposed can help junior doctors meet the requirements of completeness of gastroscopic examination and the number and position of archived images quickly.

Development and validation of machine learning model for predicting treatment responders in patients with primary biliary cholangitis

AIMS

Ursodeoxycholic acid is the first-line treatment for primary biliary cholangitis, and treatment response is one of the factors predicting the outcome. To prescribe alternative therapies, clinicians might need additional information before deciphering the treatment response to ursodeoxycholic acid, contributing to a better patient prognosis. In this study, we developed and validated machine learning (ML) algorithms to predict treatment responses using pretreatment data.

METHODS

This multicenter cohort study included collecting datasets from two data samples. Data 1 included 245 patients from 18 hospitals for ML development, and was divided into (i) training and (ii) development sets. Data 2 (iii: test set) included 51 patients from our hospital for validation. An extreme gradient boosted tree predicted the treatment response in the ML model. The area under the curve was used to evaluate the efficacy of the algorithm.

RESULTS

Data 1 showed that patients complying with the Paris II treatment response had significantly lower serum alkaline phosphatase and total bilirubin levels than those who did not respond. Three factors, total bilirubin, total protein, and alanine aminotransferase levels were selected as essential variables for prediction. Data 2 showed that patients complying with the Paris II criteria had significantly high prothrombin time and low total bilirubin levels. The area under the curve of extreme gradient boosted tree was good for (ii) (0.811) and (iii) (0.856).

CONCLUSIONS

We demonstrated the efficacy of ML in predicting the treatment response for patients with primary biliary cholangitis. Early identification of cases requiring additional treatment with our novel ML model may improve prognosis.

Artificial intelligence predicts direct-acting antivirals failure among hepatitis C virus patients: A nationwide hepatitis C virus registry program

BACKGROUND/AIMS

Despite the high efficacy of direct-acting antivirals (DAAs), approximately 1-3% of hepatitis C virus (HCV) patients fail to achieve a sustained virological response. We conducted a nationwide study to investigate risk factors associated with DAA treatment failure. Machine-learning algorithms have been applied to discriminate subjects who may fail to respond to DAA therapy.

METHODS

We analyzed the Taiwan HCV Registry Program database to explore predictors of DAA failure in HCV patients. Fifty-five host and virological features were assessed using multivariate logistic regression, decision tree, random forest, eXtreme Gradient Boosting (XGBoost), and artificial neural network. The primary outcome was undetectable HCV RNA at 12 weeks after the end of treatment.

RESULTS

The training (n=23,955) and validation (n=10,346) datasets had similar baseline demographics, with an overall DAA failure rate of 1.6% (n=538). Multivariate logistic regression analysis revealed that liver cirrhosis, hepatocellular carcinoma, poor DAA adherence, and higher hemoglobin A1c were significantly associated with virological failure. XGBoost outperformed the other algorithms and logistic regression models, with an area under the receiver operating characteristic curve of 1.000 in the training dataset and 0.803 in the validation dataset. The top five predictors of treatment failure were HCV RNA, body mass index, α-fetoprotein, platelets, and FIB-4 index. The accuracy, sensitivity, specificity, positive predictive value, and negative predictive value of the XGBoost model (cutoff value=0.5) were 99.5%, 69.7%, 99.9%, 97.4%, and 99.5%, respectively, for the entire dataset.

CONCLUSION

Machine learning algorithms effectively provide risk stratification for DAA failure and additional information on the factors associated with DAA failure.

Pediatric endoscopy: how can we improve patient outcomes and ensure best practices?

INTRODUCTION

Strategies to promote high-quality endoscopy in children require consensus around pediatric-specific quality standards and indicators. Using a rigorous guideline development process, the international Pediatric Endoscopy Quality Improvement Network (PEnQuIN) was developed to support continuous quality improvement efforts within and across pediatric endoscopy services.

AREAS COVERED

This review presents a framework, informed by the PEnQuIN guidelines, for assessing endoscopist competence, granting procedural privileges, audit and feedback, and for skill remediation, when required. As is critical for promoting quality, PEnQuIN indicators can be benchmarked at the individual endoscopist, endoscopy facility, and endoscopy community levels. Furthermore, efforts to incorporate technologies, including electronic medical records and artificial intelligence, into endoscopic quality improvement processes can aid in creation of large-scale networks to facilitate comparison and standardization of quality indicator reporting across sites.

EXPERT OPINION

PEnQuIN quality standards and indicators provide a framework for continuous quality improvement in pediatric endoscopy, benefiting individual endoscopists, endoscopy facilities, and the broader endoscopy community. Routine and reliable measurement of data, facilitated by technology, is required to identify and drive improvements in care. Engaging all stakeholders in endoscopy quality improvement processes is crucial to enhancing patient outcomes and establishing best practices for safe, efficient, and effective pediatric endoscopic care.

Artificial intelligence system for the detection of Barrett's esophagus

BACKGROUND

Barrett's esophagus (BE), which has increased in prevalence worldwide, is a precursor for esophageal adenocarcinoma. Although there is a gap in the detection rates between endoscopic BE and histological BE in current research, we trained our artificial intelligence (AI) system with images of endoscopic BE and tested the system with images of histological BE.

AIM

To assess whether an AI system can aid in the detection of BE in our setting.

METHODS

Endoscopic narrow-band imaging (NBI) was collected from Chung Shan Medical University Hospital and Changhua Christian Hospital, resulting in 724 cases, with 86 patients having pathological results. Three senior endoscopists, who were instructing physicians of the Digestive Endoscopy Society of Taiwan, independently annotated the images in the development set to determine whether each image was classified as an endoscopic BE. The test set consisted of 160 endoscopic images of 86 cases with histological results.

RESULTS

Six pre-trained models were compared, and EfficientNetV2B2 (accuracy [ACC]: 0.8) was selected as the backbone architecture for further evaluation due to better ACC results. In the final test, the AI system correctly identified 66 of 70 cases of BE and 85 of 90 cases without BE, resulting in an ACC of 94.37%.

CONCLUSION

Our AI system, which was trained by NBI of endoscopic BE, can adequately predict endoscopic images of histological BE. The ACC, sensitivity, and specificity are 94.37%, 94.29%, and 94.44%, respectively.

Evaluation of computer aided detection during colonoscopy among Veterans: Randomized clinical trial

BACKGROUND

There has been significant interest in use of computer aided detection (CADe) devices in colonoscopy to improve polyp detection and reduce miss rate.

AIM

To investigate the use of CADe amongst veterans.

METHODS

Between September 2020 and December 2021, we performed a randomized controlled trial to evaluate the impact of CADe. Patients at Veterans Affairs Palo Alto Health Care System presenting for screening or low-risk surveillance were randomized to colonoscopy performed with or without CADe. Primary outcomes of interest included adenoma detection rate (ADR), adenomas per colonoscopy (APC), and adenomas per extraction. In addition, we measured serrated polyps per colonoscopy, non-adenomatous, non-serrated polyps per colonoscopy, serrated polyp detection rate, and procedural time.

RESULTS

A total of 244 patients were enrolled (124 with CADe), with similar patient characteristics (age, sex, body mass index, indication) between the two groups. Use of CADe was found to have decreased number of adenomas (1.79 vs 2.53, P = 0.030) per colonoscopy compared to without CADe. There was no significant difference in number of serrated polyps or non-adenomatous non-serrated polyps per colonoscopy between the two groups. Overall, use of CADe was found to have lower ADR (68.5% vs 80.0%, P = 0.041) compared to without use of CADe. Serrated polyp detection rate was lower with CADe (3.2% vs 7.5%) compared to without CADe, but this was not statistically significant (P = 0.137). There was no significant difference in withdrawal and procedure times between the two groups or in detection of adenomas per extraction (71.4% vs 73.1%, P = 0.613). No adverse events were identified.

CONCLUSION

While several randomized controlled trials have demonstrated improved ADR and APC with use of CADe, in this RCT performed at a center with high ADR, use of CADe was found to have decreased APC and ADR. Further studies are needed to understand the true impact of CADe on performance quality among endoscopists as well as determine criteria for endoscopists to consider when choosing to adopt CADe in their practices.

Artificial intelligence in rectal cancer: What is the future?

Colorectal cancer (CRC) is the third most prevalent cancer in both men and women, and it is the second leading cause of cancer-related deaths globally. Around 60%-70% of CRC patients are diagnosed at advanced stages, with nearly 20% having liver metastases. It is noteworthy that the 5-year survival rates decline significantly from 80%-90% for localized disease to a mere 10%-15% for patients with metastasis at the time of diagnosis. Early diagnosis, appropriate therapeutic strategy, accurate assessment of treatment response, and prognostication is essential for better outcome. There has been significant technological development in the last couple of decades to improve the outcome of rectal cancer including Artificial intelligence (AI). AI is a broad term used to describe the study of machines that mimic human intelligence, such as perceiving the environment, drawing logical conclusions from observations, and performing complex tasks. At present AI has demonstrated a promising role in early diagnosis, prognosis, and treatment outcomes for patients with rectal cancer, a limited role in surgical decision making, and had a bright future.

Automatized Detection of Crohn's Disease in Intestinal Ultrasound Using Convolutional Neural Network

INTRODUCTION

The use of intestinal ultrasound (IUS) for the diagnosis and follow-up of inflammatory bowel disease is steadily growing. Although access to educational platforms of IUS is feasible, novice ultrasound operators lack experience in performing and interpreting IUS. An artificial intelligence (AI)-based operator supporting system that automatically detects bowel wall inflammation may simplify the use of IUS by less experienced operators. Our aim was to develop and validate an artificial intelligence module that can distinguish bowel wall thickening (a surrogate of bowel inflammation) from normal bowel images of IUS.

METHODS

We used a self-collected image data set to develop and validate a convolutional neural network module that can distinguish bowel wall thickening >3 mm (a surrogate of bowel inflammation) from normal bowel images of IUS.

RESULTS

The data set consisted of 1008 images, distributed uniformly (50% normal images, 50% abnormal images). Execution of the training phase and the classification phase was performed using 805 and 203 images, respectively. The overall accuracy, sensitivity, and specificity for detection of bowel wall thickening were 90.1%, 86.4%, and 94%, respectively. The network exhibited an average area under the ROC curve of 0.9777 for this task.

CONCLUSIONS

We developed a machine-learning module based on a pretrained convolutional neural network that is highly accurate in the recognition of bowel wall thickening on intestinal ultrasound images in Crohn's disease. Incorporation of convolutional neural network to IUS may facilitate the use of IUS by inexperienced operators and allow automatized detection of bowel inflammation and standardization of IUS imaging interpretation.

Diagnosis and Treatment of Liver Disease: Current Trends and Future Directions

This narrative review delves into the intricate landscape of liver diseases, providing a comprehensive background of the diverse conditions that afflict this vital organ. Liver diseases, ranging from viral hepatitis and non-alcoholic fatty liver disease (NAFLD) to cirrhosis and hepatocellular carcinoma (HCC), pose significant global health challenges. Understanding these diseases' multifaceted origins and progression is pivotal for developing effective diagnostic and therapeutic strategies. The epidemiology and etiology of liver diseases emphasize the global impact of viral hepatitis, with hepatitis B and C as significant contributors. Concurrently, the rising prevalence of NAFLD, linked to lifestyle factors and metabolic syndrome, underscores the intricate relationship between modern living and liver health. Chronic liver diseases often evolve insidiously, progressing from inflammation to fibrosis and, ultimately, to cirrhosis - a stage characterized by irreversible scarring and compromised function. The heightened risk of HCC in advanced liver disease stages further underscores the urgency of effective diagnostic and therapeutic interventions. The evolving landscape of non-invasive diagnostic tools is explored for their role in enabling early detection and accurate staging of liver diseases. In the realm of treatment, there is a continuous transition toward personalized medicine, customized to suit the unique profiles of individual patients. This shift encompasses a broad spectrum, ranging from personalized pharmacological interventions to lifestyle modifications and surgical options. Delving into innovative therapies, such as gene editing and immunomodulation, offers a glimpse into the promising future directions that have the potential to redefine the landscape of liver disease diagnosis and treatment.