Real-time use of artificial intelligence for diagnosing early gastric cancer by magnifying image-enhanced endoscopy: a multicenter diagnostic study (with videos)

Artificial intelligence-assisted diagnosis of early gastric cancer: present practice and future prospects

Gastric cancer (GC) occupies the first few places in the world among tumors in terms of incidence and mortality, causing serious harm to human health, and at the same time, its treatment greatly consumes the health care resources of all countries in the world. The diagnosis of GC is usually based on histopathologic examination, and it is very important to be able to detect and identify cancerous lesions at an early stage, but some endoscopists' lack of diagnostic experience and fatigue at work lead to a certain rate of under diagnosis. The rapid and striking development of Artificial intelligence (AI) has helped to enhance the ability to extract abnormal information from endoscopic images to some extent, and more and more researchers are applying AI technology to the diagnosis of GC. This initiative has not only improved the detection rate of early gastric cancer (EGC), but also significantly improved the survival rate of patients after treatment. This article reviews the results of various AI-assisted diagnoses of EGC in recent years, including the identification of EGC, the determination of differentiation type and invasion depth, and the identification of borders. Although AI has a better application prospect in the early diagnosis of ECG, there are still major challenges, and the prospects and limitations of AI application need to be further discussed.

Diagnostic performance of AI-assisted endoscopy diagnosis of digestive system tumors: an umbrella review

The diagnostic performance of artificial intelligence (AI)-assisted endoscopy for digestive tumors remains controversial. The objective of this umbrella review was to summarize the comprehensive evidence for the AI-assisted endoscopic diagnosis of digestive system tumors. We grouped the evidence according to the location of each digestive system tumor and performed separate subgroup analyses on the basis of the method of data collection and form of the data. We also compared the diagnostic performance of AI with that of experts and nonexperts. For early digestive system cancer and precancerous lesions, AI showed a high diagnostic performance in capsule endoscopy and esophageal squamous cell carcinoma. Additionally, AI-assisted endoscopic ultrasonography (EUS) had good diagnostic accuracy for pancreatic cancer. In the subgroup analysis, AI had a better diagnostic performance than experts for most digestive system tumors. However, the diagnostic performance of AI using video data requires improvement.

Artificial intelligence in gastrointestinal cancer research: Image learning advances and applications

With the rapid advancement of artificial intelligence (AI) technologies, including deep learning, large language models, and neural networks, these methodologies are increasingly being developed and integrated into cancer research. Gastrointestinal tumors are characterized by complexity and heterogeneity, posing significant challenges for early detection, diagnostic accuracy, and the development of personalized treatment strategies. The application of AI in digestive oncology has demonstrated its transformative potential. AI not only alleviates the diagnostic burden on clinicians, but it improves tumor screening sensitivity, specificity, and accuracy. Additionally, AI aids the detection of biomarkers such as microsatellite instability and mismatch repair, supports intraoperative assessments of tumor invasion depth, predicts treatment responses, and facilitates the design of personalized treatment plans to potentially significantly enhance patient outcomes. Moreover, the integration of AI with multiomics analyses and imaging technologies has led to substantial advancements in foundational research on the tumor microenvironment. This review highlights the progress of AI in gastrointestinal oncology over the past 5 years with focus on early tumor screening, diagnosis, molecular marker identification, treatment planning, and prognosis predictions. We also explored the potential of AI to enhance medical imaging analyses to aid tumor detection and characterization as well as its role in automating and refining histopathological assessments.

Role of Artificial Intelligence in the Detection and Management of Premalignant and Malignant Lesions of the Esophagus and Stomach

The advent of artificial intelligence (AI) and deep learning algorithms, particularly convolutional neural networks, promises to address pitfalls, bridging the care for patients at high risk with improved detection (computer-aided detection [CADe]) and characterization (computer-aided diagnosis [CADx]) of lesions. This review describes the available artificial intelligence (AI) technology and the current data on AI tools for screening esophageal squamous cell cancer, Barret's esophagus-related neoplasia, and gastric cancer. These tools outperformed endoscopists in many situations. Recent randomized controlled trials have demonstrated the successful application of AI tools in clinical practice with improved outcomes.

The application of artificial intelligence in upper gastrointestinal cancers

Upper gastrointestinal cancers, mainly comprising esophageal and gastric cancers, are among the most prevalent cancers worldwide. There are many new cases of upper gastrointestinal cancers annually, and the survival rate tends to be low. Therefore, timely screening, precise diagnosis, appropriate treatment strategies, and effective prognosis are crucial for patients with upper gastrointestinal cancers. In recent years, an increasing number of studies suggest that artificial intelligence (AI) technology can effectively address clinical tasks related to upper gastrointestinal cancers. These studies mainly focus on four aspects: screening, diagnosis, treatment, and prognosis. In this review, we focus on the application of AI technology in clinical tasks related to upper gastrointestinal cancers. Firstly, the basic application pipelines of radiomics and deep learning in medical image analysis were introduced. Furthermore, we separately reviewed the application of AI technology in the aforementioned aspects for both esophageal and gastric cancers. Finally, the current limitations and challenges faced in the field of upper gastrointestinal cancers were summarized, and explorations were conducted on the selection of AI algorithms in various scenarios, the popularization of early screening, the clinical applications of AI, and large multimodal models.

The artificial intelligence revolution in gastric cancer management: clinical applications

Nowadays, gastric cancer has become a significant issue in the global cancer burden, and its impact cannot be ignored. The rapid development of artificial intelligence technology is attempting to address this situation, aiming to change the clinical management landscape of gastric cancer fundamentally. In this transformative change, machine learning and deep learning, as two core technologies, play a pivotal role, bringing unprecedented innovations and breakthroughs in the diagnosis, treatment, and prognosis evaluation of gastric cancer. This article comprehensively reviews the latest research status and application of artificial intelligence algorithms in gastric cancer, covering multiple dimensions such as image recognition, pathological analysis, personalized treatment, and prognosis risk assessment. These applications not only significantly improve the sensitivity of gastric cancer risk monitoring, the accuracy of diagnosis, and the precision of survival prognosis but also provide robust data support and a scientific basis for clinical decision-making. The integration of artificial intelligence, from optimizing the diagnosis process and enhancing diagnostic efficiency to promoting the practice of precision medicine, demonstrates its promising prospects for reshaping the treatment model of gastric cancer. Although most of the current AI-based models have not been widely used in clinical practice, with the continuous deepening and expansion of precision medicine, we have reason to believe that a new era of AI-driven gastric cancer care is approaching.

Artificial Intelligence Applications in Image-Based Diagnosis of Early Esophageal and Gastric Neoplasms

Artificial intelligence (AI) holds the potential to transform the management of upper gastrointestinal (GI) conditions, such as Barrett's esophagus, esophageal squamous cell cancer, and early gastric cancer. Advancements in deep learning and convolutional neural networks offer improved diagnostic accuracy and reduced diagnostic variability across different clinical settings, particularly where human error or fatigue may impair diagnostic precision. Deep learning models have shown the potential to improve early cancer detection and lesion characterization, predict invasion depth, and delineate lesion margins with remarkable accuracy, all contributing to effective treatment planning. Several challenges, however, limit the broad application of AI in GI endoscopy, particularly in the upper GI tract. Subtle lesion morphology and restricted diversity in training datasets, which are often sourced from specialized centers, may constrain the generalizability of AI models in various clinical settings. Furthermore, the "black box" nature of some AI systems can impede explainability and clinician trust. To address these issues, efforts are underway to incorporate multimodal data, such as combining endoscopic and histopathologic imaging, to bolster model robustness and transparency. In the future, AI promises substantial advancements in automated real-time endoscopic guidance, personalized risk assessment, and optimized biopsy decision making. As it evolves, it would substantially impact not only early diagnosis and prognosis, but also the cost-effectiveness of managing upper GI diseases, ultimately leading to improved patient outcomes and more efficient health care delivery.

Real-time artificial intelligence-assisted detection and segmentation of nasopharyngeal carcinoma using multimodal endoscopic data: a multi-center, prospective study

Background

Nasopharyngeal carcinoma (NPC) is a common malignancy in southern China, and often underdiagnosed due to reliance on physician expertise. Artificial intelligence (AI) can enhance diagnostic accuracy and efficiency using large datasets and advanced algorithms.

Methods

Nasal endoscopy videos with white light imaging (WLI) and narrow-band imaging (NBI) modes from 707 patients treated at one center in China from June 2020 to December 2022 were prospectively collected. A total of 8816 frames were obtained through standardized data procedures. Nasopharyngeal Carcinoma Diagnosis Segmentation Network Framework (NPC-SDNet) was developed and internally tested based on these frames. Two hundred frames were randomly selected to compare the diagnostic performance between NPC-SDNet and rhinologists. Two external testing sets with 2818 images from other hospitals validated the robustness and generalizability of the model. This study was registered at clinicaltrials.gov (NCT04547673).

Findings

The diagnostic accuracy, precision, recall, and specificity of NPC-SDNet using WLI were 95.0% (95% CI: 94.1%-96.2%), 93.5% (95% CI: 90.2%-95.2%), 97.2% (95% CI: 96.2%-98.3%), and 93.5% (95% CI: 91.7%-94.0%), respectively, and using NBI were 95.8% (95% CI: 94.0%-96,8%), 93.1% (95% CI: 91.0%-95.6%), 96.0% (95% CI: 95.7%-96.8%), and 97.2% (95% CI: 97.1%-97.4%), respectively. Segmentation performance was also robust, with mean Intersection over Union scores of 83.4% (95% CI: 81.8%-85.6%; NBI) and 83.7% (95% CI: 85.1%-90.1%; WLI). In head-to-head comparisons with rhinologists, NPC-SDNet achieved a diagnostic accuracy of 94.0% (95% CI: 91.5%-95.8%) and processed 1000 frames per minute, outperforming clinicians (68.9%-88.2%) across different expertise levels. External validation further supported the reliability of NPC-SDNet, with area under the receiver operating characteristic curve (AUC) values of 0.998 and 0.977 in NBI images, 0.977 and 0.970 in WLI images.

Interpretation

NPC-SDNet demonstrates excellent real-time diagnostic and segmentation accuracy, offering a promising tool for enhancing the precision of NPC diagnosis.

Funding

This work was supported by National Key R&D Program of China (2020YFC1316903), the National Natural Science Foundation of China (NSFC) grants (81900918, 82020108009), Natural Science Foundation of Guangdong Province (2022A1515010002), Key-Area Research and Development of Guangdong Province (2023B1111040004, 2020B1111190001), and Key Clinical Technique of Guangzhou (2023P-ZD06).

A review of deep learning methods for gastrointestinal diseases classification applied in computer-aided diagnosis system

Recent advancements in deep learning have significantly improved the intelligent classification of gastrointestinal (GI) diseases, particularly in aiding clinical diagnosis. This paper seeks to review a computer-aided diagnosis (CAD) system for GI diseases, aligning with the actual clinical diagnostic process. It offers a comprehensive survey of deep learning (DL) techniques tailored for classifying GI diseases, addressing challenges inherent in complex scenes, clinical constraints, and technical obstacles encountered in GI imaging. Firstly, the esophagus, stomach, small intestine, and large intestine were located to determine the organs where the lesions were located. Secondly, location detection and classification of a single disease are performed on the premise that the organ's location corresponding to the image is known. Finally, comprehensive classification for multiple diseases is carried out. The results of single and multi-classification are compared to achieve more accurate classification outcomes, and a more effective computer-aided diagnosis system for gastrointestinal diseases was further constructed.

The application of the combination between artificial intelligence and endoscopy in gastrointestinal tumors

Gastrointestinal (GI) tumors have always been a major type of malignant tumor and a leading cause of tumor‐related deaths worldwide. The main principles of modern medicine for GI tumors are early prevention, early diagnosis, and early treatment, with early diagnosis being the most effective measure. Endoscopy, due to its ability to visualize lesions, has been one of the primary modalities for screening, diagnosing, and treating GI tumors. However, a qualified endoscopist often requires long training and extensive experience, which to some extent limits the wider use of endoscopy. With advances in data science, artificial intelligence (AI) has brought a new development direction for the endoscopy of GI tumors. AI can quickly process large quantities of data and images and improve diagnostic accuracy with some training, greatly reducing the workload of endoscopists and assisting them in early diagnosis. Therefore, this review focuses on the combined application of endoscopy and AI in GI tumors in recent years, describing the latest research progress on the main types of tumors and their performance in clinical trials, the application of multimodal AI in endoscopy, the development of endoscopy, and the potential applications of AI within it, with the aim of providing a reference for subsequent research.

Transformative artificial intelligence in gastric cancer: Advancements in diagnostic techniques

Gastric cancer represents a significant global health challenge with elevated incidence and mortality rates, highlighting the need for advancements in diagnostic and therapeutic strategies. This review paper addresses the critical need for a thorough synthesis of the role of artificial intelligence (AI) in the management of gastric cancer. It provides an in-depth analysis of current AI applications, focusing on their contributions to early diagnosis, treatment planning, and outcome prediction. The review identifies key gaps and limitations in the existing literature by examining recent studies and technological developments. It aims to clarify the evolution of AI-driven methods and their impact on enhancing diagnostic accuracy, personalizing treatment strategies, and improving patient outcomes. The paper emphasizes the transformative potential of AI in overcoming the challenges associated with gastric cancer management and proposes future research directions to further harness AI's capabilities. Through this synthesis, the review underscores the importance of integrating AI technologies into clinical practice to revolutionize gastric cancer management.

The diagnostic value of image-enhanced endoscopy system in sinonasal inverted papilloma

PURPOSE

This study aimed to evaluate the diagnostic value of image-enhanced endoscopy (IEE) in detecting sinonasal inverted papilloma (SNIP).

METHODS

Overall, 86 patients with unilateral nasal papillary or lobulated neoplasms were included between July 2018 and June 2019. All patients underwent IEE examinations, and the diagnosis of all neoplasms was confirmed through postoperative pathology. Logistic regression analysis was conducted to screen for independent predictors of various types of vascular patterns of SNIP. Furthermore, a prognostic nomogram was constructed using the independent predictors screened by logistic regression analysis to evaluate its usefulness in distinguishing SNIP from nasal polyp (NP) and papillary mucosa folds (PMF).

RESULTS

In total, 86 consecutive cases were observed, including 37 with SNIP, 40 with NP, and 9 with PMF. Logistic regression analysis showed that spot, corkscrew, and multilayered vascular patterns were independent predictors of SNIP diagnosis. Furthermore, a nomogram comprising the three independent risk factors was constructed with scores of 5, 2, and 3. The area under the receiver operating characteristic curve for predicting SNIP was 0.954, 0.66, 0.71, and 0.76 for the nomogram model, spot vascular pattern, corkscrew vascular pattern, and multilayered vascular pattern, respectively.

CONCLUSION

The nomogram model based on spot, corkscrew, and multilayered vascular patterns in SNIP observed using IEE can be a useful diagnostic tool for predicting and distinguishing between NP and PMF.

Emerging Technologies in Endoscopy for Gastrointestinal Neoplasms: A Comprehensive Overview

Gastrointestinal neoplasms are a growing global health concern, requiring prompt identification and treatment. Endoscopic procedures have revolutionized the detection and treatment of gastrointestinal tumors by providing accurate, minimally invasive methods. Early-stage malignancies can be treated with endoscopic excision, leading to improved outcomes and increased survival rates. Precancerous lesions, like adenomatous polyps, can be prevented by removing them, reducing cancer occurrence and death rates. Advanced techniques like chromoendoscopy, narrow-band imaging, and confocal laser endomicroscopy improve the ability to see the mucosa surface and diagnose conditions. Artificial Intelligence (AI) applications in endoscopy can enhance diagnostic accuracy and predict histology outcomes. However, challenges remain in accurately defining lesions and ensuring precise diagnosis and treatment selection. Molecular imaging approaches and therapeutic modalities like photodynamic therapy and endoscopic ultrasonography-guided therapies hold potential but require further study and clinical confirmation. This study examines the future prospects and obstacles in endoscopic procedures for the timely identification and treatment of gastrointestinal cancers. The focus is on developing technology, limits, and prospective effects on clinical practice.

Enhanced multi-class pathology lesion detection in gastric neoplasms using deep learning-based approach and validation

This study developed a new convolutional neural network model to detect and classify gastric lesions as malignant, premalignant, and benign. We used 10,181 white-light endoscopy images from 2606 patients in an 8:1:1 ratio. Lesions were categorized as early gastric cancer (EGC), advanced gastric cancer (AGC), gastric dysplasia, benign gastric ulcer (BGU), benign polyp, and benign erosion. We assessed the lesion detection and classification model using six-class, cancer versus non-cancer, and neoplasm versus non-neoplasm categories, as well as T-stage estimation in cancer lesions (T1, T2-T4). The lesion detection rate was 95.22% (219/230 patients) on a per-patient basis: 100% for EGC, 97.22% for AGC, 96.49% for dysplasia, 75.00% for BGU, 97.22% for benign polyps, and 80.49% for benign erosion. The six-class category exhibited an accuracy of 73.43%, sensitivity of 80.90%, specificity of 83.32%, positive predictive value (PPV) of 73.68%, and negative predictive value (NPV) of 88.53%. The sensitivity and NPV were 78.62% and 88.57% for the cancer versus non-cancer category, and 83.26% and 89.80% for the neoplasm versus non-neoplasm category, respectively. The T stage estimation model achieved an accuracy of 85.17%, sensitivity of 88.68%, specificity of 79.81%, PPV of 87.04%, and NPV of 82.18%. The novel CNN-based model remarkably detected and classified malignant, premalignant, and benign gastric lesions and accurately estimated gastric cancer T-stages.

Physician perceptions on the current and future impact of artificial intelligence to the field of gastroenterology

BACKGROUND AND AIMS

The use of artificial intelligence (AI) has transformative implications to the practice of gastroenterology and endoscopy. The aims of this study were to understand the perceptions of the gastroenterology community toward AI and to identify potential barriers for adoption.

METHODS

A 16-question online survey exploring perceptions on the current and future implications of AI to the field of gastroenterology was developed by the American Society for Gastrointestinal Endoscopy AI Task Force and distributed to national and international society members. Participant demographic information including age, sex, experience level, and practice setting was collected. Descriptive statistics were used to summarize survey findings, and a Pearson χ2 analysis was performed to determine the association between participant demographic information and perceptions of AI.

RESULTS

Of 10,162 invited gastroenterologists, 374 completed the survey. The mean age of participants was 46 years (standard deviation, 12), and 299 participants (80.0%) were men. One hundred seventy-nine participants (47.9%) had >10 years of practice experience, with nearly half working in the community setting. Only 25 participants (6.7%) reported the current use of AI in their clinical practice. Most participants (95.5%) believed that AI solutions will have a positive impact in their practice. One hundred seventy-six participants (47.1%) believed that AI will make clinical duties more technical but will also ease the burden of the electronic medical record (54.0%). The top 3 areas where AI was predicted to be most influential were endoscopic lesion detection (65.3%), endoscopic lesion characterization (65.8%), and quality metrics (32.6%). Participants voiced a desire for education on topics such as the clinical use of AI applications (64.4%), the advantages and limitations of AI applications (57.0%), and the technical methodology of AI (44.7%). Most participants (42.8%) expressed that the cost of AI implementation should be covered by their hospital. Demographic characteristics significantly associated with this perception included participants' years in practice and practice setting.

CONCLUSIONS

Gastroenterologists have an overall positive perception regarding the use of AI in clinical practice but voiced concerns regarding its technical aspects and coverage of costs associated with implementation. Further education on the clinical use of AI applications with understanding of the advantages and limitations appears to be valuable in promoting adoption.

Development and evaluation of a program based on a generative pre-trained transformer model from a public natural language processing platform for efficiency enhancement in post-procedural quality control of esophageal endoscopic submucosal dissection

BACKGROUND

Post-procedural quality control of endoscopic submucosal dissection (ESD) is emphasized in guidelines. However, this process can be tedious and time-consuming. Recently, a pre-training model called generative pre-trained transformer (GPT) on a public natural language processing platform has emerged and garnered significant attention, whose capabilities align well with the post-procedural quality control process and have the potential to streamline it. Therefore, we developed a simple program utilizing this platform and evaluated its performance.

METHODS

Esophageal ESDs were retrospectively included. The manual quality control process was performed and act as reference standard. GPT's prompt was optimized through multiple iterations. A Python program was developed to automatically submit prompt with pathological report of each ESD procedure and collect quality control information provided by GPT. Its performance on quality control was evaluated with accuracy, precision, recall, and F-1 score.

RESULTS

165 cases were involved into the dataset, of which 5 were utilized as the prompt optimization dataset and 160 as the validation dataset. Definitive prompt was achieved through seven iterations. Time spent on the validation dataset by GPT was 13.47 ± 2.43 min. Accuracies of pathological diagnosis, invasion depth, horizontal margin, vertical margin, vascular invasion, and lymphatic invasion of the quality control program were (0.940, 0.952) (95% CI), (0.925, 0.945) (95% CI), 0.931, 1.0, and 1.0, respectively. Precisions were (0.965, 0.969) (95% CI), (0.934, 0.954) (95% CI), and 0.957 for pathological diagnosis, invasion depth, and horizontal margin, respectively. Recalls were (0.940, 0.952) (95% CI), (0.925, 0.945) (95% CI), and 0.931 for factors as mentioned, respectively. F1-score were (0.945, 0.957) (95% CI), (0.928, 0.948) (95% CI), and 0.941 for factors as mentioned, respectively.

CONCLUSIONS

This quality control program was qualified of post-procedural quality control of esophageal ESDs. GPT can be easily applied to this quality control process and reduce workload of the endoscopists.

Application of artificial intelligence for diagnosis of early gastric cancer based on magnifying endoscopy with narrow-band imaging

Although magnifying endoscopy with narrow-band imaging is the standard diagnostic test for gastric cancer, diagnosing gastric cancer using this technology requires considerable skill. Artificial intelligence has superior image recognition, and its usefulness in endoscopic image diagnosis has been reported in many cases. The diagnostic performance (accuracy, sensitivity, and specificity) of artificial intelligence using magnifying endoscopy with narrow band still images and videos for gastric cancer was higher than that of expert endoscopists, suggesting the usefulness of artificial intelligence in diagnosing gastric cancer. Histological diagnosis of gastric cancer using artificial intelligence is also promising. However, previous studies on the use of artificial intelligence to diagnose gastric cancer were small-scale; thus, large-scale studies are necessary to examine whether a high diagnostic performance can be achieved. In addition, the diagnosis of gastric cancer using artificial intelligence has not yet become widespread in clinical practice, and further research is necessary. Therefore, in the future, artificial intelligence must be further developed as an instrument, and its diagnostic performance is expected to improve with the accumulation of numerous cases nationwide.

Building and validating an artificial intelligence model to identify tracheobronchopathia osteochondroplastica by using bronchoscopic images

BACKGROUND

Given the rarity of tracheobronchopathia osteochondroplastica (TO), many young doctors in primary hospitals are unable to identify TO based on bronchoscopy findings.

OBJECTIVES

To build an artificial intelligence (AI) model for differentiating TO from other multinodular airway diseases by using bronchoscopic images.

DESIGN

We designed the study by comparing the imaging data of patients undergoing bronchoscopy from January 2010 to October 2022 by using EfficientNet. Bronchoscopic images of 21 patients with TO at Anhui Chest Hospital from October 2019 to October 2022 were collected for external validation.

METHODS

Bronchoscopic images of patients with multinodular airway lesions (including TO, amyloidosis, tumors, and inflammation) and without airway lesions in the First Affiliated Hospital of Guangzhou Medical University were collected. The images were randomized (4:1) into training and validation groups based on different diseases and utilized for deep learning by convolutional neural networks (CNNs).

RESULTS

We enrolled 201 patients with multinodular airway disease (38, 15, 75, and 73 patients with TO, amyloidosis, tumors, and inflammation, respectively) and 213 without any airway lesions. To find multinodular lesion images for deep learning, we utilized 2183 bronchoscopic images of multinodular lesions (including TO, amyloidosis, tumor, and inflammation) and compared them with images without any airway lesions (1733). The accuracy of multinodular lesion identification was 98.9%. Further, the accuracy of TO detection based on the bronchoscopic images of multinodular lesions was 89.2%. Regarding external validation (using images from 21 patients with TO), all patients could be diagnosed with TO; the accuracy was 89.8%.

CONCLUSION

We built an AI model that could differentiate TO from other multinodular airway diseases (mainly amyloidosis, tumors, and inflammation) by using bronchoscopic images. The model could help young physicians identify this rare airway disease.

Application of artificial intelligence in endoscopic gastrointestinal tumors

With an increasing number of patients with gastrointestinal cancer, effective and accurate early diagnostic clinical tools are required provide better health care for patients with gastrointestinal cancer. Recent studies have shown that artificial intelligence (AI) plays an important role in the diagnosis and treatment of patients with gastrointestinal tumors, which not only improves the efficiency of early tumor screening, but also significantly improves the survival rate of patients after treatment. With the aid of efficient learning and judgment abilities of AI, endoscopists can improve the accuracy of diagnosis and treatment through endoscopy and avoid incorrect descriptions or judgments of gastrointestinal lesions. The present article provides an overview of the application status of various artificial intelligence in gastric and colorectal cancers in recent years, and the direction of future research and clinical practice is clarified from a clinical perspective to provide a comprehensive theoretical basis for AI as a promising diagnostic and therapeutic tool for gastrointestinal cancer.

Deep Learning and Gastric Cancer: Systematic Review of AI-Assisted Endoscopy

BACKGROUND

Gastric cancer (GC), a significant health burden worldwide, is typically diagnosed in the advanced stages due to its non-specific symptoms and complex morphological features. Deep learning (DL) has shown potential for improving and standardizing early GC detection. This systematic review aims to evaluate the current status of DL in pre-malignant, early-stage, and gastric neoplasia analysis.

METHODS

A comprehensive literature search was conducted in PubMed/MEDLINE for original studies implementing DL algorithms for gastric neoplasia detection using endoscopic images. We adhered to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. The focus was on studies providing quantitative diagnostic performance measures and those comparing AI performance with human endoscopists.

RESULTS

Our review encompasses 42 studies that utilize a variety of DL techniques. The findings demonstrate the utility of DL in GC classification, detection, tumor invasion depth assessment, cancer margin delineation, lesion segmentation, and detection of early-stage and pre-malignant lesions. Notably, DL models frequently matched or outperformed human endoscopists in diagnostic accuracy. However, heterogeneity in DL algorithms, imaging techniques, and study designs precluded a definitive conclusion about the best algorithmic approach.

CONCLUSIONS

The promise of artificial intelligence in improving and standardizing gastric neoplasia detection, diagnosis, and segmentation is significant. This review is limited by predominantly single-center studies and undisclosed datasets used in AI training, impacting generalizability and demographic representation. Further, retrospective algorithm training may not reflect actual clinical performance, and a lack of model details hinders replication efforts. More research is needed to substantiate these findings, including larger-scale multi-center studies, prospective clinical trials, and comprehensive technical reporting of DL algorithms and datasets, particularly regarding the heterogeneity in DL algorithms and study designs.

Real-time detection of laryngopharyngeal cancer using an artificial intelligence-assisted system with multimodal data

BACKGROUND

Laryngopharyngeal cancer (LPC) includes laryngeal and hypopharyngeal cancer, whose early diagnosis can significantly improve the prognosis and quality of life of patients. Pathological biopsy of suspicious cancerous tissue under the guidance of laryngoscopy is the gold standard for diagnosing LPC. However, this subjective examination largely depends on the skills and experience of laryngologists, which increases the possibility of missed diagnoses and repeated unnecessary biopsies. We aimed to develop and validate a deep convolutional neural network-based Laryngopharyngeal Artificial Intelligence Diagnostic System (LPAIDS) for real-time automatically identifying LPC in both laryngoscopy white-light imaging (WLI) and narrow-band imaging (NBI) images to improve the diagnostic accuracy of LPC by reducing diagnostic variation among on-expert laryngologists.

METHODS

All 31,543 laryngoscopic images from 2382 patients were categorised into training, verification, and test sets to develop, validate, and internal test LPAIDS. Another 25,063 images from five other hospitals were used as external tests. Overall, 551 videos were used to evaluate the real-time performance of the system, and 200 randomly selected videos were used to compare the diagnostic performance of the LPAIDS with that of laryngologists. Two deep-learning models using either WLI (model W) or NBI (model N) images were constructed to compare with LPAIDS.

RESULTS

LPAIDS had a higher diagnostic performance than models W and N, with accuracies of 0·956 and 0·949 in the internal image and video tests, respectively. The robustness and stability of LPAIDS were validated in external sets with the area under the receiver operating characteristic curve values of 0·965-0·987. In the laryngologist-machine competition, LPAIDS achieved an accuracy of 0·940, which was comparable to expert laryngologists and outperformed other laryngologists with varying qualifications.

CONCLUSIONS

LPAIDS provided high accuracy and stability in detecting LPC in real-time, which showed great potential for using LPAIDS to improve the diagnostic accuracy of LPC by reducing diagnostic variation among on-expert laryngologists.

Distinguishing bronchoscopically observed anatomical positions of airway under by convolutional neural network

Background

Artificial intelligence (AI) technology has been used for finding lesions via gastrointestinal endoscopy. However, there were few AI-associated studies that discuss bronchoscopy.

Objectives

To use convolutional neural network (CNN) to recognize the observed anatomical positions of the airway under bronchoscopy.

Design

We designed the study by comparing the imaging data of patients undergoing bronchoscopy from March 2022 to October 2022 by using EfficientNet (one of the CNNs) and U-Net.

Methods

Based on the inclusion and exclusion criteria, 1527 clear images of normal anatomical positions of the airways from 200 patients were used for training, and 475 clear images from 72 patients were utilized for validation. Further, 20 bronchoscopic videos of examination procedures in another 20 patients with normal airway structures were used to extract the bronchoscopic images of normal anatomical positions to evaluate the accuracy for the model. Finally, 21 respiratory doctors were enrolled for the test of recognizing corrected anatomical positions using the validating datasets.

Results

In all, 1527 bronchoscopic images of 200 patients with nine anatomical positions of the airway, including carina, right main bronchus, right upper lobe bronchus, right intermediate bronchus, right middle lobe bronchus, right lower lobe bronchus, left main bronchus, left upper lobe bronchus, and left lower lobe bronchus, were used for supervised machine learning and training, and 475 clear bronchoscopic images of 72 patients were used for validation. The mean accuracy of recognizing these 9 positions was 91% (carina: 98%, right main bronchus: 98%, right intermediate bronchus: 90%, right upper lobe bronchus: 91%, right middle lobe bronchus 92%, right lower lobe bronchus: 83%, left main bronchus: 89%, left upper bronchus: 91%, left lower bronchus: 76%). The area under the curves for these nine positions were >0.98. In addition, the accuracy of extracting the images via the video by the trained model was 94.7%. We also conducted a deep learning study to segment 10 segment bronchi in right lung, and 8 segment bronchi in Left lung. Because of the problem of radial depth, only segment bronchi distributions below right upper bronchus and right middle bronchus could be correctly recognized. The accuracy of recognizing was 84.33 ± 7.52% by doctors receiving interventional pulmonology education in our hospital over 6 months.

Conclusion

Our study proved that AI technology can be used to distinguish the normal anatomical positions of the airway, and the model we trained could extract the corrected images via the video to help standardize data collection and control quality.

Application of artificial intelligence for improving early detection and prediction of therapeutic outcomes for gastric cancer in the era of precision oncology

Gastric cancer is a leading contributor to cancer incidence and mortality globally. Recently, artificial intelligence approaches, particularly machine learning and deep learning, are rapidly reshaping the full spectrum of clinical management for gastric cancer. Machine learning is formed from computers running repeated iterative models for progressively improving performance on a particular task. Deep learning is a subtype of machine learning on the basis of multilayered neural networks inspired by the human brain. This review summarizes the application of artificial intelligence algorithms to multi-dimensional data including clinical and follow-up information, conventional images (endoscope, histopathology, and computed tomography (CT)), molecular biomarkers, etc. to improve the risk surveillance of gastric cancer with established risk factors; the accuracy of diagnosis, and survival prediction among established gastric cancer patients; and the prediction of treatment outcomes for assisting clinical decision making. Therefore, artificial intelligence makes a profound impact on almost all aspects of gastric cancer from improving diagnosis to precision medicine. Despite this, most established artificial intelligence-based models are in a research-based format and often have limited value in real-world clinical practice. With the increasing adoption of artificial intelligence in clinical use, we anticipate the arrival of artificial intelligence-powered gastric cancer care.

A deep-learning based system using multi-modal data for diagnosing gastric neoplasms in real-time (with video)

BACKGROUND

White light (WL) and weak-magnifying (WM) endoscopy are both important methods for diagnosing gastric neoplasms. This study constructed a deep-learning system named ENDOANGEL-MM (multi-modal) aimed at real-time diagnosing gastric neoplasms using WL and WM data.

METHODS

WL and WM images of a same lesion were combined into image-pairs. A total of 4201 images, 7436 image-pairs, and 162 videos were used for model construction and validation. Models 1-5 including two single-modal models (WL, WM) and three multi-modal models (data fusion on task-level, feature-level, and input-level) were constructed. The models were tested on three levels including images, videos, and prospective patients. The best model was selected for constructing ENDOANGEL-MM. We compared the performance between the models and endoscopists and conducted a diagnostic study to explore the ENDOANGEL-MM's assistance ability.

RESULTS

Model 4 (ENDOANGEL-MM) showed the best performance among five models. Model 2 performed better in single-modal models. The accuracy of ENDOANGEL-MM was higher than that of Model 2 in still images, real-time videos, and prospective patients. (86.54 vs 78.85%, P = 0.134; 90.00 vs 85.00%, P = 0.179; 93.55 vs 70.97%, P < 0.001). Model 2 and ENDOANGEL-MM outperformed endoscopists on WM data (85.00 vs 71.67%, P = 0.002) and multi-modal data (90.00 vs 76.17%, P = 0.002), significantly. With the assistance of ENDOANGEL-MM, the accuracy of non-experts improved significantly (85.75 vs 70.75%, P = 0.020), and performed no significant difference from experts (85.75 vs 89.00%, P = 0.159).

CONCLUSIONS

The multi-modal model constructed by feature-level fusion showed the best performance. ENDOANGEL-MM identified gastric neoplasms with good accuracy and has a potential role in real-clinic.

The Applications of Artificial Intelligence in Digestive System Neoplasms: A Review

Importance

Digestive system neoplasms (DSNs) are the leading cause of cancer-related mortality with a 5-year survival rate of less than 20%. Subjective evaluation of medical images including endoscopic images, whole slide images, computed tomography images, and magnetic resonance images plays a vital role in the clinical practice of DSNs, but with limited performance and increased workload of radiologists or pathologists. The application of artificial intelligence (AI) in medical image analysis holds promise to augment the visual interpretation of medical images, which could not only automate the complicated evaluation process but also convert medical images into quantitative imaging features that associated with tumor heterogeneity.

Highlights

We briefly introduce the methodology of AI for medical image analysis and then review its clinical applications including clinical auxiliary diagnosis, assessment of treatment response, and prognosis prediction on 4 typical DSNs including esophageal cancer, gastric cancer, colorectal cancer, and hepatocellular carcinoma.

Conclusion

AI technology has great potential in supporting the clinical diagnosis and treatment decision-making of DSNs. Several technical issues should be overcome before its application into clinical practice of DSNs.

Construction of an original anoikis-related prognostic model closely related to immune infiltration in gastric cancer

Background: Anoikis is considered as a particular type of programmed cell death, the weakness or resistance of which contributes greatly to the development and progression of most malignant solid tumors. However, the latent impact of anoikis-related genes (ARGs) on gastric cancer (GC) is still ambiguous. Based on these, this study established an anoikis-related prognostic model of GC to identify the prognosis of patients and provide more effective treatment in clinical practice. Methods: First, we extracted four public datasets containing the gene expression and clinicopathological information of GC, which were worked as the training and validating sets, separately. Then, an anoikis-related survival-predicted model of GC was developed via Lasso and COX regression analyses and verified by using the Kaplan-Meier (KM) curve and receiver operating characteristic (ROC) curve analyses. Next, we assigned GC patients to two groups characterized by the risk score calculated and analyzed somatic mutation, functional pathways, and immune infiltration between the different two groups. Finally, a unique nomogram was offered to clinicians to forecast the personal survival probability of GC patients. Results: Based on seven anoikis-related markers screened and identified, a carcinogenic model of risk score was produced. Patients placed in the high-score group suffered significantly worse overall survival (OS) in four cohorts. Additionally, the model revealed a high sensitivity and specificity to prognosticate the prognoses of GC patients [area under the ROC curve (AUC) at 5-year = 0.713; GSE84437, AUC at 5-year = 0.639; GSE15459, AUC at 5-year = 0.672; GSE62254, AUC at 5-year = 0.616]. Apart from the excellent predictive performance, the model was also identified as an independent prediction factor from other clinicopathological characteristics. Combining anoikis-related prognostic model with GC clinical features, we built a more comprehensive nomogram to foresee the likelihood of survival of GC patients in a given year, showing a well-accurate prediction performance. Conclusion: In summary, this study created a new anoikis-related signature for GC, which has potentially provided new critical insights into survival prediction and individualized therapy development.

Artificial intelligence applicated in gastric cancer: A bibliometric and visual analysis via CiteSpace

Objective

This study aimed to analyze and visualize the current research focus, research frontiers, evolutionary processes, and trends of artificial intelligence (AI) in the field of gastric cancer using a bibliometric analysis.

Methods

The Web of Science Core Collection database was selected as the data source for this study to retrieve and obtain articles and reviews related to AI in gastric cancer. All the information extracted from the articles was imported to CiteSpace to conduct the bibliometric and knowledge map analysis, allowing us to clearly visualize the research hotspots and trends in this field.

Results

A total of 183 articles published between 2017 and 2022 were included, contributed by 201 authors from 33 countries/regions. Among them, China (47.54%), Japan (21.86%), and the USA (13.11%) have made outstanding contributions in this field, accounting fsor 82.51% of the total publications. The primary research institutions were Wuhan University, Tokyo University, and Tada Tomohiro Inst Gastroenterol and Proctol. Tada (n = 12) and Hirasawa (n = 90) were ranked first in the top 10 authors and co-cited authors, respectively. Gastrointestinal Endoscopy (21 publications; IF 2022, 9.189; Q1) was the most published journal, while Gastric Cancer (133 citations; IF 2022, 8.171; Q1) was the most co-cited journal. Nevertheless, the cooperation between different countries and institutions should be further strengthened. The most common keywords were AI, gastric cancer, and convolutional neural network. The "deep-learning algorithm" started to burst in 2020 and continues till now, which indicated that this research topic has attracted continuous attention in recent years and would be the trend of research on AI application in GC.

Conclusions

Research related to AI in gastric cancer is increasing exponentially. Current research hotspots focus on the application of AI in gastric cancer, represented by convolutional neural networks and deep learning, in diagnosis and differential diagnosis and staging. Considering the great potential and clinical application prospects, the related area of AI applications in gastric cancer will remain a research hotspot in the future.

Research trends in endoscopic applications in early gastric cancer: A bibliometric analysis of studies published from 2012 to 2022

Background

Endoscopy is the optimal method of diagnosing and treating early gastric cancer (EGC), and it is therefore important to keep up with the rapid development of endoscopic applications in EGC. This study utilized bibliometric analysis to describe the development, current research progress, hotspots, and emerging trends in this field.

Methods

We retrieved publications about endoscopic applications in EGC from 2012 to 2022 from Web of Science™ (Clarivate™, Philadelphia, PA, USA) Core Collection (WoSCC). We mainly used CiteSpace (version 6.1.R3) and VOSviewer (version 1.6.18) to perform the collaboration network analysis, co-cited analysis, co-occurrence analysis, cluster analysis, and burst detection.

Results

A total of 1,333 publications were included. Overall, both the number of publications and the average number of citations per document per year increased annually. Among the 52 countries/regions that were included, Japan contributed the most in terms of publications, citations, and H-index, followed by the Republic of Korea and China. The National Cancer Center, based in both Japan and the Republic of Korea, ranked first among institutions in terms of number of publications, citation impact, and the average number of citations. Yong Chan Lee was the most productive author, and Ichiro Oda had the highest citation impact. In terms of cited authors, Gotoda Takuji had both the highest citation impact and the highest centrality. Among journals, Surgical Endoscopy and Other Interventional Techniques had the most publications, and Gastric Cancer had the highest citation impact and H-index. Among all publications and cited references, a paper by Smyth E C et al., followed by one by Gotoda T et al., had the highest citation impact. Using keywords co-occurrence and cluster analysis, 1,652 author keywords were categorized into 26 clusters, and we then divided the clusters into six groups. The largest and newest clusters were endoscopic submucosal dissection and artificial intelligence (AI), respectively.

Conclusions

Over the last decade, research into endoscopic applications in EGC has gradually increased. Japan and the Republic of Korea have contributed the most, but research in this field in China, from an initially low base, is developing at a striking speed. However, a lack of collaboration among countries, institutions, and authors, is common, and this should be addressed in future. The main focus of research in this field (i.e., the largest cluster) is endoscopic submucosal dissection, and the topic at the frontier (i.e., the newest cluster) is AI. Future research should focus on the application of AI in endoscopy, and its implications for the clinical diagnosis and treatment of EGC.

Identification of upper GI diseases during screening gastroscopy using a deep convolutional neural network algorithm

BACKGROUND AND AIMS

The clinical application of GI endoscopy for the diagnosis of multiple diseases using artificial intelligence (AI) has been limited by its high false-positive rates. There is an unmet need to develop a GI endoscopy AI-assisted diagnosis system (GEADS) to improve diagnostic accuracy and clinical utility.

METHODS

In this retrospective, multicenter study, a convolutional neural network was trained to assess upper GI diseases based on 26,228 endoscopic images from Dazhou Central Hospital that were randomly assigned (3:1:1) to a training dataset, validation dataset, and test dataset, respectively. To validate the model, 6 external independent datasets comprising 51,372 images of upper GI diseases were collected. In addition, 1 prospective dataset comprising 27,975 images was collected. The performance of GEADS was compared with endoscopists with 2 professional degrees of expertise: expert and novice. Eight endoscopists were in the expert group with >5 years of experience, whereas 3 endoscopists were in the novice group with 1 to 5 years of experience.

RESULTS

The GEADS model achieved an accuracy of .918 (95% confidence interval [CI], .914-.922), with an F1 score of .884 (95% CI, .879-.889), recall of .873 (95% CI, .868-.878), and precision of .890 (95% CI, .885-.895) in the internal validation dataset. In the external validation datasets and 1 prospective validation dataset, the diagnostic accuracy of the GEADS ranged from .841 (95% CI, .834-.848) to .949 (95% CI, .935-.963). With the help of the GEADS, the diagnosing accuracies of novice and expert endoscopists were significantly improved (P < .001).

CONCLUSIONS

The AI system can assist endoscopists in improving the accuracy of diagnosing upper GI diseases.

Adenosine signaling: Optimal target for gastric cancer immunotherapy

Gastric cancer (GC) is one of the most common malignancy and leading cause of cancer-related deaths worldwide. Due to asymptomatic or only nonspecific early symptoms, GC patients are usually in the advanced stage at first diagnosis and miss the best opportunity of treatment. Immunotherapies, especially immune checkpoint inhibitors (ICIs), have dramatically changed the landscape of available treatment options for advanced-stage cancer patients. However, with regards to existing ICIs, the clinical benefit of monotherapy for advanced gastric cancer (AGC) is quite limited. Therefore, it is urgent to explore an optimal target for the treatment of GC. In this review, we summarize the expression profiles and prognostic value of 20 common immune checkpoint-related genes in GC from Gene Expression Profiling Interactive Analysis (GEPIA) database, and then find that the adenosinergic pathway plays an indispensable role in the occurrence and development of GC. Moreover, we discuss the pathophysiological function of adenosinergic pathway in cancers. The accumulation of extracellular adenosine inhibits the normal function of immune effector cells and facilitate the effect of immunosuppressive cells to foster GC cells proliferation and migration. Finally, we provide insights into potential clinical application of adenosinergic-targeting therapies for GC patients.

Development and validation of a feature extraction-based logical anthropomorphic diagnostic system for early gastric cancer: A case-control study

BACKGROUND

Prompt diagnosis of early gastric cancer (EGC) is crucial for improving patient survival. However, most previous computer-aided-diagnosis (CAD) systems did not concretize or explain diagnostic theories. We aimed to develop a logical anthropomorphic artificial intelligence (AI) diagnostic system named ENDOANGEL-LA (logical anthropomorphic) for EGCs under magnifying image enhanced endoscopy (M-IEE).

METHODS

We retrospectively collected data for 692 patients and 1897 images from Renmin Hospital of Wuhan University, Wuhan, China between Nov 15, 2016 and May 7, 2019. The images were randomly assigned to the training set and test set by patient with a ratio of about 4:1. ENDOANGEL-LA was developed based on feature extraction combining quantitative analysis, deep learning (DL), and machine learning (ML). 11 diagnostic feature indexes were integrated into seven ML models, and an optimal model was selected. The performance of ENDOANGEL-LA was evaluated and compared with endoscopists and sole DL models. The satisfaction of endoscopists on ENDOANGEL-LA and sole DL model was also compared.

FINDINGS

Random forest showed the best performance, and demarcation line and microstructures density were the most important feature indexes. The accuracy of ENDOANGEL-LA in images (88.76%) was significantly higher than that of sole DL model (82.77%, p = 0.034) and the novices (71.63%, p<0.001), and comparable to that of the experts (88.95%). The accuracy of ENDOANGEL-LA in videos (87.00%) was significantly higher than that of the sole DL model (68.00%, p<0.001), and comparable to that of the endoscopists (89.00%). The accuracy (87.45%, p<0.001) of novices with the assistance of ENDOANGEL-LA was significantly improved. The satisfaction of endoscopists on ENDOANGEL-LA was significantly higher than that of sole DL model.

INTERPRETATION

We established a logical anthropomorphic system (ENDOANGEL-LA) that can diagnose EGC under M-IEE with diagnostic theory concretization, high accuracy, and good explainability. It has the potential to increase interactivity between endoscopists and CADs, and improve trust and acceptability of endoscopists for CADs.

FUNDING

This work was partly supported by a grant from the Hubei Province Major Science and Technology Innovation Project (2018-916-000-008) and the Fundamental Research Funds for the Central Universities (2042021kf0084).