Deep learning-based lesion detection and severity grading of small-bowel Crohn's disease ulcers on double-balloon endoscopy images

Deep ensemble framework with Bayesian optimization for multi-lesion recognition in capsule endoscopy images

In order to address the challenges posed by the large number of images acquired during wireless capsule endoscopy examinations and fatigue-induced leakage and misdiagnosis, a deep ensemble framework is proposed, which consists of CA-EfficientNet-B0, ECA-RegNetY, and Swin transformer as base learners. The ensemble model aims to automatically recognize four lesions in capsule endoscopy images, including angioectasia, bleeding, erosions, and polyps. All the three base learners employed transfer learning, with the inclusion of attention modules in EfficientNet-B0 and RegNetY for optimization. The recognition outcomes from the three base learners were subsequently combined and weighted to facilitate automatic recognition of multi-lesion images and normal images of the gastrointestinal (GI) tract. The weights were determined through the Bayesian optimization. The experiment collected a total of 8358 images of 281 cases at Shanghai East Hospital from 2017 to 2021. These images were organized and labeled by clinicians to verify the performance of the algorithm. The experimental results showed that the model achieved an accuracy of 84.31%, m-Precision of 88.60%, m-Recall of 79.36%, and m-F1-score of 81.08%. Compared to mainstream deep learning models, the ensemble model effectively improves the classification performance of GI diseases and can assist clinicians in making initial diagnoses of GI diseases.

The 2024 top 10 list of endoscopy topics in medical publishing: an annual review by the American Society for Gastrointestinal Endoscopy Editorial Board

Using a systematic literature search of original articles published during 2024 in Gastrointestinal Endoscopy (GIE) and other high-impact medical and gastroenterology journals, the GIE Editorial Board of the American Society for Gastrointestinal Endoscopy compiled a list of the top 10 most significant topic areas in general and advanced GI endoscopy during the year. Each GIE Editorial Board member was directed to consider 3 criteria in generating candidate topics: significance, novelty, and impact on clinical practice. Subject matter consensus was facilitated by the Chair through electronic voting of the entire GIE Editorial Board. The top 10 identified topics collectively represent advances in the following endoscopic areas: glucagon-like peptide-1 receptor agonists and endoscopy, advances in AI in endoscopy, ergonomics in endoscopy, peroral endoscopic myotomy, bariatric and metabolic endoscopy, endoscopic resection in the colon, gastric intestinal metaplasia and endoscopy, inflammatory bowel disease and endoscopy, GI bleeding risk stratification and endoscopic therapies, and therapeutic EUS. Board members were assigned a topic area and summarized relevant and important articles, thereby generating this overview of the "top 10" endoscopic advances of 2024.

Artificial Intelligence in Inflammatory Bowel Disease

Artificial intelligence (AI) is being increasingly studied and implemented in gastroenterology. In inflammatory bowel disease (IBD), numerous AI models are being developed to assist with IBD diagnosis, standardization of endoscopic and radiologic disease activity, and predicting outcomes. Further prospective, multicenter studies representing diverse populations and novel applications are needed prior to routine implementation in clinical practice and expected improved outcomes for clinicians and patients.

Artificial Intelligence in Inflammatory Bowel Disease Endoscopy

Inflammatory bowel diseases (IBDs), comprising Crohn's disease (CD) and ulcerative colitis (UC), are chronic immune-mediated inflammatory diseases of the gastrointestinal (GI) tract with still-elusive etiopathogeneses and an increasing prevalence worldwide. Despite the growing availability of more advanced therapies in the last two decades, there are still a number of unmet needs. For example, the achievement of mucosal healing has been widely demonstrated as a prognostic marker for better outcomes and a reduced risk of dysplasia and cancer; however, the accuracy of endoscopy is crucial for both this aim and the precise and reproducible evaluation of endoscopic activity and the detection of dysplasia. Artificial intelligence (AI) has drastically altered the field of GI studies and is being extensively applied to medical imaging. The utilization of deep learning and pattern recognition can help the operator optimize image classification and lesion segmentation, detect early mucosal abnormalities, and eventually reveal and uncover novel biomarkers with biologic and prognostic value. The role of AI in endoscopy-and potentially also in histology and imaging in the context of IBD-is still at its initial stages but shows promising characteristics that could lead to a better understanding of the complexity and heterogeneity of IBDs, with potential improvements in patient care and outcomes. The initial experience with AI in IBDs has shown its potential value in the differentiation of UC and CD when there is no ileal involvement, reducing the significant amount of time it takes to review videos of capsule endoscopy and improving the inter- and intra-observer variability in endoscopy reports and scoring. In addition, these initial experiences revealed the ability to predict the histologic score index and the presence of dysplasia. Thus, the purpose of this review was to summarize recent advances regarding the application of AI in IBD endoscopy as there is, indeed, increasing evidence suggesting that the integration of AI-based clinical tools will play a crucial role in paving the road to precision medicine in IBDs.

Artificial Intelligence for Classification of Endoscopic Severity of Inflammatory Bowel Disease: A Systematic Review and Critical Appraisal

BACKGROUND

Endoscopic scoring indices for ulcerative colitis and Crohn's disease are subject to inter-endoscopist variability. There is increasing interest in the development of deep learning models to standardize endoscopic assessment of intestinal diseases. Here, we summarize and critically appraise the literature on artificial intelligence-assisted endoscopic characterization of inflammatory bowel disease severity.

METHODS

A systematic search of Ovid MEDLINE, EMBASE, Cochrane Central Register of Controlled Trials, and IEEE Xplore was performed to identify reports of AI systems used for endoscopic severity classification of IBD. Selected studies were critically appraised for methodological and reporting quality using APPRAISE-AI.

RESULTS

Thirty-one studies published between 2019 and 2024 were included. Of 31 studies, 28 studies examined endoscopic classification of ulcerative colitis and 3 examined Crohn's disease. Researchers sought to accomplish a wide range of classification tasks, including binary and multilevel classification, based on still images or full-length colonoscopy videos. Overall scores for study quality ranged from 41 (moderate quality) to 64 (high quality) out of 100, with 28 out of 31 studies within the moderate quality range. The highest-scoring domains were clinical relevance and reporting quality, while the lowest-scoring domains were robustness of results and reproducibility.

CONCLUSIONS

Multiple AI models have demonstrated the potential for clinical translation for ulcerative colitis. Research concerning the endoscopic severity assessment of Crohn's disease is limited and should be further explored. More rigorous external validation of AI models and increased transparency of data and codes are needed to improve the quality of AI studies.

AI-luminating Artificial Intelligence in Inflammatory Bowel Diseases: A Narrative Review on the Role of AI in Endoscopy, Histology, and Imaging for IBD

Endoscopy, histology, and cross-sectional imaging serve as fundamental pillars in the detection, monitoring, and prognostication of inflammatory bowel disease (IBD). However, interpretation of these studies often relies on subjective human judgment, which can lead to delays, intra- and interobserver variability, and potential diagnostic discrepancies. With the rising incidence of IBD globally coupled with the exponential digitization of these data, there is a growing demand for innovative approaches to streamline diagnosis and elevate clinical decision-making. In this context, artificial intelligence (AI) technologies emerge as a timely solution to address the evolving challenges in IBD. Early studies using deep learning and radiomics approaches for endoscopy, histology, and imaging in IBD have demonstrated promising results for using AI to detect, diagnose, characterize, phenotype, and prognosticate IBD. Nonetheless, the available literature has inherent limitations and knowledge gaps that need to be addressed before AI can transition into a mainstream clinical tool for IBD. To better understand the potential value of integrating AI in IBD, we review the available literature to summarize our current understanding and identify gaps in knowledge to inform future investigations.