Automatic detection of colorectal neoplasia in wireless colon capsule endoscopic images using a deep convolutional neural network

Artificial Intelligence Advancements in Oncology: A Review of Current Trends and Future Directions

Cancer remains one of the leading causes of mortality worldwide, driving the need for innovative approaches in research and treatment. Artificial intelligence (AI) has emerged as a powerful tool in oncology, with the potential to revolutionize cancer diagnosis, treatment, and management. This paper reviews recent advancements in AI applications within cancer research, focusing on early detection through computer-aided diagnosis, personalized treatment strategies, and drug discovery. We survey AI-enhanced diagnostic applications and explore AI techniques such as deep learning, as well as the integration of AI with nanomedicine and immunotherapy for cancer care. Comparative analyses of AI-based models versus traditional diagnostic methods are presented, highlighting AI's superior potential. Additionally, we discuss the importance of integrating social determinants of health to optimize cancer care. Despite these advancements, challenges such as data quality, algorithmic biases, and clinical validation remain, limiting widespread adoption. The review concludes with a discussion of the future directions of AI in oncology, emphasizing its potential to reshape cancer care by enhancing diagnosis, personalizing treatments and targeted therapies, and ultimately improving patient outcomes.

Towards full integration of explainable artificial intelligence in colon capsule endoscopy's pathway

Despite recent surge of interest in deploying colon capsule endoscopy (CCE) for early diagnosis of colorectal diseases, there remains a large gap between the current state of CCE in clinical practice, and the state of its counterpart optical colonoscopy (OC). This is due to several factors, such as low quality bowel cleansing, logistical challenges around both delivery and collection of the capsule, and most importantly, the tedious manual assessment of images after retrieval. Our study, built on the "Danish CareForColon2015 trial (cfc2015)" is aimed at closing this gap, by focusing on the full integration of AI in CCE's pathway, where image processing steps linked to the detection, localization and characterisation of important findings are carried out autonomously using various AI algorithms. We developed a family of algorithms based on explainable deep neural networks (DNN) that detect polyps within a sequence of images, feed only those images containing polyps into two parallel independent networks to characterize, and estimate the size of important findings. Our recognition DNN to detect colorectal polyps was trained and validated ([Formula: see text]) and tested ([Formula: see text]) on an unaugmented database of 1751 images containing colorectal polyps and 1672 images of normal mucosa reached an impressive sensitivity of [Formula: see text], a specificity of [Formula: see text], and a negative predictive value (NPV) of [Formula: see text]. The characterisation DNN trained on an unaugmented database of 317 images featuring neoplastic polyps and 162 images of non-neoplastic polyps reached a sensitivity of [Formula: see text] and a specificity of [Formula: see text] in classifying polyps. The size estimation DNN trained on an unaugmented database of 280 images reached an accuracy of [Formula: see text] in correctly segmenting the polyps. By automatically incorporating important information including size, location and pathology of the findings into CCE's pathway, we moved a step closer towards the full integration of explainable AI (XAI) in CCE's routine clinical practice. This translates into a fewer number of unnecessary investigations and resection of diminutive, insignificant colorectal polyps.

A Comprehensive Review of Artificial Intelligence and Colon Capsule Endoscopy: Opportunities and Challenges

Colon capsule endoscopy (CCE) enables a comprehensive, non-invasive, and painless evaluation of the colon, although it still has limited indications. The lengthy reading times hinder its wider implementation, a drawback that could potentially be overcome through the integration of artificial intelligence (AI) models. Studies employing AI, particularly convolutional neural networks (CNNs), demonstrate great promise in using CCE as a viable option for detecting certain diseases and alterations in the colon, compared to other methods like colonoscopy. Additionally, employing AI models in CCE could pave the way for a minimally invasive panenteric or even panendoscopic solution. This review aims to provide a comprehensive summary of the current state-of-the-art of AI in CCE while also addressing the challenges, both technical and ethical, associated with broadening indications for AI-powered CCE. Additionally, it also gives a brief reflection of the potential environmental advantages of using this method compared to alternative ones.

Artificial intelligence in capsule endoscopy: development status and future expectations

In this review, we aim to illustrate the state-of-the-art artificial intelligence (AI) applications in the field of capsule endoscopy. AI has made significant strides in gastrointestinal imaging, particularly in capsule endoscopy - a non-invasive procedure for capturing gastrointestinal tract images. However, manual analysis of capsule endoscopy videos is labour-intensive and error-prone, prompting the development of automated computational algorithms and AI models. While currently serving as a supplementary observer, AI has the capacity to evolve into an autonomous, integrated reading system, potentially significantly reducing capsule reading time while surpassing human accuracy. We searched Embase, Pubmed, Medline, and Cochrane databases from inception to 06 Jul 2023 for studies investigating the use of AI for capsule endoscopy and screened retrieved records for eligibility. Quantitative and qualitative data were extracted and synthesised to identify current themes. In the search, 824 articles were collected, and 291 duplicates and 31 abstracts were deleted. After a double-screening process and full-text review, 106 publications were included in the review. Themes pertaining to AI for capsule endoscopy included active gastrointestinal bleeding, erosions and ulcers, vascular lesions and angiodysplasias, polyps and tumours, inflammatory bowel disease, coeliac disease, hookworms, bowel prep assessment, and multiple lesion detection. This review provides current insights into the impact of AI on capsule endoscopy as of 2023. AI holds the potential for faster and precise readings and the prospect of autonomous image analysis. However, careful consideration of diagnostic requirements and potential challenges is crucial. The untapped potential within vision transformer technology hints at further evolution and even greater patient benefit.

Capsule endoscopy and panendoscopy: A journey to the future of gastrointestinal endoscopy

In 2000, the small bowel capsule revolutionized the management of patients with small bowel disorders. Currently, the technological development achieved by the new models of double-headed endoscopic capsules, as miniaturized devices to evaluate the small bowel and colon [pan-intestinal capsule endoscopy (PCE)], makes this non-invasive procedure a disruptive concept for the management of patients with digestive disorders. This technology is expected to identify which patients will require conventional invasive endoscopic procedures (colonoscopy or balloon-assisted enteroscopy), based on the lesions detected by the capsule, i.e., those with an indication for biopsies or endoscopic treatment. The use of PCE in patients with inflammatory bowel diseases, namely Crohn's disease, as well as in patients with iron deficiency anaemia and/or overt gastrointestinal (GI) bleeding, after a non-diagnostic upper endoscopy (esophagogastroduodenoscopy), enables an effective, safe and comfortable way to identify patients with relevant lesions, who should undergo subsequent invasive endoscopic procedures. The recent development of magnetically controlled capsule endoscopy to evaluate the upper GI tract, is a further step towards the possibility of an entirely non-invasive assessment of all the segments of the digestive tract, from mouth-to-anus, meeting the expectations of the early developers of capsule endoscopy.

Direct comparison of multiple computer-aided polyp detection systems

BACKGROUND AND STUDY AIMS

 Artificial intelligence (AI)-based systems for computer-aided detection (CADe) of polyps receive regular updates and occasionally offer customizable detection thresholds, both of which impact their performance, but little is known about these effects. This study aimed to compare the performance of different CADe systems on the same benchmark dataset.

METHODS

 101 colonoscopy videos were used as benchmark. Each video frame with a visible polyp was manually annotated with bounding boxes, resulting in 129 705 polyp images. The videos were then analyzed by three different CADe systems, representing five conditions: two versions of GI Genius, Endo-AID with detection Types A and B, and EndoMind, a freely available system. Evaluation included an analysis of sensitivity and false-positive rate, among other metrics.

RESULTS

 Endo-AID detection Type A, the earlier version of GI Genius, and EndoMind detected all 93 polyps. Both the later version of GI Genius and Endo-AID Type B missed 1 polyp. The mean per-frame sensitivities were 50.63 % and 67.85 %, respectively, for the earlier and later versions of GI Genius, 65.60 % and 52.95 %, respectively, for Endo-AID Types A and B, and 60.22 % for EndoMind.

CONCLUSIONS

 This study compares the performance of different CADe systems, different updates, and different configuration modes. This might help clinicians to select the most appropriate system for their specific needs.

The Future of Minimally Invasive Capsule Panendoscopy: Robotic Precision, Wireless Imaging and AI-Driven Insights

In the early 2000s, the introduction of single-camera wireless capsule endoscopy (CE) redefined small bowel study. Progress continued with the development of double-camera devices, first for the colon and rectum, and then, for panenteric assessment. Advancements continued with magnetic capsule endoscopy (MCE), particularly when assisted by a robotic arm, designed to enhance gastric evaluation. Indeed, as CE provides full visualization of the entire gastrointestinal (GI) tract, a minimally invasive capsule panendoscopy (CPE) could be a feasible alternative, despite its time-consuming nature and learning curve, assuming appropriate bowel cleansing has been carried out. Recent progress in artificial intelligence (AI), particularly in the development of convolutional neural networks (CNN) for CE auxiliary reading (detecting and diagnosing), may provide the missing link in fulfilling the goal of establishing the use of panendoscopy, although prospective studies are still needed to validate these models in actual clinical scenarios. Recent CE advancements will be discussed, focusing on the current evidence on CNN developments, and their real-life implementation potential and associated ethical challenges.

Smart Endoscopy Is Greener Endoscopy: Leveraging Artificial Intelligence and Blockchain Technologies to Drive Sustainability in Digestive Health Care

The surge in the implementation of artificial intelligence (AI) in recent years has permeated many aspects of our life, and health care is no exception. Whereas this technology can offer clear benefits, some of the problems associated with its use have also been recognised and brought into question, for example, its environmental impact. In a similar fashion, health care also has a significant environmental impact, and it requires a considerable source of greenhouse gases. Whereas efforts are being made to reduce the footprint of AI tools, here, we were specifically interested in how employing AI tools in gastroenterology departments, and in particular in conjunction with capsule endoscopy, can reduce the carbon footprint associated with digestive health care while offering improvements, particularly in terms of diagnostic accuracy. We address the different ways that leveraging AI applications can reduce the carbon footprint associated with all types of capsule endoscopy examinations. Moreover, we contemplate how the incorporation of other technologies, such as blockchain technology, into digestive health care can help ensure the sustainability of this clinical speciality and by extension, health care in general.

Third Eye? The Assistance of Artificial Intelligence (AI) in the Endoscopy of Gastrointestinal Neoplasms

Gastrointestinal cancers are characterized by high incidence and mortality. However, there are well-established methods of screening. The endoscopy exam provides the macroscopical image and enables harvesting the tissue samples for further histopathological diagnosis. The efficiency of endoscopies relies not only on proper patient preparation, but also on the skills of the personnel conducting the exam. In recent years, a number of reports concerning the application of artificial intelligence (AI) in medicine have arisen. Numerous studies aimed to assess the utility of deep learning/ neural network systems supporting endoscopies. In this review, we summarized the most recent reports and randomized clinical trials regarding the application of AI in screening and surveillance of gastrointestinal cancers among patients suffering from esophageal, gastric, and colorectal cancer, along with the advantages, limitations, and controversies of those novel solutions.

Artificial Intelligence-Aided Optical Imaging for Cancer Theranostics

The use of artificial intelligence (AI) to assist biomedical imaging have demonstrated its high accuracy and high efficiency in medical decision-making for individualized cancer medicine. In particular, optical imaging methods are able to visualize both the structural and functional information of tumors tissues with high contrast, low cost, and noninvasive property. However, no systematic work has been performed to inspect the recent advances on AI-aided optical imaging for cancer theranostics. In this review, we demonstrated how AI can guide optical imaging methods to improve the accuracy on tumor detection, automated analysis and prediction of its histopathological section, its monitoring during treatment, and its prognosis by using computer vision, deep learning and natural language processing. By contrast, the optical imaging techniques involved mainly consisted of various tomography and microscopy imaging methods such as optical endoscopy imaging, optical coherence tomography, photoacoustic imaging, diffuse optical tomography, optical microscopy imaging, Raman imaging, and fluorescent imaging. Meanwhile, existing problems, possible challenges and future prospects for AI-aided optical imaging protocol for cancer theranostics were also discussed. It is expected that the present work can open a new avenue for precision oncology by using AI and optical imaging tools.

Automated Detection of Endometrial Polyps from Hysteroscopic Videos Using Deep Learning

Endometrial polyps are common gynecological lesions. The standard treatment for this condition is hysteroscopic polypectomy. However, this procedure may be accompanied by misdetection of endometrial polyps. To improve the diagnostic accuracy and reduce the risk of misdetection, a deep learning model based on YOLOX is proposed to detect endometrial polyps in real time. Group normalization is employed to improve its performance with large hysteroscopic images. In addition, we propose a video adjacent-frame association algorithm to address the problem of unstable polyp detection. Our proposed model was trained on a dataset of 11,839 images from 323 cases provided by a hospital and was tested on two datasets of 431 cases from two hospitals. The results show that the lesion-based sensitivity of the model reached 100% and 92.0% for the two test sets, compared with 95.83% and 77.33%, respectively, for the original YOLOX model. This demonstrates that the improved model may be used effectively as a diagnostic tool during clinical hysteroscopic procedures to reduce the risk of missing endometrial polyps.

Colon Capsule Endoscopy - Shining the Light through the Colon

PURPOSE OF REVIEW

Colon capsule endoscopy (CCE) is a non-invasive, wireless capsule endoscope. In this article, we review its current applications, compare its performance with optical colonoscopy (OC) and alternative imaging modalities like CT colonography (CTC), and highlight developments that may increase potential future use.

RECENT FINDINGS

By comparison to OC both CCE and CTC have a good sensitivity and specificity in detecting colonic polyps. CCE is more sensitive in detecting sub centimetre polyps. CCE is capable of detecting colonic inflammation and anorectal pathologies, commonly missed by CTC. However, rates of complete CCE examinations are limited by inadequate bowel preparation or incomplete colonic transit, whereas CTC can be performed with less bowel purgatives. Patients tolerate CCE better than OC, however patient preference between CCE and CTC vary. CCE and CTC are both reasonable alternatives to OC. Strategies to improve completion rates and adequacy of bowel preparation will improve cost and clinical effectiveness of CCE.

Clinicians’ Guide to Artificial Intelligence in Colon Capsule Endoscopy—Technology Made Simple

Artificial intelligence (AI) applications have become widely popular across the healthcare ecosystem. Colon capsule endoscopy (CCE) was adopted in the NHS England pilot project following the recent COVID pandemic’s impact. It demonstrated its capability to relieve the national backlog in endoscopy. As a result, AI-assisted colon capsule video analysis has become gastroenterology’s most active research area. However, with rapid AI advances, mastering these complex machine learning concepts remains challenging for healthcare professionals. This forms a barrier for clinicians to take on this new technology and embrace the new era of big data. This paper aims to bridge the knowledge gap between the current CCE system and the future, fully integrated AI system. The primary focus is on simplifying the technical terms and concepts in machine learning. This will hopefully address the general “fear of the unknown in AI” by helping healthcare professionals understand the basic principle of machine learning in capsule endoscopy and apply this knowledge in their future interactions and adaptation to AI technology. It also summarises the evidence of AI in CCE and its impact on diagnostic pathways. Finally, it discusses the unintended consequences of using AI, ethical challenges, potential flaws, and bias within clinical settings.

Artificial intelligence and capsule endoscopy: automatic detection of enteric protruding lesions using a convolutional neural network

BACKGROUND AND AIMS

capsule endoscopy (CE) revolutionized the study of the small intestine. Nevertheless, reviewing CE images is time-consuming and prone to error. Artificial intelligence algorithms, particularly convolutional neural networks (CNN), are expected to overcome these drawbacks. Protruding lesions of the small intestine exhibit enormous morphological diversity in CE images. This study aimed to develop a CNN-based algorithm for the automatic detection small bowel protruding lesions.

METHODS

a CNN was developed using a pool of CE images containing protruding lesions or normal mucosa from 1,229 patients. A training dataset was used for the development of the model. The performance of the network was evaluated using an independent dataset, by calculating its sensitivity, specificity, accuracy, positive and negative predictive values.

RESULTS

a total of 18,625 CE images (2,830 showing protruding lesions and 15,795 normal mucosa) were included. Training and validation datasets were built with an 80 %/20 % distribution, respectively. After optimizing the architecture of the network, our model automatically detected small-bowel protruding lesions with an accuracy of 92.5 %. CNN had a sensitivity and specificity of 96.8 % and 96.5 %, respectively. The CNN analyzed the validation dataset in 53 seconds, at a rate of approximately 70 frames per second.

CONCLUSIONS

we developed an accurate CNN for the automatic detection of enteric protruding lesions with a wide range of morphologies. The development of these tools may enhance the diagnostic efficiency of CE.

Automatic polyp image segmentation and cancer prediction based on deep learning

The similar shape and texture of colonic polyps and normal mucosal tissues lead to low accuracy of medical image segmentation algorithms. To solve these problems, we proposed a polyp image segmentation algorithm based on deep learning technology, which combines a HarDNet module, attention module, and multi-scale coding module with the U-Net network as the basic framework, including two stages of coding and decoding. In the encoder stage, HarDNet68 is used as the main backbone network to extract features using four null space convolutional pooling pyramids while improving the inference speed and computational efficiency; the attention mechanism module is added to the encoding and decoding network; then the model can learn the global and local feature information of the polyp image, thus having the ability to process information in both spatial and channel dimensions, to solve the problem of information loss in the encoding stage of the network and improving the performance of the segmentation network. Through comparative analysis with other algorithms, we can find that the network of this paper has a certain degree of improvement in segmentation accuracy and operation speed, which can effectively assist physicians in removing abnormal colorectal tissues and thus reduce the probability of polyp cancer, and improve the survival rate and quality of life of patients. Also, it has good generalization ability, which can provide technical support and prevention for colon cancer.

Artificial Intelligence in Colon Capsule Endoscopy—A Systematic Review

Background and aims: The applicability of colon capsule endoscopy in daily practice is limited by the accompanying labor-intensive reviewing time and the risk of inter-observer variability. Automated reviewing of colon capsule endoscopy images using artificial intelligence could be timesaving while providing an objective and reproducible outcome. This systematic review aims to provide an overview of the available literature on artificial intelligence for reviewing colonic mucosa by colon capsule endoscopy and to assess the necessary action points for its use in clinical practice. Methods: A systematic literature search of literature published up to January 2022 was conducted using Embase, Web of Science, OVID MEDLINE and Cochrane CENTRAL. Studies reporting on the use of artificial intelligence to review second-generation colon capsule endoscopy colonic images were included. Results: 1017 studies were evaluated for eligibility, of which nine were included. Two studies reported on computed bowel cleansing assessment, five studies reported on computed polyp or colorectal neoplasia detection and two studies reported on other implications. Overall, the sensitivity of the proposed artificial intelligence models were 86.5–95.5% for bowel cleansing and 47.4–98.1% for the detection of polyps and colorectal neoplasia. Two studies performed per-lesion analysis, in addition to per-frame analysis, which improved the sensitivity of polyp or colorectal neoplasia detection to 81.3–98.1%. By applying a convolutional neural network, the highest sensitivity of 98.1% for polyp detection was found. Conclusion: The use of artificial intelligence for reviewing second-generation colon capsule endoscopy images is promising. The highest sensitivity of 98.1% for polyp detection was achieved by deep learning with a convolutional neural network. Convolutional neural network algorithms should be optimized and tested with more data, possibly requiring the set-up of a large international colon capsule endoscopy database. Finally, the accuracy of the optimized convolutional neural network models need to be confirmed in a prospective setting.

Performance of a Deep Learning System for Automatic Diagnosis of Protruding Lesions in Colon Capsule Endoscopy

Background: Colon capsule endoscopy (CCE) is an alternative for patients unwilling or with contraindications for conventional colonoscopy. Colorectal cancer screening may benefit greatly from widespread acceptance of a non-invasive tool such as CCE. However, reviewing CCE exams is a time-consuming process, with risk of overlooking important lesions. We aimed to develop an artificial intelligence (AI) algorithm using a convolutional neural network (CNN) architecture for automatic detection of colonic protruding lesions in CCE images. An anonymized database of CCE images collected from a total of 124 patients was used. This database included images of patients with colonic protruding lesions or patients with normal colonic mucosa or with other pathologic findings. A total of 5715 images were extracted for CNN development. Two image datasets were created and used for training and validation of the CNN. The AUROC for detection of protruding lesions was 0.99. The sensitivity, specificity, PPV and NPV were 90.0%, 99.1%, 98.6% and 93.2%, respectively. The overall accuracy of the network was 95.3%. The developed deep learning algorithm accurately detected protruding lesions in CCE images. The introduction of AI technology to CCE may increase its diagnostic accuracy and acceptance for screening of colorectal neoplasia.

Computer-Aided Diagnosis of Gastrointestinal Protruded Lesions Using Wireless Capsule Endoscopy: A Systematic Review and Diagnostic Test Accuracy Meta-Analysis

BACKGROUND

Wireless capsule endoscopy allows the identification of small intestinal protruded lesions, such as polyps, tumors, or venous structures. However, reading wireless capsule endoscopy images or movies is time-consuming, and minute lesions are easy to miss. Computer-aided diagnosis (CAD) has been applied to improve the efficacy of the reading process of wireless capsule endoscopy images or movies. However, there are no studies that systematically determine the performance of CAD models in diagnosing gastrointestinal protruded lesions.

OBJECTIVE

The aim of this study was to evaluate the diagnostic performance of CAD models for gastrointestinal protruded lesions using wireless capsule endoscopic images.

METHODS

Core databases were searched for studies based on CAD models for the diagnosis of gastrointestinal protruded lesions using wireless capsule endoscopy, and data on diagnostic performance were presented. A systematic review and diagnostic test accuracy meta-analysis were performed.

RESULTS

Twelve studies were included. The pooled area under the curve, sensitivity, specificity, and diagnostic odds ratio of CAD models for the diagnosis of protruded lesions were 0.95 (95% confidence interval, 0.93-0.97), 0.89 (0.84-0.92), 0.91 (0.86-0.94), and 74 (43-126), respectively. Subgroup analyses showed robust results. Meta-regression found no source of heterogeneity. Publication bias was not detected.

CONCLUSION

CAD models showed high performance for the optical diagnosis of gastrointestinal protruded lesions based on wireless capsule endoscopy.

Deep learning and colon capsule endoscopy: automatic detection of blood and colonic mucosal lesions using a convolutional neural network

Background and study aims  Colon capsule endoscopy (CCE) is a minimally invasive alternative to conventional colonoscopy. However, CCE produces long videos, making its analysis time-consuming and prone to errors. Convolutional neural networks (CNN) are artificial intelligence (AI) algorithms with high performance levels in image analysis. We aimed to develop a deep learning model for automatic identification and differentiation of significant colonic mucosal lesions and blood in CCE images. Patients and methods  A retrospective multicenter study including 124 CCE examinations was conducted for development of a CNN model, using a database of CCE images including anonymized images of patients with normal colon mucosa, several mucosal lesions (erosions, ulcers, vascular lesions and protruding lesions) and luminal blood. For CNN development, 9005 images (3,075 normal mucosa, 3,115 blood and 2,815 mucosal lesions) were ultimately extracted. Two image datasets were created and used for CNN training and validation. Results  The mean (standard deviation) sensitivity and specificity of the CNN were 96.3 % (3.9 %) and 98.2 % (1.8 %) Mucosal lesions were detected with a sensitivity of 92.0 % and a specificity of 98.5 %. Blood was detected with a sensitivity and specificity of 97.2 % and 99.9 %, respectively. The algorithm was 99.2 % sensitive and 99.6 % specific in distinguishing blood from mucosal lesions. The CNN processed 65 frames per second. Conclusions  This is the first CNN-based algorithm to accurately detect and distinguish colonic mucosal lesions and luminal blood in CCE images. AI may improve diagnostic and time efficiency of CCE exams, thus facilitating CCE adoption to routine clinical practice.

Convolution neural network for the diagnosis of wireless capsule endoscopy: a systematic review and meta-analysis

BACKGROUND

Wireless capsule endoscopy (WCE) is considered to be a powerful instrument for the diagnosis of intestine diseases. Convolution neural network (CNN) is a type of artificial intelligence that has the potential to assist the detection of WCE images. We aimed to perform a systematic review of the current research progress to the CNN application in WCE.

METHODS

A search in PubMed, SinoMed, and Web of Science was conducted to collect all original publications about CNN implementation in WCE. Assessment of the risk of bias was performed by Quality Assessment of Diagnostic Accuracy Studies-2 risk list. Pooled sensitivity and specificity were calculated by an exact binominal rendition of the bivariate mixed-effects regression model. I2 was used for the evaluation of heterogeneity.

RESULTS

16 articles with 23 independent studies were included. CNN application to WCE was divided into detection on erosion/ulcer, gastrointestinal bleeding (GI bleeding), and polyps/cancer. The pooled sensitivity of CNN for erosion/ulcer is 0.96 [95% CI 0.91, 0.98], for GI bleeding is 0.97 (95% CI 0.93-0.99), and for polyps/cancer is 0.97 (95% CI 0.82-0.99). The corresponding specificity of CNN for erosion/ulcer is 0.97 (95% CI 0.93-0.99), for GI bleeding is 1.00 (95% CI 0.99-1.00), and for polyps/cancer is 0.98 (95% CI 0.92-0.99).

CONCLUSION

Based on our meta-analysis, CNN-dependent diagnosis of erosion/ulcer, GI bleeding, and polyps/cancer approached a high-level performance because of its high sensitivity and specificity. Therefore, future perspective, CNN has the potential to become an important assistant for the diagnosis of WCE.

Image-Enhanced Capsule Endoscopy Improves the Identification of Small Intestinal Lesions

Image-enhanced endoscopy is useful for diagnosing and identifying lesions in the gastrointestinal tract. Recently, image-enhanced endoscopy has become a breakthrough technology that has attracted significant attention. This image enhancing technology is available for capsule endoscopy, which is an effective tool for small intestinal lesions and has been applied in flexible spectral color enhancement technology and in contrast capsule like narrow-band imaging. In this field, most researchers focus on improving the visibility and detection of small intestinal lesions. This review summarizes previous studies on image-enhanced capsule endoscopy and aims to evaluate the efficacy of this technology.

Deep learning driven colorectal lesion detection in gastrointestinal endoscopic and pathological imaging

Colorectal cancer has the second highest incidence of malignant tumors and is the fourth leading cause of cancer deaths in China. Early diagnosis and treatment of colorectal cancer will lead to an improvement in the 5-year survival rate, which will reduce medical costs. The current diagnostic methods for early colorectal cancer include excreta, blood, endoscopy, and computer-aided endoscopy. In this paper, research on image analysis and prediction of colorectal cancer lesions based on deep learning is reviewed with the goal of providing a reference for the early diagnosis of colorectal cancer lesions by combining computer technology, 3D modeling, 5G remote technology, endoscopic robot technology, and surgical navigation technology. The findings will supplement the research and provide insights to improve the cure rate and reduce the mortality of colorectal cancer.

A systematic review on application of deep learning in digestive system image processing

With the advent of the big data era, the application of artificial intelligence represented by deep learning in medicine has become a hot topic. In gastroenterology, deep learning has accomplished remarkable accomplishments in endoscopy, imageology, and pathology. Artificial intelligence has been applied to benign gastrointestinal tract lesions, early cancer, tumors, inflammatory bowel diseases, livers, pancreas, and other diseases. Computer-aided diagnosis significantly improve diagnostic accuracy and reduce physicians' workload and provide a shred of evidence for clinical diagnosis and treatment. In the near future, artificial intelligence will have high application value in the field of medicine. This paper mainly summarizes the latest research on artificial intelligence in diagnosing and treating digestive system diseases and discussing artificial intelligence's future in digestive system diseases. We sincerely hope that our work can become a stepping stone for gastroenterologists and computer experts in artificial intelligence research and facilitate the application and development of computer-aided image processing technology in gastroenterology.

Follow-up outcomes in patients with negative initial colon capsule endoscopy findings

BACKGROUND

Colon capsule endoscopy (CCE), which became clinically applicable in 2006, is a simple and noninvasive procedure to evaluate colonic diseases; the accuracy of second-generation CCE, introduced in 2009, has dramatically improved. Currently, CCE is used as an alternative method for colorectal cancer screening, as well as for evaluating the mucosal lesions of inflammatory bowel disease, in cases where performing colonoscopy (CS) is difficult. However, the outcomes of CCE are uncertain.

AIM

To investigate the outcomes of Japanese patients with negative findings (no polyps or colorectal cancer) on initial CCE.

METHODS

This retrospective, single-center study was conducted at the Endoscopic Center at Aishinkai Nakae Hospital. This study included patients who underwent continuous CCE between November 2013 and August 2019, that exhibited no evidence of polyps or colorectal cancer at the initial CCE, and could be followed up using either the fecal immunochemical test (FIT), CS, or CCE. The observational period, follow-up method, presence or absence of polyps and colorectal cancer, pathological diagnosis, and number of colorectal cancer deaths were evaluated.

RESULTS

Thirty-one patients (mean age, 60.4 ± 15.6 years; range, 28–84 years; 14 men and 17 women) were enrolled in this study. The reasons for performing the first CCE were screening in 12, a positive FIT in six, lower abdominal pain in nine, diarrhea in two, and anemia in two patients. The mean total water volume at the time of examination was 3460 ± 602 mL (2250–4800 mL), and a total CS was performed in 28 patients (90%). The degree of cleanliness was excellent in 15 patients and good in 16, and no poor cases were observed. No adverse events, such as retention or capsule aspiration, were observed in any of the patients. The mean follow-up period was 3.1 ± 1.5 years (range, 0.3–5.5 years). Follow-up included FIT in nine, CS in 20, and CCE in four patients (including duplicate patients). The FIT was positive in two patients, while CS revealed five polyp lesions (three in the ascending colon, one in the transverse colon, and one in the descending colon), with sizes ranging between 2 mm and 8 mm. Histopathological findings revealed a hyperplastic polyp in one patient, and adenoma with low grade dysplasia in four patients; colorectal cancers were not recognized. In the follow-up example by CCE, polyps and colorectal cancer could not be recognized. During the follow-up period, there were no deaths due to colorectal cancer in any of the patients.

CONCLUSION

We determined the outcomes in patients with negative initial CCE findings.

Challenges and opportunities in the application of artificial intelligence in gastroenterology and hepatology

Artificial intelligence (AI) is an umbrella term used to describe a cluster of interrelated fields. Machine learning (ML) refers to a model that learns from past data to predict future data. Medicine and particularly gastroenterology and hepatology, are data-rich fields with extensive data repositories, and therefore fruitful ground for AI/ML-based software applications. In this study, we comprehensively review the current applications of AI/ML-based models in these fields and the opportunities that arise from their application. Specifically, we refer to the applications of AI/ML-based models in prevention, diagnosis, management, and prognosis of gastrointestinal bleeding, inflammatory bowel diseases, gastrointestinal premalignant and malignant lesions, other nonmalignant gastrointestinal lesions and diseases, hepatitis B and C infection, chronic liver diseases, hepatocellular carcinoma, cholangiocarcinoma, and primary sclerosing cholangitis. At the same time, we identify the major challenges that restrain the widespread use of these models in healthcare in an effort to explore ways to overcome them. Notably, we elaborate on the concerns regarding intrinsic biases, data protection, cybersecurity, intellectual property, liability, ethical challenges, and transparency. Even at a slower pace than anticipated, AI is infiltrating the healthcare industry. AI in healthcare will become a reality, and every physician will have to engage with it by necessity.

Colon Capsule Endoscopy as a Diagnostic Adjunct in Patients with Symptoms from the Lower Gastrointestinal Tract

Prompted by the core idea of wireless capsule endoscopy as a painless gastrointestinal examination, and the easy adoption of small bowel capsule endoscopy, the armamentarium of the capsule-based imaging platforms has grown to include colon capsule devices as well [...].

Artificial intelligence and colon capsule endoscopy: development of an automated diagnostic system of protruding lesions in colon capsule endoscopy

BACKGROUND

Colon capsule endoscopy (CCE) is a minimally invasive alternative for patients unwilling to undergo conventional colonoscopy, or for whom the latter exam is contraindicated. This is particularly important in the setting of colorectal cancer screening. Nevertheless, these exams produce large numbers of images, and reading them is a monotonous and time-consuming task, with the risk of overlooking important lesions. The development of automated tools based on artificial intelligence (AI) technology may improve some of the drawbacks of this diagnostic instrument.

METHODS

A database of CCE images was used for development of a Convolutional Neural Network (CNN) model. This database included anonymized images of patients with protruding lesions in the colon or patients with normal colonic mucosa or with other pathologic findings. A total of 3,387,259 frames from 24 CCE exams were retrospectively reviewed. For CNN development, 3640 images (860 protruding lesions and 2780 with normal mucosa or other findings) were ultimately extracted. Training and validation datasets were constructed for the development and testing of the CNN.

RESULTS

The CNN detected protruding lesions with a sensitivity, specificity, positive and negative predictive values of 90.7, 92.6, 79.2 and 96.9%, respectively. The area under the receiver operating characteristic curve for detection of protruding lesions was 0.97.

CONCLUSIONS

The deep learning algorithm we developed is capable of accurately detecting protruding lesions. The application of AI technology to CCE may increase its diagnostic accuracy and acceptance for screening of colorectal neoplasia.

Application of artificial intelligence in gastrointestinal disease: a narrative review

Objective

We collected evidence on the application of artificial intelligence (AI) in gastroenterology field. The review was carried out from two aspects of endoscopic types and gastrointestinal diseases, and briefly summarized the challenges and future directions in this field.

Background

Due to the advancement of computational power and a surge of available data, a solid foundation has been laid for the growth of AI. Specifically, varied machine learning (ML) techniques have been emerging in endoscopic image analysis. To improve the accuracy and efficiency of clinicians, AI has been widely applied to gastrointestinal endoscopy.

Methods

PubMed electronic database was searched using the keywords containing “AI”, “ML”, “deep learning (DL)”, “convolution neural network”, “endoscopy (such as white light endoscopy (WLE), narrow band imaging (NBI) endoscopy, magnifying endoscopy with narrow band imaging (ME-NBI), chromoendoscopy, endocytoscopy (EC), and capsule endoscopy (CE))”. Search results were assessed for relevance and then used for detailed discussion.

Conclusions

This review described the basic knowledge of AI, ML, and DL, and summarizes the application of AI in various endoscopes and gastrointestinal diseases. Finally, the challenges and directions of AI in clinical application were discussed. At present, the application of AI has solved some clinical problems, but more still needs to be done.

Artificial intelligence and colon capsule endoscopy: automatic detection of blood in colon capsule endoscopy using a convolutional neural network

Colon capsule endoscopy (CCE) is a minimally invasive alternative to conventional colonoscopy. Most studies on CCE focus on colorectal neoplasia detection. The development of automated tools may address some of the limitations of this diagnostic tool and widen its indications for different clinical settings. We developed an artificial intelligence model based on a convolutional neural network (CNN) for the automatic detection of blood content in CCE images. Training and validation datasets were constructed for the development and testing of the CNN. The CNN detected blood with a sensitivity, specificity, and positive and negative predictive values of 99.8 %, 93.2 %, 93.8 %, and 99.8 %, respectively. The area under the receiver operating characteristic curve for blood detection was 1.00. We developed a deep learning algorithm capable of accurately detecting blood or hematic residues within the lumen of the colon based on colon CCE images.