Computer-aided diagnosis of colorectal polyps using linked color imaging colonoscopy to predict histology

Computer-aided diagnosis system for optical diagnosis of colorectal polyps under white light imaging

OBJECTIVES

This study presents a novel computer-aided diagnosis (CADx) designed for optically diagnosing colorectal polyps using white light imaging (WLI).We aimed to evaluate the effectiveness of the CADx and its auxiliary role among endoscopists with different levels of expertise.

METHODS

We collected 2,324 neoplastic and 3,735 nonneoplastic polyp WLI images for model training, and 838 colorectal polyp images from 740 patients for model validation. We compared the diagnostic accuracy of the CADx with that of 15 endoscopists under WLI and narrow band imaging (NBI). The auxiliary benefits of CADx for endoscopists of different experience levels and for identifying different types of colorectal polyps was also evaluated.

RESULTS

The CADx demonstrated an optical diagnostic accuracy of 84.49%, showing considerable superiority over all endoscopists, irrespective of whether WLI or NBI was used (P < 0.001). Assistance from the CADx significantly improved the diagnostic accuracy of the endoscopists from 68.84% to 77.49% (P = 0.001), with the most significant impact observed among novice endoscopists. Notably, novices using CADx-assisted WLI outperform junior and expert endoscopists without such assistance.

CONCLUSIONS

The CADx demonstrated a crucial role in substantially enhancing the precision of optical diagnosis for colorectal polyps under WLI and showed the greatest auxiliary benefits for novice endoscopists.

Endoscopic Artificial Intelligence for Image Analysis in Gastrointestinal Neoplasms

BACKGROUND

Artificial intelligence (AI) using deep learning systems has recently been utilized in various medical fields. In the field of gastroenterology, AI is primarily implemented in image recognition and utilized in the realm of gastrointestinal (GI) endoscopy. In GI endoscopy, computer-aided detection/diagnosis (CAD) systems assist endoscopists in GI neoplasm detection or differentiation of cancerous or noncancerous lesions. Several AI systems for colorectal polyps have already been applied in colonoscopy clinical practices. In esophagogastroduodenoscopy, a few CAD systems for upper GI neoplasms have been launched in Asian countries. The usefulness of these CAD systems in GI endoscopy has been gradually elucidated.

SUMMARY

In this review, we outline recent articles on several studies of endoscopic AI systems for GI neoplasms, focusing on esophageal squamous cell carcinoma (ESCC), esophageal adenocarcinoma (EAC), gastric cancer (GC), and colorectal polyps. In ESCC and EAC, computer-aided detection (CADe) systems were mainly developed, and a recent meta-analysis study showed sensitivities of 91.2% and 93.1% and specificities of 80% and 86.9%, respectively. In GC, a recent meta-analysis study on CADe systems demonstrated that their sensitivity and specificity were as high as 90%. A randomized controlled trial (RCT) also showed that the use of the CADe system reduced the miss rate. Regarding computer-aided diagnosis (CADx) systems for GC, although RCTs have not yet been conducted, most studies have demonstrated expert-level performance. In colorectal polyps, multiple RCTs have shown the usefulness of the CADe system for improving the polyp detection rate, and several CADx systems have been shown to have high accuracy in colorectal polyp differentiation.

KEY MESSAGES

Most analyses of endoscopic AI systems suggested that their performance was better than that of nonexpert endoscopists and equivalent to that of expert endoscopists. Thus, endoscopic AI systems may be useful for reducing the risk of overlooking lesions and improving the diagnostic ability of endoscopists.

Application of artificial intelligence in colorectal cancer screening by colonoscopy: Future prospects (Review)

Colorectal cancer (CRC) has become a severe global health concern, with the third‑high incidence and second‑high mortality rate of all cancers. The burden of CRC is expected to surge to 60% by 2030. Fortunately, effective early evidence‑based screening could significantly reduce the incidence and mortality of CRC. Colonoscopy is the core screening method for CRC with high popularity and accuracy. Yet, the accuracy of colonoscopy in CRC screening is related to the experience and state of operating physicians. It is challenging to maintain the high CRC diagnostic rate of colonoscopy. Artificial intelligence (AI)‑assisted colonoscopy will compensate for the above shortcomings and improve the accuracy, efficiency, and quality of colonoscopy screening. The unique advantages of AI, such as the continuous advancement of high‑performance computing capabilities and innovative deep‑learning architectures, which hugely impact the control of colorectal cancer morbidity and mortality expectancy, highlight its role in colonoscopy screening.

The application of artificial intelligence in improving colonoscopic adenoma detection rate: Where are we and where are we going

Colorectal cancer (CRC) is one of the common malignant tumors in the world. Colonoscopy is the crucial examination technique in CRC screening programs for the early detection of precursor lesions, and treatment of early colorectal cancer, which can reduce the morbidity and mortality of CRC significantly. However, pooled polyp miss rates during colonoscopic examination are as high as 22%. Artificial intelligence (AI) provides a promising way to improve the colonoscopic adenoma detection rate (ADR). It might assist endoscopists in avoiding missing polyps and offer an accurate optical diagnosis of suspected lesions. Herein, we described some of the milestone studies in using AI for colonoscopy, and the future application directions of AI in improving colonoscopic ADR.

A Deep-Learning Approach for Identifying and Classifying Digestive Diseases

The digestive tract, often known as the gastrointestinal (GI) tract or the gastrointestinal system, is affected by digestive ailments. The stomach, large and small intestines, liver, pancreas and gallbladder are all components of the digestive tract. A digestive disease is any illness that affects the digestive system. Serious to moderate conditions can exist. Heartburn, cancer, irritable bowel syndrome (IBS) and lactose intolerance are only a few of the frequent issues. The digestive system may be treated with many different surgical treatments. Laparoscopy, open surgery and endoscopy are a few examples of these techniques. This paper proposes transfer-learning models with different pre-trained models to identify and classify digestive diseases. The proposed systems showed an increase in metrics, such as the accuracy, precision and recall, when compared with other state-of-the-art methods, and EfficientNetB0 achieved the best performance results of 98.01% accuracy, 98% precision and 98% recall.

Mucosal imaging in colon polyps: New advances and what the future may hold

An expanding range of advanced mucosal imaging technologies have been developed with the goal of improving the detection and characterization of lesions in the gastrointestinal tract. Many technologies have targeted colorectal neoplasia given the potential for intervention prior to the development of invasive cancer in the setting of widespread surveillance programs. Improvement in adenoma detection reduces miss rates and prevents interval cancer development. Advanced imaging technologies aim to enhance detection without significantly increasing procedural time. Accurate polyp characterisation guides resection techniques for larger polyps, as well as providing the platform for the "resect and discard" and "do not resect" strategies for small and diminutive polyps. This review aims to collate and summarise the evidence regarding these technologies to guide colonoscopic practice in both interventional and non-interventional endoscopists.

The scientific progress and prospects of artificial intelligence in digestive endoscopy: A comprehensive bibliometric analysis

Artificial intelligence (AI) has been used for diagnosis and outcome prediction in clinical practice. Furthermore, AI in digestive endoscopy has attracted much attention and shown promising and stimulating results. This study aimed to determine the development trends and research hotspots of AI in digestive endoscopy by visualizing articles. Publications on AI in digestive endoscopy research were retrieved from the Web of Science Core Collection on April 25, 2022. VOSviewer and CiteSpace were used to assess and plot the research outputs. This analytical research was based on original articles and reviews. A total of 524 records of AI research in digestive endoscopy, published between 2005 and 2022, were retrieved. The number of articles has increased 27-fold from 2017 to 2021. Fifty-one countries and 994 institutions contributed to all publications. Asian countries had the highest number of publications. China, the USA, and Japan were consistently the leading driving forces and mainly contributed (26%, 21%, and 14.31%, respectively). With a solid academic reputation in this area, Japan has the highest number of citations per article. Tada Tomohiro published the most articles and received the most citations.. Gastrointestinal endoscopy published the largest number of publications, and 4 of the top 10 cited papers were published in this journal. "The Classification," "ulcerative colitis," "capsule endoscopy," "polyp detection," and "early gastric cancer" were the leading research hotspots. Our study provides systematic elaboration for researchers to better understand the development of AI in gastrointestinal endoscopy.

Hybrid and Deep Learning Approach for Early Diagnosis of Lower Gastrointestinal Diseases

Every year, nearly two million people die as a result of gastrointestinal (GI) disorders. Lower gastrointestinal tract tumors are one of the leading causes of death worldwide. Thus, early detection of the type of tumor is of great importance in the survival of patients. Additionally, removing benign tumors in their early stages has more risks than benefits. Video endoscopy technology is essential for imaging the GI tract and identifying disorders such as bleeding, ulcers, polyps, and malignant tumors. Videography generates 5000 frames, which require extensive analysis and take a long time to follow all frames. Thus, artificial intelligence techniques, which have a higher ability to diagnose and assist physicians in making accurate diagnostic decisions, solve these challenges. In this study, many multi-methodologies were developed, where the work was divided into four proposed systems; each system has more than one diagnostic method. The first proposed system utilizes artificial neural networks (ANN) and feed-forward neural networks (FFNN) algorithms based on extracting hybrid features by three algorithms: local binary pattern (LBP), gray level co-occurrence matrix (GLCM), and fuzzy color histogram (FCH) algorithms. The second proposed system uses pre-trained CNN models which are the GoogLeNet and AlexNet based on the extraction of deep feature maps and their classification with high accuracy. The third proposed method uses hybrid techniques consisting of two blocks: the first block of CNN models (GoogLeNet and AlexNet) to extract feature maps; the second block is the support vector machine (SVM) algorithm for classifying deep feature maps. The fourth proposed system uses ANN and FFNN based on the hybrid features between CNN models (GoogLeNet and AlexNet) and LBP, GLCM and FCH algorithms. All the proposed systems achieved superior results in diagnosing endoscopic images for the early detection of lower gastrointestinal diseases. All systems produced promising results; the FFNN classifier based on the hybrid features extracted by GoogLeNet, LBP, GLCM and FCH achieved an accuracy of 99.3%, precision of 99.2%, sensitivity of 99%, specificity of 100%, and AUC of 99.87%.

Current Status and Future Perspectives of Artificial Intelligence in Colonoscopy

The early endoscopic identification, resection, and treatment of precancerous adenoma and early-stage cancer has been shown to reduce not only the prevalence of colorectal cancer but also its mortality rate. Recent advances in endoscopic devices and imaging technology have dramatically improved our ability to detect colorectal lesions and predict their pathological diagnosis. In addition to this, rapid advances in artificial intelligence (AI) technology mean that AI-related research and development is now progressing in the diagnostic imaging field, particularly colonoscopy, and AIs (i.e., devices that mimic cognitive abilities, such as learning and problem-solving) already approved as medical devices are now being introduced into everyday clinical practice. Today, there is an increasing expectation that sophisticated AIs will be able to provide high-level diagnostic performance irrespective of the level of skill of the endoscopist. In this paper, we review colonoscopy-related AI research and the AIs that have already been approved and discuss the future prospects of this technology.

Development and validation of the linked color imaging classification for endoscopic prediction of colorectal polyp histology

OBJECTIVE

Linked color imaging (LCI) is a recently developed technique that emphasizes differences in mucosal color. In this study we aimed to develop a LCI classification based on the Narrow-band Imaging International Colorectal Endoscopic Classification for predicting colorectal polyp histology and evaluate the validity and performance of the endoscopists in differentiating hyperplastic polyps from adenomas using the LCI classification.

METHODS

A workshop involving six international experts from China and Japan with substantial experience with LCI developed the classification. Three experienced and seven less-experienced endoscopists used the LCI images to predict the histology of polyps independently, recording their degrees of confidence in these predictions before and after completing the training test for the LCI classification.

RESULTS

Of the 50 polyps included, 30 (60.0%) were adenomas. Overall diagnostic accuracy before training was 75.4% (95% confidence interval [CI] 71.4%-79.1%), which increased to 85.2% (95% CI 81.8%-88.2%) after training. After training, the experienced and less-experienced endoscopists achieved an overall accuracy of 87.3% and 84.3% for the prediction of polyp histology. Polyp prediction using the color criterion alone had the highest specificity and positive predictive value, whereas the vessel criterion achieved the highest accuracy and negative predictive value among all three individual LCI criteria. After training, both the experienced and less-experienced endoscopists had high degrees of interobserver agreement.

CONCLUSIONS

We developed and validated the first LCI classification for endoscopic differentiation of adenomas and hyperplastic polyps. The LCI classification significantly improved the diagnostic accuracy of colorectal polyps.

Artificial Intelligence in Endoscopy

Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.

Optical diagnosis of colorectal polyp images using a newly developed computer-aided diagnosis system (CADx) compared with intuitive optical diagnosis

BACKGROUND

Optical diagnosis of colorectal polyps remains challenging. Image-enhancement techniques such as narrow-band imaging and blue-light imaging (BLI) can improve optical diagnosis. We developed and prospectively validated a computer-aided diagnosis system (CADx) using high-definition white-light (HDWL) and BLI images, and compared the system with the optical diagnosis of expert and novice endoscopists.

METHODS

CADx characterized colorectal polyps by exploiting artificial neural networks. Six experts and 13 novices optically diagnosed 60 colorectal polyps based on intuition. After 4 weeks, the same set of images was permuted and optically diagnosed using the BLI Adenoma Serrated International Classification (BASIC).

RESULTS

CADx had a diagnostic accuracy of 88.3 % using HDWL images and 86.7 % using BLI images. The overall diagnostic accuracy combining HDWL and BLI (multimodal imaging) was 95.0 %, which was significantly higher than that of experts (81.7 %, P = 0.03) and novices (66.7 %, P < 0.001). Sensitivity was also higher for CADx (95.6 % vs. 61.1 % and 55.4 %), whereas specificity was higher for experts compared with CADx and novices (95.6 % vs. 93.3 % and 93.2 %). For endoscopists, diagnostic accuracy did not increase when using BASIC, either for experts (intuition 79.5 % vs. BASIC 81.7 %, P = 0.14) or for novices (intuition 66.7 % vs. BASIC 66.5 %, P = 0.95).

CONCLUSION

CADx had a significantly higher diagnostic accuracy than experts and novices for the optical diagnosis of colorectal polyps. Multimodal imaging, incorporating both HDWL and BLI, improved the diagnostic accuracy of CADx. BASIC did not increase the diagnostic accuracy of endoscopists compared with intuitive optical diagnosis.

Deep Learning Approaches to Colorectal Cancer Diagnosis: A Review

Unprecedented breakthroughs in the development of graphical processing systems have led to great potential for deep learning (DL) algorithms in analyzing visual anatomy from high-resolution medical images. Recently, in digital pathology, the use of DL technologies has drawn a substantial amount of attention for use in the effective diagnosis of various cancer types, especially colorectal cancer (CRC), which is regarded as one of the dominant causes of cancer-related deaths worldwide. This review provides an in-depth perspective on recently published research articles on DL-based CRC diagnosis and prognosis. Overall, we provide a retrospective synopsis of simple image-processing-based and machine learning (ML)-based computer-aided diagnosis (CAD) systems, followed by a comprehensive appraisal of use cases with different types of state-of-the-art DL algorithms for detecting malignancies. We first list multiple standardized and publicly available CRC datasets from two imaging types: colonoscopy and histopathology. Secondly, we categorize the studies based on the different types of CRC detected (tumor tissue, microsatellite instability, and polyps), and we assess the data preprocessing steps and the adopted DL architectures before presenting the optimum diagnostic results. CRC diagnosis with DL algorithms is still in the preclinical phase, and therefore, we point out some open issues and provide some insights into the practicability and development of robust diagnostic systems in future health care and oncology.

Algorithm combining virtual chromoendoscopy features for colorectal polyp classification

Background and study aims  Colonoscopy is considered the gold standard for decreasing colorectal cancer incidence and mortality. Optical diagnosis of colorectal polyps (CRPs) is an ongoing challenge in clinical colonoscopy and its accuracy among endoscopists varies widely. Computer-aided diagnosis (CAD) for CRP characterization may help to improve this accuracy. In this study, we investigated the diagnostic accuracy of a novel algorithm for polyp malignancy classification by exploiting the complementary information revealed by three specific modalities. Methods  We developed a CAD algorithm for CRP characterization based on high-definition, non-magnified white light (HDWL), Blue light imaging (BLI) and linked color imaging (LCI) still images from routine exams. All CRPs were collected prospectively and classified into benign or premalignant using histopathology as gold standard. Images and data were used to train the CAD algorithm using triplet network architecture. Our training dataset was validated using a threefold cross validation. Results  In total 609 colonoscopy images of 203 CRPs of 154 consecutive patients were collected. A total of 174 CRPs were found to be premalignant and 29 were benign. Combining the triplet network features with all three image enhancement modalities resulted in an accuracy of 90.6 %, 89.7 % sensitivity, 96.6 % specificity, a positive predictive value of 99.4 %, and a negative predictive value of 60.9 % for CRP malignancy classification. The classification time for our CAD algorithm was approximately 90 ms per image. Conclusions  Our novel approach and algorithm for CRP classification differentiates accurately between benign and premalignant polyps in non-magnified endoscopic images. This is the first algorithm combining three optical modalities (HDWL/BLI/LCI) exploiting the triplet network approach.

Utility of artificial intelligence in colonoscopy

Colorectal cancer is one of the major causes of death worldwide. Colonoscopy is the most important tool that can identify neoplastic lesion in early stages and resect it in a timely manner which helps in reducing mortality related to colorectal cancer. However, the quality of colonoscopy findings depends on the expertise of the endoscopist and thus the rate of missed adenoma or polyp cannot be controlled. It is desirable to standardize the quality of colonoscopy by reducing the number of missed adenoma/polyps. Introduction of artificial intelligence (AI) in the field of medicine has become popular among physicians nowadays. The application of AI in colonoscopy can help in reducing miss rate and increasing colorectal cancer detection rate as per recent studies. Moreover, AI assistance during colonoscopy has also been utilized in patients with inflammatory bowel disease to improve diagnostic accuracy, assessing disease severity and predicting clinical outcomes. We conducted a literature review on the available evidence on use of AI in colonoscopy. In this review article, we discuss about the principles, application, limitations, and future aspects of AI in colonoscopy.

Artificial intelligence for the detection of polyps or cancer with colon capsule endoscopy

Colorectal cancer is common and can be devastating, with long-term survival rates vastly improved by early diagnosis. Colon capsule endoscopy (CCE) is increasingly recognised as a reliable option for colonic surveillance, but widespread adoption has been slow for several reasons, including the time-consuming reading process of the CCE recording. Automated image recognition and artificial intelligence (AI) are appealing solutions in CCE. Through a review of the currently available and developmental technologies, we discuss how AI is poised to deliver at the forefront of CCE in the coming years. Current practice for CCE reporting often involves a two-step approach, with a ‘pre-reader’ and ‘validator’. This requires skilled and experienced readers with a significant time commitment. Therefore, CCE is well-positioned to reap the benefits of the ongoing digital innovation. This is likely to initially involve an automated AI check of finished CCE evaluations as a quality control measure. Once felt reliable, AI could be used in conjunction with a ‘pre-reader’, before adopting more of this role by sending provisional results and abnormal frames to the validator. With time, AI would be able to evaluate the findings more thoroughly and reduce the input required from human readers and ultimately autogenerate a highly accurate report and recommendation of therapy, if required, for any pathology identified. As with many medical fields reliant on image recognition, AI will be a welcome aid in CCE. Initially, this will be as an adjunct to ‘double-check’ that nothing has been missed, but with time will hopefully lead to a faster, more convenient diagnostic service for the screening population.

Kvasir-Capsule, a video capsule endoscopy dataset

Artificial intelligence (AI) is predicted to have profound effects on the future of video capsule endoscopy (VCE) technology. The potential lies in improving anomaly detection while reducing manual labour. Existing work demonstrates the promising benefits of AI-based computer-assisted diagnosis systems for VCE. They also show great potential for improvements to achieve even better results. Also, medical data is often sparse and unavailable to the research community, and qualified medical personnel rarely have time for the tedious labelling work. We present Kvasir-Capsule, a large VCE dataset collected from examinations at a Norwegian Hospital. Kvasir-Capsule consists of 117 videos which can be used to extract a total of 4,741,504 image frames. We have labelled and medically verified 47,238 frames with a bounding box around findings from 14 different classes. In addition to these labelled images, there are 4,694,266 unlabelled frames included in the dataset. The Kvasir-Capsule dataset can play a valuable role in developing better algorithms in order to reach true potential of VCE technology.

Artificial Intelligence in Colorectal Cancer Screening, Diagnosis and Treatment. A New Era

The development of artificial intelligence (AI) algorithms has permeated the medical field with great success. The widespread use of AI technology in diagnosing and treating several types of cancer, especially colorectal cancer (CRC), is now attracting substantial attention. CRC, which represents the third most commonly diagnosed malignancy in both men and women, is considered a leading cause of cancer-related deaths globally. Our review herein aims to provide in-depth knowledge and analysis of the AI applications in CRC screening, diagnosis, and treatment based on current literature. We also explore the role of recent advances in AI systems regarding medical diagnosis and therapy, with several promising results. CRC is a highly preventable disease, and AI-assisted techniques in routine screening represent a pivotal step in declining incidence rates of this malignancy. So far, computer-aided detection and characterization systems have been developed to increase the detection rate of adenomas. Furthermore, CRC treatment enters a new era with robotic surgery and novel computer-assisted drug delivery techniques. At the same time, healthcare is rapidly moving toward precision or personalized medicine. Machine learning models have the potential to contribute to individual-based cancer care and transform the future of medicine.

Recent Applications of Artificial Intelligence in detection of Gastrointestinal, Hepatic and Pancreatic Diseases

There is substantial progress in artificial intelligence (AI) algorithms and their medical sciences applications in the last two decades. AI-assisted programs have already been established for remotely health monitoring using sensors and smartphones. A variety of AI-based prediction models available for the gastrointestinal inflammatory, non-malignant diseases, and bowel bleeding using wireless capsule endoscopy, electronic medical records for hepatitis-associated fibrosis, pancreatic carcinoma using endoscopic ultrasounds. AI-based models may be of immense help for healthcare professionals in the identification, analysis, and decision support using endoscopic images to establish prognosis and risk assessment of patient's treatment using multiple factors. Although enough randomized clinical trials are warranted to establish the efficacy of AI-algorithms assisted and non-AI based treatments before approval of such techniques from medical regulatory authorities. In this article, available AI approaches and AI-based prediction models for detecting gastrointestinal, hepatic, and pancreatic diseases are reviewed. The limitation of AI techniques in such disease prognosis, risk assessment, and decision support are discussed.

Comparison of deep learning and conventional machine learning methods for classification of colon polyp types

Determination of polyp types requires tissue biopsy during colonoscopy and then histopathological examination of the microscopic images which tremendously time-consuming and costly. The first aim of this study was to design a computer-aided diagnosis system to classify polyp types using colonoscopy images (optical biopsy) without the need for tissue biopsy. For this purpose, two different approaches were designed based on conventional machine learning (ML) and deep learning. Firstly, classification was performed using random forest approach by means of the features obtained from the histogram of gradients descriptor. Secondly, simple convolutional neural networks (CNN) based architecture was built to train with the colonoscopy images containing colon polyps. The performances of these approaches on two (adenoma & serrated vs. hyperplastic) or three (adenoma vs. hyperplastic vs. serrated) category classifications were investigated. Furthermore, the effect of imaging modality on the classification was also examined using white-light and narrow band imaging systems. The performance of these approaches was compared with the results obtained by 3 novice and 4 expert doctors. Two-category classification results showed that conventional ML approach achieved significantly better than the simple CNN based approach did in both narrow band and white-light imaging modalities. The accuracy reached almost 95% for white-light imaging. This performance surpassed the correct classification rate of all 7 doctors. Additionally, the second task (three-category) results indicated that the simple CNN architecture outperformed both conventional ML based approaches and the doctors. This study shows the feasibility of using conventional machine learning or deep learning based approaches in automatic classification of colon types on colonoscopy images.

Scope of Artificial Intelligence in Screening and Diagnosis of Colorectal Cancer

Globally, colorectal cancer is the third most diagnosed malignancy. It causes significant mortality and morbidity, which can be reduced by early diagnosis with an effective screening test. Integrating artificial intelligence (AI) and computer-aided detection (CAD) with screening methods has shown promising colorectal cancer screening results. AI could provide a "second look" for endoscopists to decrease the rate of missed polyps during a colonoscopy. It can also improve detection and characterization of polyps by integration with colonoscopy and various advanced endoscopic modalities such as magnifying narrow-band imaging, endocytoscopy, confocal endomicroscopy, laser-induced fluorescence spectroscopy, and magnifying chromoendoscopy. This descriptive review discusses various AI and CAD applications in colorectal cancer screening, polyp detection, and characterization.

Potential applications of artificial intelligence in colorectal polyps and cancer: Recent advances and prospects

Since the advent of artificial intelligence (AI) technology, it has been constantly studied and has achieved rapid development. The AI assistant system is expected to improve the quality of automatic polyp detection and classification. It could also help prevent endoscopists from missing polyps and make an accurate optical diagnosis. These functions provided by AI could result in a higher adenoma detection rate and decrease the cost of polypectomy for hyperplastic polyps. In addition, AI has good performance in the staging, diagnosis, and segmentation of colorectal cancer. This article provides an overview of recent research focusing on the application of AI in colorectal polyps and cancer and highlights the advances achieved.

HyperKvasir, a comprehensive multi-class image and video dataset for gastrointestinal endoscopy

Artificial intelligence is currently a hot topic in medicine. However, medical data is often sparse and hard to obtain due to legal restrictions and lack of medical personnel for the cumbersome and tedious process to manually label training data. These constraints make it difficult to develop systems for automatic analysis, like detecting disease or other lesions. In this respect, this article presents HyperKvasir, the largest image and video dataset of the gastrointestinal tract available today. The data is collected during real gastro- and colonoscopy examinations at Bærum Hospital in Norway and partly labeled by experienced gastrointestinal endoscopists. The dataset contains 110,079 images and 374 videos, and represents anatomical landmarks as well as pathological and normal findings. The total number of images and video frames together is around 1 million. Initial experiments demonstrate the potential benefits of artificial intelligence-based computer-assisted diagnosis systems. The HyperKvasir dataset can play a valuable role in developing better algorithms and computer-assisted examination systems not only for gastro- and colonoscopy, but also for other fields in medicine.

Accuracy of artificial intelligence on histology prediction and detection of colorectal polyps: a systematic review and meta-analysis

BACKGROUND AND AIMS

We performed a meta-analysis of all published studies to determine the diagnostic accuracy of artificial intelligence (AI) on histology prediction and detection of colorectal polyps.

METHOD

We searched Embase, PubMed, Medline, Web of Science, and Cochrane library databases to identify studies using AI for colorectal polyp histology prediction and detection. The quality of included studies was measured by the Quality Assessment of Diagnostic Accuracy Studies tool. We used a bivariate meta-analysis following a random-effects model to summarize the data and plotted hierarchical summary receiver operating characteristic curves. The area under the hierarchical summary receiver operating characteristic curve (AUC) served as an indicator of the diagnostic accuracy and during head-to-head comparisons.

RESULTS

A total of 7680 images of colorectal polyps from 18 studies were included in the analysis of histology prediction. The accuracy of the AI (AUC) was .96 (95% confidence interval [CI], .95-.98), with a corresponding pooled sensitivity of 92.3% (95% CI, 88.8%-94.9%) and specificity of 89.8% (95% CI, 85.3%-93.0%). The AUC of AI using narrow-band imaging (NBI) was significantly higher than the AUC using non-NBI (.98 vs .84, P < .01). The performance of AI was superior to nonexpert endoscopists (.97 vs .90, P < .01). For characterization of diminutive polyps using a deep learning model with nonmagnifying NBI, the pooled negative predictive value was 95.1% (95% CI, 87.7%-98.1%). For polyp detection, the pooled AUC was .90 (95% CI, .67-1.00) with a sensitivity of 95.0% (95% CI, 91.0%-97.0%) and a specificity of 88.0% (95% CI, 58.0%-99.0%).

CONCLUSIONS

AI was accurate in histology prediction and detection of colorectal polyps, including diminutive polyps. The performance of AI was better under NBI and was superior to nonexpert endoscopists. Despite the difference in AI models and study designs, AI performances are rather consistent, which could serve as a reference for future AI studies.

RGB Pixel Brightness Characteristics of Linked Color Imaging in Early Gastric Cancer: A Pilot Study

Background and Aims

Linked color imaging (LCI) helps screen and diagnose for early gastric cancer by color contrast in different mucosa. RGB (red, green, and blue) pixel brightness quantifies colors, which is relatively objective. Limited studies have combined LCI images with RGB to help screen for early gastric cancer (EGC). We aimed to evaluate the RGB pixel brightness characteristics of EGC and noncancer areas in LCI images.

Methods

We retrospectively reviewed early gastric cancer (EGC) patients and LCI images. All pictures were evaluated by at least two endoscopic physicians. RGB pixel brightness analysis of LCI images was performed in MATLAB software to compare the cancer with noncancer areas. Receiver operating characteristic (ROC) curve was analyzed for sensitivity, specificity, cut-off, and area under the curve (AUC).

Results

Overall, 38 early gastric cancer patients were enrolled with 38 LCI images. Pixel brightness of red, green, and blue in cancer was remarkably higher than those in noncancer areas (190.24 ± 37.10 vs. 160.00 ± 40.35, p < 0.001; 117.96 ± 33.91 vs. 105.33 ± 30.01, p = 0.039; 114.36 ± 34.88 vs. 90.93 ± 30.14, p < 0.001, respectively). Helicobacter plyori (Hp) infection was not relevant to RGB distribution of EGC. Whether the score of Kyoto Classification of Gastritis (KCG) is ≥4 or <4, the pixel brightness of red, green, and blue was not disturbed in both cancer and noncancer (p > 0.05). Receiver operating characteristic (ROC) curve for differentiating cancer from noncancer was calculated. The maximum area under the curve (AUC) was 0.767 in B/G, with a sensitivity of 0.605, a specificity of 0.921, and a cut-off of 0.97.

Conclusions

RGB pixel brightness was useful and more objective in distinguishing early gastric cancer for LCI images.

Artificial Intelligence in Gastrointestinal Endoscopy

Artificial intelligence (AI) is rapidly integrating into modern technology and clinical practice. Although in its nascency, AI has become a hot topic of investigation for applications in clinical practice. Multiple fields of medicine have embraced the possibility of a future with AI assisting in diagnosis and pathology applications.

In the field of gastroenterology, AI has been studied as a tool to assist in risk stratification, diagnosis, and pathologic identification. Specifically, AI has become of great interest in endoscopy as a technology with substantial potential to revolutionize the practice of a modern gastroenterologist. From cancer screening to automated report generation, AI has touched upon all aspects of modern endoscopy.

Here, we review landmark AI developments in endoscopy. Starting with broad definitions to develop understanding, we will summarize the current state of AI research and its potential applications. With innovation developing rapidly, this article touches upon the remarkable advances in AI-assisted endoscopy since its initial evaluation at the turn of the millennium, and the potential impact these AI models may have on the modern clinical practice. As with any discussion of new technology, its limitations must also be understood to apply clinical AI tools successfully.

Application of Artificial Intelligence to Gastroenterology and Hepatology

Since 2010, substantial progress has been made in artificial intelligence (AI) and its application to medicine. AI is explored in gastroenterology for endoscopic analysis of lesions, in detection of cancer, and to facilitate the analysis of inflammatory lesions or gastrointestinal bleeding during wireless capsule endoscopy. AI is also tested to assess liver fibrosis and to differentiate patients with pancreatic cancer from those with pancreatitis. AI might also be used to establish prognoses of patients or predict their response to treatments, based on multiple factors. We review the ways in which AI may help physicians make a diagnosis or establish a prognosis and discuss its limitations, knowing that further randomized controlled studies will be required before the approval of AI techniques by the health authorities.