Computer-aided texture analysis combined with experts' knowledge: Improving endoscopic celiac disease diagnosis

Will artificial intelligence reach any limit in gastroenterology?

Endoscopy is the cornerstone in the management of digestive diseases. Over the last few decades, technology has played an important role in the development of this field, helping endoscopists in better detecting and characterizing luminal lesions. However, despite ongoing advancements in endoscopic technology, the incidence of missed pre-neoplastic and neoplastic lesions remains high due to the operator-dependent nature of endoscopy and the challenging learning curve associated with new technologies. Artificial intelligence (AI), an operator-independent field, could be an invaluable solution. AI can serve as a “second observer”, enhancing the performance of endoscopists in detecting and characterizing luminal lesions. By utilizing deep learning (DL), an innovation within machine learning, AI automatically extracts input features from targeted endoscopic images. DL encompasses both computer-aided detection and computer-aided diagnosis, assisting endoscopists in reducing missed detection rates and predicting the histology of luminal digestive lesions. AI applications in clinical gastrointestinal diseases are continuously expanding and evolving the entire digestive tract. In all published studies, real-time AI assists endoscopists in improving the performance of non-expert gastroenterologists, bringing it to a level comparable to that of experts. The development of DL may be affected by selection biases. Studies have utilized different AI-assisted models, which are heterogeneous. In the future, algorithms need validation through large, randomized trials. Theoretically, AI has no limit to assist endoscopists in increasing the accuracy and the quality of endoscopic exams. However, practically, we still have a long way to go before standardizing our AI models to be accepted and applied by all gastroenterologists.

Artificial Intelligence in Pediatric Endoscopy: Current Status and Future Applications

The application of artificial intelligence (AI) has great promise for improving pediatric endoscopy. The majority of preclinical studies have been undertaken in adults, with the greatest progress being made in the context of colorectal cancer screening and surveillance. This development has only been possible with advances in deep learning, like the convolutional neural network model, which has enabled real-time detection of pathology. Comparatively, the majority of deep learning systems developed in inflammatory bowel disease have focused on predicting disease severity and were developed using still images rather than videos. The application of AI to pediatric endoscopy is in its infancy, thus providing an opportunity to develop clinically meaningful and fair systems that do not perpetuate societal biases. In this review, we provide an overview of AI, summarize the advances of AI in endoscopy, and describe its potential application to pediatric endoscopic practice and education.

Detection of duodenal villous atrophy on endoscopic images using a deep learning algorithm

BACKGROUND AND AIMS

Celiac disease with its endoscopic manifestation of villous atrophy (VA) is underdiagnosed worldwide. The application of artificial intelligence (AI) for the macroscopic detection of VA at routine EGD may improve diagnostic performance.

METHODS

A dataset of 858 endoscopic images of 182 patients with VA and 846 images from 323 patients with normal duodenal mucosa was collected and used to train a ResNet18 deep learning model to detect VA. An external dataset was used to test the algorithm, in addition to 6 fellows and 4 board-certified gastroenterologists. Fellows could consult the AI algorithm's result during the test. From their consultation distribution, a stratification of test images into "easy" and "difficult" was performed and used for classified performance measurement.

RESULTS

External validation of the AI algorithm yielded values of 90%, 76%, and 84% for sensitivity, specificity, and accuracy, respectively. Fellows scored corresponding values of 63%, 72%, and 67% and experts scored 72%, 69%, and 71%, respectively. AI consultation significantly improved all trainee performance statistics. Although fellows and experts showed significantly lower performance for difficult images, the performance of the AI algorithm was stable.

CONCLUSIONS

In this study, an AI algorithm outperformed endoscopy fellows and experts in the detection of VA on endoscopic still images. AI decision support significantly improved the performance of nonexpert endoscopists. The stable performance on difficult images suggests a further positive add-on effect in challenging cases.

Artificial intelligence in gastroenterology: A narrative review

Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.

Is Computer-Assisted Tissue Image Analysis the Future in Minimally Invasive Surgery? A Review on the Current Status of Its Applications

Purpose: Computer-assisted tissue image analysis (CATIA) enables an optical biopsy of human tissue during minimally invasive surgery and endoscopy. Thus far, it has been implemented in gastrointestinal, endometrial, and dermatologic examinations that use computational analysis and image texture feature systems. We review and evaluate the impact of in vivo optical biopsies performed by tissue image analysis on the surgeon’s diagnostic ability and sampling precision and investigate how operation complications could be minimized. Methods: We performed a literature search in PubMed, IEEE, Xplore, Elsevier, and Google Scholar, which yielded 28 relevant articles. Our literature review summarizes the available data on CATIA of human tissues and explores the possibilities of computer-assisted early disease diagnoses, including cancer. Results: Hysteroscopic image texture analysis of the endometrium successfully distinguished benign from malignant conditions up to 91% of the time. In dermatologic studies, the accuracy of distinguishing nevi melanoma from benign disease fluctuated from 73% to 81%. Skin biopsies of basal cell carcinoma and melanoma exhibited an accuracy of 92.4%, sensitivity of 99.1%, and specificity of 93.3% and distinguished nonmelanoma and normal lesions from benign precancerous lesions with 91.9% and 82.8% accuracy, respectively. Gastrointestinal and endometrial examinations are still at the experimental phase. Conclusions: CATIA is a promising application for distinguishing normal from abnormal tissues during endoscopic procedures and minimally invasive surgeries. However, the efficacy of computer-assisted diagnostics in distinguishing benign from malignant states is still not well documented. Prospective and randomized studies are needed before CATIA is implemented in clinical practice.

Artificial intelligence in small intestinal diseases: Application and prospects

The small intestine is located in the middle of the gastrointestinal tract, so small intestinal diseases are more difficult to diagnose than other gastrointestinal diseases. However, with the extensive application of artificial intelligence in the field of small intestinal diseases, with its efficient learning capacities and computational power, artificial intelligence plays an important role in the auxiliary diagnosis and prognosis prediction based on the capsule endoscopy and other examination methods, which improves the accuracy of diagnosis and prediction and reduces the workload of doctors. In this review, a comprehensive retrieval was performed on articles published up to October 2020 from PubMed and other databases. Thereby the application status of artificial intelligence in small intestinal diseases was systematically introduced, and the challenges and prospects in this field were also analyzed.

Recent Applications of Artificial Intelligence in detection of Gastrointestinal, Hepatic and Pancreatic Diseases

There is substantial progress in artificial intelligence (AI) algorithms and their medical sciences applications in the last two decades. AI-assisted programs have already been established for remotely health monitoring using sensors and smartphones. A variety of AI-based prediction models available for the gastrointestinal inflammatory, non-malignant diseases, and bowel bleeding using wireless capsule endoscopy, electronic medical records for hepatitis-associated fibrosis, pancreatic carcinoma using endoscopic ultrasounds. AI-based models may be of immense help for healthcare professionals in the identification, analysis, and decision support using endoscopic images to establish prognosis and risk assessment of patient's treatment using multiple factors. Although enough randomized clinical trials are warranted to establish the efficacy of AI-algorithms assisted and non-AI based treatments before approval of such techniques from medical regulatory authorities. In this article, available AI approaches and AI-based prediction models for detecting gastrointestinal, hepatic, and pancreatic diseases are reviewed. The limitation of AI techniques in such disease prognosis, risk assessment, and decision support are discussed.

Artificial Intelligence in Small Bowel Endoscopy: Current Perspectives and Future Directions

Artificial intelligence (AI) is a computer system that is able to perform tasks which normally require human intelligence. The role of AI in the field of gastroenterology has been gradually evolving since its inception in the 1950s. Discovery of wireless capsule endoscopy (WCE) and balloon enteroscopy (BE) has revolutionized small gut imaging. While WCE is a relatively patient-friendly and noninvasive mode to examine the nonobstructed small gut, it is limited by a lengthy examination time and the need for expertise in reading images acquired by the capsule. Similarly, BE, despite having the advantage of therapeutic intervention, is costly, invasive, and requires general sedation. Incorporation of concepts like machine learning and deep learning has been used to handle large amounts of data and images in gastroenterology. Interestingly, in small gut imaging, the application of AI has been limited to WCE only. This review was planned to examine and summarize available published data on various AI-based approaches applied to small bowel disease.

We conducted an extensive literature search using Google search engine, Google Scholar, and PubMed database for published literature in English on the application of different AI techniques in small bowel endoscopy, and have summarized the outcome and benefits of these applications of AI in small bowel endoscopy. Incorporation of AI in WCE has resulted in significant advancements in the detection of various lesions starting from dysplastic mucosa, inflammatory and nonmalignant lesions to the detection of bleeding with increasing accuracy and has shortened the lengthy review time in image analysis. As most of the studies to evaluate AI are retrospective, the presence of inherent selection bias cannot be excluded. Besides, the interpretability (black-box nature) of AI models remains a cause for concern. Finally, issues related to medical ethics and AI need to be judiciously addressed to enable its seamless use in future.

Artificial intelligence in celiac disease

Celiac disease (CD) has been on the rise in the world and a large part of it remains undiagnosed. Novel methods are required to address the gaps in prompt detection and management. Artificial intelligence (AI) has seen an exponential surge in the last decade worldwide. With the advent of big data and powerful computational ability, we now have self-driving cars and smart devices in our daily lives. Huge databases in the form of electronic medical records and images have rendered healthcare a lucrative sector where AI can prove revolutionary. It is being used extensively to overcome the barriers in clinical workflows. From the perspective of a disease, it can be deployed in multiple steps i.e. screening tools, diagnosis, developing novel therapeutic agents, proposing management plans, and defining prognostic indicators, etc. We review the areas where it may augment physicians in the delivery of better healthcare by summarizing current literature on the use of AI in healthcare using CD as a model. We further outline major barriers to its large-scale implementations and prospects from the healthcare point of view.

Current Evidence on Computer-Aided Diagnosis of Celiac Disease: Systematic Review

Celiac disease (CD) is a chronic autoimmune disease that occurs in genetically predisposed individuals in whom the ingestion of gluten leads to damage of the small bowel. It is estimated to affect 1 in 100 people worldwide, but is severely underdiagnosed. Currently available guidelines require CD-specific serology and atrophic histology in duodenal biopsy samples for the diagnosis of adult CD. In pediatric CD, but in recent years in adults also, nonbioptic diagnostic strategies have become increasingly popular. In this setting, in order to increase the diagnostic rate of this pathology, endoscopy itself has been thought of as a case finding strategy by use of digital image processing techniques. Research focused on computer aided decision support used as database video capsule, endoscopy and even biopsy duodenal images. Early automated methods for diagnosis of celiac disease used feature extraction methods like spatial domain features, transform domain features, scale-invariant features and spatio-temporal features. Recent artificial intelligence (AI) techniques using deep learning (DL) methods such as convolutional neural network (CNN), support vector machines (SVM) or Bayesian inference have emerged as a breakthrough computer technology which can be used for computer aided diagnosis of celiac disease. In the current review we summarize methods used in clinical studies for classification of CD from feature extraction methods to AI techniques.

Application of Artificial Intelligence to Gastroenterology and Hepatology

Since 2010, substantial progress has been made in artificial intelligence (AI) and its application to medicine. AI is explored in gastroenterology for endoscopic analysis of lesions, in detection of cancer, and to facilitate the analysis of inflammatory lesions or gastrointestinal bleeding during wireless capsule endoscopy. AI is also tested to assess liver fibrosis and to differentiate patients with pancreatic cancer from those with pancreatitis. AI might also be used to establish prognoses of patients or predict their response to treatments, based on multiple factors. We review the ways in which AI may help physicians make a diagnosis or establish a prognosis and discuss its limitations, knowing that further randomized controlled studies will be required before the approval of AI techniques by the health authorities.

Automated classification of celiac disease during upper endoscopy: Status quo and quo vadis

A large amount of digital image material is routinely captured during esophagogastroduodenoscopies but, for the most part, is not used for confirming the diagnosis process of celiac disease which is primarily based on histological examination of biopsies. Recently, considerable effort has been undertaken to make use of image material by developing semi- or fully-automated systems to improve the diagnostic workup. Recently, focus was especially laid on developing state-of-the-art deep learning architectures, exploiting the endoscopist's expert knowledge and on making systems fully automated and thereby completely observer independent. In this work, we summarize recent trends in the field of computer-aided celiac disease diagnosis based on upper endoscopy and discuss about recent progress, remaining challenges, limitations currently prohibiting a deployment in clinical practice and future efforts to tackle them.

Coeliac disease and the videocapsule: what have we learned till now

Celiac disease is diagnosed in part by finding areas of pathology in the small bowel (SB) mucosa. This can often be difficult because the pathologic alterations, including atrophy of the small intestinal villi, can often be sparse and subtle. Some of the quantitative methods for detecting and measuring the presence of villous atrophy from videocapsule endoscopy (VCE) images are presented and discussed. These methods consist of static features of measurement including texture, gray level, and presence and abundance of fissures contained within each acquired image. The methods also consist of dynamic measurements including spectral analysis, and determining motion from a sequence of endoscopic images as obtained from a VCE clip. Thus far, several methods have been found useful to characterize the SB mucosa of untreated celiac disease patients versus control patients lacking villous atrophy, which have revealed significant differences in texture, frequency, and motion on analysis of VCE. In untreated celiac patients undergoing endoscopy, there tends to be greater magnitude of changes and spatial differences in textural descriptors, longer periodic components, indicating slower periodic activity, and differences in feature location, suggesting alterations in motility at areas of pathology as compared to patients without villous atrophy. Improvements in the quantitative analysis of VCE imaging in celiac patients is important to detect pathology in suspected patients, so that biopsies can be obtained from pertinent regions of the small intestinal mucosa. Improvements are also necessary so that patients with celiac disease can be monitored to evaluate the progress of mucosal healing after onset of treatment.