1
|
Pal P, Pooja K, Nabi Z, Gupta R, Tandan M, Rao GV, Reddy N. Artificial intelligence in endoscopy related to inflammatory bowel disease: A systematic review. Indian J Gastroenterol 2024; 43:172-187. [PMID: 38418774 DOI: 10.1007/s12664-024-01531-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/09/2023] [Accepted: 01/08/2024] [Indexed: 03/02/2024]
Abstract
BACKGROUND AND OBJECTIVES In spite of rapid growth of artificial intelligence (AI) in digestive endoscopy in lesion detection and characterization, the role of AI in inflammatory bowel disease (IBD) endoscopy is not clearly defined. We aimed at systematically reviewing the role of AI in IBD endoscopy and identifying future research areas. METHODS We searched the PubMed and Embase database using keywords ("artificial intelligence" OR "machine learning" OR "computer-aided" OR "convolutional neural network") AND ("inflammatory bowel disease" OR "ulcerative colitis" OR "Crohn's") AND ("endoscopy" or "colonoscopy" or "capsule endoscopy" or "device assisted enteroscopy") between 1975 and September 2023 and identified 62 original articles for detailed review. Review articles, consensus guidelines, case reports/series, editorials, letter to the editor, non-peer-reviewed pre-prints and conference abstracts were excluded. The quality of the included studies was assessed using the MI-CLAIM checklist. RESULTS The accuracy of AI models (25 studies) to assess ulcerative colitis (UC) endoscopic activity ranged between 86.54% and 94.5%. AI-assisted capsule endoscopy reading (12 studies) substantially reduced analyzable images and reading time with excellent accuracy (90.5% to 99.9%). AI-assisted analysis of colonoscopic images can help differentiate IBD from non-IBD, UC from non-UC and UC from Crohn's disease (CD) (three studies) with 72.1%, 98.3% and > 90% accuracy, respectively. AI models based on non-invasive clinical and radiologic parameters could predict endoscopic activity (three studies). AI-assisted virtual chromoendoscopy (four studies) could predict histologic remission and long-term outcomes. Computer-assisted detection (CADe) of dysplasia (two studies) is feasible along with AI-based differentiation of high from low-grade IBD neoplasia (79% accuracy). AI is effective in linking electronic medical record data (two studies) with colonoscopic videos to facilitate widespread machine learning. CONCLUSION AI-assisted IBD endoscopy has the potential to impact clinical management by automated detection and characterization of endoscopic lesions. Large, multi-center, prospective studies and commercially available IBD-specific endoscopic AI algorithms are warranted.
Collapse
Affiliation(s)
- Partha Pal
- Medical Gastroenterology, Asian Institute of Gastroenterology, Somajiguda, Hyderabad, 500 082, India.
| | - Kanapuram Pooja
- Medical Gastroenterology, Asian Institute of Gastroenterology, Somajiguda, Hyderabad, 500 082, India
| | - Zaheer Nabi
- Medical Gastroenterology, Asian Institute of Gastroenterology, Somajiguda, Hyderabad, 500 082, India
| | - Rajesh Gupta
- Medical Gastroenterology, Asian Institute of Gastroenterology, Somajiguda, Hyderabad, 500 082, India
| | - Manu Tandan
- Medical Gastroenterology, Asian Institute of Gastroenterology, Somajiguda, Hyderabad, 500 082, India
| | - Guduru Venkat Rao
- Surgical Gastroenterology, Asian Institute of Gastroenterology, Hyderabad 500 082, India
| | - Nageshwar Reddy
- Medical Gastroenterology, Asian Institute of Gastroenterology, Somajiguda, Hyderabad, 500 082, India
| |
Collapse
|
2
|
Pinton P. Impact of artificial intelligence on prognosis, shared decision-making, and precision medicine for patients with inflammatory bowel disease: a perspective and expert opinion. Ann Med 2024; 55:2300670. [PMID: 38163336 PMCID: PMC10763920 DOI: 10.1080/07853890.2023.2300670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/17/2023] [Accepted: 12/27/2023] [Indexed: 01/03/2024] Open
Abstract
INTRODUCTION Artificial intelligence (AI) is expected to impact all facets of inflammatory bowel disease (IBD) management, including disease assessment, treatment decisions, discovery and development of new biomarkers and therapeutics, as well as clinician-patient communication. AREAS COVERED This perspective paper provides an overview of the application of AI in the clinical management of IBD through a review of the currently available AI models that could be potential tools for prognosis, shared decision-making, and precision medicine. This overview covers models that measure treatment response based on statistical or machine-learning methods, or a combination of the two. We briefly discuss a computational model that allows integration of immune/biological system knowledge with mathematical modeling and also involves a 'digital twin', which allows measurement of temporal trends in mucosal inflammatory activity for predicting treatment response. A viewpoint on AI-enabled wearables and nearables and their use to improve IBD management is also included. EXPERT OPINION Although challenges regarding data quality, privacy, and security; ethical concerns; technical limitations; and regulatory barriers remain to be fully addressed, a growing body of evidence suggests a tremendous potential for integration of AI into daily clinical practice to enable precision medicine and shared decision-making.
Collapse
Affiliation(s)
- Philippe Pinton
- Clinical and Translational Sciences, Ferring Pharmaceuticals, Kastrup, Denmark
| |
Collapse
|
3
|
Tsai MC, Yen HH, Tsai HY, Huang YK, Luo YS, Kornelius E, Sung WW, Lin CC, Tseng MH, Wang CC. Artificial intelligence system for the detection of Barrett's esophagus. World J Gastroenterol 2023; 29:6198-6207. [PMID: 38186865 PMCID: PMC10768395 DOI: 10.3748/wjg.v29.i48.6198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/03/2023] [Revised: 11/13/2023] [Accepted: 12/12/2023] [Indexed: 12/27/2023] Open
Abstract
BACKGROUND Barrett's esophagus (BE), which has increased in prevalence worldwide, is a precursor for esophageal adenocarcinoma. Although there is a gap in the detection rates between endoscopic BE and histological BE in current research, we trained our artificial intelligence (AI) system with images of endoscopic BE and tested the system with images of histological BE. AIM To assess whether an AI system can aid in the detection of BE in our setting. METHODS Endoscopic narrow-band imaging (NBI) was collected from Chung Shan Medical University Hospital and Changhua Christian Hospital, resulting in 724 cases, with 86 patients having pathological results. Three senior endoscopists, who were instructing physicians of the Digestive Endoscopy Society of Taiwan, independently annotated the images in the development set to determine whether each image was classified as an endoscopic BE. The test set consisted of 160 endoscopic images of 86 cases with histological results. RESULTS Six pre-trained models were compared, and EfficientNetV2B2 (accuracy [ACC]: 0.8) was selected as the backbone architecture for further evaluation due to better ACC results. In the final test, the AI system correctly identified 66 of 70 cases of BE and 85 of 90 cases without BE, resulting in an ACC of 94.37%. CONCLUSION Our AI system, which was trained by NBI of endoscopic BE, can adequately predict endoscopic images of histological BE. The ACC, sensitivity, and specificity are 94.37%, 94.29%, and 94.44%, respectively.
Collapse
Affiliation(s)
- Ming-Chang Tsai
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung 402, Taiwan
- School of Medicine, Chung Shan Medical University, Taichung 402, Taiwan
| | - Hsu-Heng Yen
- Division of Gastroenterology, Changhua Christian Hospital, Changhua 500, Taiwan
- Artificial Intelligence Development Center, Changhua Christian Hospital, Changhua 500, Taiwan
- Department of Post-Baccalaureate Medicine, College of Medicine, National Chung Hsing University, Taichung 400, Taiwan
| | - Hui-Yu Tsai
- Department of Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan
| | - Yu-Kai Huang
- Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| | - Yu-Sin Luo
- Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| | - Edy Kornelius
- School of Medicine, Chung Shan Medical University, Taichung 402, Taiwan
- Department of Endocrinology and Metabolism, Chung-Shan Medical University Hospital, Taichung 402, Taiwan
| | - Wen-Wei Sung
- School of Medicine, Chung Shan Medical University, Taichung 402, Taiwan
- Department of Urology, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| | - Chun-Che Lin
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung 402, Taiwan
- School of Medicine, Chung Shan Medical University, Taichung 402, Taiwan
| | - Ming-Hseng Tseng
- Department of Medical Informatics, Chung Shan Medical University, Taichung 402, Taiwan
- Information Technology Office, Chung Shan Medical University Hospital, Taichung 402, Taiwan
| | - Chi-Chih Wang
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Chung Shan Medical University Hospital, Taichung 402, Taiwan
- School of Medicine, Chung Shan Medical University, Taichung 402, Taiwan
| |
Collapse
|
4
|
He X, Ye H, Zhao R, Lu M, Chen Q, Bao L, Lv T, Li Q, Wu F. Advanced machine learning model for predicting Crohn's disease with enhanced ant colony optimization. Comput Biol Med 2023; 163:107216. [PMID: 37399742 DOI: 10.1016/j.compbiomed.2023.107216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 06/13/2023] [Accepted: 06/25/2023] [Indexed: 07/05/2023]
Abstract
Changes in human lifestyles have led to a dramatic increase in the incidence of Crohn's disease worldwide. Predicting the activity and remission of Crohn's disease has become an urgent research problem. In addition, the influence of each attribute in the test sample on the prediction results and the interpretability of the model still deserves further investigation. Therefore, in this paper, we proposed a wrapper feature selection classification model based on a combination of the improved ant colony optimization algorithm and the kernel extreme learning machine, called bIACOR-KELM-FS. IACOR introduces an evasive strategy and astrophysics strategy to balance the exploration and exploitation phases of the algorithm and enhance its optimization capabilities. The optimization capability of the proposed IACOR was validated on the IEEE CEC2017 benchmark test function. And the prediction was performed on Crohn's disease dataset. The results of the quantitative analysis showed that the prediction accuracy of bIACOR-KELM-FS for predicting the activity and remission of Crohn's disease reached 98.98%. The analysis of important attributes improved the interpretability of the model and provided a reference for the diagnosis of Crohn's disease. Therefore, the proposed model is considered a promising adjunctive diagnostic method for Crohn's disease.
Collapse
Affiliation(s)
- Xixi He
- Department of Gastroenterology, The First Affiliated Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China.
| | - Huajun Ye
- Department of Gastroenterology, The First Affiliated Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China.
| | - Rui Zhao
- Department of Gastroenterology, The First Affiliated Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China.
| | - Mengmeng Lu
- Department of Gastroenterology, The First Affiliated Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China.
| | - Qiwen Chen
- Department of Gastroenterology, The First Affiliated Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China.
| | - Lishimeng Bao
- The Second Clinical College, Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China.
| | - Tianmin Lv
- Department of Nursing Wenzhou Heping International Hospital, Wenzhou, Zhejiang, 325000, China.
| | - Qiang Li
- School of Computer Science and Technology, Beijing Institute of Technology, Beijing, 100081, China.
| | - Fang Wu
- Department of Gastroenterology, The First Affiliated Hospital, Wenzhou Medical University, Wenzhou, Zhejiang, 325000, China.
| |
Collapse
|
5
|
Galati JS, Duve RJ, O'Mara M, Gross SA. Artificial intelligence in gastroenterology: A narrative review. Artif Intell Gastroenterol 2022; 3:117-141. [DOI: 10.35712/aig.v3.i5.117] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/09/2022] [Revised: 11/21/2022] [Accepted: 12/21/2022] [Indexed: 12/28/2022] Open
Abstract
Artificial intelligence (AI) is a complex concept, broadly defined in medicine as the development of computer systems to perform tasks that require human intelligence. It has the capacity to revolutionize medicine by increasing efficiency, expediting data and image analysis and identifying patterns, trends and associations in large datasets. Within gastroenterology, recent research efforts have focused on using AI in esophagogastroduodenoscopy, wireless capsule endoscopy (WCE) and colonoscopy to assist in diagnosis, disease monitoring, lesion detection and therapeutic intervention. The main objective of this narrative review is to provide a comprehensive overview of the research being performed within gastroenterology on AI in esophagogastroduodenoscopy, WCE and colonoscopy.
Collapse
Affiliation(s)
- Jonathan S Galati
- Department of Medicine, NYU Langone Health, New York, NY 10016, United States
| | - Robert J Duve
- Department of Internal Medicine, Jacobs School of Medicine and Biomedical Sciences, University at Buffalo, Buffalo, NY 14203, United States
| | - Matthew O'Mara
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| | - Seth A Gross
- Division of Gastroenterology, NYU Langone Health, New York, NY 10016, United States
| |
Collapse
|
6
|
Parkash O, Siddiqui ATS, Jiwani U, Rind F, Padhani ZA, Rizvi A, Hoodbhoy Z, Das JK. Diagnostic accuracy of artificial intelligence for detecting gastrointestinal luminal pathologies: A systematic review and meta-analysis. Front Med (Lausanne) 2022; 9:1018937. [PMID: 36405592 PMCID: PMC9672666 DOI: 10.3389/fmed.2022.1018937] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2022] [Accepted: 10/03/2022] [Indexed: 11/06/2022] Open
Abstract
Background Artificial Intelligence (AI) holds considerable promise for diagnostics in the field of gastroenterology. This systematic review and meta-analysis aims to assess the diagnostic accuracy of AI models compared with the gold standard of experts and histopathology for the diagnosis of various gastrointestinal (GI) luminal pathologies including polyps, neoplasms, and inflammatory bowel disease. Methods We searched PubMed, CINAHL, Wiley Cochrane Library, and Web of Science electronic databases to identify studies assessing the diagnostic performance of AI models for GI luminal pathologies. We extracted binary diagnostic accuracy data and constructed contingency tables to derive the outcomes of interest: sensitivity and specificity. We performed a meta-analysis and hierarchical summary receiver operating characteristic curves (HSROC). The risk of bias was assessed using Quality Assessment for Diagnostic Accuracy Studies-2 (QUADAS-2) tool. Subgroup analyses were conducted based on the type of GI luminal disease, AI model, reference standard, and type of data used for analysis. This study is registered with PROSPERO (CRD42021288360). Findings We included 73 studies, of which 31 were externally validated and provided sufficient information for inclusion in the meta-analysis. The overall sensitivity of AI for detecting GI luminal pathologies was 91.9% (95% CI: 89.0–94.1) and specificity was 91.7% (95% CI: 87.4–94.7). Deep learning models (sensitivity: 89.8%, specificity: 91.9%) and ensemble methods (sensitivity: 95.4%, specificity: 90.9%) were the most commonly used models in the included studies. Majority of studies (n = 56, 76.7%) had a high risk of selection bias while 74% (n = 54) studies were low risk on reference standard and 67% (n = 49) were low risk for flow and timing bias. Interpretation The review suggests high sensitivity and specificity of AI models for the detection of GI luminal pathologies. There is a need for large, multi-center trials in both high income countries and low- and middle- income countries to assess the performance of these AI models in real clinical settings and its impact on diagnosis and prognosis. Systematic review registration [https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=288360], identifier [CRD42021288360].
Collapse
Affiliation(s)
- Om Parkash
- Department of Medicine, Aga Khan University, Karachi, Pakistan
| | | | - Uswa Jiwani
- Center of Excellence in Women and Child Health, Aga Khan University, Karachi, Pakistan
| | - Fahad Rind
- Head and Neck Oncology, The Ohio State University, Columbus, OH, United States
| | - Zahra Ali Padhani
- Institute for Global Health and Development, Aga Khan University, Karachi, Pakistan
| | - Arjumand Rizvi
- Center of Excellence in Women and Child Health, Aga Khan University, Karachi, Pakistan
| | - Zahra Hoodbhoy
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
| | - Jai K. Das
- Institute for Global Health and Development, Aga Khan University, Karachi, Pakistan
- Department of Pediatrics and Child Health, Aga Khan University, Karachi, Pakistan
- *Correspondence: Jai K. Das,
| |
Collapse
|
7
|
Abstract
Artificial intelligence (AI) is rapidly developing in various medical fields, and there is an increase in research performed in the field of gastrointestinal (GI) endoscopy. In particular, the advent of convolutional neural network, which is a class of deep learning method, has the potential to revolutionize the field of GI endoscopy, including esophagogastroduodenoscopy (EGD), capsule endoscopy (CE), and colonoscopy. A total of 149 original articles pertaining to AI (27 articles in esophagus, 30 articles in stomach, 29 articles in CE, and 63 articles in colon) were identified in this review. The main focuses of AI in EGD are cancer detection, identifying the depth of cancer invasion, prediction of pathological diagnosis, and prediction of Helicobacter pylori infection. In the field of CE, automated detection of bleeding sites, ulcers, tumors, and various small bowel diseases is being investigated. AI in colonoscopy has advanced with several patient-based prospective studies being conducted on the automated detection and classification of colon polyps. Furthermore, research on inflammatory bowel disease has also been recently reported. Most studies of AI in the field of GI endoscopy are still in the preclinical stages because of the retrospective design using still images. Video-based prospective studies are needed to advance the field. However, AI will continue to develop and be used in daily clinical practice in the near future. In this review, we have highlighted the published literature along with providing current status and insights into the future of AI in GI endoscopy.
Collapse
Affiliation(s)
- Yutaka Okagawa
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.,Department of Gastroenterology, Tonan Hospital, Sapporo, Japan
| | - Seiichiro Abe
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan.
| | - Masayoshi Yamada
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Ichiro Oda
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| | - Yutaka Saito
- Endoscopy Division, National Cancer Center Hospital, 5-1-1 Tsukiji, Chuo-ku, Tokyo, 104-0045, Japan
| |
Collapse
|
8
|
Solitano V, Zilli A, Franchellucci G, Allocca M, Fiorino G, Furfaro F, D’amico F, Danese S, Al Awadhi S. Artificial Endoscopy and Inflammatory Bowel Disease: Welcome to the Future. J Clin Med 2022; 11:569. [PMID: 35160021 PMCID: PMC8836846 DOI: 10.3390/jcm11030569] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 01/17/2022] [Accepted: 01/18/2022] [Indexed: 12/15/2022] Open
Abstract
Artificial intelligence (AI) is assuming an increasingly important and central role in several medical fields. Its application in endoscopy provides a powerful tool supporting human experiences in the detection, characterization, and classification of gastrointestinal lesions. Lately, the potential of AI technology has been emerging in the field of inflammatory bowel disease (IBD), where the current cornerstone is the treat-to-target strategy. A sensible and specific tool able to overcome human limitations, such as AI, could represent a great ally and guide precision medicine decisions. Here we reviewed the available literature on the endoscopic applications of AI in order to properly describe the current state-of-the-art and identify the research gaps in IBD at the dawn of 2022.
Collapse
|
9
|
Golemati S, Yanni A, Tsiaparas NN, Lechareas S, Vlachos IS, Cokkinos DD, Krokidis M, Nikita KS, Perrea D, Chatziioannou A. CurveletTransform-Based Texture Analysis of Carotid B-mode Ultrasound Images in Asymptomatic Men With Moderate and Severe Stenoses: A Preliminary Clinical Study. Ultrasound Med Biol 2022; 48:78-90. [PMID: 34666918 DOI: 10.1016/j.ultrasmedbio.2021.09.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/14/2020] [Revised: 09/02/2021] [Accepted: 09/04/2021] [Indexed: 06/13/2023]
Abstract
The curvelet transform, which represents images in terms of their geometric and textural characteristics, was investigated toward revealing differences between moderate (50%-69%, n = 11) and severe (70%-100%, n = 14) stenosis asymptomatic plaque from B-mode ultrasound. Texture features were estimated in original and curvelet transformed images of atheromatous plaque (PL), the adjacent arterial wall (intima-media [IM]) and the plaque shoulder (SH) (i.e., the boundary between plaque and wall), separately at end systole and end diastole. Seventeen features derived from the original images were significantly different between the two groups (4 for IM, 3 for PL and 10 for SH; 9 for end diastole and 8 for end systole); 19 of 234 features (2 for IM and 17 for SH; 8 for end systole and 11 for end diastole) derived from curvelet transformed images were significantly higher in the patients with severe stenosis, indicating higher magnitude, variation and randomness of image gray levels. In these patients, lower body height and higher serum creatinine concentration were observed. Our findings suggest that (a) moderate and severe plaque have similar curvelet-based texture properties, and (b) IM and SH provide useful information about arterial wall pathophysiology, complementary to PL itself. The curvelet transform is promising for identifying novel indices of cardiovascular risk and warrants further investigation in larger cohorts.
Collapse
Affiliation(s)
- Spyretta Golemati
- Medical School, National and Kapodistrian University of Athens, Athens, Greece.
| | - Amalia Yanni
- Department of Nutrition and Dietetics, Harokopio University of Athens, Athens, Greece
| | - Nikolaos N Tsiaparas
- Biomedical Simulations and Imaging Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece
| | - Symeon Lechareas
- Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Ioannis S Vlachos
- Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | | | - Miltiadis Krokidis
- Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Konstantina S Nikita
- Biomedical Simulations and Imaging Laboratory, School of Electrical and Computer Engineering, National Technical University of Athens, Athens, Greece
| | - Despina Perrea
- Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | | |
Collapse
|
10
|
Kröner PT, Engels MML, Glicksberg BS, Johnson KW, Mzaik O, van Hooft JE, Wallace MB, El-Serag HB, Krittanawong C. Artificial intelligence in gastroenterology: A state-of-the-art review. World J Gastroenterol 2021; 27:6794-6824. [PMID: 34790008 PMCID: PMC8567482 DOI: 10.3748/wjg.v27.i40.6794] [Citation(s) in RCA: 39] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/11/2021] [Revised: 06/15/2021] [Accepted: 09/16/2021] [Indexed: 02/06/2023] Open
Abstract
The development of artificial intelligence (AI) has increased dramatically in the last 20 years, with clinical applications progressively being explored for most of the medical specialties. The field of gastroenterology and hepatology, substantially reliant on vast amounts of imaging studies, is not an exception. The clinical applications of AI systems in this field include the identification of premalignant or malignant lesions (e.g., identification of dysplasia or esophageal adenocarcinoma in Barrett’s esophagus, pancreatic malignancies), detection of lesions (e.g., polyp identification and classification, small-bowel bleeding lesion on capsule endoscopy, pancreatic cystic lesions), development of objective scoring systems for risk stratification, predicting disease prognosis or treatment response [e.g., determining survival in patients post-resection of hepatocellular carcinoma), determining which patients with inflammatory bowel disease (IBD) will benefit from biologic therapy], or evaluation of metrics such as bowel preparation score or quality of endoscopic examination. The objective of this comprehensive review is to analyze the available AI-related studies pertaining to the entirety of the gastrointestinal tract, including the upper, middle and lower tracts; IBD; the hepatobiliary system; and the pancreas, discussing the findings and clinical applications, as well as outlining the current limitations and future directions in this field.
Collapse
Affiliation(s)
- Paul T Kröner
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Megan ML Engels
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Cancer Center Amsterdam, Department of Gastroenterology and Hepatology, Amsterdam UMC, Location AMC, Amsterdam 1105, The Netherlands
| | - Benjamin S Glicksberg
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Kipp W Johnson
- The Hasso Plattner Institute for Digital Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Obaie Mzaik
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
| | - Jeanin E van Hooft
- Department of Gastroenterology and Hepatology, Leiden University Medical Center, Amsterdam 2300, The Netherlands
| | - Michael B Wallace
- Division of Gastroenterology and Hepatology, Mayo Clinic, Jacksonville, FL 32224, United States
- Division of Gastroenterology and Hepatology, Sheikh Shakhbout Medical City, Abu Dhabi 11001, United Arab Emirates
| | - Hashem B El-Serag
- Section of Gastroenterology and Hepatology, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
| | - Chayakrit Krittanawong
- Section of Health Services Research, Michael E. DeBakey VA Medical Center and Baylor College of Medicine, Houston, TX 77030, United States
- Section of Cardiology, Michael E. DeBakey VA Medical Center, Houston, TX 77030, United States
| |
Collapse
|
11
|
Christou CD, Tsoulfas G. Challenges and opportunities in the application of artificial intelligence in gastroenterology and hepatology. World J Gastroenterol 2021; 27:6191-6223. [PMID: 34712027 PMCID: PMC8515803 DOI: 10.3748/wjg.v27.i37.6191] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/31/2021] [Revised: 05/06/2021] [Accepted: 08/31/2021] [Indexed: 02/06/2023] Open
Abstract
Artificial intelligence (AI) is an umbrella term used to describe a cluster of interrelated fields. Machine learning (ML) refers to a model that learns from past data to predict future data. Medicine and particularly gastroenterology and hepatology, are data-rich fields with extensive data repositories, and therefore fruitful ground for AI/ML-based software applications. In this study, we comprehensively review the current applications of AI/ML-based models in these fields and the opportunities that arise from their application. Specifically, we refer to the applications of AI/ML-based models in prevention, diagnosis, management, and prognosis of gastrointestinal bleeding, inflammatory bowel diseases, gastrointestinal premalignant and malignant lesions, other nonmalignant gastrointestinal lesions and diseases, hepatitis B and C infection, chronic liver diseases, hepatocellular carcinoma, cholangiocarcinoma, and primary sclerosing cholangitis. At the same time, we identify the major challenges that restrain the widespread use of these models in healthcare in an effort to explore ways to overcome them. Notably, we elaborate on the concerns regarding intrinsic biases, data protection, cybersecurity, intellectual property, liability, ethical challenges, and transparency. Even at a slower pace than anticipated, AI is infiltrating the healthcare industry. AI in healthcare will become a reality, and every physician will have to engage with it by necessity.
Collapse
Affiliation(s)
- Chrysanthos D Christou
- Organ Transplant Unit, Hippokration General Hospital, Aristotle University of Thessaloniki, Thessaloniki 54622, Greece
| | - Georgios Tsoulfas
- Organ Transplant Unit, Hippokration General Hospital, Aristotle University of Thessaloniki, Thessaloniki 54622, Greece
| |
Collapse
|
12
|
Oka A, Ishimura N, Ishihara S. A New Dawn for the Use of Artificial Intelligence in Gastroenterology, Hepatology and Pancreatology. Diagnostics (Basel) 2021; 11:1719. [PMID: 34574060 PMCID: PMC8468082 DOI: 10.3390/diagnostics11091719] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Revised: 09/17/2021] [Accepted: 09/17/2021] [Indexed: 12/15/2022] Open
Abstract
Artificial intelligence (AI) is rapidly becoming an essential tool in the medical field as well as in daily life. Recent developments in deep learning, a subfield of AI, have brought remarkable advances in image recognition, which facilitates improvement in the early detection of cancer by endoscopy, ultrasonography, and computed tomography. In addition, AI-assisted big data analysis represents a great step forward for precision medicine. This review provides an overview of AI technology, particularly for gastroenterology, hepatology, and pancreatology, to help clinicians utilize AI in the near future.
Collapse
Affiliation(s)
- Akihiko Oka
- Department of Internal Medicine II, Faculty of Medicine, Shimane University, Izumo 693-8501, Shimane, Japan; (N.I.); (S.I.)
| | | | | |
Collapse
|
13
|
Chen L, Li DC. Artificial intelligence and inflammatory bowel disease. Shijie Huaren Xiaohua Zazhi 2021; 29:684-689. [DOI: 10.11569/wcjd.v29.i13.684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
With the development of artificial intelligence (AI) and its gradual application in the medical field, AI has brought new ideas to the medical development. The research and application of AI in inflammatory l bowel disease (IBD), which includes ulcerative colitis (UC) and Crohn's disease (CD), are increasing. Selecting appropriate models and methods through machine learning can help diagnose, treat, and predict the prognosis of IBD. In recent years, AI combined with endoscopy has made an appearance in the diagnosis of IBD and achieved satisfactory results. At the same time, AI plays an important role in the process of disease prediction and treatment evaluation for patients with IBD. However, we should also be aware that there are still some problems with AI. This paper gives a brief review of the practical application value of AI in IBD.
Collapse
Affiliation(s)
- Lei Chen
- Graduate School of Bengbu Medical College, Bengbu 233030, Anhui Province, China
| | - De-Chun Li
- Department of Radiology, Xuzhou Central Hospital Affiliated to Medical School of Southeast University, Xuzhou 221009, Jiangsu Province, China
| |
Collapse
|
14
|
Abstract
Capsule endoscopy (CE) has been increasingly utilised in recent years as a minimally invasive tool to investigate the whole gastrointestinal (GI) tract and a range of capsules are currently available for evaluation of upper GI, small bowel, and lower GI pathology. Although CE is undoubtedly an invaluable test for the investigation of small bowel pathology, it presents considerable challenges and limitations, such as long and laborious reading times, risk of missing lesions, lack of bowel cleansing score and lack of locomotion. Artificial intelligence (AI) seems to be a promising tool that may help improve the performance metrics of CE, and consequently translate to better patient care. In the last decade, significant progress has been made to apply AI in the field of endoscopy, including CE. Although it is certain that AI will find soon its place in day-to-day endoscopy clinical practice, there are still some open questions and barriers limiting its widespread application. In this review, we provide some general information about AI, and outline recent advances in AI and CE, issues around implementation of AI in medical practice and potential future applications of AI-aided CE.
Collapse
Affiliation(s)
- Ioannis Tziortziotis
- Endoscopy Unit, Digestive Diseases Centre, Queen's Hospital, Barking Havering and Redbridge University Hospitals NHS Trust, Rom Valley Way, Romford, London RM7 0AG, UK
| | - Faidon-Marios Laskaratos
- Endoscopy Unit, Digestive Diseases Centre, Queen's Hospital, Barking Havering and Redbridge University Hospitals NHS Trust, Rom Valley Way, Romford, London RM7 0AG, UK
| | - Sergio Coda
- Endoscopy Unit, Digestive Diseases Centre, Queen's Hospital, Barking Havering and Redbridge University Hospitals NHS Trust, Rom Valley Way, Romford, London RM7 0AG, UK
- Photonics Group-Department of Physics, Imperial College London, Exhibition Rd, South Kensington, London SW7 2BX, UK
| |
Collapse
|
15
|
Tontini GE, Rimondi A, Vernero M, Neumann H, Vecchi M, Bezzio C, Cavallaro F. Artificial intelligence in gastrointestinal endoscopy for inflammatory bowel disease: a systematic review and new horizons. Therap Adv Gastroenterol 2021; 14:17562848211017730. [PMID: 34178115 PMCID: PMC8202249 DOI: 10.1177/17562848211017730] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/07/2021] [Accepted: 04/26/2021] [Indexed: 02/04/2023] Open
Abstract
INTRODUCTION Since the advent of artificial intelligence (AI) in clinical studies, luminal gastrointestinal endoscopy has made great progress, especially in the detection and characterization of neoplastic and preneoplastic lesions. Several studies have recently shown the potential of AI-driven endoscopy for the investigation of inflammatory bowel disease (IBD). This systematic review provides an overview of the current position and future potential of AI in IBD endoscopy. METHODS A systematic search was carried out in PubMed and Scopus up to 2 December 2020 using the following search terms: artificial intelligence, machine learning, computer-aided, inflammatory bowel disease, ulcerative colitis (UC), Crohn's disease (CD). All studies on human digestive endoscopy were included. A qualitative analysis and a narrative description were performed for each selected record according to the Joanna Briggs Institute methodologies and the PRISMA statement. RESULTS Of 398 identified records, 18 were ultimately included. Two-thirds of these (12/18) were published in 2020 and most were cross-sectional studies (15/18). No relevant bias at the study level was reported, although the risk of publication bias across studies cannot be ruled out at this early stage. Eleven records dealt with UC, five with CD and two with both. Most of the AI systems involved convolutional neural network, random forest and deep neural network architecture. Most studies focused on capsule endoscopy readings in CD (n = 5) and on the AI-assisted assessment of mucosal activity in UC (n = 10) for automated endoscopic scoring or real-time prediction of histological disease. DISCUSSION AI-assisted endoscopy in IBD is a rapidly evolving research field with promising technical results and additional benefits when tested in an experimental clinical scenario. External validation studies being conducted in large and prospective cohorts in real-life clinical scenarios will help confirm the added value of AI in assessing UC mucosal activity and in CD capsule reading. PLAIN LANGUAGE SUMMARY Artificial intelligence for inflammatory bowel disease endoscopy Artificial intelligence (AI) is a promising technology in many areas of medicine. In recent years, AI-assisted endoscopy has been introduced into several research fields, including inflammatory bowel disease (IBD) endoscopy, with promising applications that have the potential to revolutionize clinical practice and gastrointestinal endoscopy.We have performed the first systematic review of AI and its application in the field of IBD and endoscopy.A formal process of paper selection and analysis resulted in the assessment of 18 records. Most of these (12/18) were published in 2020 and were cross-sectional studies (15/18). No relevant biases were reported. All studies showed positive results concerning the novel technology evaluated, so the risk of publication bias cannot be ruled out at this early stage.Eleven records dealt with UC, five with CD and two with both. Most studies focused on capsule endoscopy reading in CD patients (n = 5) and on AI-assisted assessment of mucosal activity in UC patients (n = 10) for automated endoscopic scoring and real-time prediction of histological disease.We found that AI-assisted endoscopy in IBD is a rapidly growing research field. All studies indicated promising technical results. When tested in an experimental clinical scenario, AI-assisted endoscopy showed it could potentially improve the management of patients with IBD.Confirmatory evidence from real-life clinical scenarios should be obtained to verify the added value of AI-assisted IBD endoscopy in assessing UC mucosal activity and in CD capsule reading.
Collapse
Affiliation(s)
- Gian Eugenio Tontini
- Gastroenterology and Endoscopy Unit, Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, Milan, Italy
- Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy
| | - Alessandro Rimondi
- Department of Pathophysiology and Organ Transplantation, Università degli Studi di Milano, Via Francesco Sforza 35, Milano 20122, Italy
- Gastroenterology and Endoscopy Unit, Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, Milan, Italy
| | - Marta Vernero
- Gastroenterology Unit, Rho Hospital, ASST Rhodense, Milan, Italy
| | - Helmut Neumann
- Department of Interdisciplinary Endoscopy, University Hospital Mainz, Mainz, Germany
| | - Maurizio Vecchi
- Gastroenterology and Endoscopy Unit, Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, Milan, Italy
- Department of Pathophysiology and Transplantation, University of Milan, Milan, Italy
| | - Cristina Bezzio
- Gastroenterology Unit, Rho Hospital, ASST Rhodense, Milan, Italy
| | - Flaminia Cavallaro
- Gastroenterology and Endoscopy Unit, Fondazione IRCCS Ca’ Granda Ospedale Maggiore Policlinico, Milan, Italy
| |
Collapse
|
16
|
Gubatan J, Levitte S, Patel A, Balabanis T, Wei MT, Sinha SR. Artificial intelligence applications in inflammatory bowel disease: Emerging technologies and future directions. World J Gastroenterol 2021; 27:1920-1935. [PMID: 34007130 PMCID: PMC8108036 DOI: 10.3748/wjg.v27.i17.1920] [Citation(s) in RCA: 45] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/26/2021] [Revised: 03/04/2021] [Accepted: 04/13/2021] [Indexed: 02/06/2023] Open
Abstract
Inflammatory bowel disease (IBD) is a complex and multifaceted disorder of the gastrointestinal tract that is increasing in incidence worldwide and associated with significant morbidity. The rapid accumulation of large datasets from electronic health records, high-definition multi-omics (including genomics, proteomics, transcriptomics, and metagenomics), and imaging modalities (endoscopy and endomicroscopy) have provided powerful tools to unravel novel mechanistic insights and help address unmet clinical needs in IBD. Although the application of artificial intelligence (AI) methods has facilitated the analysis, integration, and interpretation of large datasets in IBD, significant heterogeneity in AI methods, datasets, and clinical outcomes and the need for unbiased prospective validations studies are current barriers to incorporation of AI into clinical practice. The purpose of this review is to summarize the most recent advances in the application of AI and machine learning technologies in the diagnosis and risk prediction, assessment of disease severity, and prediction of clinical outcomes in patients with IBD.
Collapse
Affiliation(s)
- John Gubatan
- Division of Gastroenterology and Hepatology, Stanford University School of Medicine, Redwood City, CA 94063, United States
| | - Steven Levitte
- Division of Gastroenterology and Hepatology, Stanford University School of Medicine, Redwood City, CA 94063, United States
| | - Akshar Patel
- Division of Gastroenterology and Hepatology, Stanford University School of Medicine, Redwood City, CA 94063, United States
| | - Tatiana Balabanis
- Division of Gastroenterology and Hepatology, Stanford University School of Medicine, Redwood City, CA 94063, United States
| | - Mike T Wei
- Division of Gastroenterology and Hepatology, Stanford University School of Medicine, Redwood City, CA 94063, United States
| | - Sidhartha R Sinha
- Division of Gastroenterology and Hepatology, Stanford University School of Medicine, Redwood City, CA 94063, United States
| |
Collapse
|
17
|
Kumar R, Khan FU, Sharma A, Aziz IB, Poddar NK. Recent Applications of Artificial Intelligence in detection of Gastrointestinal, Hepatic and Pancreatic Diseases. Curr Med Chem 2021; 29:66-85. [PMID: 33820515 DOI: 10.2174/0929867328666210405114938] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2020] [Revised: 02/25/2021] [Accepted: 03/06/2021] [Indexed: 11/22/2022]
Abstract
There is substantial progress in artificial intelligence (AI) algorithms and their medical sciences applications in the last two decades. AI-assisted programs have already been established for remotely health monitoring using sensors and smartphones. A variety of AI-based prediction models available for the gastrointestinal inflammatory, non-malignant diseases, and bowel bleeding using wireless capsule endoscopy, electronic medical records for hepatitis-associated fibrosis, pancreatic carcinoma using endoscopic ultrasounds. AI-based models may be of immense help for healthcare professionals in the identification, analysis, and decision support using endoscopic images to establish prognosis and risk assessment of patient's treatment using multiple factors. Although enough randomized clinical trials are warranted to establish the efficacy of AI-algorithms assisted and non-AI based treatments before approval of such techniques from medical regulatory authorities. In this article, available AI approaches and AI-based prediction models for detecting gastrointestinal, hepatic, and pancreatic diseases are reviewed. The limitation of AI techniques in such disease prognosis, risk assessment, and decision support are discussed.
Collapse
Affiliation(s)
- Rajnish Kumar
- Amity Institute of Biotechnology, Amity University Uttar Pradesh Lucknow Campus, Uttar Pradesh. India
| | - Farhat Ullah Khan
- Computer and Information Sciences Department, Universiti Teknologi Petronas, 32610, Seri Iskander, Perak. Malaysia
| | - Anju Sharma
- Department of Applied Science, Indian Institute of Information Technology, Allahabad, Uttar Pradesh. India
| | - Izzatdin Ba Aziz
- Computer and Information Sciences Department, Universiti Teknologi Petronas, 32610, Seri Iskander, Perak. Malaysia
| | | |
Collapse
|
18
|
|
19
|
Sinonquel P, Eelbode T, Bossuyt P, Maes F, Bisschops R. Artificial intelligence and its impact on quality improvement in upper and lower gastrointestinal endoscopy. Dig Endosc 2021; 33:242-253. [PMID: 33145847 DOI: 10.1111/den.13888] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/28/2020] [Revised: 10/14/2020] [Accepted: 11/01/2020] [Indexed: 12/24/2022]
Abstract
Artificial intelligence (AI) and its application in medicine has grown large interest. Within gastrointestinal (GI) endoscopy, the field of colonoscopy and polyp detection is the most investigated, however, upper GI follows the lead. Since endoscopy is performed by humans, it is inherently an imperfect procedure. Computer-aided diagnosis may improve its quality by helping prevent missing lesions and supporting optical diagnosis for those detected. An entire evolution in AI systems has been established in the last decades, resulting in optimization of the diagnostic performance with lower variability and matching or even outperformance of expert endoscopists. This shows a great potential for future quality improvement of endoscopy, given the outstanding diagnostic features of AI. With this narrative review, we highlight the potential benefit of AI to improve overall quality in daily endoscopy and describe the most recent developments for characterization and diagnosis as well as the recent conditions for regulatory approval.
Collapse
Affiliation(s)
- Pieter Sinonquel
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Leuven, Belgium.,Departments of, Department of, Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven, Leuven, Belgium
| | - Tom Eelbode
- Medical Imaging Research Center (MIRC), University Hospitals Leuven, Leuven, Belgium.,Department of Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Peter Bossuyt
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Leuven, Belgium.,Department of Gastroenterology and Hepatology, Imelda Hospital, Bonheiden, Belgium
| | - Frederik Maes
- Medical Imaging Research Center (MIRC), University Hospitals Leuven, Leuven, Belgium.,Department of Electrical Engineering (ESAT/PSI), KU Leuven, Leuven, Belgium
| | - Raf Bisschops
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Leuven, Belgium.,Departments of, Department of, Translational Research in Gastrointestinal Diseases (TARGID), KU Leuven, Leuven, Belgium
| |
Collapse
|
20
|
Sinonquel P, Bisschops R. Striving for quality improvement: can artificial intelligence help? Best Pract Res Clin Gastroenterol 2020; 52-53:101722. [PMID: 34172249 DOI: 10.1016/j.bpg.2020.101722] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/10/2020] [Accepted: 12/22/2020] [Indexed: 02/06/2023]
Abstract
Artificial intelligence (AI) is of keen interest for global health development as potential support for current human shortcomings. Gastrointestinal (GI) endoscopy is an excellent substrate for AI, since it holds the genuine potential to improve quality in GI endoscopy and overall patient care by improving detection and diagnosis guiding the endoscopists in performing endoscopy to the highest quality standards. The possibility of large data acquisitioning to refine algorithms makes implementation of AI into daily practice a potential reality. With the start of a new era adopting deep learning, large amounts of data can easily be processed, resulting in better diagnostic performances. In the upper gastrointestinal tract, research currently focusses on the detection and characterization of neoplasia, including Barrett's, squamous cell and gastric carcinoma, with an increasing amount of AI studies demonstrating the potential and benefit of AI-augmented endoscopy. Deep learning applied to small bowel video capsule endoscopy also appears to enhance pathology detection and reduce capsule reading time. In the colon, multiple prospective trials including five randomized trials, showed a consistent improvement in polyp and adenoma detection rates, one of the main quality indicators in endoscopy. There are however potential additional roles for AI to assist in quality improvement of endoscopic procedures, training and therapeutic decision making. Further large-scale, multicenter validation trials are required before AI-augmented diagnostic gastrointestinal endoscopy can be integrated into our routine clinical practice.
Collapse
Affiliation(s)
- P Sinonquel
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Herestraat 49, 3000, Leuven, Belgium; Department of Translational Research in Gastrointestinal Diseases (TARGID), Catholic University Leuven, Herestraat 49, 3000, Leuven, Belgium.
| | - R Bisschops
- Department of Gastroenterology and Hepatology, University Hospitals Leuven, Herestraat 49, 3000, Leuven, Belgium; Department of Translational Research in Gastrointestinal Diseases (TARGID), Catholic University Leuven, Herestraat 49, 3000, Leuven, Belgium.
| |
Collapse
|
21
|
Meher D, Gogoi M, Bharali P, Anirvan P, Singh SP. Artificial Intelligence in Small Bowel Endoscopy: Current Perspectives and Future Directions. Journal of Digestive Endoscopy 2020. [DOI: 10.1055/s-0040-1717824] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
AbstractArtificial intelligence (AI) is a computer system that is able to perform tasks which normally require human intelligence. The role of AI in the field of gastroenterology has been gradually evolving since its inception in the 1950s. Discovery of wireless capsule endoscopy (WCE) and balloon enteroscopy (BE) has revolutionized small gut imaging. While WCE is a relatively patient-friendly and noninvasive mode to examine the nonobstructed small gut, it is limited by a lengthy examination time and the need for expertise in reading images acquired by the capsule. Similarly, BE, despite having the advantage of therapeutic intervention, is costly, invasive, and requires general sedation. Incorporation of concepts like machine learning and deep learning has been used to handle large amounts of data and images in gastroenterology. Interestingly, in small gut imaging, the application of AI has been limited to WCE only. This review was planned to examine and summarize available published data on various AI-based approaches applied to small bowel disease.
We conducted an extensive literature search using Google search engine, Google Scholar, and PubMed database for published literature in English on the application of different AI techniques in small bowel endoscopy, and have summarized the outcome and benefits of these applications of AI in small bowel endoscopy. Incorporation of AI in WCE has resulted in significant advancements in the detection of various lesions starting from dysplastic mucosa, inflammatory and nonmalignant lesions to the detection of bleeding with increasing accuracy and has shortened the lengthy review time in image analysis. As most of the studies to evaluate AI are retrospective, the presence of inherent selection bias cannot be excluded. Besides, the interpretability (black-box nature) of AI models remains a cause for concern. Finally, issues related to medical ethics and AI need to be judiciously addressed to enable its seamless use in future.
Collapse
Affiliation(s)
- Dinesh Meher
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | - Mrinal Gogoi
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | - Pankaj Bharali
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | - Prajna Anirvan
- Department of Gastroenterology, S.C.B. Medical College, Cuttack, Odisha, India
| | | |
Collapse
|
22
|
Seyed Tabib NS, Madgwick M, Sudhakar P, Verstockt B, Korcsmaros T, Vermeire S. Big data in IBD: big progress for clinical practice. Gut 2020; 69:1520-1532. [PMID: 32111636 PMCID: PMC7398484 DOI: 10.1136/gutjnl-2019-320065] [Citation(s) in RCA: 107] [Impact Index Per Article: 26.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/11/2019] [Revised: 02/05/2020] [Accepted: 02/06/2020] [Indexed: 12/12/2022]
Abstract
IBD is a complex multifactorial inflammatory disease of the gut driven by extrinsic and intrinsic factors, including host genetics, the immune system, environmental factors and the gut microbiome. Technological advancements such as next-generation sequencing, high-throughput omics data generation and molecular networks have catalysed IBD research. The advent of artificial intelligence, in particular, machine learning, and systems biology has opened the avenue for the efficient integration and interpretation of big datasets for discovering clinically translatable knowledge. In this narrative review, we discuss how big data integration and machine learning have been applied to translational IBD research. Approaches such as machine learning may enable patient stratification, prediction of disease progression and therapy responses for fine-tuning treatment options with positive impacts on cost, health and safety. We also outline the challenges and opportunities presented by machine learning and big data in clinical IBD research.
Collapse
Affiliation(s)
| | - Matthew Madgwick
- Organisms and Ecosystems, Earlham Institute, Norwich, UK
- Gut microbes in health and disease, Quadram Institute Bioscience, Norwich, UK
| | - Padhmanand Sudhakar
- Department of Chronic Diseases, Metabolism and Ageing, TARGID, KU Leuven, Leuven, Belgium
- Organisms and Ecosystems, Earlham Institute, Norwich, UK
- Gut microbes in health and disease, Quadram Institute Bioscience, Norwich, UK
| | - Bram Verstockt
- Translational Research in GastroIntestinal Disorders, KU Leuven, Leuven, Belgium
- Department of Gastroenterology and Hepatology, KU Leuven University Hospitals Leuven, Leuven, Belgium
| | - Tamas Korcsmaros
- Organisms and Ecosystems, Earlham Institute, Norwich, UK
- Gut microbes in health and disease, Quadram Institute Bioscience, Norwich, UK
| | - Séverine Vermeire
- Department of Chronic Diseases, Metabolism and Ageing, TARGID, KU Leuven, Leuven, Belgium
- Department of Gastroenterology and Hepatology, KU Leuven University Hospitals Leuven, Leuven, Belgium
| |
Collapse
|
23
|
Le Berre C, Sandborn WJ, Aridhi S, Devignes MD, Fournier L, Smaïl-Tabbone M, Danese S, Peyrin-Biroulet L. Application of Artificial Intelligence to Gastroenterology and Hepatology. Gastroenterology 2020; 158:76-94.e2. [PMID: 31593701 DOI: 10.1053/j.gastro.2019.08.058] [Citation(s) in RCA: 259] [Impact Index Per Article: 64.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/20/2018] [Revised: 08/22/2019] [Accepted: 08/24/2019] [Indexed: 02/07/2023]
Abstract
Since 2010, substantial progress has been made in artificial intelligence (AI) and its application to medicine. AI is explored in gastroenterology for endoscopic analysis of lesions, in detection of cancer, and to facilitate the analysis of inflammatory lesions or gastrointestinal bleeding during wireless capsule endoscopy. AI is also tested to assess liver fibrosis and to differentiate patients with pancreatic cancer from those with pancreatitis. AI might also be used to establish prognoses of patients or predict their response to treatments, based on multiple factors. We review the ways in which AI may help physicians make a diagnosis or establish a prognosis and discuss its limitations, knowing that further randomized controlled studies will be required before the approval of AI techniques by the health authorities.
Collapse
Affiliation(s)
- Catherine Le Berre
- Institut des Maladies de l'Appareil Digestif, Nantes University Hospital, France; Institut National de la Santé et de la Recherche Médicale U954 and Department of Gastroenterology, Nancy University Hospital, University of Lorraine, France
| | | | - Sabeur Aridhi
- University of Lorraine, Le Centre National de la Recherche Scientifique, Inria, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Nancy, France
| | - Marie-Dominique Devignes
- University of Lorraine, Le Centre National de la Recherche Scientifique, Inria, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Nancy, France
| | - Laure Fournier
- Université Paris-Descartes, Institut National de la Santé et de la Recherche Médicale, Unité Mixte De Recherché S970, Assistance Publique-Hôpitaux de Paris, Paris, France
| | - Malika Smaïl-Tabbone
- University of Lorraine, Le Centre National de la Recherche Scientifique, Inria, Laboratoire Lorrain de Recherche en Informatique et ses Applications, Nancy, France
| | - Silvio Danese
- Inflammatory Bowel Disease Center and Department of Biomedical Sciences, Humanitas Clinical and Research Center, Humanitas University, Milan, Italy
| | - Laurent Peyrin-Biroulet
- Institut National de la Santé et de la Recherche Médicale U954 and Department of Gastroenterology, Nancy University Hospital, University of Lorraine, France.
| |
Collapse
|
24
|
Nagy S, Sziová B, Pipek J. On Structural Entropy and Spatial Filling Factor Analysis of Colonoscopy Pictures. Entropy (Basel) 2019; 21:E256. [PMID: 33266971 DOI: 10.3390/e21030256] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2018] [Revised: 02/19/2019] [Accepted: 02/27/2019] [Indexed: 12/21/2022]
Abstract
Colonoscopy is the standard device for diagnosing colorectal cancer, which develops from little lesions on the bowel wall called polyps. The Rényi entropies-based structural entropy and spatial filling factor are two scale- and resolution-independent quantities that characterize the shape of a probability distribution with the help of characteristic curves of the structural entropy–spatial filling factor map. This alternative definition of structural entropy is easy to calculate, independent of the image resolution, and does not require the calculation of neighbor statistics, unlike the other graph-based structural entropies.The distant goal of this study was to help computer aided diagnosis in finding colorectal polyps by making the Rényi entropy based structural entropy more understood. The direct goal was to determine characteristic curves that can differentiate between polyps and other structure on the picture. After analyzing the distribution of colonoscopy picture color channels, the typical structures were modeled with simple geometrical functions and the structural entropy–spatial filling factor characteristic curves were determined for these model structures for various parameter sets. A colonoscopy image analying method, i.e., the line- or column-wise scanning of the picture, was also tested, with satisfactory matching of the characteristic curve and the image.
Collapse
|