1
|
Chen J, Wang H, Zhang Z, Xia K, Gao F, Xu X, Wang G. Development and Validation of a Multi-Task Artificial Intelligence-Assisted System for Small Bowel Capsule Endoscopy. Int J Gen Med 2025; 18:2521-2536. [PMID: 40386762 PMCID: PMC12083486 DOI: 10.2147/ijgm.s522587] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2025] [Accepted: 05/07/2025] [Indexed: 05/20/2025] Open
Abstract
Objective To develop a multi-task artificial intelligence-assisted system for small bowel capsule endoscopy (SBCE) based on various Transformer neural network architectures. The system integrates lesion recognition, cumulative time statistics, and progress bar marking functions to enhance the efficiency and accuracy of endoscopic image interpretation while effectively reducing missed diagnoses. Methods A dataset comprising 12 annotated categories of images captured by three different brands of capsule endoscopy devices was collected. Transfer learning and fine-tuning were conducted on five pre-trained Transformer models. Performance metrics, including accuracy, sensitivity, specificity, and recognition speed, were evaluated to select the best-performing model. The optimal model was converted from PyTorch to Open Neural Network Exchange (ONNX) format. Using OpenCV and MMCV tools, a multi-task SBCE-assisted reading system was developed. Results A total of 34,799 images were included in the study. The best-performing model, FocalNet, achieved a weighted average sensitivity of 85.69%, specificity of 98.58%, accuracy of 85.69%, and an AUC of 0.98 across all categories. Its diagnostic accuracy outperformed junior physicians (χ²=17.26, p<0.05) and showed no statistical difference compared to senior physicians (χ²=0.0716, p>0.05). The multi-task AI-assisted reading system, "FocalCE-Master", developed based on FocalNet, achieved a diagnostic speed of 592.40 frames per second, significantly faster than endoscopists. By integrating cumulative time bar charts with progress bar marking functionality, the system enables rapid localization and review of lesions, effectively streamlining the diagnostic workflow of SBCE. Conclusion The multi-task SBCE-assisted reading system developed using Transformer networks demonstrated rapid and accurate classification of various small bowel lesions. It holds significant potential in enhancing diagnostic efficiency and image review speed for endoscopists. However, the AI system has not yet been validated in prospective clinical trials, and further real-world studies are needed to confirm its clinical applicability.
Collapse
Affiliation(s)
- Jian Chen
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, Jiangsu, 215500, People’s Republic of China
- Center of Intelligent Medical Technology Research, Changshu Hospital Affiliated to Soochow University, Suzhou, 215500, People’s Republic of China
| | - Hongwei Wang
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, Jiangsu, 215500, People’s Republic of China
- Center of Intelligent Medical Technology Research, Changshu Hospital Affiliated to Soochow University, Suzhou, 215500, People’s Republic of China
| | - Zihao Zhang
- Department of Information Engineering, Shanghai Haoxiong Education Technology Co., Ltd, Shanghai, 200434, People’s Republic of China
| | - Kaijian Xia
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, Jiangsu, 215500, People’s Republic of China
- Center of Intelligent Medical Technology Research, Changshu Hospital Affiliated to Soochow University, Suzhou, 215500, People’s Republic of China
| | - Fuli Gao
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, Jiangsu, 215500, People’s Republic of China
| | - Xiaodan Xu
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, Jiangsu, 215500, People’s Republic of China
| | - Ganhong Wang
- Department of Gastroenterology, Changshu Hospital Affiliated to Nanjing University of Chinese Medicine, Suzhou, Jiangsu, 215500, People’s Republic of China
| |
Collapse
|
2
|
Sidhu R, Shiha MG, Carretero C, Koulaouzidis A, Dray X, Mussetto A, Keuchel M, Spada C, Despott EJ, Chetcuti Zammit S, McNamara D, Rondonotti E, Sabino J, Ferlitsch M. Performance measures for small-bowel endoscopy: a European Society of Gastrointestinal Endoscopy (ESGE) Quality Improvement Initiative - Update 2025. Endoscopy 2025; 57:366-389. [PMID: 39909070 DOI: 10.1055/a-2522-1995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2025]
Abstract
Quality markers and patient experience are being implemented to ensure standardization of practice across gastrointestinal (GI) endoscopy procedures. The set benchmarks ensure high quality procedures are delivered and linked to measurable outcomes.There has been an increase in the demand for small-bowel endoscopy. In 2019, the European Society of Gastrointestinal Endoscopy (ESGE) embarked on setting performance measures for small-bowel endoscopy. This included major (key) and minor performance indicators for both small-bowel capsule endoscopy (SBCE) and device-assisted enteroscopy (DAE). These suggested quality indicators cover all procedure domains, from patient selection and preparation, to intraprocedural aspects such as pathology identification, appropriate management, the patient experience, and post-procedure complications. Since 2019, there has been an increase in published studies looking at different aspects of small-bowel endoscopy, including real-world data. This paper provides an update on the 2019 performance measures, considering the latest literature.
Collapse
Affiliation(s)
- Reena Sidhu
- Academic Unit of Gastroenterology, Sheffield Teaching Hospitals, Sheffield, UK
- Division of Clinical Medicine, School of Medicine and Population Health, University of Sheffield, Sheffield, UK
| | - Mohamed G Shiha
- Academic Unit of Gastroenterology, Sheffield Teaching Hospitals, Sheffield, UK
- Division of Clinical Medicine, School of Medicine and Population Health, University of Sheffield, Sheffield, UK
| | - Cristina Carretero
- Department of Gastroenterology, University of Navarra Clinic, Healthcare Research Institute of Navarra, Pamplona, Spain
| | - Anastasios Koulaouzidis
- Surgical Research Unit, Odense University Hospital (OUH) and Svendborg Sygehus, Svendborg, Denmark
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Department of Social Medicine and Public Health, Pomeranian Medical University, Szczecin, Poland
| | - Xavier Dray
- Sorbonne University, Center for Digestive Endoscopy, Sainte-Antoine Hospital, AP-HP, Paris, France
| | | | - Martin Keuchel
- Clinic for Internal Medicine, Agaplesion Bethesda Krankenhaus Bergedorf, Hamburg, Germany
| | - Cristiano Spada
- Digestive Endoscopy Unit and Gastroenterology, Fondazione Poliambulanza, Brescia, Italy
- Università Cattolica del Sacro Cuore, Rome, Italy
| | - Edward J Despott
- Royal Free Unit for Endoscopy, The Royal Free Hospital and UCL Institute for Liver and Digestive Health, London, UK
| | | | - Deirdre McNamara
- TAGG Research Centre, Department of Clinical Medicine, Trinity Centre, Tallaght Hospital, Dublin, Ireland
| | | | - João Sabino
- Department of Gastroenterology, University of Leuven, Leuven, Belgium
| | - Monika Ferlitsch
- Department of Internal Medicine III, Division of Gastroenterology and Hepatology, Medical University of Vienna, Vienna, Austria
- Department of Internal Medicine with Gastroenterology and Geriatrics, Klinik Floridsdorf, Vienna, Austria
| |
Collapse
|
3
|
Cortegoso Valdivia P, Fantasia S, Kayali S, Deding U, Gualandi N, Manno M, Toth E, Dray X, Yang S, Koulaouzidis A. Conventional small-bowel capsule endoscopy reading vs proprietary artificial intelligence auxiliary systems: Systematic review and meta-analysis. Endosc Int Open 2025; 13:a25442863. [PMID: 40109313 PMCID: PMC11922306 DOI: 10.1055/a-2544-2863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/14/2024] [Accepted: 02/18/2025] [Indexed: 03/22/2025] Open
Abstract
Background and study aims Small-bowel capsule endoscopy (SBCE) is the gold standard for diagnosing small bowel (SB) pathologies, but its time-consuming nature and potential for human error make it challenging. Several proprietary artificial intelligence (AI) auxiliary systems based on convolutional neural networks (CNNs) that are integrated into SBCE reading platforms are available on the market and offer the opportunity to improve lesion detection and reduce reading times. This meta-analysis aimed to evaluate performance of proprietary AI auxiliary platforms in SBCE compared with conventional, human-only reading. Methods A systematic literature search was conducted to identify studies comparing AI-assisted SBCE readings with conventional readings by gastroenterologists. Performance measures such as accuracy, sensitivity, specificity, and reading times were extracted and analyzed. Methodological transparency was assessed using the Methodological Index for Non-randomized Studies (MINORS) assessment tool. Results Of 669 identified studies, 104 met the inclusion criteria and six were included in the analysis. Quality assessment revealed high methodological transparency for all included studies. Pooled analysis showed that AI-assisted reading achieved significantly higher sensitivity and comparable specificity to conventional reading, with a higher log diagnostic odds ratio and no substantial heterogeneity. In addition, AI integration substantially reduced reading times, with a mean decrease of 12-fold compared with conventional reading. Conclusions AI-assisted SBCE reading outperforms conventional human review in terms of detection accuracy and sensitivity, remarkably reducing reading times. AI in this setting could be a game-changer in reducing endoscopy service workload and supporting novice reader training.
Collapse
Affiliation(s)
| | - Stefano Fantasia
- Gastroenterology and Endoscopy Unit, University Hospital of Parma, Parma, Italy
| | - Stefano Kayali
- Gastroenterology and Endoscopy Unit, University Hospital of Parma, Parma, Italy
| | - Ulrik Deding
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Department of Surgery, Odense University Hospital, Svendborg, Denmark
| | - Noemi Gualandi
- Gastroenterology and Digestive Endoscopy Unit, AUSL Modena, Carpi, Italy
| | - Mauro Manno
- Gastroenterology and Digestive Endoscopy Unit, AUSL Modena, Carpi, Italy
| | - Ervin Toth
- Department of Gastroenterology, Skåne University Hospital, Lund University, Malmoe, Sweden
| | - Xavier Dray
- Center for Digestive Endoscopy, Saint Antoine Hospital, APHP, Sorbonne Université, Paris, France
- Faculty of Health Sciences, University of Southern Denmark, Odense, Denmark
| | - Shiming Yang
- Department of Gastroenterology, The Second Affiliated Hospital, Third Military Medical University, Chongqing, China
| | - Anastasios Koulaouzidis
- Department of Clinical Research, University of Southern Denmark, Odense, Denmark
- Department of Medicine, Svendborg Sygehus, Svendborg, Denmark
- Surgical Research Unit, Odense University Hospital, Odense, Denmark
- Department of Gastroenterology, Pomeranian Medical University in Szczecin, Szczecin, Poland
| |
Collapse
|
4
|
Houdeville C, Souchaud M, Leenhardt R, Goltstein LC, Velut G, Beaumont H, Dray X, Histace A. Toward automated small bowel capsule endoscopy reporting using a summarizing machine learning algorithm: The SUM UP study. Clin Res Hepatol Gastroenterol 2025; 49:102509. [PMID: 39622290 DOI: 10.1016/j.clinre.2024.102509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/25/2024] [Revised: 11/25/2024] [Accepted: 11/28/2024] [Indexed: 12/11/2024]
Abstract
BACKGROUND AND OBJECTIVES Deep learning (DL) algorithms demonstrate excellent diagnostic performance for the detection of vascular lesions via small bowel (SB) capsule endoscopy (CE), including vascular abnormalities with high (P2), intermediate (P1) or low (P0) bleeding potential, while dramatically decreasing the reading time. We aimed to improve the performance of a DL algorithm by characterizing vascular abnormalities using a machine learning (ML) classifier, and selecting the most relevant images for insertion into reports. MATERIALS AND METHODS A training dataset of 75 SB CE videos was created, containing 401 sequences of interest that encompassed 1,525 images of various vascular lesions. Several image classification algorithms were tested, to discriminate "typical angiodysplasia" (P2/P1) and "other vascular lesion" (P0) and to select the most relevant image within sequences with repetitive images. The performances of the best-fitting algorithms were subsequently assessed on an independent test dataset of 73 full-length SB CE video recordings. RESULTS Following DL detection, a random forest (RF) method demonstrated a specificity of 91.1 %, an area under the receiving operating characteristic curve of 0.873, and an accuracy of 84.2 % for discriminating P2/P1 from P0 lesions while allowing an 83.2 % reduction in the number of reported images. In the independent testing database, after RF was applied, the output number decreased by 91.6 %, from 216 (IQR 108-432) to 12 (IQR 5-33). The RF algorithm achieved 98.0 % agreement with initial, conventional (human) reporting. Following DL detection, the RF method allowed better characterization and accurate selection of images of relevant (P2/P1) SB vascular abnormalities for CE reporting without impairing diagnostic accuracy. These findings pave the way for automated SB CE reporting.
Collapse
Affiliation(s)
- Charles Houdeville
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France; Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France.
| | - Marc Souchaud
- Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France
| | - Romain Leenhardt
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France
| | - Lia Cmj Goltstein
- Department of Gastroenterology and Hepatology, Radboud University Medical Center, Nijmegen, Netherlands
| | - Guillaume Velut
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France; Department of Gastroenterology CHU Nantes, Hotel Dieu, Nantes, France
| | - Hanneke Beaumont
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, Amsterdam, Netherlands
| | - Xavier Dray
- Sorbonne University, Center for Digestive Endoscopy, Saint-Antoine Hospital, APHP, 75012 Paris, France; Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France
| | - Aymeric Histace
- Équipes Traitement de l'Information et Systèmes, ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy, France
| |
Collapse
|
5
|
Chen J, Xia K, Zhang Z, Ding Y, Wang G, Xu X. Establishing an AI model and application for automated capsule endoscopy recognition based on convolutional neural networks (with video). BMC Gastroenterol 2024; 24:394. [PMID: 39501161 PMCID: PMC11539301 DOI: 10.1186/s12876-024-03482-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/11/2024] [Accepted: 10/24/2024] [Indexed: 11/08/2024] Open
Abstract
BACKGROUND Although capsule endoscopy (CE) is a crucial tool for diagnosing small bowel diseases, the need to process a vast number of images imposes a significant workload on physicians, leading to a high risk of missed diagnoses. This study aims to develop an artificial intelligence (AI) model and application based on convolutional neural networks that can automatically recognize various lesions in small bowel capsule endoscopy. METHODS Three small bowel capsule endoscopy datasets were used for AI model training, validation, and testing, encompassing 12 categories of images. The model's performance was evaluated using metrics such as AUC, sensitivity, specificity, precision, accuracy, and F1 score to select the best model. A human-machine comparison experiment was conducted using the best model and endoscopists with varying levels of experience. Model interpretability was analyzed using Grad-CAM and SHAP techniques. Finally, a clinical application was developed based on the best model using PyQt5 technology. RESULTS A total of 34,303 images were included in this study. The best model, MobileNetv3-large, achieved a weighted average sensitivity of 87.17%, specificity of 98.77%, and an AUC of 0.9897 across all categories. The application developed based on this model performed exceptionally well in comparison with endoscopists, achieving an accuracy of 87.17% and a processing speed of 75.04 frames per second, surpassing endoscopists of varying experience levels. CONCLUSION The AI model and application developed based on convolutional neural networks can quickly and accurately identify 12 types of small bowel lesions. With its high sensitivity, this system can effectively assist physicians in interpreting small bowel capsule endoscopy images.Future studies will validate the AI system for video evaluations and real-world clinical integration.
Collapse
Affiliation(s)
- Jian Chen
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, 215500, China
- Changshu Key Laboratory of Medical Artificial Intelligence and Big Data, Changshu City, Suzhou, 215500, China
| | - Kaijian Xia
- Center of Intelligent Medical Technology Research, Changshu Hospital Affiliated to Soochow University, Suzhou, 215500, China
- Changshu Key Laboratory of Medical Artificial Intelligence and Big Data, Changshu City, Suzhou, 215500, China
| | - Zihao Zhang
- Shanghai Haoxiong Education Technology Co., Ltd., Shanghai, 200434, China
| | - Yu Ding
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, 215500, China
| | - Ganhong Wang
- Department of Gastroenterology, Changshu Hospital Affiliated to Nanjing University of Chinese Medicine, Suzhou, 215500, China.
| | - Xiaodan Xu
- Department of Gastroenterology, Changshu Hospital Affiliated to Soochow University, Suzhou, 215500, China.
| |
Collapse
|
6
|
George AA, Tan JL, Kovoor JG, Lee A, Stretton B, Gupta AK, Bacchi S, George B, Singh R. Artificial intelligence in capsule endoscopy: development status and future expectations. MINI-INVASIVE SURGERY 2024. [DOI: 10.20517/2574-1225.2023.102] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/24/2025]
Abstract
In this review, we aim to illustrate the state-of-the-art artificial intelligence (AI) applications in the field of capsule endoscopy. AI has made significant strides in gastrointestinal imaging, particularly in capsule endoscopy - a non-invasive procedure for capturing gastrointestinal tract images. However, manual analysis of capsule endoscopy videos is labour-intensive and error-prone, prompting the development of automated computational algorithms and AI models. While currently serving as a supplementary observer, AI has the capacity to evolve into an autonomous, integrated reading system, potentially significantly reducing capsule reading time while surpassing human accuracy. We searched Embase, Pubmed, Medline, and Cochrane databases from inception to 06 Jul 2023 for studies investigating the use of AI for capsule endoscopy and screened retrieved records for eligibility. Quantitative and qualitative data were extracted and synthesised to identify current themes. In the search, 824 articles were collected, and 291 duplicates and 31 abstracts were deleted. After a double-screening process and full-text review, 106 publications were included in the review. Themes pertaining to AI for capsule endoscopy included active gastrointestinal bleeding, erosions and ulcers, vascular lesions and angiodysplasias, polyps and tumours, inflammatory bowel disease, coeliac disease, hookworms, bowel prep assessment, and multiple lesion detection. This review provides current insights into the impact of AI on capsule endoscopy as of 2023. AI holds the potential for faster and precise readings and the prospect of autonomous image analysis. However, careful consideration of diagnostic requirements and potential challenges is crucial. The untapped potential within vision transformer technology hints at further evolution and even greater patient benefit.
Collapse
|
7
|
Compare D, Sgamato C, Rocco A, Coccoli P, Donnarumma D, Marchitto SA, Cinque S, Palmieri P, Nardone G. The professional background of a referring physician predicts the diagnostic yield of small bowel capsule endoscopy in suspected small bowel bleeding. Endosc Int Open 2024; 12:E282-E290. [PMID: 38455125 PMCID: PMC10919998 DOI: 10.1055/a-2251-3285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/22/2023] [Accepted: 12/22/2023] [Indexed: 03/09/2024] Open
Abstract
Background and study aims The diagnostic yield of small-bowel capsule endoscopy (SBCE) in suspected small bowel bleeding (SSBB) is highly variable. Different reimbursement systems and equipment costs also limit SBCE use in clinical practice. Thus, minimizing non-diagnostic procedures is advisable. This study aimed to assess the SBCE diagnostic yield and identify factors predicting diagnostic findings in a cohort of patients with SSBB. Patients and methods In this retrospective cohort study, we analyzed the medical records of patients who consecutively underwent SBCE for SSBB over 9 years. By logistic regression, we identified covariates predicting diagnostic findings at SBCE. Finally, we performed a post-hoc cost analysis based on previous gastroenterologist or endoscopist consultations versus direct SBCE ordering by other specialists. Results The final analysis included 584 patients. Most SBCEs were ordered by a gastroenterologist or endoscopist (74%). The number of SBCEs without any finding was significantly lower in the gastroenterologist/endoscopist group P <0.001). The SBCE diagnostic yield ordered by a gastroenterologist or endoscopist was significantly higher than that by other specialists (63% vs 52%, odds ratio [OR] 1.57; 95% confidence interval [CI] 1.07-2.26, P =0.019). At multivariate analysis, older age (OR 1.7, 95%CI 1.2-2.4, P =0.005), anemia (OR 4.9, 95%CI 1.9-12, P =0.001), small bowel transit time (OR 1, 95%CI 1-1.02, P =0.039), and referring physician (OR 1.8, 95%CI 1.1-2.7, P =0.003) independently predicted diagnostic findings. Implementing prior gastroenterologist or endoscopist referral vs direct SBCE ordering would reduce medical expenditures by 16%. Conclusions The professional background of referring physicians significantly improves the diagnostic yield of SBCE and contributes to controlling public health costs.
Collapse
Affiliation(s)
- Debora Compare
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Costantino Sgamato
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Alba Rocco
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Pietro Coccoli
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Durante Donnarumma
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Stefano Andrea Marchitto
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Sofia Cinque
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Pietro Palmieri
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| | - Gerardo Nardone
- Gastroenterology Unit, Clinical Medicine and Surgery, University of Naples Federico II, Napoli, Italy
| |
Collapse
|
8
|
Zhang RY, Qiang PP, Cai LJ, Li T, Qin Y, Zhang Y, Zhao YQ, Wang JP. Automatic detection of small bowel lesions with different bleeding risks based on deep learning models. World J Gastroenterol 2024; 30:170-183. [PMID: 38312122 PMCID: PMC10835517 DOI: 10.3748/wjg.v30.i2.170] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 12/15/2023] [Accepted: 12/26/2023] [Indexed: 01/12/2024] Open
Abstract
BACKGROUND Deep learning provides an efficient automatic image recognition method for small bowel (SB) capsule endoscopy (CE) that can assist physicians in diagnosis. However, the existing deep learning models present some unresolved challenges. AIM To propose a novel and effective classification and detection model to automatically identify various SB lesions and their bleeding risks, and label the lesions accurately so as to enhance the diagnostic efficiency of physicians and the ability to identify high-risk bleeding groups. METHODS The proposed model represents a two-stage method that combined image classification with object detection. First, we utilized the improved ResNet-50 classification model to classify endoscopic images into SB lesion images, normal SB mucosa images, and invalid images. Then, the improved YOLO-V5 detection model was utilized to detect the type of lesion and its risk of bleeding, and the location of the lesion was marked. We constructed training and testing sets and compared model-assisted reading with physician reading. RESULTS The accuracy of the model constructed in this study reached 98.96%, which was higher than the accuracy of other systems using only a single module. The sensitivity, specificity, and accuracy of the model-assisted reading detection of all images were 99.17%, 99.92%, and 99.86%, which were significantly higher than those of the endoscopists' diagnoses. The image processing time of the model was 48 ms/image, and the image processing time of the physicians was 0.40 ± 0.24 s/image (P < 0.001). CONCLUSION The deep learning model of image classification combined with object detection exhibits a satisfactory diagnostic effect on a variety of SB lesions and their bleeding risks in CE images, which enhances the diagnostic efficiency of physicians and improves the ability of physicians to identify high-risk bleeding groups.
Collapse
Affiliation(s)
- Rui-Ya Zhang
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Peng-Peng Qiang
- School of Computer and Information Technology, Shanxi University, Taiyuan 030006, Shanxi Province, China
| | - Ling-Jun Cai
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Tao Li
- School of Life Sciences and Technology, Mudanjiang Normal University, Mudanjiang 157011, Heilongjiang Province, China
| | - Yan Qin
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Yu Zhang
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Yi-Qing Zhao
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| | - Jun-Ping Wang
- Department of Gastroenterology, The Fifth Clinical Medical College of Shanxi Medical University, Taiyuan 030012, Shanxi Province, China
| |
Collapse
|
9
|
Fantasia S, Cortegoso Valdivia P, Kayali S, Koulaouzidis G, Pennazio M, Koulaouzidis A. The Role of Capsule Endoscopy in the Diagnosis and Management of Small Bowel Tumors: A Narrative Review. Cancers (Basel) 2024; 16:262. [PMID: 38254753 PMCID: PMC10813471 DOI: 10.3390/cancers16020262] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Revised: 12/21/2023] [Accepted: 12/30/2023] [Indexed: 01/24/2024] Open
Abstract
Small bowel tumors (SBT) are relatively rare, but have had a steadily increasing incidence in the last few decades. Small bowel capsule endoscopy (SBCE) and device-assisted enteroscopy are the main endoscopic techniques for the study of the small bowel, the latter additionally providing sampling and therapeutic options, and hence acting complementary to SBCE in the diagnostic work-up. Although a single diagnostic modality is often insufficient in the setting of SBTs, SBCE is a fundamental tool to drive further management towards a definitive diagnosis. The aim of this paper is to provide a concise narrative review of the role of SBCE in the diagnosis and management of SBTs.
Collapse
Affiliation(s)
- Stefano Fantasia
- Gastroenterology and Endoscopy Unit, University Hospital of Parma, University of Parma, 43126 Parma, Italy; (S.F.); (S.K.)
- Department of Medicine and Surgery, University of Parma, 43125 Parma, Italy
| | - Pablo Cortegoso Valdivia
- Gastroenterology and Endoscopy Unit, University Hospital of Parma, University of Parma, 43126 Parma, Italy; (S.F.); (S.K.)
| | - Stefano Kayali
- Gastroenterology and Endoscopy Unit, University Hospital of Parma, University of Parma, 43126 Parma, Italy; (S.F.); (S.K.)
- Department of Medicine and Surgery, University of Parma, 43125 Parma, Italy
| | - George Koulaouzidis
- Department of Biochemical Sciences, Pomeranian Medical University, 70204 Szczecin, Poland;
| | - Marco Pennazio
- University Division of Gastroenterology, City of Health and Science University Hospital, University of Turin, 10126 Turin, Italy;
| | - Anastasios Koulaouzidis
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark;
- Department of Gastroenterology, OUH Svendborg Sygehus, 5700 Svendborg, Denmark
- Surgical Research Unit, Odense University Hospital, 5000 Odense, Denmark
- Department of Social Medicine and Public Health, Pomeranian Medical University, 70204 Szczecin, Poland
| |
Collapse
|
10
|
Wang X, Hu X, Xu Y, Yong J, Li X, Zhang K, Gan T, Yang J, Rao N. A systematic review on diagnosis and treatment of gastrointestinal diseases by magnetically controlled capsule endoscopy and artificial intelligence. Therap Adv Gastroenterol 2023; 16:17562848231206991. [PMID: 37900007 PMCID: PMC10612444 DOI: 10.1177/17562848231206991] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/10/2023] [Accepted: 09/21/2023] [Indexed: 10/31/2023] Open
Abstract
Background Magnetically controlled capsule endoscopy (MCCE) is a non-invasive, painless, comfortable, and safe equipment to diagnose gastrointestinal diseases (GID), partially overcoming the shortcomings of conventional endoscopy and wireless capsule endoscopy (WCE). With advancements in technology, the main technical parameters of MCCE have continuously been improved, and MCCE has become more intelligent. Objectives The aim of this systematic review was to summarize the research progress of MCCE and artificial intelligence (AI) in the diagnosis and treatment of GID. Data Sources and Methods We conducted a systematic search of PubMed and EMBASE for published studies on GID detection of MCCE, physical factors related to MCCE imaging quality, the application of AI in aiding MCCE, and its additional functions. We synergistically reviewed the included studies, extracted relevant data, and made comparisons. Results MCCE was confirmed to have the same performance as conventional gastroscopy and WCE in detecting common GID, while it lacks research in detecting early gastric cancer (EGC). The body position and cleanliness of the gastrointestinal tract are the main factors affecting imaging quality. The applications of AI in screening intestinal diseases have been comprehensive, while in the detection of common gastric diseases such as ulcers, it has been developed. MCCE can perform some additional functions, such as observations of drug behavior in the stomach and drug damage to the gastric mucosa. Furthermore, it can be improved to perform a biopsy. Conclusion This comprehensive review showed that the MCCE technology has made great progress, but studies on GID detection and treatment by MCCE are in the primary stage. Further studies are required to confirm the performance of MCCE.
Collapse
Affiliation(s)
- Xiaotong Wang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiaoming Hu
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Yongxue Xu
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Jiahao Yong
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Xiang Li
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Kaixuan Zhang
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China
| | - Tao Gan
- Digestive Endoscopic Center of West China Hospital, Sichuan University, Chengdu, China
| | - Jinlin Yang
- Digestive Endoscopic Center of West China Hospital, Sichuan University, No.37 Guoxue Alley, Wuhou District, Chengdu City, Chengdu, Sichuan Province 610017, China
| | - Nini Rao
- School of Life Science and Technology, University of Electronic Science and Technology of China, No. 4, Section Two, Jianshe North Road, Chengdu 610054, China
| |
Collapse
|
11
|
O'Hara FJ, Mc Namara D. Capsule endoscopy with artificial intelligence-assisted technology: Real-world usage of a validated AI model for capsule image review. Endosc Int Open 2023; 11:E970-E975. [PMID: 37828977 PMCID: PMC10567136 DOI: 10.1055/a-2161-1816] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 08/25/2023] [Indexed: 10/14/2023] Open
Abstract
Background and study aims Capsule endoscopy is a time-consuming procedure with a significance error rate. Artificial intelligence (AI) can potentially reduce reading time significantly by reducing the number of images that need human review. An OMOM Artificial Intelligence-enabled small bowel capsule has been recently trained and validated for small bowel capsule endoscopy video review. This study aimed to assess its performance in a real-world setting in comparison with standard reading methods. Patients and methods In this single-center retrospective study, 40 patient studies performed using the OMOM capsule were analyzed first with standard reading methods and later using AI-assisted reading. Reading time, pathology identified, intestinal landmark identification and bowel preparation assessment (Brotz Score) were compared. Results Overall diagnosis correlated 100% between the two reading methods. In a per-lesion analysis, 1293 images of significant lesions were identified combining standard and AI-assisted reading methods. AI-assisted reading captured 1268 (98.1%, 95% CI 97.15-98.7) of these findings while standard reading mode captured 1114 (86.2%, 95% confidence interval 84.2-87.9), P < 0.001. Mean reading time went from 29.7 minutes with standard reading to 2.3 minutes with AI-assisted reading ( P < 0.001), for an average time saving of 27.4 minutes per study. Time of first cecal image showed a wide discrepancy between AI and standard reading of 99.2 minutes (r = 0.085, P = 0.68). Bowel cleansing evaluation agreed in 97.4% (r = 0.805 P < 0.001). Conclusions AI-assisted reading has shown significant time savings without reducing sensitivity in this study. Limitations remain in the evaluation of other indicators.
Collapse
Affiliation(s)
- Fintan John O'Hara
- Gastroenterology, Tallaght University Hospital, Dublin, Ireland
- Medicine, Trinity College Dublin School of Medicine, Dublin, Ireland
| | - Deirdre Mc Namara
- Gastroenterology, Tallaght University Hospital, Dublin, Ireland
- Medicine, Trinity College Dublin School of Medicine, Dublin, Ireland
| |
Collapse
|
12
|
Ribeiro T, Mascarenhas Saraiva MJ, Afonso J, Cardoso P, Mendes F, Martins M, Andrade AP, Cardoso H, Mascarenhas Saraiva M, Ferreira J, Macedo G. Design of a Convolutional Neural Network as a Deep Learning Tool for the Automatic Classification of Small-Bowel Cleansing in Capsule Endoscopy. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:medicina59040810. [PMID: 37109768 PMCID: PMC10145655 DOI: 10.3390/medicina59040810] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/05/2023] [Revised: 04/03/2023] [Accepted: 04/06/2023] [Indexed: 04/29/2023]
Abstract
Background and objectives: Capsule endoscopy (CE) is a non-invasive method to inspect the small bowel that, like other enteroscopy methods, requires adequate small-bowel cleansing to obtain conclusive results. Artificial intelligence (AI) algorithms have been seen to offer important benefits in the field of medical imaging over recent years, particularly through the adaptation of convolutional neural networks (CNNs) to achieve more efficient image analysis. Here, we aimed to develop a deep learning model that uses a CNN to automatically classify the quality of intestinal preparation in CE. Methods: A CNN was designed based on 12,950 CE images obtained at two clinical centers in Porto (Portugal). The quality of the intestinal preparation was classified for each image as: excellent, ≥90% of the image surface with visible mucosa; satisfactory, 50-90% of the mucosa visible; and unsatisfactory, <50% of the mucosa visible. The total set of images was divided in an 80:20 ratio to establish training and validation datasets, respectively. The CNN prediction was compared with the classification established by consensus of a group of three experts in CE, currently considered the gold standard to evaluate cleanliness. Subsequently, how the CNN performed in diagnostic terms was evaluated using an independent validation dataset. Results: Among the images obtained, 3633 were designated as unsatisfactory preparation, 6005 satisfactory preparation, and 3312 with excellent preparation. When differentiating the classes of small-bowel preparation, the algorithm developed here achieved an overall accuracy of 92.1%, with a sensitivity of 88.4%, a specificity of 93.6%, a positive predictive value of 88.5%, and a negative predictive value of 93.4%. The area under the curve for the detection of excellent, satisfactory, and unsatisfactory classes was 0.98, 0.95, and 0.99, respectively. Conclusions: A CNN-based tool was developed to automatically classify small-bowel preparation for CE, and it was seen to accurately classify intestinal preparation for CE. The development of such a system could enhance the reproducibility of the scales used for such purposes.
Collapse
Affiliation(s)
- Tiago Ribeiro
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Miguel José Mascarenhas Saraiva
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| | - João Afonso
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Pedro Cardoso
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Francisco Mendes
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Miguel Martins
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
| | - Ana Patrícia Andrade
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| | - Hélder Cardoso
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| | | | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering, University of Porto, Rua Dr. Roberto Frias, 4200-465 Porto, Portugal
- INEGI-Institute of Science and Innovation in Mechanical and Industrial Engineering, 4200-465 Porto, Portugal
| | - Guilherme Macedo
- Department of Gasteroenterology, São João University Hospital, Alameda Professor Hernâni Monteiro, 4200-427 Porto, Portugal
- Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, 4050-345 Porto, Portugal
- Faculty of Medicine, University of Porto, 4200-319 Porto, Portugal
| |
Collapse
|
13
|
Mascarenhas M, Afonso J, Ribeiro T, Andrade P, Cardoso H, Macedo G. The Promise of Artificial Intelligence in Digestive Healthcare and the Bioethics Challenges It Presents. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:medicina59040790. [PMID: 37109748 PMCID: PMC10145124 DOI: 10.3390/medicina59040790] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/19/2023] [Revised: 03/27/2023] [Accepted: 04/02/2023] [Indexed: 04/29/2023]
Abstract
With modern society well entrenched in the digital area, the use of Artificial Intelligence (AI) to extract useful information from big data has become more commonplace in our daily lives than we perhaps realize. Medical specialties that rely heavily on imaging techniques have become a strong focus for the incorporation of AI tools to aid disease diagnosis and monitoring, yet AI-based tools that can be employed in the clinic are only now beginning to become a reality. However, the potential introduction of these applications raises a number of ethical issues that must be addressed before they can be implemented, among the most important of which are issues related to privacy, data protection, data bias, explainability and responsibility. In this short review, we aim to highlight some of the most important bioethical issues that will have to be addressed if AI solutions are to be successfully incorporated into healthcare protocols, and ideally, before they are put in place. In particular, we contemplate the use of these aids in the field of gastroenterology, focusing particularly on capsule endoscopy and highlighting efforts aimed at resolving the issues associated with their use when available.
Collapse
Affiliation(s)
- Miguel Mascarenhas
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - João Afonso
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Tiago Ribeiro
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Patrícia Andrade
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Hélder Cardoso
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| | - Guilherme Macedo
- Faculty of Medicine, University of Porto, 4200-437 Porto, Portugal
- Precision Medicine Unit, Department of Gastroenterology, Hospital São João, 4200-437 Porto, Portugal
- WGO Training Center, 4200-437 Porto, Portugal
| |
Collapse
|
14
|
Nakada A, Niikura R, Otani K, Kurose Y, Hayashi Y, Kitamura K, Nakanishi H, Kawano S, Honda T, Hasatani K, Sumiyoshi T, Nishida T, Yamada A, Aoki T, Harada T, Kawai T, Fujishiro M. Improved Object Detection Artificial Intelligence Using the Revised RetinaNet Model for the Automatic Detection of Ulcerations, Vascular Lesions, and Tumors in Wireless Capsule Endoscopy. Biomedicines 2023; 11:942. [PMID: 36979921 PMCID: PMC10046454 DOI: 10.3390/biomedicines11030942] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2023] [Revised: 02/10/2023] [Accepted: 03/15/2023] [Indexed: 03/30/2023] Open
Abstract
The use of computer-aided detection models to diagnose lesions in images from wireless capsule endoscopy (WCE) is a topical endoscopic diagnostic solution. We revised our artificial intelligence (AI) model, RetinaNet, to better diagnose multiple types of lesions, including erosions and ulcers, vascular lesions, and tumors. RetinaNet was trained using the data of 1234 patients, consisting of images of 6476 erosions and ulcers, 1916 vascular lesions, 7127 tumors, and 14,014,149 normal tissues. The mean area under the receiver operating characteristic curve (AUC), sensitivity, and specificity for each lesion were evaluated using five-fold stratified cross-validation. Each cross-validation set consisted of between 6,647,148 and 7,267,813 images from 217 patients. The mean AUC values were 0.997 for erosions and ulcers, 0.998 for vascular lesions, and 0.998 for tumors. The mean sensitivities were 0.919, 0.878, and 0.876, respectively. The mean specificities were 0.936, 0.969, and 0.937, and the mean accuracies were 0.930, 0.962, and 0.924, respectively. We developed a new version of an AI-based diagnostic model for the multiclass identification of small bowel lesions in WCE images to help endoscopists appropriately diagnose small intestine diseases in daily clinical practice.
Collapse
Affiliation(s)
- Ayako Nakada
- Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo 1138655, Japan
| | - Ryota Niikura
- Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo 1138655, Japan
- Department of Gastroenterological Endoscopy, Tokyo Medical University Hospital, Tokyo 1600023, Japan
| | - Keita Otani
- Research Center for Advanced Science and Technology, The University of Tokyo, Tokyo 1538904, Japan
| | - Yusuke Kurose
- Research Center for Advanced Science and Technology, The University of Tokyo, Tokyo 1538904, Japan
| | - Yoshito Hayashi
- Department of Gastroenterology and Hepatology, Osaka University Graduate School of Medicine, Osaka 5650871, Japan
| | - Kazuya Kitamura
- Department of Gastroenterology, Kanazawa University Hospital, 9208641 Kanazawa, Japan
| | - Hiroyoshi Nakanishi
- Department of Gastroenterology, Ishikawa Prefectural Central Hospital, Ishikawa 9208530, Japan
| | - Seiji Kawano
- Department of Gastroenterology and Hepatology, Okayama University Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, Okayama 7008558, Japan
| | - Testuya Honda
- Department of Gastroenterology, Nagasaki Harbor Medical Center, 8508555 Nagasaki, Japan
| | - Kenkei Hasatani
- Department of Gastroenterology, Fukui Prefectural Hospital, Fukui 9108526, Japan
| | - Tetsuya Sumiyoshi
- The Center for Digestive Disease, Tonan Hospital, Sapporo 0600004, Japan
| | - Tsutomu Nishida
- Department of Gastroenterology, Toyonaka Municipal Hospital, 5608565 Toyonaka, Japan
| | - Atsuo Yamada
- Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo 1138655, Japan
| | - Tomonori Aoki
- Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo 1138655, Japan
| | - Tatsuya Harada
- Research Center for Advanced Science and Technology, The University of Tokyo, Tokyo 1538904, Japan
| | - Takashi Kawai
- Department of Gastroenterological Endoscopy, Tokyo Medical University Hospital, Tokyo 1600023, Japan
| | - Mitsuhiro Fujishiro
- Department of Gastroenterology, Graduate School of Medicine, The University of Tokyo, Tokyo 1138655, Japan
| |
Collapse
|
15
|
Clinicians’ Guide to Artificial Intelligence in Colon Capsule Endoscopy—Technology Made Simple. Diagnostics (Basel) 2023; 13:diagnostics13061038. [PMID: 36980347 PMCID: PMC10047552 DOI: 10.3390/diagnostics13061038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2022] [Revised: 02/07/2023] [Accepted: 02/21/2023] [Indexed: 03/12/2023] Open
Abstract
Artificial intelligence (AI) applications have become widely popular across the healthcare ecosystem. Colon capsule endoscopy (CCE) was adopted in the NHS England pilot project following the recent COVID pandemic’s impact. It demonstrated its capability to relieve the national backlog in endoscopy. As a result, AI-assisted colon capsule video analysis has become gastroenterology’s most active research area. However, with rapid AI advances, mastering these complex machine learning concepts remains challenging for healthcare professionals. This forms a barrier for clinicians to take on this new technology and embrace the new era of big data. This paper aims to bridge the knowledge gap between the current CCE system and the future, fully integrated AI system. The primary focus is on simplifying the technical terms and concepts in machine learning. This will hopefully address the general “fear of the unknown in AI” by helping healthcare professionals understand the basic principle of machine learning in capsule endoscopy and apply this knowledge in their future interactions and adaptation to AI technology. It also summarises the evidence of AI in CCE and its impact on diagnostic pathways. Finally, it discusses the unintended consequences of using AI, ethical challenges, potential flaws, and bias within clinical settings.
Collapse
|
16
|
Cortegoso Valdivia P, Pennazio M. Wireless capsule endoscopy: concept and modalities. ARTIFICIAL INTELLIGENCE IN CAPSULE ENDOSCOPY 2023:11-20. [DOI: 10.1016/b978-0-323-99647-1.00008-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/05/2025]
|
17
|
Cortegoso Valdivia P, Deding U, Bjørsum-Meyer T, Baatrup G, Fernández-Urién I, Dray X, Boal-Carvalho P, Ellul P, Toth E, Rondonotti E, Kaalby L, Pennazio M, Koulaouzidis A. Inter/Intra-Observer Agreement in Video-Capsule Endoscopy: Are We Getting It All Wrong? A Systematic Review and Meta-Analysis. Diagnostics (Basel) 2022; 12:2400. [PMID: 36292089 PMCID: PMC9600122 DOI: 10.3390/diagnostics12102400] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2022] [Revised: 09/28/2022] [Accepted: 09/29/2022] [Indexed: 12/09/2022] Open
Abstract
Video-capsule endoscopy (VCE) reading is a time- and energy-consuming task. Agreement on findings between readers (either different or the same) is a crucial point for increasing performance and providing valid reports. The aim of this systematic review with meta-analysis is to provide an evaluation of inter/intra-observer agreement in VCE reading. A systematic literature search in PubMed, Embase and Web of Science was performed throughout September 2022. The degree of observer agreement, expressed with different test statistics, was extracted. As different statistics are not directly comparable, our analyses were stratified by type of test statistics, dividing them in groups of "None/Poor/Minimal", "Moderate/Weak/Fair", "Good/Excellent/Strong" and "Perfect/Almost perfect" to report the proportions of each. In total, 60 studies were included in the analysis, with a total of 579 comparisons. The quality of included studies, assessed with the MINORS score, was sufficient in 52/60 studies. The most common test statistics were the Kappa statistics for categorical outcomes (424 comparisons) and the intra-class correlation coefficient (ICC) for continuous outcomes (73 comparisons). In the overall comparison of inter-observer agreement, only 23% were evaluated as "good" or "perfect"; for intra-observer agreement, this was the case in 36%. Sources of heterogeneity (high, I2 81.8-98.1%) were investigated with meta-regressions, showing a possible role of country, capsule type and year of publication in Kappa inter-observer agreement. VCE reading suffers from substantial heterogeneity and sub-optimal agreement in both inter- and intra-observer evaluation. Artificial-intelligence-based tools and the adoption of a unified terminology may progressively enhance levels of agreement in VCE reading.
Collapse
Affiliation(s)
- Pablo Cortegoso Valdivia
- Gastroenterology and Endoscopy Unit, University Hospital of Parma, University of Parma, 43126 Parma, Italy
| | - Ulrik Deding
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | - Thomas Bjørsum-Meyer
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | - Gunnar Baatrup
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | | | - Xavier Dray
- Center for Digestive Endoscopy, Sorbonne University, Saint Antoine Hospital, APHP, 75012 Paris, France
| | - Pedro Boal-Carvalho
- Gastroenterology Department, Hospital da Senhora da Oliveira, Creixomil, 4835 Guimarães, Portugal
| | - Pierre Ellul
- Division of Gastroenterology, Mater Dei Hospital, 2090 Msida, Malta
| | - Ervin Toth
- Department of Gastroenterology, Skåne University Hospital, Lund University, 20502 Malmö, Sweden
| | | | - Lasse Kaalby
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Surgery, Odense University Hospital, 5000 Odense, Denmark
| | - Marco Pennazio
- University Division of Gastroenterology, City of Health and Science University Hospital, University of Turin, 10126 Turin, Italy
| | - Anastasios Koulaouzidis
- Department of Clinical Research, University of Southern Denmark, 5230 Odense, Denmark
- Department of Medicine, OUH Svendborg Sygehus, 5700 Svendborg, Denmark
- Surgical Research Unit, OUH, 5000 Odense, Denmark
- Department of Social Medicine and Public Health, Pomeranian Medical University, 70-204 Szczecin, Poland
| |
Collapse
|
18
|
Son G, Eo T, An J, Oh DJ, Shin Y, Rha H, Kim YJ, Lim YJ, Hwang D. Small Bowel Detection for Wireless Capsule Endoscopy Using Convolutional Neural Networks with Temporal Filtering. Diagnostics (Basel) 2022; 12:diagnostics12081858. [PMID: 36010210 PMCID: PMC9406835 DOI: 10.3390/diagnostics12081858] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Revised: 07/28/2022] [Accepted: 07/28/2022] [Indexed: 12/22/2022] Open
Abstract
By automatically classifying the stomach, small bowel, and colon, the reading time of the wireless capsule endoscopy (WCE) can be reduced. In addition, it is an essential first preprocessing step to localize the small bowel in order to apply automated small bowel lesion detection algorithms based on deep learning. The purpose of the study was to develop an automated small bowel detection method from long untrimmed videos captured from WCE. Through this, the stomach and colon can also be distinguished. The proposed method is based on a convolutional neural network (CNN) with a temporal filtering on the predicted probabilities from the CNN. For CNN, we use a ResNet50 model to classify three organs including stomach, small bowel, and colon. The hybrid temporal filter consisting of a Savitzky–Golay filter and a median filter is applied to the temporal probabilities for the “small bowel” class. After filtering, the small bowel and the other two organs are differentiated with thresholding. The study was conducted on dataset of 200 patients (100 normal and 100 abnormal WCE cases), which was divided into a training set of 140 cases, a validation set of 20 cases, and a test set of 40 cases. For the test set of 40 patients (20 normal and 20 abnormal WCE cases), the proposed method showed accuracy of 99.8% in binary classification for the small bowel. Transition time errors for gastrointestinal tracts were only 38.8 ± 25.8 seconds for the transition between stomach and small bowel and 32.0 ± 19.1 seconds for the transition between small bowel and colon, compared to the ground truth organ transition points marked by two experienced gastroenterologists.
Collapse
Affiliation(s)
- Geonhui Son
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea; (G.S.); (T.E.); (J.A.); (Y.S.); (H.R.)
| | - Taejoon Eo
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea; (G.S.); (T.E.); (J.A.); (Y.S.); (H.R.)
| | - Jiwoong An
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea; (G.S.); (T.E.); (J.A.); (Y.S.); (H.R.)
| | - Dong Jun Oh
- Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Korea;
| | - Yejee Shin
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea; (G.S.); (T.E.); (J.A.); (Y.S.); (H.R.)
| | - Hyenogseop Rha
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea; (G.S.); (T.E.); (J.A.); (Y.S.); (H.R.)
| | - You Jin Kim
- IntroMedic, Capsule Endoscopy Medical Device Manufacturer, Seoul 08375, Korea;
| | - Yun Jeong Lim
- Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of Medicine, Goyang 10326, Korea;
- Correspondence: (Y.J.L.); (D.H.)
| | - Dosik Hwang
- School of Electrical and Electronic Engineering, Yonsei University, Seoul 03722, Korea; (G.S.); (T.E.); (J.A.); (Y.S.); (H.R.)
- Center for Healthcare Robotics, Korea Institute of Science and Technology, 5, Hwarang-ro 14-gil, Seongbuk-gu, Seoul 02792, Korea
- Department of Oral and Maxillofacial Radiology, Yonsei University College of Dentistry, Seoul 03722, Korea
- Department of Radiology and Center for Clinical Imaging Data Science (CCIDS), Yonsei University College of Medicine, Seoul 03722, Korea
- Correspondence: (Y.J.L.); (D.H.)
| |
Collapse
|
19
|
Piccirelli S, Mussetto A, Bellumat A, Cannizzaro R, Pennazio M, Pezzoli A, Bizzotto A, Fusetti N, Valiante F, Hassan C, Pecere S, Koulaouzidis A, Spada C. New Generation Express View: An Artificial Intelligence Software Effectively Reduces Capsule Endoscopy Reading Times. Diagnostics (Basel) 2022; 12:diagnostics12081783. [PMID: 35892494 PMCID: PMC9332221 DOI: 10.3390/diagnostics12081783] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2022] [Revised: 07/15/2022] [Accepted: 07/21/2022] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND: Reading capsule endoscopy (CE) is time-consuming. The Express View (EV) (IntroMedic, Seoul, Korea) software was designed to shorten CE video reading. Our primary aim was to evaluate the diagnostic accuracy of EV in detecting significant small-bowel (SB) lesions. We also compared the reading times with EV mode and standard reading (SR). METHODS: 126 patients with suspected SB bleeding and/or suspected neoplasia were prospectively enrolled and underwent SB CE (MiroCam®1200, IntroMedic, Seoul, Korea). CE evaluation was performed in standard and EV mode. In case of discrepancies between SR and EV readings, a consensus was reached after reviewing the video segments and the findings were re-classified. RESULTS: The completion rate of SB CE in our cohort was 86.5% and no retention occurred. The per-patient analysis of sensitivity, specificity, positive predictive value, negative predictive value, and diagnostic accuracy of EV compared to SR were 86%, 86%, 90%, 81%, and 86%, respectively, before consensus. After consensus, they increased to 97%, 100%, 100%, 96%, and 98%, respectively. The median reading time with SR and EV was 71 min (range 26−340) and 13 min (range 3−85), respectively (p < 0.001). CONCLUSIONS: The new-generation EV shows high diagnostic accuracy and significantly reduces CE reading times.
Collapse
Affiliation(s)
- Stefania Piccirelli
- Fondazione Poliambulanza Istituto Ospedaliero, 25124 Brescia, Italy; (S.P.); (A.B.); (C.S.)
- Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| | | | | | | | - Marco Pennazio
- Division of Gastroenterology, University City of Health and Science University Hospital, 10121 Turin, Italy;
| | - Alessandro Pezzoli
- Endoscopy Unit, Department of Gastroenterology, Sant’Anna University Hospital, 44121 Ferrara, Italy; (A.P.); (N.F.)
| | - Alessandra Bizzotto
- Fondazione Poliambulanza Istituto Ospedaliero, 25124 Brescia, Italy; (S.P.); (A.B.); (C.S.)
| | - Nadia Fusetti
- Endoscopy Unit, Department of Gastroenterology, Sant’Anna University Hospital, 44121 Ferrara, Italy; (A.P.); (N.F.)
| | | | - Cesare Hassan
- Endoscopy Unit, Department of Gastroenterology, IRCCS Humanitas Research Hospital, 20089 Rozzano, Italy;
| | - Silvia Pecere
- Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
- Digestive Endoscopy Unit, Fondazione Policlinico Universitario A. Gemelli IRCCS, 00168 Rome, Italy
- Correspondence:
| | - Anastasios Koulaouzidis
- Department of Medicine, Odense University Hospital Svendborg Sygehus, 5700 Svendborg, Denmark;
- Department of Clinical Research, University of Southern Denmark (SDU), 5230 Odense, Denmark
- Surgical Research Unit, Odense University Hospital, 5000 Odense, Denmark
- Department of Social Medicine and Public Health, Pomeranian Medical University, 70-204 Szczecin, Poland
| | - Cristiano Spada
- Fondazione Poliambulanza Istituto Ospedaliero, 25124 Brescia, Italy; (S.P.); (A.B.); (C.S.)
- Fondazione Policlinico Universitario A. Gemelli IRCCS, Università Cattolica del Sacro Cuore, 00168 Rome, Italy
| |
Collapse
|
20
|
Alemanni LV, Fabbri S, Rondonotti E, Mussetto A. Recent developments in small bowel endoscopy: the "black box" is now open! Clin Endosc 2022; 55:473-479. [PMID: 35831981 PMCID: PMC9329645 DOI: 10.5946/ce.2022.113] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 04/28/2022] [Accepted: 05/11/2022] [Indexed: 12/09/2022] Open
Abstract
Over the last few years, capsule endoscopy has been established as a fundamental device in the practicing gastroenterologist's toolbox. Its utilization in diagnostic algorithms for suspected small bowel bleeding, Crohn's disease, and small bowel tumors has been approved by several guidelines. The advent of double-balloon enteroscopy has significantly increased the therapeutic possibilities and release of multiple devices (single-balloon enteroscopy and spiral enteroscopy) aimed at improving the performance of small bowel enteroscopy. Recently, some important innovations have appeared in the small bowel endoscopy scene, providing further improvement to its evolution. Artificial intelligence in capsule endoscopy should increase diagnostic accuracy and reading efficiency, and the introduction of motorized spiral enteroscopy into clinical practice could also improve the therapeutic yield. This review focuses on the most recent studies on artificial-intelligence-assisted capsule endoscopy and motorized spiral enteroscopy.
Collapse
Affiliation(s)
- Luigina Vanessa Alemanni
- Gastroenterology Unit, Santa Maria delle Croci Hospital, Ravenna, Italy
- Department of Medical and Surgical Sciences, S. Orsola-Malpighi Hospital, Bologna, Italy
| | - Stefano Fabbri
- Gastroenterology Unit, Santa Maria delle Croci Hospital, Ravenna, Italy
- Department of Medical and Surgical Sciences, S. Orsola-Malpighi Hospital, Bologna, Italy
| | | | | |
Collapse
|
21
|
Chetcuti Zammit S, Sidhu R. Artificial intelligence within the small bowel: are we lagging behind? Curr Opin Gastroenterol 2022; 38:307-317. [PMID: 35645023 DOI: 10.1097/mog.0000000000000827] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
PURPOSE OF REVIEW The use of artificial intelligence in small bowel capsule endoscopy is expanding. This review focusses on the use of artificial intelligence for small bowel pathology compared with human data and developments to date. RECENT FINDINGS The diagnosis and management of small bowel disease has been revolutionized with the advent of capsule endoscopy. Reading of capsule endoscopy videos however is time consuming with an average reading time of 40 min. Furthermore, the fatigued human eye may miss subtle lesions including indiscreet mucosal bulges. In recent years, artificial intelligence has made significant progress in the field of medicine including gastroenterology. Machine learning has enabled feature extraction and in combination with deep neural networks, image classification has now materialized for routine endoscopy for the clinician. SUMMARY Artificial intelligence is in built within the Navicam-Ankon capsule endoscopy reading system. This development will no doubt expand to other capsule endoscopy platforms and capsule endoscopies that are used to visualize other parts of the gastrointestinal tract as a standard. This wireless and patient friendly technique combined with rapid reading platforms with the help of artificial intelligence will become an attractive and viable choice to alter how patients are investigated in the future.
Collapse
Affiliation(s)
| | - Reena Sidhu
- Academic Department of Gastroenterology, Royal Hallamshire Hospital
- Academic Unit of Gastroenterology, Department of Infection, Immunity and Cardiovascular Disease, University of Sheffield, Sheffield, United Kingdom
| |
Collapse
|
22
|
Koulaouzidis A, Bjørsum-Meyer T, Toth E. Real-life practice data on colon capsule endoscopy: We need them fast! Endosc Int Open 2022; 10:E230-E231. [PMID: 35295244 PMCID: PMC8920598 DOI: 10.1055/a-1728-9371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
Affiliation(s)
- Anastasios Koulaouzidis
- Department of Medicine, OUH Svendborg, Sygehus, Denmark,Department of Clinical Research, University, of Southern Denmark (SDU), Denmark,Department of Social Medicine & Public Health, Pomeranian Medical University, Poland
| | | | - Ervin Toth
- Department of Gastroenterology, Skåne University Hospital, Malmö, Lund University, Sweden
| |
Collapse
|
23
|
Leenhardt R, Fernandez-Urien Sainz I, Rondonotti E, Toth E, Van de Bruaene C, Baltes P, Rosa BJ, Triantafyllou K, Histace A, Koulaouzidis A, Dray X, on behalf of the I-CARE Group. PEACE: Perception and Expectations toward Artificial Intelligence in Capsule Endoscopy. J Clin Med 2021; 10:5708. [PMID: 34884410 PMCID: PMC8658716 DOI: 10.3390/jcm10235708] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2021] [Revised: 11/22/2021] [Accepted: 11/22/2021] [Indexed: 12/16/2022] Open
Abstract
Artificial intelligence (AI) has shown promising results in digestive endoscopy, especially in capsule endoscopy (CE). However, some physicians still have some difficulties and fear the advent of this technology. We aimed to evaluate the perceptions and current sentiments toward the use of AI in CE. An online survey questionnaire was sent to an audience of gastroenterologists. In addition, several European national leaders of the International CApsule endoscopy REsearch (I CARE) Group were asked to disseminate an online survey among their national communities of CE readers (CER). The survey included 32 questions regarding general information, perceptions of AI, and its use in daily life, medicine, endoscopy, and CE. Among 380 European gastroenterologists who answered this survey, 333 (88%) were CERs. The mean average time length of experience in CE reading was 9.9 years (0.5-22). A majority of CERs agreed that AI would positively impact CE, shorten CE reading time, and help standardize reporting in CE and characterize lesions seen in CE. Nevertheless, in the foreseeable future, a majority of CERs disagreed with the complete replacement all CE reading by AI. Most CERs believed in the high potential of AI for becoming a valuable tool for automated diagnosis and for shortening the reading time. Currently, the perception is that AI will not replace CE reading.
Collapse
Affiliation(s)
- Romain Leenhardt
- Endoscopy Unit, Saint Antoine Hospital, Sorbonne University, APHP, 75012 Paris, France;
- ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy-Pontoise, France;
| | | | | | - Ervin Toth
- Department of Gastroenterology, Skane University Hospital, Lund University, 214 28 Malmo, Sweden;
| | | | - Peter Baltes
- Klinik für Innere Medizin, Agaplesion Bethesda Krankenhaus Bergedorf, 21029 Hamburg, Germany;
| | - Bruno Joel Rosa
- Department of Gastroenterology, Hospital da Senhora da Oliveira, 4835-044 Guimarães, Portugal;
- Life and Health Sciences Research Institute, School of Medicine, University of Minho, 4704-553 Braga, Portugal
| | - Konstantinos Triantafyllou
- Hepatogastroenterology Unit, Second Department of Internal Propaedeutic Medicine, Attikon University General Hospital, Medical School, National and Kapodistrian University of Athens, 10679 Athens, Greece;
| | - Aymeric Histace
- ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy-Pontoise, France;
| | - Anastasios Koulaouzidis
- Department of Social Medicine & Public Health, Faculty of Health Sciences, Pomeranian Medical University, 70-204 Szczecin, Poland;
| | - Xavier Dray
- Endoscopy Unit, Saint Antoine Hospital, Sorbonne University, APHP, 75012 Paris, France;
- ETIS UMR 8051, CY Paris Cergy University, ENSEA, CNRS, 95000 Cergy-Pontoise, France;
| | | |
Collapse
|
24
|
Mascarenhas Saraiva MJ, Afonso J, Ribeiro T, Ferreira J, Cardoso H, Andrade AP, Parente M, Natal R, Mascarenhas Saraiva M, Macedo G. Deep learning and capsule endoscopy: automatic identification and differentiation of small bowel lesions with distinct haemorrhagic potential using a convolutional neural network. BMJ Open Gastroenterol 2021; 8:bmjgast-2021-000753. [PMID: 34580155 PMCID: PMC8477239 DOI: 10.1136/bmjgast-2021-000753] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Accepted: 09/15/2021] [Indexed: 12/11/2022] Open
Abstract
OBJECTIVE Capsule endoscopy (CE) is pivotal for evaluation of small bowel disease. Obscure gastrointestinal bleeding most often originates from the small bowel. CE frequently identifies a wide range of lesions with different bleeding potentials in these patients. However, reading CE examinations is a time-consuming task. Convolutional neural networks (CNNs) are highly efficient artificial intelligence tools for image analysis. This study aims to develop a CNN-based model for identification and differentiation of multiple small bowel lesions with distinct haemorrhagic potential using CE images. DESIGN We developed, trained, and validated a denary CNN based on CE images. Each frame was labelled according to the type of lesion (lymphangiectasia, xanthomas, ulcers, erosions, vascular lesions, protruding lesions, and blood). The haemorrhagic potential was assessed by Saurin's classification. The entire dataset was divided into training and validation sets. The performance of the CNN was measured by the area under the receiving operating characteristic curve, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV). RESULTS A total of 53 555 CE images were included. The model had an overall accuracy of 99%, a sensitivity of 88%, a specificity of 99%, a PPV of 87%, and an NPV of 99% for detection of multiple small bowel abnormalities and respective classification of bleeding potential. CONCLUSION We developed and tested a CNN-based model for automatic detection of multiple types of small bowel lesions and classification of the respective bleeding potential. This system may improve the diagnostic yield of CE for these lesions and overall CE efficiency.
Collapse
Affiliation(s)
- Miguel José Mascarenhas Saraiva
- Department of Gastroenterology, Hospital São João, Porto, Portugal .,Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, Porto, Portugal.,University of Porto Faculty of Medicine, Porto, Porto, Portugal
| | - João Afonso
- Department of Gastroenterology, Hospital São João, Porto, Portugal.,Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, Porto, Portugal
| | - Tiago Ribeiro
- Department of Gastroenterology, Hospital São João, Porto, Portugal.,Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, Porto, Portugal
| | - João Ferreira
- Department of Mechanical Engineering, Faculty of Engineering of the University of Porto, Porto, Portugal.,INEGI - Institute of Science and Innovation in Mechanical and Industrial Engineering, Porto, Portugal
| | - Helder Cardoso
- Department of Gastroenterology, Hospital São João, Porto, Portugal.,Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, Porto, Portugal.,University of Porto Faculty of Medicine, Porto, Porto, Portugal
| | - Ana Patricia Andrade
- Department of Gastroenterology, Hospital São João, Porto, Portugal.,Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, Porto, Portugal.,University of Porto Faculty of Medicine, Porto, Porto, Portugal
| | - Marco Parente
- Department of Mechanical Engineering, Faculty of Engineering of the University of Porto, Porto, Portugal.,INEGI - Institute of Science and Innovation in Mechanical and Industrial Engineering, Porto, Portugal
| | - Renato Natal
- Department of Mechanical Engineering, Faculty of Engineering of the University of Porto, Porto, Portugal.,INEGI - Institute of Science and Innovation in Mechanical and Industrial Engineering, Porto, Portugal
| | | | - Guilherme Macedo
- Department of Gastroenterology, Hospital São João, Porto, Portugal.,Gastroenterology and Hepatology, WGO Gastroenterology and Hepatology Training Centre, Porto, Portugal.,University of Porto Faculty of Medicine, Porto, Porto, Portugal
| |
Collapse
|