1
|
Jukema JB, Kusters CHJ, Jong MR, Fockens KN, Boers T, van der Putten JA, Pouw RE, Duits LC, Weusten BLAM, Herrero LA, Houben MHMG, Nagengast WB, Westerhof J, Alkhalaf A, Mallant-Hent R, Scholten P, Ragunath K, Seewald S, Elbe P, Silva FB, Barret M, Ortiz Fernández-Sordo J, Moral Villarejo G, Pech O, Beyna T, Montazeri NSM, der Sommen FV, de With PH, de Groof AJ, Bergman JJ. Computer-aided diagnosis improves characterization of Barrett's neoplasia by general endoscopists (with video). Gastrointest Endosc 2024; 100:616-625.e8. [PMID: 38636819 DOI: 10.1016/j.gie.2024.04.013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/05/2023] [Revised: 01/25/2024] [Accepted: 04/08/2024] [Indexed: 04/20/2024]
Abstract
BACKGROUND AND AIMS Characterization of visible abnormalities in patients with Barrett's esophagus (BE) can be challenging, especially for inexperienced endoscopists. This results in suboptimal diagnostic accuracy and poor interobserver agreement. Computer-aided diagnosis (CADx) systems may assist endoscopists. We aimed to develop, validate, and benchmark a CADx system for BE neoplasia. METHODS The CADx system received pretraining with ImageNet and then consecutive domain-specific pretraining with GastroNet, which includes 5 million endoscopic images. It was subsequently trained and internally validated using 1758 narrow-band imaging (NBI) images of early BE neoplasia (352 patients) and 1838 NBI images of nondysplastic BE (173 patients) from 8 international centers. CADx was tested prospectively on corresponding image and video test sets with 30 cases (20 patients) of BE neoplasia and 60 cases (31 patients) of nondysplastic BE. The test set was benchmarked by 44 general endoscopists in 2 phases (phase 1, no CADx assistance; phase 2, with CADx assistance). Ten international BE experts provided additional benchmark performance. RESULTS Stand-alone sensitivity and specificity of the CADx system were 100% and 98% for images and 93% and 96% for videos, respectively. CADx outperformed general endoscopists without CADx assistance in terms of sensitivity (P = .04). Sensitivity and specificity of general endoscopists increased from 84% to 96% and 90% to 98% with CAD assistance (P < .001). CADx assistance increased endoscopists' confidence in characterization (P < .001). CADx performance was similar to that of the BE experts. CONCLUSIONS CADx assistance significantly increased characterization performance of BE neoplasia by general endoscopists to the level of expert endoscopists. The use of this CADx system may thereby improve daily Barrett surveillance.
Collapse
Affiliation(s)
- Jelmer B Jukema
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Carolus H J Kusters
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Martijn R Jong
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Kiki N Fockens
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Tim Boers
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Joost A van der Putten
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Roos E Pouw
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Lucas C Duits
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Bas L A M Weusten
- Department of Gastroenterology and Hepatology, UMC Utrecht, University of Utrecht, Utrecht, the Netherlands; Department of Gastroenterology and Hepatology, Sint Antonius Hospital, Nieuwegein, the Netherlands
| | - Lorenza Alvarez Herrero
- Department of Gastroenterology and Hepatology, Sint Antonius Hospital, Nieuwegein, the Netherlands
| | - Martin H M G Houben
- Department of Gastroenterology and Hepatology, HagaZiekenhuis Den Haag, Den Haag, the Netherlands
| | - Wouter B Nagengast
- Department of Gastroenterology and Hepatology, UMC Groningen, University of Groningen, Groningen, the Netherlands
| | - Jessie Westerhof
- Department of Gastroenterology and Hepatology, UMC Groningen, University of Groningen, Groningen, the Netherlands
| | - Alaa Alkhalaf
- Department of Gastroenterology and Hepatology, Isala Hospital Zwolle, Zwolle, the Netherlands
| | - Rosalie Mallant-Hent
- Department of Gastroenterology and Hepatology, Flevoziekenhuis Almere, Almere, the Netherlands
| | - Pieter Scholten
- Department of Gastroenterology and Hepatology, Onze Lieve Vrouwe Gasthuis, Amsterdam, the Netherlands
| | - Krish Ragunath
- Department of Gastroenterology and Hepatology, Royal Perth Hospital, Curtin University, Perth, WA, Australia
| | - Stefan Seewald
- Department of Gastroenterology and Hepatology, Hirslanden Klinik, Zurich, Switzerland
| | - Peter Elbe
- Department of Digestive Diseases, Karolinska University Hospital, Stockholm, Sweden; Division of Surgery, Department of Clinical Science, Intervention and Technology, CLINTEC, Karolinska Institutet, Stockholm, Sweden
| | - Francisco Baldaque Silva
- Department of Digestive Diseases, Karolinska University Hospital, Stockholm, Sweden; Center for Advanced Endoscopy Carlos Moreira da Silva, Gastroenterology Department, Pedro Hispano Hospital, ULSM Matosinhos, Portugal
| | - Maximilien Barret
- Department of Gastroenterology and Hepatology, Cochin Hospital Paris, Paris, France
| | - Jacobo Ortiz Fernández-Sordo
- Department of Gastroenterology and Hepatology, Nottingham University Hospitals NHS Trust, Nottingham, United Kingdom
| | - Guiomar Moral Villarejo
- Department of Gastroenterology and Hepatology, Nottingham University Hospitals NHS Trust, Nottingham, United Kingdom
| | - Oliver Pech
- Department of Gastroenterology and Hepatology, St. John of God Hospital, Regensburg, Germany
| | - Torsten Beyna
- Department of Gastroenterology and Hepatology, Evangalisches Krankenhaus Düsseldorf, Düsseldorf, Germany
| | - Nahid S M Montazeri
- Biostatistics Unit, Department of Gastroenterology and Hepatology, Amsterdam University Medical Center, location Academic Medical Center, University of Amsterdam, Amsterdam, the Netherlands
| | - Fons van der Sommen
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Peter H de With
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - A Jeroen de Groof
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Jacques J Bergman
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands.
| |
Collapse
|
2
|
Fockens KN, Jukema JB, Jong MR, Boers T, van der Putten JA, Kusters CHJ, Pouw RE, Duits LC, van der Sommen F, de With PH, de Groof AJ, Bergman JJ. The use of a real-time computer-aided detection system for visible lesions in the Barrett's esophagus during live endoscopic procedures: a pilot study (with video). Gastrointest Endosc 2024; 100:527-531.e3. [PMID: 38604297 DOI: 10.1016/j.gie.2024.04.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 03/07/2024] [Accepted: 04/01/2024] [Indexed: 04/13/2024]
Abstract
BACKGROUND AND AIMS This pilot study evaluated the performance of a recently developed computer-aided detection (CADe) system for Barrett's neoplasia during live endoscopic procedures. METHODS Fifteen patients with a visible lesion and 15 without were included in this study. A CAD-assisted workflow was used that included a slow pullback video recording of the entire Barrett's segment with live CADe assistance, followed by CADe-assisted level-based video recordings every 2 cm of the Barrett's segment. Outcomes were per-patient and per-level diagnostic accuracy of the CAD-assisted workflow, in which the primary outcome was per-patient in vivo CADe sensitivity. RESULTS In the per-patient analyses, the CADe system detected all visible lesions (sensitivity 100%). Per-patient CADe specificity was 53%. Per-level sensitivity and specificity of the CADe-assisted workflow were 100% and 73%, respectively. CONCLUSIONS In this pilot study, detection by the CADe system of all potentially neoplastic lesions in Barrett's esophagus was comparable to that of an expert endoscopist. Continued refinement of the system may improve specificity. External validation in larger multicenter studies is planned. (Clinical trial registration number: NCT05628441.).
Collapse
Affiliation(s)
- Kiki N Fockens
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Jelmer B Jukema
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Martijn R Jong
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Tim Boers
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Joost A van der Putten
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Carolus H J Kusters
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Roos E Pouw
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Lucas C Duits
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Fons van der Sommen
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - Peter H de With
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, the Netherlands
| | - A Jeroen de Groof
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - Jacques J Bergman
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology, Endocrinology and Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands.
| |
Collapse
|
3
|
Jong MR, de Groof AJ. Advancement of artificial intelligence systems for surveillance endoscopy of Barrett's esophagus. Dig Liver Dis 2024; 56:1126-1130. [PMID: 38071181 DOI: 10.1016/j.dld.2023.11.038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/29/2023] [Revised: 11/27/2023] [Accepted: 11/28/2023] [Indexed: 06/29/2024]
Abstract
Barrett's esophagus (BE) is a precursor disease for esophageal adenocarcinoma. Timely detection and treatment has significant influence on patient outcomes. Over the last years, several artificial intelligence (AI) systems have emerged to assist the endoscopist. The primary focus of research has been computer aided detection (CADe). Several groups have succeeded in developing competitive models for neoplasia detection. Additionally, computer aided diagnosis (CADx) models have been developed for subsequent lesion characterization and assistance in clinical decision making. Future studies should focus on bridging the domain gap between academic development and integration in daily practice.
Collapse
Affiliation(s)
- M R Jong
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands
| | - A J de Groof
- Department of Gastroenterology and Hepatology, Amsterdam Gastroenterology Endocrinology Metabolism, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands.
| |
Collapse
|
4
|
Jaspers TJM, Boers TGW, Kusters CHJ, Jong MR, Jukema JB, de Groof AJ, Bergman JJ, de With PHN, van der Sommen F. Robustness evaluation of deep neural networks for endoscopic image analysis: Insights and strategies. Med Image Anal 2024; 94:103157. [PMID: 38574544 DOI: 10.1016/j.media.2024.103157] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Revised: 03/19/2024] [Accepted: 03/21/2024] [Indexed: 04/06/2024]
Abstract
Computer-aided detection and diagnosis systems (CADe/CADx) in endoscopy are commonly trained using high-quality imagery, which is not representative for the heterogeneous input typically encountered in clinical practice. In endoscopy, the image quality heavily relies on both the skills and experience of the endoscopist and the specifications of the system used for screening. Factors such as poor illumination, motion blur, and specific post-processing settings can significantly alter the quality and general appearance of these images. This so-called domain gap between the data used for developing the system and the data it encounters after deployment, and the impact it has on the performance of deep neural networks (DNNs) supportive endoscopic CAD systems remains largely unexplored. As many of such systems, for e.g. polyp detection, are already being rolled out in clinical practice, this poses severe patient risks in particularly community hospitals, where both the imaging equipment and experience are subject to considerable variation. Therefore, this study aims to evaluate the impact of this domain gap on the clinical performance of CADe/CADx for various endoscopic applications. For this, we leverage two publicly available data sets (KVASIR-SEG and GIANA) and two in-house data sets. We investigate the performance of commonly-used DNN architectures under synthetic, clinically calibrated image degradations and on a prospectively collected dataset including 342 endoscopic images of lower subjective quality. Additionally, we assess the influence of DNN architecture and complexity, data augmentation, and pretraining techniques for improved robustness. The results reveal a considerable decline in performance of 11.6% (±1.5) as compared to the reference, within the clinically calibrated boundaries of image degradations. Nevertheless, employing more advanced DNN architectures and self-supervised in-domain pre-training effectively mitigate this drop to 7.7% (±2.03). Additionally, these enhancements yield the highest performance on the manually collected test set including images with lower subjective quality. By comprehensively assessing the robustness of popular DNN architectures and training strategies across multiple datasets, this study provides valuable insights into their performance and limitations for endoscopic applications. The findings highlight the importance of including robustness evaluation when developing DNNs for endoscopy applications and propose strategies to mitigate performance loss.
Collapse
Affiliation(s)
- Tim J M Jaspers
- Department of Electrical Engineering, Video Coding & Architectures, Eindhoven University of Technology, Eindhoven, The Netherlands.
| | - Tim G W Boers
- Department of Electrical Engineering, Video Coding & Architectures, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Carolus H J Kusters
- Department of Electrical Engineering, Video Coding & Architectures, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Martijn R Jong
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Jelmer B Jukema
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Albert J de Groof
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Jacques J Bergman
- Department of Gastroenterology and Hepatology, Amsterdam University Medical Centers, University of Amsterdam, Amsterdam, The Netherlands
| | - Peter H N de With
- Department of Electrical Engineering, Video Coding & Architectures, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Fons van der Sommen
- Department of Electrical Engineering, Video Coding & Architectures, Eindhoven University of Technology, Eindhoven, The Netherlands
| |
Collapse
|
5
|
Burton SJ, Muniraj T. Advancing surveillance protocols for dysplastic Barrett's esophagus after complete remission of intestinal metaplasia: Time to rethink biopsy strategy? Gastrointest Endosc 2023; 98:733-734. [PMID: 37863568 DOI: 10.1016/j.gie.2023.07.051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 07/28/2023] [Accepted: 07/28/2023] [Indexed: 10/22/2023]
Affiliation(s)
- Samuel J Burton
- Section of Digestive Diseases, Yale New Haven Health System, Yale School of Medicine, New Haven, Connecticut, USA
| | - Thiruvengadam Muniraj
- Section of Digestive Diseases, Yale New Haven Health System, Yale School of Medicine, New Haven, Connecticut, USA
| |
Collapse
|
6
|
Perisetti A, Sharma P. Tips for improving the identification of neoplastic visible lesions in Barrett's esophagus. Gastrointest Endosc 2023; 97:248-250. [PMID: 36567201 DOI: 10.1016/j.gie.2022.10.022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/27/2022] [Accepted: 10/09/2022] [Indexed: 12/27/2022]
Affiliation(s)
- Abhilash Perisetti
- Division of Gastroenterology, Kansas City VA Medical Center, Kansas City, Missouri, USA
| | - Prateek Sharma
- Division of Gastroenterology, Kansas City VA Medical Center, Kansas City, Missouri, USA; Division of Gastroenterology and Hepatology, University of Kansas School of Medicine, Kansas City, Kansas, USA
| |
Collapse
|
7
|
Li K, Duan P, He H, Du R, Wang Q, Gong P, Bian H. Construction of the Interaction Network of Hub Genes in the Progression of Barrett's Esophagus to Esophageal Adenocarcinoma. J Inflamm Res 2023; 16:1533-1551. [PMID: 37077220 PMCID: PMC10106806 DOI: 10.2147/jir.s403928] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Accepted: 04/05/2023] [Indexed: 04/21/2023] Open
Abstract
Introduction Esophageal adenocarcinoma (EAC) is one of the histologic types of esophageal cancer with a poor prognosis. The majority of EAC originate from Barrett's esophagus (BE). There are few studies focusing on the dynamic progression of BE to EAC. Methods R software was used to analyze differentially expressed genes (DEGs) based on RNA-seq data of 94 normal esophageal squamous epithelial (NE) tissues, 113 BE tissues and 147 EAC tissues. The overlapping genes of DEGs between BE and EAC were analyzed by Venn diagram tool. The hub genes were selected by Cytoscape software based on the protein-protein interaction network of the overlapping genes using STRING database. The functional analysis of hub genes was performed by R software and the protein expression was identified by immunohistochemistry. Results In the present study, we found a large degree of genetic similarity between BE and EAC, and further identified seven hub genes (including COL1A1, TGFBI, MMP1, COL4A1, NID2, MMP12, CXCL1) which were all progressively upregulated in the progression of NE-BE-EAC. We have preliminarily uncovered the probable molecular mechanisms of these hub genes in disease development and constructed the ceRNA regulatory network of hub genes. More importantly, we explored the possibility of hub genes as biomarkers in the disease progression of NE-BE-EAC. For example, TGFBI can be used as biomarkers to predict the prognosis of EAC patients. COL1A1, NID2 and COL4A1 can be used as biomarkers to predict the response to immune checkpoint blockade (ICB) therapy. We also constructed a disease progression risk model for NE-BE-EAC based on CXCL1, MMP1 and TGFBI. Finally, the results of drug sensitivity analysis based on hub genes showed that drugs such as PI3K inhibitor TGX221, bleomycin, PKC inhibitor Midostaurin, Bcr-Abl inhibitor Dasatinib, HSP90 inhibitor 17-AAG, and Docetaxel may be potential candidates to inhibit the progression of BE to EAC. Conclusion This study is based on a large number of clinical samples with high credibility, which is useful for revealing the probable carcinogenic mechanism of BE to EAC and developing new clinical treatment strategies.
Collapse
Affiliation(s)
- Kai Li
- Zhang Zhongjing College of Chinese Medicine, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
- Henan Key Laboratory of Zhang Zhongjing Formulae and Herbs for Immunoregulation, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
| | - Peipei Duan
- Zhang Zhongjing College of Chinese Medicine, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
- Henan Key Laboratory of Zhang Zhongjing Formulae and Herbs for Immunoregulation, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
| | - Haifa He
- Department of Pathology, Nanyang Central Hospital, Nanyang, Henan, People’s Republic of China
| | - Ruijuan Du
- Zhang Zhongjing College of Chinese Medicine, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
- Henan Key Laboratory of Zhang Zhongjing Formulae and Herbs for Immunoregulation, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
| | - Qian Wang
- Zhang Zhongjing College of Chinese Medicine, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
- Henan Key Laboratory of Zhang Zhongjing Formulae and Herbs for Immunoregulation, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
| | - Pengju Gong
- The University of Texas MD Anderson Cancer Center UThealth Graduate School of Biomedical Sciences, Houston, TX, USA
| | - Hua Bian
- Zhang Zhongjing College of Chinese Medicine, Nanyang Institute of Technology, Nanyang, Henan, People’s Republic of China
- Correspondence: Hua Bian; Kai Li, Zhang Zhongjing College of Chinese Medicine, Nanyang Institute of Technology, No. 80 Changjiang Road, Wancheng District, Nanyang, Henan, People’s Republic of China, Email ;
| |
Collapse
|