1
|
Classification of the Confocal Microscopy Images of Colorectal Tumor and Inflammatory Colitis Mucosa Tissue Using Deep Learning. Diagnostics (Basel) 2022; 12:diagnostics12020288. [PMID: 35204379 PMCID: PMC8870781 DOI: 10.3390/diagnostics12020288] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Revised: 01/21/2022] [Accepted: 01/21/2022] [Indexed: 12/09/2022] Open
Abstract
Confocal microscopy image analysis is a useful method for neoplasm diagnosis. Many ambiguous cases are difficult to distinguish with the naked eye, thus leading to high inter-observer variability and significant time investments for learning this method. We aimed to develop a deep learning-based neoplasm classification model that classifies confocal microscopy images of 10× magnified colon tissues into three classes: neoplasm, inflammation, and normal tissue. ResNet50 with data augmentation and transfer learning approaches was used to efficiently train the model with limited training data. A class activation map was generated by using global average pooling to confirm which areas had a major effect on the classification. The proposed method achieved an accuracy of 81%, which was 14.05% more accurate than three machine learning-based methods and 22.6% better than the predictions made by four endoscopists. ResNet50 with data augmentation and transfer learning can be utilized to effectively identify neoplasm, inflammation, and normal tissue in confocal microscopy images. The proposed method outperformed three machine learning-based methods and identified the area that had a major influence on the results. Inter-observer variability and the time required for learning can be reduced if the proposed model is used with confocal microscopy image analysis for diagnosis.
Collapse
|
2
|
Glover B, Teare J, Patel N. The Status of Advanced Imaging Techniques for Optical Biopsy of Colonic Polyps. Clin Transl Gastroenterol 2020; 11:e00130. [PMID: 32352708 PMCID: PMC7145035 DOI: 10.14309/ctg.0000000000000130] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/16/2019] [Accepted: 01/03/2020] [Indexed: 12/19/2022] Open
Abstract
The progressive miniaturization of photonic components presents the opportunity to obtain unprecedented microscopic images of colonic polyps in real time during endoscopy. This information has the potential to act as "optical biopsy" to aid clinical decision-making, including the possibility of adopting new paradigms such as a "resect and discard" approach for low-risk lesions. The technologies discussed in this review include confocal laser endomicroscopy, optical coherence tomography, multiphoton microscopy, Raman spectroscopy, and hyperspectral imaging. These are in different stages of development and clinical readiness, but all show the potential to produce reliable in vivo discrimination of different tissue types. A structured literature search of the imaging techniques for colorectal polyps has been conducted. The significant developments in endoscopic imaging were identified for each modality, and the status of current development was discussed. Of the advanced imaging techniques discussed, confocal laser endomicroscopy is in clinical use and, under optimal conditions with an experienced operator, can provide accurate histological assessment of tissue. The remaining techniques show potential for incorporation into endoscopic equipment and practice, although further component development is needed, followed by robust prospective validation of accuracy. Optical coherence tomography illustrates tissue "texture" well and gives good assessment of mucosal thickness and layers. Multiphoton microscopy produces high-resolution images at a subcellular resolution. Raman spectroscopy and hyperspectral imaging are less developed endoscopically but provide a tissue "fingerprint" which can distinguish between tissue types. Molecular imaging may become a powerful adjunct to other techniques, with its ability to precisely label specific molecules within tissue and thereby enhance imaging.
Collapse
Affiliation(s)
- Ben Glover
- Department of Surgery and Cancer, Imperial College London, London, UK
| | - Julian Teare
- Department of Surgery and Cancer, Imperial College London, London, UK
| | - Nisha Patel
- Department of Surgery and Cancer, Imperial College London, London, UK
| |
Collapse
|
3
|
Validation of Probe-based Confocal Laser Endomicroscopy (pCLE) Criteria for Diagnosing Colon Polyp Histology. J Clin Gastroenterol 2018; 52:812-816. [PMID: 28885303 DOI: 10.1097/mcg.0000000000000927] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
BACKGROUND Validated probe-based confocal endomicroscopy (pCLE) criteria for distinguishing hyperplastic polyps (HPs) and tubular adenomas (TA) have not yet been developed. AIM To develop pCLE criteria for distinguishing HP from TA and evaluate its performance characteristics among experts. METHODS pCLE criteria for colon polyp histology were developed and tested in 2 phases prospectively. Phase I: 8 preliminary criteria were developed and tested internally. Criteria achieving an accuracy of >75% (epithelial surface: regular vs. irregular; goblet cells: increased vs. decreased; gland axis: horizontal vs. vertical; gland shape: slit/stellate vs. villiform; image scale: gray vs. dark) were evaluated in Phase II of study wherein external assessors evaluated these criteria in a separate set of pCLE videos. Accuracy and interobserver agreement (95% confidence intervals) were determined for colon histology prediction. RESULTS Phase I (criteria development/internal testing): 8 criteria were assessed by 4 pCLE experts using 28 videos (14 HP/14 TA). Five of 8 pCLE criteria met selection for phase II (accuracy >75%). Phase II (external validation): 36 pCLE colon polyp videos (HP 16/TA 20) were evaluated by 8 external assessors. Overall accuracy in diagnosis of colon polyp histology was 84.9% (95% confidence interval, 81.7-87.7). Of predictions made with high confidence (75%), histology was predicted with an accuracy of 91%, sensitivity 83%, specificity 100%, negative predictive value 87% and positive predictive value 98%. Interobserver agreement was substantial (κ=0.73). CONCLUSIONS We demonstrate the development and validation of pCLE criteria for prediction of colon polyp histology. Using these criteria, overall accuracy in differentiating TA from HP was high with substantial interobserver agreement.
Collapse
|
4
|
Fugazza A, Gaiani F, Carra MC, Brunetti F, Lévy M, Sobhani I, Azoulay D, Catena F, de'Angelis GL, de'Angelis N. Confocal Laser Endomicroscopy in Gastrointestinal and Pancreatobiliary Diseases: A Systematic Review and Meta-Analysis. BIOMED RESEARCH INTERNATIONAL 2016; 2016:4638683. [PMID: 26989684 PMCID: PMC4773527 DOI: 10.1155/2016/4638683] [Citation(s) in RCA: 72] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/06/2015] [Accepted: 12/31/2015] [Indexed: 12/15/2022]
Abstract
Confocal laser endomicroscopy (CLE) is an endoscopic-assisted technique developed to obtain histopathological diagnoses of gastrointestinal and pancreatobiliary diseases in real time. The objective of this systematic review is to analyze the current literature on CLE and to evaluate the applicability and diagnostic yield of CLE in patients with gastrointestinal and pancreatobiliary diseases. A literature search was performed on MEDLINE, EMBASE, Scopus, and Cochrane Oral Health Group Specialized Register, using pertinent keywords without time limitations. Both prospective and retrospective clinical studies that evaluated the sensitivity, specificity, or accuracy of CLE were eligible for inclusion. Of 662 articles identified, 102 studies were included in the systematic review. The studies were conducted between 2004 and 2015 in 16 different countries. CLE demonstrated high sensitivity and specificity in the detection of dysplasia in Barrett's esophagus, gastric neoplasms and polyps, colorectal cancers in inflammatory bowel disease, malignant pancreatobiliary strictures, and pancreatic cysts. Although CLE has several promising applications, its use has been limited by its low availability, high cost, and need of specific operator training. Further clinical trials with a particular focus on cost-effectiveness and medicoeconomic analyses, as well as standardized institutional training, are advocated to implement CLE in routine clinical practice.
Collapse
Affiliation(s)
- Alessandro Fugazza
- Unit of Gastroenterology and Digestive Endoscopy, University of Parma, 43100 Parma, Italy
| | - Federica Gaiani
- Unit of Gastroenterology and Digestive Endoscopy, University of Parma, 43100 Parma, Italy
| | | | - Francesco Brunetti
- Unit of Digestive, Hepato-Pancreato-Biliary Surgery and Liver Transplantation, Henri Mondor Hospital, AP-HP, 94010 Créteil, France
| | - Michaël Lévy
- Department of Gastroenterology and Digestive Endoscopy, Henri Mondor Hospital, AP-HP, 94010 Créteil, France
| | - Iradj Sobhani
- Department of Gastroenterology and Digestive Endoscopy, Henri Mondor Hospital, AP-HP, 94010 Créteil, France
- Cancer Research Lab. EC2M3, Université Paris-Est, Val de Marne UPEC, 94010 Créteil, France
| | - Daniel Azoulay
- Unit of Digestive, Hepato-Pancreato-Biliary Surgery and Liver Transplantation, Henri Mondor Hospital, AP-HP, 94010 Créteil, France
| | - Fausto Catena
- Emergency Surgery Department, University of Parma, 43100 Parma, Italy
| | - Gian Luigi de'Angelis
- Unit of Gastroenterology and Digestive Endoscopy, University of Parma, 43100 Parma, Italy
| | - Nicola de'Angelis
- Unit of Digestive, Hepato-Pancreato-Biliary Surgery and Liver Transplantation, Henri Mondor Hospital, AP-HP, 94010 Créteil, France
- Cancer Research Lab. EC2M3, Université Paris-Est, Val de Marne UPEC, 94010 Créteil, France
- Department of Advanced Biomedical Sciences, University Federico II of Naples, 80138 Naples, Italy
| |
Collapse
|
5
|
Ma HB, Cai LJ, Fan YH. Progress of research and clinical application of probe-based confocal laser endomicroscopy. Shijie Huaren Xiaohua Zazhi 2016; 24:89-96. [DOI: 10.11569/wcjd.v24.i1.89] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
Probe based confocal laser endomicroscopy (pCLE) is a new endoscopic diagnostic method which integrates micro-imaging technology into endoscopy and can identify the morphological structure of particular tissue surface, so that the ongoing procedure of endoscopy can make the histopathological diagnosis. pCLE has the "optical biopsy" function, avoids shortcomings in physical biopsies such as being time-consuming, cumbersome, and prone to sampling error, and thus improves the diagnostic accuracy and efficiency. The field of research of pCLE as a new endoscopic imaging technology has been expanded from the digestive cavity structure to the respiratory system and urinary system. This article reviews the progress of research and clinical application of pCLE.
Collapse
|
6
|
Hosoe N, Ogata H. Application and Efficacy of Super-Magnifying Endoscopy for the Lower Intestinal Tract. Clin Endosc 2016; 49:37-40. [PMID: 26855922 PMCID: PMC4743732 DOI: 10.5946/ce.2016.49.1.37] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/23/2015] [Revised: 11/01/2015] [Accepted: 11/02/2015] [Indexed: 12/26/2022] Open
Abstract
Endoscopy plays a significant role in the diagnosis, management, and surveillance of colorectal cancer (CRC) and inflammatory bowel diseases (IBDs). Moreover, magnifying endoscopy and image-enhanced endoscopy has a crucial role in the clinical setting. Recently, a super-magnifying endoscope has been developed, and two devices, confocal laser endomicroscopy (CLE) and an endocytoscopy system (ECS), which allow in vivo microscopic inspection of the microstructural mucosal features of the gastrointestinal tract, are currently available. Studies on the use of ECS in CRC were reported by a Japanese group. Additionally, a few studies on the use of ECS in IBD have been reported. CLE has been shown to be reliable in assessing the activity of the disease in IBDs in both ulcerative colitis and Crohn's disease. Various published studies evaluated the use of CLE during colonoscopy to distinguish colorectal polyp pathology and neoplasia. However, these studies are heterogeneous, and further evidence is necessary to confirm the efficacy of CLE.
Collapse
Affiliation(s)
- Naoki Hosoe
- Center for Diagnostic and Therapeutic Endoscopy, Keio University School of Medicine, Tokyo, Japan
| | - Haruhiko Ogata
- Center for Diagnostic and Therapeutic Endoscopy, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|
7
|
Buchner AM, Wallace MB. In-vivo microscopy in the diagnosis of intestinal neoplasia and inflammatory conditions. Histopathology 2015; 66:137-46. [PMID: 25639481 DOI: 10.1111/his.12597] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Confocal laser endomicroscopy (CLE) is a rapidly emerging tool in endoscopic imaging allowing in-vivo microscopy of examined gastrointestinal mucosa. This review will discuss the most recent advances of confocal laser endomicroscopy in the diagnosis of intestinal neoplasia and inflammatory conditions.
Collapse
Affiliation(s)
- Anna M Buchner
- Division of Gastroenterology, University of Pennsylvania, Philadelphia, PA, USA
| | | |
Collapse
|