1
|
Perperidis A, Dhaliwal K, McLaughlin S, Vercauteren T. Image computing for fibre-bundle endomicroscopy: A review. Med Image Anal 2020; 62:101620. [PMID: 32279053 PMCID: PMC7611433 DOI: 10.1016/j.media.2019.101620] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2018] [Accepted: 11/18/2019] [Indexed: 12/12/2022]
Abstract
Endomicroscopy is an emerging imaging modality, that facilitates the acquisition of in vivo, in situ optical biopsies, assisting diagnostic and potentially therapeutic interventions. While there is a diverse and constantly expanding range of commercial and experimental optical biopsy platforms available, fibre-bundle endomicroscopy is currently the most widely used platform and is approved for clinical use in a range of clinical indications. Miniaturised, flexible fibre-bundles, guided through the working channel of endoscopes, needles and catheters, enable high-resolution imaging across a variety of organ systems. Yet, the nature of image acquisition though a fibre-bundle gives rise to several inherent characteristics and limitations necessitating novel and effective image pre- and post-processing algorithms, ranging from image formation, enhancement and mosaicing to pathology detection and quantification. This paper introduces the underlying technology and most prevalent clinical applications of fibre-bundle endomicroscopy, and provides a comprehensive, up-to-date, review of relevant image reconstruction, analysis and understanding/inference methodologies. Furthermore, current limitations as well as future challenges and opportunities in fibre-bundle endomicroscopy computing are identified and discussed.
Collapse
Affiliation(s)
- Antonios Perperidis
- Institute of Sensors, Signals and Systems (ISSS), Heriot Watt University, EH14 4AS, UK; EPSRC IRC "Hub" in Optical Molecular Sensing & Imaging, MRC Centre for Inflammation Research, Queen's Medical Research Institute (QMRI), University of Edinburgh, EH16 4TJ, UK.
| | - Kevin Dhaliwal
- EPSRC IRC "Hub" in Optical Molecular Sensing & Imaging, MRC Centre for Inflammation Research, Queen's Medical Research Institute (QMRI), University of Edinburgh, EH16 4TJ, UK.
| | - Stephen McLaughlin
- Institute of Sensors, Signals and Systems (ISSS), Heriot Watt University, EH14 4AS, UK.
| | - Tom Vercauteren
- School of Biomedical Engineering and Imaging Sciences, King's College London, WC2R 2LS, UK.
| |
Collapse
|
2
|
Abstract
Barrett's esophagus (BE) is present in up to 5.6% of the US population and is the precursor lesion for esophageal adenocarcinoma. Surveillance endoscopy is the primary management approach for BE. However, standard protocol biopsies have been associated with significant miss rates of dysplastic lesions in patients with BE. Thus, a variety of methods to optimize the imaging of BE have been developed to improve the efficiency and diagnostic yield of surveillance endoscopy in detecting early neoplasia. These techniques use changes that occur at macroscopic, microscopic, and subcellular levels in early neoplasia and are the focus of this article.
Collapse
Affiliation(s)
- V Raman Muthusamy
- Division of Digestive Diseases, David Geffen School of Medicine at UCLA, 200 UCLA Medical Plaza, Room 330-37, Los Angeles, CA 90095, USA.
| | - Stephen Kim
- Division of Digestive Diseases, David Geffen School of Medicine at UCLA, 200 UCLA Medical Plaza, Room 330-37, Los Angeles, CA 90095, USA
| | - Michael B Wallace
- Division of Gastroenterology and Hepatology, Mayo School of Medicine, 4500 San Pablo Road, Jacksonville, FL 32224, USA
| |
Collapse
|
3
|
Sessile serrated polyps: detection, eradication, and prevention of the evil twin. ACTA ACUST UNITED AC 2015; 13:156-70. [PMID: 25623474 DOI: 10.1007/s11938-015-0046-y] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
OPINION STATEMENT The sessile serrated polyp (SSP), also known as sessile serrated adenoma, is the evil twin among the colorectal cancer precursors. As will be described, these lesions have multiple aliases (serrated adenoma, serrated polyp, or serrated lesion among others), they hang out in a bad neighborhood (the poorly prepped right colon), they hide behind a mask of mucus, they are difficult for witnesses (pathologists) to identify, they are difficult for police (endoscopists) to find, they are difficult to permanently remove from the society (high incomplete resection rate), they can be impulsive (progress rapidly to colorectal cancer (CRC)), and enforcers (gastroenterologists) do not know how best to control them (uncertain surveillance recommendations). There is no wonder that there is a need to understand these lesions well, learn how best to prevent the colonic mucosa from going down this errant path or, if that fails, detect these deviants and eradicate them from the colonic society. These lesions should be on endoscopists' most wanted list.
Collapse
|
4
|
Chiew WM, Lin F, Qian K, Seah HS. A heterogeneous computing system for coupling 3D endomicroscopy with volume rendering in real-time image visualization. COMPUT IND 2014. [DOI: 10.1016/j.compind.2013.10.002] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
5
|
Hughes M, Chang TP, Yang GZ. Fiber bundle endocytoscopy. BIOMEDICAL OPTICS EXPRESS 2013; 4:2781-94. [PMID: 24409380 PMCID: PMC3862163 DOI: 10.1364/boe.4.002781] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2013] [Revised: 09/27/2013] [Accepted: 09/28/2013] [Indexed: 05/20/2023]
Abstract
Endocytoscopy is an optical biopsy technique which uses a miniaturized camera to capture white light microscopy images through an endoscope. We have developed an alternative design that instead relays images to an external camera via a coherent fiber bundle. In this paper we characterize the device and demonstrate microscopy of porcine tissue ex vivo. One advantage of our approach is the ease with which other bundle-compatible imaging modalities can be deployed simultaneously. We show this by acquiring quasi-simultaneous endocytoscopy and fluorescence confocal endomicroscopy images through a single fiber bundle. This opens up possibilities for multi-modal endomicroscopy, combining white light and fluorescence imaging.
Collapse
Affiliation(s)
- Michael Hughes
- The Hamlyn Centre for Robotic Surgery, Imperial College London, South Kensington Campus, London. SW2 2AZ. UK
- Department of Computing, Imperial College London UK
| | - Tou Pin Chang
- The Hamlyn Centre for Robotic Surgery, Imperial College London, South Kensington Campus, London. SW2 2AZ. UK
- Department of Surgery and Cancer, Imperial College London UK
| | - Guang-Zhong Yang
- The Hamlyn Centre for Robotic Surgery, Imperial College London, South Kensington Campus, London. SW2 2AZ. UK
- Department of Computing, Imperial College London UK
| |
Collapse
|
6
|
Eleftheriadis N, Inoue H, Ikeda H, Onimaru M, Yoshida A, Hosoya T, Maselli R, Kudo SE. Endocytoscopic visualization of squamous cell islands within Barrett's epithelium. World J Gastrointest Endosc 2013; 5:174-179. [PMID: 23596541 PMCID: PMC3627841 DOI: 10.4253/wjge.v5.i4.174] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/24/2012] [Revised: 03/11/2013] [Accepted: 03/15/2013] [Indexed: 02/05/2023] Open
Abstract
AIM To study the endocytoscopic visualization of squamous cell islands within Barrett's epithelium. METHODS Endocytoscopy (ECS) has been studied in the surveillance of Barrett's esophagus, with controversial results. In initial studies, however, a soft catheter type endocytoscope was used, while only methylene blue dye was used for the staining of Barrett's mucosa. Integrated type endocytoscopes (GIF-Q260 EC, Olympus Corp, Tokyo, Japan) have been recently developed, with the incorporation of a high-power magnifying endocytoscope into a standard endoscope together with narrow-band imaging (NBI). Moreover, double staining with a mixture of 0.05% crystal violet and 0.1% of methylene blue (CM) during ECS enables higher quality images comparable to conventional hematoxylin eosin histopathological images. RESULTS In vivo endocytoscopic visualization of papillary squamous cell islands within glandular Barrett's epithelium in a patient with long-segment Barrett's esophagus is reported. Conventional white light endoscopy showed typical long-segment Barrett's esophagus, with small squamous cell islands within normal Barrett's mucosa, which were better visualized by NBI endoscopy. ECS after double CM staining showed regular Barrett's esophagus, while higher magnification (× 480) revealed the orifices of glandular structures better. Furthermore, typical squamous cell papillary protrusion, classified as endocytoscopic atypia classification (ECA) 2 according to ECA, was identified within regular glandular Barrett's mucosa. Histological examination of biopsies taken from the same area showed squamous epithelium within glandular Barrett's mucosa, corresponding well to endocytoscopic findings. CONCLUSION To our knowledge, this is the first report of in vivo visualization of esophageal papillary squamous cell islands surrounded by glandular Barrett's epithelium.
Collapse
Affiliation(s)
- Nicholas Eleftheriadis
- Nicholas Eleftheriadis, Haruhiro Inoue, Haruo Ikeda, Manabu Onimaru, Akira Yoshida, Toshihisa Hosoya, Roberta Maselli, Shin-ei Kudo, Digestive Disease Center, Showa University, Northern Yokohama Hospital, Tsuzuki-ku, Yokohama 224-8503, Japan
| | | | | | | | | | | | | | | |
Collapse
|
7
|
Thong PSP, Tandjung SS, Movania MM, Chiew WM, Olivo M, Bhuvaneswari R, Seah HS, Lin F, Qian K, Soo KC. Toward real-time virtual biopsy of oral lesions using confocal laser endomicroscopy interfaced with embedded computing. JOURNAL OF BIOMEDICAL OPTICS 2012; 17:056009. [PMID: 22612132 DOI: 10.1117/1.jbo.17.5.056009] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
Oral lesions are conventionally diagnosed using white light endoscopy and histopathology. This can pose a challenge because the lesions may be difficult to visualise under white light illumination. Confocal laser endomicroscopy can be used for confocal fluorescence imaging of surface and subsurface cellular and tissue structures. To move toward real-time "virtual" biopsy of oral lesions, we interfaced an embedded computing system to a confocal laser endomicroscope to achieve a prototype three-dimensional (3-D) fluorescence imaging system. A field-programmable gated array computing platform was programmed to enable synchronization of cross-sectional image grabbing and Z-depth scanning, automate the acquisition of confocal image stacks and perform volume rendering. Fluorescence imaging of the human and murine oral cavities was carried out using the fluorescent dyes fluorescein sodium and hypericin. Volume rendering of cellular and tissue structures from the oral cavity demonstrate the potential of the system for 3-D fluorescence visualization of the oral cavity in real-time. We aim toward achieving a real-time virtual biopsy technique that can complement current diagnostic techniques and aid in targeted biopsy for better clinical outcomes.
Collapse
|
8
|
Ernst A, Anantham D. Update on interventional bronchoscopy for the thoracic radiologist. J Thorac Imaging 2012; 26:263-77. [PMID: 22009080 DOI: 10.1097/rti.0b013e318221ec03] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
Abstract
Interventional bronchoscopy, together with other domains of interventional pulmonology, has experienced tremendous technological advances. Diagnostic applications include endobronchial ultrasound, which enables endoscopists to see through airway walls. White light videobronchoscopy, autofluorescence imaging, and narrow band imaging have enhanced the ability to detect early lung cancer at a preinvasive stage. Electromagnetic navigational bronchoscopy, ultrathin bronchoscopy, and virtual bronchoscopy increase the diagnostic yield of biopsy of small peripheral lung lesions. The options that are currently available for the relief of central airway obstruction are also numerous, with both flexible and rigid bronchoscopic applications. Stents, although dichotomized to silicone and metal, come in various sizes and shapes to suit the requirements of the pathology being treated. Ablative techniques are categorized into those with an immediate effect and those with a delayed effect. Laser, electrocautery, and argon plasma coagulation can immediately relieve obstruction and control hemoptysis, whereas cryosurgery, brachytherapy, and photodynamic therapy have established roles in subacute airway obstruction and in the treatment of early lung cancer. Microdebriders have recently been added to the armamentarium of modalities for mechanical debulking of tumor. Distal airway obstruction has also been targeted with bronchial thermoplasty treatment of refractory asthma and with bronchoscopic lung volume reduction for the management of severe emphysema. This array of new technology has fostered collaborative work with a wide range of other medical specialties to deliver safer, more effective, minimally invasive treatment.
Collapse
Affiliation(s)
- Armin Ernst
- Pulmonary, Critical Care and Sleep Medicine, St Elizabeth Medical Center, Tufts University School of Medicine, Boston, MA, USA.
| | | |
Collapse
|
9
|
Kiesslich R, Goetz M, Hoffman A, Galle PR. New imaging techniques and opportunities in endoscopy. Nat Rev Gastroenterol Hepatol 2011; 8:547-53. [PMID: 21894196 DOI: 10.1038/nrgastro.2011.152] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Gastrointestinal endoscopy is undergoing major improvements, which are driven by new available technologies and substantial refinements of optical features. In this Review, we summarize available and evolving imaging technologies that could influence the clinical algorithm of endoscopic diagnosis. Detection, characterization and confirmation are essential steps required for proper endoscopic diagnosis. Optical and nonoptical methods can help to improve each step; these improvements are likely to increase the detection rate of neoplasias and reduce unnecessary endoscopic treatments. Furthermore, functional and molecular imaging are emerging as new diagnostic tools that could provide an opportunity for personalized medicine, in which endoscopy will define disease outcome or predict the response to targeted therapy.
Collapse
Affiliation(s)
- Ralf Kiesslich
- Department of Internal Medicine, Johannes Gutenberg University of Mainz, Langenbeckstrasse 1, 55131 Mainz, Germany.
| | | | | | | |
Collapse
|
10
|
Weitschies W, Wilson CG. In vivo imaging of drug delivery systems in the gastrointestinal tract. Int J Pharm 2011; 417:216-26. [DOI: 10.1016/j.ijpharm.2011.07.031] [Citation(s) in RCA: 41] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2011] [Revised: 07/19/2011] [Accepted: 07/19/2011] [Indexed: 11/17/2022]
|