The Status of Advanced Imaging Techniques for Optical Biopsy of Colonic Polyps

Evaluation of a novel forward-looking optical coherence tomography probe for endoscopic applications: an ex vivo feasibility study

BACKGROUND

As a result of recent advances in the development of small microelectromechanical system mirrors, a novel forward-looking optical coherence tomography (OCT) probe with a uniquely large field of view is being commercially developed. The aim of this study is to prospectively assess the feasibility of this advanced OCT probe in interpreting ex vivo images of colorectal polyp tissue and to identify necessary steps for further development.

METHODS

A total of 13 colorectal lesions from 9 patients, removed during endoscopic resection, were imaged ex vivo with the OCT device and compared with histopathological images that served as the gold standard for diagnostics. Normal tissue from one patient, removed during the endoscopic procedure, was imaged as a negative control. We assessed the presence of features indicative for polyp type and degree of dysplasia, by comparing OCT images to histopathological images and by evaluating the presence of OCT-specific features identified by previous studies, such as effacement (loss of layered tissue structure), a hyperreflective epithelial layer, and irregularity of the surface.

RESULTS

As verified by corresponding histological images, tissue structures such as blood vessels and tissue layers could be distinguished in OCT images of the normal tissue sample. Detailed structures on histological images such as crypts and cell nuclei could not be identified in the OCT images. However, we did identify OCT features specific for colorectal lesions, such as effacement and a hyperreflective epithelial layer. In general, the imaging depth was about 1 mm.

CONCLUSION

Some relevant tissue structures could be observed in OCT images of the novel device. However, some adaptations, such as increasing imaging depth using a laser with a longer central wavelength, are required to improve its clinical value for the imaging of colorectal lesions.

in vivo and in situ robust quantitative optical biopsy of hepatocellular carcinoma and metastasis based on two-photon autofluorescence imaging

Two-photon autofluorescence (TPAF) imaging is able to offer precise cellular metabolic information with high spatiotemporal resolution, making it a promising biopsy tool. The technique is greatly hampered by the complexity of either the optical system or data processing. Here, the excitation wavelength was optimized to simultaneously excite both flavin adenine dinucleotide and nicotinamide adenine dinucleotide and eliminate the unexpected TPAF. The optical redox ratio (ORR) images were robustly achieved without additional calibration under the optimized single-wavelength excitation. The in vitro, ex vivo, and in vivo biopsy by the TPAF method were systematically studied and compared using hepato-cellular carcinoma and metastasis as examples. It was demonstrated that the proposed TPAF method simplified the optical system, improved the robustness of ORR, and enabled early-stage cancer diagnosis, showing distinguished advantages as compared with previous methods.

Emerging Technologies in Endoscopy for Gastrointestinal Neoplasms: A Comprehensive Overview

Gastrointestinal neoplasms are a growing global health concern, requiring prompt identification and treatment. Endoscopic procedures have revolutionized the detection and treatment of gastrointestinal tumors by providing accurate, minimally invasive methods. Early-stage malignancies can be treated with endoscopic excision, leading to improved outcomes and increased survival rates. Precancerous lesions, like adenomatous polyps, can be prevented by removing them, reducing cancer occurrence and death rates. Advanced techniques like chromoendoscopy, narrow-band imaging, and confocal laser endomicroscopy improve the ability to see the mucosa surface and diagnose conditions. Artificial Intelligence (AI) applications in endoscopy can enhance diagnostic accuracy and predict histology outcomes. However, challenges remain in accurately defining lesions and ensuring precise diagnosis and treatment selection. Molecular imaging approaches and therapeutic modalities like photodynamic therapy and endoscopic ultrasonography-guided therapies hold potential but require further study and clinical confirmation. This study examines the future prospects and obstacles in endoscopic procedures for the timely identification and treatment of gastrointestinal cancers. The focus is on developing technology, limits, and prospective effects on clinical practice.

EARLY STAGES OF COLORECTAL CANCER CHARACTERIZATION BY AUTOFLUORESCENCE 3D MICROSCOPY: A PRELIMINARY STUDY

BACKGROUND

Colorectal cancer is one of the most prevalent pathologies worldwide whose prognosis is linked to early detection. Colonoscopy is the gold standard for screening, and diagnosis is usually made histologically from biopsies. Aiming to reduce the inspection and diagnostic time as well as the biopsies and resources involved, other techniques are being promoted to conduct accurate in vivo colonoscopy assessments. Optical biopsy aims to detect normal and neoplastic tissues analysing the autofluorescence spectrum based on the changes in the distribution and concentration of autofluorescent molecules caused by colorectal cancer. Therefore, the autofluorescence contribution analysed by image processing techniques could be an approach to a faster characterization of the target tissue.

OBJECTIVE

Quantify intensity parameters through digital processing of two data sets of three-dimensional widefield autofluorescence microscopy images, acquired by fresh colon tissue samples from a colorectal cancer murine model. Additionally, analyse the autofluorescence data to provide a characterization over a volume of approximately 50 µm of the colon mucosa for each image, at second (2nd), fourth (4th) and eighth (8th) weeks after colorectal cancer induction.

METHODS

Development of a colorectal cancer murine model using azoxymethane/dextran sodium sulphate induction, and data sets acquisition of Z-stack images by widefield autofluorescence microscopy, from control and colorectal cancer induced animals. Pre-processing steps of intensity value adjustments followed by quantification and characterization procedures using image processing workflow automation by Fiji's macros, and statistical data analysis.

RESULTS

The effectiveness of the colorectal cancer induction model was corroborated by a histological assessment to correlate and validate the link between histological and autofluorescence changes. The image digital processing methodology proposed was then performed on the three-dimensional images from control mice and from the 2nd, 4th, and 8th weeks after colorectal cancer chemical induction, for each data set. Statistical analyses found significant differences in the mean, standard deviation, and minimum parameters between control samples and those of the 2nd week after induction with respect to the 4th week of the first experimental study. This suggests that the characteristics of colorectal cancer can be detected after the 2nd week post-induction.

CONCLUSION

The use of autofluorescence still exhibits levels of variability that prevent greater systematization of the data obtained during the progression of colorectal cancer. However, these preliminary outcomes could be considered an approach to the three-dimensional characterization of the autofluorescence of colorectal tissue, describing the autofluorescence features of samples coming from dysplasia to colorectal cancer.

BACKGROUND

• A new digital image processing method was developed to measure intensity in 3D autofluorescence images of colorectal samples using a CRC mouse model.

BACKGROUND

• This method showed that autofluorescence intensity in colon mucosa is similar in healthy tissue but changes significantly in tumor development.

BACKGROUND

• Statistical analysis revealed CRC traits detectable from the second week post-induction, aiding in early CRC detection.

BACKGROUND

• The study provides a basis for 3D autofluorescence characterization in colorectal tissue from dysplasia to cancer, although variability in autofluorescence limits data systematization during cancer progression.

Optical imaging for screening and early cancer diagnosis in low-resource settings

Low-cost optical imaging technologies have the potential to reduce inequalities in healthcare by improving the detection of pre-cancer or early cancer and enabling more effective and less invasive treatment. In this Review, we summarise technologies for in vivo widefield, multi-spectral, endoscopic, and high-resolution optical imaging that could offer affordable approaches to improve cancer screening and early detection at the point-of-care. Additionally, we discuss approaches to slide-free microscopy, including confocal imaging, lightsheet microscopy, and phase modulation techniques that can reduce the infrastructure and expertise needed for definitive cancer diagnosis. We also evaluate how machine learning-based algorithms can improve the accuracy and accessibility of optical imaging systems and provide real-time image analysis. To achieve the potential of optical technologies, developers must ensure that devices are easy to use; the optical technologies must be evaluated in multi-institutional, prospective clinical tests in the intended setting; and the barriers to commercial scale-up in under-resourced markets must be overcome. Therefore, test developers should view the production of simple and effective diagnostic tools that are accessible and affordable for all countries and settings as a central goal of their profession.

Automatic optical biopsy for colorectal cancer using hyperspectral imaging and artificial neural networks

BACKGROUND

Intraoperative identification of cancerous tissue is fundamental during oncological surgical or endoscopic procedures. This relies on visual assessment supported by histopathological evaluation, implying a longer operative time. Hyperspectral imaging (HSI), a contrast-free and contactless imaging technology, provides spatially resolved spectroscopic analysis, with the potential to differentiate tissue at a cellular level. However, HSI produces "big data", which is impossible to directly interpret by clinicians. We hypothesize that advanced machine learning algorithms (convolutional neural networks-CNNs) can accurately detect colorectal cancer in HSI data.

METHODS

In 34 patients undergoing colorectal resections for cancer, immediately after extraction, the specimen was opened, the tumor-bearing section was exposed and imaged using HSI. Cancer and normal mucosa were categorized from histopathology. A state-of-the-art CNN was developed to automatically detect regions of colorectal cancer in a hyperspectral image. Accuracy was validated with three levels of cross-validation (twofold, fivefold, and 15-fold).

RESULTS

32 patients had colorectal adenocarcinomas confirmed by histopathology (9 left, 11 right, 4 transverse colon, and 9 rectum). 6 patients had a local initial stage (T1-2) and 26 had a local advanced stage (T3-4). The cancer detection performance of the CNN using 15-fold cross-validation showed high sensitivity and specificity (87% and 90%, respectively) and a ROC-AUC score of 0.95 (considered outstanding). In the T1-2 group, the sensitivity and specificity were 89% and 90%, respectively, and in the T3-4 group, the sensitivity and specificity were 81% and 93%, respectively.

CONCLUSIONS

Automatic colorectal cancer detection on fresh specimens using HSI, using a properly trained CNN is feasible and accurate, even with small datasets, regardless of the local tumor extension. In the near future, this approach may become a useful intraoperative tool during oncological endoscopic and surgical procedures, and may result in precise and non-destructive optical biopsies to support objective and consistent tumor-free resection margins.

Using of artificial intelligence: Current and future applications in colorectal cancer screening

Significant developments in colorectal cancer screening are underway and include new screening guidelines that incorporate considerations for patients aged 45 years, with unique features and new techniques at the forefront of screening. One of these new techniques is artificial intelligence which can increase adenoma detection rate and reduce the prevalence of colonic neoplasia.

Optical biopsy mapping on endoscopic image mosaics with a marker-free probe

Gastric cancer is the second leading cause of cancer-related deaths worldwide. Early diagnosis significantly increases the chances of survival; therefore, improved assisted exploration and screening techniques are necessary. Previously, we made use of an augmented multi-spectral endoscope by inserting an optical probe into the instrumentation channel. However, the limited field of view and the lack of markings left by optical biopsies on the tissue complicate the navigation and revisit of the suspect areas probed in-vivo. In this contribution two innovative tools are introduced to significantly increase the traceability and monitoring of patients in clinical practice: (i) video mosaicing to build a more comprehensive and panoramic view of large gastric areas; (ii) optical biopsy targeting and registration with the endoscopic images. The proposed optical flow-based mosaicing technique selects images that minimize texture discontinuities and is robust despite the lack of texture and illumination variations. The optical biopsy targeting is based on automatic tracking of a free-marker probe in the endoscopic view using deep learning to dynamically estimate its pose during exploration. The accuracy of pose estimation is sufficient to ensure a precise overlapping of the standard white-light color image and the hyperspectral probe image, assuming that the small target area of the organ is almost flat. This allows the mapping of all spatio-temporally tracked biopsy sites onto the panoramic mosaic. Experimental validations are carried out from videos acquired on patients in hospital. The proposed technique is purely software-based and therefore easily integrable into clinical practice. It is also generic and compatible to any imaging modality that connects to a fiberscope.

Novel Pixelwise Co-Registered Hematoxylin-Eosin and Multiphoton Microscopy Image Dataset for Human Colon Lesion Diagnosis

Colorectal cancer presents one of the most elevated incidences of cancer worldwide. Colonoscopy relies on histopathology analysis of hematoxylin-eosin (H&E) images of the removed tissue. Novel techniques such as multi-photon microscopy (MPM) show promising results for performing real-time optical biopsies. However, clinicians are not used to this imaging modality and correlation between MPM and H&E information is not clear. The objective of this paper is to describe and make publicly available an extensive dataset of fully co-registered H&E and MPM images that allows the research community to analyze the relationship between MPM and H&E histopathological images and the effect of the semantic gap that prevents clinicians from correctly diagnosing MPM images. The dataset provides a fully scanned tissue images at 10x optical resolution (0.5 µm/px) from 50 samples of lesions obtained by colonoscopies and colectomies. Diagnostics capabilities of TPF and H&E images were compared. Additionally, TPF tiles were virtually stained into H&E images by means of a deep-learning model. A panel of 5 expert pathologists evaluated the different modalities into three classes (healthy, adenoma/hyperplastic, and adenocarcinoma). Results showed that the performance of the pathologists over MPM images was 65% of the H&E performance while the virtual staining method achieved 90%. MPM imaging can provide appropriate information for diagnosing colorectal cancer without the need for H&E staining. However, the existing semantic gap among modalities needs to be corrected.

Confocal Laser Endomicroscopy in the Diagnosis of Biliary and Pancreatic Disorders: A Systematic Analysis

BACKGROUND/AIMS

Endoscopic visualization of the microscopic anatomy can facilitate the real-time diagnosis of pancreatobiliary disorders and provide guidance for treatment. This study aimed to review the technique, image classification, and diagnostic performance of confocal laser endomicroscopy (CLE).

METHODS

We conducted a systematic review of CLE in pancreatic and biliary ducts of humans, and have provided a narrative of the technique, image classification, diagnostic performance, ongoing research, and limitations.

RESULTS

Probe-based CLE differentiates malignant from benign biliary strictures (sensitivity, ≥89%; specificity, ≥61%). Needlebased CLE differentiates mucinous from non-mucinous pancreatic cysts (sensitivity, 59%; specificity, ≥94%) and identifies dysplasia. Pancreatitis may develop in 2-7% of pancreatic cyst cases. Needle-based CLE has potential applications in adenocarcinoma, neuroendocrine tumors, and pancreatitis (chronic or autoimmune). Costs, catheter lifespan, endoscopist training, and interobserver variability are challenges for routine utilization.

CONCLUSION

CLE reveals microscopic pancreatobiliary system anatomy with adequate specificity and sensitivity. Reducing costs and simplifying image interpretation will promote utilization by advanced endoscopists.

First experience in clinical application of hyperspectral endoscopy for evaluation of colonic polyps

Early detection and resection of adenomatous polyps prevents their progression to colorectal cancer (CRC), significantly improving patient outcomes. Polyps are typically identified and removed during white-light colonoscopy. Unfortunately, the rate of interval cancers that arise between CRC screening events remains high, linked to poor visualization of polyps during screening and incomplete polyp removal. Here, we sought to evaluate the potential of a hyperspectral endoscope (HySE) to enhance polyp discrimination for detection and resection. We designed, built and tested a new compact HySE in a proof-of-concept clinical study. We successfully collected spectra from three tissue types in seven patients undergoing routine colonoscopy screening. The acquired spectral data from normal tissue and polyps, both pre- and post- resection, were subjected to quantitative analysis using spectral angle mapping and machine learning, which discriminated the data by tissue type, meriting further investigation of HySE as a clinical tool.

Nanotechnology for Cancer Imaging: Advances, Challenges, and Clinical Opportunities

Nanoparticle (NP) imaging applications have the potential to improve cancer diagnostics, therapeutics, and treatment management. In biomedical research and clinical practice, NPs can serve as labels or labeled carriers for monitoring drug delivery or serve as imaging agents for enhanced imaging contrast, as well as providing improved signal sensitivity and specificity for in vivo imaging of molecular and cellular processes. These qualities offer exciting opportunities for NP-based imaging agents to address current limitations in oncologic imaging. Despite substantial advancements in NP design and development, very few NP-based imaging agents have translated into clinics within the past 5 years. This review highlights some promising NP-enabled imaging techniques and their potential to address current clinical cancer imaging limitations. Although most examples provided herein are from the preclinical space, discussed imaging solutions could offer unique in vivo tools to solve biologic questions, improve cancer treatment effectiveness, and inspire clinical translation innovation to improve patient care. Keywords: Molecular Imaging-Cancer, Molecular Imaging-Nanoparticles, Molecular Imaging-Optical Imaging, Metastases, Oncology, Surgery, Treatment Effects.

Feedforward Artificial Neural Network-Based Colorectal Cancer Detection Using Hyperspectral Imaging: A Step towards Automatic Optical Biopsy

Simple Summary

Detection of colorectal carcinoma is performed visually by investigators and is confirmed pathologically. With hyperspectral imaging, an expanded spectral range of optical information is now available for analysis. The acquired recordings were analyzed with a neural network, and it was possible to differentiate tumor from healthy mucosa in colorectal carcinoma by automatic classification with high reliability. Classification and visualization were performed based on a four-layer perceptron neural network. Based on a neural network, the classification of CA or AD resulted in a sensitivity of 86% and a specificity of 95%, by means of leave-one-patient-out cross-validation. Additionally, significant differences in terms of perfusion parameters (e.g., oxygen saturation) related to tumor staging and neoadjuvant therapy were observed. This is a step towards optical biopsy.

Abstract

Currently, colorectal cancer (CRC) is mainly identified via a visual assessment during colonoscopy, increasingly used artificial intelligence algorithms, or surgery. Subsequently, CRC is confirmed through a histopathological examination by a pathologist. Hyperspectral imaging (HSI), a non-invasive optical imaging technology, has shown promising results in the medical field. In the current study, we combined HSI with several artificial intelligence algorithms to discriminate CRC. Between July 2019 and May 2020, 54 consecutive patients undergoing colorectal resections for CRC were included. The tumor was imaged from the mucosal side with a hyperspectral camera. The image annotations were classified into three groups (cancer, CA; adenomatous margin around the central tumor, AD; and healthy mucosa, HM). Classification and visualization were performed based on a four-layer perceptron neural network. Based on a neural network, the classification of CA or AD resulted in a sensitivity of 86% and a specificity of 95%, by means of leave-one-patient-out cross-validation. Additionally, significant differences in terms of perfusion parameters (e.g., oxygen saturation) related to tumor staging and neoadjuvant therapy were observed. Hyperspectral imaging combined with automatic classification can be used to differentiate between CRC and healthy mucosa. Additionally, the biological changes induced by chemotherapy to the tissue are detectable with HSI.