Handheld multispectral fluorescence lifetime imaging system for in vivo applications

Applications of machine learning in time-domain fluorescence lifetime imaging: a review

Many medical imaging modalities have benefited from recent advances in Machine Learning (ML), specifically in deep learning, such as neural networks. Computers can be trained to investigate and enhance medical imaging methods without using valuable human resources. In recent years, Fluorescence Lifetime Imaging (FLIm) has received increasing attention from the ML community. FLIm goes beyond conventional spectral imaging, providing additional lifetime information, and could lead to optical histopathology supporting real-time diagnostics. However, most current studies do not use the full potential of machine/deep learning models. As a developing image modality, FLIm data are not easily obtainable, which, coupled with an absence of standardisation, is pushing back the research to develop models which could advance automated diagnosis and help promote FLIm. In this paper, we describe recent developments that improve FLIm image quality, specifically time-domain systems, and we summarise sensing, signal-to-noise analysis and the advances in registration and low-level tracking. We review the two main applications of ML for FLIm: lifetime estimation and image analysis through classification and segmentation. We suggest a course of action to improve the quality of ML studies applied to FLIm. Our final goal is to promote FLIm and attract more ML practitioners to explore the potential of lifetime imaging.

Fluorescence lifetime imaging for explosive detection

In this Letter, a time-resolved 120 × 128 pixel single-photon avalanche diode (SPAD) sensor is used in conjunction with an array of organic semiconductor films as a means of detecting the presence of explosive vapors. Using the spatial and temporal resolution of the sensor, both fluorescence intensity and fluorescence lifetime can be monitored on a pixel-by-pixel basis for each of the polymer films arranged in a 2 × 2 grid. This represents a significant improvement on similar systems demonstrated in the past, which either offer spatial resolution without the temporal resolution required to monitor lifetime or offer only a single bulk measurement of lifetime and intensity without the spatial resolution. The potential of the sensing system is demonstrated using vapors of DNT, and differing responses for each of the four polymer films is observed. This system has clear applications as the basis of a portable chemical fingerprinting tool with applications in humanitarian demining and security.

Handheld wide-field fluorescence lifetime imaging system based on a distally mounted SPAD array

In this work a handheld Fluorescent Lifetime IMaging (FLIM) system based on a distally mounted < 2 mm² 128 × 120 single photon avalanche diode (SPAD) array operating over a > 1 m long wired interface is demonstrated. The head of the system is ∼4.5 cm x 4.5 cm x 4.5 cm making it suitable for hand-held ex vivo applications. This is, to the best of the authors' knowledge, the first example of a SPAD array mounted on the distal end of a handheld FLIM system in this manner. All existing systems to date use a fibre to collect and relay fluorescent light to detectors at the proximal end of the system. This has clear potential biological and biomedical applications. To demonstrate this, the system is used to provide contrast between regions of differing tissue composition in ovine kidney samples, and between healthy and stressed or damaged plant leaves. Additionally, FLIM videos are provided showing that frame rates of > 1 Hz are achievable. It is thus an important step in realising an in vivo miniaturized chip-on-tip FLIM endoscopy system.

Direct frequency domain fluorescence lifetime imaging using simultaneous ultraviolet and visible excitation

Due to the complexity, limited practicality, and cost of conventional fluorescence lifetime imaging/microscopy (FLIM) instrumentation, FLIM adoption has been mostly limited to academic settings. We present a novel point scanning frequency-domain (FD) FLIM instrumentation design capable of simultaneous multi-wavelength excitation, simultaneous multispectral detection, and sub-nanosecond to nanosecond fluorescence lifetime estimation. Fluorescence excitation is implemented using intensity-modulated CW diode lasers that are available in a selection of wavelengths spanning the UV-VI-NIR range (375-1064 nm). Digital laser intensity modulation was adopted to enable simultaneous frequency interrogation at the fundamental frequency and corresponding harmonics. Time-resolved fluorescence detection is implemented using low-cost, fixed-gain, narrow bandwidth (100 MHz) avalanche photodiodes, thus, enabling cost-effective fluorescence lifetime measurements at multiple emission spectral bands simultaneously. Synchronized laser modulation and fluorescence signal digitization (250 MHz) is implemented using a common field-programmable gate array (FPGA). This synchronization reduces temporal jitter, which simplifies instrumentation, system calibration, and data processing. The FPGA also allows for the implementation of the real-time processing of the fluorescence emission phase and modulation at up to 13 modulation frequencies (processing rate matching the sampling rate of 250 MHz). Rigorous validation experiments have demonstrated the capabilities of this novel FD-FLIM implementation to accurately measure fluorescence lifetimes in the range of 0.5-12 ns. In vivo endogenous, dual-excitation (375nm/445nm), multispectral (four bands) FD-FLIM imaging of human skin and oral mucosa at 12.5 kHz pixel rate and room-light conditions was also successfully demonstrated. This versatile, simple, compact, and cost-effective FD-FLIM implementation will facilitate the clinical translation of FLIM imaging and microscopy.

Multimodal optical imaging with real-time projection of cancer risk and biopsy guidance maps for early oral cancer diagnosis and treatment

SIGNIFICANCE

Despite recent advances in multimodal optical imaging, oral imaging systems often do not provide real-time actionable guidance to the clinician who is making biopsy and treatment decisions.

AIM

We demonstrate a low-cost, portable active biopsy guidance system (ABGS) that uses multimodal optical imaging with deep learning to directly project cancer risk and biopsy guidance maps onto oral mucosa in real time.

APPROACH

Cancer risk maps are generated based on widefield autofluorescence images and projected onto the at-risk tissue using a digital light projector. Microendoscopy images are obtained from at-risk areas, and multimodal image data are used to calculate a biopsy guidance map, which is projected onto tissue.

RESULTS

Representative patient examples highlight clinically actionable visualizations provided in real time during an imaging procedure. Results show multimodal imaging with cancer risk and biopsy guidance map projection offers a versatile, quantitative, and precise tool to guide biopsy site selection and improve early detection of oral cancers.

CONCLUSIONS

The ABGS provides direct visible guidance to identify early lesions and locate appropriate sites to biopsy within those lesions. This represents an opportunity to translate multimodal imaging into real-time clinically actionable visualizations to help improve patient outcomes.

Clinical label-free endoscopic imaging of biochemical and metabolic autofluorescence biomarkers of benign, precancerous, and cancerous oral lesions

Early detection is critical for improving the survival rate and quality of life of oral cancer patients; unfortunately, dysplastic and early-stage cancerous oral lesions are often difficult to distinguish from oral benign lesions during standard clinical oral examination. Therefore, there is a critical need for novel clinical technologies that would enable reliable oral cancer screening. The autofluorescence properties of the oral epithelial tissue provide quantitative information about morphological, biochemical, and metabolic tissue and cellular alterations accompanying carcinogenesis. This study aimed to identify novel biochemical and metabolic autofluorescence biomarkers of oral dysplasia and cancer that could be clinically imaged using novel multispectral autofluorescence lifetime imaging (maFLIM) endoscopy technologies. In vivo maFLIM clinical endoscopic images of benign, precancerous, and cancerous lesions from 67 patients were acquired using a novel maFLIM endoscope. Widefield maFLIM feature maps were generated, and statistical analyses were applied to identify maFLIM features providing contrast between dysplastic/cancerous vs. benign oral lesions. A total of 14 spectral and time-resolved maFLIM features were found to provide contrast between dysplastic/cancerous vs. benign oral lesions, representing novel biochemical and metabolic autofluorescence biomarkers of oral epithelial dysplasia and cancer. To the best of our knowledge, this is the first demonstration of clinical widefield maFLIM endoscopic imaging of novel biochemical and metabolic autofluorescence biomarkers of oral dysplasia and cancer, supporting the potential of maFLIM endoscopy for early detection of oral cancer.

A layer-level multi-scale architecture for lung cancer classification with fluorescence lifetime imaging endomicroscopy

In this paper, we introduce our unique dataset of fluorescence lifetime imaging endo/microscopy (FLIM), containing over 100,000 different FLIM images collected from 18 pairs of cancer/non-cancer human lung tissues of 18 patients by our custom fibre-based FLIM system. The aim of providing this dataset is that more researchers from relevant fields can push forward this particular area of research. Afterwards, we describe the best practice of image post-processing suitable per the dataset. In addition, we propose a novel hierarchically aggregated multi-scale architecture to improve the binary classification performance of classic CNNs. The proposed model integrates the advantages of multi-scale feature extraction at different levels, where layer-wise global information is aggregated with branch-wise local information. We integrate the proposal, namely ResNetZ, into ResNet, and appraise it on the FLIM dataset. Since ResNetZ can be configured with a shortcut connection and the aggregations by Addition or Concatenation, we first evaluate the impact of different configurations on the performance. We thoroughly examine various ResNetZ variants to demonstrate the superiority. We also compare our model with a feature-level multi-scale model to illustrate the advantages and disadvantages of multi-scale architectures at different levels.

End-to-End Neural Network for Feature Extraction and Cancer Diagnosis of In Vivo Fluorescence Lifetime Images of Oral Lesions

In contrast to previous studies that focused on classical machine learning algorithms and hand-crafted features, we present an end-to-end neural network classification method able to accommodate lesion heterogeneity for improved oral cancer diagnosis using multispectral autofluorescence lifetime imaging (maFLIM) endoscopy. Our method uses an autoencoder framework jointly trained with a classifier designed to handle overfitting problems with reduced databases, which is often the case in healthcare applications. The autoencoder guides the feature extraction process through the reconstruction loss and enables the potential use of unsupervised data for domain adaptation and improved generalization. The classifier ensures the features extracted are task-specific, providing discriminative information for the classification task. The data-driven feature extraction method automatically generates task-specific features directly from fluorescence decays, eliminating the need for iterative signal reconstruction. We validate our proposed neural network method against support vector machine (SVM) baselines, with our method showing a 6.5%-8.3% increase in sensitivity. Our results show that neural networks that implement data-driven feature extraction provide superior results and enable the capacity needed to target specific issues, such as inter-patient variability and the heterogeneity of oral lesions.Clinical relevance- We improve standard classification algorithms for in vivo diagnosis of oral cancer lesions from maFLIm for clinical use in cancer screening, reducing unnecessary biopsies and facilitating early detection of oral cancer.

Machine-Learning Assisted Discrimination of Precancerous and Cancerous from Healthy Oral Tissue Based on Multispectral Autofluorescence Lifetime Imaging Endoscopy

Multispectral autofluorescence lifetime imaging (maFLIM) can be used to clinically image a plurality of metabolic and biochemical autofluorescence biomarkers of oral epithelial dysplasia and cancer. This study tested the hypothesis that maFLIM-derived autofluorescence biomarkers can be used in machine-learning (ML) models to discriminate dysplastic and cancerous from healthy oral tissue. Clinical widefield maFLIM endoscopy imaging of cancerous and dysplastic oral lesions was performed at two clinical centers. Endoscopic maFLIM images from 34 patients acquired at one of the clinical centers were used to optimize ML models for automated discrimination of dysplastic and cancerous from healthy oral tissue. A computer-aided detection system was developed and applied to a set of endoscopic maFLIM images from 23 patients acquired at the other clinical center, and its performance was quantified in terms of the area under the receiver operating characteristic curve (ROC-AUC). Discrimination of dysplastic and cancerous from healthy oral tissue was achieved with an ROC-AUC of 0.81. This study demonstrates the capabilities of widefield maFLIM endoscopy to clinically image autofluorescence biomarkers that can be used in ML models to discriminate dysplastic and cancerous from healthy oral tissue. Widefield maFLIM endoscopy thus holds potential for automated in situ detection of oral dysplasia and cancer.

Multispectral fluorescence lifetime imaging device with a silicon avalanche photodetector

We report the design, development, and characterization of a novel multi-spectral fluorescence lifetime measurement device incorporating solid-state detectors and automated gain control. For every excitation pulse (∼1 µJ, 600 ps), this device records complete fluorescence decay from multiple spectral channels simultaneously within microseconds, using a dedicated UV enhanced avalanche photodetector and analog to digital convert (2.5 GS/s) in each channel. Fast (<2 ms) channel-wise dynamic range adjustment maximizes the signal-to-noise ratio. Fluorophores with known lifetime ranging from 0.5-6.0 ns were used to demonstrate the device accuracy. Current results show the clear benefits of this device compared to existing devices employing microchannel-plate photomultiplier tubes. This is demonstrated by 5-fold reduction of lifetime measurement variability in identical conditions, independent gain adjustment in each spectral band, and 4-times faster imaging speed. The use of solid-state detectors will also facilitate future improved performance and miniaturization of the instrument.

FLIM as a Promising Tool for Cancer Diagnosis and Treatment Monitoring

Fluorescence lifetime imaging microscopy (FLIM) has been rapidly developed over the past 30 years and widely applied in biomedical engineering. Recent progress in fluorophore-dyed probe design has widened the application prospects of fluorescence. Because fluorescence lifetime is sensitive to microenvironments and molecule alterations, FLIM is promising for the detection of pathological conditions. Current cancer-related FLIM applications can be divided into three main categories: (i) FLIM with autofluorescence molecules in or out of a cell, especially with reduced form of nicotinamide adenine dinucleotide, and flavin adenine dinucleotide for cellular metabolism research; (ii) FLIM with Förster resonance energy transfer for monitoring protein interactions; and (iii) FLIM with fluorophore-dyed probes for specific aberration detection. Advancements in nanomaterial production and efficient calculation systems, as well as novel cancer biomarker discoveries, have promoted FLIM optimization, offering more opportunities for medical research and applications to cancer diagnosis and treatment monitoring. This review summarizes cutting-edge researches from 2015 to 2020 on cancer-related FLIM applications and the potential of FLIM for future cancer diagnosis methods and anti-cancer therapy development. We also highlight current challenges and provide perspectives for further investigation.

Mesoscopic fluorescence lifetime imaging: Fundamental principles, clinical applications and future directions

Fluorescence lifetime imaging (FLIm) is an optical spectroscopic imaging technique capable of real-time assessments of tissue properties in clinical settings. Label-free FLIm is sensitive to changes in tissue structure and biochemistry resulting from pathological conditions, thus providing optical contrast to identify and monitor the progression of disease. Technical and methodological advances over the last two decades have enabled the development of FLIm instrumentation for real-time, in situ, mesoscopic imaging compatible with standard clinical workflows. Herein, we review the fundamental working principles of mesoscopic FLIm, discuss the technical characteristics of current clinical FLIm instrumentation, highlight the most commonly used analytical methods to interpret fluorescence lifetime data and discuss the recent applications of FLIm in surgical oncology and cardiovascular diagnostics. Finally, we conclude with an outlook on the future directions of clinical FLIm.

Recent advances in point-of-care diagnostics for oral cancer

Early-stage diagnosis is a crucial step in reducing the mortality rate in oral cancer cases. Point-of-care (POC) devices for oral cancer diagnosis hold great future potential in improving the survival rates as well as the quality of life of oral cancer patients. The conventional oral examination followed by needle biopsy and histopathological analysis have limited diagnostic accuracy. Besides, it involves patient discomfort and is not feasible in resource-limited settings. POC detection of biomarkers and diagnostic adjuncts has emerged as non- or minimally invasive tools for the diagnosis of oral cancer at an early stage. Various biosensors have been developed for the rapid detection of oral cancer biomarkers at the point-of-care. Several optical imaging methods have also been employed as adjuncts to detect alterations in oral tissue indicative of malignancy. This review summarizes the different POC platforms developed for the detection of oral cancer biomarkers, along with various POC imaging and cytological adjuncts that aid in oral cancer diagnosis, especially in low resource settings. Various immunosensors and nucleic acid biosensors developed to detect oral cancer biomarkers are summarized with examples. The different imaging methods used to detect oral tissue malignancy are also discussed herein. Additionally, the currently available commercial devices used as adjuncts in the POC detection of oral cancer are emphasized along with their characteristics. Finally, we discuss the limitations and challenges that persist in translating the developed POC techniques in the clinical settings for oral cancer diagnosis, along with future perspectives.

Enhanced detection of oral dysplasia by structured illumination fluorescence lifetime imaging microscopy

We demonstrate that structured illumination microscopy has the potential to enhance fluorescence lifetime imaging microscopy (FLIM) as an early detection method for oral squamous cell carcinoma. FLIM can be used to monitor or detect changes in the fluorescence lifetime of metabolic cofactors (e.g. NADH and FAD) associated with the onset of carcinogenesis. However, out of focus fluorescence often interferes with this lifetime measurement. Structured illumination fluorescence lifetime imaging (SI-FLIM) addresses this by providing depth-resolved lifetime measurements, and applied to oral mucosa, can localize the collected signal to the epithelium. In this study, the hamster model of oral carcinogenesis was used to evaluate SI-FLIM in premalignant and malignant oral mucosa. Cheek pouches were imaged in vivo and correlated to histopathological diagnoses. The potential of NADH fluorescence signal and lifetime, as measured by widefield FLIM and SI-FLIM, to differentiate dysplasia (pre-malignancy) from normal tissue was evaluated. ROC analysis was carried out with the task of discriminating between normal tissue and mild dysplasia, when changes in fluorescence characteristics are localized to the epithelium only. The results demonstrate that SI-FLIM (AUC = 0.83) is a significantly better (p-value = 0.031) marker for mild dysplasia when compared to widefield FLIM (AUC = 0.63).

Fluorescence lifetime imaging via spatio-temporal speckle patterns in a single-pixel camera configuration

Photoluminescence (PL) spectroscopy offers excellent methods for mapping the PL decay on the nanosecond time scale. However, capturing maps of emission dynamics on the microsecond timescale can be highly time-consuming. We present a new approach to fluorescence lifetime imaging (FLIM), which combines the concept of random temporal speckles excitation (RATS) with the concept of a single-pixel camera based on spatial speckles. The spatio-temporal speckle pattern makes it possible to map PL dynamics with unmatched simplicity. Moreover, the method can acquire all the data necessary to map PL decay on the microsecond timescale within minutes. We present proof-of-principle measurements for two samples and compare the reconstructed decays to the non-imaging measurements. Finally, we discuss the effect of the preprocessing routine and other factors on the reconstruction noise level. The presented method is suitable for lifetime imaging processes in several samples, including monitoring charge carrier dynamics in perovskites or monitoring solid-state luminophores with a long lifetime of PL.

Real-time multispectral fluorescence lifetime imaging using Single Photon Avalanche Diode arrays

Autofluorescence spectroscopy has emerged in recent years as a powerful tool to report label-free contrast between normal and diseased tissues, both in vivo and ex vivo. We report the development of an instrument employing Single Photon Avalanche Diode (SPAD) arrays to realize real-time multispectral autofluorescence lifetime imaging at a macroscopic scale using handheld single-point fibre optic probes, under bright background conditions. At the detection end, the fluorescence signal is passed through a transmission grating and both spectral and temporal information are encoded in the SPAD array. This configuration allows interrogation in the spectral range of interest in real time. Spatial information is provided by an external camera together with a guiding beam that provides a visual reference that is tracked in real-time. Through fast image processing and data analysis, fluorescence lifetime maps are augmented on white light images to provide feedback of the measurements in real-time. We validate and demonstrate the practicality of this technique in the reference fluorophores and in articular cartilage samples mimicking the degradation that occurs in osteoarthritis. Our results demonstrate that SPADs together with fibre probes can offer means to report autofluorescence spectral and lifetime contrast in real-time and thus are suitable candidates for in situ tissue diagnostics.

Optical Biopsy of the Upper GI Tract Using Fluorescence Lifetime and Spectra

Screening and surveillance for gastrointestinal (GI) cancers by endoscope guided biopsy is invasive, time consuming, and has the potential for sampling error. Tissue endogenous fluorescence spectra contain biochemical and physiological information, which may enable real-time, objective diagnosis. We first briefly reviewed optical biopsy modalities for GI cancer diagnosis with a focus on fluorescence-based techniques. In an ex vivo pilot clinical study, we measured fluorescence spectra and lifetime on fresh biopsy specimens obtained during routine upper GI screening procedures. Our results demonstrated the feasibility of rapid acquisition of time-resolved fluorescence (TRF) spectra from fresh GI mucosal specimens. We also identified spectroscopic signatures that can differentiate between normal mucosal samples obtained from the esophagus, stomach, and duodenum.

Clinical label-free biochemical and metabolic fluorescence lifetime endoscopic imaging of precancerous and cancerous oral lesions

INTRODUCTION

Incomplete head and neck cancer resection occurs in up to 85% of cases, leading to increased odds of local recurrence and regional metastases; thus, image-guided surgical tools for accurate, in situ and fast detection of positive margins during head and neck cancer resection surgery are urgently needed. Oral epithelial dysplasia and cancer development is accompanied by morphological, biochemical, and metabolic tissue and cellular alterations that can modulate the autofluorescence properties of the oral epithelial tissue.

OBJECTIVE

This study aimed to test the hypothesis that autofluorescence biomarkers of oral precancer and cancer can be clinically imaged and quantified by means of multispectral fluorescence lifetime imaging (FLIM) endoscopy.

METHODS

Multispectral autofluorescence lifetime images of precancerous and cancerous lesions from 39 patients were imaged in vivo using a novel multispectral FLIM endoscope and processed to generate widefield maps of biochemical and metabolic autofluorescence biomarkers of oral precancer and cancer.

RESULTS

Statistical analyses applied to the quantified multispectral FLIM endoscopy based autofluorescence biomarkers indicated their potential to provide contrast between precancerous/cancerous vs. healthy oral epithelial tissue.

CONCLUSION

To the best of our knowledge, this study represents the first demonstration of label-free biochemical and metabolic clinical imaging of precancerous and cancerous oral lesions by means of widefield multispectral autofluorescence lifetime endoscopy. Future studies will focus on demonstrating the capabilities of endogenous multispectral FLIM endoscopy as an image-guided surgical tool for positive margin detection during head and neck cancer resection surgery.

Development of a Robust Autofluorescence Lifetime Sensing Method for Use in an Endoscopic Application

Endoscopic autofluorescence lifetime imaging is a promising technique for making quantitative and non-invasive diagnoses of abnormal tissue. However, motion artifacts caused by vibration in the direction perpendicular to the tissue surface in a body makes clinical diagnosis difficult. Thus, this paper proposes a robust autofluorescence lifetime sensing technique with a lens tracking system based on a laser beam spot analysis. Our optical setup can be easily mounted on the head of an endoscope. The variation in distance between the optical system and the target surface is tracked by the change in the spot size of the laser beam captured by the camera, and the lens actuator is feedback-controlled to suppress motion artifacts. The experimental results show that, when using a lens tracking system, the standard deviation of fluorescence lifetime is dramatically reduced. Furthermore, the validity of the proposed method is experimentally confirmed by using a bio-mimicking phantom that replicates the shape, optical parameters, and chemical component distribution of the cancerous tissue.

Multispectral autofluorescence dermoscope for skin lesion assessment

Basal cell carcinoma (BCC) is the most common type of skin cancer. Diagnosis and edge assessment of BCC lesions are based on clinical and dermoscopy evaluation, which are strongly dependent on the expertise and training of the physician. There is a high rate of underdiagnosis because BCC is frequently confused with certain common benign lesions and is often indistinguishable from the surrounding healthy tissue. In the present study, a multispectral fluorescence lifetime imaging (FLIm) dermoscopy system, designed for imaging and analyzing the autofluorescence emission of skin tissue, was used to image thirty-eight patients with diagnosed nodular BCC (nBCC) lesions, using clinically acceptable levels of excitation light exposure. With this system, skin autofluorescence was imaged simultaneously using three emission bands: 390 ± 20 nm, 452 ± 22 nm, and >496 nm, preferentially targeting collagen, NADH, and FAD autofluorescence, respectively. Statistical classifiers based on FLIm features developed to discriminate BCC from healthy tissue showed promising performance (ROC area-under-the-curve of 0.82). This study demonstrates the feasibility of clinically performing multispectral endogenous FLIm dermoscopy providing baseline results indicating the potential of this technology as an image-guided tool to improve the delineation of nBCC during surgical lesion resection.

Endogenous Fluorescence Lifetime Imaging (FLIM) Endoscopy For Early Detection Of Oral Cancer And Dysplasia

We have performed a pilot clinical study, in which multispectral endogenous fluorescence (or autofluorescence) lifetime imaging (FLIM) was performed on clinically suspicious oral lesions of 73 patients undergoing tissue biopsy for oral dysplasia and cancer diagnosis. The results from this pilot study indicated that mild-dysplasia and early stage oral cancer could be detected from benign lesions using a computed aided diagnosis system developed based on biochemical and metabolic biomarkers derived from the endogenous FLIM images. The diagnostic performance of this novel FLIM clinical tool was estimated using a leave-onepatient-out cross-validation approach, which reported levels of sensitivity >90%, specificity >85%, and Area Under the Receiving Operating Curve (ROC-AUC) >0.9.

Feasibility of a Video-Mosaicking Approach to Extend the Field-of-View For Reflectance Confocal Microscopy in the Oral Cavity In Vivo

BACKGROUND

Reflectance confocal microscopy (RCM) is a developing approach for noninvasive detection of oral lesions with label-free contrast and cellular-level resolution. For access into the oral cavity, confocal microscopes are being configured with small-diameter telescopic probes and small objective lenses. However, a small probe and objective lens allows for a rather small field-of-view relative to the large areas of tissue that must be examined for diagnosis. To extend the field-of-view for intraoral RCM imaging, we are investigating a video-mosaicking approach.

METHODS

A relay telescope and objective lens were adapted to an existing confocal microscope for access into the oral cavity. Imaging was performed using metal three-dimensional-printed objective lens front-end caps with coverslip windows to contact and stabilize the tissue and set depth. Four healthy volunteers (normal oral mucosa), one patient (with an amalgam tattoo) in a clinical setting, and 20 anesthetized patients (with oral squamous cell carcinoma [OSCC]) in a surgical setting were imaged. Instead of the usual still RCM images, videos were recorded and then processed into video-mosaics. Thirty video-mosaics were read and qualitatively assessed by an expert reader of RCM images of the oral mucosa.

RESULTS

Whereas the objective lens' native field-of-view is 0.75 mm × 0.75 mm, the video-mosaics display larger areas, ranging from 2 mm × 2 mm to 4 mm × 2 mm, with resolution, morphologic detail, and image quality that is preserved relative to that observed in the original videos (individual images). Video-mosaics in healthy volunteers' and the patients' images showed cellular morphologic patterns in the lower epithelium and at the epithelial junction, and connective tissue along with capillary loops and blood flow in the deeper lamina propria. In OSCC, tumor nests could be observed along with normal looking mucosa in margin areas.

CONCLUSIONS

Video-mosaicking is a reasonably quick and efficient approach for extending the field-of-view of RCM imaging, which can, to some extent, overcome the inherent limitation of an intraoral probe's small field-of-view. Reading video-mosaics can mimic the procedure for examining pathology: initial visualization of the spatial cellular and morphologic patterns of the tumor and the spread of tumor margins over larger areas of the lesion, followed by digitally zooming (magnifying) for closer inspection of suspicious areas. However, faster processing of videos into video-mosaics will be necessary, to allow examination of video-mosaics in real-time at the bedside. Lasers Surg. Med. 51:439-451, 2019. © 2019 Wiley Periodicals, Inc.

Multispectral Depth-Resolved Fluorescence Lifetime Spectroscopy Using SPAD Array Detectors and Fiber Probes

Single Photon Avalanche Diode (SPAD) arrays are increasingly exploited and have demonstrated potential in biochemical and biomedical research, both for imaging and single-point spectroscopy applications. In this study, we explore the application of SPADs together with fiber-optic-based delivery and collection geometry to realize fast and simultaneous single-point time-, spectral-, and depth-resolved fluorescence measurements at 375 nm excitation light. Spectral information is encoded across the columns of the array through grating-based dispersion, while depth information is encoded across the rows thanks to a linear arrangement of probe collecting fibers. The initial characterization and validation were realized against layered fluorescent agarose-based phantoms. To verify the practicality and feasibility of this approach in biological specimens, we measured the fluorescence signature of formalin-fixed rabbit aorta samples derived from an animal model of atherosclerosis. The initial results demonstrate that this detection configuration can report fluorescence spectral and lifetime contrast originating at different depths within the specimens. We believe that our optical scheme, based on SPAD array detectors and fiber-optic probes, constitute a powerful and versatile approach for the deployment of multidimensional fluorescence spectroscopy in clinical applications where information from deeper tissue layers is important for diagnosis.

Noninvasive Optical Assessment of Implanted Engineered Tissues Correlates with Cytokine Secretion

Fluorescence lifetime sensing has been shown to noninvasively characterize the preimplantation health and viability of engineered tissue constructs. However, current practices to monitor postimplantation construct integration are either qualitative (visual assessment) or destructive (tissue histology). We employed label-free fluorescence lifetime spectroscopy for quantitative, noninvasive optical assessment of engineered tissue constructs that were implanted into a murine model. The portable system was designed to be suitable for intravital measurements and included a handheld probe to precisely and rapidly acquire data at multiple sites per construct. Our model tissue constructs were manufactured from primary human cells to simulate patient variability based on a standard protocol, and half of the manufactured constructs were stressed to create a range of health states. Secreted amounts of three cytokines that relate to cellular viability were measured in vitro to assess preimplantation construct health: interleukin-8 (IL-8), human β-defensin 1 (hBD-1), and vascular endothelial growth factor (VEGF). Preimplantation cytokine secretion ranged from 1.5 to 33.5 pg/mL for IL-8, from 3.4 to 195.0 pg/mL for hBD-1, and from 0.1 to 154.3 pg/mL for VEGF. In vivo optical sensing assessed constructs at 1 and 3 weeks postimplantation. We found that at 1 week postimplantation, in vivo optical parameters correlated with in vitro preimplantation secretion levels of all three cytokines (p < 0.05). This correlation was not observed in optical measurements at 3 weeks postimplantation when histology showed that the constructs had re-epithelialized, independent of preimplantation health state, supporting the lack of a correlation. These results suggest that clinical optical diagnostic tools based on label-free fluorescence lifetime sensing of endogenous tissue fluorophores could noninvasively monitor postimplantation integration of engineered tissues.

Real-time visualization of two-photon fluorescence lifetime imaging microscopy using a wavelength-tunable femtosecond pulsed laser

A fluorescence lifetime imaging microscopy (FLIM) integrated with two-photon excitation technique was developed. A wavelength-tunable femtosecond pulsed laser with nominal pulse repetition rate of 76-MHz was used to acquire FLIM images with a high pixel rate of 3.91 MHz by processing the pulsed two-photon fluorescence signal. Analog mean-delay (AMD) method was adopted to accelerate the lifetime measurement process and to visualize lifetime map in real-time. As a result, rapid tomographic visualization of both structural and chemical properties of the tissues was possible with longer depth penetration and lower photo-damage compared to the conventional single-photon FLIM techniques.

Protein-bound NAD(P)H Lifetime is Sensitive to Multiple Fates of Glucose Carbon

While NAD(P)H fluorescence lifetime imaging (FLIM) can detect changes in flux through the TCA cycle and electron transport chain (ETC), it remains unclear whether NAD(P)H FLIM is sensitive to other potential fates of glucose. Glucose carbon can be diverted from mitochondria by the pentose phosphate pathway (via glucose 6-phosphate dehydrogenase, G6PDH), lactate production (via lactate dehydrogenase, LDH), and rejection of carbon from the TCA cycle (via pyruvate dehydrogenase kinase, PDK), all of which can be upregulated in cancer cells. Here, we demonstrate that multiphoton NAD(P)H FLIM can be used to quantify the relative concentrations of recombinant LDH and malate dehydrogenase (MDH) in solution. In multiple epithelial cell lines, NAD(P)H FLIM was also sensitive to inhibition of LDH and PDK, as well as the directionality of LDH in cells forced to use pyruvate versus lactate as fuel sources. Among the parameters measurable by FLIM, only the lifetime of protein-bound NAD(P)H (τ₂) was sensitive to these changes, in contrast to the optical redox ratio, mean NAD(P)H lifetime, free NAD(P)H lifetime, or the relative amount of free and protein-bound NAD(P)H. NAD(P)H τ₂ offers the ability to non-invasively quantify diversions of carbon away from the TCA cycle/ETC, which may support mechanisms of drug resistance.

Noninvasive diagnostic adjuncts for the evaluation of potentially premalignant oral epithelial lesions: current limitations and future directions

Potentially premalignant oral epithelial lesions (PPOELs) are a group of clinically suspicious conditions, of which a small percentage will undergo malignant transformation. PPOELs are suboptimally diagnosed and managed under the current standard of care. Dysplasia is the most well-established marker to distinguish high-risk PPOELs from low-risk PPOELs, and performing a biopsy to establish dysplasia is the diagnostic gold standard. However, a biopsy is limited by morbidity, resource requirements, and the potential for underdiagnosis. Diagnostic adjuncts may help clinicians better evaluate PPOELs before definitive biopsy, but existing adjuncts, such as toluidine blue, acetowhitening, and autofluorescence imaging, have poor accuracy and are not generally recommended. Recently, in vivo microscopy technologies, such as high-resolution microendoscopy, optical coherence tomography, reflectance confocal microscopy, and multiphoton imaging, have shown promise for improving PPOEL patient care. These technologies allow clinicians to visualize many of the same microscopic features used for histopathologic assessment at the point of care.

Molecular mobility and activity in an intravital imaging setting - implications for cancer progression and targeting

Molecular mobility, localisation and spatiotemporal activity are at the core of cell biological processes and deregulation of these dynamic events can underpin disease development and progression. Recent advances in intravital imaging techniques in mice are providing new avenues to study real-time molecular behaviour in intact tissues within a live organism and to gain exciting insights into the intricate regulation of live cell biology at the microscale level. The monitoring of fluorescently labelled proteins and agents can be combined with autofluorescent properties of the microenvironment to provide a comprehensive snapshot of in vivo cell biology. In this Review, we summarise recent intravital microscopy approaches in mice, in processes ranging from normal development and homeostasis to disease progression and treatment in cancer, where we emphasise the utility of intravital imaging to observe dynamic and transient events in vivo We also highlight the recent integration of advanced subcellular imaging techniques into the intravital imaging pipeline, which can provide in-depth biological information beyond the single-cell level. We conclude with an outlook of ongoing developments in intravital microscopy towards imaging in humans, as well as provide an overview of the challenges the intravital imaging community currently faces and outline potential ways for overcoming these hurdles.

Optically sectioned wide-field fluorescence lifetime imaging microscopy enabled by structured illumination

In this paper, we demonstrate the ability of structured illumination microscopy to enhance the ability of fluorescence lifetime imaging to resolve fluorescence lifetimes in relatively thick samples that possess distinct but spectrally overlapping fluorescent layers. Structured illumination fluorescent lifetime imaging microscopy (SI-FLIM) is shown to be able to accurately reconstruct lifetime values in homogenous fluorophore samples (POPOP, NADH, and FAD) as well as accurately measure fluorescent lifetime in two layer models that are layered with NADH/FAD over POPOP, where NADH/FAD and POPOP have spectral overlap. Finally, the ability of SI-FLIM was demonstrated in a hamster cheek pouch ex vivo to show that more accurate lifetimes could be measured for each layer of interest in the oral mucosa (epithelium and submucosa).

Automated algorithm for actinic cheilitis diagnosis by wide-field fluorescence imaging

Actinic cheilitis (AC) is a disease caused by prolonged and cumulative sun exposure that mostly affects the lower lip, which can progress to a lip squamous cell carcinoma. Routine diagnosis relies on clinician experience and training. We investigated the diagnostic efficacy of wide-field fluorescence imaging coupled to an automated algorithm for AC recognition. Fluorescence images were acquired from 57 patients with confirmed AC and 46 normal volunteers. Three different algorithms were employed: two based on the emission characteristics of local heterogeneity, entropy and intensity range, and one based on the number of objects after K-mean clustering. A classification model was obtained using a fivefold cross correlation algorithm. Sensitivity and specificity rates were 86% and 89.1%, respectively.

Objective Detection of Oral Carcinoma with Multispectral Fluorescence Lifetime Imaging In Vivo

Successful early detection and demarcation of oral carcinoma can greatly impact the associated morbidity and mortality rates. Current methods for detection of oral cancer include comprehensive visual examination of the oral cavity, typically followed by tissue biopsy. A noninvasive means to guide the clinician in making a more objective and informed decision toward tissue biopsy can potentially improve the diagnostic yield of this process. To this end, we investigate the potential of fluorescence lifetime imaging (FLIM) for objective detection of oral carcinoma in the hamster cheek pouch model of oral carcinogenesis in vivo. We report that systematically selected FLIM features can differentiate between low-risk (normal, benign and low-grade dysplasia) and high-risk (high-grade dysplasia and cancer) oral lesions with sensitivity and specificity of 87.26% and 93.96%, respectively. We also show the ability of FLIM to generate "disease" maps of the tissue which can be used to evaluate relative risk of neoplasia. The results demonstrate the potential of multispectral FLIM with objective image analysis as a noninvasive tool to guide comprehensive oral examination.

A novel multimodal optical imaging system for early detection of oral cancer

OBJECTIVES

Several imaging techniques have been advocated as clinical adjuncts to improve identification of suspicious oral lesions. However, these have not yet shown superior sensitivity or specificity over conventional oral examination techniques. We developed a multimodal, multi-scale optical imaging system that combines macroscopic biochemical imaging of fluorescence lifetime imaging with subcellular morphologic imaging of reflectance confocal microscopy for early detection of oral cancer. We tested our system on excised human oral tissues.

STUDY DESIGN

In total, 4 tissue specimens were imaged. These specimens were diagnosed as either clinically normal, oral lichen planus, gingival hyperplasia, or superficially invasive squamous cell carcinoma. The optical and fluorescence lifetime properties of each specimen were recorded.

RESULTS

Both quantitative and qualitative differences among normal, benign, and squamous cell carcinoma lesions can be resolved with fluorescence lifetime imaging reflectance confocal microscopy. The results demonstrate that an integrated approach based on these two methods can potentially enable rapid screening and evaluation of large areas of oral epithelial tissue.

CONCLUSIONS

Early results from ongoing studies of imaging human oral cavity illustrate the synergistic combination of the 2 modalities. An adjunct device based on such optical characterization of oral mucosa can potentially be used to detect oral carcinogenesis in early stages.