The Dual Luminescence Lifetime pH/Oxygen Sensor: Evaluation of Applicability for Intravital Analysis of 2D- and 3D-Cultivated Human Endometrial Mesenchymal Stromal Cells

The oxygenation of cells and tissues and acidification of the cellular endolysosomal system are among the major factors that ensure normal functioning of an organism and are violated in various pathologies. Recording of these parameters and their changes under various conditions is an important task for both basic research and clinical applications. In the present work, we utilized internalizable dual pH/O2 lifetime sensor (Ir-HSA-FITC) based on the covalent conjugation of human serum albumin (HSA) with fluorescein isothiocyanate (FITC) as pH sensor and an orthometalated iridium complex as O2 sensor. The probe was tested for simultaneous detection of acidification level and oxygen concentration in endolysosomes of endometrial mesenchymal stem/stromal cells (enMSCs) cultivated as 2D monolayers and 3D spheroids. Using a combined FLIM/PLIM approach, we found that due to high autofluorescence of enMSCs FITC lifetime signal in control cells was insufficient to estimate pH changes. However, using flow cytometry and confocal microscopy, we managed to detect the FITC signal response to inhibition of endolysosomal acidification by Bafilomycin A1. The iridium chromophore phosphorescence was detected reliably by all methods used. It was demonstrated that the sensor, accumulated in endolysosomes for 24 h, disappeared from proliferating 2D enMSCs by 72 h, but can still be recorded in non-proliferating spheroids. PLIM showed high sensitivity and responsiveness of iridium chromophore phosphorescence to experimental hypoxia both in 2D and 3D cultures. In spheroids, the phosphorescence signal was detected at a depth of up to 60 μm using PLIM and showed a gradient in the intracellular O2 level towards their center.

Building Fluorescence Lifetime Maps Photon-by-Photon by Leveraging Spatial Correlations

Fluorescence lifetime imaging microscopy (FLIM) has become a standard tool in the quantitative characterization of subcellular environments. However, quantitative FLIM analyses face several challenges. First, spatial correlations between pixels are often ignored as signal from individual pixels is analyzed independently thereby limiting spatial resolution. Second, existing methods deduce photon ratios instead of absolute lifetime maps. Next, the number of fluorophore species contributing to the signal is unknown, while excited state lifetimes with <1 ns difference are difficult to discriminate. Finally, existing analyses require high photon budgets and often cannot rigorously propagate experimental uncertainty into values over lifetime maps and number of species involved. To overcome all of these challenges simultaneously and self-consistently at once, we propose the first doubly nonparametric framework. That is, we learn the number of species (using Beta-Bernoulli process priors) and absolute maps of these fluorophore species (using Gaussian process priors) by leveraging information from pulses not leading to observed photon. We benchmark our framework using a broad range of synthetic and experimental data and demonstrate its robustness across a number of scenarios including cases where we recover lifetime differences between species as small as 0.3 ns with merely 1000 photons.

Low-rate smartphone videoscopy for microsecond luminescence lifetime imaging with machine learning

Time-resolved techniques have been widely used in time-gated and luminescence lifetime imaging. However, traditional time-resolved systems require expensive lab equipment such as high-speed excitation sources and detectors or complicated mechanical choppers to achieve high repetition rates. Here, we present a cost-effective and miniaturized smartphone lifetime imaging system integrated with a pulsed ultraviolet (UV) light-emitting diode (LED) for 2D luminescence lifetime imaging using a videoscopy-based virtual chopper (V-chopper) mechanism combined with machine learning. The V-chopper method generates a series of time-delayed images between excitation pulses and smartphone gating so that the luminescence lifetime can be measured at each pixel using a relatively low acquisition frame rate (e.g. 30 frames per second [fps]) without the need for excitation synchronization. Europium (Eu) complex dyes with different luminescent lifetimes ranging from microseconds to seconds were used to demonstrate and evaluate the principle of V-chopper on a 3D-printed smartphone microscopy platform. A convolutional neural network (CNN) model was developed to automatically distinguish the gated images in different decay cycles with an accuracy of >99.5%. The current smartphone V-chopper system can detect lifetime down to ∼75 µs utilizing the default phase shift between the smartphone video rate and excitation pulses and in principle can detect much shorter lifetimes by accurately programming the time delay. This V-chopper methodology has eliminated the need for the expensive and complicated instruments used in traditional time-resolved detection and can greatly expand the applications of time-resolved lifetime technologies.

Computational macroscopic lifetime imaging and concentration unmixing of autofluorescence

Single-pixel computational imaging can leverage highly sensitive detectors that concurrently acquire data across spectral and temporal domains. For molecular imaging, such methodology enables to collect rich intensity and lifetime multiplexed fluorescence datasets. Herein we report on the application of a single-pixel structured light-based platform for macroscopic imaging of tissue autofluorescence. The super-continuum visible excitation and hyperspectral single-pixel detection allow for parallel characterization of autofluorescence intensity and lifetime. Furthermore, we exploit a deep learning based data processing pipeline, to perform autofluorescence unmixing while yielding the autofluorophores' concentrations. The full scheme (setup and processing) is validated in silico and in vitro with clinically relevant autofluorophores flavin adenine dinucleotide, riboflavin, and protoporphyrin. The presented results demonstrate the potential of the methodology for macroscopically quantifying the intensity and lifetime of autofluorophores, with higher specificity for cases of mixed emissions, which are ubiquitous in autofluorescence and multiplexed in vivo imaging.

Deep learning in macroscopic diffuse optical imaging

SIGNIFICANCE

Biomedical optics system design, image formation, and image analysis have primarily been guided by classical physical modeling and signal processing methodologies. Recently, however, deep learning (DL) has become a major paradigm in computational modeling and has demonstrated utility in numerous scientific domains and various forms of data analysis.

AIM

We aim to comprehensively review the use of DL applied to macroscopic diffuse optical imaging (DOI).

APPROACH

First, we provide a layman introduction to DL. Then, the review summarizes current DL work in some of the most active areas of this field, including optical properties retrieval, fluorescence lifetime imaging, and diffuse optical tomography.

RESULTS

The advantages of using DL for DOI versus conventional inverse solvers cited in the literature reviewed herein are numerous. These include, among others, a decrease in analysis time (often by many orders of magnitude), increased quantitative reconstruction quality, robustness to noise, and the unique capability to learn complex end-to-end relationships.

CONCLUSIONS

The heavily validated capability of DL's use across a wide range of complex inverse solving methodologies has enormous potential to bring novel DOI modalities, otherwise deemed impractical for clinical translation, to the patient's bedside.

Near-infrared probes for luminescence lifetime imaging

Biomedical luminescence imaging in the near-infrared (NIR, 700-1700 nm) region has shown great potential in visualizing biological processes and pathological conditions at cellular and animal levels, owing to the reduced tissue absorption and scattering compared to light in the visible (400-700 nm) region. To overcome the background interference and signal attenuation during intensity-based luminescence imaging, lifetime imaging has demonstrated a reliable imaging modality complementary to intensity measurement. Several selective or environment-responsive probes have been successfully developed for luminescence lifetime imaging and multiplex detection. This review summarizes recent advances in the application of luminescence lifetime imaging at cellular and animal levels in NIR-I and NIR-II regions. Finally, the challenges and further directions of luminescence lifetime imaging are also discussed.

Optimal parameters in variable-velocity scanning luminescence lifetime microscopy

We determine the optimal parameters (scan velocities) for measuring the luminescence lifetime on the microsecond scale using the recently introduced method based on scanning the excitation beam across the sample. Using simulations, we evaluate the standard deviation and bias of the luminescence decay rate determined by scanning with two different velocities. The analysis is performed for Poisson- and normal-distributed signals, representing different types of detection techniques. We also show that a weak uncorrected background induces a bias in the obtained decay rate, and take this effect into account when choosing optimal measurement parameters. For comparison, the analysis is additionally performed for two conventional gating schemes for lifetime measurement. The variable-velocity scanning method is found to be more robust to the effect of the background signal than the gating schemes.

Multiplexed non-invasive tumor imaging of glucose metabolism and receptor-ligand engagement using dark quencher FRET acceptor

Rationale: Following an ever-increased focus on personalized medicine, there is a continuing need to develop preclinical molecular imaging modalities to guide the development and optimization of targeted therapies. Near-Infrared (NIR) Macroscopic Fluorescence Lifetime Förster Resonance Energy Transfer (MFLI-FRET) imaging offers a unique method to robustly quantify receptor-ligand engagement in live intact animals, which is critical to assess the delivery efficacy of therapeutics. However, to date, non-invasive imaging approaches that can simultaneously measure cellular drug delivery efficacy and metabolic response are lacking. A major challenge for the implementation of concurrent optical and MFLI-FRET in vivo whole-body preclinical imaging is the spectral crowding and cross-contamination between fluorescent probes. Methods: We report on a strategy that relies on a dark quencher enabling simultaneous assessment of receptor-ligand engagement and tumor metabolism in intact live mice. Several optical imaging approaches, such as in vitro NIR FLI microscopy (FLIM) and in vivo wide-field MFLI, were used to validate a novel donor-dark quencher FRET pair. IRDye 800CW 2-deoxyglucose (2-DG) imaging was multiplexed with MFLI-FRET of NIR-labeled transferrin FRET pair (Tf-AF700/Tf-QC-1) to monitor tumor metabolism and probe uptake in breast tumor xenografts in intact live nude mice. Immunohistochemistry was used to validate in vivo imaging results. Results: First, we establish that IRDye QC-1 (QC-1) is an effective NIR dark acceptor for the FRET-induced quenching of donor Alexa Fluor 700 (AF700). Second, we report on simultaneous in vivo imaging of the metabolic probe 2-DG and MFLI-FRET imaging of Tf-AF700/Tf-QC-1 uptake in tumors. Such multiplexed imaging revealed an inverse relationship between 2-DG uptake and Tf intracellular delivery, suggesting that 2-DG signal may predict the efficacy of intracellular targeted delivery. Conclusions: Overall, our methodology enables for the first time simultaneous non-invasive monitoring of intracellular drug delivery and metabolic response in preclinical studies.

Quantitative Mapping of Liver Hypoxia in Living Mice Using Time-Resolved Wide-Field Phosphorescence Lifetime Imaging

Hypoxia has been identified to contribute the pathogenesis of a wide range of liver diseases, and therefore, quantitative mapping of liver hypoxia is important for providing critical information in the diagnosis and treatment of hepatic diseases. However, the existing imaging methods are unsuitable to quantitatively assess liver hypoxia due to the need of liver-specific contrast agents and be easily affected by other imaging factors. Here, a time-resolved lifetime-based imaging method is established for quantitative mapping of the distribution of hypoxia in the livers of mice by combining a wide-field luminescence lifetime imaging system with an oxygen-sensitive nanoprobe. It is shown that the method is suitable for real-time quantification of the change of oxygen pressure in the process of hepatic ischemia-reperfusion of the mouse. Moreover, the developed lifetime imaging methodology is used to quantitatively map liver hypoxia regions in the mouse model of orthotopic liver tumor, where the average oxygen pressure in tumorous liver is far below the normal liver.

Luminescence Lifetime-Based In Vivo Detection with Responsive Rare Earth-Dye Nanocomposite

For years, luminescence lifetime imaging has served as a quantitative tool in indicating intracellular components and activities. However, very few studies involve the in vivo study of animals, especially in vivo stimuli-responsive activities of animals, as both excitation and emission wavelengths should fall into the near-infrared (NIR) optical transparent window (660-950 and 1000-1500 nm). Herein, this work reports a lifetime-responsive nanocomposite with both excitation and emission in the NIR I window (800 nm) and lifetime in the microsecond region. The incorporation of Tm³⁺ -doped rare-earth nanocrystals and NIR dye builds an efficient energy transfer pathway that enables a tunable luminescence lifetime range. The NaYF₄ :Tm nanocrystal, which absorbs and emits photons at the same energy level, is found to be 33 times brighter than optimized core-shell upconversion nanocrystals, and proved to be an effective donor for NIR luminescence resonance energy transfer (LRET). The anti-interference capability of luminescence lifetime signals is further confirmed by luminescence and lifetime imaging. In vivo studies also verify the lifetime response upon stimulation generated in an arthritis mouse model. This work introduces an intriguing tool for luminescence lifetime-based sensing in the microsecond region.

Dual-Emissive Phosphorescent Polymer Probe for Accurate Temperature Sensing in Living Cells and Zebrafish Using Ratiometric and Phosphorescence Lifetime Imaging Microscopy

Temperature plays an important part in many biochemical processes. Accurate diagnosis and proper treatment usually depend on precise measurement of temperature. In this work, a dual-emissive phosphorescent polymer temperature probe, composed of iridium(III) complexes as temperature sensitive unit with phosphorescence lifetime of ∼500 ns and europium(III) complexes as reference unit with lifetime of ∼400 μs, has been rationally designed and synthesized. Upon the increase of the temperature, the luminescence intensity from the iridium(III) complexes is enhanced, while that from the europium(III) complexes remains unchanged, which makes it possible for the ratiometric detection of temperature. Furthermore, the polymer also displays a significant change in emission lifetime accompanied by the temperature variation. By utilizing the laser scanning confocal microscope and time-resolved luminescence imaging systems, ratiometric and time-resolved luminescence imaging in Hela cells and zebrafish have been carried out. Notably, the intensity ratio and long-lifetime-based imaging can offer higher sensitivity, decrease the detection limit, and minimize the background interference from biosamples.

Rapid fluorescence lifetime estimation with modified phasor approach and Laguerre deconvolution: a comparative study

Fluorescence lifetime imaging has been shown to serve as a valuable tool for interrogating and diagnosis of biological tissue at a mesoscopic level. The ability to analyze fluorescence decay curves to extract lifetime values in real-time is crucial for clinical translation and applications such as tumor margin delineation or intracoronary imaging of atherosclerotic plaques. In this work, we compare the performance of two popular non-parametric (fit-free) methods for determining lifetime values from fluorescence decays in real-time-the Phasor approach and Laguerre deconvolution. We demonstrate results from simulated and experimental data to compare the accuracy and speed of both methods and their dependence on noise and model parameters.

MMP-2/9-Specific Activatable Lifetime Imaging Agent

Optical (molecular) imaging can benefit from a combination of the high signal-to-background ratio of activatable fluorescence imaging with the high specificity of luminescence lifetime imaging. To allow for this combination, both imaging techniques were integrated in a single imaging agent, a so-called activatable lifetime imaging agent. Important in the design of this imaging agent is the use of two luminophores that are tethered by a specific peptide with a hairpin-motive that ensured close proximity of the two while also having a specific amino acid sequence available for enzymatic cleavage by tumor-related MMP-2/9. Ir(ppy)3 and Cy5 were used because in close proximity the emission intensities of both luminophores were quenched and the influence of Cy5 shortens the Ir(ppy)3 luminescence lifetime from 98 ns to 30 ns. Upon cleavage in vitro, both effects are undone, yielding an increase in Ir(ppy)3 and Cy5 luminescence and a restoration of Ir(ppy)3 luminescence lifetime to 94 ns. As a reference for the luminescence activation, a similar imaging agent with the more common Cy3-Cy5 fluorophore pair was used. Our findings underline that the combination of enzymatic signal activation with lifetime imaging is possible and that it provides a promising method in the design of future disease specific imaging agents.

In vivo validation of a bimodal technique combining time-resolved fluorescence spectroscopy and ultrasonic backscatter microscopy for diagnosis of oral carcinoma

Tissue diagnostic features generated by a bimodal technique integrating scanning time-resolved fluorescence spectroscopy (TRFS) and ultrasonic backscatter microscopy (UBM) are investigated in an in vivo hamster oral carcinoma model. Tissue fluorescence is excited by a pulsed nitrogen laser and spectrally and temporally resolved using a set of filters/dichroic mirrors and a fast digitizer, respectively. A 41-MHz focused transducer (37-μm axial, 65-μm lateral resolution) is used for UBM scanning. Representative lesions of the different stages of carcinogenesis show that fluorescence characteristics complement ultrasonic features, and both correlate with histological findings. These results demonstrate that TRFS-UBM provide a wealth of co-registered, complementary data concerning tissue composition and structure as it relates to disease status. The direct co-registration of the TRFS data (sensitive to surface molecular changes) with the UBM data (sensitive to cross-sectional structural changes and depth of tumor invasion) is expected to play an important role in pre-operative diagnosis and intra-operative determination of tumor margins.

Metabolic imaging using two-photon excited NADH intensity and fluorescence lifetime imaging

Metabolism and mitochondrial dysfunction are known to be involved in many different disease states. We have employed two-photon fluorescence imaging of intrinsic mitochondrial reduced nicotinamide adenine dinucleotide (NADH) to quantify the metabolic state of several cultured cell lines, multicell tumor spheroids, and the intact mouse organ of Corti. Historically, fluorescence intensity has commonly been used as an indicator of the NADH concentration in cells and tissues. More recently, fluorescence lifetime imaging has revealed that changes in metabolism produce not only changes in fluorescence intensity, but also significant changes in the lifetimes and concentrations of free and enzyme-bound pools of NADH. Since NADH binding changes with metabolic state, this approach presents a new opportunity to track the cellular metabolic state.

Pinhole shifting lifetime imaging microscopy

Lifetime imaging microscopy is a powerful tool to probe biological phenomena independent of luminescence intensity and fluorophore concentration. We describe time-resolved imaging of long-lifetime luminescence with an unmodified commercial laser scanning confocal/multiphoton microscope. The principle of the measurement is displacement of the detection pinhole to collect delayed luminescence from a position lagging the rasting laser beam. As proof of principle, luminescence from microspheres containing europium (Eu(3+)), a red emitting probe, was compared to that of short-lifetime green-fluorescing microspheres and/or fluorescein and rhodamine in solution. Using 720-nm two-photon excitation and a pinhole diameter of 1 Airy unit, the short-lifetime fluorescence of fluorescein, rhodamine and green microspheres disappeared much more rapidly than the long-lifetime phosphorescence of Eu(3+) microspheres as the pinhole was repositioned in the lagging direction. In contrast, repositioning of the pinhole in the leading and orthogonal directions caused equal loss of short- and long-lifetime luminescence. From measurements at different lag pinhole positions, a lifetime of 270 micros was estimated for the Eu(3+) microspheres, consistent with independent measurements. This simple adaptation is the basis for quantitative 3-D lifetime imaging microscopy.

Fluorescence lifetime characterization of novel low-pH probes

The structures and functions of the cellular acidic compartments are strongly dependent on the pH gradients across vesicular membranes. Measurement and imaging of the vesicular pH require fluorophores with appropriate pK(a) values. In this report, we characterized the pH-dependent lifetime responses of a family of acidotropic probes, LysoSensors, to evaluate their usefulness to low-pH lifetime imaging. LysoSensors are cell-permeable weak bases that selectively accumulate in acidic vesicles after being protonated. They have higher quantum yields at lower pH ranges to allow visualization of the lysosomes. For LysoSensors DND-167, DND-189, and DND-153, raising the buffer pH increased the quenching effects of their basic side chains and substantially reduced their steady-state fluorescence and lifetimes. The apparent pK(a) values determined from their lifetime responses were shifted to near neutral values because of the dominant intensity contribution from their protonated species. One unique property of LysoSensor DND-189 is its nonmonotonic lifetime responses of the maxima occurring between pH 4 and 5. LysoSensor DND-192 did not show significant lifetime changes over a wide pH range. LysoSensor DND-160, which was the only excitation and emission ratiometric probe, showed significant pH-dependent lifetime changes as well as its spectral shifts. Its apparent pK(a) values determined from the lifetime responses were comparable to the lysosomal pH because of its bright basic form. Because of the pH-dependent absorption spectra, the apparent pK(a) values could be manipulated between 3 and 5 by changing the excitation and/or emission wavelengths. These results indicate that LysoSensor DND-160 is a promising probe for lifetime imaging to determine lysosomal pH.