Simultaneous two-photon spectral and lifetime fluorescence microscopy

Fluorescence lifetime imaging in drug delivery research

Once an exotic add-on to fluorescence microscopy for life science research, fluorescence lifetime imaging (FLIm) has become a powerful and increasingly utilised technique owing to its self-calibration nature, which affords superior quantification over conventional steady-state fluorescence imaging. This review focuses on the state-of-the-art implementation of FLIm related to the formulation, release, dosage, and mechanism of action of drugs aimed for innovative diagnostics and therapy. Quantitative measurements using FLIm have appeared instrumental for encapsulated drug delivery design, pharmacokinetics and pharmacodynamics, pathological investigations, early disease diagnosis, and evaluation of therapeutic efficacy. Attention is paid to the latest advances in lifetime-engineered nanomaterials and practical instrumentation, which begin to show preclinical and clinical translation potential beyond in vitro samples of cells and tissues. Finally, major challenges that need to be overcome in order to facilitate future perspectives are discussed.

Fluorescence Lifetime Imaging Techniques-A Review on Principles, Applications and Clinical Relevance

This article gives an overview of the most frequently used fluorescence-lifetime imaging (FLIM) techniques, their capabilities, and typical applications. Starting from a general introduction to fluorescence and phosphorescence lifetime, we will show that the fluorescence lifetime or, more accurately, the fluorescence decay function of a fluorophore is a direct indicator of the interaction with its molecular environment. FLIM is therefore more than a simple contrast technique in microscopy-it is a technique of molecular imaging. FLIM techniques can be classified into time-domain and frequency-domain techniques, analogue and photon counting techniques, and scanning and wide-field techniques. Starting from an overview of these general technical principles we will describe the features and peculiarities of the different FLIM techniques in use. An extended section is dedicated to TCSPC FLIM, addressing unique capabilities that make the technique especially interesting to FLIM of biological systems.

Deep learning in macroscopic diffuse optical imaging

SIGNIFICANCE

Biomedical optics system design, image formation, and image analysis have primarily been guided by classical physical modeling and signal processing methodologies. Recently, however, deep learning (DL) has become a major paradigm in computational modeling and has demonstrated utility in numerous scientific domains and various forms of data analysis.

AIM

We aim to comprehensively review the use of DL applied to macroscopic diffuse optical imaging (DOI).

APPROACH

First, we provide a layman introduction to DL. Then, the review summarizes current DL work in some of the most active areas of this field, including optical properties retrieval, fluorescence lifetime imaging, and diffuse optical tomography.

RESULTS

The advantages of using DL for DOI versus conventional inverse solvers cited in the literature reviewed herein are numerous. These include, among others, a decrease in analysis time (often by many orders of magnitude), increased quantitative reconstruction quality, robustness to noise, and the unique capability to learn complex end-to-end relationships.

CONCLUSIONS

The heavily validated capability of DL's use across a wide range of complex inverse solving methodologies has enormous potential to bring novel DOI modalities, otherwise deemed impractical for clinical translation, to the patient's bedside.

A Mechanically Flexible, Implantable Neural Interface for Computational Imaging and Optogenetic Stimulation Over 5.4×5.4mm2 FoV

Emerging optical functional imaging and optogenetics are among the most promising approaches in neuroscience to study neuronal circuits. Combining both methods into a single implantable device enables all-optical neural interrogation with immediate applications in freely-behaving animal studies. In this paper, we demonstrate such a device capable of optical neural recording and stimulation over large cortical areas. This implantable surface device exploits lens-less computational imaging and a novel packaging scheme to achieve an ultra-thin (250μm-thick), mechanically flexible form factor. The core of this device is a custom-designed CMOS integrated circuit containing a 160×160 array of time-gated single-photon avalanche photodiodes (SPAD) for low-light intensity imaging and an interspersed array of dual-color (blue and green) flip-chip bonded micro-LED (μLED) as light sources. We achieved 60μm lateral imaging resolution and 0.2mm³ volumetric precision for optogenetics over a 5.4×5.4mm² field of view (FoV). The device achieves a 125-fps frame-rate and consumes 40 mW of total power.

Full spectrum fluorescence lifetime imaging with 0.5 nm spectral and 50 ps temporal resolution

The use of optical techniques to interrogate wide ranging samples from semiconductors to biological tissue for rapid analysis and diagnostics has gained wide adoption over the past decades. The desire to collect ever more spatially, spectrally and temporally detailed optical signatures for sample characterization has specifically driven a sharp rise in new optical microscopy technologies. Here we present a high-speed optical scanning microscope capable of capturing time resolved images across 512 spectral and 32 time channels in a single acquisition with the potential for ~0.2 frames per second (256 × 256 image pixels). Each pixel in the resulting images contains a detailed data cube for the study of diverse time resolved light driven phenomena. This is enabled by integration of system control electronics and on-chip processing which overcomes the challenges presented by high data volume and low imaging speed, often bottlenecks in previous systems.

High data volumes from multidimensional imaging techniques can lead to slow collection and processing times. Here, the authors implement multispectral fluorescence lifetime imaging microscopy (FLIM) that uses time-correlated photon counting technology to reach simultaneously high imaging rates combined with high spectral and temporal resolution.

The ImageJ ecosystem: Open-source software for image visualization, processing, and analysis

For decades, biologists have relied on software to visualize and interpret imaging data. As techniques for acquiring images increase in complexity, resulting in larger multidimensional datasets, imaging software must adapt. ImageJ is an open-source image analysis software platform that has aided researchers with a variety of image analysis applications, driven mainly by engaged and collaborative user and developer communities. The close collaboration between programmers and users has resulted in adaptations to accommodate new challenges in image analysis that address the needs of ImageJ's diverse user base. ImageJ consists of many components, some relevant primarily for developers and a vast collection of user-centric plugins. It is available in many forms, including the widely used Fiji distribution. We refer to this entire ImageJ codebase and community as the ImageJ ecosystem. Here we review the core features of this ecosystem and highlight how ImageJ has responded to imaging technology advancements with new plugins and tools in recent years. These plugins and tools have been developed to address user needs in several areas such as visualization, segmentation, and tracking of biological entities in large, complex datasets. Moreover, new capabilities for deep learning are being added to ImageJ, reflecting a shift in the bioimage analysis community towards exploiting artificial intelligence. These new tools have been facilitated by profound architectural changes to the ImageJ core brought about by the ImageJ2 project. Therefore, we also discuss the contributions of ImageJ2 to enhancing multidimensional image processing and interoperability in the ImageJ ecosystem.

Molecular and Functional Networks Linked to Sarcopenia Prevention by Caloric Restriction in Rhesus Monkeys

Caloric restriction (CR) improves survival in nonhuman primates and delays the onset of age-related morbidities including sarcopenia, which is characterized by the age-related loss of muscle mass and function. A shift in metabolism anticipates the onset of muscle-aging phenotypes in nonhuman primates, suggesting a potential role for metabolism in the protective effects of CR. Here, we show that CR induced profound changes in muscle composition and the cellular metabolic environment. Bioinformatic analysis linked these adaptations to proteostasis, RNA processing, and lipid synthetic pathways. At the tissue level, CR maintained contractile content and attenuated age-related metabolic shifts among individual fiber types with higher mitochondrial activity, altered redox metabolism, and smaller lipid droplet size. Biometric and metabolic rate data confirm preserved metabolic efficiency in CR animals that correlated with the attenuation of age-related muscle mass and physical activity. These data suggest that CR-induced reprogramming of metabolism plays a role in delayed aging of skeletal muscle in rhesus monkeys.

Optical fiber-based dispersion for spectral discrimination in fluorescence lifetime imaging systems

The excited state lifetime of a fluorophore together with its fluorescence emission spectrum provide information that can yield valuable insights into the nature of a fluorophore and its microenvironment. However, it is difficult to obtain both channels of information in a conventional scheme as detectors are typically configured either for spectral or lifetime detection. We present a fiber-based method to obtain spectral information from a multiphoton fluorescence lifetime imaging (FLIM) system. This is made possible using the time delay introduced in the fluorescence emission path by a dispersive optical fiber coupled to a detector operating in time-correlated single-photon counting mode. This add-on spectral implementation requires only a few simple modifications to any existing FLIM system and is considerably more cost-efficient compared to currently available spectral detectors.

Two-photon imaging with silicon photomultipliers

We compared performance of recently developed silicon photomultipliers (SiPMs) to GaAsP photomultiplier tubes (PMTs) for two-photon imaging of neural activity. Despite higher dark counts, SiPMs match or exceed the signal-to-noise ratio of PMTs at photon rates encountered in typical calcium imaging experiments due to their low pulse height variability. At higher photon rates encountered during high-speed voltage imaging, SiPMs substantially outperform PMTs.

A multiscale Mueller polarimetry module for a stereo zoom microscope

Mueller polarimetry is a quantitative polarized light imaging modality that is capable of label-free visualization of tissue pathology, does not require extensive sample preparation, and is suitable for wide-field tissue analysis. It holds promise for selected applications in biomedicine, but polarimetry systems are often constrained by limited end-user accessibility and/or long-imaging times. In order to address these needs, we designed a multiscale-polarimetry module that easily couples to a commercially available stereo zoom microscope. This paper describes the module design and provides initial polarimetry imaging results from a murine preclinical breast cancer model and human breast cancer samples. The resultant polarimetry module has variable resolution and field of view, is low-cost, and is simple to switch in or out of a commercial microscope. The module can reduce long imaging times by adopting the main imaging approach used in pathology: scanning at low resolution to identify regions of interest, then at high resolution to inspect the regions in detail. Preliminary results show how the system can aid in region of interest identification for pathology, but also highlight that more work is needed to understand how tissue structures of pathological interest appear in Mueller polarimetry images across varying spatial zoom scales.

Enhancing Biochemical Resolution by Hyperdimensional Imaging Microscopy

Two decades of fast-paced innovation have improved the spatial resolution of fluorescence microscopy to enable molecular resolution with low invasiveness and high specificity. Fluorescence microscopy also enables scientists and clinicians to map and quantitate the physicochemical properties (e.g., analyte concentration, enzymatic activities, and protein-protein interactions) of biological samples. But the biochemical resolving power of fluorescence microscopy is not as well optimized as its spatial resolution. Current techniques typically observe only the individual properties of fluorescence, thus limiting the opportunities for sensing and multiplexing. Here, we demonstrate a new, to our knowledge, imaging paradigm, hyperdimensional imaging microscopy, which quantifies simultaneously and efficiently all the properties of fluorescence emission (excited-state lifetime, polarization, and spectra) in biological samples, transcending existing limitations. Such simultaneous detection of fluorescence features maximizes the biochemical resolving power of fluorescence microscopy, thereby providing the means to enhance sensing capabilities and enable heavily multiplexed assays. Just as multidimensional separation in mass-spectroscopy and multidimensional spectra in NMR have empowered proteomics and structural biology, we envisage that hyperdimensional imaging microscopy spectra of unprecedented dimensionality will catalyze advances in systems biology and medical diagnostics.

Compressive hyperspectral time-resolved wide-field fluorescence lifetime imaging

Spectrally resolved fluorescence lifetime imaging^1-3 and spatial multiplexing^1,4,5 have offered information content and collection-efficiency boosts in microscopy, but efficient implementations for macroscopic applications are still lacking. An imaging platform based on time-resolved structured light and hyperspectral single-pixel detection has been developed to perform quantitative macroscopic fluorescence lifetime imaging (MFLI) over a large field of view (FOV) and multiple spectral bands simultaneously. The system makes use of three digital micromirror device (DMD)-based spatial light modulators (SLMs) to generate spatial optical bases and reconstruct N by N images over 16 spectral channels with a time-resolved capability (~40 ps temporal resolution) using fewer than N² optical measurements. We demonstrate the potential of this new imaging platform by quantitatively imaging near-infrared (NIR) Förster resonance energy transfer (FRET) both in vitro and in vivo. The technique is well suited for quantitative hyperspectral lifetime imaging with a high sensitivity and paves the way for many important biomedical applications.

Quantitating the cell: turning images into numbers with ImageJ

Modern biological research particularly in the fields of developmental and cell biology has been transformed by the rapid evolution of the light microscope. The light microscope, long a mainstay of the experimental biologist, is now used for a wide array of biological experimental scenarios and sample types. Much of the great developments in advanced biological imaging have been driven by the digital imaging revolution with powerful processors and algorithms. In particular, this combination of advanced imaging and computational analysis has resulted in the drive of the modern biologist to not only visually inspect dynamic phenomena, but to quantify the involved processes. This need to quantitate images has become a major thrust within the bioimaging community and requires extensible and accessible image processing routines with corresponding intuitive software packages. Novel algorithms both made specifically for light microscopy or adapted from other fields, such as astronomy, are available to biologists, but often in a form that is inaccessible for a number of reasons ranging from data input issues, usability and training concerns, and accessibility and output limitations. The biological community has responded to this need by developing open source software packages that are freely available and provide access to image processing routines. One of the most prominent is the open-source image package ImageJ. In this review, we give an overview of prominent imaging processing approaches in ImageJ that we think are of particular interest for biological imaging and that illustrate the functionality of ImageJ and other open source image analysis software. WIREs Dev Biol 2017, 6:e260. doi: 10.1002/wdev.260 For further resources related to this article, please visit the WIREs website.

Using fluorescence lifetime microscopy to study the subcellular localization of anthocyanins

Anthocyanins are flavonoid pigments that accumulate in most seed plants. They are synthesized in the cytoplasm but accumulate inside the vacuoles. Anthocyanins are pigmented at the lower vacuolar pH, but in the cytoplasm they can be visualized based on their fluorescence properties. Thus, anthocyanins provide an ideal system for the development of new methods to investigate cytoplasmic pools and association with other molecular components. We have analyzed the fluorescence decay of anthocyanins by fluorescence lifetime imaging microscopy (FLIM), in both in vitro and in vivo conditions, using wild-type and mutant Arabidopsis thaliana seedlings. Within plant cells, the amplitude-weighted mean fluorescence lifetime (τ_m ) correlated with distinct subcellular localizations of anthocyanins. The vacuolar pool of anthocyanins exhibited shorter τ_m than the cytoplasmic pool. Consistently, lowering the pH of anthocyanins in solution shortened their fluorescence decay. We propose that FLIM is a useful tool for understanding the trafficking of anthocyanins and, potentially, for estimating vacuolar pH inside intact plant cells.

Three-dimensional printed miniaturized spectral system for collagen fluorescence lifetime measurements

Various types of collagens, e.g., type I and III, represent the main load-bearing components in biological tissues. Their composition changes during processes such as wound healing and fibrosis. When excited by ultraviolet light, collagens exhibit autofluorescence distinguishable by their unique fluorescent lifetimes across a range of emission wavelengths. Here, we designed a miniaturized spectral-lifetime detection system as a noninvasive probe for monitoring tissue collagen compositions. A sine-modulated LED illumination was applied to enable frequency domain fluorescence lifetime measurements under three wavelength bands, separated via a series of longpass dichroics at 387, 409, and 435 nm. We employed a lithography-based three-dimensional (3-D) printer with <50  μm resolution to create a custom designed optomechanics in a handheld form factor. We examined the characteristics of the optomechanics with finite element modeling to simulate the effect of thermal (from LED) and mechanical (from handling) strain on the optical system. The geometry was further optimized with ray tracing to form the final 3-D printed structure. Using this device, the phase shift and demodulation of collagen types were measured, where the separate spectral bands enhanced the differentiation of their lifetimes. This system represents a low cost, handheld probe for clinical tissue monitoring applications.

Regional metabolic heterogeneity of the hippocampus is nonuniformly impacted by age and caloric restriction

The hippocampus is critical for cognition and memory formation and is vulnerable to age‐related atrophy and loss of function. These phenotypes are attenuated by caloric restriction (CR), a dietary intervention that delays aging. Here, we show significant regional effects in hippocampal energy metabolism that are responsive to age and CR, implicating metabolic pathways in neuronal protection. In situ mitochondrial cytochrome c oxidase activity was region specific and lower in aged mice, and the impact of age was region specific. Multiphoton laser scanning microscopy revealed region‐ and age‐specific differences in nicotinamide adenine dinucleotide (NAD)‐derived metabolic cofactors. Age‐related changes in metabolic parameters were temporally separated, with early and late events in the metabolic response to age. There was a significant regional impact of age to lower levels of PGC‐1α, a master mitochondrial regulator. Rather than reversing the impact of age, CR induced a distinct metabolic state with decreased cytochrome c oxidase activity and increased levels of NAD(P)H. Levels of hippocampal PGC‐1α were lower with CR, as were levels of GSK3β, a key regulator of PGC‐1α turnover and activity. Regional distribution and colocalization of PGC‐1α and GSK3β in mouse hippocampus was similar in monkeys. Furthermore, the impact of CR to lower levels of both PGC‐1α and GSK3β was also conserved. The studies presented here establish the hippocampus as a highly varied metabolic environment, reveal cell‐type and regional specificity in the metabolic response to age and delayed aging by CR, and suggest that PGC‐1α and GSK3β play a role in implementing the neuroprotective program induced by CR.

Fast and simple spectral FLIM for biochemical and medical imaging

Spectrally resolved fluorescence lifetime imaging microscopy (λFLIM) has powerful potential for biochemical and medical imaging applications. However, long acquisition times, low spectral resolution and complexity of λFLIM often narrow its use to specialized laboratories. Therefore, we demonstrate here a simple spectral FLIM based on a solid-state detector array providing in-pixel histrogramming and delivering faster acquisition, larger dynamic range, and higher spectral elements than state-of-the-art λFLIM. We successfully apply this novel microscopy system to biochemical and medical imaging demonstrating that solid-state detectors are a key strategic technology to enable complex assays in biomedical laboratories and the clinic.

Spectrally resolved fluorescence lifetime imaging of Nile red for measurements of intracellular polarity

Spectrally resolved confocal microscopy and fluorescence lifetime imaging have been used to measure the polarity of lipid-rich regions in living HeLa cells stained with Nile red. The emission peak from the solvatochromic dye in lipid droplets is at a shorter wavelength than other, more polar, stained internal membranes, and this is indicative of a low polarity environment. We estimate that the dielectric constant, ϵ , is around 5 in lipid droplets and 25<ϵ<40 in other lipid-rich regions. Our spectrally resolved fluorescence lifetime imaging microscopy (FLIM) data show that intracellular Nile red exhibits complex, multiexponential fluorescence decays due to emission from a short lifetime locally excited state and a longer lifetime intramolecular charge transfer state. We measure an increase in the average fluorescence lifetime of the dye with increasing emission wavelength, as shown using phasor plots of the FLIM data. We also show using these phasor plots that the shortest lifetime decay components arise from lipid droplets. Thus, fluorescence lifetime is a viable contrast parameter for distinguishing lipid droplets from other stained lipid-rich regions. Finally, we discuss the FLIM of Nile red as a method for simultaneously mapping both polarity and relative viscosity based on fluorescence lifetime measurements.

A shift in energy metabolism anticipates the onset of sarcopenia in rhesus monkeys

Age-associated skeletal muscle mass loss curtails quality of life and may contribute to defects in metabolic homeostasis in older persons. The onset of sarcopenia occurs in middle age in rhesus macaques although the trigger has yet to be identified. Here, we show that a shift in metabolism occurs in advance of the onset of sarcopenia in rhesus vastus lateralis. Multiphoton laser-scanning microscopy detects a shift in the kinetics of photon emission from autofluorescent metabolic cofactors NADH and FAD. Lifetime of both fluorophores is shortened at mid-age, and this is observed in both free and bound constituent pools. Levels of FAD and free NADH are increased and the NAD/NADH redox ratio is lower. Concomitant with this, expression of fiber-type myosin isoforms is altered resulting in a shift in fiber-type distribution, activity of cytochrome c oxidase involved in mitochondrial oxidative phosphorylation is significantly lower, and the subcellular organization of mitochondria in oxidative fibers is compromised. A regulatory switch involving the transcriptional coactivator PGC-1α directs metabolic fuel utilization and governs the expression of structural proteins. Age did not significantly impact total levels of PGC-1α; however, its subcellular localization was disrupted, suggesting that PGC-1α activities may be compromised. Consistent with this, intracellular lipid storage is altered and there is shift to larger lipid droplet size that likely reflects a decline in lipid turnover or a loss in efficiency of lipid metabolism. We suggest that changes in energy metabolism contribute directly to skeletal muscle aging in rhesus monkeys.

High speed multispectral fluorescence lifetime imaging

We report a spectrally resolved fluorescence lifetime imaging system based on time gated single photon detection with a fixed gate width of 200 ps and 7 spectral channels. Time gated systems can operate at high count rates but usually have large gate widths and sample only part of the fluorescence decay curve. In the system presented in this work, the fluorescence signal is sampled using a high speed transceiver. An error analysis is carried out to characterize the performance of both lifetime and spectral detection. The effect of gate width and spectral channel width on the accuracy of estimated lifetimes and spectral widths is described. The performance of the whole instrument is evaluated at count rates of up to 12 MHz. Accurate fluorescence lifetimes (error < 2%) are recorded at count rates as high as 5 MHz. This is limited by the PMT performance, not by the electronics. Analysis of the large spectral lifetime image sets is challenging and time-consuming. Here, we demonstrate the use of lifetime and spectral phasors for analyzing images of fibroblast cells with 2 different labeled components. The phasor approach provides a fast and intuitive way of analyzing the results of spectrally resolved fluorescence lifetime imaging experiments.

From molecular structure to tissue architecture: collagen organization probed by SHG microscopy

Second-harmonic generation (SHG) microscopy is a fantastic tool for imaging collagen and probing its hierarchical organization from molecular scale up to tissue architectural level. In fact, SHG combines the advantages of a non-linear microscopy approach with a coherent modality able to probe molecular organization. In this manuscript we review the physical concepts describing SHG from collagen, highlighting how this optical process allows to probe structures ranging from molecular sizes to tissue architecture, through image pattern analysis and scoring methods. Starting from the description of the most relevant approaches employing SHG polarization anisotropy and forward - backward SHG detection, we then focus on the most relevant methods for imaging and characterizing collagen organization in tissues through image pattern analysis methods, highlighting advantages and limitations of the methods applied to tissue imaging and to potential clinical applications.

Optical biomarkers of serous and mucinous human ovarian tumor assessed with nonlinear optics microscopies

BACKGROUND

Nonlinear optical (NLO) microscopy techniques have potential to improve the early detection of epithelial ovarian cancer. In this study we showed that multimodal NLO microscopies, including two-photon excitation fluorescence (TPEF), second-harmonic generation (SHG), third-harmonic generation (THG) and fluorescence lifetime imaging microscopy (FLIM) can detect morphological and metabolic changes associated with ovarian cancer progression.

METHODOLOGY/PRINCIPAL FINDINGS

We obtained strong TPEF + SHG + THG signals from fixed samples stained with Hematoxylin & Eosin (H&E) and robust FLIM signal from fixed unstained samples. Particularly, we imaged 34 ovarian biopsies from different patients (median age, 49 years) including 5 normal ovarian tissue, 18 serous tumors and 11 mucinous tumors with the multimodal NLO platform developed in our laboratory. We have been able to distinguish adenomas, borderline, and adenocarcinomas specimens. Using a complete set of scoring methods we found significant differences in the content, distribution and organization of collagen fibrils in the stroma as well as in the morphology and fluorescence lifetime from epithelial ovarian cells.

CONCLUSIONS/SIGNIFICANCE

NLO microscopes provide complementary information about tissue microstructure, showing distinctive patterns for serous and mucinous ovarian tumors. The results provide a basis to interpret future NLO images of ovarian tissue and lay the foundation for future in vivo optical evaluation of premature ovarian lesions.

Endogenous fluorescence signatures in living pluripotent stem cells change with loss of potency

The therapeutic potential of stem cells is limited by the non-uniformity of their phenotypic state. Thus it would be advantageous to noninvasively monitor stem cell status. Driven by this challenge, we employed multidimensional multiphoton microscopy to quantify changes in endogenous fluorescence occurring with pluripotent stem cell differentiation. We found that global and cellular-scale fluorescence lifetime of human embryonic stem cells (hESC) and murine embryonic stem cells (mESC) consistently decreased with differentiation. Less consistent were trends in endogenous fluorescence intensity with differentiation, suggesting intensity is more readily impacted by nuances of species and scale of analysis. What emerges is a practical and accessible approach to evaluate, and ultimately enrich, living stem cell populations based on changes in metabolism that could be exploited for both research and clinical applications.

Fluorescence lifetime imaging comes of age how to do it and how to interpret it

Fluorescence lifetime imaging (FLI) has been used widely for measuring biomedical samples. Practical guidelines on taking successful FLI data are provided to avoid common errors that arise during the measurement. Several methods for analyzing and interpreting FLI results are also introduced; e.g., a model-free data analysis method called the polar plot allows visualization and analysis of FLI data without iterative fitting, and an image denoising algorithm called variance-stabilizing-transform TI Haar helps to elucidate the information of a complex biomedical sample. The instrument considerations and data analysis of Spectral-FLI are also discussed.

Imaging cardiac extracellular matrices: a blueprint for regeneration

Once damaged, cardiac tissue does not readily repair and is therefore a primary target of regenerative therapies. One regenerative approach is the development of scaffolds that functionally mimic the cardiac extracellular matrix (ECM) to deliver stem cells or cardiac precursor populations to the heart. Technological advances in micro/nanotechnology, stem cell biology, biomaterials and tissue decellularization have propelled this promising approach forward. Surprisingly, technological advances in optical imaging methods have not been fully utilized in the field of cardiac regeneration. Here, we describe and provide examples to demonstrate how advanced imaging techniques could revolutionize how ECM-mimicking cardiac tissues are informed and evaluated.

High-resolution multiphoton imaging of tumors in vivo

Analysis of the individual steps in metastasis is crucial if insights at the molecular level are to be linked to the cell biology of cancer. A technical hurdle to achieving the analysis of the individual steps of metastasis is the fact that, at the gross level, tumors are heterogeneous in both animal models and patients. Human primary tumors show extensive variation in all properties ranging from growth and morphology of the tumor through tumor-cell density in the blood and formation and growth of metastases. Methods capable of the direct visualization and analysis of tumor-cell behavior at single-cell resolution in vivo have become crucial in advancing the understanding of mechanisms of metastasis, the definition of microenvironment, and the markers related to both. This article discusses the use of high-resolution multiphoton imaging of tumors (specifically breast tumors in mice) in vivo.

Setup and use of a two-laser multiphoton microscope for multichannel intravital fluorescence imaging

Characterizing biological mechanisms dependent upon the interaction of many cell types in vivo requires both multiphoton microscope systems capable of expanding the number and types of fluorophores that can be imaged simultaneously while removing the wavelength and tunability restrictions of existing systems, and enhanced software for extracting critical cellular parameters from voluminous 4D data sets. We present a procedure for constructing a two-laser multiphoton microscope that extends the wavelength range of excitation light, expands the number of simultaneously usable fluorophores and markedly increases signal to noise via 'over-clocking' of detection. We also utilize a custom-written software plug-in that simplifies the quantitative tracking and analysis of 4D intravital image data. We begin by describing the optics, hardware, electronics and software required, and finally the use of the plug-in for analysis. We demonstrate the use of the setup and plug-in by presenting data collected via intravital imaging of a mouse model of breast cancer. The procedure may be completed in ∼24 h.

Multiphoton flow cytometry to assess intrinsic and extrinsic fluorescence in cellular aggregates: applications to stem cells

Detection and tracking of stem cell state are difficult due to insufficient means for rapidly screening cell state in a noninvasive manner. This challenge is compounded when stem cells are cultured in aggregates or three-dimensional (3D) constructs because living cells in this form are difficult to analyze without disrupting cellular contacts. Multiphoton laser scanning microscopy is uniquely suited to analyze 3D structures due to the broad tunability of excitation sources, deep sectioning capacity, and minimal phototoxicity but is throughput limited. A novel multiphoton fluorescence excitation flow cytometry (MPFC) instrument could be used to accurately probe cells in the interior of multicell aggregates or tissue constructs in an enhanced-throughput manner and measure corresponding fluorescent properties. By exciting endogenous fluorophores as intrinsic biomarkers or exciting extrinsic reporter molecules, the properties of cells in aggregates can be understood while the viable cellular aggregates are maintained. Here we introduce a first generation MPFC system and show appropriate speed and accuracy of image capture and measured fluorescence intensity, including intrinsic fluorescence intensity. Thus, this novel instrument enables rapid characterization of stem cells and corresponding aggregates in a noninvasive manner and could dramatically transform how stem cells are studied in the laboratory and utilized in the clinic.

Application of ultrafast gold luminescence to measuring the instrument response function for multispectral multiphoton fluorescence lifetime imaging

When performing multiphoton fluorescence lifetime imaging in multiple spectral emission channels, an instrument response function must be acquired in each channel if accurate measurements of complex fluorescence decays are to be performed. Although this can be achieved using the reference reconvolution technique, it is difficult to identify suitable fluorophores with a mono-exponential fluorescence decay across a broad emission spectrum. We present a solution to this problem by measuring the IRF using the ultrafast luminescence from gold nanorods. We show that ultrafast gold nanorod luminescence allows the IRF to be directly obtained in multiple spectral channels simultaneously across a wide spectral range. We validate this approach by presenting an analysis of multispectral autofluorescence FLIM data obtained from human skin ex vivo.

Aligned collagen is a prognostic signature for survival in human breast carcinoma

Evidence for the potent influence of stromal organization and function on invasion and metastasis of breast tumors is ever growing. We have performed a rigorous examination of the relationship of a tumor-associated collagen signature-3 (TACS-3) to the long-term survival rate of human patients. TACS-3 is characterized by bundles of straightened and aligned collagen fibers that are oriented perpendicular to the tumor boundary. An evaluation of TACS-3 was performed in biopsied tissue sections from 196 patients by second harmonic generation imaging of the backscattered signal generated by collagen. Univariate analysis of a Cox proportional hazard model demonstrated that the presence of TACS-3 was associated with poor disease-specific and disease-free survival, resulting in hazard ratios between 3.0 and 3.9. Furthermore, TACS-3 was confirmed to be an independent prognostic indicator regardless of tumor grade and size, estrogen or progesterone receptor status, human epidermal growth factor receptor-2 status, node status, and tumor subtype. Interestingly, TACS-3 was positively correlated to expression of stromal syndecan-1, a receptor for several extracellular matrix proteins including collagens. Because of the strong statistical evidence for poor survival in patients with TACS, and because the assessment can be performed in routine histopathological samples imaged via second harmonic generation or using picrosirius, we propose that quantifying collagen alignment is a viable, novel paradigm for the prediction of human breast cancer survival.

Spectrally resolved fluorescence lifetime imaging microscopy: Förster resonant energy transfer global analysis with a one- and two-exponential donor model

In many fields of life science, visualization of spatial proximity, as an indicator of protein interactions in living cells, is of outstanding interest. A method to accomplish this is the measurement of Förster resonant energy transfer (FRET) by means of spectrally resolved fluorescence lifetime imaging microscopy. The fluorescence lifetime is calculated using a multiple-wavelength fitting routine. The donor profile is assumed first to have a monoexponential time-dependent behavior, and the acceptor decay profile is solved analytically. Later, the donor profile is assumed to have a two-exponential time-dependent behavior and the acceptor decay profile is derived analytically. We develop and apply a multispectral fluorescence lifetime imaging microscopy analysis system for FRET global analysis with time-resolved and spectrally resolved techniques, including information from donor and acceptor channels in contrast to using just a limited spectral data set from one detector only and a model accounting only for the donor signal. This analysis is used to demonstrate close vicinity of β-secretase (BACE) and GGA1, two proteins involved in Alzheimer's disease pathology. We attempt to verify if an improvement in calculating the donor lifetimes could be achieved when time-resolved and spectrally resolved techniques are simultaneously incorporated.

Nonlinear optical microscopy and computational analysis of intrinsic signatures in breast cancer

Recently, new non-invasive imaging methods have been developed and applied to cellular and animal mammary models that have enabled breast cancer researchers to track key players and events in mammary metastasis. Noninvasive nonlinear optical methods such as multiphoton laser scanning microscopy (MPLSM), Fluorescence Lifetime Microscopy (FLIM) and second harmonic generation (SHG) imaging provide an unrivaled ability for obtaining high-resolution images from deep within tissue that can be exploited in the quest to understand breast cancer progression. These optical methods can add greatly to our knowledge of cancer progression by allowing key processes to be non-invasively imaged such as metabolism (on the basis of free and bound NADH detection via FLIM) and interactions with the extracellular matrix (SHG imaging of collagen). In this short application note we present a survey of our latest optical and computational efforts to study intrinsic fluorescence in breast cancer models. In particular we present the latest development in our SLIM Plotter application, an open source visualization program for interactive visualization and inspection of combined spectral lifetime (SLIM) data.

Detection of counterfeit U.S. paper money using intrinsic fluorescence lifetime

Genuine U.S. Federal Reserve Notes have a consistent, two-component intrinsic fluorescence lifetime. This allows for detection of counterfeit paper money because of its significant differences in fluorescence lifetime when compared to genuine paper money. We used scanning two-photon laser excitation and the time-correlated single photon counting (TCSPC) method to sample a approximately 4 mm(2) region. Three types of counterfeit samples were tested. Four out of the nine counterfeit samples fit to a one-component decay. Five out of nine counterfeit samples fit to a two-component model, but are identified as counterfeit due to significant deviations in the longer lifetime component compared to genuine bills.

Fluorescence lifetime imaging of endogenous fluorophores in histopathology sections reveals differences between normal and tumor epithelium in carcinoma in situ of the breast

The classical examination of histology slides from a mouse model of breast cancer has been extended in this study to incorporate modern multiphoton excitation and photon-counting techniques. The advantage of such approaches is quantification of potential diagnostic parameters from the fluorescence emission signal, whereby the traditional descriptive staging process is complemented by measurements of fluorescence intensity, lifetime, and spectra. We explored whether the clinical "gold standard" of eosin and hematoxylin stained histology slides would provide optical biomarker signatures of diagnostic value. Alternatively, we examined unstained slides for changes in intensity and/or fluorescence lifetime of relevant endogenous fluorophores. Although eosin provided a strong emission signal and had distinct spectra and lifetime, we found that it was not useful as a fluorescent biological marker, particularly when combined with hematoxylin. Instead, we found that the properties of the fluorescence from the endogenous fluorophores NADH and FAD were indicative of the pathological state of the tissue. Comparing regions of carcinoma in situ to adjacent histologically normal regions, we found that tumor cells produced higher intensity and had a longer fluorescence lifetime. By imaging at 780 nm and 890 nm excitation, we were able to differentiate the fluorescence of FAD from NADH by separating the emission spectra. The shift to a longer lifetime in tumor cells was independent of the free or bound state of FAD and NADH, and of the excitation wavelength. Most forms of cancer have altered metabolism and redox ratios; here we present a method that has potential for early detection of these changes, which are preserved in fixed tissue samples such as classic histopathology slides.

Imaging lifetime and anisotropy spectra in the frequency domain

We report the development of a system combining the capabilities of fluorescence imaging spectroscopy (x, lambda, I), fluorescence lifetime (tau) and static and dynamic fluorescence anisotropy (r), enabling the wide-field measurement of the spectroscopic parameters of fluorophores: (x, lambda, I, tau, r). The system employs a frequency domain data collection strategy with a modulated light emitting diode as the light source. A polarization rotator placed in the excitation path after a polarizer allows alternating parallel and perpendicular images to be collected without moving parts. A second polarizer on the emission side serves as the analyzer, leading to estimations of the wavelength-dependent dynamic anisotropies. The spectrograph has a nominal range of 365-920 nm; however, the light-emitting diodes and filter sets used in this study restricted the usable range from about 510 to 700 nm. The system was tested on rhodamine 6G (R6G) solutions containing 0, 15, 37, 45, 59, 74 and 91 glycerol. These experiments gave rotational diffusion results comparing favourably with literature values while also demonstrating a trend towards shorter measured lifetimes at high refractive index. The ability of the system to resolve mixtures was tested on mixtures of anti-human IgG-FITC (gamma-chain-specific) and R6G. These fluorophores have similar lifetimes but could be separated using anisotropy parameters. The imaging capabilities of the system were tested on mixtures of fluorescent beads with glycerol solutions of R6G.

Spectrally resolved fluorescent lifetime imaging

Placing an imaging spectrograph or related components capable of generating a spectrum between a microscope and the image intensifier of a conventional fluorescence lifetime imaging (FLIM) system creates a spectrally resolved FLIM (SFLIM). This arrangement provides a number of opportunities not readily available to conventional systems using bandpass filters. The examples include: simultaneous viewing of multiple fluorophores; tracking of both the donor and acceptor; and observation of a range of spectroscopic changes invisible to the conventional FLIM systems. In the frequency-domain implementation of the method, variation in the fractional contributions from different fluorophores along the wavelength dimension can behave as a surrogate for a frequency sweep or spatial variations while analysing fluorophore mixtures. This paper reviews the development of the SFLIM method, provides a theoretical and practical overview of frequency-domain SFLIM including: presentation of the data; manifestations of energy transfer; observation of multiple fluorophores; and the limits of single frequency methods.

Multimode microscopy: spectral and lifetime imaging

Multimode microscopy exploits the measurement of multiple spectroscopic parameters to yield a wealth of spatially resolved spectroscopic detail about the sample under study. Here, we describe the realization of a multimode microscope capable of wide-field transmission, reflectivity and emission imaging. The instrument also incorporates confocal spectral and lifetime imaging enabling convenient high-content imaging of complex samples, allowing the direct correlation of the data obtained from the different modes. We demonstrate the versatility of this imaging platform by reviewing applications to the modulation of fluorescent protein emission by inverse opal photonic crystals, to the detection and visualization of J-aggregate coupling of small molecule dyes intercalated into nanochannels in zeolites and to the visualization of fluorescent proteins micropatterned onto surfaces. In all cases, the combination of different microspectroscopic modes is essential for the resolution of specific photophysical details of the complex systems in question.

A compact, multidimensional spectrofluorometer exploiting supercontinuum generation

We report a novel, compact and automated multidimensional spectrofluorometer that exploits a fibre-laser-pumped ultrafast supercontinuum source to provide resolution with respect to intensity, excitation and emission wavelength, decay time and polarisation. This instrument has been applied to study the photophysics of the phase-sensitive membrane probe di-4-ANEPPDHQ and to characterise protein-protein interactions via Förster resonance energy transfer. It can be applied to in situ measurements via a fibre-optic probe in medical and other contexts and is demonstrated here to provide a comprehensive characterisation of tissue autofluorescence.

Nonlinear optical imaging of cellular processes in breast cancer

Nonlinear optical imaging techniques such as multiphoton and second harmonic generation (SHG) microscopy used in conjunction with novel signal analysis techniques such as spectroscopic and fluorescence excited state lifetime detection have begun to be used widely for biological studies. This is largely due to their promise to noninvasively monitor the intracellular processes of a cell together with the cell's interaction with its microenvironment. Compared to other optical methods these modalities provide superior depth penetration and viability and have the additional advantage in that they are compatible technologies that can be applied simultaneously. Therefore, application of these nonlinear optical approaches to the study of breast cancer holds particular promise as these techniques can be used to image exogeneous fluorophores such as green fluorescent protein as well as intrinsic signals such as SHG from collagen and endogenous fluorescence from nicotinamide adenine dinucleotide or flavin adenine dinucleotide. In this article the application of multiphoton excitation, SHG, and fluorescence lifetime imaging microscopy to relevant issues regarding the tumor-stromal interaction, cellular metabolism, and cell signaling in breast cancer is described. Furthermore, the ability to record and monitor the intrinsic fluorescence and SHG signals provides a unique tool for researchers to understand key events in cancer progression in its natural context.

Multiphoton microscopy and fluorescence lifetime imaging microscopy (FLIM) to monitor metastasis and the tumor microenvironment

Cancer metastasis involves complex cell behavior and interaction with the extracellular matrix by metabolically active cells. To observe invasion and metastasis with sub-cellular resolution in vivo, multiphoton microscopy (MPM) allows imaging more deeply into tissues with less toxicity, compared with other optical imaging methods. MPM can be combined with second harmonic generation (SHG), fluorescent lifetime imaging microscopy (FLIM), and spectral-lifetime imaging microscopy (SLIM). SHG facilitates imaging of stromal collagen and tumor-stroma interactions, including the architecture and remodeling of the tumor microenvironment. FLIM allows characterization of exogenous and endogenous fluorophores, such as the metabolites FAD and NADH to score for metabolic state and provide optical biomarkers. SLIM permits additional identification and separation of endogenous and exogenous fluorophores by simultaneously collecting their spectra and lifetime, producing an optical molecular "fingerprint". Both FLIM and SLIM also serve as an improved method for the assessment of Förster (or fluorescence) resonance energy transfer (FRET). Hence, the use and further development of these approaches strongly enhances the visualization and quantification of tumor progression, invasion, and metastasis. Herein, we review recent developments of multiphoton FLIM and SLIM to study 2D and 3D cell migration, invasion into the tumor microenvironment, and metastasis.

Navigating transdermal diffusion with multiphoton fluorescence lifetime imaging

We demonstrate the potential of fluorescence lifetime imaging by time-correlated single-photon counting as a method for monitoring the transdermal diffusion pathway and diffusion rate of pharmaceuticals in human skin. The current application relies on observing subtle changes in the fluorescence lifetime of the intrinsic fluorophores present in the intracellular region between corneocytes of the stratum corneum. We have comprehensively characterized the measured fluorescence lifetimes from intracorneocyte junctions in three skin section types (dermatomed skin, epidermal membranes and stratum corneum) revealing statistically significant differences of the short lifetime component between each of the types, which we attribute to the sample preparation and imaging method. We show using epidermal membrane sections that application of a drug/solvent formulation consisting of ethinyl estradiol and spectroscopic grade ethanol to the surface gives rise to a slight but statistically significant shortening of the fluorescence lifetime of the long-lived emitting species present in the sample, from approximately 2.8 ns to 2.5 ns. The method may be useful for future studies where the kinetics and pathways of a variety of applied formulations could be investigated.

Nonlinear optical imaging and spectral-lifetime computational analysis of endogenous and exogenous fluorophores in breast cancer

Multiphoton laser scanning microscopy (MPLSM) utilizing techniques such as multiphoton excitation (MPE), second harmonic generation (SHG), and multiphoton fluorescence lifetime imaging and spectral lifetime imaging (FLIM and SLIM, respectively) are greatly expanding the degree of information obtainable with optical imaging in biomedical research. The application of these nonlinear optical approaches to the study of breast cancer holds particular promise. These noninvasive, multidimensional techniques are well suited to image exogenous fluorophores that allow relevant questions regarding protein localization and signaling to be addressed both in vivo and in vitro. Furthermore, MPLSM imaging of endogenous signals from collagen and fluorophores such as nicotinamide adenine dinucleotide (NADH) or flavin adenine dinucleotide (FAD), address important questions regarding the tumor-stromal interaction and the physiologic state of the cell. We demonstrate the utility of multimodal MPE/SHG/FLIM for imaging both exogenous and/or endogenous fluorophores in mammary tumors or relevant 3-D systems. Using SLIM, we present a method for imaging and differentiating signals from multiple fluorophores that can have overlapping spectra via SLIM Plotter-a computational tool for visualizing and analyzing large spectral-lifetime data sets.

Collagen density promotes mammary tumor initiation and progression

BACKGROUND

Mammographically dense breast tissue is one of the greatest risk factors for developing breast carcinoma. Despite the strong clinical correlation, breast density has not been causally linked to tumorigenesis, largely because no animal model has existed for studying breast tissue density. Importantly, regions of high breast density are associated with increased stromal collagen. Thus, the influence of the extracellular matrix on breast carcinoma development and the underlying molecular mechanisms are not understood.

METHODS

To study the effects of collagen density on mammary tumor formation and progression, we utilized a bi-transgenic tumor model with increased stromal collagen in mouse mammary tissue. Imaging of the tumors and tumor-stromal interface in live tumor tissue was performed with multiphoton laser-scanning microscopy to generate multiphoton excitation and spectrally resolved fluorescent lifetimes of endogenous fluorophores. Second harmonic generation was utilized to image stromal collagen.

RESULTS

Herein we demonstrate that increased stromal collagen in mouse mammary tissue significantly increases tumor formation approximately three-fold (p < 0.00001) and results in a significantly more invasive phenotype with approximately three times more lung metastasis (p < 0.05). Furthermore, the increased invasive phenotype of tumor cells that arose within collagen-dense mammary tissues remains after tumor explants are cultured within reconstituted three-dimensional collagen gels. To better understand this behavior we imaged live tumors using nonlinear optical imaging approaches to demonstrate that local invasion is facilitated by stromal collagen re-organization and that this behavior is significantly increased in collagen-dense tissues. In addition, using multiphoton fluorescence and spectral lifetime imaging we identify a metabolic signature for flavin adenine dinucleotide, with increased fluorescent intensity and lifetime, in invading metastatic cells.

CONCLUSION

This study provides the first data causally linking increased stromal collagen to mammary tumor formation and metastasis, and demonstrates that fundamental differences arise and persist in epithelial tumor cells that progressed within collagen-dense microenvironments. Furthermore, the imaging techniques and signature identified in this work may provide useful diagnostic tools to rapidly assess fresh tissue biopsies.