Automated motion artifact removal for intravital microscopy, without a priori information

Intravital Microscopy With an Airy Beam Light Sheet Microscope Improves Temporal Resolution and Reduces Surgical Trauma

Intravital microscopy has emerged as a powerful imaging tool, which allows the visualization and precise understanding of rapid physiological processes at sites of inflammation in vivo, such as vascular permeability and leukocyte migration. Leukocyte interactions with the vascular endothelium can be characterized in the living organism in the murine cremaster muscle. Here, we present a microscopy technique using an Airy Beam Light Sheet microscope that has significant advantages over our previously used confocal microscopy systems. In comparison, the light sheet microscope offers near isotropic optical resolution and faster acquisition speed, while imaging a larger field of view. With less invasive surgery we can significantly reduce side effects such as bleeding, muscle twitching, and surgical inflammation. However, the increased acquisition speed requires exceptional tissue stability to avoid imaging artefacts. Since respiratory motion is transmitted to the tissue under investigation, we have developed a relocation algorithm that removes motion artefacts from our intravital microscopy images. Using these techniques, we are now able to obtain more detailed 3D time-lapse images of the cremaster vascular microcirculation, which allow us to observe the process of leukocyte emigration into the surrounding tissue with increased temporal resolution in comparison to our previous confocal approach.

Improved Liver Intravital Microscopic Imaging Using a Film-Assisted Stabilization Method

Intravital microscopy (IVM) is a valuable method for biomedical characterization of dynamic processes, which has been applied to many fields such as neuroscience, oncology, and immunology. During IVM, vibration suppression is a major challenge due to the inevitable respiration and heartbeat from live animals. In this study, taking liver IVM as an example, we have unraveled the vibration inhibition effect of liquid bridges by studying the friction characteristics of a moist surface on the mouse liver. We confirmed the presence of liquid bridges on the liver through fluorescence imaging, which can provide microscale and nondestructive liquid connections between adjacent surfaces. Liquid bridges were constructed to sufficiently stabilize the liver after abdominal dissection by covering it with a polymer film, taking advantage of the high adhesion properties of liquid bridges. We further prototyped a microscope-integrated vibration-damping device with adjustable film tension to simplify the sample preparation procedure, which remarkably decreased the liver vibration. In practical application scenarios, we observed the process of liposome phagocytosis by liver Kupffer cells with significantly improved image and video quality. Collectively, our method not only provided a feasible solution to vibration suppression in the field of IVM, but also has the potential to be applied to vibration damping of precision instruments or other fields that require nondestructive ″soft″ vibration damping.

Intravital two-photon microscopy of the native mouse thymus

The thymus, a key organ in the adaptive immune system, is sensitive to a variety of insults including cytotoxic preconditioning, which leads to atrophy, compression of the blood vascular system, and alterations in hemodynamics. Although the thymus has innate regenerative capabilities, the production of T cells relies on the trafficking of lymphoid progenitors from the bone marrow through the altered thymic blood vascular system. Our understanding of thymic blood vascular hemodynamics is limited due to technical challenges associated with accessing the native thymus in live mice. To overcome this challenge, we developed an intravital two-photon imaging method to visualize the native thymus in vivo and investigated functional changes to the vascular system following sublethal irradiation. We quantified blood flow velocity and shear rate in cortical blood vessels and identified a subtle but significant increase in vessel leakage and diameter ~24 hrs post-sublethal irradiation. Ex vivo whole organ imaging of optically cleared thymus lobes confirmed a disruption of the thymus vascular structure, resulting in an increase in blood vessel diameter and vessel area, and concurrent thymic atrophy. This novel two-photon intravital imaging method enables a new paradigm for directly investigating the thymic microenvironment in vivo.

Toward next-generation endoscopes integrating biomimetic video systems, nonlinear optical microscopy, and deep learning

According to the World Health Organization, the proportion of the world's population over 60 years will approximately double by 2050. This progressive increase in the elderly population will lead to a dramatic growth of age-related diseases, resulting in tremendous pressure on the sustainability of healthcare systems globally. In this context, finding more efficient ways to address cancers, a set of diseases whose incidence is correlated with age, is of utmost importance. Prevention of cancers to decrease morbidity relies on the identification of precursor lesions before the onset of the disease, or at least diagnosis at an early stage. In this article, after briefly discussing some of the most prominent endoscopic approaches for gastric cancer diagnostics, we review relevant progress in three emerging technologies that have significant potential to play pivotal roles in next-generation endoscopy systems: biomimetic vision (with special focus on compound eye cameras), non-linear optical microscopies, and Deep Learning. Such systems are urgently needed to enhance the three major steps required for the successful diagnostics of gastrointestinal cancers: detection, characterization, and confirmation of suspicious lesions. In the final part, we discuss challenges that lie en route to translating these technologies to next-generation endoscopes that could enhance gastrointestinal imaging, and depict a possible configuration of a system capable of (i) biomimetic endoscopic vision enabling easier detection of lesions, (ii) label-free in vivo tissue characterization, and (iii) intelligently automated gastrointestinal cancer diagnostic.

In Vivo Click Chemistry Enables Multiplexed Intravital Microscopy

The ability to observe cells in live organisms is essential for understanding their function in complex in vivo milieus. A major challenge today has been the limited ability to perform higher multiplexing beyond four to six colors to define cell subtypes in vivo. Here, a click chemistry-based strategy is presented for higher multiplexed in vivo imaging in mouse models. The method uses a scission-accelerated fluorophore exchange (SAFE), which exploits a highly efficient bioorthogonal mechanism to completely remove fluorescent signal from antibody-labeled cells in vivo. It is shown that the SAFE-intravital microscopy imaging method allows 1) in vivo staining of specific cell types in dorsal and cranial window chambers of mice, 2) complete un-staining in minutes, 3) in vivo click chemistries at lower (µm) and thus non-toxic concentrations, and 4) the ability to perform in vivo cyclic imaging. The potential utility of the method is demonstrated by 12 color imaging of immune cells in live mice.

Handheld laser scanning microscope catheter for real-time and in vivo confocal microscopy using a high definition high frame rate Lissajous MEMS mirror

A handheld confocal microscope using a rapid MEMS scanning mirror facilitates real-time optical biopsy for simple cancer diagnosis. Here we report a handheld confocal microscope catheter using high definition and high frame rate (HDHF) Lissajous scanning MEMS mirror. The broad resonant frequency region of the fast axis on the MEMS mirror with a low Q-factor facilitates the flexible selection of scanning frequencies. HDHF Lissajous scanning was achieved by selecting the scanning frequencies with high greatest common divisor (GCD) and high total lobe number. The MEMS mirror was fully packaged into a handheld configuration, which was coupled to a home-built confocal imaging system. The confocal microscope catheter allows fluorescence imaging of in vivo and ex vivo mouse tissues with 30 Hz frame rate and 95.4% fill factor at 256 × 256 pixels image, where the lateral resolution is 4.35 μm and the field-of-view (FOV) is 330 μm × 330 μm. This compact confocal microscope can provide diverse handheld microscopic applications for real-time, on-demand, and in vivo optical biopsy.

Fluorescence Microscopy-An Outline of Hardware, Biological Handling, and Fluorophore Considerations

Fluorescence microscopy has become a critical tool for researchers to understand biological processes at the cellular level. Micrographs from fixed and live-cell imaging procedures feature in a plethora of scientific articles for the field of cell biology, but the complexities of fluorescence microscopy as an imaging tool can sometimes be overlooked or misunderstood. This review seeks to cover the three fundamental considerations when designing fluorescence microscopy experiments: (1) hardware availability; (2) amenability of biological models to fluorescence microscopy; and (3) suitability of imaging agents for intended applications. This review will help equip the reader to make judicious decisions when designing fluorescence microscopy experiments that deliver high-resolution and informative images for cell biology.

High-resolution structural and functional deep brain imaging using adaptive optics three-photon microscopy

Multiphoton microscopy has become a powerful tool with which to visualize the morphology and function of neural cells and circuits in the intact mammalian brain. However, tissue scattering, optical aberrations and motion artifacts degrade the imaging performance at depth. Here we describe a minimally invasive intravital imaging methodology based on three-photon excitation, indirect adaptive optics (AO) and active electrocardiogram gating to advance deep-tissue imaging. Our modal-based, sensorless AO approach is robust to low signal-to-noise ratios as commonly encountered in deep scattering tissues such as the mouse brain, and permits AO correction over large axial fields of view. We demonstrate near-diffraction-limited imaging of deep cortical spines and (sub)cortical dendrites up to a depth of 1.4 mm (the edge of the mouse CA1 hippocampus). In addition, we show applications to deep-layer calcium imaging of astrocytes, including fibrous astrocytes that reside in the highly scattering corpus callosum.

Intravital mesoscopic fluorescence molecular tomography allows non-invasive in vivo monitoring and quantification of breast cancer growth dynamics

Preclinical breast tumor models are an invaluable tool to systematically study tumor progression and treatment response, yet methods to non-invasively monitor the involved molecular and mechanistic properties under physiologically relevant conditions are limited. Here we present an intravital mesoscopic fluorescence molecular tomography (henceforth IFT) approach that is capable of tracking fluorescently labeled tumor cells in a quantitative manner inside the mammary gland of living mice. Our mesoscopic approach is entirely non-invasive and thus permits prolonged observational periods of several months. The relatively high sensitivity and spatial resolution further enable inferring the overall number of oncogene-expressing tumor cells as well as their tumor volume over the entire cycle from early tumor growth to residual disease following the treatment phase. Our IFT approach is a promising method for studying tumor growth dynamics in a quantitative and longitudinal fashion in-vivo.

Intravital imaging of megakaryocytes

The dynamics of platelet formation could only be investigated since the development of two-photon microscopy in combination with suitable fluorescent labeling strategies. In this review paper, we give an overview of recent advances in fluorescence imaging of the bone marrow that have contributed to our understanding of platelet biogenesis during the last decade. We make a brief survey through the perspectives and limitations of today's intravital imaging, but also discuss complementary methods that may help to piece together the puzzle of megakaryopoiesis and platelet formation.

Experimental pathology by intravital microscopy and genetically encoded fluorescent biosensors

The invention of two‐photon excitation microscopes widens the potential application of intravital microscopy (IVM) to the broad field of experimental pathology. Moreover, the recent development of fluorescent protein‐based, genetically encoded biosensors provides an ideal tool to visualize the cell function in live animals. We start from a brief review of IVM with two‐photon excitation microscopes and genetically encoded biosensors based on the principle of Förster resonance energy transfer (FRET). Then, we describe how IVM using biosensors has revealed the pathogenesis of several disease models.

Reprint of "Multi-modal image cytometry approach - From dynamic to whole organ imaging"

Optical imaging is a valuable tool to visualise biological processes in the context of the tissue. Each imaging modality provides the biologist with different types of information - cell dynamics and migration over time can be tracked with time-lapse imaging (e.g. intra-vital imaging); an overview of whole tissues can be acquired using optical clearing in conjunction with light sheet microscopy; finer details such as cellular morphology and fine nerve tortuosity can be imaged at higher resolution using the confocal microscope. Multi-modal imaging combined with image cytometry - a form of quantitative analysis of image datasets - provides an objective basis for comparing between sample groups. Here, we provide an overview of technical aspects to look out for in an image cytometry workflow, and discuss issues related to sample preparation, image post-processing and analysis for intra-vital and whole organ imaging.

Multiphoton intravital microscopy in small animals: motion artefact challenges and technical solutions

Since its invention 29 years ago, two‐photon laser‐scanning microscopy has evolved from a promising imaging technique, to an established widely available imaging modality used throughout the biomedical research community. The establishment of two‐photon microscopy as the preferred method for imaging fluorescently labelled cells and structures in living animals can be attributed to the biophysical mechanism by which the generation of fluorescence is accomplished. The use of powerful lasers capable of delivering infrared light pulses within femtosecond intervals, facilitates the nonlinear excitation of fluorescent molecules only at the focal plane and determines by objective lens position. This offers numerous benefits for studies of biological samples at high spatial and temporal resolutions with limited photo‐damage and superior tissue penetration. Indeed, these attributes have established two‐photon microscopy as the ideal method for live‐animal imaging in several areas of biology and have led to a whole new field of study dedicated to imaging biological phenomena in intact tissues and living organisms. However, despite its appealing features, two‐photon intravital microscopy is inherently limited by tissue motion from heartbeat, respiratory cycles, peristalsis, muscle/vascular tone and physiological functions that change tissue geometry. Because these movements impede temporal and spatial resolution, they must be properly addressed to harness the full potential of two‐photon intravital microscopy and enable accurate data analysis and interpretation. In addition, the sources and features of these motion artefacts are varied, sometimes unpredictable and unique to specific organs and multiple complex strategies have previously been devised to address them. This review will discuss these motion artefacts requirement and technical solutions for their correction and after intravital two‐photon microscopy.

Multicolor two-photon imaging of in vivo cellular pathophysiology upon influenza virus infection using the two-photon IMPRESS

In vivo two-photon imaging is a valuable technique for studies of viral pathogenesis and host responses to infection in vivo. In this protocol, we describe a methodology for analyzing influenza virus-infected lung in vivo by two-photon imaging microscopy. We describe the surgical procedure, how to stabilize the lung, and an approach to analyzing the data. Further, we provide a database of fluorescent dyes, antibodies, and reporter mouse lines that can be used in combination with a reporter influenza virus (Color-flu) for multicolor analysis. Setup of this model typically takes ~30 min and enables the observation of influenza virus-infected lungs for >4 h during the acute phase of the inflammation and at least 1 h in the lethal phase. This imaging system, which we termed two-photon IMPRESS (imaging pathophysiology research system), is broadly applicable to analyses of other respiratory pathogens and reveals disease progression at the cellular level in vivo.

Intravital Microscopy of the Beating Murine Heart to Understand Cardiac Leukocyte Dynamics

Cardiovascular disease is the leading cause of worldwide mortality. Intravital microscopy has provided unprecedented insight into leukocyte biology by enabling the visualization of dynamic responses within living organ systems at the cell-scale. The heart presents a uniquely dynamic microenvironment driven by periodic, synchronous electrical conduction leading to rhythmic contractions of cardiomyocytes, and phasic coronary blood flow. In addition to functions shared throughout the body, immune cells have specific functions in the heart including tissue-resident macrophage-facilitated electrical conduction and rapid monocyte infiltration upon injury. Leukocyte responses to cardiac pathologies, including myocardial infarction and heart failure, have been well-studied using standard techniques, however, certain questions related to spatiotemporal relationships remain unanswered. Intravital imaging techniques could greatly benefit our understanding of the complexities of in vivo leukocyte behavior within cardiac tissue, but these techniques have been challenging to apply. Different approaches have been developed including high frame rate imaging of the beating heart, explantation models, micro-endoscopy, and mechanical stabilization coupled with various acquisition schemes to overcome challenges specific to the heart. The field of cardiac science has only begun to benefit from intravital microscopy techniques. The current focused review presents an overview of leukocyte responses in the heart, recent developments in intravital microscopy for the murine heart, and a discussion of future developments and applications for cardiovascular immunology.

Multimodal imaging for tumour characterization from micro- to macroscopic level using a newly developed dorsal chamber designed for long-term follow-up

Optical imaging of living animals is a unique method of studying the dynamics of physiological and pathological processes at a subcellular level. One-shot acquisitions at high resolution can be achieved on exteriorized organs before animal euthanasia. For longitudinal follow-up, intravital imaging can be used and involves imaging windows implanted in cranial, thoracic or dorsal regions. Several imaging window models exist, but none have proven to be applicable for long-term monitoring and most biological processes take place over several weeks. Moreover, none are compatible with multiple imaging modalities, meaning that different biological parameters cannot be assessed in an individual animal. We developed a new dorsal chamber that was well tolerated by mice (over several months) and allowed individual and collective cell tracking and behaviour analysis by optical imaging, ultrasound and magnetic resonance tomography. This new model broadens potential applications to areas requiring study of long-term biological processes, as in cancer research.

Improving nanotherapy delivery and action through image-guided systems pharmacology

Despite recent advances in the translation of therapeutic nanoparticles (TNPs) into the clinic, the field continues to face challenges in predictably and selectively delivering nanomaterials for the treatment of solid cancers. The concept of enhanced permeability and retention (EPR) has been coined as a convenient but simplistic descriptor of high TNP accumulation in some tumors. However, in practice EPR represents a number of physiological variables rather than a single one (including dysfunctional vasculature, compromised lymphatics and recruited host cells, among other aspects of the tumor microenvironment) — each of which can be highly heterogenous within a given tumor, patient and across patients. Therefore, a clear need exists to dissect the specific biophysical factors underlying the EPR effect, to formulate better TNP designs, and to identify patients with high-EPR tumors who are likely to respond to TNP. The overall pharmacology of TNP is governed by an interconnected set of spatially defined and dynamic processes that benefit from a systems-level quantitative approach, and insights into the physiology have profited from the marriage between in vivo imaging and quantitative systems pharmacology (QSP) methodologies. In this article, we review recent developments pertinent to image-guided systems pharmacology of nanomedicines in oncology. We first discuss recent developments of quantitative imaging technologies that enable analysis of nanomaterial pharmacology at multiple spatiotemporal scales, and then examine reports that have adopted these imaging technologies to guide QSP approaches. In particular, we focus on studies that have integrated multi-scale imaging with computational modeling to derive insights about the EPR effect, as well as studies that have used modeling to guide the manipulation of the EPR effect and other aspects of the tumor microenvironment for improving TNP action. We anticipate that the synergistic combination of imaging with systems-level computational methods for effective clinical translation of TNPs will only grow in relevance as technologies increase in resolution, multiplexing capability, and in the ability to examine heterogeneous behaviors at the single-cell level.

Fluorescence anisotropy imaging in drug discovery

Non-invasive measurement of drug-target engagement can provide critical insights in the molecular pharmacology of small molecule drugs. Fluorescence polarization/fluorescence anisotropy measurements are commonly employed in protein/cell screening assays. However, the expansion of such measurements to the in vivo setting has proven difficult until recently. With the advent of high-resolution fluorescence anisotropy microscopy it is now possible to perform kinetic measurements of intracellular drug distribution and target engagement in commonly used mouse models. In this review we discuss the background, current advances and future perspectives in intravital fluorescence anisotropy measurements to derive pharmacokinetic and pharmacodynamic measurements in single cells and whole organs.

Textures of the tumour microenvironment

In this review, we present recent findings on the dynamic nature of the tumour microenvironment (TME) and how intravital microscopy studies have defined TME components in a spatiotemporal manner. Intravital microscopy has shed light into the nature of the TME, revealing structural details of both tumour cells and other TME co-habitants in vivo, how these cells communicate with each other, and how they are organized in three-dimensional space to orchestrate tumour growth, invasion, dissemination and metastasis. We will review different imaging tools, imaging reporters and fate-mapping strategies that have begun to uncover the complexity of the TME in vivo.

Label-Free Multiphoton Endomicroscopy for Minimally Invasive In Vivo Imaging

Multiphoton microscopy of cellular autofluorescence and second harmonic generation from collagen facilitates imaging of living cells and tissues without the need for additional fluorescent labels. Here, a compact multiphoton endomicroscope for label-free in vivo imaging in small animals via side-viewing needle objectives is presented. Minimal invasive imaging at cellular resolution is performed in colonoscopy of mice without surgical measures and without fluorescent dyes as a contrast agent. The colon mucosa is imaged repeatedly in the same animal in a mouse model of acute intestinal inflammation to study the process of inflammation at the tissue level within a time period of ten days, demonstrating the capabilities of label-free endomicroscopy for longitudinal studies for the first time.

Toolbox for In Vivo Imaging of Host-Parasite Interactions at Multiple Scales

Animal models have for long been pivotal for parasitology research. Over the last few years, techniques such as intravital, optoacoustic and magnetic resonance imaging, optical projection tomography, and selective plane illumination microscopy developed promising potential for gaining insights into host-pathogen interactions by allowing different visualization forms in vivo and ex vivo. Advances including increased resolution, penetration depth, and acquisition speed, together with more complex image analysis methods, facilitate tackling biological problems previously impossible to study and/or quantify. Here we discuss advances and challenges in the in vivo imaging toolbox, which hold promising potential for the field of parasitology.

Molecular mobility and activity in an intravital imaging setting - implications for cancer progression and targeting

Molecular mobility, localisation and spatiotemporal activity are at the core of cell biological processes and deregulation of these dynamic events can underpin disease development and progression. Recent advances in intravital imaging techniques in mice are providing new avenues to study real-time molecular behaviour in intact tissues within a live organism and to gain exciting insights into the intricate regulation of live cell biology at the microscale level. The monitoring of fluorescently labelled proteins and agents can be combined with autofluorescent properties of the microenvironment to provide a comprehensive snapshot of in vivo cell biology. In this Review, we summarise recent intravital microscopy approaches in mice, in processes ranging from normal development and homeostasis to disease progression and treatment in cancer, where we emphasise the utility of intravital imaging to observe dynamic and transient events in vivo We also highlight the recent integration of advanced subcellular imaging techniques into the intravital imaging pipeline, which can provide in-depth biological information beyond the single-cell level. We conclude with an outlook of ongoing developments in intravital microscopy towards imaging in humans, as well as provide an overview of the challenges the intravital imaging community currently faces and outline potential ways for overcoming these hurdles.

Flexible polygon-mirror based laser scanning microscope platform for multiphoton in-vivo imaging

Commercial microscopy systems make use of tandem scanning i.e. either slow or fast scanning. We constructed, for the first time, an advanced control system capable of delivering a dynamic line scanning speed ranging from 2.7 kHz to 27 kHz and achieve variable frame rates from 5 Hz to 50 Hz (512 × 512). The dynamic scanning ability is digitally controlled by a new customized open-source software named PScan1.0. This permits manipulation of scanning rates either to gain higher fluorescence signal at slow frame rate without increasing laser power or increase frame rates to capture high speed events. By adjusting imaging speed from 40 Hz to 160 Hz, we capture a range of calcium waves and transient peaks from soma and dendrite of single fluorescence neuron (CAL-520AM). Motion artifacts arising from respiratory and cardiac motion in small animal imaging reduce quality of real-time images of single cells in-vivo. An image registration algorithm, integrated with PScan1.0, was shown to perform both real time and post-processed motion correction. The improvement is verified by quantification of blood flow rates. This work describes all the steps necessary to develop a high performance and flexible polygon-mirror based multiphoton microscope system for in-vivo biological imaging.

Characterization of Cardiac Dynamics in an Acute Myocardial Infarction Model by Four-Dimensional Optoacoustic and Magnetic Resonance Imaging

Extraction of murine cardiac functional parameters on a beat-by-beat basis is limited with the existing imaging modalities due to insufficient three-dimensional temporal resolution. Faster volumetric imaging methods enabling in vivo characterization of functional parameters are poised to advance cardiovascular research and provide a better understanding of the mechanisms underlying cardiac diseases. We present a new approach based on analyzing contrast-enhanced optoacoustic (OA) images acquired at high volumetric frame rate without using cardiac gating or other approaches for motion correction. We apply an acute murine myocardial infarction model optimized for acquisition of artifact-free optoacoustic imaging data to study cardiovascular hemodynamics. Infarcted hearts (n = 21) could be clearly differentiated from healthy controls (n = 9) based on a significantly higher pulmonary transit time (PTT) (2.25 [2.00-2.41] s versus 1.34 [1.25-1.67] s, p = 0.0235), while no statistically significant difference was observed in the heart rate (318 [252-361] bpm versus 264 [252-320] bpm, p = 0.3129). Nevertheless, nonlinear heartbeat dynamics was stronger in the healthy hearts, as evidenced by the third harmonic component in the heartbeat spectra. MRI data acquired from the same mice further revealed that the PTT increases with the size of infarction and similarly increases with reduced ejection fraction. Moreover, an inverse relationship between infarct PTT and time post-surgery was found, which suggests the occurrence of cardiac healing. In combination with the proven ability of optoacoustics to track targeted probes within the injured myocardium, our method can depict cardiac anatomy, function, and molecular signatures, with both high spatial and temporal resolution. Volumetric four-dimensional optoacoustic characterization of cardiac dynamics with supreme temporal resolution can capture cardiovascular dynamics on a beat-by-beat basis in mouse models of myocardial ischemia.

NoRMCorre: An online algorithm for piecewise rigid motion correction of calcium imaging data

BACKGROUND

Motion correction is a challenging pre-processing problem that arises early in the analysis pipeline of calcium imaging data sequences. The motion artifacts in two-photon microscopy recordings can be non-rigid, arising from the finite time of raster scanning and non-uniform deformations of the brain medium.

NEW METHOD

We introduce an algorithm for fast Non-Rigid Motion Correction (NoRMCorre) based on template matching. NoRMCorre operates by splitting the field of view (FOV) into overlapping spatial patches along all directions. The patches are registered at a sub-pixel resolution for rigid translation against a regularly updated template. The estimated alignments are subsequently up-sampled to create a smooth motion field for each frame that can efficiently approximate non-rigid artifacts in a piecewise-rigid manner.

EXISTING METHODS

Existing approaches either do not scale well in terms of computational performance or are targeted to non-rigid artifacts arising just from the finite speed of raster scanning, and thus cannot correct for non-rigid motion observable in datasets from a large FOV.

RESULTS

NoRMCorre can be run in an online mode resulting in comparable to or even faster than real time motion registration of streaming data. We evaluate its performance with simple yet intuitive metrics and compare against other non-rigid registration methods on simulated data and in vivo two-photon calcium imaging datasets. Open source Matlab and Python code is also made available.

CONCLUSIONS

The proposed method and accompanying code can be useful for solving large scale image registration problems in calcium imaging, especially in the presence of non-rigid deformations.

Imaging the pharmacology of nanomaterials by intravital microscopy: Toward understanding their biological behavior

Therapeutic nanoparticles (NPs) can deliver cytotoxic chemotherapeutics and other drugs more safely and efficiently to patients; furthermore, selective delivery to target tissues can theoretically be accomplished actively through coating NPs with molecular ligands, and passively through exploiting physiological "enhanced permeability and retention" features. However, clinical trial results have been mixed in showing improved efficacy with drug nanoencapsulation, largely due to heterogeneous NP accumulation at target sites across patients. Thus, a clear need exists to better understand why many NP strategies fail in vivo and not result in significantly improved tumor uptake or therapeutic response. Multicolor in vivo confocal fluorescence imaging (intravital microscopy; IVM) enables integrated pharmacokinetic and pharmacodynamic (PK/PD) measurement at the single-cell level, and has helped answer key questions regarding the biological mechanisms of in vivo NP behavior. This review summarizes progress to date and also describes useful technical strategies for successful IVM experimentation.

Clinically compatible flexible wide-field multi-color fluorescence endoscopy with a porcine colon model

Early detection of structural or molecular changes in dysplastic epithelial tissues is crucial for cancer screening and surveillance. Multi-targeting molecular endoscopic fluorescence imaging may improve noninvasive detection of precancerous lesions in the colon. Here, we report the first clinically compatible, wide-field-of-view, multi-color fluorescence endoscopy with a leached fiber bundle scope using a porcine model. A porcine colon model that resembles the human colon is used for the detection of surrogate tumors composed of multiple biocompatible fluorophores (FITC, ICG, and heavy metal-free quantum dots (hfQDs)). With an ex vivo porcine colon tumor model, molecular imaging with hfQDs conjugated with MMP14 antibody was achieved by spraying molecular probes on a mucosa layer that contains xenograft tumors. With an in vivo porcine colon embedded with surrogate tumors, target-to-background ratios of 3.36 ± 0.43, 2.70 ± 0.72, and 2.10 ± 0.13 were achieved for FITC, ICG, and hfQD probes, respectively. This promising endoscopic technology with molecular contrast shows the capacity to reveal hidden tumors and guide treatment strategy decisions.

Intravital microscopy of the lung: minimizing invasiveness

In vivo microscopy has recently become a gold standard in lung immunology studies involving small animals, largely benefiting from the democratization of multiphoton microscopy allowing for deep tissue imaging. This technology represents currently our only way of exploring the lungs and inferring what happens in human respiratory medicine. The interest of lung in vivo microscopy essentially relies upon its relevance as a study model, fulfilling physiological requirements in comparison with in vitro and ex vivo experiments. However, strategies developed in order to overcome movements of the thorax caused by breathing and heartbeats remain the chief drawback of the technique and a major source of invasiveness. In this context, minimizing invasiveness is an unavoidable prerequisite for any improvement of lung in vivo microscopy. This review puts into perspective the main techniques enabling lung in vivo microscopy, providing pros and cons regarding invasiveness.

Intravital imaging reveals new ancillary mechanisms co-opted by cancer cells to drive tumor progression

Intravital imaging is providing new insights into the dynamics of tumor progression in native tissues and has started to reveal the layers of complexity found in cancer. Recent advances in intravital imaging have allowed us to look deeper into cancer behavior and to dissect the interactions between tumor cells and the ancillary host niche that promote cancer development. In this review, we provide an insight into the latest advances in cancer biology achieved by intravital imaging, focusing on recently discovered mechanisms by which tumor cells manipulate normal tissue to facilitate disease progression.

Tyrosine kinase-mediated axial motility of basal cells revealed by intravital imaging

Epithelial cells are generally considered to be static relative to their neighbours. Basal cells in pseudostratified epithelia display a single long cytoplasmic process that can cross the tight junction barrier to reach the lumen. Using in vivo microscopy to visualize the epididymis, a model system for the study of pseudostratified epithelia, we report here the surprising discovery that these basal cell projections--which we call axiopodia--periodically extend and retract over time. We found that axiopodia extensions and retractions follow an oscillatory pattern. This movement, which we refer to as periodic axial motility (PAM), is controlled by c-Src and MEK1/2-ERK1/2. Therapeutic inhibition of tyrosine kinase activity induces a retraction of these projections. Such unexpected cell motility may reflect a novel mechanism by which specialized epithelial cells sample the luminal environment.

High-frame rate four dimensional optoacoustic tomography enables visualization of cardiovascular dynamics and mouse heart perfusion

Functional imaging of mouse models of cardiac health and disease provides a major contribution to our fundamental understanding of the mammalian heart. However, imaging murine hearts presents significant challenges due to their small size and rapid heart rate. Here we demonstrate the feasibility of high-frame-rate, noninvasive optoacoustic imaging of the murine heart. The temporal resolution of 50 three-dimensional frames per second provides functional information at important phases of the cardiac cycle without the use of gating or other motion-reduction methods. Differentiation of the blood oxygenation state in the heart chambers was enabled by exploiting the wavelength dependence of optoacoustic signals. Real-time volumetric tracking of blood perfusion in the cardiac chambers was also evaluated using indocyanine green. Taken together, the newly-discovered capacities offer a unique tool set for in-vivo structural and functional imaging of the whole heart with high spatio-temporal resolution in all three dimensions.

New techniques for motion-artifact-free in vivo cardiac microscopy

Intravital imaging microscopy (i.e., imaging in live animals at microscopic resolution) has become an indispensable tool for studying the cellular micro-dynamics in cancer, immunology and neurobiology. High spatial and temporal resolution, combined with large penetration depth and multi-reporter visualization capability make fluorescence intravital microscopy compelling for heart imaging. However, tissue motion caused by cardiac contraction and respiration critically limits its use. As a result, in vitro cell preparations or non-contracting explanted heart models are more commonly employed. Unfortunately, these approaches fall short of understanding the more complex host physiology that may be dynamic and occur over longer periods of time. In this review, we report on novel technologies, which have been recently developed by our group and others, aimed at overcoming motion-induced artifacts and capable of providing in vivo subcellular resolution imaging in the beating mouse heart. The methods are based on mechanical stabilization, image processing algorithms, gated/triggered acquisition schemes or a combination of both. We expect that in the immediate future all these methodologies will have considerable applications in expanding our understanding of the cardiac biology, elucidating cardiomyocyte function and interactions within the organism in vivo, and ultimately improving the treatment of cardiac diseases.

Fibre-coupled multiphoton microscope with adaptive motion compensation

To address the challenge of sample motion during in vivo imaging, we present a fibre-coupled multiphoton microscope with active axial motion compensation. The position of the sample surface is measured using optical coherence tomography and fed back to a piezo actuator that adjusts the axial location of the objective to compensate for sample motion. We characterise the system's performance and demonstrate that it can compensate for axial sample velocities up to 700 µm/s. Finally we illustrate the impact of motion compensation when imaging multiphoton excited autofluorescence in ex vivo mouse skin.

Correlative intravital imaging of cGMP signals and vasodilation in mice

Cyclic guanosine monophosphate (cGMP) is an important signaling molecule and drug target in the cardiovascular system. It is well known that stimulation of the vascular nitric oxide (NO)-cGMP pathway results in vasodilation. However, the spatiotemporal dynamics of cGMP signals themselves and the cGMP concentrations within specific cardiovascular cell types in health, disease, and during pharmacotherapy with cGMP-elevating drugs are largely unknown. To facilitate the analysis of cGMP signaling in vivo, we have generated transgenic mice that express fluorescence resonance energy transfer (FRET)-based cGMP sensor proteins. Here, we describe two models of intravital FRET/cGMP imaging in the vasculature of cGMP sensor mice: (1) epifluorescence-based ratio imaging in resistance-type vessels of the cremaster muscle and (2) ratio imaging by multiphoton microscopy within the walls of subcutaneous blood vessels accessed through a dorsal skinfold chamber. Both methods allow simultaneous monitoring of NO-induced cGMP transients and vasodilation in living mice. Detailed protocols of all steps necessary to perform and evaluate intravital imaging experiments of the vasculature of anesthetized mice including surgery, imaging, and data evaluation are provided. An image segmentation approach is described to estimate FRET/cGMP changes within moving structures such as the vessel wall during vasodilation. The methods presented herein should be useful to visualize cGMP or other biochemical signals that are detectable with FRET-based biosensors, such as cyclic adenosine monophosphate or Ca²⁺, and to correlate them with respective vascular responses. With further refinement and combination of transgenic mouse models and intravital imaging technologies, we envision an exciting future, in which we are able to “watch” biochemistry, (patho-)physiology, and pharmacotherapy in the context of a living mammalian organism.

Imaging windows for long-term intravital imaging: General overview and technical insights

Intravital microscopy is increasingly used to visualize and quantitate dynamic biological processes at the (sub)cellular level in live animals. By visualizing tissues through imaging windows, individual cells (e.g., cancer, host, or stem cells) can be tracked and studied over a time-span of days to months. Several imaging windows have been developed to access tissues including the brain, superficial fascia, mammary glands, liver, kidney, pancreas, and small intestine among others. Here, we review the development of imaging windows and compare the most commonly used long-term imaging windows for cancer biology: the cranial imaging window, the dorsal skin fold chamber, the mammary imaging window, and the abdominal imaging window. Moreover, we provide technical details, considerations, and trouble-shooting tips on the surgical procedures and microscopy setups for each imaging window and explain different strategies to assure imaging of the same area over multiple imaging sessions. This review aims to be a useful resource for establishing the long-term intravital imaging procedure.