Real-time volumetric reconstruction of biological dynamics with light-field microscopy and deep learning

Physics-driven self-supervised learning for fast high-resolution robust 3D reconstruction of light-field microscopy

Light-field microscopy (LFM) and its variants have significantly advanced intravital high-speed 3D imaging. However, their practical applications remain limited due to trade-offs among processing speed, fidelity, and generalization in existing reconstruction methods. Here we propose a physics-driven self-supervised reconstruction network (SeReNet) for unscanned LFM and scanning LFM (sLFM) to achieve near-diffraction-limited resolution at millisecond-level processing speed. SeReNet leverages 4D information priors to not only achieve better generalization than existing deep-learning methods, especially under challenging conditions such as strong noise, optical aberration, and sample motion, but also improve processing speed by 700 times over iterative tomography. Axial performance can be further enhanced via fine-tuning as an optional add-on with compromised generalization. We demonstrate these advantages by imaging living cells, zebrafish embryos and larvae, Caenorhabditis elegans, and mice. Equipped with SeReNet, sLFM now enables continuous day-long high-speed 3D subcellular imaging with over 300,000 volumes of large-scale intercellular dynamics, such as immune responses and neural activities, leading to widespread practical biological applications.

Multiscale and recursive unmixing of spatiotemporal rhythms for live-cell and intravital cardiac microscopy

Cardiovascular diseases remain a pressing public health issue, necessitating the development of advanced therapeutic strategies underpinned by precise cardiac observations. While fluorescence microscopy is an invaluable tool for probing biological processes, cardiovascular signals are often complicated by persistent autofluorescence, overlaying dynamic cardiovascular entities and nonspecific labeling from tissue microenvironments. Here we present multiscale recursive decomposition for the precise extraction of dynamic cardiovascular signals. Multiscale recursive decomposition constructs a comprehensive framework for cardiac microscopy that includes pixel-wise image enhancement, robust principal component analysis and recursive motion segmentation. This method has been validated in various cardiac systems, including in vitro studies with human induced pluripotent stem cell-derived cardiomyocytes and in vivo studies of cardiovascular morphology and function in Xenopus embryos. The approach advances light-field cardiac microscopy, facilitating simultaneous, multiparametric and volumetric analysis of cardiac activities with minimum photodamage. We anticipate that the methodology will advance cardiovascular studies across a broad spectrum of cardiac models.

Real-time and universal network for volumetric imaging from microscale to macroscale at high resolution

Light-field imaging has wide applications in various domains, including microscale life science imaging, mesoscale neuroimaging, and macroscale fluid dynamics imaging. The development of deep learning-based reconstruction methods has greatly facilitated high-resolution light-field image processing, however, current deep learning-based light-field reconstruction methods have predominantly concentrated on the microscale. Considering the multiscale imaging capacity of light-field technique, a network that can work over variant scales of light-field image reconstruction will significantly benefit the development of volumetric imaging. Unfortunately, to our knowledge, no one has reported a universal high-resolution light-field image reconstruction algorithm that is compatible with microscale, mesoscale, and macroscale. To fill this gap, we present a real-time and universal network (RTU-Net) to reconstruct high-resolution light-field images at any scale. RTU-Net, as the first network that works over multiscale light-field image reconstruction, employs an adaptive loss function based on generative adversarial theory and consequently exhibits strong generalization capability. We comprehensively assessed the performance of RTU-Net through the reconstruction of multiscale light-field images, including microscale tubulin and mitochondrion dataset, mesoscale synthetic mouse neuro dataset, and macroscale light-field particle imaging velocimetry dataset. The results indicated that RTU-Net has achieved real-time and high-resolution light-field image reconstruction for volume sizes ranging from 300 μm × 300 μm × 12 μm to 25 mm × 25 mm × 25 mm, and demonstrated higher resolution when compared with recently reported light-field reconstruction networks. The high-resolution, strong robustness, high efficiency, and especially the general applicability of RTU-Net will significantly deepen our insight into high-resolution and volumetric imaging.

Imaging 3D cell cultures with optical microscopy

Three-dimensional (3D) cell cultures have gained popularity in recent years due to their ability to represent complex tissues or organs more faithfully than conventional two-dimensional (2D) cell culture. This article reviews the application of both 2D and 3D microscopy approaches for monitoring and studying 3D cell cultures. We first summarize the most popular optical microscopy methods that have been used with 3D cell cultures. We then discuss the general advantages and disadvantages of various microscopy techniques for several broad categories of investigation involving 3D cell cultures. Finally, we provide perspectives on key areas of technical need in which there are clear opportunities for innovation. Our goal is to guide microscope engineers and biomedical end users toward optimal imaging methods for specific investigational scenarios and to identify use cases in which additional innovations in high-resolution imaging could be helpful.

Long-term intravital subcellular imaging with confocal scanning light-field microscopy

Long-term observation of subcellular dynamics in living organisms is limited by background fluorescence originating from tissue scattering or dense labeling. Existing confocal approaches face an inevitable tradeoff among parallelization, resolution and phototoxicity. Here we present confocal scanning light-field microscopy (csLFM), which integrates axially elongated line-confocal illumination with the rolling shutter in scanning light-field microscopy (sLFM). csLFM enables high-fidelity, high-speed, three-dimensional (3D) imaging at near-diffraction-limit resolution with both optical sectioning and low phototoxicity. By simultaneous 3D excitation and detection, the excitation intensity can be reduced below 1 mW mm-2, with 15-fold higher signal-to-background ratio over sLFM. We imaged subcellular dynamics over 25,000 timeframes in optically challenging environments in different species, such as migrasome delivery in mouse spleen, retractosome generation in mouse liver and 3D voltage imaging in Drosophila. Moreover, csLFM facilitates high-fidelity, large-scale neural recording with reduced crosstalk, leading to high orientation selectivity to visual stimuli, similar to two-photon microscopy, which aids understanding of neural coding mechanisms.

Ultrafast optical imaging techniques for exploring rapid neuronal dynamics

Optical neuroimaging has significantly advanced our understanding of brain function, particularly through techniques such as two-photon microscopy, which captures three-dimensional brain structures with sub-cellular resolution. However, traditional methods struggle to record fast, complex neuronal interactions in real time, which are crucial for understanding brain networks and developing treatments for neurological diseases such as Alzheimer's, Parkinson's, and chronic pain. Recent advancements in ultrafast imaging technologies, including kilohertz two-photon microscopy, light field microscopy, and event-based imaging, are pushing the boundaries of temporal resolution in neuroimaging. These techniques enable the capture of rapid neural events with unprecedented speed and detail. This review examines the principles, applications, and limitations of these technologies, highlighting their potential to revolutionize neuroimaging and improve the diagnose and treatment of neurological disorders. Despite challenges such as photodamage risks and spatial resolution trade-offs, integrating these approaches promises to enhance our understanding of brain function and drive future breakthroughs in neuroscience and medicine. Continued interdisciplinary collaboration is essential to fully leverage these innovations for advancements in both basic and clinical neuroscience.

Volumetric imaging and computation to explore contractile function in zebrafish hearts

Despite advancements in cardiovascular engineering, heart diseases remain a leading cause of mortality. The limited understanding of the underlying mechanisms of cardiac dysfunction at the cellular level restricts the development of effective screening and therapeutic methods. To address this, we have developed a framework that incorporates light field detection and individual cell tracking to capture real-time volumetric data in zebrafish hearts, which share structural and electrical similarities with the human heart and generate 120 to 180 beats per minute. Our results indicate that the in-house system achieves an acquisition speed of 200 volumes per second, with resolutions of up to 5.02 ± 0.54 µm laterally and 9.02 ± 1.11 µm axially across the entire depth, using the estimated-maximized-smoothed deconvolution method. The subsequent deep learning-based cell trackers enable further investigation of contractile dynamics, including cellular displacement and velocity, followed by volumetric tracking of specific cells of interest from end-systole to end-diastole in an interactive environment. Collectively, our strategy facilitates real-time volumetric imaging and assessment of contractile dynamics across the entire ventricle at the cellular resolution over multiple cycles, providing significant potential for exploring intercellular interactions in both health and disease.

Ultra-fast light-field microscopy with event detection

The event detection technique has been introduced to light-field microscopy, boosting its imaging speed in orders of magnitude with simultaneous axial resolution enhancement in scattering medium.

Volumetric voltage imaging of neuronal populations in the mouse brain by confocal light-field microscopy

Voltage imaging measures neuronal activity directly and holds promise for understanding information processing within individual neurons and across populations. However, imaging voltage over large neuronal populations has been challenging owing to the simultaneous requirements of high imaging speed and signal-to-noise ratio, large volume coverage and low photobleaching rate. Here, to overcome this challenge, we developed a confocal light-field microscope that surpassed the traditional limits in speed and noise performance by incorporating a speed-enhanced camera, a fast and robust scanning mechanism, laser-speckle-noise elimination and optimized light efficiency. With this method, we achieved simultaneous recording from more than 300 spiking neurons within an 800-µm-diameter and 180-µm-thick volume in the mouse cortex, for more than 20 min. By integrating the spatial and voltage activity profiles, we have mapped three-dimensional neural coordination patterns in awake mouse brains. Our method is robust for routine application in volumetric voltage imaging.

Long-term mesoscale imaging of 3D intercellular dynamics across a mammalian organ

A comprehensive understanding of physio-pathological processes necessitates non-invasive intravital three-dimensional (3D) imaging over varying spatial and temporal scales. However, huge data throughput, optical heterogeneity, surface irregularity, and phototoxicity pose great challenges, leading to an inevitable trade-off between volume size, resolution, speed, sample health, and system complexity. Here, we introduce a compact real-time, ultra-large-scale, high-resolution 3D mesoscope (RUSH3D), achieving uniform resolutions of 2.6 × 2.6 × 6 μm3 across a volume of 8,000 × 6,000 × 400 μm3 at 20 Hz with low phototoxicity. Through the integration of multiple computational imaging techniques, RUSH3D facilitates a 13-fold improvement in data throughput and an orders-of-magnitude reduction in system size and cost. With these advantages, we observed premovement neural activity and cross-day visual representational drift across the mouse cortex, the formation and progression of multiple germinal centers in mouse inguinal lymph nodes, and heterogeneous immune responses following traumatic brain injury-all at single-cell resolution, opening up a horizon for intravital mesoscale study of large-scale intercellular interactions at the organ level.

Frontiers in artificial intelligence-directed light-sheet microscopy for uncovering biological phenomena and multi-organ imaging

Light-sheet fluorescence microscopy (LSFM) introduces fast scanning of biological phenomena with deep photon penetration and minimal phototoxicity. This advancement represents a significant shift in 3-D imaging of large-scale biological tissues and 4-D (space + time) imaging of small live animals. The large data associated with LSFM requires efficient imaging acquisition and analysis with the use of artificial intelligence (AI)/machine learning (ML) algorithms. To this end, AI/ML-directed LSFM is an emerging area for multi-organ imaging and tumor diagnostics. This review will present the development of LSFM and highlight various LSFM configurations and designs for multi-scale imaging. Optical clearance techniques will be compared for effective reduction in light scattering and optimal deep-tissue imaging. This review will further depict a diverse range of research and translational applications, from small live organisms to multi-organ imaging to tumor diagnosis. In addition, this review will address AI/ML-directed imaging reconstruction, including the application of convolutional neural networks (CNNs) and generative adversarial networks (GANs). In summary, the advancements of LSFM have enabled effective and efficient post-imaging reconstruction and data analyses, underscoring LSFM's contribution to advancing fundamental and translational research.

Semantic redundancy-aware implicit neural compression for multidimensional biomedical image data

The surge in advanced imaging techniques has generated vast biomedical image data with diverse dimensions in space, time and spectrum, posing big challenges to conventional compression techniques in image storage, transmission, and sharing. Here, we propose an intelligent image compression approach with the first-proved semantic redundancy of biomedical data in the implicit neural function domain. This Semantic redundancy based Implicit Neural Compression guided with Saliency map (SINCS) can notably improve the compression efficiency for arbitrary-dimensional image data in terms of compression ratio and fidelity. Moreover, with weight transfer and residual entropy coding strategies, it shows improved compression speed while maintaining high quality. SINCS yields high quality compression with over 2000-fold compression ratio on 2D, 2D-T, 3D, 4D biomedical images of diverse targets ranging from single virus to entire human organs, and ensures reliable downstream tasks, such as object segmentation and quantitative analyses, to be conducted at high efficiency.

Pretraining a foundation model for generalizable fluorescence microscopy-based image restoration

Fluorescence microscopy-based image restoration has received widespread attention in the life sciences and has led to significant progress, benefiting from deep learning technology. However, most current task-specific methods have limited generalizability to different fluorescence microscopy-based image restoration problems. Here, we seek to improve generalizability and explore the potential of applying a pretrained foundation model to fluorescence microscopy-based image restoration. We provide a universal fluorescence microscopy-based image restoration (UniFMIR) model to address different restoration problems, and show that UniFMIR offers higher image restoration precision, better generalization and increased versatility. Demonstrations on five tasks and 14 datasets covering a wide range of microscopy imaging modalities and biological samples demonstrate that the pretrained UniFMIR can effectively transfer knowledge to a specific situation via fine-tuning, uncover clear nanoscale biomolecular structures and facilitate high-quality imaging. This work has the potential to inspire and trigger new research highlights for fluorescence microscopy-based image restoration.

Synthetic color-and-depth encoded (sCade) illumination-based high-resolution light field particle imaging velocimetry

Light-field particle imaging velocimetry (LF-PIV) is widely used in large-scale flow field measurement scenarios due to its instant 3D imaging capability. However, conventional LF-PIV systems suffer low axial resolution and thereby have limited application in high-resolution and volumetric velocity measurements. Here, we report the use of synthetic color-and-depth-encoded (sCade) illumination to improve the axial resolution of LF-PIV. The sCade LF-PIV illuminated the imaging region with a color-and-depth encoded beam synthesized by structured beams of three lasers with distinct wavelengths and attained high-fidelity particle localization by decoding the color and depth information encoded in the acquired image. We systematically characterized the system performance by imaging particles and obtained 29 times improvement in axial resolution when compared to traditional LF-PIV. The high axial resolution of sCade LF-PIV allowed it to reconstruct vortices generated by square lid-driven cavity flow and a stirring disk with higher accuracy and smaller errors than the conventional method, highlighting the possibility and advantage of sCade LF-PIV for high-resolution and volumetric flow measurement applications. This approach can favorably advance the development of fluid measurement technology.

Depth-enhanced high-throughput microscopy by compact PSF engineering

High-throughput microscopy is vital for screening applications, where three-dimensional (3D) cellular models play a key role. However, due to defocus susceptibility, current 3D high-throughput microscopes require axial scanning, which lowers throughput and increases photobleaching and photodamage. Point spread function (PSF) engineering is an optical method that enables various 3D imaging capabilities, yet it has not been implemented in high-throughput microscopy due to the cumbersome optical extension it typically requires. Here we demonstrate compact PSF engineering in the objective lens, which allows us to enhance the imaging depth of field and, combined with deep learning, recover 3D information using single snapshots. Beyond the applications shown here, this work showcases the usefulness of high-throughput microscopy in obtaining training data for deep learning-based algorithms, applicable to a variety of microscopy modalities.

Bringing Artificial Intelligence (AI) into Environmental Toxicology Studies: A Perspective of AI-Enabled Zebrafish High-Throughput Screening

The booming development of artificial intelligence (AI) has brought excitement to many research fields that could benefit from its big data analysis capability for causative relationship establishment and knowledge generation. In toxicology studies using zebrafish, the microscopic images and videos that illustrate the developmental stages, phenotypic morphologies, and animal behaviors possess great potential to facilitate rapid hazard assessment and dissection of the toxicity mechanism of environmental pollutants. However, the traditional manual observation approach is both labor-intensive and time-consuming. In this Perspective, we aim to summarize the current AI-enabled image and video analysis tools to realize the full potential of AI. For image analysis, AI-based tools allow fast and objective determination of morphological features and extraction of quantitative information from images of various sorts. The advantages of providing accurate and reproducible results while avoiding human intervention play a critical role in speeding up the screening process. For video analysis, AI-based tools enable the tracking of dynamic changes in both microscopic cellular events and macroscopic animal behaviors. The subtle changes revealed by video analysis could serve as sensitive indicators of adverse outcomes. With AI-based toxicity analysis in its infancy, exciting developments and applications are expected to appear in the years to come.

Efficient high-resolution fluorescence projection imaging over an extended depth of field through optical hardware and deep learning optimizations

Optical microscopy has witnessed notable advancements but has also become more costly and complex. Conventional wide field microscopy (WFM) has low resolution and shallow depth-of-field (DOF), which limits its applications in practical biological experiments. Recently, confocal and light sheet microscopy become major workhorses for biology that incorporate high-precision scanning to perform imaging within an extended DOF but at the sacrifice of expense, complexity, and imaging speed. Here, we propose deep focus microscopy, an efficient framework optimized both in hardware and algorithm to address the tradeoff between resolution and DOF. Our deep focus microscopy achieves large-DOF and high-resolution projection imaging by integrating a deep focus network (DFnet) into light field microscopy (LFM) setups. Based on our constructed dataset, deep focus microscopy features a significantly enhanced spatial resolution of ∼260 nm, an extended DOF of over 30 µm, and broad generalization across diverse sample structures. It also reduces the computational costs by four orders of magnitude compared to conventional LFM technologies. We demonstrate the excellent performance of deep focus microscopy in vivo, including long-term observations of cell division and migrasome formation in zebrafish embryos and mouse livers at high resolution without background contamination.

Neurophotonics: a comprehensive review, current challenges and future trends

The human brain, with its vast network of billions of neurons and trillions of synapses (connections) between diverse cell types, remains one of the greatest mysteries in science and medicine. Despite extensive research, an understanding of the underlying mechanisms that drive normal behaviors and response to disease states is still limited. Advancement in the Neuroscience field and development of therapeutics for related pathologies requires innovative technologies that can provide a dynamic and systematic understanding of the interactions between neurons and neural circuits. In this work, we provide an up-to-date overview of the evolution of neurophotonic approaches in the last 10 years through a multi-source, literature analysis. From an initial corpus of 243 papers retrieved from Scopus, PubMed and WoS databases, we have followed the PRISMA approach to select 56 papers in the area. Following a full-text evaluation of these 56 scientific articles, six main areas of applied research were identified and discussed: (1) Advanced optogenetics, (2) Multimodal neural interfaces, (3) Innovative therapeutics, (4) Imaging devices and probes, (5) Remote operations, and (6) Microfluidic platforms. For each area, the main technologies selected are discussed according to the photonic principles applied, the neuroscience application evaluated and the more indicative results of efficiency and scientific potential. This detailed analysis is followed by an outlook of the main challenges tackled over the last 10 years in the Neurophotonics field, as well as the main technological advances regarding specificity, light delivery, multimodality, imaging, materials and system designs. We conclude with a discussion of considerable challenges for future innovation and translation in Neurophotonics, from light delivery within the brain to physical constraints and data management strategies.

Versatile multiple object tracking in sparse 2D/3D videos via deformable image registration

Tracking body parts in behaving animals, extracting fluorescence signals from cells embedded in deforming tissue, and analyzing cell migration patterns during development all require tracking objects with partially correlated motion. As dataset sizes increase, manual tracking of objects becomes prohibitively inefficient and slow, necessitating automated and semi-automated computational tools. Unfortunately, existing methods for multiple object tracking (MOT) are either developed for specific datasets and hence do not generalize well to other datasets, or require large amounts of training data that are not readily available. This is further exacerbated when tracking fluorescent sources in moving and deforming tissues, where the lack of unique features and sparsely populated images create a challenging environment, especially for modern deep learning techniques. By leveraging technology recently developed for spatial transformer networks, we propose ZephIR, an image registration framework for semi-supervised MOT in 2D and 3D videos. ZephIR can generalize to a wide range of biological systems by incorporating adjustable parameters that encode spatial (sparsity, texture, rigidity) and temporal priors of a given data class. We demonstrate the accuracy and versatility of our approach in a variety of applications, including tracking the body parts of a behaving mouse and neurons in the brain of a freely moving C. elegans. We provide an open-source package along with a web-based graphical user interface that allows users to provide small numbers of annotations to interactively improve tracking results.

Model-Based Explainable Deep Learning for Light-Field Microscopy Imaging

In modern neuroscience, observing the dynamics of large populations of neurons is a critical step of understanding how networks of neurons process information. Light-field microscopy (LFM) has emerged as a type of scanless, high-speed, three-dimensional (3D) imaging tool, particularly attractive for this purpose. Imaging neuronal activity using LFM calls for the development of novel computational approaches that fully exploit domain knowledge embedded in physics and optics models, as well as enabling high interpretability and transparency. To this end, we propose a model-based explainable deep learning approach for LFM. Different from purely data-driven methods, the proposed approach integrates wave-optics theory, sparse representation and non-linear optimization with the artificial neural network. In particular, the architecture of the proposed neural network is designed following precise signal and optimization models. Moreover, the network's parameters are learned from a training dataset using a novel training strategy that integrates layer-wise training with tailored knowledge distillation. Such design allows the network to take advantage of domain knowledge and learned new features. It combines the benefit of both model-based and learning-based methods, thereby contributing to superior interpretability, transparency and performance. By evaluating on both structural and functional LFM data obtained from scattering mammalian brain tissues, we demonstrate the capabilities of the proposed approach to achieve fast, robust 3D localization of neuron sources and accurate neural activity identification.

Bioluminescence as a functional tool for visualizing and controlling neuronal activity in vivo

The use of bioluminescence as a reporter for physiology in neuroscience is as old as the discovery of the calcium-dependent photon emission of aequorin. Over the years, luciferases have been largely replaced by fluorescent reporters, but recently, the field has seen a renaissance of bioluminescent probes, catalyzed by unique developments in imaging technology, bioengineering, and biochemistry to produce luciferases with previously unseen colors and intensity. This is not surprising as the advantages of bioluminescence make luciferases very attractive for noninvasive, longitudinal in vivo observations without the need of an excitation light source. Here, we review how the development of dedicated and specific sensor-luciferases afforded, among others, transcranial imaging of calcium and neurotransmitters, or cellular metabolites and physical quantities such as forces and membrane voltage. Further, the increased versatility and light output of luciferases have paved the way for a new field of functional bioluminescence optogenetics, in which the photon emission of the luciferase is coupled to the gating of a photosensor, e.g., a channelrhodopsin and we review how they have been successfully used to engineer synthetic neuronal connections. Finally, we provide a primer to consider important factors in setting up functional bioluminescence experiments, with a particular focus on the genetic model Caenorhabditis elegans, and discuss the leading challenges that the field needs to overcome to regain a competitive advantage over fluorescence modalities. Together, our paper caters to experienced users of bioluminescence as well as novices who would like to experience the advantages of luciferases in their own hand.

Fast light-field 3D microscopy with out-of-distribution detection and adaptation through conditional normalizing flows

Real-time 3D fluorescence microscopy is crucial for the spatiotemporal analysis of live organisms, such as neural activity monitoring. The eXtended field-of-view light field microscope (XLFM), also known as Fourier light field microscope, is a straightforward, single snapshot solution to achieve this. The XLFM acquires spatial-angular information in a single camera exposure. In a subsequent step, a 3D volume can be algorithmically reconstructed, making it exceptionally well-suited for real-time 3D acquisition and potential analysis. Unfortunately, traditional reconstruction methods (like deconvolution) require lengthy processing times (0.0220 Hz), hampering the speed advantages of the XLFM. Neural network architectures can overcome the speed constraints but do not automatically provide a way to certify the realism of their reconstructions, which is essential in the biomedical realm. To address these shortcomings, this work proposes a novel architecture to perform fast 3D reconstructions of live immobilized zebrafish neural activity based on a conditional normalizing flow. It reconstructs volumes at 8 Hz spanning 512x512x96 voxels, and it can be trained in under two hours due to the small dataset requirements (50 image-volume pairs). Furthermore, normalizing flows provides a way to compute the exact likelihood of a sample. This allows us to certify whether the predicted output is in- or ood, and retrain the system when a novel sample is detected. We evaluate the proposed method on a cross-validation approach involving multiple in-distribution samples (genetically identical zebrafish) and various out-of-distribution ones.

High-resolution 3D imaging in light-field microscopy through Stokes matrices and data fusion

The trade-off between the lateral and vertical resolution has long posed challenges to the efficient and widespread application of Fourier light-field microscopy, a highly scalable 3D imaging tool. Although existing methods for resolution enhancement can improve the measurement result to a certain extent, they come with limitations in terms of accuracy and applicable specimen types. To address these problems, this paper proposed a resolution enhancement scheme utilizing data fusion of polarization Stokes vectors and light-field information for Fourier light-field microscopy system. By introducing the surface normal vector information obtained from polarization measurement and integrating it with the light-field 3D point cloud data, 3D reconstruction results accuracy is highly improved in axial direction. Experimental results with a Fourier light-field 3D imaging microscope demonstrated a substantial enhancement of vertical resolution with a depth resolution to depth of field ratio of 0.19%. This represented approximately 44 times the improvement compared to the theoretical ratio before data fusion, enabling the system to access more detailed information with finer measurement accuracy for test samples. This work not only provides a feasible solution for breaking the limitations imposed by traditional light-field microscope hardware configurations but also offers superior 3D measurement approach in a more cost-effective and practical manner.

Zebrafish (Danio rerio) as a Model for the Study of Developmental and Cardiovascular Toxicity of Electronic Cigarettes

The increasing popularity of electronic cigarettes (e-cigarettes) as an alternative to conventional tobacco products has raised concerns regarding their potential adverse effects. The cardiovascular system undergoes intricate processes forming the heart and blood vessels during fetal development. However, the precise impact of e-cigarette smoke and aerosols on these delicate developmental processes remains elusive. Previous studies have revealed changes in gene expression patterns, disruptions in cellular signaling pathways, and increased oxidative stress resulting from e-cigarette exposure. These findings indicate the potential for e-cigarettes to cause developmental and cardiovascular harm. This comprehensive review article discusses various aspects of electronic cigarette use, emphasizing the relevance of cardiovascular studies in Zebrafish for understanding the risks to human health. It also highlights novel experimental approaches and technologies while addressing their inherent challenges and limitations.

Video-rate 3D imaging of living cells using Fourier view-channel-depth light field microscopy

Interrogation of subcellular biological dynamics occurring in a living cell often requires noninvasive imaging of the fragile cell with high spatiotemporal resolution across all three dimensions. It thereby poses big challenges to modern fluorescence microscopy implementations because the limited photon budget in a live-cell imaging task makes the achievable performance of conventional microscopy approaches compromise between their spatial resolution, volumetric imaging speed, and phototoxicity. Here, we incorporate a two-stage view-channel-depth (VCD) deep-learning reconstruction strategy with a Fourier light-field microscope based on diffractive optical element to realize fast 3D super-resolution reconstructions of intracellular dynamics from single diffraction-limited 2D light-filed measurements. This VCD-enabled Fourier light-filed imaging approach (F-VCD), achieves video-rate (50 volumes per second) 3D imaging of intracellular dynamics at a high spatiotemporal resolution of ~180 nm × 180 nm × 400 nm and strong noise-resistant capability, with which light field images with a signal-to-noise ratio (SNR) down to -1.62 dB could be well reconstructed. With this approach, we successfully demonstrate the 4D imaging of intracellular organelle dynamics, e.g., mitochondria fission and fusion, with ~5000 times of observation.

Optical projection tomography reconstruction with few views using highly-generalizable deep learning at sinogram domain

Optical projection tomography (OPT) reconstruction using a minimal number of measured views offers the potential to significantly reduce excitation dosage and greatly enhance temporal resolution in biomedical imaging. However, traditional algorithms for tomographic reconstruction exhibit severe quality degradation, e.g., presence of streak artifacts, when the number of views is reduced. In this study, we introduce a novel domain evaluation method which can evaluate the domain complexity, and thereby validate that the sinogram domain exhibits lower complexity as compared to the conventional spatial domain. Then we achieve robust deep-learning-based reconstruction with a feedback-based data initialization method at sinogram domain, which shows strong generalization ability that notably improves the overall performance for OPT image reconstruction. This learning-based approach, termed SinNet, enables 4-view OPT reconstructions of diverse biological samples showing robust generalization ability. It surpasses the conventional OPT reconstruction approaches in terms of peak-signal-to-noise ratio (PSNR) and structural similarity (SSIM) metrics, showing its potential for the augment of widely-used OPT techniques.

Integrating 4-D light-sheet fluorescence microscopy and genetic zebrafish system to investigate ambient pollutants-mediated toxicity

Ambient air pollutants, including PM2.5 (aerodynamic diameter d ~2.5 μm), PM10 (d ~10 μm), and ultrafine particles (UFP: d < 0.1 μm) impart both short- and long-term toxicity to various organs, including cardiopulmonary, central nervous, and gastrointestinal systems. While rodents have been the principal animal model to elucidate air pollution-mediated organ dysfunction, zebrafish (Danio rerio) is genetically tractable for its short husbandry and life cycle to study ambient pollutants. Its electrocardiogram (ECG) resembles that of humans, and the fluorescent reporter-labeled tissues in the zebrafish system allow for screening a host of ambient pollutants that impair cardiovascular development, organ regeneration, and gut-vascular barriers. In parallel, the high spatiotemporal resolution of light-sheet fluorescence microscopy (LSFM) enables investigators to take advantage of the transparent zebrafish embryos and genetically labeled fluorescent reporters for imaging the dynamic cardiac structure and function at a single-cell resolution. In this context, our review highlights the integrated strengths of the genetic zebrafish system and LSFM for high-resolution and high-throughput investigation of ambient pollutants-mediated cardiac and intestinal toxicity.

Light field measurement of specular surfaces by multi-polarization and hybrid modulated illumination

Specular highlights present a challenge in light field microscopy imaging fields, leading to loss of target information and incorrect observation results. Existing highlight elimination methods suffer from computational complexity, false information and applicability. To address these issues, an adaptive multi-polarization illumination scheme is proposed to effectively eliminate highlight reflections and ensure uniform illumination without complex optical setup or mechanical rotation. Using a multi-polarized light source with hybrid modulated illumination, the system achieved combined multi-polarized illumination and physical elimination of specular highlights. This was achieved by exploiting the different light contributions at different polarization angles and by using optimal solution algorithms and precise electronic control. Experimental results show that the proposed adaptive illumination system can efficiently compute control parameters and precisely adjust the light source output in real time, resulting in a significant reduction of specular highlight pixels to less than 0.001% of the original image. In addition, the system ensures uniform illumination of the target area under different illumination configurations, further improving the overall image quality. This study presents a multi-polarization-based adaptive de-highlighting system with potential applications in miniaturization, biological imaging and materials analysis.

Fluorescence Microscopy: a statistics-optics perspective

Fundamental properties of light unavoidably impose features on images collected using fluorescence microscopes. Modeling these features is ever more important in quantitatively interpreting microscopy images collected at scales on par or smaller than light's wavelength. Here we review the optics responsible for generating fluorescent images, fluorophore properties, microscopy modalities leveraging properties of both light and fluorophores, in addition to the necessarily probabilistic modeling tools imposed by the stochastic nature of light and measurement.

Machine learning for cross-scale microscopy of viruses

Despite advances in virological sciences and antiviral research, viruses continue to emerge, circulate, and threaten public health. We still lack a comprehensive understanding of how cells and individuals remain susceptible to infectious agents. This deficiency is in part due to the complexity of viruses, including the cell states controlling virus-host interactions. Microscopy samples distinct cellular infection stages in a multi-parametric, time-resolved manner at molecular resolution and is increasingly enhanced by machine learning and deep learning. Here we discuss how state-of-the-art artificial intelligence (AI) augments light and electron microscopy and advances virological research of cells. We describe current procedures for image denoising, object segmentation, tracking, classification, and super-resolution and showcase examples of how AI has improved the acquisition and analyses of microscopy data. The power of AI-enhanced microscopy will continue to help unravel virus infection mechanisms, develop antiviral agents, and improve viral vectors.

Enhancing Total Optical Throughput of Microscopy with Deep Learning for Intravital Observation

The significance of performing large-depth dynamic microscopic imaging in vivo for life science research cannot be overstated. However, the optical throughput of the microscope limits the available information per unit of time, i.e., it is difficult to obtain both high spatial and temporal resolution at once. Here, a method is proposed to construct a kind of intravital microscopy with high optical throughput, by making near-infrared-II (NIR-II, 900-1880 nm) wide-field fluorescence microscopy learn from two-photon fluorescence microscopy based on a scale-recurrent network. Using this upgraded NIR-II fluorescence microscope, vessels in the opaque brain of a rodent are reconstructed three-dimensionally. Five-fold axial and thirteen-fold lateral resolution improvements are achieved without sacrificing temporal resolution and light utilization. Also, tiny cerebral vessel dilatations in early acute respiratory failure mice are observed, with this high optical throughput NIR-II microscope at an imaging speed of 30 fps.

Revolutionizing microfluidics with artificial intelligence: a new dawn for lab-on-a-chip technologies

Keisuke Goda, Hang Lu, Peng Fei, and Jochen Guck introduce the AI in Microfluidics themed collection, on revolutionizing microfluidics with artificial intelligence: a new dawn for lab-on-a-chip technologies.

Fast algorithm for 3D volume reconstruction from light field microscopy datasets

Light field microscopy can capture 3D volume datasets in a snapshot, making it a valuable tool for high-speed 3D imaging of dynamic biological events. However, subsequent computational reconstruction of the raw data into a human-interpretable 3D+time image is very time-consuming, limiting the technique's utility as a routine imaging tool. Here we derive improved equations for 3D volume reconstruction from light field microscopy datasets, leading to dramatic speedups. We characterize our open-source Python implementation of these algorithms and demonstrate real-world reconstruction speedups of more than an order of magnitude compared with established approaches. The scale of this performance improvement opens up new possibilities for studying large timelapse datasets in light field microscopy.

Machine learning in cardiology: Clinical application and basic research

Machine learning is a subfield of artificial intelligence. The quality and versatility of machine learning have been rapidly improving and playing a critical role in many aspects of social life. This trend is also observed in the medical field. Generally, there are three main types of machine learning: supervised, unsupervised, and reinforcement learning. Each type of learning is adequately selected for the purpose and type of data. In the field of medicine, various types of information are collected and used, and research using machine learning is becoming increasingly relevant. Many clinical studies are conducted using electronic health and medical records, including in the cardiovascular area. Machine learning has also been applied in basic research. Machine learning has been widely used for several types of data analysis, such as clustering of microarray analysis and RNA sequence analysis. Machine learning is essential for genome and multi-omics analyses. This review summarizes the recent advancements in the use of machine learning in clinical applications and basic cardiovascular research.

3D Chemical Imaging by Fluorescence-detected Mid-Infrared Photothermal Fourier Light Field Microscopy

Three-dimensional molecular imaging of living organisms and cells plays a significant role in modern biology. Yet, current volumetric imaging modalities are largely fluorescence-based and thus lack chemical content information. Mid-infrared photothermal microscopy as a chemical imaging technology provides infrared spectroscopic information at submicrometer spatial resolution. Here, by harnessing thermosensitive fluorescent dyes to sense the mid-infrared photothermal effect, we demonstrate 3D fluorescence-detected mid-infrared photothermal Fourier light field (FMIP-FLF) microscopy at the speed of 8 volumes per second and submicron spatial resolution. Protein contents in bacteria and lipid droplets in living pancreatic cancer cells are visualized. Altered lipid metabolism in drug-resistant pancreatic cancer cells is observed with the FMIP-FLF microscope.

Deep learning-enhanced fluorescence microscopy via confocal physical imaging model

Confocal microscopy is one of the most widely used tools for high-resolution cellular, tissue imaging and industrial inspection. Micrograph reconstruction based on deep learning has become an effective tool for modern microscopy imaging techniques. While most deep learning methods neglect the imaging process mechanism, which requires a lot of work to solve the multi-scale image pairs aliasing problem. We show that these limitations can be mitigated via an image degradation model based on Richards-Wolf vectorial diffraction integral and confocal imaging theory. The low-resolution images required for network training are generated by model degradation from their high-resolution counterparts, thereby eliminating the need for accurate image alignment. The image degradation model ensures the generalization and fidelity of the confocal images. By combining the residual neural network with a lightweight feature attention module with degradation model of confocal microscopy ensures high fidelity and generalization. Experiments on different measured data report that compared with the two deconvolution algorithms, non-negative least squares algorithm and Richardson-Lucy algorithm, the structural similarity index between the network output image and the real image reaches a high level above 0.82, and the peak signal-to-noise ratio can be improved by more than 0.6 dB. It also shows good applicability in different deep learning networks.

4D Light-sheet imaging and interactive analysis of cardiac contractility in zebrafish larvae

Despite ongoing efforts in cardiovascular research, the acquisition of high-resolution and high-speed images for the purpose of assessing cardiac contraction remains challenging. Light-sheet fluorescence microscopy (LSFM) offers superior spatiotemporal resolution and minimal photodamage, providing an indispensable opportunity for the in vivo study of cardiac micro-structure and contractile function in zebrafish larvae. To track the myocardial architecture and contractility, we have developed an imaging strategy ranging from LSFM system construction, retrospective synchronization, single cell tracking, to user-directed virtual reality (VR) analysis. Our system enables the four-dimensional (4D) investigation of individual cardiomyocytes across the entire atrium and ventricle during multiple cardiac cycles in a zebrafish larva at the cellular resolution. To enhance the throughput of our model reconstruction and assessment, we have developed a parallel computing-assisted algorithm for 4D synchronization, resulting in a nearly tenfold enhancement of reconstruction efficiency. The machine learning-based nuclei segmentation and VR-based interaction further allow us to quantify cellular dynamics in the myocardium from end-systole to end-diastole. Collectively, our strategy facilitates noninvasive cardiac imaging and user-directed data interpretation with improved efficiency and accuracy, holding great promise to characterize functional changes and regional mechanics at the single cell level during cardiac development and regeneration.

Practical guide for setting up a Fourier light-field microscope

A practical guide for the easy implementation of a Fourier light-field microscope is reported. The Fourier light-field concept applied to microscopy allows the capture in real time of a series of 2D orthographic images of microscopic thick dynamic samples. Such perspective images contain spatial and angular information of the light-field emitted by the sample. A feature of this technology is the tight requirement of a double optical conjugation relationship, and also the requirement of NA matching. For these reasons, the Fourier light-field microscope being a non-complex optical system, a clear protocol on how to set up the optical elements accurately is needed. In this sense, this guide is aimed to simplify the implementation process, with an optical bench and off-the-shelf components. This will help the widespread use of this recent technology.

Quantitative 4D imaging of biomechanical regulation of ventricular growth and maturation

Abnormal cardiac development is intimately associated with congenital heart disease. During development, a sponge-like network of muscle fibers in the endocardium, known as trabeculation, becomes compacted. Biomechanical forces regulate myocardial differentiation and proliferation to form trabeculation, while the molecular mechanism is still enigmatic. Biomechanical forces, including intracardiac hemodynamic flow and myocardial contractile force, activate a host of molecular signaling pathways to mediate cardiac morphogenesis. While mechanotransduction pathways to initiate ventricular trabeculation is well studied, deciphering the relative importance of hemodynamic shear vs. mechanical contractile forces to modulate the transition from trabeculation to compaction requires advanced imaging tools and genetically tractable animal models. For these reasons, the advent of 4-D multi-scale light-sheet imaging and complementary multiplex live imaging via micro-CT in the beating zebrafish heart and live chick embryos respectively. Thus, this review highlights the complementary animal models and advanced imaging needed to elucidate the mechanotransduction underlying cardiac ventricular development.

Single-frame deep-learning super-resolution microscopy for intracellular dynamics imaging

Single-molecule localization microscopy (SMLM) can be used to resolve subcellular structures and achieve a tenfold improvement in spatial resolution compared to that obtained by conventional fluorescence microscopy. However, the separation of single-molecule fluorescence events that requires thousands of frames dramatically increases the image acquisition time and phototoxicity, impeding the observation of instantaneous intracellular dynamics. Here we develop a deep-learning based single-frame super-resolution microscopy (SFSRM) method which utilizes a subpixel edge map and a multicomponent optimization strategy to guide the neural network to reconstruct a super-resolution image from a single frame of a diffraction-limited image. Under a tolerable signal density and an affordable signal-to-noise ratio, SFSRM enables high-fidelity live-cell imaging with spatiotemporal resolutions of 30 nm and 10 ms, allowing for prolonged monitoring of subcellular dynamics such as interplays between mitochondria and endoplasmic reticulum, the vesicle transport along microtubules, and the endosome fusion and fission. Moreover, its adaptability to different microscopes and spectra makes it a useful tool for various imaging systems.

Two-photon synthetic aperture microscopy for minimally invasive fast 3D imaging of native subcellular behaviors in deep tissue

Holistic understanding of physio-pathological processes requires noninvasive 3D imaging in deep tissue across multiple spatial and temporal scales to link diverse transient subcellular behaviors with long-term physiogenesis. Despite broad applications of two-photon microscopy (TPM), there remains an inevitable tradeoff among spatiotemporal resolution, imaging volumes, and durations due to the point-scanning scheme, accumulated phototoxicity, and optical aberrations. Here, we harnessed the concept of synthetic aperture radar in TPM to achieve aberration-corrected 3D imaging of subcellular dynamics at a millisecond scale for over 100,000 large volumes in deep tissue, with three orders of magnitude reduction in photobleaching. With its advantages, we identified direct intercellular communications through migrasome generation following traumatic brain injury, visualized the formation process of germinal center in the mouse lymph node, and characterized heterogeneous cellular states in the mouse visual cortex, opening up a horizon for intravital imaging to understand the organizations and functions of biological systems at a holistic level.

Virtual-scanning light-field microscopy for robust snapshot high-resolution volumetric imaging

High-speed three-dimensional (3D) intravital imaging in animals is useful for studying transient subcellular interactions and functions in health and disease. Light-field microscopy (LFM) provides a computational solution for snapshot 3D imaging with low phototoxicity but is restricted by low resolution and reconstruction artifacts induced by optical aberrations, motion and noise. Here, we propose virtual-scanning LFM (VsLFM), a physics-based deep learning framework to increase the resolution of LFM up to the diffraction limit within a snapshot. By constructing a 40 GB high-resolution scanning LFM dataset across different species, we exploit physical priors between phase-correlated angular views to address the frequency aliasing problem. This enables us to bypass hardware scanning and associated motion artifacts. Here, we show that VsLFM achieves ultrafast 3D imaging of diverse processes such as the beating heart in embryonic zebrafish, voltage activity in Drosophila brains and neutrophil migration in the mouse liver at up to 500 volumes per second.

Whole-brain imaging of freely-moving zebrafish

One of the holy grails of neuroscience is to record the activity of every neuron in the brain while an animal moves freely and performs complex behavioral tasks. While important steps forward have been taken recently in large-scale neural recording in rodent models, single neuron resolution across the entire mammalian brain remains elusive. In contrast the larval zebrafish offers great promise in this regard. Zebrafish are a vertebrate model with substantial homology to the mammalian brain, but their transparency allows whole-brain recordings of genetically-encoded fluorescent indicators at single-neuron resolution using optical microscopy techniques. Furthermore zebrafish begin to show a complex repertoire of natural behavior from an early age, including hunting small, fast-moving prey using visual cues. Until recently work to address the neural bases of these behaviors mostly relied on assays where the fish was immobilized under the microscope objective, and stimuli such as prey were presented virtually. However significant progress has recently been made in developing brain imaging techniques for zebrafish which are not immobilized. Here we discuss recent advances, focusing particularly on techniques based on light-field microscopy. We also draw attention to several important outstanding issues which remain to be addressed to increase the ecological validity of the results obtained.

Large-scale high-throughput 3D culture, imaging, and analysis of cell spheroids using microchip-enhanced light-sheet microscopy

Light sheet microscopy combined with a microchip is an emerging tool in biomedical research that notably improves efficiency. However, microchip-enhanced light-sheet microscopy is limited by noticeable aberrations induced by the complex refractive indices in the chip. Herein, we report a droplet microchip that is specifically engineered to be capable of large-scale culture of 3D spheroids (over 600 samples per chip) and has a polymer index matched to water (difference <1%). When combined with a lab-built open-top light-sheet microscope, this microchip-enhanced microscopy technique allows 3D time-lapse imaging of the cultivated spheroids with ∼2.5-µm single-cell resolution and a high throughput of ∼120 spheroids per minute. This technique was validated by a comparative study on the proliferation and apoptosis rates of hundreds of spheroids with or without treatment with the apoptosis-inducing drug Staurosporine.

A practical guide to deep-learning light-field microscopy for 3D imaging of biological dynamics

Here, we present a step-by-step protocol for the implementation of deep-learning-enhanced light-field microscopy enabling 3D imaging of instantaneous biological processes. We first provide the instructions to build a light-field microscope (LFM) capable of capturing optically encoded dynamic signals. Then, we detail the data processing and model training of a view-channel-depth (VCD) neural network, which enables instant 3D image reconstruction from a single 2D light-field snapshot. Finally, we describe VCD-LFM imaging of several model organisms and demonstrate image-based quantitative studies on neural activities and cardio-hemodynamics. For complete details on the use and execution of this protocol, please refer to Wang et al. (2021).1.

Compact, Hybrid Light-Sheet and Fourier Light-Field Microscopy with a Single Objective for High-Speed Volumetric Imaging In Vivo

Volumetric imaging of biodynamics at high spatiotemporal resolutions in vivo is vital in biomedical studies, in which Fourier light field microscopy (FLFM) is a promising technique. However, the commonly used wide-field illumination strategy in FLFM introduces intense out of depth-of-field background, which not only degrades the image quality, but also introduces reconstruction artifacts. Employing light sheet illumination is an effective way to alleviate the background and reduce photobleaching in light-field microscopy. Unfortunately, the introduction of light-sheet illumination often requires an extra objective and precise alignment, which increases the system complexity. Here, we propose the compact, hybrid light-sheet and FLFM (CLS-FLFM), which uses only a single objective to achieve both light-sheet illumination and Fourier light-field imaging simultaneously. With a micromirror under the objective, we focus the light sheet, which ensures selective-volume-illumination, on the imaging plane of the FLFM to perform volumetric imaging. We demonstrate the superior performance of CLS-FLFM in inhibiting background in both structural and dynamical imaging of larval zebrafish in vivo. We envision that CLS-FLFM finds wide applications in high-speed, background-inhibited volumetric imaging of biodynamics in vivo.

Optofluidic imaging meets deep learning: from merging to emerging

Propelled by the striking advances in optical microscopy and deep learning (DL), the role of imaging in lab-on-a-chip has dramatically been transformed from a silo inspection tool to a quantitative "smart" engine. A suite of advanced optical microscopes now enables imaging over a range of spatial scales (from molecules to organisms) and temporal window (from microseconds to hours). On the other hand, the staggering diversity of DL algorithms has revolutionized image processing and analysis at the scale and complexity that were once inconceivable. Recognizing these exciting but overwhelming developments, we provide a timely review of their latest trends in the context of lab-on-a-chip imaging, or coined optofluidic imaging. More importantly, here we discuss the strengths and caveats of how to adopt, reinvent, and integrate these imaging techniques and DL algorithms in order to tailor different lab-on-a-chip applications. In particular, we highlight three areas where the latest advances in lab-on-a-chip imaging and DL can form unique synergisms: image formation, image analytics and intelligent image-guided autonomous lab-on-a-chip. Despite the on-going challenges, we anticipate that they will represent the next frontiers in lab-on-a-chip imaging that will spearhead new capabilities in advancing analytical chemistry research, accelerating biological discovery, and empowering new intelligent clinical applications.

Real-time denoising enables high-sensitivity fluorescence time-lapse imaging beyond the shot-noise limit

A fundamental challenge in fluorescence microscopy is the photon shot noise arising from the inevitable stochasticity of photon detection. Noise increases measurement uncertainty and limits imaging resolution, speed and sensitivity. To achieve high-sensitivity fluorescence imaging beyond the shot-noise limit, we present DeepCAD-RT, a self-supervised deep learning method for real-time noise suppression. Based on our previous framework DeepCAD, we reduced the number of network parameters by 94%, memory consumption by 27-fold and processing time by a factor of 20, allowing real-time processing on a two-photon microscope. A high imaging signal-to-noise ratio can be acquired with tenfold fewer photons than in standard imaging approaches. We demonstrate the utility of DeepCAD-RT in a series of photon-limited experiments, including in vivo calcium imaging of mice, zebrafish larva and fruit flies, recording of three-dimensional (3D) migration of neutrophils after acute brain injury and imaging of 3D dynamics of cortical ATP release. DeepCAD-RT will facilitate the morphological and functional interrogation of biological dynamics with a minimal photon budget.

Volumetric imaging of fast cellular dynamics with deep learning enhanced bioluminescence microscopy

Bioluminescence microscopy is an appealing alternative to fluorescence microscopy, because it does not depend on external illumination, and consequently does neither produce spurious background autofluorescence, nor perturb intrinsically photosensitive processes in living cells and animals. The low photon emission of known luciferases, however, demands long exposure times that are prohibitive for imaging fast biological dynamics. To increase the versatility of bioluminescence microscopy, we present an improved low-light microscope in combination with deep learning methods to image extremely photon-starved samples enabling subsecond exposures for timelapse and volumetric imaging. We apply our method to image subcellular dynamics in mouse embryonic stem cells, epithelial morphology during zebrafish development, and DAF-16 FoxO transcription factor shuttling from the cytoplasm to the nucleus under external stress. Finally, we concatenate neural networks for denoising and light-field deconvolution to resolve intracellular calcium dynamics in three dimensions of freely moving Caenorhabditis elegans.