Classification of diffusion modes in single-particle tracking data: Feature-based versus deep-learning approach

Physics-informed deep learning for stochastic particle dynamics estimation

Single-particle tracking has enabled quantitative studies of complex systems, providing nanometer localization precision and millisecond temporal resolution in heterogeneous environments. However, at micro- or nanometer scales, probe dynamics become inherently stochastic due to Brownian motion and complex interactions, leading to varied diffusion behaviors. Typically, analysis of such trajectory data involves certain moving-window operation and assumes the existence of some pseudo-steady states, particularly when evaluating predefined parameters or specific types of diffusion modes. Here, we introduce the stochastic particle-informed neural network (SPINN), a physics-informed deep learning framework that integrates stochastic differential equations to model and infer particle diffusion dynamics. The SPINN autonomously explores parameter spaces and distinguishes between deterministic and stochastic components with single-frame resolution. Using the anomalous diffusion dataset, we validated SPINN's ability to reduce frame-to-frame variability while preserving key statistical correlations, allowing for accurate characterization of different stochastic processes. When applied to the diffusion of single gold nanorods in hydrogels, the SPINN revealed enhanced microrheological properties during hydrogel gelation and uncovered interfacial dynamics during dextran/tetra-PEG liquid-liquid phase separation. By improving the temporal resolution of stochastic dynamics, the SPINN facilitates the estimation and prediction of complex diffusion behaviors, offering insights into underlying physical mechanisms at mesoscopic scales.

Fractional Langevin equation far from equilibrium: Riemann-Liouville fractional Brownian motion, spurious nonergodicity, and aging

We consider the fractional Langevin equation far from equilibrium (FLEFE) to describe stochastic dynamics which do not obey the fluctuation-dissipation theorem, unlike the conventional fractional Langevin equation (FLE). The solution of this equation is Riemann-Liouville fractional Brownian motion (RL-FBM), also known in the literature as FBM II. Spurious nonergodicity, stationarity, and aging properties of the solution are explored for all admissible values α>1/2 of the order α of the time-fractional Caputo derivative in the FLEFE. The increments of the process are asymptotically stationary. However when 1/2<α<3/2, the time-averaged mean-squared displacement (TAMSD) does not converge to the mean-squared displacement (MSD). Instead, it converges to the mean-squared increment (MSI) or structure function, leading to the phenomenon of spurious nonergodicity. When α≥3/2, the increments of FLEFE motion are nonergodic, however the higher order increments are asymptotically ergodic. We also discuss the aging effect in the FLEFE by investigating the influence of an aging time t_{a} on the MSD, TAMSD and autocovariance function of the increments. We find that under strong aging conditions the process becomes ergodic, and the increments become stationary in the domain 1/2<α<3/2.

High-fidelity predictions of diffusion in the brain microenvironment

Multiple-particle tracking (MPT) is a microscopy technique capable of simultaneously tracking hundreds to thousands of nanoparticles in a biological sample and has been used extensively to characterize biological microenvironments, including the brain extracellular space (ECS). Machine learning techniques have been applied to MPT data sets to predict the diffusion mode of nanoparticle trajectories as well as more complex biological variables, such as biological age. In this study, we develop a machine learning pipeline to predict and investigate changes to the brain ECS due to injury using supervised classification and feature importance calculations. We first validate the pipeline on three related but distinct MPT data sets from the living brain ECS-age differences, region differences, and enzymatic degradation of ECS structure. We predict three ages with 86% accuracy, three regions with 90% accuracy, and healthy versus enzyme-treated tissue with 69% accuracy. Since injury across groups is normally compared with traditional statistical approaches, we first used linear mixed effects models to compare features between healthy control conditions and injury induced by two different oxygen glucose deprivation exposure times. We then used machine learning to predict injury state using MPT features. We show that the pipeline predicts between the healthy control, 0.5 h OGD treatment, and 1.5 h OGD treatment with 59% accuracy in the cortex and 66% in the striatum, and identifies nonlinear relationships between trajectory features that were not evident from traditional linear models. Our work demonstrates that machine learning applied to MPT data is effective across multiple experimental conditions and can find unique biologically relevant features of nanoparticle diffusion.

BNP-Track: a framework for superresolved tracking

Superresolution tools, such as PALM and STORM, provide nanoscale localization accuracy by relying on rare photophysical events, limiting these methods to static samples. By contrast, here, we extend superresolution to dynamics without relying on photodynamics by simultaneously determining emitter numbers and their tracks (localization and linking) with the same localization accuracy per frame as widefield superresolution on immobilized emitters under similar imaging conditions (≈50 nm). We demonstrate our Bayesian nonparametric track (BNP-Track) framework on both in cellulo and synthetic data. BNP-Track develops a joint (posterior) distribution that learns and quantifies uncertainty over emitter numbers and their associated tracks propagated from shot noise, camera artifacts, pixelation, background and out-of-focus motion. In doing so, we integrate spatiotemporal information into our distribution, which is otherwise compromised by modularly determining emitter numbers and localizing and linking emitter positions across frames. For this reason, BNP-Track remains accurate in crowding regimens beyond those accessible to other single-particle tracking tools.

Trajectory Analysis in Single-Particle Tracking: From Mean Squared Displacement to Machine Learning Approaches

Single-particle tracking is a powerful technique to investigate the motion of molecules or particles. Here, we review the methods for analyzing the reconstructed trajectories, a fundamental step for deciphering the underlying mechanisms driving the motion. First, we review the traditional analysis based on the mean squared displacement (MSD), highlighting the sometimes-neglected factors potentially affecting the accuracy of the results. We then report methods that exploit the distribution of parameters other than displacements, e.g., angles, velocities, and times and probabilities of reaching a target, discussing how they are more sensitive in characterizing heterogeneities and transient behaviors masked in the MSD analysis. Hidden Markov Models are also used for this purpose, and these allow for the identification of different states, their populations and the switching kinetics. Finally, we discuss a rapidly expanding field-trajectory analysis based on machine learning. Various approaches, from random forest to deep learning, are used to classify trajectory motions, which can be identified by motion models or by model-free sets of trajectory features, either previously defined or automatically identified by the algorithms. We also review free software available for some of the analysis methods. We emphasize that approaches based on a combination of the different methods, including classical statistics and machine learning, may be the way to obtain the most informative and accurate results.

Multifractal spectral features enhance classification of anomalous diffusion

Anomalous diffusion processes, characterized by their nonstandard scaling of the mean-squared displacement, pose a unique challenge in classification and characterization. In a previous study [Mangalam et al., Phys. Rev. Res. 5, 023144 (2023)2643-156410.1103/PhysRevResearch.5.023144], we established a comprehensive framework for understanding anomalous diffusion using multifractal formalism. The present study delves into the potential of multifractal spectral features for effectively distinguishing anomalous diffusion trajectories from five widely used models: fractional Brownian motion, scaled Brownian motion, continuous-time random walk, annealed transient time motion, and Lévy walk. We generate extensive datasets comprising 10^{6} trajectories from these five anomalous diffusion models and extract multiple multifractal spectra from each trajectory to accomplish this. Our investigation entails a thorough analysis of neural network performance, encompassing features derived from varying numbers of spectra. We also explore the integration of multifractal spectra into traditional feature datasets, enabling us to assess their impact comprehensively. To ensure a statistically meaningful comparison, we categorize features into concept groups and train neural networks using features from each designated group. Notably, several feature groups demonstrate similar levels of accuracy, with the highest performance observed in groups utilizing moving-window characteristics and p varation features. Multifractal spectral features, particularly those derived from three spectra involving different timescales and cutoffs, closely follow, highlighting their robust discriminatory potential. Remarkably, a neural network exclusively trained on features from a single multifractal spectrum exhibits commendable performance, surpassing other feature groups. In summary, our findings underscore the diverse and potent efficacy of multifractal spectral features in enhancing the predictive capacity of machine learning to classify anomalous diffusion processes.

Hidden Markov modeling of single-particle diffusion with stochastic tethering

The statistics of the diffusive motion of particles often serve as an experimental proxy for their interaction with the environment. However, inferring the physical properties from the observed trajectories is challenging. Inspired by a recent experiment, here we analyze the problem of particles undergoing two-dimensional Brownian motion with transient tethering to the surface. We model the problem as a hidden Markov model where the physical position is observed and the tethering state is hidden. We develop an alternating maximization algorithm to infer the hidden state of the particle and estimate the physical parameters of the system. The crux of our method is a saddle-point-like approximation, which involves finding the most likely sequence of hidden states and estimating the physical parameters from it. Extensive numerical tests demonstrate that our algorithm reliably finds the model parameters and is insensitive to the initial guess. We discuss the different regimes of physical parameters and the algorithm's performance in these regimes. We also provide a free software implementation of our algorithm.

Deep learning assisted single particle tracking for automated correlation between diffusion and function

Sub-cellular diffusion in living systems reflects cellular processes and interactions. Recent advances in optical microscopy allow the tracking of this nanoscale diffusion of individual objects with an unprecedented level of precision. However, the agnostic and automated extraction of functional information from the diffusion of molecules and organelles within the sub-cellular environment, is labor-intensive and poses a significant challenge. Here we introduce DeepSPT, a deep learning framework to interpret the diffusional 2D or 3D temporal behavior of objects in a rapid and efficient manner, agnostically. Demonstrating its versatility, we have applied DeepSPT to automated mapping of the early events of viral infections, identifying distinct types of endosomal organelles, and clathrin-coated pits and vesicles with up to 95% accuracy and within seconds instead of weeks. The fact that DeepSPT effectively extracts biological information from diffusion alone illustrates that besides structure, motion encodes function at the molecular and subcellular level.

Computational drug development for membrane protein targets

The application of computational biology in drug development for membrane protein targets has experienced a boost from recent developments in deep learning-driven structure prediction, increased speed and resolution of structure elucidation, machine learning structure-based design and the evaluation of big data. Recent protein structure predictions based on machine learning tools have delivered surprisingly reliable results for water-soluble and membrane proteins but have limitations for development of drugs that target membrane proteins. Structural transitions of membrane proteins have a central role during transmembrane signaling and are often influenced by therapeutic compounds. Resolving the structural and functional basis of dynamic transmembrane signaling networks, especially within the native membrane or cellular environment, remains a central challenge for drug development. Tackling this challenge will require an interplay between experimental and computational tools, such as super-resolution optical microscopy for quantification of the molecular interactions of cellular signaling networks and their modulation by potential drugs, cryo-electron microscopy for determination of the structural transitions of proteins in native cell membranes and entire cells, and computational tools for data analysis and prediction of the structure and function of cellular signaling networks, as well as generation of promising drug candidates.

Inferring pointwise diffusion properties of single trajectories with deep learning

To characterize the mechanisms governing the diffusion of particles in biological scenarios, it is essential to accurately determine their diffusive properties. To do so, we propose a machine-learning method to characterize diffusion processes with time-dependent properties at the experimental time resolution. Our approach operates at the single-trajectory level predicting the properties of interest, such as the diffusion coefficient or the anomalous diffusion exponent, at every time step of the trajectory. In this way, changes in the diffusive properties occurring along the trajectory emerge naturally in the prediction and thus allow the characterization without any prior knowledge or assumption about the system. We first benchmark the method on synthetic trajectories simulated under several conditions. We show that our approach can successfully characterize both abrupt and continuous changes in the diffusion coefficient or the anomalous diffusion exponent. Finally, we leverage the method to analyze experiments of single-molecule diffusion of two membrane proteins in living cells: the pathogen-recognition receptor DC-SIGN and the integrin α5β1. The analysis allows us to characterize physical parameters and diffusive states with unprecedented accuracy, shedding new light on the underlying mechanisms.

Extract latent features of single-particle trajectories with historical experience learning

Single-particle tracking has enabled real-time, in situ quantitative studies of complex systems. However, inferring dynamic state changes from noisy and undersampling trajectories encounters challenges. Here, we introduce a data-driven method for extracting features of subtrajectories with historical experience learning (Deep-SEES), where a single-particle tracking analysis pipeline based on a self-supervised architecture automatically searches for the latent space, allowing effective segmentation of the underlying states from noisy trajectories without prior knowledge on the particle dynamics. We validated our method on a variety of noisy simulated and experimental data. Our results showed that the method can faithfully capture both stable states and their dynamic switch. In highly random systems, our method outperformed commonly used unsupervised methods in inferring motion states, which is important for understanding nanoparticles interacting with living cell membranes, active enzymes, and liquid-liquid phase separation. Self-generating latent features of trajectories could potentially improve the understanding, estimation, and prediction of many complex systems.

Deep learning assisted single particle tracking for automated correlation between diffusion and function

Sub-cellular diffusion in living systems reflects cellular processes and interactions. Recent advances in optical microscopy allow the tracking of this nanoscale diffusion of individual objects with an unprecedented level of precision. However, the agnostic and automated extraction of functional information from the diffusion of molecules and organelles within the sub-cellular environment, is labor-intensive and poses a significant challenge. Here we introduce DeepSPT, a deep learning framework to interpret the diffusional 2D or 3D temporal behavior of objects in a rapid and efficient manner, agnostically. Demonstrating its versatility, we have applied DeepSPT to automated mapping of the early events of viral infections, identifying distinct types of endosomal organelles, and clathrin-coated pits and vesicles with up to 95% accuracy and within seconds instead of weeks. The fact that DeepSPT effectively extracts biological information from diffusion alone indicates that besides structure, motion encodes function at the molecular and subcellular level.

Machine-Learning Solutions for the Analysis of Single-Particle Diffusion Trajectories

Single-particle traces of the diffusive motion of molecules, cells, or animals are by now routinely measured, similar to stochastic records of stock prices or weather data. Deciphering the stochastic mechanism behind the recorded dynamics is vital in understanding the observed systems. Typically, the task is to decipher the exact type of diffusion and/or to determine the system parameters. The tools used in this endeavor are currently being revolutionized by modern machine-learning techniques. In this Perspective we provide an overview of recently introduced methods in machine-learning for diffusive time series, most notably, those successfully competing in the anomalous diffusion challenge. As such methods are often criticized for their lack of interpretability, we focus on means to include uncertainty estimates and feature-based approaches, both improving interpretability and providing concrete insight into the learning process of the machine. We expand the discussion by examining predictions on different out-of-distribution data. We also comment on expected future developments.

Single-molecule tracking to determine the abundances and stoichiometries of freely-diffusing protein complexes in living cells: Past applications and future prospects

Most biological processes in living cells rely on interactions between proteins. Live-cell compatible approaches that can quantify to what extent a given protein participates in homo- and hetero-oligomeric complexes of different size and subunit composition are therefore critical to advance our understanding of how cellular physiology is governed by these molecular interactions. Biomolecular complex formation changes the diffusion coefficient of constituent proteins, and these changes can be measured using fluorescence microscopy-based approaches, such as single-molecule tracking, fluorescence correlation spectroscopy, and fluorescence recovery after photobleaching. In this review, we focus on the use of single-molecule tracking to identify, resolve, and quantify the presence of freely-diffusing proteins and protein complexes in living cells. We compare and contrast different data analysis methods that are currently employed in the field and discuss experimental designs that can aid the interpretation of the obtained results. Comparisons of diffusion rates for different proteins and protein complexes in intracellular aqueous environments reported in the recent literature reveal a clear and systematic deviation from the Stokes-Einstein diffusion theory. While a complete and quantitative theoretical explanation of why such deviations manifest is missing, the available data suggest the possibility of weighing freely-diffusing proteins and protein complexes in living cells by measuring their diffusion coefficients. Mapping individual diffusive states to protein complexes of defined molecular weight, subunit stoichiometry, and structure promises to provide key new insights into how protein-protein interactions regulate protein conformational, translational, and rotational dynamics, and ultimately protein function.

Recent Advances in Single-Molecule Tracking and Imaging Techniques

Since the early 1990s, single-molecule detection in solution at room temperature has enabled direct observation of single biomolecules at work in real time and under physiological conditions, providing insights into complex biological systems that the traditional ensemble methods cannot offer. In particular, recent advances in single-molecule tracking techniques allow researchers to follow individual biomolecules in their native environments for a timescale of seconds to minutes, revealing not only the distinct pathways these biomolecules take for downstream signaling but also their roles in supporting life. In this review, we discuss various single-molecule tracking and imaging techniques developed to date, with an emphasis on advanced three-dimensional (3D) tracking systems that not only achieve ultrahigh spatiotemporal resolution but also provide sufficient working depths suitable for tracking single molecules in 3D tissue models. We then summarize the observables that can be extracted from the trajectory data. Methods to perform single-molecule clustering analysis and future directions are also discussed.

BNP-Track: A framework for superresolved tracking

Assessing dynamic processes at single molecule scales is key toward capturing life at the level of its molecular actors. Widefield superresolution methods, such as STORM, PALM, and PAINT, provide nanoscale localization accuracy, even when distances between fluorescently labeled single molecules ("emitters") fall below light's diffraction limit. However, as these superresolution methods rely on rare photophysical events to distinguish emitters from both each other and background, they are largely limited to static samples. In contrast, here we leverage spatiotemporal correlations of dynamic widefield imaging data to extend superresolution to simultaneous multiple emitter tracking without relying on photodynamics even as emitter distances from one another fall below the diffraction limit. We simultaneously determine emitter numbers and their tracks (localization and linking) with the same localization accuracy per frame as widefield superresolution does for immobilized emitters under similar imaging conditions (≈50nm). We demonstrate our results for both in cellulo data and, for benchmarking purposes, on synthetic data. To this end, we avoid the existing tracking paradigm relying on completely or partially separating the tasks of emitter number determination, localization of each emitter, and linking emitter positions across frames. Instead, we develop a fully joint posterior distribution over the quantities of interest, including emitter tracks and their total, otherwise unknown, number within the Bayesian nonparametric paradigm. Our posterior quantifies the full uncertainty over emitter numbers and their associated tracks propagated from origins including shot noise and camera artefacts, pixelation, stochastic background, and out-of-focus motion. Finally, it remains accurate in more crowded regimes where alternative tracking tools cannot be applied.

ExTrack characterizes transition kinetics and diffusion in noisy single-particle tracks

Single-particle tracking microscopy is a powerful technique to investigate how proteins dynamically interact with their environment in live cells. However, the analysis of tracks is confounded by noisy molecule localization, short tracks, and rapid transitions between different motion states, notably between immobile and diffusive states. Here, we propose a probabilistic method termed ExTrack that uses the full spatio-temporal information of tracks to extract global model parameters, to calculate state probabilities at every time point, to reveal distributions of state durations, and to refine the positions of bound molecules. ExTrack works for a wide range of diffusion coefficients and transition rates, even if experimental data deviate from model assumptions. We demonstrate its capacity by applying it to slowly diffusing and rapidly transitioning bacterial envelope proteins. ExTrack greatly increases the regime of computationally analyzable noisy single-particle tracks. The ExTrack package is available in ImageJ and Python.

ExTrack characterizes transition kinetics and diffusion in noisy single-particle tracks

Single-particle tracking microscopy is a powerful technique to investigate how proteins dynamically interact with their environment in live cells. However, the analysis of tracks is confounded by noisy molecule localization, short tracks, and rapid transitions between different motion states, notably between immobile and diffusive states. Here, we propose a probabilistic method termed ExTrack that uses the full spatio-temporal information of tracks to extract global model parameters, to calculate state probabilities at every time point, to reveal distributions of state durations, and to refine the positions of bound molecules. ExTrack works for a wide range of diffusion coefficients and transition rates, even if experimental data deviate from model assumptions. We demonstrate its capacity by applying it to slowly diffusing and rapidly transitioning bacterial envelope proteins. ExTrack greatly increases the regime of computationally analyzable noisy single-particle tracks. The ExTrack package is available in ImageJ and Python.

Machine-learning-powered extraction of molecular diffusivity from single-molecule images for super-resolution mapping

While critical to biological processes, molecular diffusion is difficult to quantify, and spatial mapping of local diffusivity is even more challenging. Here we report a machine-learning-enabled approach, pixels-to-diffusivity (Pix2D), to directly extract the diffusion coefficient D from single-molecule images, and consequently enable super-resolved D spatial mapping. Working with single-molecule images recorded at a fixed framerate under typical single-molecule localization microscopy (SMLM) conditions, Pix2D exploits the often undesired yet evident motion blur, i.e., the convolution of single-molecule motion trajectory during the frame recording time with the diffraction-limited point spread function (PSF) of the microscope. Whereas the stochastic nature of diffusion imprints diverse diffusion trajectories to different molecules diffusing at the same given D, we construct a convolutional neural network (CNN) model that takes a stack of single-molecule images as the input and evaluates a D-value as the output. We thus validate robust D evaluation and spatial mapping with simulated data, and with experimental data successfully characterize D differences for supported lipid bilayers of different compositions and resolve gel and fluidic phases at the nanoscale.

Gramian angular fields for leveraging pretrained computer vision models with anomalous diffusion trajectories

Anomalous diffusion is present at all scales, from atomic to large ones. Some exemplary systems are ultracold atoms, telomeres in the nucleus of cells, moisture transport in cement-based materials, arthropods' free movement, and birds' migration patterns. The characterization of the diffusion gives critical information about the dynamics of these systems and provides an interdisciplinary framework with which to study diffusive transport. Thus, the problem of identifying underlying diffusive regimes and inferring the anomalous diffusion exponent α with high confidence is critical to physics, chemistry, biology, and ecology. Classification and analysis of raw trajectories combining machine learning techniques with statistics extracted from them have widely been studied in the Anomalous Diffusion Challenge [Muñoz-Gil et al., Nat. Commun. 12, 6253 (2021)2041-172310.1038/s41467-021-26320-w]. Here we present a new data-driven method for working with diffusive trajectories. This method utilizes Gramian angular fields (GAF) to encode one-dimensional trajectories as images (Gramian matrices), while preserving their spatiotemporal structure for input to computer-vision models. This allows us to leverage two well-established pretrained computer-vision models, ResNet and MobileNet, to characterize the underlying diffusive regime and infer the anomalous diffusion exponent α. Short raw trajectories of lengths between 10 and 50 are commonly encountered in single-particle tracking experiments and are the most difficult ones to characterize. We show that GAF images can outperform the current state-of-the-art while increasing accessibility to machine learning methods in an applied setting.

Extracting, quantifying, and comparing dynamical and biomechanical properties of living matter through single particle tracking

A panoply of new tools for tracking single particles and molecules has led to an explosion of experimental data, leading to novel insights into physical properties of living matter governing cellular development and function, health and disease. In this Perspective, we present tools to investigate the dynamics and mechanics of living systems from the molecular to cellular scale via single-particle techniques. In particular, we focus on methods to measure, interpret, and analyse complex data sets that are associated with forces, materials properties, transport, and emergent organisation phenomena within biological and soft-matter systems. Current approaches, challenges, and existing solutions in the associated fields are outlined in order to support the growing community of researchers at the interface of physics and the life sciences. Each section focuses not only on the general physical principles and the potential for understanding living matter, but also on details of practical data extraction and analysis, discussing limitations, interpretation, and comparison across different experimental realisations and theoretical frameworks. Particularly relevant results are introduced as examples. While this Perspective describes living matter from a physical perspective, highlighting experimental and theoretical physics techniques relevant for such systems, it is also meant to serve as a solid starting point for researchers in the life sciences interested in the implementation of biophysical methods.

Multifractional Brownian motion characterization based on Hurst exponent estimation and statistical learning

This paper proposes an approach for the estimation of a time-varying Hurst exponent to allow accurate identification of multifractional Brownian motion (MFBM). The contribution provides a prescription for how to deal with the MFBM measurement data to solve regression and classification problems. Theoretical studies are supplemented with computer simulations and real-world examples. Those prove that the procedure proposed in this paper outperforms the best-in-class algorithm.

Classification-based motion analysis of single-molecule trajectories using DiffusionLab

Single-particle tracking is a powerful approach to study the motion of individual molecules and particles. It can uncover heterogeneities that are invisible to ensemble techniques, which places it uniquely among techniques to study mass transport. Analysis of the trajectories obtained with single-particle tracking in inorganic porous hosts is often challenging, because trajectories are short and/or motion is heterogeneous. We present the DiffusionLab software package for motion analysis of such challenging data sets. Trajectories are first classified into populations with similar characteristics to which the motion analysis is tailored in a second step. DiffusionLab provides tools to classify trajectories based on the motion type either with machine learning or manually. It also offers quantitative mean squared displacement analysis of the trajectories. The software can compute the diffusion constant for an individual trajectory if it is sufficiently long, or the average diffusion constant for multiple shorter trajectories. We demonstrate the DiffusionLab approach via the analysis of a simulated data set with motion types frequently observed in inorganic porous hosts, such as zeolites. The software package with graphical user interface and its documentation are freely available.

Probing Diffusive Dynamics of Natural Tubule Nanoclays with Machine Learning

Reproducibility of the experimental results and object of study itself is one of the basic principles in science. But what if the object characterized by technologically important properties is natural and cannot be artificially reproduced one-to-one in the laboratory? The situation becomes even more complicated when we are interested in exploring stochastic properties of a natural system and only a limited set of noisy experimental data is available. In this paper we address these problems by exploring diffusive motion of some natural clays, halloysite and sepiolite, in a liquid environment. By using a combination of dark-field microscopy and machine learning algorithms, a quantitative theoretical characterization of the nanotubes' rotational diffusive dynamics is performed. Scanning the experimental video with the gradient boosting tree method, we can trace time dependence of the diffusion coefficient and probe different regimes of nonequilibrium rotational dynamics that are due to contacts with surfaces and other experimental imperfections. The method we propose is of general nature and can be applied to explore diffusive dynamics of various biological systems in real time.

Biophysical Models of PAR Cluster Transport by Cortical Flow in C. elegans Early Embryogenesis

The clustering of membrane-bound proteins facilitates their transport by cortical actin flow in early Caenorhabditis elegans embryo cell polarity. PAR-3 clustering is critical for this process, yet the biophysical processes that couple protein clusters to cortical flow remain unknown. We develop a discrete, stochastic agent-based model of protein clustering and test four hypothetical models for how clusters may interact with the flow. Results show that the canonical way to assess transport characteristics from single-particle tracking data used thus far in this area, the Péclet number, is insufficient to distinguish these hypotheses and that all models can account for transport characteristics quantified by this measure. However, using this model, we demonstrate that these different cluster-cortex interactions may be distinguished using a different metric, namely the scalar projection of cluster displacement on to the flow displacement vector. Our results thus provide a testable way to use existing single-particle tracking data to test how endogenous protein clusters may interact with the cortical flow to localize during polarity establishment. To facilitate this investigation, we also develop both improved simulation and semi-analytic methodologies to quantify motion summary statistics (e.g., Péclet number and scalar projection) for these stochastic models as a function of biophysical parameters.

Objective comparison of methods to decode anomalous diffusion

Deviations from Brownian motion leading to anomalous diffusion are found in transport dynamics from quantum physics to life sciences. The characterization of anomalous diffusion from the measurement of an individual trajectory is a challenging task, which traditionally relies on calculating the trajectory mean squared displacement. However, this approach breaks down for cases of practical interest, e.g., short or noisy trajectories, heterogeneous behaviour, or non-ergodic processes. Recently, several new approaches have been proposed, mostly building on the ongoing machine-learning revolution. To perform an objective comparison of methods, we gathered the community and organized an open competition, the Anomalous Diffusion challenge (AnDi). Participating teams applied their algorithms to a commonly-defined dataset including diverse conditions. Although no single method performed best across all scenarios, machine-learning-based approaches achieved superior performance for all tasks. The discussion of the challenge results provides practical advice for users and a benchmark for developers.

Single-molecule tracking technologies for quantifying the dynamics of gene regulation in cells, tissue and embryos

For decades, we have relied on population and time-averaged snapshots of dynamic molecular scale events to understand how genes are regulated during development and beyond. The advent of techniques to observe single-molecule kinetics in increasingly endogenous contexts, progressing from in vitro studies to living embryos, has revealed how much we have missed. Here, we provide an accessible overview of the rapidly expanding family of technologies for single-molecule tracking (SMT), with the goal of enabling the reader to critically analyse single-molecule studies, as well as to inspire the application of SMT to their own work. We start by overviewing the basics of and motivation for SMT experiments, and the trade-offs involved when optimizing parameters. We then cover key technologies, including fluorescent labelling, excitation and detection optics, localization and tracking algorithms, and data analysis. Finally, we provide a summary of selected recent applications of SMT to study the dynamics of gene regulation.

Pore Forming Protein Induced Biomembrane Reorganization and Dynamics: A Focused Review

Pore forming proteins are a broad class of pathogenic proteins secreted by organisms as virulence factors due to their ability to form pores on the target cell membrane. Bacterial pore forming toxins (PFTs) belong to a subclass of pore forming proteins widely implicated in bacterial infections. Although the action of PFTs on target cells have been widely investigated, the underlying membrane response of lipids during membrane binding and pore formation has received less attention. With the advent of superresolution microscopy as well as the ability to carry out molecular dynamics (MD) simulations of the large protein membrane assemblies, novel microscopic insights on the pore forming mechanism have emerged over the last decade. In this review, we focus primarily on results collated in our laboratory which probe dynamic lipid reorganization induced in the plasma membrane during various stages of pore formation by two archetypal bacterial PFTs, cytolysin A (ClyA), an α-toxin and listeriolysin O (LLO), a β-toxin. The extent of lipid perturbation is dependent on both the secondary structure of the membrane inserted motifs of pore complex as well as the topological variations of the pore complex. Using confocal and superresolution stimulated emission depletion (STED) fluorescence correlation spectroscopy (FCS) and MD simulations, lipid diffusion, cholesterol reorganization and deviations from Brownian diffusion are correlated with the oligomeric state of the membrane bound protein as well as the underlying membrane composition. Deviations from free diffusion are typically observed at length scales below ∼130 nm to reveal the presence of local dynamical heterogeneities that emerge at the nanoscale-driven in part by preferential protein binding to cholesterol and domains present in the lipid membrane. Interrogating the lipid dynamics at the nanoscale allows us further differentiate between binding and pore formation of β- and α-PFTs to specific domains in the membrane. The molecular insights gained from the intricate coupling that occurs between proteins and membrane lipids and receptors during pore formation are expected to improve our understanding of the virulent action of PFTs.

Single-particle diffusional fingerprinting: A machine-learning framework for quantitative analysis of heterogeneous diffusion

Single-particle tracking (SPT) analysis of individual biomolecules is an indispensable tool for extracting quantitative information from dynamic biological processes, but often requires some a priori knowledge of the system. Here we present “single-particle diffusional fingerprinting,” a more general approach for extraction of diffusional patterns in SPT independently of the biological system. This method extracts a set of descriptive features for each SPT trajectory, which are ranked upon classification to yield mechanistic insights for the species under comparison. We demonstrate its capacity to yield a dictionary of diffusional traits across multiple systems (e.g., lipases hydrolyzing fat, transcription factors diffusing in cells, and nanoparticles in mucus), supporting its use on multiple biological phenomena (e.g., drug delivery, receptor dynamics, and virology).

Single-particle tracking (SPT) is a key tool for quantitative analysis of dynamic biological processes and has provided unprecedented insights into a wide range of systems such as receptor localization, enzyme propulsion, bacteria motility, and drug nanocarrier delivery. The inherently complex diffusion in such biological systems can vary drastically both in time and across systems, consequently imposing considerable analytical challenges, and currently requires an a priori knowledge of the system. Here we introduce a method for SPT data analysis, processing, and classification, which we term “diffusional fingerprinting.” This method allows for dissecting the features that underlie diffusional behavior and establishing molecular identity, regardless of the underlying diffusion type. The method operates by isolating 17 descriptive features for each observed motion trajectory and generating a diffusional map of all features for each type of particle. Precise classification of the diffusing particle identity is then obtained by training a simple logistic regression model. A linear discriminant analysis generates a feature ranking that outputs the main differences among diffusional features, providing key mechanistic insights. Fingerprinting operates by both training on and predicting experimental data, without the need for pretraining on simulated data. We found this approach to work across a wide range of simulated and experimentally diverse systems, such as tracked lipases on fat substrates, transcription factors diffusing in cells, and nanoparticles diffusing in mucus. This flexibility ultimately supports diffusional fingerprinting’s utility as a universal paradigm for SPT diffusional analysis and prediction.

Classification of particle trajectories in living cells: Machine learning versus statistical testing hypothesis for fractional anomalous diffusion

Single-particle tracking (SPT) has become a popular tool to study the intracellular transport of molecules in living cells. Inferring the character of their dynamics is important, because it determines the organization and functions of the cells. For this reason, one of the first steps in the analysis of SPT data is the identification of the diffusion type of the observed particles. The most popular method to identify the class of a trajectory is based on the mean-square displacement (MSD). However, due to its known limitations, several other approaches have been already proposed. With the recent advances in algorithms and the developments of modern hardware, the classification attempts rooted in machine learning (ML) are of particular interest. In this work, we adopt two ML ensemble algorithms, i.e., random forest and gradient boosting, to the problem of trajectory classification. We present a new set of features used to transform the raw trajectories data into input vectors required by the classifiers. The resulting models are then applied to real data for G protein-coupled receptors and G proteins. The classification results are compared to recent statistical methods going beyond MSD.

Time-averaged mean squared displacement ratio test for Gaussian processes with unknown diffusion coefficient

The time-averaged mean squared displacement (TAMSD) is one of the most common statistics used for the analysis of anomalous diffusion processes. Anomalous diffusion is manifested by non-linear (mostly power-law) characteristics of the process in contrast to normal diffusion where linear characteristics are expected. One can distinguish between sub- and super-diffusive processes. We consider Gaussian anomalous diffusion models and propose a new approach used for their testing. This approach is based on the TAMSD ratio statistic for different time lags. Similar to the TAMSD, this statistic exhibits a specific behavior in the anomalous diffusion regime. Through its structure, it is independent of the diffusion coefficient, which, in general, does not influence anomalous diffusion behavior. Thus, the TAMSD ratio-based approach does not require preliminary knowledge of the diffusion coefficient's value, in contrast to the TAMSD-approach, where this value is crucial in the testing procedure. Based on the quadratic form representation of the TAMSD ratio, we calculate its main characteristics and propose a step-by-step testing procedure that can be applied for any Gaussian process. For the anomalous diffusion model used here, namely, the fractional Brownian motion, we demonstrate the effectiveness of the proposed methodology. We show that the new approach outperforms the TAMSD-based one, especially for small sample sizes. Finally, the methodology is applied to the real data from the financial market.

Detection of Anomalous Diffusion with Deep Residual Networks

Identification of the diffusion type of molecules in living cells is crucial to deduct their driving forces and hence to get insight into the characteristics of the cells. In this paper, deep residual networks have been used to classify the trajectories of molecules. We started from the well known ResNet architecture, developed for image classification, and carried out a series of numerical experiments to adapt it to detection of diffusion modes. We managed to find a model that has a better accuracy than the initial network, but contains only a small fraction of its parameters. The reduced size significantly shortened the training time of the model. Moreover, the resulting network has less tendency to overfitting and generalizes better to unseen data.

Measurements and characterization of the dynamics of tracer particles in an actin network

The underlying physics governing the diffusion of a tracer particle in a viscoelastic material is a topic of some dispute. The long-term memory in the mechanical response of such materials should induce diffusive motion with a memory kernel, such as fractional Brownian motion (fBM). This is the reason that microrheology is able to provide the shear modulus of polymer networks. Surprisingly, the diffusion of a tracer particle in a network of a purified protein, actin, was found to conform to the continuous time random walk type (CTRW). We set out to resolve this discrepancy by studying the tracer particle diffusion using two different tracer particle sizes, in actin networks of different mesh sizes. We find that the ratio of tracer particle size to the characteristic length scale of a bio-polymer network plays a crucial role in determining the type of diffusion it performs. We find that the diffusion of the tracer particles has features of fBm when the particle is large compared to the mesh size, of normal diffusion when the particle is much smaller than the mesh size, and of the CTRW in between these two limits. Based on our findings, we propose and verify numerically a new model for the motion of the tracer in all regimes. Our model suggests that diffusion in actin networks consists of fBm of the tracer particle coupled with caging events with power-law distributed escape times.

Time-dependent classification of protein diffusion types: A statistical detection of mean-squared-displacement exponent transitions

In this paper, we have proposed a statistical procedure for detecting transitions of the mean-square-displacement exponent value within a single trajectory. With this procedure, we have identified three regimes of proteins dynamics on a cell membrane, namely, subdiffusion, free diffusion, and immobility. The fourth considered dynamics type, namely, superdiffusion was not detected. We show that the analyzed protein trajectories are not stationary and not ergodic. Moreover, classification of the dynamics type performed without prior detection of transitions may lead to the overestimation of the proportion of subdiffusive trajectories.

Single-Nanoparticle Orientation Sensing by Deep Learning

This paper describes a computational imaging platform to determine the orientation of anisotropic optical probes under differential interference contrast (DIC) microscopy. We established a deep-learning model based on data sets of DIC images collected from metal nanoparticle optical probes at different orientations. This model predicted the in-plane angle of gold nanorods with an error below 20°, the inherent limit of the DIC method. Using low-symmetry gold nanostars as optical probes, we demonstrated the detection of in-plane particle orientation in the full 0-360° range. We also showed that orientation predictions of the same particle were consistent even with variations in the imaging background. Finally, the deep-learning model was extended to enable simultaneous prediction of in-plane and out-of-plane rotation angles for a multibranched nanostar by concurrent analysis of DIC images measured at multiple wavelengths.

Impact of Feature Choice on Machine Learning Classification of Fractional Anomalous Diffusion

The growing interest in machine learning methods has raised the need for a careful study of their application to the experimental single-particle tracking data. In this paper, we present the differences in the classification of the fractional anomalous diffusion trajectories that arise from the selection of the features used in random forest and gradient boosting algorithms. Comparing two recently used sets of human-engineered attributes with a new one, which was tailor-made for the problem, we show the importance of a thoughtful choice of the features and parameters. We also analyse the influence of alterations of synthetic training data set on the classification results. The trained classifiers are tested on real trajectories of G proteins and their receptors on a plasma membrane.

Fractional Dynamics Identification via Intelligent Unpacking of the Sample Autocovariance Function by Neural Networks

Many single-particle tracking data related to the motion in crowded environments exhibit anomalous diffusion behavior. This phenomenon can be described by different theoretical models. In this paper, fractional Brownian motion (FBM) was examined as the exemplary Gaussian process with fractional dynamics. The autocovariance function (ACVF) is a function that determines completely the Gaussian process. In the case of experimental data with anomalous dynamics, the main problem is first to recognize the type of anomaly and then to reconstruct properly the physical rules governing such a phenomenon. The challenge is to identify the process from short trajectory inputs. Various approaches to address this problem can be found in the literature, e.g., theoretical properties of the sample ACVF for a given process. This method is effective; however, it does not utilize all of the information contained in the sample ACVF for a given trajectory, i.e., only values of statistics for selected lags are used for identification. An evolution of this approach is proposed in this paper, where the process is determined based on the knowledge extracted from the ACVF. The designed method is intuitive and it uses information directly available in a new fashion. Moreover, the knowledge retrieval from the sample ACVF vector is enhanced with a learning-based scheme operating on the most informative subset of available lags, which is proven to be an effective encoder of the properties inherited in complex data. Finally, the robustness of the proposed algorithm for FBM is demonstrated with the use of Monte Carlo simulations.

Recent advances in point spread function engineering and related computational microscopy approaches: from one viewpoint

This personal hybrid review piece, written in light of my recipience of the UIPAB 2020 young investigator award, contains a mixture of my scientific biography and work so far. This paper is not intended to be a comprehensive review, but only to highlight my contributions to computation-related aspects of super-resolution microscopy, as well as their origins and future directions.

Look at Tempered Subdiffusion in a Conjugate Map: Desire for the Confinement

The Laplace distribution of random processes was observed in numerous situations that include glasses, colloidal suspensions, live cells, and firm growth. Its origin is not so trivial as in the case of Gaussian distribution, supported by the central limit theorem. Sums of Laplace distributed random variables are not Laplace distributed. We discovered a new mechanism leading to the Laplace distribution of observable values. This mechanism changes the contribution ratio between a jump and a continuous parts of random processes. Our concept uses properties of Bernstein functions and subordinators connected with them.

Gaining insight into cellular cardiac physiology using single particle tracking

Single particle tracking (SPT) is a robust technique to monitor single-molecule behaviors in living cells directly. By this approach, we can uncover the potential biological significance of particle dynamics by statistically characterizing individual molecular behaviors. SPT provides valuable information at the single-molecule level, that could be obscured by simple averaging that is inherent to conventional ensemble measurements. Here, we give a brief introduction to SPT including the commonly used optical implementations, fluorescence labeling strategies, and data analysis methods. We then focus on how SPT has been harnessed to decipher myocardial function. In this context, SPT has provided novel insight into the lateral diffusion of signal receptors and ion channels, the dynamic organization of cardiac nanodomains, subunit composition and stoichiometry of cardiac ion channels, myosin movement along actin filaments, the kinetic features of transcription factors involved in cardiac remodeling, and the intercellular communication by nanotubes. Finally, we speculate on the prospects and challenges of applying SPT to future questions regarding cellular cardiac physiology using SPT.

Fluorescence strategies for mapping cell membrane dynamics and structures

Fluorescence spectroscopy has been a cornerstone of research in membrane dynamics and organization. Technological advances in fluorescence spectroscopy went hand in hand with discovery of various physicochemical properties of membranes at nanometric spatial and microsecond timescales. In this perspective, we discuss the various challenges associated with quantification of physicochemical properties of membranes and how various modes of fluorescence spectroscopy have overcome these challenges to shed light on the structure and organization of membranes. Finally, we discuss newer measurement strategies and data analysis tools to investigate the structure, dynamics, and organization of membranes.

Deep learning in single-molecule microscopy: fundamentals, caveats, and recent developments [Invited]

Deep learning-based data analysis methods have gained considerable attention in all fields of science over the last decade. In recent years, this trend has reached the single-molecule community. In this review, we will survey significant contributions of the application of deep learning in single-molecule imaging experiments. Additionally, we will describe the historical events that led to the development of modern deep learning methods, summarize the fundamental concepts of deep learning, and highlight the importance of proper data composition for accurate, unbiased results.