Clausius Relation for Active Particles: What Can We Learn from Fluctuations

Deep learning probability flows and entropy production rates in active matter

Active matter systems, from self-propelled colloids to motile bacteria, are characterized by the conversion of free energy into useful work at the microscopic scale. They involve physics beyond the reach of equilibrium statistical mechanics, and a persistent challenge has been to understand the nature of their nonequilibrium states. The entropy production rate and the probability current provide quantitative ways to do so by measuring the breakdown of time-reversal symmetry. Yet, their efficient computation has remained elusive, as they depend on the system's unknown and high-dimensional probability density. Here, building upon recent advances in generative modeling, we develop a deep learning framework to estimate the score of this density. We show that the score, together with the microscopic equations of motion, gives access to the entropy production rate, the probability current, and their decomposition into local contributions from individual particles. To represent the score, we introduce a spatially local transformer network architecture that learns high-order interactions between particles while respecting their underlying permutation symmetry. We demonstrate the broad utility and scalability of the method by applying it to several high-dimensional systems of active particles undergoing motility-induced phase separation (MIPS). We show that a single network trained on a system of 4,096 particles at one packing fraction can generalize to other regions of the phase diagram, including to systems with as many as 32,768 particles. We use this observation to quantify the spatial structure of the departure from equilibrium in MIPS as a function of the number of particles and the packing fraction.

Entropy production and collective excitations of crystals out of equilibrium: The concept of entropons

We study the collective vibrational excitations of crystals under out-of-equilibrium steady conditions that give rise to entropy production. Their excitation spectrum comprises equilibriumlike phonons of thermal origin and additional collective excitations called entropons because each of them represents a mode of spectral entropy production. Entropons coexist with phonons and dominate them when the system is far from equilibrium while they are negligible in near-equilibrium regimes. The concept of entropons has been recently introduced and verified in a special case of crystals formed by self-propelled particles. Here we show that entropons exist in a broader class of active crystals that are intrinsically out of equilibrium and characterized by the lack of detailed balance. After a general derivation, several explicit examples are discussed, including crystals consisting of particles with alignment interactions and frictional contact forces.

Effects of the self-propulsion parity on the efficiency of a fuel-consuming active heat engine

We propose a thermodynamically consistent, analytically tractable model of steady-state active heat engines driven by both temperature difference and a constant chemical driving. While the engine follows the dynamics of the active Ornstein-Uhlenbeck particle, its self-propulsion stems from the mechanochemical coupling with the fuel consumption dynamics, allowing for both even- and odd-parity self-propulsion forces. Using the standard methods of stochastic thermodynamics, we show that the entropy production of the engine satisfies the conventional Clausius relation, based on which we define the efficiency of the model that is bounded from above by the second law of thermodynamics. Using this framework, we obtain exact expressions for the efficiency at maximum power. The results show that the engine performance has a nonmonotonic dependence on the magnitude of the chemical driving and that the even-parity (odd-parity) engines perform better when the size of the engine is smaller (larger) than the persistence length of the active particle. We also discuss the existence of a tighter upper bound on the efficiency of the odd-parity engines stemming from the detailed structure of the entropy production.

Entropy production of active particles formulated for underdamped dynamics

The present work investigates the effect of inertia on the entropy production rate Π for all canonical models of active particles for different dimensions and the type of confinement. To calculate Π, the link between the entropy production and dissipation of heat rate is explored, resulting in a simple and intuitive expression. By analyzing the Kramers equation, alternative formulations of Π are obtained and the virial theorem for active particles is derived. Exact results are obtained for particles in an unconfined environment and in a harmonic trap. In both cases, Π is independent of temperature. For the case of a harmonic trap, Π attains a maximal value for τ=ω^{-1}, where τ is the persistence time and ω is the natural frequency of an oscillator. For active particles in one-dimensional box, or other nonharmonic potentials, thermal fluctuations are found to reduce Π.

Premelting controlled active matter in ice

Self-propelled particles can undergo complex dynamics due to a range of bulk and surface interactions. When a particle is embedded in a host solid near its bulk melting temperature, the latter may melt at the surface of the former in a process known as interfacial premelting. The thickness of the melt film depends on the temperature, impurities, material properties and geometry. A temperature gradient is accompanied by a thermomolecular pressure gradient that drives the interfacial liquid from high to low temperatures and hence the particle from low to high temperatures, in a process called thermal regelation. When the host material is ice and the embedded particle is a biological entity, one has a particularly different form of active matter, which addresses interplay between a wide range of problems, from extremophiles of both terrestrial and exobiological relevance to ecological dynamics in Earth's cryosphere. Of basic importance in all such settings is the combined influence of biological activity and thermal regelation in controlling the redistribution of bioparticles. Therefore, we recast this class of regelation phenomena in the stochastic framework of active Ornstein-Uhlenbeck dynamics and make predictions relevant to this and related problems of interest in biological and geophysical problems. We examine how thermal regelation compromises paleoclimate studies in the context of ice core dating and we find that the activity influences particle dynamics during thermal regelation by enhancing the effective diffusion coefficient. Therefore, accurate dating relies on a quantitative treatment of both effects.

Active Ornstein-Uhlenbeck model for self-propelled particles with inertia

Self-propelled particles, which convert energy into mechanical motion, exhibit inertia if they have a macroscopic size or move inside a gaseous medium, in contrast to micron-sized overdamped particles immersed in a viscous fluid. Here we study an extension of the active Ornstein-Uhlenbeck model, in which self-propulsion is described by colored noise, to access these inertial effects. We summarize and discuss analytical solutions of the particle's mean-squared displacement and velocity autocorrelation function for several settings ranging from a free particle to various external influences, like a linear or harmonic potential and coupling to another particle via a harmonic spring. Taking into account the particular role of the initial particle velocity in a nonstationary setup, we observe all dynamical exponents between zero and four. After the typical inertial time, determined by the particle's mass, the results inherently revert to the behavior of an overdamped particle with the exception of the harmonically confined systems, in which the overall displacement is enhanced by inertia. We further consider an underdamped model for an active particle with a time-dependent mass, which critically affects the displacement in the intermediate time-regime. Most strikingly, for a sufficiently large rate of mass accumulation, the particle's motion is completely governed by inertial effects as it remains superdiffusive for all times.

Optimization of an active heat engine

Optimization of heat engines at the microscale has applications in biological and artificial nanotechnology and stimulates theoretical research in nonequilibrium statistical physics. Here we consider noninteracting overdamped particles confined by an external harmonic potential, in contact with either a thermal reservoir or a stochastic self-propulsion force (active Ornstein-Uhlenbeck model). A cyclical machine is produced by periodic variation of the parameters of the potential and of the noise. An exact mapping between the passive and the active model allows us to define the effective temperature T_{eff}(t), which is meaningful for the thermodynamic performance of the engine. We show that T_{eff}(t) is different from all other known active temperatures, typically used in static situations. The mapping allows us to optimize the active engine, regardless of the values of the persistence time or self-propulsion velocity. In particular, through linear irreversible thermodynamics (small amplitude of the cycle), we give an explicit formula for the optimal cycle period and phase delay (between the two modulated parameters, stiffness and temperature) achieving maximum power with Curzon-Ahlborn efficiency. In the quasistatic limit, the formula for T_{eff}(t) simplifies and coincides with a recently proposed temperature for stochastic thermodynamics, bearing a compact expression for the maximum efficiency. A point, which has been overlooked in recent literature, is made about the difficulty in defining efficiency without a consistent definition of effective temperature.

Collective motion in large deviations of active particles

We analyze collective motion that occurs during rare (large deviation) events in systems of active particles, both numerically and analytically. We discuss the associated dynamical phase transition to collective motion, which occurs when the active work is biased towards larger values, and is associated with alignment of particles' orientations. A finite biasing field is needed to induce spontaneous symmetry breaking, even in large systems. Particle alignment is computed exactly for a system of two particles. For many-particle systems, we analyze the symmetry breaking by an optimal-control representation of the biased dynamics, and we propose a fluctuating hydrodynamic theory that captures the emergence of polar order in the biased state.

Fluctuation–Dissipation Relations in Active Matter Systems

We investigate the non-equilibrium character of self-propelled particles through the study of the linear response of the active Ornstein–Uhlenbeck particle (AOUP) model. We express the linear response in terms of correlations computed in the absence of perturbations, proposing a particularly compact and readable fluctuation–dissipation relation (FDR): such an expression explicitly separates equilibrium and non-equilibrium contributions due to self-propulsion. As a case study, we consider non-interacting AOUP confined in single-well and double-well potentials. In the former case, we also unveil the effect of dimensionality, studying one-, two-, and three-dimensional dynamics. We show that information about the distance from equilibrium can be deduced from the FDR, putting in evidence the roles of position and velocity variables in the non-equilibrium relaxation.

Active noise experienced by a passive particle trapped in an active bath

We study the properties of active noise experienced by a passive particle harmonically trapped in an active bath. The active bath is either explicitly simulated by an ensemble of active Brownian particles or abstractly represented by an active colored noise in theory. Assuming the equivalence of the two descriptions of the active bath, the active noise in the simulation system, which is directly extracted by fitting theoretical predictions to simulation measurements, is shown to depend on the constraint suffered by the passive tracer. This scenario is in significant contrast to the case of thermal noise that is independent of external trap potentials. The constraint dependence of active noise arises from the fact that the persistent force on the passive particle from the active bath can be influenced by the particle relaxation dynamics. Moreover, due to the interplay between the active collisions and particle relaxation dynamics, the effective temperature of the passive tracer quantified as the ratio of fluctuation to dissipation increases as the constraint strengthens, while the average potential and kinetic energies of the passive particle both decrease.

Collective forces in scalar active matter

Large-scale collective behavior in suspensions of active particles can be understood from the balance of statistical forces emerging beyond the direct microscopic particle interactions. Here we review some aspects of the collective forces that can arise in suspensions of self-propelled active Brownian particles: wall forces under confinement, interfacial forces, and forces on immersed bodies mediated by the suspension. Even for non-aligning active particles, these forces are intimately related to a non-uniform polarization of particle orientations induced by walls and bodies, or inhomogeneous density profiles. We conclude by pointing out future directions and promising areas for the application of collective forces in synthetic active matter, as well as their role in living active matter.

Microscopic origins of the swim pressure and the anomalous surface tension of active matter

The unique pressure exerted by active particles-the "swim" pressure-has proven to be a useful quantity in explaining many of the seemingly confounding behaviors of active particles. However, its use has also resulted in some puzzling findings including an extremely negative surface tension between phase separated active particles. Here, we demonstrate that this contradiction stems from the fact that the swim pressure is not a true pressure. At a boundary or interface, the reduction in particle swimming generates a net active force density-an entirely self-generated body force. The pressure at the boundary, which was previously identified as the swim pressure, is in fact an elevated (relative to the bulk) value of the traditional particle pressure that is generated by this interfacial force density. Recognizing this unique mechanism for stress generation allows us to define a much more physically plausible surface tension. We clarify the utility of the swim pressure as an "equivalent pressure" (analogous to those defined from electrostatic and gravitational body forces) and the conditions in which this concept can be appropriately applied.

Generalized Ornstein-Uhlenbeck model for active motion

We investigate a one-dimensional model of active motion, which takes into account the effects of persistent self-propulsion through a memory function in a dissipative-like term of the generalized Langevin equation for particle swimming velocity. The proposed model is a generalization of the active Ornstein-Uhlenbeck model introduced by G. Szamel [Phys. Rev. E 90, 012111 (2014)10.1103/PhysRevE.90.012111]. We focus on two different kinds of memory which arise in many natural systems: an exponential decay and a power law, supplemented with additive colored noise. We provide analytical expressions for the velocity autocorrelation function and the mean-squared displacement, which are in excellent agreement with numerical simulations. For both models, damped oscillatory solutions emerge due to the competition between the memory of the system and the persistence of velocity fluctuations. In particular, for a power-law model with fractional Brownian noise, we show that long-time active subdiffusion occurs with increasing long-term memory.

Active Ornstein-Uhlenbeck particles

Active Ornstein-Uhlenbeck particles (AOUPs) are overdamped particles in an interaction potential subject to external Ornstein-Uhlenbeck noises. They can be transformed into a system of underdamped particles under additional velocity dependent forces and subject to white noise forces. There has been some discussion in the literature on whether AOUPs can be in equilibrium for particular interaction potentials and how far from equilibrium they are in the limit of small persistence time. By using a theorem on the time reversed form of the AOUP Langevin-Ito equations, I prove that they have an equilibrium probability density invariant under time reversal if and only if their smooth interaction potential has zero third derivatives. In the limit of small persistence Ornstein-Uhlenbeck time τ, a Chapman-Enskog expansion of the Fokker-Planck equation shows that the probability density has a local equilibrium solution in the particle momenta modulated by a reduced probability density that varies slowly with the position. The reduced probability density satisfies a continuity equation in which the probability current has an asymptotic expansion in powers of τ. Keeping up to O(τ) terms, this equation is a diffusion equation, which has an equilibrium stationary solution with zero current. However, O(τ^{2}) terms contain fifth- and sixth-order spatial derivatives and the continuity equation no longer has a zero current stationary solution. The expansion of the overall stationary solution now contains odd terms in the momenta, which clearly shows that it is not an equilibrium.

On the fluctuation-dissipation relation in non-equilibrium and non-Hamiltonian systems

We review generalized fluctuation-dissipation relations, which are valid under general conditions even in "nonstandard systems," e.g., out of equilibrium and/or without a Hamiltonian structure. The response functions can be expressed in terms of suitable correlation functions computed in the unperturbed dynamics. In these relations, typically, one has nontrivial contributions due to the form of the stationary probability distribution; such terms take into account the interaction among the relevant degrees of freedom in the system. We illustrate the general formalism with some examples in nonstandard cases, including driven granular media, systems with a multiscale structure, active matter, and systems showing anomalous diffusion.

Additivity and density fluctuations in Vicsek-like models of self-propelled particles

We study coarse-grained density fluctuations in the disordered phase of the paradigmatic Vicsek-like models of self-propelled particles with alignment interactions and random self-propulsion velocities. By numerically integrating a fluctuation-response relation-the direct consequence of an additivity property-we compute logarithm of the large-deviation probabilities of the coarse-grained subsystem density, while the system is in the disordered fluid phase with vanishing macroscopic velocity. The large-deviation probabilities, computed within additivity, agree remarkably well with that obtained from direct microscopic simulations of the models. Our results provide evidence of the existence of an equilibriumlike chemical potential, which governs the coarse-grained density fluctuations in the Vicsek-like models. Moreover, comparison of the particle-number fluctuations among several self-propelled particle systems suggests a common mechanism through which the number fluctuations arise in such systems.

Active chiral particles under confinement: surface currents and bulk accumulation phenomena

In this work, we study the stationary behavior of an assembly of independent chiral active particles under confinement by employing an extension of the active Ornstein-Uhlenbeck model. The chirality modeled by means of an effective torque term leads to a drastic reduction in the accumulation near the walls with respect to the case without handedness and to the appearance of currents parallel to the container walls accompanied by a large accumulation of particles in the inner region. In the case of two-dimensional chiral particles confined by harmonic walls, we determine the analytic form of the distribution of positions and velocities in two different situations: a rotationally invariant confining potential and an infinite channel with parabolic walls. Both these models display currents and chirality induced inner accumulation. These phenomena are further investigated by means of a more realistic description of a channel, where the wall and bulk regions are clearly separated. The corresponding current and density profiles are obtained by numerical simulations. At variance with the harmonic models, the third model shows a progressive emptying of the wall regions and the simultaneous enhancement of the bulk population. We explain such a phenomenon in terms of the combined effect of wall repulsive forces and chiral motion and provide a semiquantitative description of the current profile in terms of effective viscosity of the chiral gas.

Activity induced delocalization and freezing in self-propelled systems

We study a system of interacting active particles, propelled by colored noises, characterized by an activity time τ, and confined by a single-well anharmonic potential. We assume pair-wise repulsive forces among particles, modelling the steric interactions among microswimmers. This system has been experimentally studied in the case of a dilute suspension of Janus particles confined through acoustic traps. We observe that already in the dilute regime - when inter-particle interactions are negligible - increasing the persistent time, τ, pushes the particles away from the potential minimum, until a saturation distance is reached. We compute the phase diagram (activity versus interaction length), showing that the interaction does not suppress this delocalization phenomenon but induces a liquid- or solid-like structure in the densest regions. Interestingly a reentrant behavior is observed: a first increase of τ from small values acts as an effective warming, favouring fluidization; at higher values, when the delocalization occurs, a further increase of τ induces freezing inside the densest regions. An approximate analytical scheme gives fair predictions for the density profiles in the weakly interacting case. The analysis of non-equilibrium heat fluxes reveals that in the region of largest particle concentration equilibrium is restored in several aspects.

Optimizing active work: Dynamical phase transitions, collective motion, and jamming

Active work measures how far the local self-forcing of active particles translates into real motion. Using population Monte Carlo methods, we investigate large deviations in the active work for repulsive active Brownian disks. Minimizing the active work generically results in dynamical arrest; in contrast, despite the lack of aligning interactions, trajectories of high active work correspond to a collectively moving, aligned state. We use heuristic and analytic arguments to explain the origin of dynamical phase transitions separating the arrested, typical, and aligned regimes.

Hidden entropy production and work fluctuations in an ideal active gas

Collections of self-propelled particles that move persistently by continuously consuming free energy are a paradigmatic example of active matter. In these systems, unlike Brownian "hot colloids," the breakdown of detailed balance yields a continuous production of entropy at steady state, even for an ideal active gas. We quantify the irreversibility for a noninteracting active particle in two dimensions by treating both conjugated and time-reversed dynamics. By starting with underdamped dynamics, we identify a hidden rate of entropy production required to maintain persistence and prevent the rapidly relaxing momenta from thermalizing, even in the limit of very large friction. Additionally, comparing two popular models of self-propulsion with identical dissipation on average, we find that the fluctuations and large deviations in work done are markedly different, providing thermodynamic insight into the varying extents to which macroscopically similar active matter systems may depart from equilibrium.

Entropy Production and Fluctuation Theorems for Active Matter

Active biological systems reside far from equilibrium, dissipating heat even in their steady state, thus requiring an extension of conventional equilibrium thermodynamics and statistical mechanics. In this Letter, we have extended the emerging framework of stochastic thermodynamics to active matter. In particular, for the active Ornstein-Uhlenbeck model, we have provided consistent definitions of thermodynamic quantities such as work, energy, heat, entropy, and entropy production at the level of single, stochastic trajectories and derived related fluctuation relations. We have developed a generalization of the Clausius inequality, which is valid even in the presence of the non-Hamiltonian dynamics underlying active matter systems. We have illustrated our results with explicit numerical studies.