Estimating dissipation from single stationary trajectories

Unified approach to classical speed limit and thermodynamic uncertainty relation

The total entropy production quantifies the extent of irreversibility in thermodynamic systems, which is nonnegative for any feasible dynamics. When additional information such as the initial and final states or moments of an observable is available, it is known that tighter lower bounds on the entropy production exist according to the classical speed limits and the thermodynamic uncertainty relations. Here we obtain a universal lower bound on the total entropy production in terms of probability distributions of an observable in the time forward and backward processes. For a particular case, we show that our universal relation reduces to a classical speed limit, imposing a constraint on the speed of the system's evolution in terms of the Hatano-Sasa entropy production. Notably, the obtained classical speed limit is tighter than the previously reported bound by a constant factor. Moreover, we demonstrate that a generalized thermodynamic uncertainty relation can be derived from another particular case of the universal relation. Our uncertainty relation holds for systems with time-reversal symmetry breaking and recovers several existing bounds. Our approach provides a unified perspective on two closely related classes of inequality: classical speed limits and thermodynamic uncertainty relations.

Irreversibility in dynamical phases and transitions

Living and non-living active matter consumes energy at the microscopic scale to drive emergent, macroscopic behavior including traveling waves and coherent oscillations. Recent work has characterized non-equilibrium systems by their total energy dissipation, but little has been said about how dissipation manifests in distinct spatiotemporal patterns. We introduce a measure of irreversibility we term the entropy production factor to quantify how time reversal symmetry is broken in field theories across scales. We use this scalar, dimensionless function to characterize a dynamical phase transition in simulations of the Brusselator, a prototypical biochemically motivated non-linear oscillator. We measure the total energetic cost of establishing synchronized biochemical oscillations while simultaneously quantifying the distribution of irreversibility across spatiotemporal frequencies.

Thermodynamic Uncertainty Relation for Time-Dependent Driving

Thermodynamic uncertainty relations yield a lower bound on entropy production in terms of the mean and fluctuations of a current. We derive their general form for systems under arbitrary time-dependent driving from arbitrary initial states and extend these relations beyond currents to state variables. The quality of the bound is discussed for various types of observables for an interacting pair of colloidal particles in a moving laser trap and for the dynamical unfolding of a small protein. Since the input for evaluating these bounds does not require specific knowledge of the system or its coupling to the time-dependent control, they should become widely applicable tools for thermodynamic inference in time-dependently driven systems.

Learning the non-equilibrium dynamics of Brownian movies

Time-lapse microscopy imaging provides direct access to the dynamics of soft and living systems. At mesoscopic scales, such microscopy experiments reveal intrinsic thermal and non-equilibrium fluctuations. These fluctuations, together with measurement noise, pose a challenge for the dynamical analysis of these Brownian movies. Traditionally, methods to analyze such experimental data rely on tracking embedded or endogenous probes. However, it is in general unclear, especially in complex many-body systems, which degrees of freedom are the most informative about their non-equilibrium nature. Here, we introduce an alternative, tracking-free approach that overcomes these difficulties via an unsupervised analysis of the Brownian movie. We develop a dimensional reduction scheme selecting a basis of modes based on dissipation. Subsequently, we learn the non-equilibrium dynamics, thereby estimating the entropy production rate and time-resolved force maps. After benchmarking our method against a minimal model, we illustrate its broader applicability with an example inspired by active biopolymer gels.

Learning Entropy Production via Neural Networks

This Letter presents a neural estimator for entropy production (NEEP), that estimates entropy production (EP) from trajectories of relevant variables without detailed information on the system dynamics. For steady state, we rigorously prove that the estimator, which can be built up from different choices of deep neural networks, provides stochastic EP by optimizing the objective function proposed here. We verify the NEEP with the stochastic processes of the bead spring and discrete flashing ratchet models and also demonstrate that our method is applicable to high-dimensional data and can provide coarse-grained EP for Markov systems with unobservable states.

Estimating entropy production by machine learning of short-time fluctuating currents

Thermodynamic uncertainty relations (TURs) are the inequalities which give lower bounds on the entropy production rate using only the mean and the variance of fluctuating currents. Since the TURs do not refer to the full details of the stochastic dynamics, it would be promising to apply the TURs for estimating the entropy production rate from a limited set of trajectory data corresponding to the dynamics. Here we investigate a theoretical framework for estimation of the entropy production rate using the TURs along with machine learning techniques without prior knowledge of the parameters of the stochastic dynamics. Specifically, we derive a TUR for the short-time region and prove that it can provide the exact value, not only a lower bound, of the entropy production rate for Langevin dynamics, if the observed current is optimally chosen. This formulation naturally includes a generalization of the TURs with the partial entropy production of subsystems under autonomous interaction, which reveals the hierarchical structure of the estimation. We then construct estimators on the basis of the short-time TUR and machine learning techniques such as the gradient ascent. By performing numerical experiments, we demonstrate that our learning protocol performs well even in nonlinear Langevin dynamics. We also discuss the case of Markov jump processes, where the exact estimation is shown to be impossible in general. Our result provides a platform that can be applied to a broad class of stochastic dynamics out of equilibrium, including biological systems.

Time Irreversibility of Resting-State Activity in the Healthy Brain and Pathology

Characterizing brain activity at rest is of paramount importance to our understanding both of general principles of brain functioning and of the way brain dynamics is affected in the presence of neurological or psychiatric pathologies. We measured the time-reversal symmetry of spontaneous electroencephalographic brain activity recorded from three groups of patients and their respective control group under two experimental conditions (eyes open and closed). We evaluated differences in time irreversibility in terms of possible underlying physical generating mechanisms. The results showed that resting brain activity is generically time-irreversible at sufficiently long time scales, and that brain pathology is generally associated with a reduction in time-asymmetry, albeit with pathology-specific patterns. The significance of these results and their possible dynamical etiology are discussed. Some implications of the differential modulation of time asymmetry by pathology and experimental condition are examined.

Inferring broken detailed balance in the absence of observable currents

Identifying dissipation is essential for understanding the physical mechanisms underlying nonequilibrium processes. In living systems, for example, the dissipation is directly related to the hydrolysis of fuel molecules such as adenosine triphosphate (ATP). Nevertheless, detecting broken time-reversal symmetry, which is the hallmark of dissipative processes, remains a challenge in the absence of observable directed motion, flows, or fluxes. Furthermore, quantifying the entropy production in a complex system requires detailed information about its dynamics and internal degrees of freedom. Here we introduce a novel approach to detect time irreversibility and estimate the entropy production from time-series measurements, even in the absence of observable currents. We apply our technique to two different physical systems, namely, a partially hidden network and a molecular motor. Our method does not require complete information about the system dynamics and thus provides a new tool for studying nonequilibrium phenomena.

Non-equilibrium systems with hidden states are relevant for biological systems such as molecular motors. Here the authors introduce a method for quantifying irreversibility in such a system by exploiting the fluctuations in the waiting times of time series data.

Visibility graph analysis of temporal irreversibility in sleep electroencephalograms

The study of sleep has continued to garner increased attention. However, most studies assume stationarity of sleep electroencephalogram (EEG) signals, whereas they are typically nonlinear and nonstationary. Little work has focused on the time irreversibility of sleep EEG signals. Hence, the aim of this work is to reveal the temporally irreversible structures of rapid-eye-movement (REM) and non-REM sleep using a visibility algorithm, which is robust to nonstationarity and finite-size effect. Results show that the temporal structure of non-REM sleep is more irreversible than that of REM sleep. The degree of irreversibility is highest in slow-wave sleep. Moreover, statistical analysis suggests that aging is the major factor that affects the irreversibility of sleep signals, while gender and body mass index contribute insignificantly. The dominant role of slow oscillations on the irreversible structures of the sleep signals is also indicated.

Non-Markovianity and negative entropy production rates

Entropy production plays a fundamental role in nonequilibrium thermodynamics to quantify the irreversibility of open systems. Its positivity can be ensured for a wide class of setups, but the entropy production rate can become negative sometimes. This is often taken as an indicator of non-Markovianity. We make this link precise by showing under which conditions a negative entropy production rate implies non-Markovianity and when it does not. For a system coupled to a single heat bath, this can be established within a unified language for two setups: (i) the dynamics resulting from a coarse-grained description of a Markovian master equation and (ii) the classical Hamiltonian dynamics of a system coupled to a bath. The quantum version of the latter result is shown not to hold despite the fact that the integrated thermodynamic description is formally equivalent to the classical case. The instantaneous fixed point of a non-Markovian dynamics plays an important role in our study. Our key contribution is to provide a consistent theoretical framework to study the finite-time thermodynamics of a large class of dynamics with a precise link to its non-Markovianity.

Unattainability of Carnot efficiency in thermal motors: Coarse graining and entropy production of Feynman-Smoluchowski ratchets

We revisit and analyze the thermodynamic efficiency of the Feynman-Smoluchowski (FS) ratchet, a classical thought experiment describing an autonomous heat-work converter. Starting from the full kinetics of the FS ratchet and deriving the exact forms of the hidden dissipations resulting from coarse graining, we restate the historical controversy over its thermodynamic efficiency. The existence of hidden entropy productions implies that the standard framework of stochastic thermodynamics applied to the coarse-grained descriptions fails in capturing the dissipative feature of the system. In response to this problem, we explore an extended framework of stochastic thermodynamics to reconstruct the hidden entropy production from the coarse-grained dynamics. The approach serves as a key example of how we can systematically address the problem of thermodynamic efficiency in a multivariable fluctuating nonequilibrium system.

Assessing Time Series Reversibility through Permutation Patterns

Time irreversibility, i.e., the lack of invariance of the statistical properties of a system under time reversal, is a fundamental property of all systems operating out of equilibrium. Time reversal symmetry is associated with important statistical and physical properties and is related to the predictability of the system generating the time series. Over the past fifteen years, various methods to quantify time irreversibility in time series have been proposed, but these can be computationally expensive. Here, we propose a new method, based on permutation entropy, which is essentially parameter-free, temporally local, yields straightforward statistical tests, and has fast convergence properties. We apply this method to the study of financial time series, showing that stocks and indices present a rich irreversibility dynamics. We illustrate the comparative methodological advantages of our method with respect to a recently proposed method based on visibility graphs, and discuss the implications of our results for financial data analysis and interpretation.

Causality, dynamical systems and the arrow of time

Using several methods for detection of causality in time series, we show in a numerical study that coupled chaotic dynamical systems violate the first principle of Granger causality that the cause precedes the effect. While such a violation can be observed in formal applications of time series analysis methods, it cannot occur in nature, due to the relation between entropy production and temporal irreversibility. The obtained knowledge, however, can help to understand the type of causal relations observed in experimental data, namely, it can help to distinguish linear transfer of time-delayed signals from nonlinear interactions. We illustrate these findings in causality detected in experimental time series from the climate system and mammalian cardio-respiratory interactions.

Universal bounds on current fluctuations

For current fluctuations in nonequilibrium steady states of Markovian processes, we derive four different universal bounds valid beyond the Gaussian regime. Different variants of these bounds apply to either the entropy change or any individual current, e.g., the rate of substrate consumption in a chemical reaction or the electron current in an electronic device. The bounds vary with respect to their degree of universality and tightness. A universal parabolic bound on the generating function of an arbitrary current depends solely on the average entropy production. A second, stronger bound requires knowledge both of the thermodynamic forces that drive the system and of the topology of the network of states. These two bounds are conjectures based on extensive numerics. An exponential bound that depends only on the average entropy production and the average number of transitions per time is rigorously proved. This bound has no obvious relation to the parabolic bound but it is typically tighter further away from equilibrium. An asymptotic bound that depends on the specific transition rates and becomes tight for large fluctuations is also derived. This bound allows for the prediction of the asymptotic growth of the generating function. Even though our results are restricted to networks with a finite number of states, we show that the parabolic bound is also valid for three paradigmatic examples of driven diffusive systems for which the generating function can be calculated using the additivity principle. Our bounds provide a general class of constraints for nonequilibrium systems.

Cycles, randomness, and transport from chaotic dynamics to stochastic processes

An overview of advances at the frontier between dynamical systems theory and nonequilibrium statistical mechanics is given. Sensitivity to initial conditions is a mechanism at the origin of dynamical randomness-alias temporal disorder-in deterministic dynamical systems. In spatially extended systems, sustaining transport processes, such as diffusion, relationships can be established between the characteristic quantities of dynamical chaos and the transport coefficients, bringing new insight into the second law of thermodynamics. With methods from dynamical systems theory, the microscopic time-reversal symmetry can be shown to be broken at the statistical level of description in nonequilibrium systems. In this way, the thermodynamic entropy production turns out to be related to temporal disorder and its time asymmetry away from equilibrium.

Time reversibility from visibility graphs of nonstationary processes

Visibility algorithms are a family of methods to map time series into networks, with the aim of describing the structure of time series and their underlying dynamical properties in graph-theoretical terms. Here we explore some properties of both natural and horizontal visibility graphs associated to several nonstationary processes, and we pay particular attention to their capacity to assess time irreversibility. Nonstationary signals are (infinitely) irreversible by definition (independently of whether the process is Markovian or producing entropy at a positive rate), and thus the link between entropy production and time series irreversibility has only been explored in nonequilibrium stationary states. Here we show that the visibility formalism naturally induces a new working definition of time irreversibility, which allows us to quantify several degrees of irreversibility for stationary and nonstationary series, yielding finite values that can be used to efficiently assess the presence of memory and off-equilibrium dynamics in nonstationary processes without the need to differentiate or detrend them. We provide rigorous results complemented by extensive numerical simulations on several classes of stochastic processes.

Harvesting entropy and quantifying the transition from noise to chaos in a photon-counting feedback loop

Many physical processes, including the intensity fluctuations of a chaotic laser, the detection of single photons, and the Brownian motion of a microscopic particle in a fluid are unpredictable, at least on long timescales. This unpredictability can be due to a variety of physical mechanisms, but it is quantified by an entropy rate. This rate, which describes how quickly a system produces new and random information, is fundamentally important in statistical mechanics and practically important for random number generation. We experimentally study entropy generation and the emergence of deterministic chaotic dynamics from discrete noise in a system that applies feedback to a weak optical signal at the single-photon level. We show that the dynamics transition from shot noise to chaos as the photon rate increases and that the entropy rate can reflect either the deterministic or noisy aspects of the system depending on the sampling rate and resolution.

Stochastic thermodynamics of hidden pumps

We show that a reversible pumping mechanism operating between two states of a kinetic network can give rise to Poisson transitions between these two states. An external observer, for whom the pumping mechanism is not accessible, will observe a Markov chain satisfying local detailed balance with an emerging effective force induced by the hidden pump. Due to the reversibility of the pump, the actual entropy production turns out to be lower than the coarse-grained entropy production estimated from the flows and affinities of the resulting Markov chain. Moreover, in presence of a large time scale separation between the fast-pumping dynamics and the slow-network dynamics, a finite current with zero dissipation may be produced. We make use of these general results to build a synthetase-like kinetic scheme able to reversibly produce high free-energy molecules at a finite rate and a rotatory motor achieving 100% efficiency at finite speed.

Determination of reaction flux from concentration fluctuations near a Hopf bifurcation

Small open chemical systems, typically associated with far-from-equilibrium, nonlinear stochastic dynamics, offer the appropriate framework to elucidate biological phenomena at the cellular scale. Stochastic differential equations of Langevin-type are employed to establish the relation between the departure from equilibrium and the time cross-correlation functions of concentration fluctuations for chemical species susceptible to oscillate. Except in the immediate vicinity of the Hopf bifurcation, the results are in agreement with simulations of the chemical master equation but always differ from the prediction obtained for linear deterministic dynamics. In general, the magnitude of the asymmetry of time correlation functions definitely depends on the reaction flux circulating in an open system but also on the details of the nonlinearities of deterministic dynamics.

Temporal cross-correlation asymmetry and departure from equilibrium in a bistable chemical system

This paper aims at determining sustained reaction fluxes in a nonlinear chemical system driven in a nonequilibrium steady state. The method relies on the computation of cross-correlation functions for the internal fluctuations of chemical species concentrations. By employing Langevin-type equations, we derive approximate analytical formulas for the cross-correlation functions associated with nonlinear dynamics. Kinetic Monte Carlo simulations of the chemical master equation are performed in order to check the validity of the Langevin equations for a bistable chemical system. The two approaches are found in excellent agreement, except for critical parameter values where the bifurcation between monostability and bistability occurs. From the theoretical point of view, the results imply that the behavior of cross-correlation functions cannot be exploited to measure sustained reaction fluxes in a specific nonlinear system without the prior knowledge of the associated chemical mechanism and the rate constants.

Energy versus information based estimations of dissipation using a pair of magnetic colloidal particles

Using the framework of stochastic thermodynamics, we present an experimental study of a doublet of magnetic colloidal particles that is manipulated by a time-dependent magnetic field. Because of hydrodynamic interactions, each bead experiences a state-dependent friction, which we characterize using a hydrodynamic model. In this work, we compare two estimates of the dissipation in this system: the first one is energy based since it relies on the measured interaction potential, while the second one is information based since it uses only the information content of the trajectories. While the latter only offers a lower bound of the former, we find it to be simple to implement and of general applicability to more complex systems.

Trajectory Entropy of Continuous Stochastic Processes at Equilibrium

We propose to quantify the trajectory entropy of a dynamic system as the information content in excess of a free-diffusion reference model. The space-time trajectory is now the dynamic variable, and its path probability is given by the Onsager-Machlup action. For the time propagation of the overdamped Langevin equation, we solved the action path integral in the continuum limit and arrived at an exact analytical expression that emerged as a simple functional of the deterministic mean force and the stochastic diffusion. This work may have direct implications in chemical and phase equilibria, bond isomerization, and conformational changes in biological macromolecules as well transport problems in general.

Sleep Electroencephalogram Analysis Based on Symbolic Transfer Entropy

The quality of sleep has a great relationship with health. The result of sleep stage classification is an important indicator to measure the quality of sleep. It was found that the symbolic transfer entropy about wake and the first stage of non-rapid eye movement sleep reflect on the changes of sleep stage. And it was confirmed by T test and multi-samples experiments. The symbolic transfer entropy can apply into automatic sleep stage classification. By Multi-parameter analysis it could achieve a higher accuracy of sleep stage classification.

Stochastic thermodynamics, fluctuation theorems and molecular machines

Stochastic thermodynamics as reviewed here systematically provides a framework for extending the notions of classical thermodynamics such as work, heat and entropy production to the level of individual trajectories of well-defined non-equilibrium ensembles. It applies whenever a non-equilibrium process is still coupled to one (or several) heat bath(s) of constant temperature. Paradigmatic systems are single colloidal particles in time-dependent laser traps, polymers in external flow, enzymes and molecular motors in single molecule assays, small biochemical networks and thermoelectric devices involving single electron transport. For such systems, a first-law like energy balance can be identified along fluctuating trajectories. For a basic Markovian dynamics implemented either on the continuum level with Langevin equations or on a discrete set of states as a master equation, thermodynamic consistency imposes a local-detailed balance constraint on noise and rates, respectively. Various integral and detailed fluctuation theorems, which are derived here in a unifying approach from one master theorem, constrain the probability distributions for work, heat and entropy production depending on the nature of the system and the choice of non-equilibrium conditions. For non-equilibrium steady states, particularly strong results hold like a generalized fluctuation-dissipation theorem involving entropy production. Ramifications and applications of these concepts include optimal driving between specified states in finite time, the role of measurement-based feedback processes and the relation between dissipation and irreversibility. Efficiency and, in particular, efficiency at maximum power can be discussed systematically beyond the linear response regime for two classes of molecular machines, isothermal ones such as molecular motors, and heat engines such as thermoelectric devices, using a common framework based on a cycle decomposition of entropy production.

Entropy production and Kullback-Leibler divergence between stationary trajectories of discrete systems

The irreversibility of a stationary time series can be quantified using the Kullback-Leibler divergence (KLD) between the probability of observing the series and the probability of observing the time-reversed series. Moreover, this KLD is a tool to estimate entropy production from stationary trajectories since it gives a lower bound to the entropy production of the physical process generating the series. In this paper we introduce analytical and numerical techniques to estimate the KLD between time series generated by several stochastic dynamics with a finite number of states. We examine the accuracy of our estimators for a specific example, a discrete flashing ratchet, and investigate how close the KLD is to the entropy production depending on the number of degrees of freedom of the system that are sampled in the trajectories.