Stochastic control and non-equilibrium thermodynamics: fundamental limits

Fundamental Limits of an Irreversible Heat Engine

We investigated the optimal performance of an irreversible Stirling-like heat engine described by both overdamped and underdamped models within the framework of stochastic thermodynamics. By establishing a link between energy dissipation and Wasserstein distance, we derived the upper bound of maximal power that can be delivered over a complete engine cycle for both models. Additionally, we analytically developed an optimal control strategy to achieve this upper bound of maximal power and determined the efficiency at maximal power in the overdamped scenario.

Time-asymmetric fluctuation theorem and efficient free-energy estimation

The free-energy difference ΔF between two high-dimensional systems is notoriously difficult to compute but very important for many applications such as drug discovery. We demonstrate that an unconventional definition of work introduced by Vaikuntanathan and Jarzynski (2008) satisfies a microscopic fluctuation theorem that relates path ensembles that are driven by protocols unequal under time reversal. It has been shown before that counterdiabatic protocols-those having additional forcing that enforces the system to remain in instantaneous equilibrium, also known as escorted dynamics or engineered swift equilibration-yield zero-variance work measurements for this definition. We show that this time-asymmetric microscopic fluctuation theorem can be exploited for efficient free-energy estimation by developing a simple (i.e., neural-network free) and efficient adaptive time-asymmetric protocol optimization algorithm that yields ΔF estimates that are orders of magnitude lower in mean squared error than the generic linear interpolation protocol with which it is initialized.

Beyond Linear Response: Equivalence between Thermodynamic Geometry and Optimal Transport

A fundamental result of thermodynamic geometry is that the optimal, minimal-work protocol that drives a nonequilibrium system between two thermodynamic states in the slow-driving limit is given by a geodesic of the friction tensor, a Riemannian metric defined on control space. For overdamped dynamics in arbitrary dimensions, we demonstrate that thermodynamic geometry is equivalent to L^{2} optimal transport geometry defined on the space of equilibrium distributions corresponding to the control parameters. We show that obtaining optimal protocols past the slow-driving or linear response regime is computationally tractable as the sum of a friction tensor geodesic and a counterdiabatic term related to the Fisher information metric. These geodesic-counterdiabatic optimal protocols are exact for parametric harmonic potentials, reproduce the surprising nonmonotonic behavior recently discovered in linearly biased double well optimal protocols, and explain the ubiquitous discontinuous jumps observed at the beginning and end times.

Limited-control optimal protocols arbitrarily far from equilibrium

Recent studies have explored finite-time dissipation-minimizing protocols for stochastic thermodynamic systems driven arbitrarily far from equilibrium, when granted full external control to drive the system. However, in both simulation and experimental contexts, systems often may only be controlled with a limited set of degrees of freedom. Here, going beyond slow- and fast-driving approximations employed in previous studies, we obtain exact finite-time optimal protocols for this limited-control setting. By working with deterministic Fokker-Planck probability density time evolution, we can frame the work-minimizing protocol problem in the standard form of an optimal control theory problem. We demonstrate that finding the exact optimal protocol is equivalent to solving a system of Hamiltonian partial differential equations, which in many cases admit efficiently calculable numerical solutions. Within this framework, we reproduce analytical results for the optimal control of harmonic potentials and numerically devise optimal protocols for two anharmonic examples: varying the stiffness of a quartic potential and linearly biasing a double-well potential. We confirm that these optimal protocols outperform other protocols produced through previous methods, in some cases by a substantial amount. We find that for the linearly biased double-well problem, the mean position under the optimal protocol travels at a near-constant velocity. Surprisingly, for a certain timescale and barrier height regime, the optimal protocol is also nonmonotonic in time.

Quantifying brain state transition cost via Schrödinger Bridge

Quantifying brain state transition cost is a fundamental problem in systems neuroscience. Previous studies utilized network control theory to measure the cost by considering a neural system as a deterministic dynamical system. However, this approach does not capture the stochasticity of neural systems, which is important for accurately quantifying brain state transition cost. Here, we propose a novel framework based on optimal control in stochastic systems. In our framework, we quantify the transition cost as the Kullback-Leibler divergence from an uncontrolled transition path to the optimally controlled path, which is known as Schrödinger Bridge. To test its utility, we applied this framework to functional magnetic resonance imaging data from the Human Connectome Project and computed the brain state transition cost in cognitive tasks. We demonstrate correspondence between brain state transition cost and the difficulty of tasks. The results suggest that our framework provides a general theoretical tool for investigating cognitive functions from the viewpoint of transition cost.

Underdamped stochastic thermodynamic engines in contact with a heat bath with arbitrary temperature profile

We study thermodynamic processes in contact with a heat bath that may have an arbitrary time-varying periodic temperature profile. Within the framework of stochastic thermodynamics, and for models of thermodynamic engines in the idealized case of underdamped particles in the low-friction regime subject to a harmonic potential, we derive explicit bounds as well as optimal control protocols that draw maximum power and achieve maximum efficiency at any specified level of power.