A Numerical Procedure to Evaluate Memory Effects in Non‐Equilibrium Coarse‐Grained Models

Ab initio generalized Langevin equation

We introduce a machine learning-based approach called ab initio generalized Langevin equation (AIGLE) to model the dynamics of slow collective variables (CVs) in materials and molecules. In this scheme, the parameters are learned from atomistic simulations based on ab initio quantum mechanical models. Force field, memory kernel, and noise generator are constructed in the context of the Mori-Zwanzig formalism, under the constraint of the fluctuation-dissipation theorem. Combined with deep potential molecular dynamics and electronic density functional theory, this approach opens the way to multiscale modeling in a variety of situations. Here, we demonstrate this capability with a study of two mesoscale processes in crystalline lead titanate, namely the field-driven dynamics of a planar ferroelectric domain wall, and the dynamics of an extensive lattice of coarse-grained electric dipoles. In the first case, AIGLE extends the reach of ab initio simulations to a regime of noise-driven motions not accessible to molecular dynamics. In the second case, AIGLE deals with an extensive set of CVs by adopting a local approximation for the memory kernel and retaining only short-range noise correlations. The scheme is computationally more efficient than molecular dynamics by several orders of magnitude and mimics the microscopic dynamics at low frequencies where it reproduces accurately the dominant far-infrared absorption frequency.

Chemically Specific Systematic Coarse-Grained Polymer Model with Both Consistently Structural and Dynamical Properties

The coarse-grained (CG) model serves as a powerful tool for the simulation of polymer systems; its reliability depends on the accurate representation of both structural and dynamical properties. However, strong correlations between structural and dynamical properties on different scales and also a strong memory effect, enforced by chain connectivity between monomers in polymer systems, render developing a chemically specific systematic CG model a formidable task. In this study, we report a systematic CG approach that combines the iterative Boltzmann inversion (IBI) method and the generalized Langevin equation (GLE) dynamics. Structural properties are ensured by using conservative CG potentials derived from the IBI method. To retrieve the correct dynamical properties in the system, we demonstrate that using a combination of a Rouse-type delta function and a time-dependent short-time kernel in the GLE simulation is practically efficient. The former can be used to adjust the long-time diffusion dynamics, and the latter can be reconstructed from an iterative procedure according to the velocity autocorrelation function (ACF) from all-atomistic (AA) simulations. Taking the polystyrene as an example, we show that not only structural properties of radial distribution function, intramolecular bond, and angle distributions can be reproduced but also dynamical properties of mean-square displacement, velocity ACF, and force ACF resulted from our CG model have quantitative agreement with the reference AA model. In addition, reasonable agreements are observed in other collective properties between our GLE-CG model and the AA simulations as well.

Inferring free-energy barriers and kinetic rates from molecular dynamics via underdamped Langevin models

Rare events include many of the most interesting transformation processes in condensed matter, from phase transitions to biomolecular conformational changes to chemical reactions. Access to the corresponding mechanisms, free-energy landscapes and kinetic rates can in principle be obtained by different techniques after projecting the high-dimensional atomic dynamics on one (or a few) collective variable. Even though it is well-known that the projected dynamics approximately follows - in a statistical sense - the generalized, underdamped or overdamped Langevin equations (depending on the time resolution), to date it is nontrivial to parameterize such equations starting from a limited, practically accessible amount of non-ergodic trajectories. In this work we focus on Markovian, underdamped Langevin equations, that arise naturally when considering, e.g., numerous water-solution processes at sub-picosecond resolution. After contrasting the advantages and pitfalls of different numerical approaches, we present an efficient parametrization strategy based on a limited set of molecular dynamics data, including equilibrium trajectories confined to minima and few hundreds transition path sampling-like trajectories. Employing velocity autocorrelation or memory kernel information for learning the friction and likelihood maximization for learning the free-energy landscape, we demonstrate the possibility to reconstruct accurate barriers and rates both for a benchmark system and for the interaction of carbon nanoparticles in water.

Anisotropic Friction in a Ligand-Protein Complex

The effect of an externally applied directional force on molecular friction is so far poorly understood. Here, we study the force-driven dissociation of the ligand-protein complex biotin-streptavidin and identify anisotropic friction as a not yet described type of molecular friction. Using AFM-based stereographic single molecule force spectroscopy and targeted molecular dynamics simulations, we find that the rupture force and friction for biotin-streptavidin vary with the pulling angle. This observation holds true for friction extracted from Kramers' rate expression and by dissipation-corrected targeted molecular dynamics simulations based on Jarzynski's identity. We rule out ligand solvation and protein-internal friction as sources of the angle-dependent friction. Instead, we observe a heterogeneity in free energy barriers along an experimentally uncontrolled orientation parameter, which increases the rupture force variance and therefore the overall friction. We anticipate that anisotropic friction needs to be accounted for in a complete understanding of friction in biomolecular dynamics and anisotropic mechanical environments.

Pair-Reaction Dynamics in Water: Competition of Memory, Potential Shape, and Inertial Effects

When described by a one-dimensional reaction coordinate, pair-reaction rates in a solvent depend, in addition to the potential barrier height and the friction coefficient, on the potential shape, the effective mass, and the friction relaxation spectrum, but a rate theory that accurately accounts for all of these effects does not exist. After a review of classical reaction-rate theories, we show how to extract all parameters of the generalized Langevin equation (GLE) and, in particular, the friction memory function from molecular dynamics (MD) simulations of two prototypical pair reactions in water, the dissociation of NaCl and of two methane molecules. The memory exhibits multiple time scales and, for NaCl, pronounced oscillatory components. Simulations of the GLE by Markovian embedding techniques accurately reproduce the pair-reaction kinetics from MD simulations without any fitting parameters, which confirms the accuracy of the approximative form of the GLE and of the parameter extraction techniques. By modification of the GLE parameters, we investigate the relative importance of memory, mass, and potential shape effects. Neglect of memory slows down NaCl and methane dissociation by roughly a factor of 2; neglect of mass accelerates reactions by a similar factor, and the harmonic approximation of the potential shape gives rise to slight acceleration. This partial error cancellation explains why Kramers' theory, which neglects memory effects and treats the potential shape in harmonic approximation, describes reaction rates better than more sophisticated theories. In essence, all three effects, friction memory, inertia, and the potential shape nonharmonicity, are important to quantitatively describe pair-reaction kinetics in water.

Generalized Langevin dynamics simulation with non-stationary memory kernels: How to make noise

We present a numerical method to produce stochastic dynamics according to the generalized Langevin equation with a non-stationary memory kernel. This type of dynamics occurs when a microscopic system with an explicitly time-dependent Liouvillian is coarse-grained by means of a projection operator formalism. We show how to replace the deterministic fluctuating force in the generalized Langevin equation by a stochastic process, such that the distributions of the observables are reproduced up to moments of a given order. Thus, in combination with a method to extract the memory kernel from simulation data of the underlying microscopic model, the method introduced here allows us to construct and simulate a coarse-grained model for a driven process.

Barrier-crossing times for different non-Markovian friction in well and barrier: A numerical study

We introduce a generalized Langevin model system for different non-Markovian effects in the well and barrier regions of a potential, and use it to numerically study the barrier-crossing time. In the appropriate limits, our model interpolates between the theoretical barrier-crossing-time predictions by Grote and Hynes (GH), as well as by Pollak et al., which for a single barrier memory time can differ by several orders of magnitude. Our model furthermore allows one to test an analytic rate theory for space-inhomogeneous memory, which disagrees with our numerical results in the long well-memory regime. In this regime, we find that short barrier memory decreases the barrier-crossing time as compared to long barrier memory. This is in contrast with the short well-memory regime, where both our numerical results and the GH theory predict an acceleration of the barrier crossing time with increasing barrier memory time. Both effects, the "Markovian-barrier acceleration" and GH "non-Markovian-barrier acceleration," can be understood from a committor analysis. Our model combines finite relaxation times of orthogonal degrees of freedom with a space-inhomogeneous coupling to such degrees and represents a step towards more realistic modeling of reaction coordinates.

Molecular Origin of Driving-Dependent Friction in Fluids

The friction coefficient of fluids may become a function of the velocity at increased external driving. This non-Newtonian behavior is of general theoretical interest and of great practical importance, for example, for the design of lubricants. Although the effect has been observed in large-scale atomistic simulations of bulk liquids, its theoretical formulation and microscopic origin are not well understood. Here, we use dissipation-corrected targeted molecular dynamics, which pulls apart two tagged liquid molecules in the presence of surrounding molecules, and analyze this nonequilibrium process via a generalized Langevin equation. The approach is based on a second-order cumulant expansion of Jarzynski's identity, which is shown to be valid for fluids and therefore allows for an exact computation of the friction profile as well of the underlying memory kernel. We show that velocity-dependent friction in fluids results from an intricate interplay of near-order structural effects and the non-Markovian behavior of the friction memory kernel. For complex fluids such as the model lubricant C₄₀H₈₂, the memory kernel exhibits a stretched-exponential long-time decay, which reflects the multitude of timescales of the system.

Phase space geometry of isolated to condensed chemical reactions

The complexity of gas and condensed phase chemical reactions has generally been uncovered either approximately through transition state theories or exactly through (analytic or computational) integration of trajectories. These approaches can be improved by recognizing that the dynamics and associated geometric structures exist in phase space, ensuring that the propagator is symplectic as in velocity-Verlet integrators and by extending the space of dividing surfaces to optimize the rate variationally, respectively. The dividing surface can be analytically or variationally optimized in phase space, not just over configuration space, to obtain more accurate rates. Thus, a phase space perspective is of primary importance in creating a deeper understanding of the geometric structure of chemical reactions. A key contribution from dynamical systems theory is the generalization of the transition state (TS) in terms of the normally hyperbolic invariant manifold (NHIM) whose geometric phase-space structure persists under perturbation. The NHIM can be regarded as an anchor of a dividing surface in phase space and it gives rise to an exact non-recrossing TS theory rate in reactions that are dominated by a single bottleneck. Here, we review recent advances of phase space geometrical structures of particular relevance to chemical reactions in the condensed phase. We also provide conjectures on the promise of these techniques toward the design and control of chemical reactions.

Mori-Zwanzig Formalism for General Relativity: A New Approach to the Averaging Problem

Cosmology relies on a coarse-grained description of the universe, assumed to be valid on large length scales. However, the nonlinearity of general relativity makes coarse graining extremely difficult. We here address this problem by extending the Mori-Zwanzig projection operator formalism, a highly successful coarse-graining method from statistical mechanics, towards general relativity. Using the Buchert equations, we derive a new dynamic equation for the Hubble parameter which captures the effects of averaging through a memory function. This gives an empirical prediction for the cosmic jerk.

Data-Driven Langevin Modeling of Nonequilibrium Processes

Given nonstationary data from molecular dynamics simulations, a Markovian Langevin model is constructed that aims to reproduce the time evolution of the underlying process. While at equilibrium the free energy landscape is sampled, nonequilibrium processes can be associated with a biased energy landscape, which accounts for finite sampling effects and external driving. When the data-driven Langevin equation (dLE) approach [Phys. Rev. Lett. 2015, 115, 050602] is extended to the modeling of nonequilibrium processes, an efficient way to calculate multidimensional Langevin fields is outlined. The dLE is shown to correctly account for various nonequilibrium processes, including the enforced dissociation of sodium chloride in water, the pressure-jump induced nucleation of a liquid of hard spheres, and the conformational dynamics of a helical peptide sampled from nonstationary short trajectories.

Data-driven coarse-grained modeling of non-equilibrium systems

Modeling a high-dimensional Hamiltonian system in reduced dimensions with respect to coarse-grained (CG) variables can greatly reduce computational cost and enable efficient bottom-up prediction of main features of the system for many applications. However, it usually experiences significantly altered dynamics due to loss of degrees of freedom upon coarse-graining. To establish CG models that can faithfully preserve dynamics, previous efforts mainly focused on equilibrium systems. In contrast, various soft matter systems are known to be out of equilibrium. Therefore, the present work concerns non-equilibrium systems and enables accurate and efficient CG modeling that preserves non-equilibrium dynamics and is generally applicable to any non-equilibrium process and any observable of interest. To this end, the dynamic equation of a CG variable is built in the form of the non-stationary generalized Langevin equation (nsGLE), where the two-time memory kernel is determined from the data of the auto-correlation function of the observable of interest. By embedding the nsGLE in an extended dynamics framework, the nsGLE can be solved efficiently to predict the non-equilibrium dynamics of the CG variable. To prove and exploit the equivalence of the nsGLE and extended dynamics, the memory kernel is parameterized in a two-time exponential expansion. A data-driven hybrid optimization process is proposed for the parameterization, which integrates the differential-evolution method with the Levenberg-Marquardt algorithm to efficiently tackle a non-convex and high-dimensional optimization problem.

Introducing Memory in Coarse-Grained Molecular Simulations

Preserving the correct dynamics at the coarse-grained (CG) level is a pressing problem in the development of systematic CG models in soft matter simulation. Starting from the seminal idea of simple time-scale mapping, there have been many efforts over the years toward establishing a meticulous connection between the CG and fine-grained (FG) dynamics based on fundamental statistical mechanics approaches. One of the most successful attempts in this context has been the development of CG models based on the Mori-Zwanzig (MZ) theory, where the resulting equation of motion has the form of a generalized Langevin equation (GLE) and closely preserves the underlying FG dynamics. In this Review, we describe some of the recent studies in this regard. We focus on the construction and simulation of dynamically consistent systematic CG models based on the GLE, both in the simple Markovian limit and the non-Markovian case. Some recent studies of physical effects of memory are also discussed. The Review is aimed at summarizing recent developments in the field while highlighting the major challenges and possible future directions.

Comments on the validity of the non-stationary generalized Langevin equation as a coarse-grained evolution equation for microscopic stochastic dynamics

We recently showed that the dynamics of coarse-grained observables in systems out of thermal equilibrium are governed by the non-stationary generalized Langevin equation [H. Meyer, T. Voigtmann, and T. Schilling, J. Chem. Phys. 147, 214110 (2017); 150, 174118 (2019)]. The derivation we presented in these two articles was based on the assumption that the dynamics of the microscopic degrees of freedom were deterministic. Here, we extend the discussion to stochastic microscopic dynamics. The fact that the same form of the non-stationary generalized Langevin equation as derived for the deterministic case also holds for stochastic processes implies that methods designed to estimate the memory kernel, drift term, and fluctuating force term of this equation, as well as methods designed to propagate it numerically, can be applied to data obtained in molecular dynamics simulations that employ a stochastic thermostat or barostat.

Evaluation of memory effects at phase transitions and during relaxation processes

We propose to describe the dynamics of phase transitions in terms of a nonstationary generalized Langevin equation for the order parameter. By construction, this equation is nonlocal in time, i.e., it involves memory effects whose intensity is governed by a memory kernel. In general, it is a hard task to determine the physical origin and the extent of the memory effects based on the underlying microscopic equations of motion. Therefore we propose to relate the extent of the memory kernel to quantities that are experimentally observed such as the induction time and the duration of the phase transformation process. Using a simple kinematic model, we show that the extent of the memory kernel is positively correlated with the duration of the transition, and that it is of the same order of magnitude, while the distribution of induction times does not have an effect on the memory kernel. This observation is tested at the example of several model systems, for which we have run computer simulations: a modified Potts model, a dipole gas, an anharmonic spring in a bath, and a nucleation problem. All these cases are shown to be consistent with the simple theoretical model.