Isostable reduction of oscillators with piecewise smooth dynamics and complex Floquet multipliers

Phase and amplitude responses for delay equations using harmonic balance

Robust delay induced oscillations, common in nature, are often modeled by delay-differential equations (DDEs). Motivated by the success of phase-amplitude reductions for ordinary differential equations with limit cycle oscillations, there is now a growing interest in the development of analogous approaches for DDEs to understand their response to external forcing. When combined with Floquet theory, the fundamental quantities for this reduction are phase and amplitude response functions. Here, we develop a framework for their construction that utilizes the method of harmonic balance.

Insights into oscillator network dynamics using a phase-isostable framework

Networks of coupled nonlinear oscillators can display a wide range of emergent behaviors under the variation of the strength of the coupling. Network equations for pairs of coupled oscillators where the dynamics of each node is described by the evolution of its phase and slowest decaying isostable coordinate have previously been shown to capture bifurcations and dynamics of the network, which cannot be explained through standard phase reduction. An alternative framework using isostable coordinates to obtain higher-order phase reductions has also demonstrated a similar descriptive ability for two oscillators. In this work, we consider the phase-isostable network equations for an arbitrary but finite number of identical coupled oscillators, obtaining conditions required for the stability of phase-locked states including synchrony. For the mean-field complex Ginzburg-Landau equation where the solutions of the full system are known, we compare the accuracy of the phase-isostable network equations and higher-order phase reductions in capturing bifurcations of phase-locked states. We find the former to be the more accurate and, therefore, employ this to investigate the dynamics of globally linearly coupled networks of Morris-Lecar neuron models (both two and many nodes). We observe qualitative correspondence between results from numerical simulations of the full system and the phase-isostable description demonstrating that in both small and large networks, the phase-isostable framework is able to capture dynamics that the first-order phase description cannot.

Variational and phase response analysis for limit cycles with hard boundaries, with applications to neuromechanical control problems

Motor systems show an overall robustness, but because they are highly nonlinear, understanding how they achieve robustness is difficult. In many rhythmic systems, robustness against perturbations involves response of both the shape and the timing of the trajectory. This makes the study of robustness even more challenging. To understand how a motor system produces robust behaviors in a variable environment, we consider a neuromechanical model of motor patterns in the feeding apparatus of the marine mollusk Aplysia californica (Shaw et al. in J Comput Neurosci 38(1):25-51, 2015; Lyttle et al. in Biol Cybern 111(1):25-47, 2017). We established in (Wang et al. in SIAM J Appl Dyn Syst 20(2):701-744, 2021. https://doi.org/10.1137/20M1344974 ) the tools for studying combined shape and timing responses of limit cycle systems under sustained perturbations and here apply them to study robustness of the neuromechanical model against increased mechanical load during swallowing. Interestingly, we discover that nonlinear biomechanical properties confer resilience by immediately increasing resistance to applied loads. In contrast, the effect of changed sensory feedback signal is significantly delayed by the firing rates' hard boundary properties. Our analysis suggests that sensory feedback contributes to robustness in swallowing primarily by shifting the timing of neural activation involved in the power stroke of the motor cycle (retraction). This effect enables the system to generate stronger retractor muscle forces to compensate for the increased load, and hence achieve strong robustness. The approaches that we are applying to understanding a neuromechanical model in Aplysia, and the results that we have obtained, are likely to provide insights into the function of other motor systems that encounter changing mechanical loads and hard boundaries, both due to mechanical and neuronal firing properties.

Interspike interval correlations in neuron models with adaptation and correlated noise

The generation of neural action potentials (spikes) is random but nevertheless may result in a rich statistical structure of the spike sequence. In particular, contrary to the popular renewal assumption of theoreticians, the intervals between adjacent spikes are often correlated. Experimentally, different patterns of interspike-interval correlations have been observed and computational studies have identified spike-frequency adaptation and correlated noise as the two main mechanisms that can lead to such correlations. Analytical studies have focused on the single cases of either correlated (colored) noise or adaptation currents in combination with uncorrelated (white) noise. For low-pass filtered noise or adaptation, the serial correlation coefficient can be approximated as a single geometric sequence of the lag between the intervals, providing an explanation for some of the experimentally observed patterns. Here we address the problem of interval correlations for a widely used class of models, multidimensional integrate-and-fire neurons subject to a combination of colored and white noise sources and a spike-triggered adaptation current. Assuming weak noise, we derive a simple formula for the serial correlation coefficient, a sum of two geometric sequences, which accounts for a large class of correlation patterns. The theory is confirmed by means of numerical simulations in a number of special cases including the leaky, quadratic, and generalized integrate-and-fire models with colored noise and spike-frequency adaptation. Furthermore we study the case in which the adaptation current and the colored noise share the same time scale, corresponding to a slow stochastic population of adaptation channels; we demonstrate that our theory can account for a nonmonotonic dependence of the correlation coefficient on the channel's time scale. Another application of the theory is a neuron driven by network-noise-like fluctuations (green noise). We also discuss the range of validity of our weak-noise theory and show that by changing the relative strength of white and colored noise sources, we can change the sign of the correlation coefficient. Finally, we apply our theory to a conductance-based model which demonstrates its broad applicability.

Exploiting circadian memory to hasten recovery from circadian misalignment

Recent years have seen a sustained interest in the development of circadian reentrainment strategies to limit the deleterious effects of jet lag. Due to the dynamical complexity of many circadian models, phase-based model reduction techniques are often an imperative first step in the analysis. However, amplitude coordinates that capture lingering effects (i.e., memory) from past inputs are often neglected. In this work, we focus on these amplitude coordinates using an operational phase and an isostable coordinate framework in the context of the development of jet-lag amelioration strategies. By accounting for the influence of circadian memory, we identify a latent phase shift that can prime one's circadian cycle to reentrain more rapidly to an expected time-zone shift. A subsequent optimal control problem is proposed that balances the trade-off between control effort and the resulting latent phase shift. Data-driven model identification techniques for the inference of necessary reduced order, phase-amplitude-based models are considered in situations where the underlying model equations are unknown, and numerical results are illustrated in both a simple planar model and in a coupled population of circadian oscillators.

Data-driven phase-isostable reduction for optimal nonfeedback stabilization of cardiac alternans

Phase-isostable reduction is an emerging model reduction strategy that can be used to accurately replicate nonlinear behaviors in systems for which standard phase reduction techniques fail. In this work, we derive relationships between the cycle-to-cycle variance of the reduced isostable coordinates for systems subject to both additive white noise and periodic stimulation. Using this information, we propose a data-driven technique for inferring nonlinear terms of the phase-isostable coordinate reduction framework. We apply the proposed model inference strategy to the biologically motivated problem of eliminating cardiac alternans, an arrhythmia that is widely considered to be a precursor to more deadly cardiac arrhythmias. Using this strategy, by simply measuring a series of action potential durations in response to periodic stimulation, we are able to identify energy-optimal, nonfeedback control inputs to stabilize a period-1, alternans-free solution.

Data-driven inference of high-accuracy isostable-based dynamical models in response to external inputs

Isostable reduction is a powerful technique that can be used to characterize behaviors of nonlinear dynamical systems using a basis of slowly decaying eigenfunctions of the Koopman operator. When the underlying dynamical equations are known, previously developed numerical techniques allow for high-order accuracy computation of isostable reduced models. However, in situations where the dynamical equations are unknown, few general techniques are available that provide reliable estimates of the isostable reduced equations, especially in applications where large magnitude inputs are considered. In this work, a purely data-driven inference strategy yielding high-accuracy isostable reduced models is developed for dynamical systems with a fixed point attractor. By analyzing steady-state outputs of nonlinear systems in response to sinusoidal forcing, both isostable response functions and isostable-to-output relationships can be estimated to arbitrary accuracy in an expansion performed in the isostable coordinates. Detailed examples are considered for a population of synaptically coupled neurons and for the one-dimensional Burgers' equation. While linear estimates of the isostable response functions are sufficient to characterize the dynamical behavior when small magnitude inputs are considered, the high-accuracy reduced order model inference strategy proposed here is essential when considering large magnitude inputs.

Degenerate isostable reduction for fixed-point and limit-cycle attractors with defective linearizations

Isostable coordinates provide a convenient framework for understanding the transient behavior of dynamical systems with stable attractors. These isostable coordinates are often used to characterize the slowest decaying eigenfunctions of the Koopman operator; by neglecting the rapidly decaying Koopman eigenfunctions a reduced order model can be obtained. Existing work has focused primarily on nondegenerate isostable coordinates, that is, isostable coordinates that are associated with eigenvalues that have identical algebraic and geometric multiplicities. Current isostable reduction methods cannot be applied to characterize the decay associated with a defective eigenvalue. In this work, a degenerate isostable framework is proposed for use when eigenvalues are defective. These degenerate isostable coordinates are investigated in the context of various reduced order modeling frameworks that retain many of the important properties of standard (nondegenerate) isostable reduced modeling strategies. Reduced order modeling examples that require the use of degenerate isostable coordinates are presented with relevance to both circadian physiology and nonlinear fluid flows.

Analysis of input-induced oscillations using the isostable coordinate framework

Many reduced order modeling techniques for oscillatory dynamical systems are only applicable when the underlying system admits a stable periodic orbit in the absence of input. By contrast, very few reduction frameworks can be applied when the oscillations themselves are induced by coupling or other exogenous inputs. In this work, the behavior of such input-induced oscillations is considered. By leveraging the isostable coordinate framework, a high-accuracy reduced set of equations can be identified and used to predict coupling-induced bifurcations that precipitate stable oscillations. Subsequent analysis is performed to predict the steady state phase-locking relationships. Input-induced oscillations are considered for two classes of coupled dynamical systems. For the first, stable fixed points of systems with parameters near Hopf bifurcations are considered so that the salient dynamical features can be captured using an asymptotic expansion of the isostable coordinate dynamics. For the second, an adaptive phase-amplitude reduction framework is used to analyze input-induced oscillations that emerge in excitable systems. Examples with relevance to circadian and neural physiology are provided that highlight the utility of the proposed techniques.

Shape versus timing: linear responses of a limit cycle with hard boundaries under instantaneous and static perturbation

When dynamical systems that produce rhythmic behaviors operate within hard limits, they may exhibit limit cycles with sliding components, that is, closed isolated periodic orbits that make and break contact with a constraint surface. Examples include heel-ground interaction in locomotion, firing rate rectification in neural networks, and stick-slip oscillators. In many rhythmic systems, robustness against external perturbations involves response of both the shape and the timing of the limit cycle trajectory. The existing methods of infinitesimal phase response curve (iPRC) and variational analysis are well established for quantifying changes in timing and shape, respectively, for smooth systems. These tools have recently been extended to nonsmooth dynamics with transversal crossing boundaries. In this work, we further extend the iPRC method to nonsmooth systems with sliding components, which enables us to make predictions about the synchronization properties of weakly coupled stick-slip oscillators. We observe a new feature of the isochrons in a planar limit cycle with hard sliding boundaries: a nonsmooth kink in the asymptotic phase function, originating from the point at which the limit cycle smoothly departs the constraint surface, and propagating away from the hard boundary into the interior of the domain. Moreover, the classical variational analysis neglects timing information and is restricted to instantaneous perturbations. By defining the "infinitesimal shape response curve" (iSRC), we incorporate timing sensitivity of an oscillator to describe the shape response of this oscillator to parametric perturbations. In order to extract timing information, we also develop a "local timing response curve" (lTRC) that measures the timing sensitivity of a limit cycle within any given region. We demonstrate in a specific example that taking into account local timing sensitivity in a nonsmooth system greatly improves the accuracy of the iSRC over global timing analysis given by the iPRC.

Optimal open-loop desynchronization of neural oscillator populations

Deep brain stimulation (DBS) is an increasingly used medical treatment for various neurological disorders. While its mechanisms are not fully understood, experimental evidence suggests that through application of periodic electrical stimulation DBS may act to desynchronize pathologically synchronized populations of neurons resulting desirable changes to a larger brain circuit. However, the underlying mathematical mechanisms by which periodic stimulation can engender desynchronization in a coupled population of neurons is not well understood. In this work, a reduced phase-amplitude reduction framework is used to characterize the desynchronizing influence of periodic stimulation on a population of coupled oscillators. Subsequently, optimal control theory allows for the design of periodic, open-loop stimuli with the capacity to destabilize completely synchronized solutions while simultaneously stabilizing rotating block solutions. This framework exploits system nonlinearities in order to strategically modify unstable Floquet exponents. In the limit of weak neural coupling, it is shown that this method only requires information about the phase response curves of the individual neurons. The effects of noise and heterogeneity are also considered and numerical results are presented. This framework could ultimately be used to inform the design of more efficient deep brain stimulation waveforms for the treatment of neurological disease.

Stabilization of Weakly Unstable Fixed Points as a Common Dynamical Mechanism of High-Frequency Electrical Stimulation

While high-frequency electrical stimulation often used to treat various biological diseases, it is generally difficult to understand its dynamical mechanisms of action. In this work, high-frequency electrical stimulation is considered in the context of neurological and cardiological systems. Despite inherent differences between these systems, results from both theory and computational modeling suggest identical dynamical mechanisms responsible for desirable qualitative changes in behavior in response to high-frequency stimuli. Specifically, desynchronization observed in a population of periodically firing neurons and reversible conduction block that occurs in cardiomyocytes both result from bifurcations engendered by stimulation that modifies the stability of unstable fixed points. Using a reduced order phase-amplitude modeling framework, this phenomenon is described in detail from a theoretical perspective. Results are consistent with and provide additional insight for previously published experimental observations. Also, it is found that sinusoidal input is energy-optimal for modifying the stability of weakly unstable fixed points using periodic stimulation.

Phase-amplitude reduction far beyond the weakly perturbed paradigm

While phase reduction is a well-established technique for the analysis of perturbed limit cycle oscillators, practical application requires perturbations to be sufficiently weak thereby limiting its utility in many situations. Here, a general strategy is developed for constructing a set of phase-amplitude reduced equations that is valid to arbitrary orders of accuracy in the amplitude coordinates. This reduction framework can be used to investigate the behavior of oscillatory dynamical systems far beyond the weakly perturbed paradigm. Additionally, a patchwork phase-amplitude reduction method is suggested that is useful when exceedingly large magnitude perturbations are considered. This patchwork method incorporates the high-accuracy phase-amplitude reductions of multiple nearby periodic orbits that result from modifications to nominal parameters. The proposed method of high-accuracy phase-amplitude reduction can be readily implemented numerically and examples are provided where reductions are computed up to fourteenth order accuracy.

A data-driven phase and isostable reduced modeling framework for oscillatory dynamical systems

Phase-amplitude reduction is of growing interest as a strategy for the reduction and analysis of oscillatory dynamical systems. Augmentation of the widely studied phase reduction with amplitude coordinates can be used to characterize transient behavior in directions transverse to a limit cycle to give a richer description of the dynamical behavior. Various definitions for amplitude coordinates have been suggested, but none are particularly well suited for implementation in experimental systems where output recordings are readily available but the underlying equations are typically unknown. In this work, a reduction framework is developed for inferring a phase-amplitude reduced model using only the observed model output from an arbitrarily high-dimensional system. This framework employs a proper orthogonal reduction strategy to identify important features of the transient decay of solutions to the limit cycle. These features are explicitly related to previously developed phase and isostable coordinates and used to define so-called data-driven phase and isostable coordinates that are valid in the entire basin of attraction of a limit cycle. The utility of this reduction strategy is illustrated in examples related to neural physiology and is used to implement an optimal control strategy that would otherwise be computationally intractable. The proposed data-driven phase and isostable coordinate system and associated reduced modeling framework represent a useful tool for the study of nonlinear dynamical systems in situations where the underlying dynamical equations are unknown and in particularly high-dimensional or complicated numerical systems for which standard phase-amplitude reduction techniques are not computationally feasible.

Recent advances in coupled oscillator theory

We review the theory of weakly coupled oscillators for smooth systems. We then examine situations where application of the standard theory falls short and illustrate how it can be extended. Specific examples are given to non-smooth systems with applications to the Izhikevich neuron. We then introduce the idea of isostable reduction to explore behaviours that the weak coupling paradigm cannot explain. In an additional example, we show how bifurcations that change the stability of phase-locked solutions in a pair of identical coupled neurons can be understood using the notion of isostable reduction. This article is part of the theme issue 'Coupling functions: dynamical interaction mechanisms in the physical, biological and social sciences'.

Phase Models Beyond Weak Coupling

We use the theory of isostable reduction to incorporate higher order effects that are lost in the first order phase reduction of coupled oscillators. We apply this theory to weakly coupled complex Ginzburg-Landau equations, a pair of conductance-based neural models, and finally to a short derivation of the Kuramoto-Sivashinsky equations. Numerical and analytical examples illustrate bifurcations occurring in coupled oscillator networks that can cause standard phase-reduction methods to fail.

Synchronization of Electrically Coupled Resonate-and-Fire Neurons

Electrical coupling between neurons is broadly present across brain areas and is typically assumed to synchronize network activity. However, intrinsic properties of the coupled cells can complicate this simple picture. Many cell types with electrical coupling show a diversity of post-spike subthreshold fluctuations, often linked to subthreshold resonance, which are transmitted through electrical synapses in addition to action potentials. Using the theory of weakly coupled oscillators, we explore the effect of both subthreshold and spike-mediated coupling on synchrony in small networks of electrically coupled resonate-and-fire neurons, a hybrid neuron model with damped subthreshold oscillations and a range of post-spike voltage dynamics. We calculate the phase response curve using an extension of the adjoint method that accounts for the discontinuous post-spike reset rule. We find that both spikes and subthreshold fluctuations can jointly promote synchronization. The subthreshold contribution is strongest when the voltage exhibits a significant post-spike elevation in voltage, or plateau potential. Additionally, we show that the geometry of trajectories approaching the spiking threshold causes a "reset-induced shear" effect that can oppose synchrony in the presence of network asymmetry, despite having no effect on the phase-locking of symmetrically coupled pairs.