Leveraging deep learning to control neural oscillators

Optimal control for stochastic neural oscillators

This study develops an event-based, energy-efficient control strategy for desynchronizing coupled neuronal networks using optimal control theory. Inspired by phase resetting techniques in Parkinson's disease treatment, we incorporate stochasticity of the system's dynamics into deterministic models to address neural system intrinsic noise. We use an advanced computational solver for nonlinear stochastic partial differential equations to solve the stochastic Hamilton-Jacobi-Bellman equation via level set methods for a single neuron model; this allows us to find control inputs which drive the dynamics close to the system's phaseless set. When applied to coupled neuronal networks, these inputs achieve effective randomization of neuronal spike timing, leading to significant network desynchronization. Compared to its deterministic counterpart, our stochastic method can achieve considerable energy savings. The event-based control minimizes unnecessary charge transfer, potentially extending implanted stimulator battery life while maintaining robustness against variations in neuronal coupling strengths and network heterogeneities. These findings highlight the potential for developing energy-efficient neurostimulation techniques with implications for deep brain stimulation protocols. The presented computational framework could also be applied to other domains for which stochastic optimal control problems are prevalent.

Data-driven control of oscillator networks with population-level measurement

Controlling complex networks of nonlinear limit-cycle oscillators is an important problem pertinent to various applications in engineering and natural sciences. While in recent years the control of oscillator populations with comprehensive biophysical models or simplified models, e.g., phase models, has seen notable advances, learning appropriate controls directly from data without prior model assumptions or pre-existing data remains a challenging and less developed area of research. In this paper, we address this problem by leveraging the network's current dynamics to iteratively learn an appropriate control online without constructing a global model of the system. We illustrate through a range of numerical simulations that the proposed technique can effectively regulate synchrony in various oscillator networks after a small number of trials using only one input and one noisy population-level output measurement. We provide a theoretical analysis of our approach, illustrate its robustness to system variations, and compare its performance with existing model-based and data-driven approaches.

A feasibility study on AI-controlled closed-loop electrical stimulation implants

Miniaturized electrical stimulation (ES) implants show great promise in practice, but their real-time control by means of biophysical mechanistic algorithms is not feasible due to computational complexity. Here, we study the feasibility of more computationally efficient machine learning methods to control ES implants. For this, we estimate the normalized twitch force of the stimulated extensor digitorum longus muscle on n = 11 Wistar rats with intra- and cross-subject calibration. After 2000 training stimulations, we reach a mean absolute error of 0.03 in an intra-subject setting and 0.2 in a cross-subject setting with a random forest regressor. To the best of our knowledge, this work is the first experiment showing the feasibility of AI to simulate complex ES mechanistic models. However, the results of cross-subject training motivate more research on error reduction methods for this setting.