A Bayesian Framework to Identify Type 1 Diabetes Physiological Models Using Easily Accessible Patient Data

Individualized Models for Glucose Prediction in Type 1 Diabetes: Comparing Black-Box Approaches to a Physiological White-Box One

OBJECTIVE

Accurate blood glucose (BG) prediction are key in next-generation tools for type 1 diabetes (T1D) management, such as improved decision support systems and advanced closed-loop control. Glucose prediction algorithms commonly rely on black-box models. Large physiological models, successfully adopted for simulation, were little explored for glucose prediction, mostly because their parameters are hard to individualize. In this work, we develop a BG prediction algorithm based on a personalized physiological model inspired by the UVA/Padova T1D Simulator. Then we compare white-box and advanced black-box personalized prediction techniques.

METHODS

A personalized nonlinear physiological model is identified from patient data through a Bayesian approach based on Markov Chain Monte Carlo technique. The individualized model was integrated within a particle filter (PF) to predict future BG concentrations. The black-box methodologies considered are non-parametric models estimated via gaussian regression (NP), three deep learning methods: long-short-term-memory (LSTM), gated recurrent unit (GRU), temporal convolutional networks (TCN), and a recursive autoregressive with exogenous input model (rARX). BG forecasting performances are assessed for several prediction horizons (PH) on 12 individuals with T1D, monitored in free-living conditions under open-loop therapy for 10 weeks.

RESULTS

NP models provide the most effective BG predictions by achieving a root mean square error (RMSE), RMSE = 18.99 mg/dL, RMSE = 25.72 mg/dL and RMSE = 31.60 mg/dL, significantly outperforming: LSTM, GRU (for PH = 30 minutes), TCN, rARX, and the proposed physiological model for PH=30, 45 and 60 minutes.

CONCLUSIONS

Black-box strategies remain preferable for glucose prediction even when compared to a white-box model with sound physiological structure and individualized parameters.

ReplayBG: A Digital Twin-Based Methodology to Identify a Personalized Model From Type 1 Diabetes Data and Simulate Glucose Concentrations to Assess Alternative Therapies

OBJECTIVE

Design and assessment of new therapies for type 1 diabetes (T1D) management can be greatly facilitated by in silico simulations. The ReplayBG simulation methodology here proposed allows "replaying" the scenario behind data already collected by simulating the glucose concentration obtained in response to alternative insulin/carbohydrate therapies and evaluate their efficacy leveraging the concept of digital twin.

METHODS

ReplayBG is based on two steps. First, a personalized model of glucose-insulin dynamics is identified using insulin, carbohydrate, and continuous glucose monitoring (CGM) data. Then, this model is used to simulate the glucose concentration that would have been obtained by "replaying" the same portion of data using a different therapy. The validity of the methodology was evaluated on 100 virtual subjects using the UVa/Padova T1D Simulator (T1DS). In particular, the glucose concentration traces simulated by ReplayBG are compared with those provided by T1DS in five different scenarios of insulin and carbohydrate treatment modifications. Furthermore, we compared ReplayBG with a state-of-the-art methodology for the scope. Finally, two case studies using real data are also presented.

RESULTS

ReplayBG simulates with high accuracy the effect of the considered insulin and carbohydrate treatment alterations, performing significantly better than state-of-art method in almost all considered situations.

CONCLUSION

ReplayBG proved to be a reliable and robust tool to retrospectively explore the effect of new treatments for T1D on the glucose dynamics. It is freely available as open source software at https://github.com/gcappon/replay-bg.

SIGNIFICANCE

ReplayBG offers a new approach to preliminary evaluate new therapies for T1D management before clinical trials.

Offline Deep Reinforcement Learning and Off-Policy Evaluation for Personalized Basal Insulin Control in Type 1 Diabetes

Recent advancements in hybrid closed-loop systems, also known as the artificial pancreas (AP), have been shown to optimize glucose control and reduce the self-management burdens for people living with type 1 diabetes (T1D). AP systems can adjust the basal infusion rates of insulin pumps, facilitated by real-time communication with continuous glucose monitoring. Deep reinforcement learning (DRL) has introduced new paradigms of basal insulin control algorithms. However, all the existing DRL-based AP controllers require extensive random online interactions between the agent and environment. While this can be validated in T1D simulators, it becomes impractical in real-world clinical settings. To this end, we propose an offline DRL framework that can develop and validate models for basal insulin control entirely offline. It comprises a DRL model based on the twin delayed deep deterministic policy gradient and behavior cloning, as well as off-policy evaluation (OPE) using fitted Q evaluation. We evaluated the proposed framework on an in silico dataset generated by the UVA/Padova T1D simulator, and the OhioT1DM dataset, a real clinical dataset. The performance on the in silico dataset shows that the offline DRL algorithm significantly increased time in range while reducing time below range and time above range for both adult and adolescent groups. Then, we used the OPE to estimate model performance on the clinical dataset, where a notable increase in policy values was observed for each subject. The results demonstrate that the proposed framework is a viable and safe method for improving personalized basal insulin control in T1D.

A Correction Insulin Bolus Delivery Strategy for Decision Support Systems in Type 1 Diabetes

Management of type 1 diabetes (T1D) requires affected individuals to perform multiple daily actions to keep their blood glucose levels within the safe rage and avoid adverse hypo-/hyperglycemic episodes. Decision support systems (DSS) for T1D are composite tools that implement multiple software modules aiming to ease such a burden and to improve glucose control. At the University of Padova, we are developing a new DSS that currently integrate a smart insulin bolus calculator for optimal insulin dosing and a rescue carbohydrate intake advisor to tackle hypoglycemia. However, a module specifically targeting hyperglycemia, that suggests the administration of corrective insulin boluses (CIB), is still missing. For such a scope, this work aims to assess a recent literature methodology, proposed by Aleppo et al., which provides a simple strategy for dealing with hyperglycemia. The methodology is tested retrospectively on clinical data of individuals with T1D. In particular, here we leveraged a novel in silico tool that first identifies a non-linear model of glucose-insulin dynamics on data, then uses such model to simulate and compare the glucose trace obtained by "replaying" the recorded scenario and the glucose trace obtained using the CIB delivery strategy under evaluation. Results show that the CIB delivery strategy significantly reduce the percentage of time spent in hyperglycemia (-15.63%) without inducing any hypoglycemic episode, demonstrating both safety and efficacy of its use. These preliminary results suggest that the CIB delivery strategy proposed by Aleppo et al. is a promising candidate to be included in our system to counteract hyperglycemia. Future work will extensively evaluate the methodology and will compare it against other competing approaches.