Prediction of Nocturnal Hypoglycemia From Continuous Glucose Monitoring Data in People With Type 1 Diabetes: A Proof-of-Concept Study

Appropriateness and acceptability of continuous glucose monitoring in people with type 1 diabetes at rural first-level hospitals in Malawi: a qualitative study

OBJECTIVES

The purpose of this qualitative study is to describe the acceptability and appropriateness of continuous glucose monitoring (CGM) in people living with type 1 diabetes (PLWT1D) at first-level (district) hospitals in Malawi.

DESIGN

We conducted semistructured qualitative interviews among PLWT1D and healthcare providers participating in the study. Standardised interview guides elicited perspectives on the appropriateness and acceptability of CGM use for PLWT1D and their providers, and provider perspectives on the effectiveness of CGM use in Malawi. Data were coded using Dedoose software and analysed using a thematic approach.

SETTING

First-level hospitals in Neno district, Malawi.

PARTICIPANTS

Participants were part of a randomised controlled trial focused on CGM at first-level hospitals in Neno district, Malawi. Pretrial and post-trial interviews were conducted for participants in the CGM and usual care arms, and one set of interviews was conducted with providers.

RESULTS

Eleven PLWT1D recruited for the CGM randomised controlled trial and five healthcare providers who provided care to participants with T1D were included. Nine PLWT1D were interviewed twice, two were interviewed once. Of the 11 participants with T1D, six were from the CGM arm and five were in usual care arm. Key themes emerged regarding the appropriateness and effectiveness of CGM use in lower resource setting. The four main themes were (a) patient provider relationship, (b) stigma and psychosocial support, (c) device usage and (d) clinical management.

CONCLUSIONS

Participants and healthcare providers reported that CGM use was appropriate and acceptable in the study setting, although the need to support it with health education sessions was highlighted. This research supports the use of CGM as a component of personalised diabetes treatment for PLWT1D in resource constraint settings.

TRIAL REGISTRATION NUMBER

PACTR202102832069874; Post-results.

Bedtime Prediction of Nocturnal Hypoglycemia in Insulin-Treated Type 2 Diabetes Patients

BACKGROUND AND AIMS

Hypoglycemia may lead to anxiety, poor adherence, and hypoglycemia unawareness and is especially a threat during the night in patients with insulin-treated type 2 diabetes (T2D). It would therefore be beneficial to warn patients at risk of hypoglycemia at bedtime so they can react accordingly and avoid the episode. Hence, the aim of the present study was to develop a model for predicting nocturnal hypoglycemia.

METHODS

Continuous glucose monitoring (CGM), mealtime, and insulin data were collected from 67 insulin-treated patients with T2D (NCT01819129). Data were structured into 24-hour periods and labeled as nocturnal hypoglycemia or not depending on whether 15 consecutive minutes were spent below 3.0 mmol/L (54 mg/dL) during the following night. Each period was divided into "last night," "morning," "day," and "evening" for feature extraction purposes, and 72 potential features were extracted for every period. A five-fold cross-validation was used to select features by forward selection and for training and validating a model based on logistic regression.

RESULTS

The prediction model was based on 30 patients with 60/496 periods resulting in nocturnal hypoglycemia. Forward selection revealed that the best features were based on CGM and involved the last value and mean value during the evening, as well as the relative difference in maximum value during the day between the present period and previous periods. The model obtained a mean area under the receiver operating characteristics curve (AUC) of 0.82 with an accuracy of 0.79.

CONCLUSIONS

The model was able to predict nocturnal hypoglycemia with an acceptable accuracy and could therefore prevent such cases.

Machine Learning and Deep Learning Models for Nocturnal High- and Low-Glucose Prediction in Adults with Type 1 Diabetes

Glucose management at night is a major challenge for people with type 1 diabetes (T1D), especially for those managed with multiple daily injections (MDIs). In this study, we developed machine learning (ML) and deep learning (DL) models to predict nocturnal glucose within the target range (3.9-10 mmol/L), above the target range, and below the target range in subjects with T1D managed with MDIs. The models were trained and tested on continuous glucose monitoring data obtained from 380 subjects with T1D. Two DL algorithms-multi-layer perceptron (MLP) and a convolutional neural network (CNN)-as well as two classic ML algorithms, random forest (RF) and gradient boosting trees (GBTs), were applied. The resulting models based on the DL and ML algorithms demonstrated high and similar accuracy in predicting target glucose (F1 metric: 96-98%) and above-target glucose (F1: 93-97%) within a 30 min prediction horizon. Model performance was poorer when predicting low glucose (F1: 80-86%). MLP provided the highest accuracy in low-glucose prediction. The results indicate that both DL (MLP, CNN) and ML (RF, GBTs) algorithms operating CGM data can be used for the simultaneous prediction of nocturnal glucose values within the target, above-target, and below-target ranges in people with T1D managed with MDIs.

Artificial Intelligence and Machine Learning for Improving Glycemic Control in Diabetes: Best Practices, Pitfalls, and Opportunities

OBJECTIVE

Artificial intelligence and machine learning are transforming many fields including medicine. In diabetes, robust biosensing technologies and automated insulin delivery therapies have created a substantial opportunity to improve health. While the number of manuscripts addressing the topic of applying machine learning to diabetes has grown in recent years, there has been a lack of consistency in the methods, metrics, and data used to train and evaluate these algorithms. This manuscript provides consensus guidelines for machine learning practitioners in the field of diabetes, including best practice recommended approaches and warnings about pitfalls to avoid.

METHODS

Algorithmic approaches are reviewed and benefits of different algorithms are discussed including importance of clinical accuracy, explainability, interpretability, and personalization. We review the most common features used in machine learning applications in diabetes glucose control and provide an open-source library of functions for calculating features, as well as a framework for specifying data sets using data sheets. A review of current data sets available for training algorithms is provided as well as an online repository of data sources.

SIGNIFICANCE

These consensus guidelines are designed to improve performance and translatability of new machine learning algorithms developed in the field of diabetes for engineers and data scientists.

Explainable Machine Learning for Real-Time Hypoglycemia and Hyperglycemia Prediction and Personalized Control Recommendations

BACKGROUND

The occurrences of acute complications arising from hypoglycemia and hyperglycemia peak as young adults with type 1 diabetes (T1D) take control of their own care. Continuous glucose monitoring (CGM) devices provide real-time glucose readings enabling users to manage their control proactively. Machine learning algorithms can use CGM data to make ahead-of-time risk predictions and provide insight into an individual's longer term control.

METHODS

We introduce explainable machine learning to make predictions of hypoglycemia (<70 mg/dL) and hyperglycemia (>270 mg/dL) up to 60 minutes ahead of time. We train our models using CGM data from 153 people living with T1D in the CITY (CGM Intervention in Teens and Young Adults With Type 1 Diabetes)survey totaling more than 28 000 days of usage, which we summarize into (short-term, medium-term, and long-term) glucose control features along with demographic information. We use machine learning explanations (SHAP [SHapley Additive exPlanations]) to identify which features have been most important in predicting risk per user.

RESULTS

Machine learning models (XGBoost) show excellent performance at predicting hypoglycemia (area under the receiver operating curve [AUROC]: 0.998, average precision: 0.953) and hyperglycemia (AUROC: 0.989, average precision: 0.931) in comparison with a baseline heuristic and logistic regression model.

CONCLUSIONS

Maximizing model performance for glucose risk prediction and management is crucial to reduce the burden of alarm fatigue on CGM users. Machine learning enables more precise and timely predictions in comparison with baseline models. SHAP helps identify what about a CGM user's glucose control has led to predictions of risk which can be used to reduce their long-term risk of complications.

Combining uncertainty-aware predictive modeling and a bedtime Smart Snack intervention to prevent nocturnal hypoglycemia in people with type 1 diabetes on multiple daily injections

OBJECTIVE

Nocturnal hypoglycemia is a known challenge for people with type 1 diabetes, especially for physically active individuals or those on multiple daily injections. We developed an evidential neural network (ENN) to predict at bedtime the probability and timing of nocturnal hypoglycemia (0-4 vs 4-8 h after bedtime) based on several glucose metrics and physical activity patterns. We utilized these predictions in silico to prescribe bedtime carbohydrates with a Smart Snack intervention specific to the predicted minimum nocturnal glucose and timing of nocturnal hypoglycemia.

MATERIALS AND METHODS

We leveraged free-living datasets collected from 366 individuals from the T1DEXI Study and Glooko. Inputs to the ENN used to model nocturnal hypoglycemia were derived from demographic information, continuous glucose monitoring, and physical activity data. We assessed the accuracy of the ENN using area under the receiver operating curve, and the clinical impact of the Smart Snack intervention through simulations.

RESULTS

The ENN achieved an area under the receiver operating curve of 0.80 and 0.71 to predict nocturnal hypoglycemic events during 0-4 and 4-8 h after bedtime, respectively, outperforming all evaluated baseline methods. Use of the Smart Snack intervention reduced probability of nocturnal hypoglycemia from 23.9 ± 14.1% to 14.0 ± 13.3% and duration from 7.4 ± 7.0% to 2.4 ± 3.3% in silico.

DISCUSSION

Our findings indicate that the ENN-based Smart Snack intervention has the potential to significantly reduce the frequency and duration of nocturnal hypoglycemic events.

CONCLUSION

A decision support system that combines prediction of minimum nocturnal glucose and proactive recommendations for bedtime carbohydrate intake might effectively prevent nocturnal hypoglycemia and reduce the burden of glycemic self-management.

Machine Learning Models for Blood Glucose Level Prediction in Patients With Diabetes Mellitus: Systematic Review and Network Meta-Analysis

BACKGROUND

Machine learning (ML) models provide more choices to patients with diabetes mellitus (DM) to more properly manage blood glucose (BG) levels. However, because of numerous types of ML algorithms, choosing an appropriate model is vitally important.

OBJECTIVE

In a systematic review and network meta-analysis, this study aimed to comprehensively assess the performance of ML models in predicting BG levels. In addition, we assessed ML models used to detect and predict adverse BG (hypoglycemia) events by calculating pooled estimates of sensitivity and specificity.

METHODS

PubMed, Embase, Web of Science, and Institute of Electrical and Electronics Engineers Explore databases were systematically searched for studies on predicting BG levels and predicting or detecting adverse BG events using ML models, from inception to November 2022. Studies that assessed the performance of different ML models in predicting or detecting BG levels or adverse BG events of patients with DM were included. Studies with no derivation or performance metrics of ML models were excluded. The Quality Assessment of Diagnostic Accuracy Studies tool was applied to assess the quality of included studies. Primary outcomes were the relative ranking of ML models for predicting BG levels in different prediction horizons (PHs) and pooled estimates of the sensitivity and specificity of ML models in detecting or predicting adverse BG events.

RESULTS

In total, 46 eligible studies were included for meta-analysis. Regarding ML models for predicting BG levels, the means of the absolute root mean square error (RMSE) in a PH of 15, 30, 45, and 60 minutes were 18.88 (SD 19.71), 21.40 (SD 12.56), 21.27 (SD 5.17), and 30.01 (SD 7.23) mg/dL, respectively. The neural network model (NNM) showed the highest relative performance in different PHs. Furthermore, the pooled estimates of the positive likelihood ratio and the negative likelihood ratio of ML models were 8.3 (95% CI 5.7-12.0) and 0.31 (95% CI 0.22-0.44), respectively, for predicting hypoglycemia and 2.4 (95% CI 1.6-3.7) and 0.37 (95% CI 0.29-0.46), respectively, for detecting hypoglycemia.

CONCLUSIONS

Statistically significant high heterogeneity was detected in all subgroups, with different sources of heterogeneity. For predicting precise BG levels, the RMSE increases with a rise in the PH, and the NNM shows the highest relative performance among all the ML models. Meanwhile, current ML models have sufficient ability to predict adverse BG events, while their ability to detect adverse BG events needs to be enhanced.

TRIAL REGISTRATION

PROSPERO CRD42022375250; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=375250.

Development and Validation of Binary Classifiers to Predict Nocturnal Hypoglycemia in Adults With Type 1 Diabetes

BACKGROUND

One of the biggest challenges for people with type 1 diabetes (T1D) using multiple daily injections (MDIs) is nocturnal hypoglycemia (NH). Recurrent NH can lead to serious complications; hence, prevention is of high importance. In this work, we develop and externally validate, device-agnostic Machine Learning (ML) models to provide bedtime decision support to people with T1D and minimize the risk of NH.

METHODS

We present the design and development of binary classifiers to predict NH (blood glucose levels occurring below 70 mg/dL). Using data collected from a 6-month study of 37 adult participants with T1D under free-living conditions, we extract daytime features from continuous glucose monitor (CGM) sensors, administered insulin, meal, and physical activity information. We use these features to train and test the performance of two ML algorithms: Random Forests (RF) and Support Vector Machines (SVMs). We further evaluate our model in an external population of 20 adults with T1D using MDI insulin therapy and wearing CGM and flash glucose monitoring sensors for two periods of eight weeks each.

RESULTS

At population-level, SVM outperforms RF algorithm with a receiver operating characteristic-area under curve (ROC-AUC) of 79.36% (95% CI: 76.86%, 81.86%). The proposed SVM model generalizes well in an unseen population (ROC-AUC = 77.06%), as well as between the two different glucose sensors (ROC-AUC = 77.74%).

CONCLUSIONS

Our model shows state-of-the-art performance, generalizability, and robustness in sensor devices from different manufacturers. We believe it is a potential viable approach to inform people with T1D about their risk of NH before it occurs.

Data-based modeling for hypoglycemia prediction: Importance, trends, and implications for clinical practice

Background and objective

Hypoglycemia is a key barrier to achieving optimal glycemic control in people with diabetes, which has been proven to cause a set of deleterious outcomes, such as impaired cognition, increased cardiovascular disease, and mortality. Hypoglycemia prediction has come to play a role in diabetes management as big data analysis and machine learning (ML) approaches have become increasingly prevalent in recent years. As a result, a review is needed to summarize the existing prediction algorithms and models to guide better clinical practice in hypoglycemia prevention.

Materials and methods

PubMed, EMBASE, and the Cochrane Library were searched for relevant studies published between 1 January 2015 and 8 December 2022. Five hypoglycemia prediction aspects were covered: real-time hypoglycemia, mild and severe hypoglycemia, nocturnal hypoglycemia, inpatient hypoglycemia, and other hypoglycemia (postprandial, exercise-related).

Results

From the 5,042 records retrieved, we included 79 studies in our analysis. Two major categories of prediction models are identified by an overview of the chosen studies: simple or logistic regression models based on clinical data and data-based ML models (continuous glucose monitoring data is most commonly used). Models utilizing clinical data have identified a variety of risk factors that can lead to hypoglycemic events. Data-driven models based on various techniques such as neural networks, autoregressive, ensemble learning, supervised learning, and mathematical formulas have also revealed suggestive features in cases of hypoglycemia prediction.

Conclusion

In this study, we looked deep into the currently established hypoglycemia prediction models and identified hypoglycemia risk factors from various perspectives, which may provide readers with a better understanding of future trends in this topic.

The behaviour change behind a successful pilot of hypoglycaemia reduction with HYPO-CHEAT

Background

Children with hypoglycaemia disorders, such as congenital hyperinsulinism (CHI), are at constant risk of hypoglycaemia (low blood sugars) with the attendant risk of brain injury. Current approaches to hypoglycaemia detection and prevention vary from fingerprick glucose testing to the provision of continuous glucose monitoring (CGM) to machine learning (ML) driven glucose forecasting. Recent trends for ML have had limited success in preventing free-living hypoglycaemia, due to a focus on increasingly accurate glucose forecasts and a failure to acknowledge the human in the loop and the essential step of changing behaviour. The wealth of evidence from the fields of behaviour change and persuasive technology (PT) allows for the creation of a theory-informed and technologically considered approach.

Objectives

We aimed to create a PT that would overcome the identified barriers to hypoglycaemia prevention for those with CHI to focus on proactive prevention rather than commonly used reactive approaches.

Methods

We used the behaviour change technique taxonomy and persuasive systems design models to create HYPO-CHEAT (HYpoglycaemia-Prevention-thrOugh-Cgm-HEatmap-Assisted-Technology): a novel approach that presents aggregated CGM data in simple visualisations. The resultant ease of data interpretation is intended to facilitate behaviour change and subsequently reduce hypoglycaemia.

Results

HYPO-CHEAT was piloted in 10 patients with CHI over 12 weeks and successfully identified weekly patterns of hypoglycaemia. These patterns consistently correlated with identifiable behaviours and were translated into both a change in proximal fingerprick behaviour and ultimately, a significant reduction in aggregated hypoglycaemia from 7.1% to 5.4% with four out of five patients showing clinically meaningful reductions in hypoglycaemia.

Conclusions

We have provided pilot data of a new approach to hypoglycaemia prevention that focuses on proactive prevention and behaviour change. This approach is personalised for individual patients with CHI and is a first step in changing our approach to hypoglycaemia prevention in this group.

Recent applications of machine learning and deep learning models in the prediction, diagnosis, and management of diabetes: a comprehensive review

Diabetes as a metabolic illness can be characterized by increased amounts of blood glucose. This abnormal increase can lead to critical detriment to the other organs such as the kidneys, eyes, heart, nerves, and blood vessels. Therefore, its prediction, prognosis, and management are essential to prevent harmful effects and also recommend more useful treatments. For these goals, machine learning algorithms have found considerable attention and have been developed successfully. This review surveys the recently proposed machine learning (ML) and deep learning (DL) models for the objectives mentioned earlier. The reported results disclose that the ML and DL algorithms are promising approaches for controlling blood glucose and diabetes. However, they should be improved and employed in large datasets to affirm their applicability.

HYPO-CHEAT's aggregated weekly visualisations of risk reduce real world hypoglycaemia

Background

Children with congenital hyperinsulinism (CHI) are at constant risk of hypoglycaemia with the attendant risk of brain injury. Current hypoglycaemia prevention methods centre on the prediction of a continuous glucose variable using machine learning (ML) processing of continuous glucose monitoring (CGM). This approach ignores repetitive and predictable behavioural factors and is dependent upon ongoing CGM. Thus, there has been very limited success in reducing real-world hypoglycaemia with a ML approach in any condition.

Objectives

We describe the development of HYPO-CHEAT (HYpoglycaemia-Prevention-thrOugh-CGM-HEatmap-Technology), which is designed to overcome these limitations by describing weekly hypoglycaemia risk. We tested HYPO-CHEAT in a real-world setting to evaluate change in hypoglycaemia.

Methods

HYPO-CHEAT aggregates individual CGM data to identify weekly hypoglycaemia patterns. These are visualised via a hypoglycaemia heatmap along with actionable interpretations and targets. The algorithm is iterative and reacts to anticipated changing patterns of hypoglycaemia. HYPO-CHEAT was compared with Dexcom Clarity's pattern identification and Facebook Prophet's forecasting algorithm using data from 10 children with CHI using CGM for 12 weeks. HYPO-CHEAT's efficacy was assessed via change in time below range (TBR).

Results

HYPO-CHEAT identified hypoglycaemia patterns in all patients. Dexcom Clarity identified no patterns. Predictions from Facebook Prophet were inconsistent and difficult to interpret. Importantly, the patterns identified by HYPO-CHEAT matched the lived experience of all patients, generating new and actionable understanding of the cause of hypos. This facilitated patients to significantly reduce their time in hypoglycaemia from 7.1% to 5.4% even when real-time CGM data was removed.

Conclusions

HYPO-CHEAT's personalised hypoglycaemia heatmaps reduced total and targeted TBR even when CGM was reblinded. HYPO-CHEAT offers a highly effective and immediately available personalised approach to prevent hypoglycaemia and empower patients to self-care.

Machine Learning Models for Nocturnal Hypoglycemia Prediction in Hospitalized Patients with Type 1 Diabetes

Nocturnal hypoglycemia (NH) is a dangerous complication of insulin therapy that often goes undetected. In this study, we aimed to generate machine learning (ML)-based models for short-term NH prediction in hospitalized patients with type 1 diabetes (T1D). The models were trained on continuous glucose monitoring (CGM) data obtained from 406 adult patients admitted to a tertiary referral hospital. Eight CGM-derived metrics of glycemic control and glucose variability were included in the models. Combinations of CGM and clinical data (23 parameters) were also assessed. Random Forest (RF), Logistic Linear Regression with Lasso regularization, and Artificial Neuron Networks algorithms were applied. In our models, RF provided the best prediction accuracy with 15 min and 30 min prediction horizons. The addition of clinical parameters slightly improved the prediction accuracy of most models, whereas oversampling and undersampling procedures did not have significant effects. The areas under the curve of the best models based on CGM and clinical data with 15 min and 30 min prediction horizons were 0.97 and 0.942, respectively. Basal insulin dose, diabetes duration, proteinuria, and HbA1c were the most important clinical predictors of NH assessed by RF. In conclusion, ML is a promising approach to personalized prediction of NH in hospitalized patients with T1D.

A Machine Learning Approach to Minimize Nocturnal Hypoglycemic Events in Type 1 Diabetic Patients under Multiple Doses of Insulin

Nocturnal hypoglycemia (NH) is one of the most challenging events for multiple dose insulin therapy (MDI) in people with type 1 diabetes (T1D). The goal of this study is to design a method to reduce the incidence of NH in people with T1D under MDI therapy, providing a decision-support system and improving confidence toward self-management of the disease considering the dataset used by Bertachi et al. Different machine learning (ML) algorithms, data sources, optimization metrics and mitigation measures to predict and avoid NH events have been studied. In addition, we have designed population and personalized models and studied the generalizability of the models and the influence of physical activity (PA) on them. Obtaining 30 g of rescue carbohydrates (CHO) is the optimal value for preventing NH, so it can be asserted that this is the value with which the time under 70 mg/dL decreases the most, with almost a 35% reduction, while increasing the time in the target range by 1.3%. This study supports the feasibility of using ML techniques to address the prediction of NH in patients with T1D under MDI therapy, using continuous glucose monitoring (CGM) and a PA tracker. The results obtained prove that BG predictions can not only be critical in achieving safer diabetes management, but also assist physicians and patients to make better and safer decisions regarding insulin therapy and their day-to-day lives.

Hypoglycaemia detection and prediction techniques: A systematic review on the latest developments

The main objective of diabetes control is to correct hyperglycaemia while avoiding hypoglycaemia, especially in insulin-treated patients. Fear of hypoglycaemia is a hurdle to effective correction of hyperglycaemia because it promotes under-dosing of insulin. Strategies to minimise hypoglycaemia include education and training for improved hypoglycaemia awareness and the development of technologies to allow their early detection and thus minimise their occurrence. Patients with impaired hypoglycaemia awareness would benefit the most from these technologies. The purpose of this systematic review is to review currently available or in-development technologies that support detection of hypoglycaemia or hypoglycaemia risk, and identify gaps in the research. Nanomaterial use in sensors is a promising strategy to increase the accuracy of continuous glucose monitoring devices for low glucose values. Hypoglycaemia is associated with changes on vital signs, so electrocardiogram and encephalogram could also be used to detect hypoglycaemia. Accuracy improvements through multivariable measures can make already marketed galvanic skin response devices a good noninvasive alternative. Breath volatile organic compounds can be detected by dogs and devices and alert patients at hypoglycaemia onset, while near-infrared spectroscopy can also be used as a hypoglycaemia alarms. Finally, one of the main directions of research are deep learning algorithms to analyse continuous glucose monitoring data and provide earlier and more accurate prediction of hypoglycaemia. Current developments for early identification of hypoglycaemia risk combine improvements of available 'needle-type' enzymatic glucose sensors and noninvasive alternatives. Patient usability will be essential to demonstrate to allow their implementation for daily use in diabetes management.

Data-based algorithms and models using diabetics real data for blood glucose and hypoglycaemia prediction - A systematic literature review

BACKGROUND AND AIM

Hypoglycaemia prediction play an important role in diabetes management being able to reduce the number of dangerous situations. Thus, it is relevant to present a systematic review on the currently available prediction algorithms and models for hypoglycaemia (or hypoglycemia in US English) prediction.

METHODS

This study aims to systematically review the literature on data-based algorithms and models using diabetics real data for hypoglycaemia prediction. Five electronic databases were screened for studies published from January 2014 to June 2020: ScienceDirect, IEEE Xplore, ACM Digital Library, SCOPUS, and PubMed.

RESULTS

Sixty-three eligible studies were retrieved that met the inclusion criteria. The review identifies the current trend in this topic: most of the studies perform short-term predictions (82.5%). Also, the review pinpoints the inputs and shows that information fusion is relevant for hypoglycaemia prediction. Regarding data-based models (80.9%) and hybrid models (19.1%) different predictive techniques are used: Artificial neural network (22.2%), ensemble learning (27.0%), supervised learning (20.6%), statistic/probabilistic (7.9%), autoregressive (7.9%), evolutionary (6.4%), deep learning (4.8%) and adaptative filter (3.2%). Artificial Neural networks and hybrid models show better results.

CONCLUSIONS

The data-based models for blood glucose and hypoglycaemia prediction should be able to provide a good balance between the applicability and performance, integrating complementary data from different sources or from different models. This review identifies trends and possible opportunities for research in this topic.

Feature-Based Machine Learning Model for Real-Time Hypoglycemia Prediction

BACKGROUND

Hypoglycemia is a serious health concern in youth with type 1 diabetes (T1D). Real-time data from continuous glucose monitoring (CGM) can be used to predict hypoglycemic risk, allowing patients to take timely intervention measures.

METHODS

A machine learning model is developed for probabilistic prediction of hypoglycemia (<70 mg/dL) in 30- and 60-minute time horizons based on CGM datasets obtained from 112 patients over a range of 90 days consisting of over 1.6 million CGM values under normal living conditions. A comprehensive set of features relevant for hypoglycemia are developed and a parsimonious subset with most influence on predicting hypoglycemic risk is identified. Model performance is evaluated both with and without contextual information on insulin and carbohydrate intake.

RESULTS

The model predicted hypoglycemia with >91% sensitivity for 30- and 60-minute prediction horizons while maintaining specificity >90%. Inclusion of insulin and carbohydrate data yielded performance improvement for 60-minute but not for 30-minute predictions. Model performance was highest for nocturnal hypoglycemia (~95% sensitivity). Shortterm (less than one hour) and medium-term (one to four hours) features for good prediction performance are identified.

CONCLUSIONS

Innovative feature identification facilitated high performance for hypoglycemia risk prediction in pediatric youth with T1D. Timely alerts of impending hypoglycemia may enable proactive measures to avoid severe hypoglycemia and achieve optimal glycemic control. The model will be deployed on a patient-facing smartphone application in an upcoming pilot study.

The demise of islet allotransplantation in the United States: A call for an urgent regulatory update

Islet allotransplantation in the United States (US) is facing an imminent demise. Despite nearly three decades of progress in the field, an archaic regulatory framework has stymied US clinical practice. Current regulations do not reflect the state-of-the-art in clinical or technical practices. In the US, islets are considered biologic drugs and "more than minimally manipulated" human cell and tissue products (HCT/Ps). In contrast, across the world, human islets are appropriately defined as "minimally manipulated tissue" and not regulated as a drug, which has led to islet allotransplantation (allo-ITx) becoming a standard-of-care procedure for selected patients with type 1 diabetes mellitus. This regulatory distinction impedes patient access to islets for transplantation in the US. As a result only 11 patients underwent allo-ITx in the US between 2016 and 2019, and all as investigational procedures in the settings of a clinical trials. Herein, we describe the current regulations pertaining to islet transplantation in the United States. We explore the progress which has been made in the field and demonstrate why the regulatory framework must be updated to both better reflect our current clinical practice and to deal with upcoming challenges. We propose specific updates to current regulations which are required for the renaissance of ethical, safe, effective, and affordable allo-ITx in the United States.

Ability of Current Machine Learning Algorithms to Predict and Detect Hypoglycemia in Patients With Diabetes Mellitus: Meta-analysis

Background

Machine learning (ML) algorithms have been widely introduced to diabetes research including those for the identification of hypoglycemia.

Objective

The objective of this meta-analysis is to assess the current ability of ML algorithms to detect hypoglycemia (ie, alert to hypoglycemia coinciding with its symptoms) or predict hypoglycemia (ie, alert to hypoglycemia before its symptoms have occurred).

Methods

Electronic literature searches (from January 1, 1950, to September 14, 2020) were conducted using the Dialog platform that covers 96 databases of peer-reviewed literature. Included studies had to train the ML algorithm in order to build a model to detect or predict hypoglycemia and test its performance. The set of 2 × 2 data (ie, number of true positives, false positives, true negatives, and false negatives) was pooled with a hierarchical summary receiver operating characteristic model.

Results

A total of 33 studies (14 studies for detecting hypoglycemia and 19 studies for predicting hypoglycemia) were eligible. For detection of hypoglycemia, pooled estimates (95% CI) of sensitivity, specificity, positive likelihood ratio (PLR), and negative likelihood ratio (NLR) were 0.79 (0.75-0.83), 0.80 (0.64-0.91), 8.05 (4.79-13.51), and 0.18 (0.12-0.27), respectively. For prediction of hypoglycemia, pooled estimates (95% CI) were 0.80 (0.72-0.86) for sensitivity, 0.92 (0.87-0.96) for specificity, 10.42 (5.82-18.65) for PLR, and 0.22 (0.15-0.31) for NLR.

Conclusions

Current ML algorithms have insufficient ability to detect ongoing hypoglycemia and considerate ability to predict impeding hypoglycemia in patients with diabetes mellitus using hypoglycemic drugs with regard to diagnostic tests in accordance with the Users’ Guide to Medical Literature (PLR should be ≥5 and NLR should be ≤0.2 for moderate reliability). However, it should be emphasized that the clinical applicability of these ML algorithms should be evaluated according to patients’ risk profiles such as for hypoglycemia and its associated complications (eg, arrhythmia, neuroglycopenia) as well as the average ability of the ML algorithms. Continued research is required to develop more accurate ML algorithms than those that currently exist and to enhance the feasibility of applying ML in clinical settings.

Trial Registration

PROSPERO International Prospective Register of Systematic Reviews CRD42020163682; http://www.crd.york.ac.uk/PROSPERO/display_record.php?ID=CRD42020163682

Machine Learning Techniques for Hypoglycemia Prediction: Trends and Challenges

(1) Background: the use of machine learning techniques for the purpose of anticipating hypoglycemia has increased considerably in the past few years. Hypoglycemia is the drop in blood glucose below critical levels in diabetic patients. This may cause loss of cognitive ability, seizures, and in extreme cases, death. In almost half of all the severe cases, hypoglycemia arrives unannounced and is essentially asymptomatic. The inability of a diabetic patient to anticipate and intervene the occurrence of a hypoglycemic event often results in crisis. Hence, the prediction of hypoglycemia is a vital step in improving the life quality of a diabetic patient. The objective of this paper is to review work performed in the domain of hypoglycemia prediction by using machine learning and also to explore the latest trends and challenges that the researchers face in this area; (2) Methods: literature obtained from PubMed and Google Scholar was reviewed. Manuscripts from the last five years were searched for this purpose. A total of 903 papers were initially selected of which 57 papers were eventually shortlisted for detailed review; (3) Results: a thorough dissection of the shortlisted manuscripts provided an interesting split between the works based on two categories: hypoglycemia prediction and hypoglycemia detection. The entire review was carried out keeping this categorical distinction in perspective while providing a thorough overview of the machine learning approaches used to anticipate hypoglycemia, the type of training data, and the prediction horizon.

Predicting and Preventing Nocturnal Hypoglycemia in Type 1 Diabetes Using Big Data Analytics and Decision Theoretic Analysis

Background: Despite new glucose sensing technologies, nocturnal hypoglycemia is still a problem for people with type 1 diabetes (T1D) as symptoms and sensor alarms may not be detected while sleeping. Accurately predicting nocturnal hypoglycemia before sleep may help minimize nighttime hypoglycemia. Methods: A support vector regression (SVR) model was trained to predict, before bedtime, the overnight minimum glucose and overnight nocturnal hypoglycemia for people with T1D. The algorithm was trained on continuous glucose measurements and insulin data collected from 124 people (22,804 valid nights of data) with T1D. The minimum glucose threshold for announcing nocturnal hypoglycemia risk was derived by applying a decision theoretic criterion to maximize expected net benefit. Accuracy was evaluated on a validation set from 10 people with T1D during a 4-week trial under free-living sensor-augmented insulin-pump therapy. The primary outcome measures were sensitivity and specificity of prediction, the correlation between predicted and actual minimum nocturnal glucose, and root-mean-square error. The impact of using the algorithm to prevent nocturnal hypoglycemia is shown in-silico. Results: The algorithm predicted 94.1% of nocturnal hypoglycemia events (<3.9 mmol/L, 95% confidence interval [CI], 71.3-99.9) with an area under the receiver operating characteristic curve of 0.86 (95% CI, 0.75-0.98). Correlation between actual and predicted minimum glucose was high (R = 0.71, P < 0.001). In-silico simulations showed that the algorithm could reduce nocturnal hypoglycemia by 77.0% (P = 0.006) without impacting time in target range (3.9-10 mmol/L). Conclusion: An SVR model trained on a big data set and optimized using decision theoretic criterion can accurately predict at bedtime if overnight nocturnal hypoglycemia will occur and may help reduce nocturnal hypoglycemia.

Continuous glucose monitoring for hypoglycaemia in children: Perspectives in 2020

Hypoglycaemia in children is a major risk factor for adverse neurodevelopment with rates as high as 50% in hyperinsulinaemic hypoglycaemia (HH). A key part of management relies upon timely identification and treatment of hypoglycaemia. The current standard of care for glucose monitoring is by infrequent fingerprick plasma glucose testing but this carries a high risk of missed hypoglycaemia identification. High-frequency Continuous Glucose Monitoring (CGM) offers an attractive alternative for glucose trend monitoring and glycaemic phenotyping but its utility remains largely unestablished in disorders of hypoglycaemia. Attempts to determine accuracy through correlation with plasma glucose measurements using conventional methods such as Mean Absolute Relative Difference (MARD) overestimate accuracy at hypoglycaemia. The inaccuracy of CGM in true hypoglycaemia is amplified by calibration algorithms that prioritize hyperglycaemia over hypoglycaemia with minimal objective evidence of efficacy in HH. Conversely, alternative algorithm design has significant potential for predicting hypoglycaemia to prevent neuroglycopaenia and consequent brain dysfunction in childhood disorders. Delays in the detection of hypoglycaemia, alarm fatigue, device calibration and current high cost are all barriers to the wider adoption of CGM in disorders of hypoglycaemia. However, machine learning, artificial intelligence and other computer-generated algorithms now offer significant potential for further improvement in CGM device technology and widespread application in childhood hypoglycaemia.

Prediction of Nocturnal Hypoglycemia in Adults with Type 1 Diabetes under Multiple Daily Injections Using Continuous Glucose Monitoring and Physical Activity Monitor

(1) Background: nocturnal hypoglycemia (NH) is one of the most challenging side effects of multiple doses of insulin (MDI) therapy in type 1 diabetes (T1D). This work aimed to investigate the feasibility of a machine-learning-based prediction model to anticipate NH in T1D patients on MDI. (2) Methods: ten T1D adults were studied during 12 weeks. Information regarding T1D management, continuous glucose monitoring (CGM), and from a physical activity tracker were obtained under free-living conditions at home. Supervised machine-learning algorithms were applied to the data, and prediction models were created to forecast the occurrence of NH. Individualized prediction models were generated using multilayer perceptron (MLP) and a support vector machine (SVM). (3) Results: population outcomes indicated that more than 70% of the NH may be avoided with the proposed methodology. The predictions performed by the SVM achieved the best population outcomes, with a sensitivity and specificity of 78.75% and 82.15%, respectively. (4) Conclusions: our study supports the feasibility of using ML techniques to address the prediction of nocturnal hypoglycemia in the daily life of patients with T1D on MDI, using CGM and a physical activity tracker.