Early warning signal reliability varies with COVID-19 waves

Early warning indicators capture catastrophic transitions driven by explicit rates of environmental change

In response to external changes, ecosystems can undergo catastrophic transitions. Early warning indicators aim to predict such transitions based on the phenomenon of critical slowing down at bifurcation points found under a constant environment. When an explicit rate of environmental change is considered, catastrophic transitions can become distinct phenomena from bifurcations, and result from a delayed response to noncatastrophic bifurcations. We use a trophic metacommunity model where transitions in time series and bifurcations of the system are distinct phenomena. We calculate early warning indicators from the time series of the continually changing system and show that they predict not the bifurcation of the underlying system but the actual catastrophic transition driven by the explicit rate of change. Predictions based on the bifurcation structure could miss catastrophic transitions that can still be captured by early warning signals calculated from time series. Our results expand the repertoire of mechanistic models used to anticipate catastrophic transitions to nonequilibrium ecological systems exposed to a constant rate of environmental change.

Application of early warning signs to physiological contexts: a comparison of multivariate indices in patients on long-term hemodialysis

Early warnings signs (EWSs) can anticipate abrupt changes in system state, known as "critical transitions," by detecting dynamic variations, including increases in variance, autocorrelation (AC), and cross-correlation. Numerous EWSs have been proposed; yet no consensus on which perform best exists. Here, we compared 15 multivariate EWSs in time series of 763 hemodialyzed patients, previously shown to present relevant critical transition dynamics. We calculated five EWSs based on AC, six on variance, one on cross-correlation, and three on AC and variance. We assessed their pairwise correlations, trends before death, and mortality predictive power, alone and in combination. Variance-based EWSs showed stronger correlations (r = 0.663 ± 0.222 vs. 0.170 ± 0.205 for AC-based indices) and a steeper increase before death. Two variance-based EWSs yielded HR95 > 9 (HR95 standing for a scale-invariant metric of hazard ratio), but combining them did not improve the area under the receiver-operating curve (AUC) much compared to using them alone (AUC = 0.798 vs. 0.796 and 0.791). Nevertheless, the AUC reached 0.825 when combining 13 indices. While some indicators did not perform overly well alone, their addition to the best performing EWSs increased the predictive power, suggesting that indices combination captures a broader range of dynamic changes occurring within the system. It is unclear whether this added benefit reflects measurement error of a unified phenomenon or heterogeneity in the nature of signals preceding critical transitions. Finally, the modest predictive performance and weak correlations among some indices call into question their validity, at least in this context.

A Low-Cost Early Warning Method for Infectious Diseases with Asymptomatic Carriers

At the beginning of 2023, the Italian former prime minister, the former health minister and 17 others including the current president of the Lombardy region were placed under investigation on suspicion of aggravated culpable epidemic in connection with the government's response at the start of the COVID-19 pandemic. The charges revolve around the failure by authorities to take adequate measures to prevent the spread of the virus in the Bergamo area, which experienced a significant excess of deaths during the initial outbreak. The aim of this paper is to analyse the pandemic data of Italy and the Lombardy region in the first 10 days of the pandemic, spanning from the 24th of February 2020 to the 4th of March 2020. The objective is to determine whether the use of early warning indicators could have facilitated the identification of a critical increase in infections. This identification, in turn, would have enabled the timely formulation of strategies for pandemic containment, thereby reducing the number of deaths. In conclusion, to translate our findings into practical guidelines, we propose a low-cost early warning method for infectious respiratory diseases with asymptomatic carriers.

Anticipating regime shifts by mixing early warning signals from different nodes

Real systems showing regime shifts, such as ecosystems, are often composed of many dynamical elements interacting on a network. Various early warning signals have been proposed for anticipating regime shifts from observed data. However, it is unclear how one should combine early warning signals from different nodes for better performance. Based on theory of stochastic differential equations, we propose a method to optimize the node set from which to construct an early warning signal. The proposed method takes into account that uncertainty as well as the magnitude of the signal affects its predictive performance, that a large magnitude or small uncertainty of the signal in one situation does not imply the signal's high performance, and that combining early warning signals from different nodes is often but not always beneficial. The method performs well particularly when different nodes are subjected to different amounts of dynamical noise and stress.

Early warning signals have limited applicability to empirical lake data

Research aimed at identifying indicators of persistent abrupt shifts in ecological communities, a.k.a regime shifts, has led to the development of a suite of early warning signals (EWSs). As these often perform inaccurately when applied to real-world observational data, it remains unclear whether critical transitions are the dominant mechanism of regime shifts and, if so, which EWS methods can predict them. Here, using multi-trophic planktonic data on multiple lakes from around the world, we classify both lake dynamics and the reliability of classic and second generation EWSs methods to predict whole-ecosystem change. We find few instances of critical transitions, with different trophic levels often expressing different forms of abrupt change. The ability to predict this change is highly processing dependant, with most indicators not performing better than chance, multivariate EWSs being weakly superior to univariate, and a recent machine learning model performing poorly. Our results suggest that predictive ecology should start to move away from the concept of critical transitions, developing methods suitable for predicting resilience loss not limited to the strict bounds of bifurcation theory.

The potential of resilience indicators to anticipate infectious disease outbreaks, a systematic review and guide

To reduce the consequences of infectious disease outbreaks, the timely implementation of public health measures is crucial. Currently used early-warning systems are highly context-dependent and require a long phase of model building. A proposed solution to anticipate the onset or termination of an outbreak is the use of so-called resilience indicators. These indicators are based on the generic theory of critical slowing down and require only incidence time series. Here we assess the potential for this approach to contribute to outbreak anticipation. We systematically reviewed studies that used resilience indicators to predict outbreaks or terminations of epidemics. We identified 37 studies meeting the inclusion criteria: 21 using simulated data and 16 real-world data. 36 out of 37 studies detected significant signs of critical slowing down before a critical transition (i.e., the onset or end of an outbreak), with a highly variable sensitivity (i.e., the proportion of true positive outbreak warnings) ranging from 0.03 to 1 and a lead time ranging from 10 days to 68 months. Challenges include low resolution and limited length of time series, a too rapid increase in cases, and strong seasonal patterns which may hamper the sensitivity of resilience indicators. Alternative types of data, such as Google searches or social media data, have the potential to improve predictions in some cases. Resilience indicators may be useful when the risk of disease outbreaks is changing gradually. This may happen, for instance, when pathogens become increasingly adapted to an environment or evolve gradually to escape immunity. High-resolution monitoring is needed to reach sufficient sensitivity. If those conditions are met, resilience indicators could help improve the current practice of prediction, facilitating timely outbreak response. We provide a step-by-step guide on the use of resilience indicators in infectious disease epidemiology, and guidance on the relevant situations to use this approach.

Understanding the leading indicators of hospital admissions from COVID-19 across successive waves in the UK

Following the end of universal testing in the UK, hospital admissions are a key measure of COVID-19 pandemic pressure. Understanding leading indicators of admissions at the National Health Service (NHS) Trust, regional and national geographies help health services plan for ongoing pressures. We explored the spatio-temporal relationships of leading indicators of hospitalisations across SARS-CoV-2 waves in England. This analysis includes an evaluation of internet search volumes from Google Trends, NHS triage calls and online queries, the NHS COVID-19 app, lateral flow devices (LFDs), and the ZOE app. Data sources were analysed for their feasibility as leading indicators using Granger causality, cross-correlation, and dynamic time warping at fine spatial scales. Google Trends and NHS triages consistently temporally led admissions in most locations, with lead times ranging from 5 to 20 days, whereas an inconsistent relationship was found for the ZOE app, NHS COVID-19 app, and LFD testing, which diminished with spatial resolution, showing cross-correlation of leads between -7 and 7 days. The results indicate that novel surveillance sources can be used effectively to understand the expected healthcare burden within hospital administrative areas though the temporal and spatial heterogeneity of these relationships is a key determinant of their operational public health utility.

Simple methods for early warnings of COVID-19 surges: Lessons learned from 21 months of wastewater and clinical data collection in Detroit, Michigan, United States

Wastewater-based epidemiology (WBE) has drawn great attention since the Coronavirus disease 2019 (COVID-19) pandemic, not only due to its capability to circumvent the limitations of traditional clinical surveillance, but also due to its potential to forewarn fluctuations of disease incidences in communities. One critical application of WBE is to provide "early warnings" for upcoming fluctuations of disease incidences in communities which traditional clinical testing is incapable to achieve. While intricate models have been developed to determine early warnings based on wastewater surveillance data, there is an exigent need for straightforward, rapid, broadly applicable methods for health departments and partner agencies to implement. Our purpose in this study is to develop and evaluate such early-warning methods and clinical-case peak-detection methods based on WBE data to mount an informed public health response. Throughout an extended wastewater surveillance period across Detroit, MI metropolitan area (the entire study period is from September 2020 to May 2022) we designed eight early-warning methods (three real-time and five post-factum). Additionally, we designed three peak-detection methods based on clinical epidemiological data. We demonstrated the utility of these methods for providing early warnings for COVID-19 incidences, with their counterpart accuracies evaluated by hit rates. "Hit rates" were defined as the number of early warning dates (using wastewater surveillance data) that captured defined peaks (using clinical epidemiological data) divided by the total number of early warning dates. Hit rates demonstrated that the accuracy of both real-time and post-factum methods could reach 100 %. Furthermore, the results indicate that the accuracy was influenced by approaches to defining peaks of disease incidence. The proposed methods herein can assist health departments capitalizing on WBE data to assess trends and implement quick public health responses to future epidemics. Besides, this study elucidated critical factors affecting early warnings based on WBE amid the COVID-19 pandemic.

Using digital traces to build prospective and real-time county-level early warning systems to anticipate COVID-19 outbreaks in the United States

Coronavirus disease 2019 (COVID-19) continues to affect the world, and the design of strategies to curb disease outbreaks requires close monitoring of their trajectories. We present machine learning methods that leverage internet-based digital traces to anticipate sharp increases in COVID-19 activity in U.S. counties. In a complementary direction to the efforts led by the Centers for Disease Control and Prevention (CDC), our models are designed to detect the time when an uptrend in COVID-19 activity will occur. Motivated by the need for finer spatial resolution epidemiological insights, we build upon previous efforts conceived at the state level. Our methods-tested in an out-of-sample manner, as events were unfolding, in 97 counties representative of multiple population sizes across the United States-frequently anticipated increases in COVID-19 activity 1 to 6 weeks before local outbreaks, defined when the effective reproduction number R_t becomes larger than 1 for a period of 2 weeks.

An experimental COVID-19 messaging study in a representative sample of the Scottish population: Increasing physical distancing intentions through self-efficacy

OBJECTIVES

Self-efficacy is important for adherence to transmission-reducing behaviours (e.g., physical distancing) as also shown in the CHARIS project. We aimed to show that a theory-based short message can increase physical distancing self-efficacy and intentions to keep physical distance.

DESIGN

Structured telephone surveys with a randomly selected nationally representative sample of adults in Scotland (N = 497).

METHODS

Participants were randomly assigned to one of two experimental conditions: message condition (short message to increase self-efficacy via vicarious experiences, verbal persuasion and emotional arousal) or control condition (no message). Followed by measures for self-efficacy and intention for physical distancing on 4-point scales. Adherence to physical distancing was assessed on a 5-point frequency scale (never - always).

RESULTS

Using mediation analyses with bootstrapping procedures, we first confirmed that self-efficacy was associated indirectly with adherence, via higher intentions in a partial mediation (unstandardized indirect effect .21, 95% CI .18-.25). The message increased self-efficacy; participants receiving the message reported higher self-efficacy (M = 4.23, SD = .80) compared to participants in the control condition (M = 4.08, SD = .77; standardized regression coefficient = .19, p < .05) and self-efficacy affected intention (.48, p < .001). There was a small significant indirect effect of the message on intention via self-efficacy (unstandardized indirect effect .07, CI .01-.14).

CONCLUSIONS

Increasing self-efficacy for physical distancing with a short message can successfully increase intention to physical distance via increased self-efficacy. As both self-efficacy and intentions are important predictors of adherence to transmission-reducing behaviours short messages have potential to limit the spread of COVID-19.

A Bioinformatics Tool for Predicting Future COVID-19 Waves Based on a Retrospective Analysis of the Second Wave in India: Model Development Study

Background

Since the start of the COVID-19 pandemic, health policymakers globally have been attempting to predict an impending wave of COVID-19. India experienced a devastating second wave of COVID-19 in the late first week of May 2021. We retrospectively analyzed the viral genomic sequences and epidemiological data reflecting the emergence and spread of the second wave of COVID-19 in India to construct a prediction model.

Objective

We aimed to develop a bioinformatics tool that can predict an impending COVID-19 wave.

Methods

We analyzed the time series distribution of genomic sequence data for SARS-CoV-2 and correlated it with epidemiological data for new cases and deaths for the corresponding period of the second wave. In addition, we analyzed the phylodynamics of circulating SARS-CoV-2 variants in the Indian population during the study period.

Results

Our prediction analysis showed that the first signs of the arrival of the second wave could be seen by the end of January 2021, about 2 months before its peak in May 2021. By the end of March 2021, it was distinct. B.1.617 lineage variants powered the wave, most notably B.1.617.2 (Delta variant).

Conclusions

Based on the observations of this study, we propose that genomic surveillance of SARS-CoV-2 variants, complemented with epidemiological data, can be a promising tool to predict impending COVID-19 waves.

Performance of early warning signals for disease re-emergence: A case study on COVID-19 data

Developing measures for rapid and early detection of disease re-emergence is important to perform science-based risk assessment of epidemic threats. In the past few years, several early warning signals (EWS) from complex systems theory have been introduced to detect impending critical transitions and extend the set of indicators. However, it is still debated whether they are generically applicable or potentially sensitive to some dynamical characteristics such as system noise and rates of approach to critical parameter values. Moreover, testing on empirical data has, so far, been limited. Hence, verifying EWS performance remains a challenge. In this study, we tackle this question by analyzing the performance of common EWS, such as increasing variance and autocorrelation, in detecting the emergence of COVID-19 outbreaks in various countries. Our work illustrates that these EWS might be successful in detecting disease emergence when some basic assumptions are satisfied: a slow forcing through the transitions and not-fat-tailed noise. In uncertain cases, we observe that noise properties or commensurable time scales may obscure the expected early warning signals. Overall, our results suggest that EWS can be useful for active monitoring of epidemic dynamics, but that their performance is sensitive to certain features of the underlying dynamics. Our findings thus pave a connection between theoretical and empirical studies, constituting a further step towards the application of EWS indicators for informing public health policies.