Essential information: Uncertainty and optimal control of Ebola outbreaks

Characterising information gains and losses when collecting multiple epidemic model outputs

BACKGROUND

Collaborative comparisons and combinations of epidemic models are used as policy-relevant evidence during epidemic outbreaks. In the process of collecting multiple model projections, such collaborations may gain or lose relevant information. Typically, modellers contribute a probabilistic summary at each time-step. We compared this to directly collecting simulated trajectories. We aimed to explore information on key epidemic quantities; ensemble uncertainty; and performance against data, investigating potential to continuously gain information from a single cross-sectional collection of model results.

METHODS

We compared projections from the European COVID-19 Scenario Modelling Hub. Five teams modelled incidence in Belgium, the Netherlands, and Spain. We compared July 2022 projections by incidence, peaks, and cumulative totals. We created a probabilistic ensemble drawn from all trajectories, and compared to ensembles from a median across each model's quantiles, or a linear opinion pool. We measured the predictive accuracy of individual trajectories against observations, using this in a weighted ensemble. We repeated this sequentially against increasing weeks of observed data. We evaluated these ensembles to reflect performance with varying observed data.

RESULTS

By collecting modelled trajectories, we showed policy-relevant epidemic characteristics. Trajectories contained a right-skewed distribution well represented by an ensemble of trajectories or a linear opinion pool, but not models' quantile intervals. Ensembles weighted by performance typically retained the range of plausible incidence over time, and in some cases narrowed this by excluding some epidemic shapes.

CONCLUSIONS

We observed several information gains from collecting modelled trajectories rather than quantile distributions, including potential for continuously updated information from a single model collection. The value of information gains and losses may vary with each collaborative effort's aims, depending on the needs of projection users. Understanding the differing information potential of methods to collect model projections can support the accuracy, sustainability, and communication of collaborative infectious disease modelling efforts.

When do we need multiple infectious disease models? Agreement between projection rank and magnitude in a multi-model setting

Mathematical models are useful for public health planning and response to infectious disease threats. However, different models can provide differing results, which can hamper decision making if not synthesized appropriately. To address this challenge, multi-model hubs convene independent modeling groups to generate ensembles, known to provide more accurate predictions of future outcomes. Yet, these hubs are resource intensive, and how many models are sufficient in a hub is not known. Here, we compare the benefit of predictions from multiple models in different contexts: (1) decision settings that depend on predictions of quantitative outcomes (e.g., hospital capacity planning), where assessments of the benefits of multi-model ensembles have largely focused; and (2) decisions settings that require the ranking of alternative epidemic scenarios (e.g., comparing outcomes under multiple possible interventions and biological uncertainties). We develop a mathematical framework to mimic a multi-model prediction setting, and use this framework to quantify how frequently predictions from different models agree. We further explore multi-model agreement using real-world, empirical data from 14 rounds of U.S. COVID-19 Scenario Modeling Hub projections. Our results suggest that the value of multiple models could be different in different decision contexts, and if only a few models are available, focusing on the rank of alternative epidemic scenarios could be more robust than focusing on quantitative outcomes. Although additional exploration of the sufficient number of models for different contexts is still needed, our results indicate that it may be possible to identify decision contexts where it is robust to rely on fewer models, a finding that can inform the use of modeling resources during future public health crises.

Optimizing two-dose vaccine resource allocation to combat a pandemic in the context of limited supply: The case of COVID-19

The adequate vaccination is a promising solution to mitigate the enormous socio-economic costs of the ongoing COVID-19 pandemic and allow us to return to normal pre-pandemic activity patterns. However, the vaccine supply shortage will be inevitable during the early stage of the vaccine rollout. Public health authorities face a crucial challenge in allocating scarce vaccines to maximize the benefits of vaccination. In this paper, we study a multi-period two-dose vaccine allocation problem when the vaccine supply is highly limited. To address this problem, we constructed a novel age-structured compartmental model to capture COVID-19 transmission and formulated as a nonlinear programming (NLP) model to minimize the total number of deaths in the population. In the NLP model, we explicitly take into account the two-dose vaccination procedure and several important epidemiologic features of COVID-19, such as pre-symptomatic and asymptomatic transmission, as well as group heterogeneity in susceptibility, symptom rates, severity, etc. We validated the applicability of the proposed model using a real case of the 2021 COVID-19 vaccination campaign in the Midlands of England. We conducted comparative studies to demonstrate the superiority of our method. Our numerical results show that prioritizing the allocation of vaccine resources to older age groups is a robust strategy to prevent more subsequent deaths. In addition, we show that releasing more vaccine doses for first-dose recipients could lead to a greater vaccination benefit than holding back second doses. We also find that it is necessary to maintain appropriate non-pharmaceutical interventions (NPIs) during the vaccination rollout, especially in low-resource settings. Furthermore, our analysis indicates that starting vaccination as soon as possible is able to markedly alleviate the epidemic impact when the vaccine resources are limited but are currently available. Our model provides an effective tool to assist policymakers in developing adaptive COVID-19 likewise vaccination strategies for better preparedness against future pandemic threats.

Vote-processing rules for combining control recommendations from multiple models

Mathematical modelling is used during disease outbreaks to compare control interventions. Using multiple models, the best method to combine model recommendations is unclear. Existing methods weight model projections, then rank control interventions using the combined projections, presuming model outputs are directly comparable. However, the way each model represents the epidemiological system will vary. We apply electoral vote-processing rules to combine model-generated rankings of interventions. Combining rankings of interventions, instead of combining model projections, avoids assuming that projections are comparable as all comparisons of projections are made within each model. We investigate four rules: First-past-the-post, Alternative Vote (AV), Coombs Method and Borda Count. We investigate rule sensitivity by including models that favour only one action or including those that rank interventions randomly. We investigate two case studies: the 2014 Ebola outbreak in West Africa (37 compartmental models) and a hypothetical foot-and-mouth disease outbreak in UK (four individual-based models). The Coombs Method was least susceptible to adding models that favoured a single action, Borda Count and AV were most susceptible to adding models that ranked interventions randomly. Each rule chose the same intervention as when ranking interventions by mean projections, suggesting that combining rankings provides similar recommendations with fewer assumptions about model comparability. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.

The forecast trap

Encouraged by decision makers' appetite for future information on topics ranging from elections to pandemics, and enabled by the explosion of data and computational methods, model-based forecasts have garnered increasing influence on a breadth of decisions in modern society. Using several classic examples from fisheries management, I demonstrate that selecting the model or models that produce the most accurate and precise forecast (measured by statistical scores) can sometimes lead to worse outcomes (measured by real-world objectives). This can create a forecast trap, in which the outcomes such as fish biomass or economic yield decline while the manager becomes increasingly convinced that these actions are consistent with the best models and data available. The forecast trap is not unique to this example, but a fundamental consequence of non-uniqueness of models. Existing practices promoting a broader set of models are the best way to avoid the trap.

From Climate Change to Pandemics: Decision Science Can Help Scientists Have Impact

Scientific knowledge and advances are a cornerstone of modern society. They improve our understanding of the world we live in and help us navigate global challenges including emerging infectious diseases, climate change and the biodiversity crisis. However, there is a perpetual challenge in translating scientific insight into policy. Many articles explain how to better bridge the gap through improved communication and engagement, but we believe that communication and engagement are only one part of the puzzle. There is a fundamental tension between science and policy because scientific endeavors are rightfully grounded in discovery, but policymakers formulate problems in terms of objectives, actions and outcomes. Decision science provides a solution by framing scientific questions in a way that is beneficial to policy development, facilitating scientists’ contribution to public discussion and policy. At its core, decision science is a field that aims to pinpoint evidence-based management strategies by focussing on those objectives, actions, and outcomes defined through the policy process. The importance of scientific discovery here is in linking actions to outcomes, helping decision-makers determine which actions best meet their objectives. In this paper we explain how problems can be formulated through the structured decision-making process. We give our vision for what decision science may grow to be, describing current gaps in methodology and application. By better understanding and engaging with the decision-making processes, scientists can have greater impact and make stronger contributions to important societal problems.

Design a robust sliding mode controller based on the state and parameter estimation for the nonlinear epidemiological model of Covid-19

In this research, the challenging problem of Covid-19 mitigation is looked at from an engineering point of view. At first, the behavior of coronavirus in the Iranian and Russian societies is expressed by a set of ordinary differential equations. In the proposed model, the control input signals are vaccination, social distance and facial masks, and medical treatment. The unknown parameters of the system are estimated by long short-term memory (LSTM) algorithm. In the LSTM algorithm, the problem of long-term dependency is prevented. The uncertainty and measurement noises are inherent characteristics of epidemiological models. For this reason, an extended Kalman filter (EKF) is developed to estimate the state variables of the proposed model. In continuation, a robust sliding mode controller is designed to control the spread of coronavirus under vaccination, social distance and facial masks, and medical treatment. The stability of the closed-loop system is guaranteed by the Lyapunov theorems. The official confirmed data provided by the Iranian and Russian ministries of health are employed to simulate the proposed algorithms. It is understood from simulation results that global vaccination has the potential to create herd immunity in long term. Under the proposed controller, daily Covid-19 infections and deaths become less than 500 and 10 people, respectively.

Governance structure affects transboundary disease management under alternative objectives

Background

The development of public health policy is inextricably linked with governance structure. In our increasingly globalized world, human migration and infectious diseases often span multiple administrative jurisdictions that might have different systems of government and divergent management objectives. However, few studies have considered how the allocation of regulatory authority among jurisdictions can affect disease management outcomes.

Methods

Here we evaluate the relative merits of decentralized and centralized management by developing and numerically analyzing a two-jurisdiction SIRS model that explicitly incorporates migration. In our model, managers choose between vaccination, isolation, medication, border closure, and a travel ban on infected individuals while aiming to minimize either the number of cases or the number of deaths.

Results

We consider a variety of scenarios and show how optimal strategies differ for decentralized and centralized management levels. We demonstrate that policies formed in the best interest of individual jurisdictions may not achieve global objectives, and identify situations where locally applied interventions can lead to an overall increase in the numbers of cases and deaths.

Conclusions

Our approach underscores the importance of tailoring disease management plans to existing regulatory structures as part of an evidence-based decision framework. Most importantly, we demonstrate that there needs to be a greater consideration of the degree to which governance structure impacts disease outcomes.

Supplementary Information

The online version contains supplementary material available at (10.1186/s12889-021-11797-3).

Trade-offs between individual and ensemble forecasts of an emerging infectious disease

Probabilistic forecasts play an indispensable role in answering questions about the spread of newly emerged pathogens. However, uncertainties about the epidemiology of emerging pathogens can make it difficult to choose among alternative model structures and assumptions. To assess the potential for uncertainties about emerging pathogens to affect forecasts of their spread, we evaluated the performance 16 forecasting models in the context of the 2015-2016 Zika epidemic in Colombia. Each model featured a different combination of assumptions about human mobility, spatiotemporal variation in transmission potential, and the number of virus introductions. We found that which model assumptions had the most ensemble weight changed through time. We additionally identified a trade-off whereby some individual models outperformed ensemble models early in the epidemic, but on average the ensembles outperformed all individual models. Our results suggest that multiple models spanning uncertainty across alternative assumptions are necessary to obtain robust forecasts for emerging infectious diseases.

Weighing the unknowns: Value of Information for biological and operational uncertainty in invasion management

The management of biological invasions is a worldwide conservation priority. Unfortunately, decision-making on optimal invasion management can be impeded by lack of information about the biological processes that determine invader success (i.e. biological uncertainty) or by uncertainty about the effectiveness of candidate interventions (i.e. operational uncertainty). Concurrent assessment of both sources of uncertainty within the same framework can help to optimize control decisions.Here, we present a Value of Information (VoI) framework to simultaneously analyse the effects of biological and operational uncertainties on management outcomes. We demonstrate this approach with a case study: minimizing the long-term population growth of musk thistle Carduus nutans, a widespread invasive plant, using several insects as biological control agents, including Trichosirocalus horridus, Rhinocyllus conicus and Urophora solstitialis.The ranking of biocontrol agents was sensitive to differences in the target weed's demography and also to differences in the effectiveness of the different biocontrol agents. This finding suggests that accounting for both biological and operational uncertainties is valuable when making management recommendations for invasion control. Furthermore, our VoI analyses show that reduction of all uncertainties across all combinations of demographic model and biocontrol effectiveness explored in the current study would lead, on average, to a 15.6% reduction in musk thistle population growth rate. The specific growth reduction that would be observed in any instance would depend on how the uncertainties actually resolve. Resolving biological uncertainty (across demographic model combinations) or operational uncertainty (across biocontrol effectiveness combinations) alone would reduce expected population growth rate by 8.5% and 10.5% respectively.Synthesis and applications. Our study demonstrates that intervention rank is determined both by biological processes in the targeted invasive populations and by intervention effectiveness. Ignoring either biological uncertainty or operational uncertainty may result in a suboptimal recommendation. Therefore, it is important to simultaneously acknowledge both sources of uncertainty during the decision-making process in invasion management. The framework presented here can accommodate diverse data sources and modelling approaches, and has wide applicability to guide invasive species management and conservation efforts.

State estimation-based control of COVID-19 epidemic before and after vaccine development

In this study, a nonlinear robust control policy is designed together with a state observer in order to manage the novel coronavirus disease (COVID-19) outbreak having an uncertain epidemiological model with unmeasurable variables. This nonlinear model for the COVID-19 epidemic includes eight state variables (susceptible, exposed, infected, quarantined, hospitalized, recovered, deceased, and insusceptible populations). Two plausible scenarios are put forward in this article to control this epidemic before and after its vaccine invention. In the first scenario, the social distancing and hospitalization rates are employed as two applicable control inputs to diminish the exposed and infected groups. However, in the second scenario after the vaccine development, the vaccination rate is taken into account as the third control input to reduce the susceptible populations, in addition to the two objectives of the first scenario. The proposed feedback control measures are defined in terms of the hospitalized and deceased populations due to the available statistical data, while other unmeasurable compartmental variables are estimated by an extended Kalman filter (EKF). In other words, the susceptible, exposed, infected, quarantined, recovered, and insusceptible individuals cannot be identified precisely because of the asymptomatic infection of COVID-19 in some cases, its incubation period, and the lack of an adequate community screening. Utilizing the Lyapunov theorem, the stability and bounded tracking convergence of the closed-loop epidemiological system are investigated in the presence of modeling uncertainties. Finally, a comprehensive simulation study is conducted based on Canada's reported cases for two defined timing plans (with different treatment rates). Obtained results demonstrate that the developed EKF-based control scheme can achieve desired epidemic goals (exponential decrease of infected, exposed, and susceptible people).

A Mathematical Model of Contact Tracing during the 2014–2016 West African Ebola Outbreak

The 2014–2016 West African outbreak of Ebola Virus Disease (EVD) was the largest and most deadly to date. Contact tracing, following up those who may have been infected through contact with an infected individual to prevent secondary spread, plays a vital role in controlling such outbreaks. Our aim in this work was to mechanistically represent the contact tracing process to illustrate potential areas of improvement in managing contact tracing efforts. We also explored the role contact tracing played in eventually ending the outbreak. We present a system of ordinary differential equations to model contact tracing in Sierra Leonne during the outbreak. Using data on cumulative cases and deaths, we estimate most of the parameters in our model. We include the novel features of counting the total number of people being traced and tying this directly to the number of tracers doing this work. Our work highlights the importance of incorporating changing behavior into one’s model as needed when indicated by the data and reported trends. Our results show that a larger contact tracing program would have reduced the death toll of the outbreak. Counting the total number of people being traced and including changes in behavior in our model led to better understanding of disease management.

Rational policymaking during a pandemic

Policymaking during a pandemic can be extremely challenging. As COVID-19 is a new disease and its global impacts are unprecedented, decisions are taken in a highly uncertain, complex, and rapidly changing environment. In such a context, in which human lives and the economy are at stake, we argue that using ideas and constructs from modern decision theory, even informally, will make policymaking a more responsible and transparent process.

Anticipating future learning affects current control decisions: A comparison between passive and active adaptive management in an epidemiological setting

•

Adaptive epidemic control.

•

Using real-time outbreak information to improve epidemic control.

•

Active Adaptive Management in an epidemiological setting.

•

Analysing the interaction between control and monitoring during an epidemic.

Infectious disease epidemics present a difficult task for policymakers, requiring the implementation of control strategies under significant time constraints and uncertainty. Mathematical models can be used to predict the outcome of control interventions, providing useful information to policymakers in the event of such an epidemic. However, these models suffer in the early stages of an outbreak from a lack of accurate, relevant information regarding the dynamics and spread of the disease and the efficacy of control. As such, recommendations provided by these models are often incorporated in an ad hoc fashion, as and when more reliable information becomes available. In this work, we show that such trial-and-error-type approaches to management, which do not formally take into account the resolution of uncertainty and how control actions affect this, can lead to sub-optimal management outcomes. We compare three approaches to managing a theoretical epidemic: a non-adaptive management (AM) approach that does not use real-time outbreak information to adapt control, a passive AM approach that incorporates real-time information if and when it becomes available, and an active AM approach that explicitly incorporates the future resolution of uncertainty through gathering real-time information into its initial recommendations. The structured framework of active AM encourages the specification of quantifiable objectives, models of system behaviour and possible control and monitoring actions, followed by an iterative learning and control phase that is able to employ complex control optimisations and resolve system uncertainty. The result is a management framework that is able to provide dynamic, long-term projections to help policymakers meet the objectives of management. We investigate in detail the effect of different methods of incorporating up-to-date outbreak information. We find that, even in a highly simplified system, the method of incorporating new data can lead to different results that may influence initial policy decisions, with an active AM approach to management providing better information that can lead to more desirable outcomes from an epidemic.

Predictive accuracy of a hierarchical logistic model of cumulative SARS-CoV-2 case growth until May 2020

BACKGROUND

Infectious disease predictions models, including virtually all epidemiological models describing the spread of the SARS-CoV-2 pandemic, are rarely evaluated empirically. The aim of the present study was to investigate the predictive accuracy of a prognostic model for forecasting the development of the cumulative number of reported SARS-CoV-2 cases in countries and administrative regions worldwide until the end of May 2020.

METHODS

The cumulative number of reported SARS-CoV-2 cases was forecasted in 251 regions with a horizon of two weeks, one month, and two months using a hierarchical logistic model at the end of March 2020. Forecasts were compared to actual observations by using a series of evaluation metrics.

RESULTS

On average, predictive accuracy was very high in nearly all regions at the two weeks forecast, high in most regions at the one month forecast, and notable in the majority of the regions at the two months forecast. Higher accuracy was associated with the availability of more data for estimation and with a more pronounced cumulative case growth from the first case to the date of estimation. In some strongly affected regions, cumulative case counts were considerably underestimated.

CONCLUSIONS

With keeping its limitations in mind, the investigated model may be used for the preparation and distribution of resources during the initial phase of epidemics. Future research should primarily address the model's assumptions and its scope of applicability. In addition, establishing a relationship with known mechanisms and traditional epidemiological models of disease transmission would be desirable.

COVID-19 reopening strategies at the county level in the face of uncertainty: Multiple Models for Outbreak Decision Support

Policymakers make decisions about COVID-19 management in the face of considerable uncertainty. We convened multiple modeling teams to evaluate reopening strategies for a mid-sized county in the United States, in a novel process designed to fully express scientific uncertainty while reducing linguistic uncertainty and cognitive biases. For the scenarios considered, the consensus from 17 distinct models was that a second outbreak will occur within 6 months of reopening, unless schools and non-essential workplaces remain closed. Up to half the population could be infected with full workplace reopening; non-essential business closures reduced median cumulative infections by 82%. Intermediate reopening interventions identified no win-win situations; there was a trade-off between public health outcomes and duration of workplace closures. Aggregate results captured twice the uncertainty of individual models, providing a more complete expression of risk for decision-making purposes.

EBOLA OUTBREAKS AND INTERNATIONAL TRAVEL RESTRICTIONS: CASE STUDIES OF CENTRAL AND WEST AFRICA REGIONS

Ebola outbreaks in Africa have occurred mostly in the Central and West Africa regions that are politically identified as the Economic Community of Central African States (ECCAS) and Economic Community of Western African States (ECOWAS), respectively. In the ECOWAS region, people and goods are allowed to travel freely across national borders of all the 15 member countries, but in the ECCAS region such regional travel across the national borders of its 10 member countries is limited. In this paper, we use parameterized mathematical models of Ebola to investigate the effects of free international travel, and the timing of border closings, on the high number of Ebola infection cases and deaths of the recent 2014–2016 Ebola outbreaks in Guinea, Liberia and Sierra Leone (ECOWAS); as compared to previous and current outbreaks in Democratic Republic of Congo (ECCAS, 1976–2018). Simulations of our single-patch Ebola model without movement of humans across international borders are shown to capture the recorded numbers of Ebola infections and deaths in the ECCAS region, and simulations of our 3-patch model with interpatch movements capture that of the ECOWAS region. We obtain that international travel restrictions and timing of border closings can play important roles in mitigating against the spread of future fatal infectious disease outbreaks.

Impacts of environmental and socio-economic factors on emergence and epidemic potential of Ebola in Africa

Recent outbreaks of animal-borne emerging infectious diseases have likely been precipitated by a complex interplay of changing ecological, epidemiological and socio-economic factors. Here, we develop modelling methods that capture elements of each of these factors, to predict the risk of Ebola virus disease (EVD) across time and space. Our modelling results match previously-observed outbreak patterns with high accuracy, and suggest further outbreaks could occur across most of West and Central Africa. Trends in the underlying drivers of EVD risk suggest a 1.75 to 3.2-fold increase in the endemic rate of animal-human viral spill-overs in Africa by 2070, given current modes of healthcare intervention. Future global change scenarios with higher human population growth and lower rates of socio-economic development yield a fourfold higher likelihood of epidemics occurring as a result of spill-over events. Our modelling framework can be used to target interventions designed to reduce epidemic risk for many zoonotic diseases.

Epidemic growth rates and host movement patterns shape management performance for pathogen spillover at the wildlife-livestock interface

Managing pathogen spillover at the wildlife-livestock interface is a key step towards improving global animal health, food security and wildlife conservation. However, predicting the effectiveness of management actions across host-pathogen systems with different life histories is an on-going challenge since data on intervention effectiveness are expensive to collect and results are system-specific. We developed a simulation model to explore how the efficacies of different management strategies vary according to host movement patterns and epidemic growth rates. The model suggested that fast-growing, fast-moving epidemics like avian influenza were best-managed with actions like biosecurity or containment, which limited and localized overall spillover risk. For fast-growing, slower-moving diseases like foot-and-mouth disease, depopulation or prophylactic vaccination were competitive management options. Many actions performed competitively when epidemics grew slowly and host movements were limited, and how management efficacy related to epidemic growth rate or host movement propensity depended on what objective was used to evaluate management performance. This framework offers one means of classifying and prioritizing responses to novel pathogen spillover threats, and evaluating current management actions for pathogens emerging at the wildlife-livestock interface. This article is part of the theme issue 'Dynamic and integrative approaches to understanding pathogen spillover'.

Concurrent assessment of epidemiological and operational uncertainties for optimal outbreak control: Ebola as a case study

Determining how best to manage an infectious disease outbreak may be hindered by both epidemiological uncertainty (i.e. about epidemiological processes) and operational uncertainty (i.e. about the effectiveness of candidate interventions). However, these two uncertainties are rarely addressed concurrently in epidemic studies. We present an approach to simultaneously address both sources of uncertainty, to elucidate which source most impedes decision-making. In the case of the 2014 West African Ebola outbreak, epidemiological uncertainty is represented by a large ensemble of published models. Operational uncertainty about three classes of interventions is assessed for a wide range of potential intervention effectiveness. We ranked each intervention by caseload reduction in each model, initially assuming an unlimited budget as a counterfactual. We then assessed the influence of three candidate cost functions relating intervention effectiveness and cost for different budget levels. The improvement in management outcomes to be gained by resolving uncertainty is generally high in this study; appropriate information gain could reduce expected caseload by more than 50%. The ranking of interventions is jointly determined by the underlying epidemiological process, the effectiveness of the interventions and the size of the budget. An epidemiologically effective intervention might not be optimal if its costs outweigh its epidemiological benefit. Under higher-budget conditions, resolution of epidemiological uncertainty is most valuable. When budgets are tight, however, operational and epidemiological uncertainty are equally important. Overall, our study demonstrates that significant reductions in caseload could result from a careful examination of both epidemiological and operational uncertainties within the same modelling structure. This approach can be applied to decision-making for the management of other diseases for which multiple models and multiple interventions are available.

Resolving the Measurement Uncertainty Paradox in Ecological Management

Ecological management and decision-making typically focus on uncertainty about the future, but surprisingly little is known about how to account for uncertainty of the present: that is, the realities of having only partial or imperfect measurements. Our primary paradigms for handling decisions under uncertainty-the precautionary principle and optimal control-have so far given contradictory results. This paradox is best illustrated in the example of fisheries management, where many ideas that guide thinking about ecological decision-making were first developed. We find that simplistic optimal control approaches have repeatedly concluded that a manager should increase catch quotas when faced with greater uncertainty about the fish biomass. Current best practices take a more precautionary approach, decreasing catch quotas by a fixed amount to account for uncertainty. Using comparisons to both simulated and historical catch data, we find that neither approach is sufficient to avoid stock collapses under moderate observational uncertainty. Using partially observed Markov decision process (POMDP) methods, we demonstrate how this paradox arises from flaws in the standard theory, which contributes to overexploitation of fisheries and increased probability of economic and ecological collapse. In contrast, we find that POMDP-based management avoids such overexploitation while also generating higher economic value. These results have significant implications for how we handle uncertainty in both fisheries and ecological management more generally.

Effect of sexual transmission on the West Africa Ebola outbreak in 2014: a mathematical modelling study

The outbreak of the Ebola virus has resulted in significant morbidity and mortality in the affected areas, and Ebola virus RNA has been found in the semen of the survivors after 9 months of symptom onset. However, the role that sexual transmission played in the transmission is not very clear. In this paper, we developed a compartmental model for Ebola virus disease (EVD) dynamics, which includes three different infectious routes: contact with the infectious, contact with dead bodies, and transmission by sexual behaviour with convalescent survivors. We fitted the model to daily cumulative cases from the first reported infected case to October 25, 2014 for the epidemic in Sierra Leone, Liberia and Guinea. The basic reproduction numbers in these countries were estimated as 1.6726 (95%CI:1.5922–1.7573), 1.8162 (95%CI:1.7660–1.8329) and 1.4873 (95%CI:1.4770–1.4990), respectively. We calculated the contribution of sexual transmission to the basic reproduction number R₀ as 0.1155 (6.9%), 0.0236 (2.8%) and 0.0546 (3.7%) in Sierra Leone, Liberia and Guinea, respectively. Sensitivity analysis shows that the transmission rates caused by contacts with alive patients and sexual activities with convalescent patients have stronger impacts on the R₀. These results suggest that isolating the infectious individuals and advising the recovery men to avoid sexual intercourse are efficient ways for the eradication of endemic EVD.

Uncertainty in malaria simulations in the highlands of Kenya: Relative contributions of model parameter setting, driving climate and initial condition errors

In this study, experiments are conducted to gauge the relative importance of model, initial condition, and driving climate uncertainty for simulations of malaria transmission at a highland plantation in Kericho, Kenya. A genetic algorithm calibrates each of these three factors within their assessed prior uncertainty in turn to see which allows the best fit to a timeseries of confirmed cases. It is shown that for high altitude locations close to the threshold for transmission, the spatial representativeness uncertainty for climate, in particular temperature, dominates the uncertainty due to model parameter settings. Initial condition uncertainty plays little role after the first two years, and is thus important in the early warning system context, but negligible for decadal and climate change investigations. Thus, while reducing uncertainty in the model parameters would improve the quality of the simulations, the uncertainty in the temperature driving data is critical. It is emphasized that this result is a function of the mean climate of the location itself, and it is shown that model uncertainty would be relatively more important at warmer, lower altitude locations.

Optimal treatment allocations in space and time for on-line control of an emerging infectious disease

A key component in controlling the spread of an epidemic is deciding where, when and to whom to apply an intervention. We develop a framework for using data to inform these decisions in realtime. We formalize a treatment allocation strategy as a sequence of functions, one per treatment period, that map up-to-date information on the spread of an infectious disease to a subset of locations where treatment should be allocated. An optimal allocation strategy optimizes some cumulative outcome, e.g. the number of uninfected locations, the geographic footprint of the disease or the cost of the epidemic. Estimation of an optimal allocation strategy for an emerging infectious disease is challenging because spatial proximity induces interference between locations, the number of possible allocations is exponential in the number of locations, and because disease dynamics and intervention effectiveness are unknown at out-break. We derive a Bayesian on-line estimator of the optimal allocation strategy that combines simulation-optimization with Thompson sampling. The estimator proposed performs favourably in simulation experiments. This work is motivated by and illustrated using data on the spread of white nose syndrome, which is a highly fatal infectious disease devastating bat populations in North America.

Real-time decision-making during emergency disease outbreaks

In the event of a new infectious disease outbreak, mathematical and simulation models are commonly used to inform policy by evaluating which control strategies will minimize the impact of the epidemic. In the early stages of such outbreaks, substantial parameter uncertainty may limit the ability of models to provide accurate predictions, and policymakers do not have the luxury of waiting for data to alleviate this state of uncertainty. For policymakers, however, it is the selection of the optimal control intervention in the face of uncertainty, rather than accuracy of model predictions, that is the measure of success that counts. We simulate the process of real-time decision-making by fitting an epidemic model to observed, spatially-explicit, infection data at weekly intervals throughout two historical outbreaks of foot-and-mouth disease, UK in 2001 and Miyazaki, Japan in 2010, and compare forward simulations of the impact of switching to an alternative control intervention at the time point in question. These are compared to policy recommendations generated in hindsight using data from the entire outbreak, thereby comparing the best we could have done at the time with the best we could have done in retrospect. Our results show that the control policy that would have been chosen using all the data is also identified from an early stage in an outbreak using only the available data, despite high variability in projections of epidemic size. Critically, we find that it is an improved understanding of the locations of infected farms, rather than improved estimates of transmission parameters, that drives improved prediction of the relative performance of control interventions. However, the ability to estimate undetected infectious premises is a function of uncertainty in the transmission parameters. Here, we demonstrate the need for both real-time model fitting and generating projections to evaluate alternative control interventions throughout an outbreak. Our results highlight the use of using models at outbreak onset to inform policy and the importance of state-dependent interventions that adapt in response to additional information throughout an outbreak.

Control fast or control smart: When should invading pathogens be controlled?

The intuitive response to an invading pathogen is to start disease management as rapidly as possible, since this would be expected to minimise the future impacts of disease. However, since more spread data become available as an outbreak unfolds, processes underpinning pathogen transmission can almost always be characterised more precisely later in epidemics. This allows the future progression of any outbreak to be forecast more accurately, and so enables control interventions to be targeted more precisely. There is also the chance that the outbreak might die out without any intervention whatsoever, making prophylactic control unnecessary. Optimal decision-making involves continuously balancing these potential benefits of waiting against the possible costs of further spread. We introduce a generic, extensible data-driven algorithm based on parameter estimation and outbreak simulation for making decisions in real-time concerning when and how to control an invading pathogen. The Control Smart Algorithm (CSA) resolves the trade-off between the competing advantages of controlling as soon as possible and controlling later when more information has become available. We show-using a generic mathematical model representing the transmission of a pathogen of agricultural animals or plants through a population of farms or fields-how the CSA allows the timing and level of deployment of vaccination or chemical control to be optimised. In particular, the algorithm outperforms simpler strategies such as intervening when the outbreak size reaches a pre-specified threshold, or controlling when the outbreak has persisted for a threshold length of time. This remains the case even if the simpler methods are fully optimised in advance. Our work highlights the potential benefits of giving careful consideration to the question of when to start disease management during emerging outbreaks, and provides a concrete framework to allow policy-makers to make this decision.