Visualization for epidemiological modelling: challenges, solutions, reflections and recommendations

RAMPVIS: A visualization and visual analytics infrastructure for COVID-19 data

The COVID-19 pandemic generated large amounts of diverse data, including testing, treatments, vaccine trials, data from modeling, etc. To support epidemiologists and modeling scientists in their efforts to understand and respond to the pandemic, there arose a need for web visualization and visual analytics (VIS) applications to provide insights and support decision-making. In this paper, we present RAMPVIS, an infrastructure designed to support a range of observational, analytical, model-developmental, and dissemination tasks. One of the main features of the system is the ability to "propagate" a visualization designed for one data source to similar ones, this allows a user to quickly visualize large amounts of data. In addition to the COVID pandemic, the RAMPVIS software may be adapted and used with different data to provide rapid visualization support for other emergency responses.

Development and Evaluation of Two Approaches of Visual Sensitivity Analysis to Support Epidemiological Modeling

Computational modeling is a commonly used technology in many scientific disciplines and has played a noticeable role in combating the COVID-19 pandemic. Modeling scientists conduct sensitivity analysis frequently to observe and monitor the behavior of a model during its development and deployment. The traditional algorithmic ranking of sensitivity of different parameters usually does not provide modeling scientists with sufficient information to understand the interactions between different parameters and model outputs, while modeling scientists need to observe a large number of model runs in order to gain actionable information for parameter optimization. To address the above challenge, we developed and compared two visual analytics approaches, namely: algorithm-centric and visualization-assisted, and visualization-centric and algorithm-assisted. We evaluated the two approaches based on a structured analysis of different tasks in visual sensitivity analysis as well as the feedback of domain experts. While the work was carried out in the context of epidemiological modeling, the two approaches developed in this work are directly applicable to a variety of modeling processes featuring time series outputs, and can be extended to work with models with other types of outputs.

Estimation of age-stratified contact rates during the COVID-19 pandemic using a novel inference algorithm

Well parameterized epidemiological models including accurate representation of contacts are fundamental to controlling epidemics. However, age-stratified contacts are typically estimated from pre-pandemic/peace-time surveys, even though interventions and public response likely alter contacts. Here, we fit age-stratified models, including re-estimation of relative contact rates between age classes, to public data describing the 2020-2021 COVID-19 outbreak in England. This data includes age-stratified population size, cases, deaths, hospital admissions and results from the Coronavirus Infection Survey (almost 9000 observations in all). Fitting stochastic compartmental models to such detailed data is extremely challenging, especially considering the large number of model parameters being estimated (over 150). An efficient new inference algorithm ABC-MBP combining existing approximate Bayesian computation (ABC) methodology with model-based proposals (MBPs) is applied. Modified contact rates are inferred alongside time-varying reproduction numbers that quantify changes in overall transmission due to pandemic response, and age-stratified proportions of asymptomatic cases, hospitalization rates and deaths. These inferences are robust to a range of assumptions including the values of parameters that cannot be estimated from available data. ABC-MBP is shown to enable reliable joint analysis of complex epidemiological data yielding consistent parametrization of dynamic transmission models that can inform data-driven public health policy and interventions. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.

Technical challenges of modelling real-life epidemics and examples of overcoming these

The coronavirus disease 2019 (COVID-19) pandemic has highlighted the importance of mathematical modelling in informing and advising policy decision-making. Effective practice of mathematical modelling has challenges. These can be around the technical modelling framework and how different techniques are combined, the appropriate use of mathematical formalisms or computational languages to accurately capture the intended mechanism or process being studied, in transparency and robustness of models and numerical code, in simulating the appropriate scenarios via explicitly identifying underlying assumptions about the process in nature and simplifying approximations to facilitate modelling, in correctly quantifying the uncertainty of the model parameters and projections, in taking into account the variable quality of data sources, and applying established software engineering practices to avoid duplication of effort and ensure reproducibility of numerical results. Via a collection of 16 technical papers, this special issue aims to address some of these challenges alongside showcasing the usefulness of modelling as applied in this pandemic. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.

An algebraic framework for structured epidemic modelling

Pandemic management requires that scientists rapidly formulate and analyse epidemiological models in order to forecast the spread of disease and the effects of mitigation strategies. Scientists must modify existing models and create novel ones in light of new biological data and policy changes such as social distancing and vaccination. Traditional scientific modelling workflows detach the structure of a model-its submodels and their interactions-from its implementation in software. Consequently, incorporating local changes to model components may require global edits to the code base through a manual, time-intensive and error-prone process. We propose a compositional modelling framework that uses high-level algebraic structures to capture domain-specific scientific knowledge and bridge the gap between how scientists think about models and the code that implements them. These algebraic structures, grounded in applied category theory, simplify and expedite modelling tasks such as model specification, stratification, analysis and calibration. With their structure made explicit, models also become easier to communicate, criticize and refine in light of stakeholder feedback. This article is part of the theme issue 'Technical challenges of modelling real-life epidemics and examples of overcoming these'.