A concern over terminology in vaccine effectiveness studies

Adjustment for Disease Severity in the Test-Negative Study Design

The test-negative study design is often used to estimate vaccine effectiveness in influenza studies, but it has also been proposed in the context of other infectious diseases, such as cholera, dengue, or Ebola. It was introduced as a variation of the case-control design, in an attempt to reduce confounding bias due to health-care-seeking behavior, and has quickly gained popularity because of its logistic advantages. However, examination of the directed acyclic graphs that describe the test-negative design reveals that without strong assumptions, the estimated odds ratio derived under this sampling mechanism is not collapsible over the selection variable, such that the results obtained for the sampled individuals cannot be generalized to the whole population. In this paper, we show that adjustment for severity of disease can reduce this bias and, under certain assumptions, makes it possible to unbiasedly estimate a causal odds ratio. We support our findings with extensive simulations and discuss them in the context of recently published cholera test-negative studies of the effectiveness of cholera vaccines.

The Use of Test-negative Controls to Monitor Vaccine Effectiveness: A Systematic Review of Methodology

BACKGROUND

The test-negative design is an increasingly popular approach for estimating vaccine effectiveness (VE) due to its efficiency. This review aims to examine published test-negative design studies of VE and to explore similarities and differences in methodological choices for different diseases and vaccines.

METHODS

We conducted a systematic search on PubMed, Web of Science, and Medline, for studies reporting the effectiveness of any vaccines using a test-negative design. We screened titles and abstracts and reviewed full texts to identify relevant articles. We created a standardized form for each included article to extract information on the pathogen of interest, vaccine(s) being evaluated, study setting, clinical case definition, choices of cases and controls, and statistical approaches used to estimate VE.

RESULTS

We identified a total of 348 articles, including studies on VE against influenza virus (n = 253), rotavirus (n = 48), pneumococcus (n = 24), and nine other pathogens. Clinical case definitions used to enroll patients were similar by pathogens of interest but the sets of symptoms that defined them varied substantially. Controls could be those testing negative for the pathogen of interest, those testing positive for nonvaccine type of the pathogen of interest, or a subset of those testing positive for alternative pathogens. Most studies controlled for age, calendar time, and comorbidities.

CONCLUSIONS

Our review highlights similarities and differences in the application of the test-negative design that deserve further examination. If vaccination reduces disease severity in breakthrough infections, particular care must be taken in interpreting vaccine effectiveness estimates from test-negative design studies.

Effectiveness of influenza vaccination on influenza-associated hospitalisations over time among children in Hong Kong: a test-negative case-control study

BACKGROUND

The protection conferred by influenza vaccination is generally thought to last less than a year, necessitating annual revaccination. However, the speed with which influenza vaccine effectiveness might decline during a year is unknown, which is of particular importance for locations with year-round influenza activity. We aimed to assess how influenza vaccine effectiveness changes by time intervals between vaccination and admission to hospital, taking advantage of almost year-round circulation of influenza in Hong Kong.

METHODS

In this test-negative case-control study, we analysed vaccine effectiveness in children (aged 6 months to 17 years) who were admitted to hospital in Hong Kong over 5 consecutive years (2012-17). We included those who were admitted to general wards in four public hospitals in Hong Kong with a fever (≥38°C) and any respiratory symptom, such as runny nose, cough, or sore throat. We used direct immunofluorescence assay and reverse transcription PCR to detect influenza virus infection, and recorded children's influenza immunisation history. We compared characteristics of positive cases and negative controls and examined how vaccine effectiveness changed by time between vaccination and admission to hospital with regression analyses.

FINDINGS

Between Sept 1, 2012, and Aug 31, 2017, we enrolled 15 695 children hospitalised for respiratory infections, including 2500 (15·9%) who tested positive for influenza A or B and 13 195 (84·1%) who tested negative. 159 (6·4%) influenza-positive cases and 1445 (11·0%) influenza-negative cases had been vaccinated. Most vaccinations were done by December of each influenza vaccination season. Influenza-related admissions to hospital occurred year-round, with peaks in January through March in most years and a large summer peak in 2016; pooled vaccine effectiveness for children of all ages was 79% (95% CI 42-92) for September to December, 67% (57-74) for January to April, and 43% (25-57) for May to August. Vaccine effectiveness against influenza A or B was estimated as 79% (95% CI 64-88) within 0·5-2 months of vaccination, 60% (46-71) within >2-4 months, 57% (39-70) within >4-6 months, and 45% (22-61) within >6-9 months. In separate analyses by type and subtype, we estimated that vaccine effectiveness declined by 2-5 percentage points per month.

INTERPRETATION

Influenza vaccine effectiveness decreased during the 9 months after vaccination in children in Hong Kong. Our findings confirm the importance of annual vaccination in children. Influenza vaccines that provide broader and longer-lasting protection are needed to provide year-round protection in regions with irregular influenza seasonality or lengthy periods of influenza activity.

FUNDING

Health and Medical Research Fund, Hong Kong and the Research Grants Council, Hong Kong.