Evaluating adverse events after vaccination in the Medicare population

Signal Detection of Adverse Events Following Pneumococcal Vaccines from the Korea Adverse Event Reporting System Database, 2005-2016

PURPOSE

We aimed to analyze the surveillance reports of adverse events (AEs) due to different types of pneumococcal vaccines, in addition to detecting and validating signals of pneumococcal vaccines by comparing AEs with labels.

MATERIALS AND METHODS

We analyzed the percentages of AEs according to vaccine type [pneumococcal polysaccharide vaccines (PPSVs) and pneumococcal conjugate vaccines (PCVs)] in children and adults using data from the Korea Adverse Event Reporting System (KAERS) database from 2005 to 2016. A signal was defined as an AE that met all three indices of data mining: proportional reporting ratio (PRR), reporting odds ratio (ROR), and information component (IC). We validated the detected signals by calculating sensitivity, specificity, as well as positive and negative predictive values of the signals against label information.

RESULTS

Of the 39933 AE reports on vaccination, 5718 (7.0%) were related to pneumococcal vaccine. The most frequent AE after vaccination with PPSV was fever (23.9%) in children and injection-site reaction in adults. The most frequent AE after vaccination with PCV in children was pharyngitis (26.2%). In total, 13 AEs met all three indices for signal detection. Among these, hypotension, apathy, sepsis, and increased serum glutamic oxaloacetic transaminase level were not listed on vaccine labels. In validation analysis, PRR and ROR performed slightly better than IC for adults who were vaccinated with PPSVs.

CONCLUSION

Overall, 13 new signals of PPSVs, including four signals not listed on the labels, were detected. Further research based on additional AE reports is required to confirm the validity of these signals for children.

Comparison of alpha-spending plans for near real-time monitoring for Guillain-Barré Syndrome after influenza vaccination during the 2010/11 influenza season

BACKGROUND

Near real-time surveillance of the influenza vaccine, which is administered to a large proportion of the US population every year, is essential to ensure safety of the vaccine. For efficient near real-time surveillance, it is key to select appropriate parameters such as monitoring start date, number of interim tests and a scheme for spending a pre-defined total alpha across the entire influenza season. Guillain-Barré Syndrome, shown to be associated with the 1976 influenza vaccine, is used to evaluate how choices of these parameters can affect whether or not a signal is detected and the time to signal. FDA has been monitoring for the risk of GBS after influenza vaccination for every influenza season since 2008.

METHODS

Using Medicare administrative data and the Updating Sequential Probability Ratio Test methodology to account for claims delay, we evaluated a number of different alpha-spending plans by varying several parameters.

RESULTS

For relative risks of 5 or greater, almost all alpha-spending plans have 100% power; however, for relative risks of 1.5 or lower, the constant and O'Brien-Fleming plans have increasingly more power. For RRs of 1.5 and greater, the Pocock plan signals earliest but would not signal at a RR of 1.25, as observed in prior influenza seasons. There were no remarkable differences across the different plans in regards to monitoring start dates defined by the number of vaccinations; reducing the number of interim tests improves performance only marginally.

CONCLUSIONS

A constant alpha-spending plan appears to be robust, in terms of power and time to detect a signal, across a range of these parameters, including alternate monitoring start dates based on either cumulative vaccinations or GBS claims observed, frequency of monitoring, hypothetical relative risks, and vaccine uptake patterns.

A simulation study of the statistical power and signaling characteristics of an early season sequential test for influenza vaccine safety

PURPOSE

The US Food and Drug Administration monitors the risk of Guillain-Barré syndrome (GBS) following influenza vaccination using several data sources including Medicare. In the 2017 to 2018 season, we transitioned our near real-time surveillance in Medicare to more effectively detect large GBS risk increases early in the season while avoiding false positives.

METHODS

We conducted a simulation study examining the ability of the updating sequential probability ratio test (USPRT) to detect substantially elevated GBS risk in the 8- to 21-day postvaccination versus 5× to 30× the historical rate. We varied the first testing week (weeks 5-8) and the null rate (1×-3×) and evaluated power. We estimated signal probability and the risk ratio (RR) after signaling when high-risk seasons were rare.

RESULTS

Applying fixed alternatives, we found >80% power to detect a risk 30× the historical rate in week 5 for the 1× null and in week 6 for the 1.5× to 3× nulls. Nearly all testing schedules had >80% power for a 5× risk by week 11. To test the robustness of USPRT, we further simulated seasons where 1% were true high-risk seasons. Using a 1× null led to 10% of seasons signaling by week 11 (median RR approximately 1.4), which decreased to approximately 1% with the ≥2.5× null (median RR approximately 16.0).

CONCLUSIONS

On the basis of the results from this simulation and subsequent consultations with experts and stakeholders, we specified USPRT to test continuously from weeks 7 to 11 using the null hypothesis that the observed GBS rate was 2.5× the historical rate. This helped improve the ability of USPRT to provide early detection of GBS risk following influenza vaccination as part of a multilayered system of surveillance.

Sepsis, parenteral vaccination and skin disinfection

ASBSTRACT Disinfection should be required for all skin penetrative procedures including parenteral administration of vaccines. This review analyses medically attended infectious events following parenteral vaccination in terms of their microbiological aetiology and pathogenesis. Like 'clean' surgical site infections, the major pathogens responsible for these events were Staphylococcal species, implicating endogenous con-tamination as a significant source of infection. As 70% isopropyl alcohol swabbing has been shown to effectively disinfect the skin, it would be medico-legally difficult to defend a case of sepsis with the omission of skin disinfection unless the very low risk of this event was adequately explained to the patient and documented prior to vaccination. There was a significant cost-benefit for skin disinfection and cellulitis. Skin disinfection in the context of parenteral vaccination represents a new paradigm of medical practice; the use of a low cost intervention to prevent an event of very low prevalence but of significant cost.

The safety of influenza vaccines in children: An Institute for Vaccine Safety white paper

Most influenza vaccines are generally safe, but influenza vaccines can cause rare serious adverse events. Some adverse events, such as fever and febrile seizures, are more common in children than adults. There can be differences in the safety of vaccines in different populations due to underlying differences in genetic predisposition to the adverse event. Live attenuated vaccines have not been studied adequately in children under 2 years of age to determine the risks of adverse events; more studies are needed to address this and several other priority safety issues with all influenza vaccines in children. All vaccines intended for use in children require safety testing in the target age group, especially in young children. Safety of one influenza vaccine in children should not be extrapolated to assumed safety of all influenza vaccines in children. The low rates of adverse events from influenza vaccines should not be a deterrent to the use of influenza vaccines because of the overwhelming evidence of the burden of disease due to influenza in children.

Brief Report: Severe Inflammation Following Vaccination Against Streptococcus pneumoniae in Patients With Cryopyrin-Associated Periodic Syndromes

OBJECTIVE

Pneumococcal vaccination is recommended for patients receiving immunosuppressive drugs. We describe unusually severe adverse reactions to pneumococcal vaccination in each of 7 consecutive patients with cryopyrin-associated periodic syndromes (CAPS).

METHODS

Seven consecutive patients with CAPS were vaccinated with pneumococcal polysaccharide or conjugate vaccines. Clinical information was collected retrospectively.

RESULTS

Within a few hours after the vaccination, all 7 patients developed severe local reactions at the injection site. Two patients had to be hospitalized for systemic reactions including fever. All symptoms resolved in a period of 3-17 days.

CONCLUSION

Our findings indicate that pneumococcal vaccines can trigger a severe local and systemic inflammatory reaction in patients with CAPS and possibly patients with other autoinflammatory diseases. Careful consideration is warranted when implementing current European League Against Rheumatism immunization guidelines in this patient population.

Post-licensure safety surveillance of 23-valent pneumococcal polysaccharide vaccine in the Vaccine Adverse Event Reporting System (VAERS), 1990-2013

BACKGROUND

23-Valent pneumococcal polysaccharide vaccine, trade name Pneumovax(®)23 (PPSV23), has been used for decades in the Unites States and has an extensive clinical record. However, limited post-licensure safety assessment has been conducted.

OBJECTIVE

To analyze reports submitted to the Vaccine Adverse Event Reporting System (VAERS) following PPSV23 from 1990 to 2013 in order to characterize its safety profile.

METHODS

We searched the VAERS database for US reports following PPSV23 for persons vaccinated from 1990 to 2013. We assessed safety through: automated analysis of VAERS data, crude adverse event (AE) reporting rates based on PPSV23 doses distributed in the US market, clinical review of death reports and reports involving vaccine administered to pregnant women, and empirical Bayesian data mining to assess for disproportional reporting.

RESULTS

During the study period, VAERS received 25,168 PPSV23 reports; 92% were non-serious, 67% were in females and 86% were in adults aged ≥19 years. When PPSV23 was administered alone, fever (43%), injection site erythema (28%) and injection site pain (25%) were the most commonly reported non-serious AEs in children. Injection site erythema (32%), injection site pain (27%) and injection site swelling (23%) were the most commonly reported non-serious AEs in adults. Of serious reports (2129, 8% of total), fever was most commonly reported in both children (69%) and adults (39%). There were 66 reports of death, four in children and 62 in adults. Clinical review of death reports did not reveal any concerning patterns that would suggest a causal association with PPSV23. No disproportional reporting of unexpected AEs was observed in empirical Bayesian data mining.

CONCLUSIONS

We did not identify any new or unexpected safety concerns for PPSV23. The VAERS data are consistent with safety data from pre-licensure clinical trials and other post-licensure studies.

Overall conceptual framework for studying the genetics of autoimmune diseases following vaccination: a regulatory perspective

The US Vaccine Adverse Event Reporting System contains case reports of autoimmune diseases (ADs) occurring following vaccinations. ADs are rare and occur in unvaccinated people, making the potential association between vaccines and ADs challenging to evaluate. Developing mechanistic pathways that link genes, immune mediators, vaccine components and ADs would be helpful for hypothesis generation, enhancing theories of biologic plausibility and grouping rare autoimmune adverse events to increase the ability to detect and evaluate safety signals. Here, we propose a conceptual framework for investigating the genetics of ADs as safety signals following vaccination, potentially contributing to the identification of relevant biomarkers. We also discuss a study design that incorporates genetic information into postmarket clinical evaluation of autoimmune adverse events following vaccination.

Medicare claims versus beneficiary self-report for influenza vaccination surveillance

BACKGROUND

Although self-reported influenza vaccination status is routinely used in surveillance to estimate influenza vaccine coverage, Medicare data are becoming a promising resource for influenza surveillance to inform vaccination program management and planning.

PURPOSE

To evaluate the concordance between self-reported influenza vaccination and influenza vaccination claims among Medicare beneficiaries.

METHODS

This study compared influenza vaccination based upon Medicare claims and self-report among a sample of Medicare beneficiaries (N=9,378) from the 2011 Medicare Current Beneficiary Survey, which was the most recent year of data at the time of analysis (summer 2013). Sensitivity, specificity, positive predictive value, and negative predictive value were calculated using self-reported data as the referent standard. Logistic regression was used to compute the marginal mean proportions for whether a Medicare influenza vaccination claim was present among beneficiaries who reported receiving the vaccination.

RESULTS

Influenza vaccination was higher for self-report (69.4%) than Medicare claims (48.3%). For Medicare claims, sensitivity=67.5%, specificity=96.3%, positive predictive value=97.6%, and negative predictive value=56.7%. Among beneficiaries reporting receiving an influenza vaccination, the percentage of beneficiaries with a vaccination claim was lower for beneficiaries who were aged <65 years, male, non-Hispanic black or Hispanic, and had less than a college education.

CONCLUSIONS

The classification of influenza vaccination status for Medicare beneficiaries can differ based upon survey and claims. To improve Medicare claims-based surveillance studies, further research is needed to determine the sources of discordance in self-reported and Medicare claims data, specifically for sensitivity and negative predictive value.

[Post-licensure passive safety surveillance of rotavirus vaccines: reporting sensitivity for intussusception]

INTRODUCTION

The aims of this study were to describe the reports of suspected adverse events due to rotavirus vaccines, and assess the reporting sensitivity for intussusception.

MATERIAL AND METHODS

Descriptive study performed using the reports of suspected adverse events following rotavirus vaccination in infants aged less than 10 months, as registered in the Pharmacovigilance Centre of the Valencian Community during 2007-2011. The reporting rate for intussusception was compared to the intussusception rate in vaccinated infants obtained using the hospital discharge database (CMBD), and the regional vaccine registry.

RESULTS

The adverse event reporting rate was 20 per 100,000 administered doses, with the majority (74%) of the reports being classified as non-serious. Fever, vomiting, and diarrhea were the adverse events reported more frequently. Two intussusception cases, which occurred within the first seven days post-vaccination, were reported as temporarily associated to vaccination. The reporting sensitivity for intussusception at the Pharmacovigilance Centre in the 1-7 day interval following rotavirus vaccination was 50%.

CONCLUSIONS

Our results suggest that rotavirus vaccines have, in general, a good safety profile. Intussusception reporting to the Pharmacovigilance Centre shows sensitivity similar to other passive surveillance systems. The intussusception risk should be further investigated using well-designed epidemiological studies, and evaluated in comparison with the well-known benefits provided by these vaccines.

Surveillance for Guillain-Barré syndrome after influenza vaccination among the Medicare population, 2009-2010

OBJECTIVES

We implemented active surveillance for Guillain-Barré syndrome (GBS) following seasonal or H1N1 influenza vaccination among the Medicare population during the 2009-2010 influenza season.

METHODS

We used weekly Medicare claims data to monitor vaccinations and subsequent hospitalizations with principal diagnosis code for GBS within 42 days. Group sequential testing assessed whether the observed GBS rate exceeded a critical limit based on the expected rate from 5 previous years adjusted for claims delay. We evaluated the lag between date of service and date of claims availability and used it for adjustment.

RESULTS

By July 30, 2010 (after 26 interim surveillance tests), 14.0 million seasonal and 3.3 million H1N1 vaccinations had accrued. Taking into account claims delay appropriately lowered the critical limit during early monitoring. The observed GBS rate was below the critical limit throughout the surveillance.

CONCLUSIONS

Medicare data contributed rapid safety monitoring among millions of 2009-2010 influenza vaccine recipients. Adjustment for claims delay facilitates early detection of potential safety issues. Although limited by lack of medical record review to confirm cases, this claims-based surveillance did not indicate a statistically significant elevated GBS rate following seasonal or H1N1 influenza vaccination.

Pneumococcal polysaccharide 23-valent vaccine: long-term persistence of circulating antibody and immunogenicity and safety after revaccination in adults

Since publication of a 1997 review of the immunogenicity and safety data for pneumococcal polysaccharide vaccines (PPSVs), dozens of additional studies have been published, involving larger cohorts, longer observation periods, and more specific assays. Additionally, a 13-valent pneumococcal conjugate vaccine (PCV) has been licensed for adults. This paper reviews adult studies assessing antibody persistence for ≥ 3 years after pneumococcal vaccination, and adult studies of immunogenicity and safety after revaccination. This review emphasizes the currently registered PPSV23 formulations containing 25-μg polysaccharide per serotype, for which far more long-term data are available. Broadly, IgG and functional antibody levels after PPSV23 in adults persist above concentrations in unvaccinated adults for at least 5-10 years in most studies. The few exceptions involve populations of non-ambulatory adults or those with confounding host-factor issues. Revaccination with PPSV23 5-10 years after a previous dose consistently and substantially increases both IgG and functional antibody levels. There is an inverse association between circulating antibody level just before primary or revaccination and subsequent antibody increase. Although injection-site reactions (e.g., pain, swelling, redness) were reported more commonly after PPSV23 revaccination than after primary vaccination in most studies, these reactions typically resolved within 5 days. We interpret the contemporary literature as supporting pneumococcal revaccination as a means to sustain anti-pneumococcal antibodies at levels greater than among unvaccinated adults. PPSV23 is a broad-spectrum public-health tool to help prevent serious pneumococcal diseases across the adult lifespan.

Algorithm to assess causality after individual adverse events following immunizations

Assessing individual reports of adverse events following immunizations (AEFI) can be challenging. Most published reviews are based on expert opinions, but the methods and logic used to arrive at these opinions are neither well described nor understood by many health care providers and scientists. We developed a standardized algorithm to assist in collecting and interpreting data, and to help assess causality after individual AEFI. Key questions that should be asked during the assessment of AEFI include: Is the diagnosis of the AEFI correct? Does clinical or laboratory evidence exist that supports possible causes for the AEFI other than the vaccine in the affected individual? Is there a known causal association between the AEFI and the vaccine? Is there strong evidence against a causal association? Is there a specific laboratory test implicating the vaccine in the pathogenesis? An algorithm can assist with addressing these questions in a standardized, transparent manner which can be tracked and reassessed if additional information becomes available. Examples in this document illustrate the process of using the algorithm to determine causality. As new epidemiologic and clinical data become available, the algorithm and guidelines will need to be modified. Feedback from users of the algorithm will be invaluable in this process. We hope that this algorithm approach can assist with educational efforts to improve the collection of key information on AEFI and provide a platform for teaching about causality assessment.

Use of the self-controlled case-series method in vaccine safety studies: review and recommendations for best practice

The self-controlled case-series method was originally developed to investigate potential associations between vaccines and adverse events, and is now commonly used for this purpose. This study reviews applications of the method to vaccine safety investigations in the period 1995–2010. In total, 40 studies were reviewed. The application of the self-controlled case-series method in these studies is critically examined, with particular reference to the definition of observation and risk periods, control of confounders, assumptions and potential biases, methodological and presentation issues, power and sample size, and software. Comparisons with other study designs undertaken in the papers reviewed are also highlighted. Some recommendations are presented, with the emphasis on promoting good practice.

Statistical, epidemiological, and risk-assessment approaches to evaluating safety of vaccines throughout the life cycle at the Food and Drug Administration

The public health community faces increasing demands for improving vaccine safety while simultaneously increasing the number of vaccines available to prevent infectious diseases. The passage of the US Food and Drug Administration (FDA) Amendment Act of 2007 formalized the concept of life-cycle management of the risks and benefits of vaccines, from early clinical development through many years of use in large numbers of people. Harnessing scientific and technologic advances is necessary to improve vaccine-safety evaluation. The Office of Biostatistics and Epidemiology in the Center for Biologics Evaluation and Research is working to improve the FDA's ability to monitor vaccine safety by improving statistical, epidemiologic, and risk-assessment methods, gaining access to new sources of data, and exploring the use of genomics data. In this article we describe the current approaches, new resources, and future directions that the FDA is taking to improve the evaluation of vaccine safety.

Evaluation of Guillain-Barré Syndrome among recipients of influenza vaccine in 2000 and 2001

BACKGROUND

The 1976-1977 swine influenza vaccine was associated with an elevated risk of Guillain-Barré Syndrome (GBS), especially within 6 weeks after vaccination. A 2004 IOM report concluded that evidence was inadequate to accept or reject a causal relationship between subsequent influenza vaccine formulations and GBS. Studies published after the IOM report have been limited by passively reported data or lack of validation of coded diagnoses.

PURPOSE

To evaluate whether influenza vaccine is associated with GBS.

METHODS

Controlled observational study using national data from the Medicare program, which ensures a predominantly elderly population. People included had a Medicare claim for influenza vaccination during September-December in 2000 or 2001. Medical records were reviewed to classify definite, probable, or possible GBS (or not a case) using a standardized case definition. In a risk interval design, the incidence rate of GBS during Weeks 0-6 after vaccination (exposed period) was compared to Weeks 9-14 after vaccination (comparison period). Data collection occurred during 2003-2007, and analysis was conducted during 2007-2009.

RESULTS

Primary analysis included 22.2 million vaccinees, among whom 164 definite or probable GBS cases with onset during Weeks 0-6 or 9-14 were identified. The incidence rate ratio (IRR [95% CIs]) based on the GBS rate in the vaccine-exposed versus comparison periods, was 1.04 (0.76, 1.43) for combined years; 0.86 (0.52, 1.41) among people vaccinated in 2000; and 1.21 (0.79, 1.86) among people vaccinated in 2001. Secondary analysis additionally included 74 possible GBS cases; results were similar.

CONCLUSIONS

Overall, the results do not support an association between influenza vaccine receipt and GBS among the elderly for the years studied (2000-2001 and 2001-2002 formulations).

Accuracy of influenza vaccination status in a computer-based immunization tracking system of a managed care organization

Influenza vaccine safety and effectiveness studies conducted using electronic medical records rely on accurate assessment of influenza vaccination status. However, influenza immunization in non-traditional settings (e.g., the workplace) may not be captured in patient immunization tracking systems. We compared influenza vaccination status from electronic records with self-reported vaccination status for five hundred and two 50-79 years olds enrolled in a large managed care organization. Influenza vaccination status in the medical record had a high positive predictive value and specificity (both >99%). The negative predictive value was 80% and sensitivity was 78%. These data suggest that an electronic record of influenza vaccination reliably indicates immunization, while the absence of such a record is only moderately accurate, partly due to vaccines received in non-traditional settings.

Near real-time surveillance for influenza vaccine safety: proof-of-concept in the Vaccine Safety Datalink Project

The emergence of pandemic H1N1 influenza in 2009 has prompted public health responses, including production and licensure of new influenza A (H1N1) 2009 monovalent vaccines. Safety monitoring is a critical component of vaccination programs. As proof-of-concept, the authors mimicked near real-time prospective surveillance for prespecified neurologic and allergic adverse events among enrollees in 8 medical care organizations (the Vaccine Safety Datalink Project) who received seasonal trivalent inactivated influenza vaccine during the 2005/06-2007/08 influenza seasons. In self-controlled case series analysis, the risk of adverse events in a prespecified exposure period following vaccination was compared with the risk in 1 control period for the same individual either before or after vaccination. In difference-in-difference analysis, the relative risk in exposed versus control periods each season was compared with the relative risk in previous seasons since 2000/01. The authors used Poisson-based analysis to compare the risk of Guillain-Barré syndrome following vaccination in each season with that in previous seasons. Maximized sequential probability ratio tests were used to adjust for repeated analyses on weekly data. With administration of 1,195,552 doses to children under age 18 years and 4,773,956 doses to adults, no elevated risk of adverse events was identified. Near real-time surveillance for selected adverse events can be implemented prospectively to rapidly assess seasonal and pandemic influenza vaccine safety.

Active computerized pharmacovigilance using natural language processing, statistics, and electronic health records: a feasibility study

OBJECTIVE It is vital to detect the full safety profile of a drug throughout its market life. Current pharmacovigilance systems still have substantial limitations, however. The objective of our work is to demonstrate the feasibility of using natural language processing (NLP), the comprehensive Electronic Health Record (EHR), and association statistics for pharmacovigilance purposes. DESIGN Narrative discharge summaries were collected from the Clinical Information System at New York Presbyterian Hospital (NYPH). MedLEE, an NLP system, was applied to the collection to identify medication events and entities which could be potential adverse drug events (ADEs). Co-occurrence statistics with adjusted volume tests were used to detect associations between the two types of entities, to calculate the strengths of the associations, and to determine their cutoff thresholds. Seven drugs/drug classes (ibuprofen, morphine, warfarin, bupropion, paroxetine, rosiglitazone, ACE inhibitors) with known ADEs were selected to evaluate the system. RESULTS One hundred thirty-two potential ADEs were found to be associated with the 7 drugs. Overall recall and precision were 0.75 and 0.31 for known ADEs respectively. Importantly, qualitative evaluation using historic roll back design suggested that novel ADEs could be detected using our system. CONCLUSIONS This study provides a framework for the development of active, high-throughput and prospective systems which could potentially unveil drug safety profiles throughout their entire market life. Our results demonstrate that the framework is feasible although there are some challenging issues. To the best of our knowledge, this is the first study using comprehensive unstructured data from the EHR for pharmacovigilance.