1
|
Heo SJ, Jeong S, Jung D, Jung I. Signal detection statistics of adverse drug events in hierarchical structure for matched case-control data. Biostatistics 2023:kxad029. [PMID: 37886808 DOI: 10.1093/biostatistics/kxad029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2022] [Revised: 10/04/2023] [Accepted: 10/06/2023] [Indexed: 10/28/2023] Open
Abstract
The tree-based scan statistic is a data mining method used to identify signals of adverse drug reactions in a database of spontaneous reporting systems. It is particularly beneficial when dealing with hierarchical data structures. One may use a retrospective case-control study design from spontaneous reporting systems (SRS) to investigate whether a specific adverse event of interest is associated with certain drugs. However, the existing Bernoulli model of the tree-based scan statistic may not be suitable as it fails to adequately account for dependencies within matched pairs. In this article, we propose signal detection statistics for matched case-control data based on McNemar's test, Wald test for conditional logistic regression, and the likelihood ratio test for a multinomial distribution. Through simulation studies, we demonstrate that our proposed methods outperform the existing approach in terms of the type I error rate, power, sensitivity, and false detection rate. To illustrate our proposed approach, we applied the three methods and the existing method to detect drug signals for dizziness-related adverse events related to antihypertensive drugs using the database of the Korea Adverse Event Reporting System.
Collapse
Affiliation(s)
- Seok-Jae Heo
- Division of Biostatistics, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul 03722, Korea
| | - Sohee Jeong
- Division of Biostatistics, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul 03722, Korea
| | - Dagyeom Jung
- Division of Biostatistics, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul 03722, Korea
| | - Inkyung Jung
- Division of Biostatistics, Department of Biomedical Systems Informatics, Yonsei University College of Medicine, Seoul 03722, Korea
| |
Collapse
|
2
|
Jeong NY, Kim CJ, Park SM, Kim YJ, Lee J, Choi NK. Active surveillance for adverse events of influenza vaccine safety in elderly cancer patients using self-controlled tree-temporal scan statistic analysis. Sci Rep 2023; 13:13346. [PMID: 37587127 PMCID: PMC10432531 DOI: 10.1038/s41598-023-40091-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 08/04/2023] [Indexed: 08/18/2023] Open
Abstract
Both cancer patients and the elderly are at high risk of developing flu complications, so influenza vaccination is recommended. We aimed to evaluate potential adverse events (AEs) following influenza vaccination in elderly cancer patients using the self-controlled tree-temporal scan statistic method. From a large linked database of Korea Disease Control and Prevention Agency vaccination data and the National Health Insurance Service claims data, we identified cancer patients aged over 65 who received flu vaccines during the 2016/2017 and 2017/2018 seasons. We included all the outcomes occurring on 1-84 days post-vaccination and evaluated all temporal risk windows, which started 1-28 days and ended 2-42 days. Patients who were diagnosed with the same disease during a year prior to vaccination were excluded. We used the hierarchy of ICD-10 to identify statistically significant clustering. This study included 431,276 doses of flu vaccine. We detected signals for 1 set: other dorsopathies on 1-15 days (attributable risk 16.5 per 100,000, P = 0.017). Dorsopathy is a known AE of influenza vaccine. No statistically significant clusters were found when analyzed by flu season. Therefore, influenza vaccination is more recommended for elderly patients with cancer and weakened immune systems.
Collapse
Affiliation(s)
- Na-Young Jeong
- Department of Health Convergence, College of Science & Industry Convergence, Ewha Womans University, Seoul, Korea
| | - Chung-Jong Kim
- Department of Internal Medicine, Ewha Womans University Seoul Hospital, Seoul, Korea
| | - Sang Min Park
- Department of Family Medicine, Seoul National University Hospital, Seoul, Korea
- Department of Biomedical Sciences, Seoul National University Graduate School, Seoul National University College of Medicine, Seoul, Korea
| | - Ye-Jee Kim
- Department of Clinical Epidemiology and Biostatistics, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Joongyub Lee
- Department of Preventive Medicine, Seoul National University College of Medicine, Seoul, Korea
| | - Nam-Kyong Choi
- Department of Health Convergence, College of Science & Industry Convergence, Ewha Womans University, Seoul, Korea.
- Graduate School of Industrial Pharmaceutical Science, College of Pharmacy, Ewha Womans University, Seoul, Korea.
| |
Collapse
|
3
|
Suarez EA, Nguyen M, Zhang D, Zhao Y, Stojanovic D, Munoz M, Liedtka J, Anderson A, Liu W, Dashevsky I, Cole D, DeLuccia S, Menzin T, Noble J, Maro JC. Novel methods for pregnancy drug safety surveillance in the FDA Sentinel System. Pharmacoepidemiol Drug Saf 2023; 32:126-136. [PMID: 35871766 DOI: 10.1002/pds.5512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Revised: 07/14/2022] [Accepted: 07/21/2022] [Indexed: 01/26/2023]
Abstract
PURPOSE It is a priority of the US Food and Drug Administration (FDA) to monitor the safety of medications used during pregnancy. Pregnancy exposure registries and cohort studies utilizing electronic health record data are primary sources of information but are limited by small sample sizes and limited outcome assessment. TreeScan™, a statistical data mining tool, can be applied within the FDA Sentinel System to simultaneously identify multiple potential adverse neonatal and infant outcomes after maternal medication exposure. METHODS We implemented TreeScan using the Sentinel analytic tools in a cohort of linked live birth deliveries and infants nested in the IBM MarketScan® Research Database. As a case study, we compared first trimester fluoroquinolone use and cephalosporin use. We used the Bernoulli and Poisson TreeScan statistics with compatible propensity score-based study designs for confounding control (matching and stratification) and used multiple propensity score models with various strategies for confounding control to inform best practices. We developed a hierarchical outcome tree including major congenital malformations and outcomes of gestational length and birth weight. RESULTS A total of 1791 fluoroquinolone-exposed and 8739 cephalosporin-exposed mother-infant pairs were eligible for analysis. Both TreeScan analysis methods resulted in single alerts that were deemed to be due to uncontrolled confounding or otherwise not warranting follow-up. CONCLUSIONS In this implementation of TreeScan using Sentinel analytic tools, we did not observe any new safety signals for fluoroquinolone use in the first trimester. TreeScan, with tailored or high-dimensional propensity scores for confounding control, is a valuable tool in addition to current safety surveillance methods for medications used during pregnancy.
Collapse
Affiliation(s)
- Elizabeth A Suarez
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Massachusetts, USA
| | - Michael Nguyen
- Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Di Zhang
- Office of Biostatistics, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Yueqin Zhao
- Office of Biostatistics, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Danijela Stojanovic
- Office of Surveillance and Epidemiology, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Monica Munoz
- Division of Pharmacovigilance, Center for Drug Evaluation and Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Jane Liedtka
- Division of Pediatric and Maternal Health, Center for Drug and Evaluation Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Abby Anderson
- Division of Urology, Obstetrics and Gynecology, Center for Drug and Evaluation Research, US Food and Drug Administration, Beltsville, Maryland, USA
| | - Wei Liu
- Division of Epidemiology, Center for Drug and Evaluation Research, US Food and Drug Administration, Silver Spring, Maryland, USA
| | - Inna Dashevsky
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Massachusetts, USA
| | - David Cole
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Massachusetts, USA
| | - Sandra DeLuccia
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Massachusetts, USA
| | - Talia Menzin
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Massachusetts, USA
| | - Jennifer Noble
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Massachusetts, USA
| | - Judith C Maro
- Department of Population Medicine, Harvard Pilgrim Health Care Institute and Harvard Medical School, Boston, Massachusetts, USA
| |
Collapse
|
4
|
Yih WK, Kulldorff M, Dashevsky I, Maro JC. Sequential Data-Mining for Adverse Events After Recombinant Herpes Zoster Vaccination Using the Tree-Based Scan Statistic. Am J Epidemiol 2023; 192:276-282. [PMID: 36227263 DOI: 10.1093/aje/kwac176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 08/13/2022] [Accepted: 10/07/2022] [Indexed: 02/07/2023] Open
Abstract
Tree-based scan statistics have been successfully used to study the safety of several vaccines without prespecifying health outcomes of concern. In this study, the binomial tree-based scan statistic was applied sequentially to detect adverse events in days 1-28 compared with days 29-56 after recombinant herpes zoster (RZV) vaccination, with 5 looks at the data and formal adjustment for the repeated analyses over time. IBM MarketScan data on commercially insured persons ≥50 years of age receiving RZV during January 1, 2018, to May 5, 2020, were used. With 999,876 doses of RZV included, statistically significant signals were detected only for unspecified adverse effects/complications following immunization, with attributable risks as low as 2 excess cases per 100,000 vaccinations. Ninety percent of cases in the signals occurred in the week after vaccination and, based on previous studies, likely represent nonserious events like fever, fatigue, and headache. Strengths of our study include its untargeted nature, self-controlled design, and formal adjustment for repeated testing. Although the method requires prespecification of the risk window of interest and may miss some true signals detectable using the tree-temporal variant of the method, it allows for early detection of potential safety problems through early initiation of ongoing monitoring.
Collapse
|
5
|
Yih WK, Daley MF, Duffy J, Fireman B, McClure D, Nelson J, Qian L, Smith N, Vazquez-Benitez G, Weintraub E, Williams JTB, Xu S, Maro JC. A broad assessment of covid-19 vaccine safety using tree-based data-mining in the vaccine safety datalink. Vaccine 2023; 41:826-835. [PMID: 36535825 PMCID: PMC9755007 DOI: 10.1016/j.vaccine.2022.12.026] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 11/18/2022] [Accepted: 12/10/2022] [Indexed: 12/23/2022]
Abstract
BACKGROUND Except for spontaneous reporting systems, vaccine safety monitoring generally involves pre-specifying health outcomes and post-vaccination risk windows of concern. Instead, we used tree-based data-mining to look more broadly for possible adverse events after Pfizer-BioNTech, Moderna, and Janssen COVID-19 vaccination. METHODS Vaccine Safety Datalink enrollees receiving ≥1 dose of COVID-19 vaccine in 2020-2021 were followed for 70 days after Pfizer-BioNTech or Moderna and 56 days after Janssen vaccination. Incident diagnoses in inpatient or emergency department settings were analyzed for clustering within both the hierarchical ICD-10-CM code structure and the post-vaccination follow-up period. We used the self-controlled tree-temporal scan statistic and TreeScan software. Monte Carlo simulation was used to estimate p-values; p = 0.01 was the pre-specified cut-off for statistical significance of a cluster. RESULTS There were 4.1, 2.6, and 0.4 million Pfizer-BioNTech, Moderna, and Janssen vaccinees, respectively. Clusters after Pfizer-BioNTech vaccination included: (1) unspecified adverse effects, (2) common vaccine reactions, such as fever, myalgia, and headache, (3) myocarditis/pericarditis, and (4) less specific cardiac or respiratory symptoms, all with the strongest clusters generally after Dose 2; and (5) COVID-19/viral pneumonia/sepsis/respiratory failure in the first 3 weeks after Dose 1. Moderna results were similar but without a significant myocarditis/pericarditis cluster. Further investigation suggested the fifth signal group was a manifestation of mRNA vaccine effectiveness after the first 3 weeks. Janssen vaccinees had clusters of unspecified or common vaccine reactions, gait/mobility abnormalities, and muscle weakness. The latter two were deemed to have arisen from confounding related to practices at one site. CONCLUSIONS We detected post-vaccination clusters of unspecified adverse effects, common vaccine reactions, and, for the mRNA vaccines, chest pain and palpitations, as well as myocarditis/pericarditis after Pfizer-BioNTech Dose 2. Unique advantages of this data mining are its untargeted nature and its inherent adjustment for the multiplicity of diagnoses and risk intervals scanned.
Collapse
Affiliation(s)
- W Katherine Yih
- Harvard Pilgrim Health Care Institute and Department of Population Medicine, Harvard Medical School, Boston, MA, United States
| | | | - Jonathan Duffy
- Immunization Safety Office, Centers for Disease Control and Prevention, Atlanta, GA, United States
| | - Bruce Fireman
- Kaiser Permanente Northern California, Oakland, CA, United States
| | - David McClure
- Marshfield Clinic Research Institute, Marshfield, WI, United States
| | | | - Lei Qian
- Kaiser Permanente Southern California, Pasadena, CA, United States
| | - Ning Smith
- Kaiser Permanente Northwest, Portland, OR, United States
| | | | - Eric Weintraub
- Immunization Safety Office, Centers for Disease Control and Prevention, Atlanta, GA, United States
| | | | - Stanley Xu
- Kaiser Permanente Southern California, Pasadena, CA, United States
| | - Judith C Maro
- Harvard Pilgrim Health Care Institute and Department of Population Medicine, Harvard Medical School, Boston, MA, United States
| |
Collapse
|
6
|
Lewin B, Qian L, Huang R, Sy LS, Goddard K, Naleway AL, DeSilva M, Daley MF, McNeil MM, Jackson LA, Jacobsen SJ. Travelers and travel vaccines at six health care systems in the Vaccine Safety Datalink. Vaccine 2022; 40:5904-5911. [PMID: 36064668 PMCID: PMC10883331 DOI: 10.1016/j.vaccine.2022.08.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 08/04/2022] [Accepted: 08/11/2022] [Indexed: 11/18/2022]
Abstract
BACKGROUND Studying the safety of travel vaccines poses challenges since recipients may be traveling during the risk window for adverse events and the identification of a suitable comparison group can also be difficult. The examination of traveler characteristics, travel vaccination patterns, and health care utilization using electronic health record (EHR) data can inform the feasibility of future travel vaccine safety studies. METHODS A retrospective cohort study of health plan members in the Vaccine Safety Datalink Project aged 9 months and older who had a travel-related encounter or received a travel vaccine from 2009 to 2018 was performed. Travel regions visited, travel duration, type of travel vaccine received (typhoid, yellow fever, Japanese encephalitis, rabies, and cholera), and timing of vaccination date before departure date were described. Sociodemographic information, clinical characteristics, and health care utilization were compared between travelers who received travel vaccines and travelers who did not. RESULTS A total of 1,026,822 unique travelers departing from the United States were identified; 612,795 travelers received 898,196 doses of travel vaccines. The most commonly administered travel vaccine was typhoid vaccine and 77% of all travel vaccines were given more than one week prior to departure. Compared with travelers without travel vaccines, travelers with travel vaccines were overall similar but as a group were slightly younger, healthier, and had lower Hispanic representation. Health care utilization dramatically decreased during travel. Outpatient visits decreased from 294.8 visits per 10,000 person-days before travel to 24.2 visits per 10,000 person-days during reported travel dates. CONCLUSIONS Through the EHR information from almost a million travelers, a departure date and duration of travel were successfully captured for the majority of travelers with corresponding health care utilization data. Time after vaccination and prior to departure can potentially be used in the future to compare travelers who receive travel vaccines with travelers who do not receive travel vaccines when looking at adverse events of interest after vaccination.
Collapse
Affiliation(s)
- Bruno Lewin
- Department of Research & Evaluation, Kaiser Permanente Southern California, 100 S Los Robles, Pasadena, CA 91101, USA.
| | - Lei Qian
- Department of Research & Evaluation, Kaiser Permanente Southern California, 100 S Los Robles, Pasadena, CA 91101, USA
| | - Runxin Huang
- Department of Research & Evaluation, Kaiser Permanente Southern California, 100 S Los Robles, Pasadena, CA 91101, USA
| | - Lina S Sy
- Department of Research & Evaluation, Kaiser Permanente Southern California, 100 S Los Robles, Pasadena, CA 91101, USA
| | - Kristin Goddard
- Kaiser Permanente Vaccine Study Center, Kaiser Permanente Northern California, 1 Kaiser Plaza 16th Floor, Oakland, CA 94612, USA
| | - Allison L Naleway
- Center for Health Research, Kaiser Permanente Northwest, 3800 N. Interstate Ave, Portland, OR 97227, USA
| | - Malini DeSilva
- HealthPartners Institute, 8170 33rd Avenue South PO Box 1524, Minneapolis, MN 55440, USA
| | - Matthew F Daley
- Institute for Health Research, Kaiser Permanente Colorado, 10065 E. Harvard Suite 300, Denver, CO 8023, USA
| | - Michael M McNeil
- Immunization Safety Office, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA
| | - Lisa A Jackson
- Kaiser Permanente Washington Health Research Institute, 1730 Minor Ave Suite 1600, Seattle, WA 98101, USA
| | - Steven J Jacobsen
- Department of Research & Evaluation, Kaiser Permanente Southern California, 100 S Los Robles, Pasadena, CA 91101, USA
| |
Collapse
|
7
|
Yih WK, Kulldorff M, Dashevsky I, Maro JC. A Broad Safety Assessment of the Recombinant Herpes Zoster Vaccine. Am J Epidemiol 2022; 191:957-964. [PMID: 35152283 PMCID: PMC9071519 DOI: 10.1093/aje/kwac030] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2021] [Revised: 01/25/2022] [Accepted: 02/08/2022] [Indexed: 12/30/2022] Open
Abstract
The recombinant herpes zoster vaccine (RZV), approved as a 2-dose series in the United States in October 2017, has proven highly effective and generally safe. However, a small risk of Guillain-Barré syndrome after vaccination was identified after approval, and questions remain about other possible adverse events. This data-mining study assessed RZV safety in the United States using the self-controlled tree-temporal scan statistic, scanning data on thousands of diagnoses recorded during follow-up to detect any statistically unusual temporal clustering of cases within a large hierarchy of diagnoses. IBM MarketScan data on commercially insured persons at least 50 years of age receiving RZV between January 1, 2018, and May 5, 2020, were used, including 56 days of follow-up; 1,014,329 doses were included. Statistically significant clustering was found within a few days of vaccination for unspecified adverse effects, complications, or reactions to immunization or other medical substances/care; fever; unspecified allergy; syncope/collapse; cellulitis; myalgia; and dizziness/giddiness. These findings are consistent with the known safety profile of this and other injected vaccines. No cluster of Guillain-Barré syndrome was detected, possibly due to insufficient sample size. This signal-detection method has now been applied to 5 vaccines, with consistently plausible results, and seems a promising addition to vaccine-safety evaluation methods.
Collapse
Affiliation(s)
- W Katherine Yih
- Correspondence to Dr. W. Katherine Yih, Harvard Pilgrim Health Care Institute, 401 Park Drive, Suite 401 East, Boston, MA 02215 (e-mail: )
| | | | | | | |
Collapse
|
8
|
Safety surveillance of varicella vaccine using tree-temporal scan analysis. Vaccine 2021; 39:6378-6384. [PMID: 34561139 DOI: 10.1016/j.vaccine.2021.09.035] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2021] [Revised: 08/03/2021] [Accepted: 09/13/2021] [Indexed: 11/20/2022]
Abstract
IMPORTANCE Passive surveillance systems are susceptible to the under-reporting of adverse events (AE) and a lack of information pertaining to vaccinated populations. Conventional active surveillance focuses on predefined AEs. Advanced data mining tools could be used to identify unusual clusters of potential AEs after vaccination. OBJECTIVE To assess the feasibility of a novel tree-based statistical approach to the identification of AE clustering following the implementation of a varicella vaccination program among one-year-olds. SETTING AND PARTICIPANTS This nationwide safety surveillance was based on data from the Taiwan National Health Insurance database and National Immunization Information System for the period 2004 through 2014. The study population was children aged 12-35 months who received the varicella vaccine. EXPOSURE First-dose varicella vaccine. OUTCOMES AND MEASURES All incident ICD-9-CM diagnoses (emergency or inpatient departments) occurring 1-56 days after the varicella vaccination were classified within a hierarchical system of diagnosis categories using Multi-Level Clinical Classifications Software. A self-controlled tree-temporal data mining tool was then used to explore the incidence of AE clustering with a variety of potential risk intervals. The comparison interval consisted of days in the 56-day follow-up period that fell outside the risk interval. RESULTS Among 1,194,189 varicella vaccinees with no other same-day vaccinations, nine diagnoses with clustering features were categorized into four safety signals: fever on days 1-6 (attributable risk [AR] 38.5 per 100,000, p < 0.001), gastritis and duodenitis on days 1-2 (AR 5.9 per 100,000, p < 0.001), acute upper respiratory infection on days 1-5 (AR 11.0 per 100,000, p = 0.006), and varicella infection on days 1-9 (AR 2.7 per 100,000, p < 0.001). These safety profiles and their corresponding risk intervals have been identified in previous safety surveillance studies. CONCLUSIONS Unexpected clusters of AEs were not detected after the mass administration of childhood varicella vaccines in Taiwan. The tree-temporal statistical method is a feasible approach to the safety surveillance of vaccines in populations of young children.
Collapse
|
9
|
Yih WK, Kulldorff M, Dashevsky I, Maro JC. A Broad Safety Assessment of the 9-Valent Human Papillomavirus Vaccine. Am J Epidemiol 2021; 190:1253-1259. [PMID: 33558897 PMCID: PMC8245868 DOI: 10.1093/aje/kwab022] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 01/29/2021] [Accepted: 02/03/2021] [Indexed: 12/14/2022] Open
Abstract
Parents indicate that safety is their top concern about human papillomavirus (HPV) vaccination. A data-mining method not requiring prespecification of health outcome(s) or postexposure period(s) of potentially increased risk can be used to identify possible associations between an exposure and any of thousands of medically attended health outcomes; this method was applied to data on the 9-valent HPV vaccine (HPV9) to detect potential safety problems. Data on 9- to 26-year-olds who had received HPV9 vaccine between November 4, 2016, and August 5, 2018, inclusive, were extracted from the MarketScan database and analyzed for statistically significant clustering of incident diagnoses within the hierarchy of diagnoses coded using the International Classification of Diseases and temporally within the 1 year after vaccination, using the self-controlled tree-temporal scan statistic and TreeScan software. Only 56 days of postvaccination enrollment was required; subsequent follow-up was censored at disenrollment. Multiple testing was adjusted for. The analysis included 493,089 doses of HPV9. Almost all signals resulted from temporal confounding, not unexpected with a 1-year follow-up period. The only plausible signals were for nonspecific adverse events (e.g., injection-site reactions, headache) on days 1–2 after vaccination, with attributable risks as low as 1 per 100,000 vaccinees. Considering the broad scope of the evaluation and the high statistical power, the findings of no specific serious adverse events should provide reassurance about this vaccine’s safety.
Collapse
Affiliation(s)
- W Katherine Yih
- Correspondence to Dr. W. Katherine Yih, Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, 401 Park Drive, Suite 401 East, Boston, MA 02215 (e-mail: )
| | | | | | | |
Collapse
|
10
|
Cuesta Esteve I, Fernández Fernández P, López Palacios S, Menor Rodríguez MJ, Parra Vino H, Reyero Ortega B, Nieto Nevot ML, Drago Manchón G, López-Belmonte JL. Health care professionals' preference for a fully liquid, ready-to-use hexavalent vaccine in Spain. Prev Med Rep 2021; 22:101376. [PMID: 33996389 PMCID: PMC8105659 DOI: 10.1016/j.pmedr.2021.101376] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2020] [Revised: 02/09/2021] [Accepted: 03/21/2021] [Indexed: 11/30/2022] Open
Abstract
Biosafety devices are needed to safely administer vaccines. Use of “ready-to-use” vaccines can avoid biological accidents. Majority of nurses showed concerns about using lyophilized vaccines.
Vaccination is an effective health intervention for the prevention of infectious diseases. This study aims to evaluate the response provided by nurses toward the use of ready-to-use (RTU) formulations of hexavalent vaccines and measures to prevent errors during the vaccination process. This observational, descriptive, cross-sectional study took place from March to May 2018. It included 201 interviews with nurses from health centers in Madrid (70), Murcia (59), and Andalusia (72), who had administered RTU vaccines in the last 12 months. Approximately 91.6% of nurses provided a positive feedback for the use of RTU vaccines. The most significant concerns experienced by nurses were during the preparation and administration of vaccines; 84.1% versus 18.9% of nurses felt that the risk of making mistakes was lower while using RTU vaccines compared with non-reconstituted (lyophilized) vaccines, and 74.1% versus 22.4% of nurses felt ease at preparing RTU vaccines compared with lyophilized vaccines. A total of 66.7% of nurses believed that there were risks associated with the preparation of lyophilized vaccines (administration risk [42.8%] and risk of needle injury [42.3%]). Risk percentages reduced to 4% and 9.5%, respectively, with the use of the RTU vaccines. Therefore, nurses adopted an average of seven steps to reduce the risk of errors. The average time saved during the administration of the vaccines was 1.1 min. In summary, nurses highlighted the need for administering vaccines using RTU formulations for ensuring the safety of the recipients, preventing errors, and saving time during the vaccination process.
Collapse
Key Words
- DTPa HBV-IPV, diphtheria-tetanus-acellular pertussis-hepatitis B recombinant (adsorbed)-inactivated poliomyelitis-adsorbed conjugated Haemophilus influenzae type b vaccine
- DTaP, diphtheria, tetanus, and acellular pertussis (whooping cough)
- HB, hepatitis B
- HCP, healthcare professionals
- HPV, human papillomavirus
- Hib, Haemophilus influenzae type b
- ICC/ESOMAR, International Chamber of Commerce/European Society for Opinion and Market Research
- IPV, inactivated polio vaccine
- Lyophilized vaccines
- MM, measles, mumps
- MMR, measles, mumps, rubella
- Medication errors
- MenACWY, meningococcal conjugate vaccine
- MenC, meningococcal C vaccine
- PCV, pneumococcal conjugate vaccine
- Pediatric vaccination
- Primary healthcare
- RTU, ready-to-use
- Ready-to-use vaccines
- Td, tetanus, diphtheria
- Vaccination
- WHO, World Health Organization
Collapse
Affiliation(s)
- Inmaculada Cuesta Esteve
- Vaccine Expert Group of the General Council of Nurses, Calle Fuente del Rey, s/n, 28023 Madrid, Spain
| | | | - Sonia López Palacios
- Vaccine Expert Group of the General Council of Nurses, Calle Fuente del Rey, s/n, 28023 Madrid, Spain
| | | | - Hosanna Parra Vino
- Group of the General Council of Nurses, Calle Fuente del Rey, s/n, 28023 Madrid, Spain
| | - Begoña Reyero Ortega
- Group of the General Council of Nurses, Calle Fuente del Rey, s/n, 28023 Madrid, Spain
| | | | - Georgina Drago Manchón
- Sanofi Pasteur, Calle de Josep Pla, 2, 08019 Barcelona, Spain
- Corresponding author at: Sanofi Pasteur, Calle de Josep Pla, 2, 08019 Barcelona, Spain.
| | | |
Collapse
|
11
|
Fralick M, Kulldorff M, Redelmeier D, Wang SV, Vine S, Schneeweiss S, Patorno E. A novel data mining application to detect safety signals for newly approved medications in routine care of patients with diabetes. ENDOCRINOLOGY DIABETES & METABOLISM 2021; 4:e00237. [PMID: 34277962 PMCID: PMC8279599 DOI: 10.1002/edm2.237] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 01/17/2021] [Accepted: 01/23/2021] [Indexed: 12/24/2022]
Abstract
Background Clinical trials are often underpowered to detect serious but rare adverse events of a new medication. We applied a novel data mining tool to detect potential adverse events of canagliflozin, the first sodium glucose co‐transporter 2 (SGLT2 inhibitor) in the United States, using real‐world data from shortly after its market entry and before public awareness of its potential safety concerns. Methods In a U. S. commercial claims dataset (29 March 2013–30 Sept 2015), two pairwise cohorts of patients over 18 years of age with type 2 diabetes (T2D) who were newly dispensed canagliflozin or an active comparator, that is a dipeptidyl peptidase 4 inhibitor (DPP4) or a glucagon‐like peptide 1 receptor agonist (GLP1), were identified and propensity score‐matched. We used variable ratio matching with up to four people receiving a DPP4 or GLP1 for each person receiving canagliflozin. We identified potential safety signals using a hierarchical tree‐based scan statistic data mining method with the hierarchical outcome tree constructed based on international classification of disease coding. We screened for incident adverse events where there were more outcomes observed among canagliflozin vs. comparator initiators than expected by chance, after adjusting for multiple testing. Results We identified two pairwise propensity score variable ratio matched cohorts of 44,733 canagliflozin vs. 99,458 DPP4 initiators, and 55,974 canagliflozin vs. 74,727 GLP1 initiators. When we screened inpatient and emergency room diagnoses, diabetic ketoacidosis was the only severe adverse event associated with canagliflozin initiation with p < .05 in both cohorts. When outpatient diagnoses were also considered, signals for female and male genital infections emerged in both cohorts (p < .05). Conclusions and relevance In a large population‐based study, we identified known but no other adverse events associated with canagliflozin, providing reassurance on its safety among adult patients with T2D and suggesting the tree‐based scan statistic method is a useful post‐marketing safety monitoring tool for newly approved medications.
Collapse
Affiliation(s)
- Michael Fralick
- Division of Pharmacoepidemiology and Pharmacoeconomics Department of Medicine Brigham and Women's Hospital and Harvard Medical School Boston MA USA.,Sinai Health System and the Department of Medicine University of Toronto Toronto ON Canada
| | - Martin Kulldorff
- Division of Pharmacoepidemiology and Pharmacoeconomics Department of Medicine Brigham and Women's Hospital and Harvard Medical School Boston MA USA
| | - Donald Redelmeier
- Sunnybrook Research Institute Sunnybrook Health Sciences Centre Toronto ON Canada.,ICES Sunnybrook Health Sciences Centre Toronto ON Canada
| | - Shirley V Wang
- Division of Pharmacoepidemiology and Pharmacoeconomics Department of Medicine Brigham and Women's Hospital and Harvard Medical School Boston MA USA
| | - Seanna Vine
- Division of Pharmacoepidemiology and Pharmacoeconomics Department of Medicine Brigham and Women's Hospital and Harvard Medical School Boston MA USA
| | - Sebastian Schneeweiss
- Division of Pharmacoepidemiology and Pharmacoeconomics Department of Medicine Brigham and Women's Hospital and Harvard Medical School Boston MA USA
| | - Elisabetta Patorno
- Division of Pharmacoepidemiology and Pharmacoeconomics Department of Medicine Brigham and Women's Hospital and Harvard Medical School Boston MA USA
| |
Collapse
|
12
|
Kim HS, Engel S, Neveu D, Thollot Y, Oster P, Yang K. Post-Marketing Surveillance Observational Study of Quadrivalent Meningococcal Diphtheria Toxoid Conjugate Vaccine (MenACWY-DT, MCV4/Menactra ®) in the Republic of Korea, 2014-2019. Infect Dis Ther 2021; 10:399-409. [PMID: 33439463 PMCID: PMC7954957 DOI: 10.1007/s40121-020-00393-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 12/11/2020] [Indexed: 01/19/2023] Open
Abstract
Background Invasive meningococcal disease is a notifiable disease in the Republic of Korea. The meningococcal (groups A, C, Y, and W) polysaccharide diphtheria toxoid conjugate vaccine (MenACWY-DT, Menactra®) was licensed in the Republic of Korea in 2014. This post-marketing surveillance (PMS) observational study aims to assess the safety of MenACWY-DT administration of routine clinical care to individuals aged 9–23 months as a two-dose series at least 3 months apart and to individuals 2–55 years as a single dose. Methods The PMS observational study (NCT02864927) included participants aged 9 months to 55 years and who were given MenACWY-DT during routine healthcare visits. The study participants were followed-up for up to 30 days following vaccination (additional time was allowed for the visit or phone call to be conducted). Study outcomes included solicited and unsolicited adverse reactions, unexpected adverse events, and serious adverse events (SAEs). Results A total of 640 participants 9–23 months of age and 671 participants 2–55 years of age were eligible for safety analysis. Overall, AEs were reported by 35.3% of participants aged < 2 years and 45% of participants aged 2–55 years. Solicited adverse reactions were reported by 21.4% and 17.4% of participants aged < 2 years and 2–55 years, respectively. Unsolicited adverse reactions were reported by 26.1% and 37.9%, respectively. No vaccine-related SAEs occurred during the study. The AEs reported in Korean population were consistent with the known safety profile of MenACWY-DT, and most were of grade 1–2 in severity. Conclusions This study did not detect any unanticipated or new safety findings of concern with MenACWY-DT in either of the study age groups, and provides reassurance that MenACWY-DT can be used as part of routine immunization care for the prevention of invasive meningococcal disease. Trial Registration ClinicalTrials.gov Identifier, NCT02864927
Collapse
|
13
|
Becerra-Culqui TA, Sy LS, Solano Z, Tseng HF. Real-world evidence of quadrivalent meningococcal conjugate vaccine safety in the United States: a systematic review. Hum Vaccin Immunother 2020; 17:1432-1441. [PMID: 33327853 DOI: 10.1080/21645515.2020.1829412] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/22/2022] Open
Abstract
Two quadrivalent meningococcal conjugate vaccines (MenACWY) that prevent invasive meningococcal disease caused by N. meningitidis serogroups A, C, Y, and W have been licensed in the U.S. in the past 10-15 years. We systematically reviewed published studies conducted in the U.S. to evaluate the real-world safety evidence of meningococcal conjugate vaccines. We performed a literature search in PubMed of publications from 01/01/2005 to 02/29/2020 and identified 18 studies meeting inclusion criteria. Populations included high-risk persons aged 2 months to 10 years, adolescents/adults aged ≥11 years, pregnant populations, and hematopoietic cell transplant recipients. We extracted information about study setting, study design, exposure, outcomes, comparison group, follow-up/look back period, study population, sample size, available demographic/indication information, results, key conclusion, and reference. These published studies found no new significant safety concerns related to MenACWY. Consideration for future research includes a post-licensure safety evaluation of a new MenACWY product approved in April 2020.
Collapse
Affiliation(s)
- Tracy A Becerra-Culqui
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA, USA
| | - Lina S Sy
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA, USA
| | - Zendi Solano
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA, USA
| | - Hung Fu Tseng
- Department of Research and Evaluation, Kaiser Permanente Southern California, Pasadena, CA, USA
| |
Collapse
|
14
|
Wintzell V, Svanström H, Melbye M, Ludvigsson JF, Pasternak B, Kulldorff M. Data Mining for Adverse Events of Tumor Necrosis Factor-Alpha Inhibitors in Pediatric Patients: Tree-Based Scan Statistic Analyses of Danish Nationwide Health Data. Clin Drug Investig 2020; 40:1147-1154. [PMID: 33104987 PMCID: PMC7701063 DOI: 10.1007/s40261-020-00977-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/07/2020] [Indexed: 10/25/2022]
Abstract
BACKGROUND AND OBJECTIVES Tumor necrosis factor-alpha (TNF-α) inhibitors are efficacious and considered generally safe in adults. However, pediatric-specific safety evidence is scarce. The aim of this study was to screen for signals of previously unknown adverse events of TNF-α inhibitors in pediatric patients. METHODS We conducted a data-mining study based on routinely collected, nationwide Danish healthcare data for 2004-2016. Using tree-based scan statistics to identify events with unexpectedly high incidence during TNF-α inhibitor use among patients with inflammatory bowel disease or juvenile idiopathic arthritis, two analyses were performed: comparison with episodes of no use and with other time periods from the same patient. Based on incident physician-assigned diagnosis codes from outpatient and inpatient visits in specialist care, we screened thousands of potential adverse events while adjusting for multiple testing. RESULTS We identified 1310 episodes of new TNF-α inhibitor use that met the eligibility criteria. Two signals of adverse events of TNF-α inhibitors, as compared with no use, were detected. First, there were excess events of dermatologic complications (ICD-10: L00-L99, 87 vs. 44 events, risk difference [RD] 3.3%), which have been described previously in adults and children. Second, there were excess events of psychiatric diagnosis adjustment disorders (ICD-10: F432, 33 vs. 7 events, RD 2.0%), which was likely associated with the underlying disease and its severity, rather than with the treatment. The self-controlled analysis generated no signal. CONCLUSIONS No signals of previously unknown adverse events of TNF-α inhibitors in pediatric patients were detected. The study showed that real-world data and newly developed methods for adverse events data mining can play a particularly important role in pediatrics where pre-approval drug safety data are scarce.
Collapse
Affiliation(s)
- Viktor Wintzell
- Clinical Epidemiology Division T2, Department of Medicine Solna, Karolinska Institutet, 17176, Stockholm, Sweden.
| | - Henrik Svanström
- Clinical Epidemiology Division T2, Department of Medicine Solna, Karolinska Institutet, 17176, Stockholm, Sweden
- Department of Epidemiology Research, Statens Serum Institut, Copenhagen, Denmark
| | - Mads Melbye
- Department of Epidemiology Research, Statens Serum Institut, Copenhagen, Denmark
- Department of Clinical Medicine, University of Copenhagen, Copenhagen, Denmark
- Department of Medicine, Stanford University School of Medicine, Stanford, CA, USA
| | - Jonas F Ludvigsson
- Department Medical Epidemiology and Biostatistics, Karolinska Institutet, Stockholm, Sweden
- Department of Pediatrics, Örebro University Hospital, Örebro University, Örebro, Sweden
- Division of Epidemiology and Public Health, School of Medicine, University of Nottingham, Nottingham, UK
- Department of Medicine, Columbia University College of Physicians and Surgeons, New York, NY, USA
| | - Björn Pasternak
- Clinical Epidemiology Division T2, Department of Medicine Solna, Karolinska Institutet, 17176, Stockholm, Sweden
- Department of Epidemiology Research, Statens Serum Institut, Copenhagen, Denmark
| | - Martin Kulldorff
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Harvard Medical School and Brigham and Women's Hospital, Boston, MA, USA
| |
Collapse
|
15
|
Mbaeyi SA, Bozio CH, Duffy J, Rubin LG, Hariri S, Stephens DS, MacNeil JR. Meningococcal Vaccination: Recommendations of the Advisory Committee on Immunization Practices, United States, 2020. MMWR Recomm Rep 2020; 69:1-41. [PMID: 33417592 PMCID: PMC7527029 DOI: 10.15585/mmwr.rr6909a1] [Citation(s) in RCA: 113] [Impact Index Per Article: 28.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023] Open
Abstract
This report compiles and summarizes all recommendations from CDC's Advisory Committee on Immunization Practices (ACIP) for use of meningococcal vaccines in the United States. As a comprehensive summary and update of previously published recommendations, it replaces all previously published reports and policy notes. This report also contains new recommendations for administration of booster doses of serogroup B meningococcal (MenB) vaccine for persons at increased risk for serogroup B meningococcal disease. These guidelines will be updated as needed on the basis of availability of new data or licensure of new meningococcal vaccines. ACIP recommends routine vaccination with a quadrivalent meningococcal conjugate vaccine (MenACWY) for adolescents aged 11 or 12 years, with a booster dose at age 16 years. ACIP also recommends routine vaccination with MenACWY for persons aged ≥2 months at increased risk for meningococcal disease caused by serogroups A, C, W, or Y, including persons who have persistent complement component deficiencies; persons receiving a complement inhibitor (e.g., eculizumab [Soliris] or ravulizumab [Ultomiris]); persons who have anatomic or functional asplenia; persons with human immunodeficiency virus infection; microbiologists routinely exposed to isolates of Neisseria meningitidis; persons identified to be at increased risk because of a meningococcal disease outbreak caused by serogroups A, C, W, or Y; persons who travel to or live in areas in which meningococcal disease is hyperendemic or epidemic; unvaccinated or incompletely vaccinated first-year college students living in residence halls; and military recruits. ACIP recommends MenACWY booster doses for previously vaccinated persons who become or remain at increased risk.In addition, ACIP recommends routine use of MenB vaccine series among persons aged ≥10 years who are at increased risk for serogroup B meningococcal disease, including persons who have persistent complement component deficiencies; persons receiving a complement inhibitor; persons who have anatomic or functional asplenia; microbiologists who are routinely exposed to isolates of N. meningitidis; and persons identified to be at increased risk because of a meningococcal disease outbreak caused by serogroup B. ACIP recommends MenB booster doses for previously vaccinated persons who become or remain at increased risk. In addition, ACIP recommends a MenB series for adolescents and young adults aged 16-23 years on the basis of shared clinical decision-making to provide short-term protection against disease caused by most strains of serogroup B N. meningitidis.
Collapse
|
16
|
Myers TR, McNeil MM, Ng CS, Li R, Marquez PL, Moro PL, Omer SB, Cano MV. Adverse events following quadrivalent meningococcal diphtheria toxoid conjugate vaccine (Menactra®) reported to the Vaccine Adverse Event Reporting System (VAERS), 2005-2016. Vaccine 2020; 38:6291-6298. [PMID: 32747215 PMCID: PMC7495357 DOI: 10.1016/j.vaccine.2020.07.039] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Revised: 07/16/2020] [Accepted: 07/18/2020] [Indexed: 10/23/2022]
Abstract
BACKGROUND Post marketing safety evaluations of quadrivalent meningococcal diphtheria-toxoid conjugate vaccine (MenACWY-D) have focused on post-vaccination risk of Guillain Barré syndrome (GBS), adverse events (AEs) after maternal vaccination, and comparative studies with the newer quadrivalent meningococcal CRM197 conjugate vaccine (MenACWY-CRM). To provide an updated general safety assessment, we reviewed reports of AEs following MenACWY-D submitted to the Vaccine Adverse Event Reporting System (VAERS). METHODS VAERS is a national spontaneous reporting vaccine safety surveillance system co-administered by the Centers for Disease Control and Prevention and the U.S. Food and Drug Administration. We searched the VAERS database for U.S. reports of AEs after administration of MenACWY-D from January 2005 through June 2016. We conducted clinical reviews of serious reports after MenACWY-D administered alone, reports of MenACWY-D use during pregnancy, and reports of selected pre-specified outcomes. We screened for disproportionate reporting of AEs after MenACWY-D using empirical Bayesian data mining. RESULTS VAERS received 13,075 U.S. reports after receipt of MenACWY-D; most (86%) described vaccination in adolescents, were classified as non-serious (94%), and described AEs consistent with pre-licensure studies. We did not find any evidence that reported deaths were related to vaccination. In serious reports, GBS and meningococcal infection were the most commonly reported medical conditions. Many reports of MenACWY-D use during pregnancy described inadvertent vaccination; most (61%) did not report any AE. CONCLUSIONS Findings from our comprehensive review of reports to VAERS following MenACWY-D are consistent with data from pre-licensure studies and provide further reassurance on the safety of MenACWY-D.
Collapse
Affiliation(s)
- Tanya R Myers
- Division of Healthcare Quality Promotion, Immunization Safety Office, National Center for Emerging Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA.
| | - Michael M McNeil
- Division of Healthcare Quality Promotion, Immunization Safety Office, National Center for Emerging Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA
| | - Carmen S Ng
- Division of Healthcare Quality Promotion, Immunization Safety Office, National Center for Emerging Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA
| | - Rongxia Li
- Division of Healthcare Quality Promotion, Immunization Safety Office, National Center for Emerging Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA
| | - Paige L Marquez
- Division of Healthcare Quality Promotion, Immunization Safety Office, National Center for Emerging Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA
| | - Pedro L Moro
- Division of Healthcare Quality Promotion, Immunization Safety Office, National Center for Emerging Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA
| | - Saad B Omer
- Yale Institute for Global Health, 1 Church Street, New Haven, CT 06517, USA
| | - Maria V Cano
- Division of Healthcare Quality Promotion, Immunization Safety Office, National Center for Emerging Zoonotic Infectious Diseases, Centers for Disease Control and Prevention, 1600 Clifton Road NE, Atlanta, GA 30333, USA
| |
Collapse
|
17
|
Lee H, Kim JH, Choe YJ, Shin JY. Safety Surveillance of Pneumococcal Vaccine Using Three Algorithms: Disproportionality Methods, Empirical Bayes Geometric Mean, and Tree-Based Scan Statistic. Vaccines (Basel) 2020; 8:E242. [PMID: 32456068 PMCID: PMC7349998 DOI: 10.3390/vaccines8020242] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2020] [Revised: 05/14/2020] [Accepted: 05/19/2020] [Indexed: 12/05/2022] Open
Abstract
Introduction: Diverse algorithms for signal detection exist. However, inconsistent results are often encountered among the algorithms due to different levels of specificity used in defining the adverse events (AEs) and signal threshold. We aimed to explore potential safety signals for two pneumococcal vaccines in a spontaneous reporting database and compare the results and performances among the algorithms. Methods: Safety surveillance was conducted using the Korea national spontaneous reporting database from 1988 to 2017. Safety signals for pneumococcal vaccine and its subtypes were detected using the following the algorithms: disproportionality methods comprising of proportional reporting ratio (PRR), reporting odds ratio (ROR), and information component (IC); empirical Bayes geometric mean (EBGM); and tree-based scan statistics (TSS). Moreover, the performances of these algorithms were measured by comparing detected signals with the known AEs or pneumococcal vaccines (reference standard). Results: Among 10,380 vaccine-related AEs, 1135 reports and 101 AE terms were reported following pneumococcal vaccine. IC generated the most safety signals for pneumococcal vaccine (40/101), followed by PRR and ROR (19/101 each), TSS (15/101), and EBGM (1/101). Similar results were observed for its subtypes. Cellulitis was the only AE detected by all algorithms for pneumococcal vaccine. TSS showed the best balance in the performance: the highest in accuracy, negative predictive value, and area under the curve (70.3%, 67.4%, and 64.2%). Conclusion: Discrepancy in the number of detected signals was observed between algorithms. EBGM and TSS calibrated noise better than disproportionality methods, and TSS showed balanced performance. Nonetheless, these results should be interpreted with caution due to a lack of a gold standard for signal detection.
Collapse
Affiliation(s)
- Hyesung Lee
- School of Pharmacy, Sungkyunkwan University, Suwon 16419, Korea; (H.L.); (J.H.K.)
| | - Ju Hwan Kim
- School of Pharmacy, Sungkyunkwan University, Suwon 16419, Korea; (H.L.); (J.H.K.)
| | - Young June Choe
- College of Medicine, Hallym University, Chuncheon 24252, Korea;
| | - Ju-Young Shin
- School of Pharmacy, Sungkyunkwan University, Suwon 16419, Korea; (H.L.); (J.H.K.)
- Samsung Advanced Institute for Health Sciences and Technology (SAIHST), Sungkyunkwan University, Seoul 06355, Korea
| |
Collapse
|
18
|
Bacillus Calmette–Guérin (BCG) vaccine safety surveillance in the Korea Adverse Event Reporting System using the tree-based scan statistic and conventional disproportionality-based algorithms. Vaccine 2020; 38:3702-3710. [DOI: 10.1016/j.vaccine.2020.04.007] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2019] [Revised: 04/01/2020] [Accepted: 04/03/2020] [Indexed: 12/16/2022]
|
19
|
Schachterle SE, Hurley S, Liu Q, Petronis KR, Bate A. An Implementation and Visualization of the Tree-Based Scan Statistic for Safety Event Monitoring in Longitudinal Electronic Health Data. Drug Saf 2020; 42:727-741. [PMID: 30617498 DOI: 10.1007/s40264-018-00784-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
INTRODUCTION Longitudinal electronic healthcare data hold great potential for drug safety surveillance. The tree-based scan statistic (TBSS), as implemented by the TreeScan® software, allows for hypothesis-free signal detection in longitudinal data by grouping safety events according to branching, hierarchical data coding systems, and then identifying signals of disproportionate recording (SDRs) among the singular events or event groups. OBJECTIVE The objective of this analysis was to identify and visualize SDRs with the TBSS in historical data from patients using two antifungal drugs, itraconazole or terbinafine. By examining patients who used either itraconazole or terbinafine, we provide a conceptual replication of a previous TBSS analyses by varying methodological choices and using a data source that had not been previously used with the TBSS, i.e., the Optum Clinformatics™ claims database. With this analysis, we aimed to test a parsimonious design that could be the basis of a broadly applicable method for multiple drug and safety event pairs. METHODS The TBSS analysis was used to examine incident events and any itraconazole or terbinafine use among US-based patients from 2002 through 2007. Event frequencies before and after the first day of drug exposure were compared over 14- and 56-day periods of observation in a Bernoulli model with a self-controlled design. Safety events were classified into a hierarchical tree structure using the Clinical Classifications Software (CCS) which mapped International Classification of Diseases, 9th Revision (ICD-9) codes to 879 diagnostic groups. Using the TBSS, the log likelihood ratio of observed versus expected events in all groups along the CCS hierarchy were compared, and groups of events that occurred at disproportionally high frequencies were identified as potential SDRs; p-values for the potential SDRs were estimated with Monte-Carlo permutation based methods. Output from TreeScan® was visualized and plotted as a network which followed the CCS tree structure. RESULTS Terbinafine use (n = 223,968) was associated with SDRs for diseases of the circulatory system (14- and 56-day p = 0.001) and heart (14-day p = 0.026 and 56-day p = 0.001) as well as coronary atherosclerosis and other heart disease (14-day p = 0.003 and 56-day p = 0.004). For itraconazole use (n = 36,025), the TBSS identified SDRs for coronary atherosclerosis and other heart disease (p = 0.002) and complications of an implanted or grafted device (14-day p = 0.001 and 56-day p < 0.05). Use of both drugs was associated with SDRs for diseases of the digestive system at 14 days (p < 0.05) and this SDR had been observed among terbinafine users in a previous TBSS analysis with a different data source. The TreeScan® visualization facilitated the identification of the atherosclerosis and other heart disease SDRs as well as highlighting the consistency of the SDR for diseases of the digestive system across drugs and data sources. CONCLUSION With the TBSS, we identified potential SDRs related to the circulatory system that may reflect the cardiac risk that was described in the itraconazole product label. SDRs for diseases of the digestive system among terbinafine users were also reported in a previous signal detection analysis, although other SDRs from the previous publications were not replicated. The TBSS visualizations aided in the understanding and interpretation of the TBSS output, including the comparisons to the previous publications. In this conceptual replication, differences in the results observed in our analysis and the previous analyses could be attributable to variation in modeling and design choices as well as factors that were intrinsic to the underlying data sources. The broad consistency, but far from perfect concordance, of our results with the known safety profile of these antifungals including the risks from the itraconazole product label supports the rationale for continued investigations of signal detection methods across differing data sources and populations.
Collapse
Affiliation(s)
- Stephen E Schachterle
- Worldwide Safety and Regulatory, Pfizer Inc., 219 E. 42nd St, New York, NY, 10017, USA.
- City University of New York Graduate School of Public Health and Health Policy, 55 W 125th Street, New York, NY, 10027, USA.
| | - Sharon Hurley
- Worldwide Safety and Regulatory, Pfizer Inc., 219 E. 42nd St, New York, NY, 10017, USA
| | - Qing Liu
- Worldwide Safety and Regulatory, Pfizer Inc., 219 E. 42nd St, New York, NY, 10017, USA
| | - Kenneth R Petronis
- Worldwide Safety and Regulatory, Pfizer Inc., 219 E. 42nd St, New York, NY, 10017, USA
| | - Andrew Bate
- Worldwide Safety and Regulatory, Pfizer Inc., 219 E. 42nd St, New York, NY, 10017, USA
| |
Collapse
|
20
|
Yih WK, Kulldorff M, Dashevsky I, Maro JC. Using the Self-Controlled Tree-Temporal Scan Statistic to Assess the Safety of Live Attenuated Herpes Zoster Vaccine. Am J Epidemiol 2019; 188:1383-1388. [PMID: 31062840 DOI: 10.1093/aje/kwz104] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2019] [Revised: 04/22/2019] [Accepted: 04/23/2019] [Indexed: 12/13/2022] Open
Abstract
The self-controlled tree-temporal scan statistic allows detection of potential vaccine- or drug-associated adverse events without prespecifying the specific events or postexposure risk intervals of concern. It thus opens a promising new avenue for safety studies. The method has been successfully used to evaluate the safety of 2 vaccines for adolescents and young adults, but its suitability to study vaccines for older adults had not been established. The present study applied the method to assess the safety of live attenuated herpes zoster vaccination during 2011-2017 in US adults aged ≥60 years, using claims data from Truven Health MarketScan Research Databases. Counts of International Classification of Diseases diagnosis codes recorded in emergency department or hospital settings were scanned for any statistically unusual clustering within a hierarchical tree structure of diagnoses and within 42 days after vaccination. Among 1.24 million vaccinations, 4 clusters were found: cellulitis on days 1-3, nonspecific erythematous condition on days 2-4, "other complications . . ." on days 1-3, and nonspecific allergy on days 1-6. These results are consistent with local injection-site reactions and other known, generally mild, vaccine-associated adverse events and a favorable safety profile. This method might be useful for assessing the safety of other vaccines for older adults.
Collapse
Affiliation(s)
- W Katherine Yih
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts
| | - Martin Kulldorff
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Harvard Medical School and Brigham and Women’s Hospital, Boston, Massachusetts
| | - Inna Dashevsky
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts
| | - Judith C Maro
- Department of Population Medicine, Harvard Medical School and Harvard Pilgrim Health Care Institute, Boston, Massachusetts
| |
Collapse
|
21
|
Pottegård A, Hallas J, Wang SV, Gagne JJ. Identifying signals of interest when screening for drug-outcome associations in health care data. Br J Clin Pharmacol 2018; 84:1865-1867. [PMID: 29862551 DOI: 10.1111/bcp.13634] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2018] [Revised: 05/03/2018] [Accepted: 05/03/2018] [Indexed: 12/25/2022] Open
Affiliation(s)
- Anton Pottegård
- Clinical Pharmacology and Pharmacy, Department of Public Health, University of Southern Denmark, Odense, Denmark
| | - Jesper Hallas
- Clinical Pharmacology and Pharmacy, Department of Public Health, University of Southern Denmark, Odense, Denmark
| | - Shirley V Wang
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| | - Joshua J Gagne
- Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women's Hospital and Harvard Medical School, Boston, MA, USA
| |
Collapse
|