1
|
Archambault PM, Rosychuk RJ, Audet M, Bola R, Vatanpour S, Brooks SC, Daoust R, Clark G, Grant L, Vaillancourt S, Welsford M, Morrison LJ, Hohl CM. Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study. JMIR Public Health Surveill 2023; 9:e44465. [PMID: 37327046 DOI: 10.2196/44465] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 04/11/2023] [Accepted: 05/03/2023] [Indexed: 06/17/2023] Open
Abstract
BACKGROUND The accuracy of self-reported vaccination status is important to guide real-world vaccine effectiveness studies and policy making in jurisdictions where access to electronic vaccine registries is restricted. OBJECTIVE This study aimed to determine the accuracy of self-reported vaccination status and reliability of the self-reported number of doses, brand, and time of vaccine administration. METHODS This diagnostic accuracy study was completed by the Canadian COVID-19 Emergency Department Rapid Response Network. We enrolled consecutive patients presenting to 4 emergency departments (EDs) in Québec between March 24, 2020, and December 25, 2021. We included adult patients who were able to consent, could speak English or French, and had a proven COVID-19 infection. We compared the self-reported vaccination status of the patients with their vaccination status in the electronic Québec Vaccination Registry. Our primary outcome was the accuracy of the self-reported vaccination status (index test) ascertained during telephone follow-up compared with the Québec Vaccination Registry (reference standard). The accuracy was calculated by dividing all correctly self-reported vaccinated and unvaccinated participants by the sum of all correctly and incorrectly self-reported vaccinated and unvaccinated participants. We also reported interrater agreement with the reference standard as measured by unweighted Cohen κ for self-reported vaccination status at telephone follow-up and at the time of their index ED visit, number of vaccine doses, and brand. RESULTS During the study period, we included 1361 participants. At the time of the follow-up interview, 932 participants reported at least 1 dose of a COVID-19 vaccine. The accuracy of the self-reported vaccination status was 96% (95% CI 95%-97%). Cohen κ for self-reported vaccination status at phone follow-up was 0.91 (95% CI 0.89-0.93) and 0.85 (95% CI 0.77-0.92) at the time of their index ED visit. Cohen κ was 0.89 (95% CI 0.87-0.91) for the number of doses, 0.80 (95% CI 0.75-0.84) for the brand of the first dose, 0.76 (95% CI 0.70-0.83) for the brand of the second dose, and 0.59 (95% CI 0.34-0.83) for the brand of the third dose. CONCLUSIONS We reported a high accuracy of self-reported vaccination status for adult patients without cognitive disorders who can express themselves in English or French. Researchers can use self-reported COVID-19 vaccination data on the number of doses received, vaccine brand name, and timing of vaccination to guide future research with patients who are capable of self-reporting their vaccination data. However, access to official electronic vaccine registries is still needed to determine the vaccination status in certain susceptible populations where self-reported vaccination data remain missing or impossible to obtain. TRIAL REGISTRATION Clinicaltrials.gov NCT04702945; https://clinicaltrials.gov/ct2/show/NCT04702945.
Collapse
Affiliation(s)
- Patrick M Archambault
- Department of Family Medicine and Emergency Medicine, Université Laval, Québec, QC, Canada
- Centre de recherche intégrée pour un système de santé apprenant en santé et services sociaux, Centre intégré de santé et services sociaux de Chaudière-Appalaches, Lévis, QC, Canada
- VITAM - Centre de recherche en santé durable, Québec, QC, Canada
- Department of Anesthesiology and Intensive Care, Université Laval, Québec, QC, Canada
| | - Rhonda J Rosychuk
- Department of Pediatrics, Faculty of Medicine & Dentistry, University of Alberta, Edmonton, AB, Canada
| | - Martyne Audet
- Centre de recherche intégrée pour un système de santé apprenant en santé et services sociaux, Centre intégré de santé et services sociaux de Chaudière-Appalaches, Lévis, QC, Canada
| | - Rajan Bola
- Department of Emergency Medicine, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| | - Shabnam Vatanpour
- Center for Health Informatics, Cumming School of Medicine, University of Calgary, Calgary, AB, Canada
| | - Steven C Brooks
- Department of Emergency Medicine, Queen's University, Kingston, ON, Canada
| | - Raoul Daoust
- Department of Family Medicine and Emergency Medicine, Université de Montréal, Montréal, QC, Canada
| | - Gregory Clark
- Department of Emergency Medicine, Faculty of Medicine, McGill University, Montréal, QC, Canada
| | - Lars Grant
- Department of Emergency Medicine, Faculty of Medicine, McGill University, Montréal, QC, Canada
- Lady Davis Institute for Medical Research, Jewish General Hospital, Montréal, QC, Canada
| | - Samuel Vaillancourt
- Department of Emergency Medicine, Li Ka Shing Knowledge Institute, St Michael's Hospital, Unity Health Toronto, Toronto, ON, Canada
- Department of Medicine, University of Toronto, Toronto, ON, Canada
| | - Michelle Welsford
- Division of Emergency Medicine, Department of Medicine, McMaster University, Hamilton, ON, Canada
| | - Laurie J Morrison
- Division of Emergency Medicine, Department of Medicine, University of Toronto, Toronto, ON, Canada
- Department of Emergency Services, Sunnybrook Health Sciences Centre, Toronto, ON, Canada
| | - Corinne M Hohl
- Department of Emergency Medicine, Faculty of Medicine, University of British Columbia, Vancouver, BC, Canada
| |
Collapse
|