Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Public Health and Surveillance

Date Submitted: Nov 24, 2022
Date Accepted: May 3, 2023

The final, peer-reviewed published version of this preprint can be found here:

Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study

Archambault PM, Rosychuk RJ, Audet M, Bola R, Vatanpour S, Brooks SC, Daoust R, Clark G, Grant L, Vaillancourt S, Welsford M, Morrison L, Hohl C, Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN) investigators , Network of Canadian Emergency Researchers , Canadian Critical Care Trials Group

Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study

JMIR Public Health Surveill 2023;9:e44465

DOI: 10.2196/44465

PMID: 37327046

PMCID: 10278735

Accuracy of Self-Reported COVID-19 Vaccination Status Compared to a Public Health Vaccination Registry: Observational Diagnostic Study in Québec

  • Patrick M Archambault; 
  • Rhonda J Rosychuk; 
  • Martyne Audet; 
  • Rajan Bola; 
  • Shabnam Vatanpour; 
  • Steven C Brooks; 
  • Raoul Daoust; 
  • Gregory Clark; 
  • Lars Grant; 
  • Samuel Vaillancourt; 
  • Michelle Welsford; 
  • Laurie Morrison; 
  • Corinne Hohl; 
  • Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN) investigators; 
  • Network of Canadian Emergency Researchers; 
  • Canadian Critical Care Trials Group

ABSTRACT

Background:

Accuracy of self-reported vaccination status is important to guide real-world vaccine effectiveness studies in jurisdictions where access to electronic vaccine registries is restricted.

Objective:

Determine the accuracy of self-reported vaccination status.

Methods:

This study was a diagnostic accuracy study completed by the Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN). We compared the self-reported vaccination status of 1,361 patients diagnosed with COVID-19 who presented to one of four emergency departments (EDs) with their vaccination status in the electronic Québec Vaccination Registry. Our primary outcome was the accuracy of self-reported vaccination status (index test) ascertained during phone follow-up compared to the Québec Vaccination Registry (reference standard). Accuracy was calculated by dividing all correctly self-reported vaccinated and unvaccinated participants by the sum of all correctly and incorrectly self-reported vaccinated and unvaccinated participants. We also report inter-rater agreement with the reference standard as measured by unweighted Cohen’s Kappa for self-reported vaccination status at phone follow-up and at the time of their index ED visit, number of vaccine doses, and brand.

Results:

The accuracy of the self-reported vaccination status was 96% (95% CI: 95-97). Cohen’s Kappa for self-reported vaccination status at phone follow-up was 0.91 (0.89-0.93) and 0.85 (0.77, 0.92) at the time of their index ED visit. Cohen’s Kappa was: 0.89 (0.87-0.91) for the number of doses, 0.80 (0.75-0.84) for the brand of Dose 1, 0.76 (0.70-0.83) for Dose 2, and 0.59 (0.34, 0.83) for Dose 3.

Conclusions:

We report high accuracy of self-reported vaccination status for adult ED patients. The inter-rater agreement between self-reported number of doses and vaccination status was strong. Although the agreement for self-reported brand was strong when one dose was reported, the agreement decreased with repeat doses. Clinical Trial: Clinicaltrials.gov NCT04702945


 Citation

Please cite as:

Archambault PM, Rosychuk RJ, Audet M, Bola R, Vatanpour S, Brooks SC, Daoust R, Clark G, Grant L, Vaillancourt S, Welsford M, Morrison L, Hohl C, Canadian COVID-19 Emergency Department Rapid Response Network (CCEDRRN) investigators , Network of Canadian Emergency Researchers , Canadian Critical Care Trials Group

Accuracy of Self-Reported COVID-19 Vaccination Status Compared With a Public Health Vaccination Registry in Québec: Observational Diagnostic Study

JMIR Public Health Surveill 2023;9:e44465

DOI: 10.2196/44465

PMID: 37327046

PMCID: 10278735

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.