Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Dec 6, 2021
Date Accepted: Jul 14, 2022

The final, peer-reviewed published version of this preprint can be found here:

A Data-Driven Reference Standard for Adverse Drug Reaction (RS-ADR) Signal Assessment: Development and Validation

Lee S, Lee JH, Kim GJ, Kim JY, Shin H, Ko I, Choe S, Kim J

A Data-Driven Reference Standard for Adverse Drug Reaction (RS-ADR) Signal Assessment: Development and Validation

J Med Internet Res 2022;24(10):e35464

DOI: 10.2196/35464

PMID: 36201386

PMCID: 9585444

Development of a Data-Driven Reference Standard for Adverse Drug Reaction (RS-ADR) Signal Assessment

  • Suehyun Lee; 
  • Jeong Hoon Lee; 
  • Grace Juyun Kim; 
  • Jong-Yeup Kim; 
  • Hyunah Shin; 
  • Inseok Ko; 
  • Seon Choe; 
  • Juhan Kim

ABSTRACT

Background:

Pharmacovigilance using real-world data (RWD), such as multicenter electronic health records (EHRs), yields massively parallel adverse drug reaction (ADR) signals. However, proper validation of computationally detected ADR signals is not possible due to the lack of a reference standard for positive and negative associations.

Objective:

To develop a reference standard for ADR (RS-ADR) to streamline the systematic detection, assessment, and understanding of almost all drug-ADR associations suggested by RWD analyses.

Methods:

We integrated well-known reference sets for drug-ADR pairs, including Side Effect Resource (SIDER), Observational Medical Outcomes Partnership, and EU-ADR. We created a pharmacovigilance dictionary using controlled vocabularies and systematically annotated EHR data. Drug-ADR associations computed from MetaLAB and MetaNurse analyses of multicenter EHRs and extracted from the FDA Adverse Event Reporting System (FAERS) were integrated as ‘empirically determined’ positive and negative reference sets by means of cross-validation between institutions.

Results:

The RS-ADR consisted of 1,344 drugs, 4,485 ADRs, and 6,027,840 drug-ADR pairs with positive and negative consensus votes as pharmacovigilance reference sets. After curation of the initial version of RS-ADR, novel ADR signals such as ‘famotidine’-‘hepatic function abnormal’ were detected and reasonably validated by RS-ADR. While the validation of the entire reference standard is challenging, especially with this initial version, the reference standard will improve as more RWD participate in the consensus voting with advanced pharmacovigilance dictionaries and analytic algorithms. One can check if a drug-ADR pair has been reported by our web-based search interface for RS-ADRs available at https://bioemr2.snubi.org:19108/.

Conclusions:

RS-ADRs enriched with the pharmacovigilance dictionary, ADR knowledge, and real-world evidence from EHRs may streamline the systematic detection, evaluation, and causality assessment of computationally detected ADR signals.


 Citation

Please cite as:

Lee S, Lee JH, Kim GJ, Kim JY, Shin H, Ko I, Choe S, Kim J

A Data-Driven Reference Standard for Adverse Drug Reaction (RS-ADR) Signal Assessment: Development and Validation

J Med Internet Res 2022;24(10):e35464

DOI: 10.2196/35464

PMID: 36201386

PMCID: 9585444

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.