Accepted for/Published in: JMIR Medical Informatics
Date Submitted: Feb 17, 2020
Date Accepted: Jan 17, 2021
Date Submitted to PubMed: Jan 18, 2021
Automated Identification of Common Disease-Specific Outcomes for Comparative Effectiveness Research Using ClinicalTrials.gov
ABSTRACT
Background:
Common diseases-specific outcomes (CDO) are vital for ensuring comparability of clinical trial data and enabling meta analyses and inter-study comparisons. Traditionally, the process of deciding which outcomes should be recommended as common for a particular disease relied on assembling and surveying panels of subject-matter experts. This is usually a time-consuming and laborious process.
Objective:
The objectives of this work are to develop and evaluate a generalized pipeline that can automatically identify common outcomes specific to any given disease by finding, downloading, and analyzing data of previous clinical trials relevant to that disease.
Methods:
An automated pipeline to interface with ClinicalTrials.gov’s API and download the relevant trials for the input condition was designed. The primary and secondary outcomes of those trials were parsed and grouped based on text similarity and ranked based on frequency. The quality and usefulness of the pipeline’s output were assessed by comparing the top outcomes identified by it for Chronic Obstructive Pulmonary Disease (COPD) to a list of 80 outcomes manually abstracted from the most frequently cited and comprehensive reviews delineating clinical outcomes for COPD.
Results:
The CDO pipeline successfully downloaded and processed 3,876 studies related to COPD. Manual verification indicated that the pipeline was downloading and processing the same number of trials as were obtained from the self-service ClinicalTrials.gov portal. Evaluating the automatically identified outcomes against the manually abstracted ones showed the pipeline achieved recall of 92% and precision of 79%. The precision number indicated that the pipeline was identifying many outcomes that are not covered in the literature reviews. Assessment of those outcomes indicated that they are relevant to COPD and could be considered in future research.
Conclusions:
An automated evidence-based pipeline can identify common clinical trial outcomes of comparable breadth and quality as the outcomes identified in comprehensive literature reviews. Moreover, such an approach can highlight relevant outcomes for further consideration.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.