Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Sep 29, 2022
Date Accepted: Nov 30, 2022
Date Submitted to PubMed: Dec 1, 2022

The final, peer-reviewed published version of this preprint can be found here:

How COVID-19 Affected the Journal Impact Factor of High Impact Medical Journals: Bibliometric Analysis

Giannos P, Delardas O

How COVID-19 Affected the Journal Impact Factor of High Impact Medical Journals: Bibliometric Analysis

J Med Internet Res 2022;24(12):e43089

DOI: 10.2196/43089

PMID: 36454727

PMCID: 9778719

The Great Inflation: How COVID-19 affected the Journal Impact Factor of high impact medical journals

  • Panagiotis Giannos; 
  • Orestis Delardas

ABSTRACT

The journal impact factor (IF) is the leading method of scholarly assessment in today’s research world, influencing where scholars submit their research and funders distribute their resources. The Coronavirus disease 2019 (COVID-19), one of the most serious health crises, resulted in an unprecedented surge of publications across all areas of knowledge. An important question is whether COVID-19 affected the “gold standard of scholarly assessment”. We took as an example six high impact general medicine journals (Annals, BMJ, Lancet, Nature, NEJM and JAMA) and searched the literature using the Web of Science database for manuscripts published between January 1, 2019 and December 31, 2021. To assess the effect of COVID-19 and non-COVID-19 literature in their scholarly impact, we calculated their annual IFs and percentage changes. Thereafter, we estimated the citation probability of COVID-19 and non-COVID-19 publications along with their publication and citation rates by journal. A significant increase in IF change for COVID-19 manuscripts published from 2019 to 2020 was seen, against non-COVID-19 ones. The likelihood of highly cited publications was significantly increased in COVID-19 manuscripts from 2019 to 2021.The publication and citation rates of COVID-19 publications followed a positive trajectory, as opposed to non-COVID-19. The citation rate for COVID-19 publications peaked 10 months earlier than the publication rate. The rapid surge of COVID-19 publications emphasised the capacity of scientific communities to respond against a global health emergency, yet inflated IFs create ambiguity as benchmark tools for assessing scholarly impact. The immediate implication is a loss in value of and trust on journal IFs as metrics of research and scientific rigour perceived by academia and the society. Loss of confidence towards procedures employed by highly reputable publishers may incentivise authors to exploit the publication process by monopolising their research on COVID-19 and encourage them towards publishing in journals of predatory behaviour.


 Citation

Please cite as:

Giannos P, Delardas O

How COVID-19 Affected the Journal Impact Factor of High Impact Medical Journals: Bibliometric Analysis

J Med Internet Res 2022;24(12):e43089

DOI: 10.2196/43089

PMID: 36454727

PMCID: 9778719

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.