Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Mar 13, 2024
Open Peer Review Period: Mar 13, 2024 - May 8, 2024
Date Accepted: Jan 29, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

The AI Reviewer: Evaluating AI’s Role in Citation Screening for Streamlined Systematic Reviews

Ghossein J, Hryciw BN, Ramsay T, Kyeremanteng K

The AI Reviewer: Evaluating AI’s Role in Citation Screening for Streamlined Systematic Reviews

JMIR Form Res 2025;9:e58366

DOI: 10.2196/58366

PMID: 40153601

PMCID: 11970706

The AI Reviewer: Evaluating AI’s Role in Citation Screening for Streamlined Systematic Reviews

  • Jamie Ghossein; 
  • Brett N. Hryciw; 
  • Tim Ramsay; 
  • Kwadwo Kyeremanteng

ABSTRACT

This study serves as an exploratory analysis of the efficacy of various large language models in a direct comparison of automated title and abstract screening for systematic reviews and demonstrates promising but variable agreement levels with human reviewers emphasizing the importance of model selection for systematic review.


 Citation

Please cite as:

Ghossein J, Hryciw BN, Ramsay T, Kyeremanteng K

The AI Reviewer: Evaluating AI’s Role in Citation Screening for Streamlined Systematic Reviews

JMIR Form Res 2025;9:e58366

DOI: 10.2196/58366

PMID: 40153601

PMCID: 11970706

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.