Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews
Takehiko Oami;
Yohei Okada;
Taka-aki Nakada
ABSTRACT
This study compared the accuracy and efficiency of GPT-3.5 Turbo and GPT-4 Turbo in citation screening for systematic reviews in critical care. We used the data from the Japanese Clinical Practice Guidelines for Management of Sepsis and Septic Shock 2024. GPT-4 Turbo demonstrated superior specificity (0.98) compared to GPT-3.5 Turbo (0.51), with comparable sensitivity (0.85 vs. 0.83). GPT-3.5 Turbo processed 100 studies slightly faster than GPT-4 Turbo (0.9 vs. 1.6 minutes). GPT-4 Turbo may be more suitable in screening citations due to its higher specificity. This study highlights the potential of large language models in optimizing literature selection processes.
Citation
Please cite as:
Oami T, Okada Y, Nakada Ta
GPT-3.5 Turbo and GPT-4 Turbo in Title and Abstract Screening for Systematic Reviews