Currently submitted to: JMIR Medical Education
Date Submitted: Sep 15, 2026
Open Peer Review Period: Sep 16, 2026 - Nov 11, 2026
(closed for review but you can still tweet)
NOTE: This is an unreviewed Preprint
Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).
Peer review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.
Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).
Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.
Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.
Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Can a Brief Introduction to Citation Searching Improve Literature-Searching Performance in Undergraduate Medical Students? A Pragmatic Controlled Quasi-Experimental Study
ABSTRACT
Background:
Identifying and selecting relevant scientific evidence is central to evidence-based medicine but challenging to teach early in medical training. Educational interventions have shown inconsistent effects on objectively measured performance, leaving limited evidence on how to improve students’ practical evidence retrieval and selection.
Objective:
To evaluate whether adding a brief introduction to citation searching to standard literature-searching instruction improves the relevance and methodological quality of evidence selected by undergraduate medical students.
Methods:
We conducted a pragmatic controlled quasi-experimental study among second-year medical students in Lille, France. Two pre-existing teaching sessions received the same 45-minute standard literature-searching course. Control students completed the study assessment before, and intervention students after, an additional 15-minute introduction to citation searching, including its automation using BibliZap. BibliZap is an open-source tool for automated multilevel forward and backward citation searching. Students searched 1 of 6 randomly assigned clinical questions for 30 minutes and submitted up to 10 references; BibliZap use was optional and tracked. Two blinded experts independently evaluated academic articles. The primary outcome was the rate of expert top picks, defined as references experts considered particularly important for the assigned question; secondary outcomes assessed relevance and quality. Intention-to-teach analyses compared assigned groups irrespective of BibliZap use; per-use analyses compared controls with intervention students who used BibliZap. Models accounted for the number of references submitted and were adjusted for prespecified participant characteristics.
Results:
Among 450 participating students (79.1% of the class), 222 were controls and 228 intervention students; 71 (31%) intervention students used BibliZap. Median search duration was 21 minutes in both groups (Q1-Q3, 14-28 and 15-27), and the median number of references submitted was 7 (Q1-Q3, 6-8 and 6-9, respectively). In intention-to-teach analyses, citation-searching training increased expert top picks by 14% (incidence rate ratio [IRR] 1.14, 95% CI 1.04-1.25; P=.006), articles experts would include in a talk (IRR 1.10, 95% CI 1.03-1.18; P=.003), and mean relevance grade (+0.30/10, 95% CI 0.20-0.40; P<.001). For expert top picks, the IRR was 1.09 (95% CI 0.98-1.21) with no tracked BibliZap use, 1.24 (95% CI 1.09-1.41) with at least 1 seed, and 1.37 (95% CI 1.14-1.66) with at least 2 seeds. The intervention also reduced nonacademic references by 51% (IRR 0.49, 95% CI 0.33-0.74) and students selected articles with greater methodological rigor (proportional odds ratio 1.42, 95% CI 1.16-1.74; both P<.001).
Conclusions:
Adding a brief introduction to citation searching to standard literature-searching instruction improved the relevance and quality of evidence selected by undergraduate medical students. These findings support citation searching as a practical component of early literature-searching education and warrant evaluation of whether its benefits persist and generalize beyond a single teaching session.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.