Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Mar 27, 2026
Date Accepted: Oct 8, 2026

The final, peer-reviewed published version of this preprint can be found here:

Detecting Invisible Triangular Citations in Biomedical Research Using a Dual-Threshold Framework Based on Textual Similarity and Bibliographic Coupling Strength: Method Development and Validation Study

Liu Y, Xu J, Huang L

Detecting Invisible Triangular Citations in Biomedical Research Using a Dual-Threshold Framework Based on Textual Similarity and Bibliographic Coupling Strength: Method Development and Validation Study

JMIR Med Inform 2026;14:e96265

DOI: 10.2196/96265

PMID: 43044108

Detecting Invisible Triangular Citations in Biomedical Research Using a Dual-Threshold Framework Based on Textual Similarity and Bibliographic Coupling Strength: Method Development and Validation Study

  • Yunmei Liu; 
  • Jingyi Xu; 
  • Lei Huang

ABSTRACT

Background:

Invisible triangular citations (ITCs)—a citation malpractice where authors of a follower document (C) derive content from a seminal work (A) through an unacknowledged intermediary (B)—pose a significant threat to knowledge provenance and academic integrity. This concealed practice is particularly hazardous in biomedical research, where distorted attribution can propagate misinterpreted concepts into clinical guidelines and therapeutic protocols. Current detection methods lack robust, content-based models to identify such obscured citation pathways.

Objective:

To establish and empirically validate a dual-threshold framework for detecting ITCs in biomedical research by integrating textual similarity with bibliographic coupling strength, and to characterize the positional and semantic patterns of these concealed citations.

Methods:

Using Web of Science’s Enriched Cited References (ECR) technology, we conducted a full-text citation analysis on 591 source papers, 6,239 citing documents, and 9,448 citation sentences from the cuproptosis domain—a 2023-2024 Clarivate Hot Research Front in cancer therapy. The framework combined textual similarity (cosine similarity) with bibliographic coupling strength (shared references). Statistical validation employed Spearman’s rank correlation, chi-square tests, and heatmap visualization across over 5.4 million pairwise data points.

Results:

Optimal detection thresholds were identified as cosine similarity ≥0.5 and coupling strength ≥10, beyond which citation behavior deviated normatively. A striking 99.5–99.9% of normative citations resided in low-similarity/low-coupling zones. ITCs were most frequent in the Background section (41.1%), followed by Discussion (33.5%) and Basis (25.3%). While cosine similarity intervals showed no significant association with citation positions (P = 0.300), coupling strength demonstrated a robust association (P < 0.001). Notably, 66.5% of ITCs fell within a "paraphrase zone" (cosine similarity 0.5–0.6), suggesting strategic rewriting to evade detection.

Conclusions:

This empirically validated dual-threshold framework provides a transferable model for ITC detection across biomedical disciplines. The primacy of bibliographic coupling over semantic similarity as an indicator of concealed influence reveals that authors replicate reference structures while paraphrasing text. The vulnerability of the Background section highlights systemic weaknesses in knowledge transmission, with implications for clinical practice. This study pioneers the application of ECR technology to safeguard attributional integrity and offers actionable governance strategies for research integrity.


 Citation

Please cite as:

Liu Y, Xu J, Huang L

Detecting Invisible Triangular Citations in Biomedical Research Using a Dual-Threshold Framework Based on Textual Similarity and Bibliographic Coupling Strength: Method Development and Validation Study

JMIR Med Inform 2026;14:e96265

DOI: 10.2196/96265

PMID: 43044108

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.