Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Feb 6, 2024
Date Accepted: May 25, 2024

The final, peer-reviewed published version of this preprint can be found here:

Evaluation of AI-Driven LabTest Checker for Diagnostic Accuracy and Safety: Prospective Cohort Study

Szumilas D, Ochmann A, Zięba K, Bartoszewicz B, Kubrak A, Makuch S, Agrawal S, Mazur G, Chudek J

Evaluation of AI-Driven LabTest Checker for Diagnostic Accuracy and Safety: Prospective Cohort Study

JMIR Med Inform 2024;12:e57162

DOI: 10.2196/57162

PMID: 39149851

PMCID: 11337233

Evaluation of AI-Driven LabTest Checker (LTC-AI) for Diagnostic Accuracy and Safety: A Prospective Cohort Study

  • Dawid Szumilas; 
  • Anna Ochmann; 
  • Katarzyna Zięba; 
  • Bartłomiej Bartoszewicz; 
  • Anna Kubrak; 
  • Sebastian Makuch; 
  • Siddarth Agrawal; 
  • Grzegorz Mazur; 
  • Jerzy Chudek

ABSTRACT

Background:

In recent years, the implementation of artificial intelligence (AI) in healthcare is progressively transforming medical fields, with Clinical Decision Support Systems (CDSS) as a notable application. Laboratory tests are vital for accurate diagnoses, but their increasing reliance presents challenges. The need for effective strategies for managing laboratory test interpretation is evident from the millions of monthly searches on test results' significance. The potential role of CDSS in laboratory diagnostics gains significance, however, more research needs to explore this area.

Objective:

The primary objective of our study was to assess the accuracy and safety of LabTest Checker (LTC), a CDSS designed to support medical diagnoses by analyzing both laboratory test results and patients' medical histories.

Methods:

This cohort study embraced a prospective data collection approach. A total of 101 patients were enrolled, aged 18 and above, in stable condition, requiring comprehensive diagnosis. A panel of blood laboratory tests was conducted for each participant. Participants utilized LabTest Checker for test result interpretation. Accuracy and safety of the tool were assessed by comparing AI-generated suggestions to experienced doctor (consultant) recommendations, considered the gold standard.

Results:

The system achieved a 74.3% accuracy and 100% sensitivity for emergency safety and 92.3% sensitivity for urgent cases. It potentially reduced unnecessary medical visits by 41.6% and achieved an 82.9% accuracy in identifying underlying pathologies.

Conclusions:

This study underscores the transformative potential of AI-based CDSS in laboratory diagnostics, contributing to enhanced patient care, efficient healthcare systems, and improved medical outcomes. LabTest Checker's performance evaluation highlights the advancements in AI's role in laboratory medicine.


 Citation

Please cite as:

Szumilas D, Ochmann A, Zięba K, Bartoszewicz B, Kubrak A, Makuch S, Agrawal S, Mazur G, Chudek J

Evaluation of AI-Driven LabTest Checker for Diagnostic Accuracy and Safety: Prospective Cohort Study

JMIR Med Inform 2024;12:e57162

DOI: 10.2196/57162

PMID: 39149851

PMCID: 11337233

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.