Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Sep 3, 2020
Date Accepted: Feb 25, 2021
Date Submitted to PubMed: Apr 12, 2021

The final, peer-reviewed published version of this preprint can be found here:

A Natural Language Processing–Based Virtual Patient Simulator and Intelligent Tutoring System for the Clinical Diagnostic Process: Simulator Development and Case Study

Furlan R, Gatti M, Menè R, Shiffer D, Marchiori C, Giaj Levra A, Saturnino V, Brunetta E, Dipaola F

A Natural Language Processing–Based Virtual Patient Simulator and Intelligent Tutoring System for the Clinical Diagnostic Process: Simulator Development and Case Study

JMIR Med Inform 2021;9(4):e24073

DOI: 10.2196/24073

PMID: 33720840

PMCID: 8041050

An NLP-based Virtual Patient Simulator and Intelligent Tutoring System for the Clinical Diagnostic Process: a Case Study.

  • Raffaello Furlan; 
  • Mauro Gatti; 
  • Roberto Menè; 
  • Dana Shiffer; 
  • Chiara Marchiori; 
  • Alessandro Giaj Levra; 
  • Vincenzo Saturnino; 
  • Enrico Brunetta; 
  • Franca Dipaola

ABSTRACT

Background:

Shortage of human resources, increasing educational costs and need to keep social distances in response to the COVID-19 worldwide outbreak prompt the necessity to move from a in-presence, bed-sided, didactic sessions towards novel tele-health teaching. Virtual Patient Simulators may partially accomplish these needs.

Objective:

To introduce the underlying rationale and most important features of Hepius, a Cognitive Tutor and Simulator, mimicking the doctor’s diagnostic process. To provide preliminary results on undergraduate students short-term knowledge change after Hepius use.

Methods:

Hepius was built up to let the student gather clinical information from input scenario, patient’s medical history, physical examination and tests results and address these information by prompting hypothesis generation, binary and pattern analyses. Natural language processing (NLP) techniques were used to simulate daily life student’s interaction with a real patient. Fifteen students attending the 5th year of the Humanitas University Medical School underwent two identical multiple choice question tests before and after performing a pulmonary embolism simulation with Hepius. Multiple choice test was made up of 22 questions, 11 of which (core questions) were specifically designed to evaluate knowledge acquired directly from performing the simulation.

Results:

Mean post-simulation test score was greater (P=0.0001) than pre-simulation score. There was an improvement (P=0.0004) in mean core questions score from pre- to post-simulation. Correct responses to core questions were greater (P=0.0027) post- compared to pre-simulation.

Conclusions:

The use of a software based on NLP techniques, specifically designed to mirror doctor’s diagnostic process, proved to be effective in promoting the short-term enhancement of students’ knowledge by a tele-health teaching approach.


 Citation

Please cite as:

Furlan R, Gatti M, Menè R, Shiffer D, Marchiori C, Giaj Levra A, Saturnino V, Brunetta E, Dipaola F

A Natural Language Processing–Based Virtual Patient Simulator and Intelligent Tutoring System for the Clinical Diagnostic Process: Simulator Development and Case Study

JMIR Med Inform 2021;9(4):e24073

DOI: 10.2196/24073

PMID: 33720840

PMCID: 8041050

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.