Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Jul 22, 2021
Open Peer Review Period: Jul 22, 2021 - Sep 16, 2021
Date Accepted: Mar 27, 2022
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Using the Diagnostic Odds Ratio to Select Patterns to Build an Interpretable Pattern-Based Classifier in a Clinical Domain: Multivariate Sequential Pattern Mining Study

Casanova IJ, Campos M, Juarez JM, Gomariz A, Lorente-Ros M, Lorente JA

Using the Diagnostic Odds Ratio to Select Patterns to Build an Interpretable Pattern-Based Classifier in a Clinical Domain: Multivariate Sequential Pattern Mining Study

JMIR Med Inform 2022;10(8):e32319

DOI: 10.2196/32319

PMID: 35947437

PMCID: 9403826

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Using the diagnostic odds ratio to select multivariate sequential patterns in order to build an interpretable pattern-based classifier in a clinical domain

  • Isidoro J. Casanova; 
  • Manuel Campos; 
  • Jose M. Juarez; 
  • Antonio Gomariz; 
  • Marta Lorente-Ros; 
  • Jose A. Lorente

ABSTRACT

Background:

It is important to exploit all available data on patients in settings such as Intensive Care Burn Units (ICBUs), where several variables are recorded over time. It is possible to take advantage of the multivariate patterns that model the evolution of patients in order to predict their survival. However, pattern discovery algorithms generate a large number of patterns, of which only some are relevant for classification. The interpretability of the model is, moreover, an essential property in the clinical domain.

Objective:

We propose to use the Diagnostic Odds Ratio (DOR) to select the multivariate sequential patterns used in the classification in a clinical domain, rather than employing frequency properties. This makes it possible to employ a terminology closer to the language of clinicians, in which a pattern is considered to be a risk factor or to have a protection factor.

Methods:

We employ data obtained from the ICBU at the University Hospital of Getafe, where six temporal variables for 465 patients were registered every day during 5 days, and to model the evolution of these clinical variables we use multivariate sequential patterns. We compare four ways in which to employ the DOR for pattern selection: 1) We use it as a threshold in order to select patterns with a minimum DOR; 2) We select patterns whose differential DORs are higher than a threshold as regards their extensions; 3) We select patterns whose DOR confidence intervals do not overlap; and 4) We propose the combination of threshold and non-overlapping confidence intervals in order to select the most discriminative patterns. As a baseline, we compare our proposals with Jumping Emerging Patterns (JEPs), one of the most frequently used techniques for pattern selection that utilize frequency properties.

Results:

We have compared the number and length of the patterns eventually selected, classification performance, and pattern and model interpretability. We show that discretization has a great impact on the accuracy of the classification model, but that a trade off must be found between classification accuracy and the physicians' capacity to interpret the patterns obtained. We have, therefore, opted to use expert discretization without losing too much accuracy. We have also identified that the experiments combining threshold and non-overlapping confidence intervals (Option 4) obtained the fewest number of patterns but also with the smallest size, thus implying the loss of an acceptable accuracy as regards clinician interpretation.

Conclusions:

A method for the classification of patients’ survival can benefit from the use of sequential patterns, since these patterns consider knowledge about the temporal evolution of the variables in the case of ICBU. We have proved that the DOR can be used in several ways, and that it is a suitable measure with which to select discriminative and interpretable quality patterns.


 Citation

Please cite as:

Casanova IJ, Campos M, Juarez JM, Gomariz A, Lorente-Ros M, Lorente JA

Using the Diagnostic Odds Ratio to Select Patterns to Build an Interpretable Pattern-Based Classifier in a Clinical Domain: Multivariate Sequential Pattern Mining Study

JMIR Med Inform 2022;10(8):e32319

DOI: 10.2196/32319

PMID: 35947437

PMCID: 9403826

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.