Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Oct 14, 2024
Date Accepted: Feb 5, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Developing a Scalable Annotation Method for Large Datasets That Enhances Alarms With Actionability Data to Increase Informativeness: Mixed Methods Approach

Klopfenstein SAI, Flint AR, Heeren P, Prendke M, Chaoui A, Ocker T, Chromik J, Arnrich B, Balzer F, Poncette AS

Developing a Scalable Annotation Method for Large Datasets That Enhances Alarms With Actionability Data to Increase Informativeness: Mixed Methods Approach

J Med Internet Res 2025;27:e65961

DOI: 10.2196/65961

PMID: 40324165

PMCID: 12089878

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Towards Smart Alarms in Intensive Care Units by Using a Multifaceted Annotation Method: a Mixed Methods Approach

  • Sophie Anne Ines Klopfenstein; 
  • Anne Rike Flint; 
  • Patrick Heeren; 
  • Mona Prendke; 
  • Amin Chaoui; 
  • Thomas Ocker; 
  • Jonas Chromik; 
  • Bert Arnrich; 
  • Felix Balzer; 
  • Akira-Sebastian Poncette

ABSTRACT

Alarm fatigue, a multifactorial desensitization of staff to alarms, can harm both patients and healthcare staff in intensive care units (ICU), especially due to false and non-actionable alarms. Increasing amounts of alarm and routinely collected ICU patient data are paving the way for training machine learning (ML) models that may be able to reduce the number of non-actionable alarms and thus alarm fatigue. Today, however, there exists no publicly available dataset or process that routinely collects information on alarm actionability, whether an alarm triggered a medical intervention or not—a key feature for developing meaningful ML models for alarm management. Case-based manual annotation is too slow and resource intensive for large amounts of data. In a multidisciplinary, consensus-based approach, we defined pre-processing steps and a rule-based annotation method to classify alarms as either actionable or non-actionable based on data from the patient data management system. Our annotation method will serve in the future to semi-automatically, retrospectively, and time-savingly label large amounts of alarms using patient data to generate annotated datasets for ML models in alarm fatigue research. We present our experience in developing the annotation method and provide resources that we generated, such as rule sets and data mappings. These could be used by others to prepare data for future ML projects, even beyond the topic of alarms.


 Citation

Please cite as:

Klopfenstein SAI, Flint AR, Heeren P, Prendke M, Chaoui A, Ocker T, Chromik J, Arnrich B, Balzer F, Poncette AS

Developing a Scalable Annotation Method for Large Datasets That Enhances Alarms With Actionability Data to Increase Informativeness: Mixed Methods Approach

J Med Internet Res 2025;27:e65961

DOI: 10.2196/65961

PMID: 40324165

PMCID: 12089878

Per the author's request the PDF is not available.