Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
Klopfenstein SAI, Flint AR, Heeren P, Prendke M, Chaoui A, Ocker T, Chromik J, Arnrich B, Balzer F, Poncette AS
Developing a Scalable Annotation Method for Large Datasets That Enhances Alarms With Actionability Data to Increase Informativeness: Mixed Methods Approach
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Towards Smart Alarms in Intensive Care Units by Using a Multifaceted Annotation Method: a Mixed Methods Approach
Sophie Anne Ines Klopfenstein;
Anne Rike Flint;
Patrick Heeren;
Mona Prendke;
Amin Chaoui;
Thomas Ocker;
Jonas Chromik;
Bert Arnrich;
Felix Balzer;
Akira-Sebastian Poncette
ABSTRACT
Alarm fatigue, a multifactorial desensitization of staff to alarms, can harm both patients and healthcare staff in intensive care units (ICU), especially due to false and non-actionable alarms. Increasing amounts of alarm and routinely collected ICU patient data are paving the way for training machine learning (ML) models that may be able to reduce the number of non-actionable alarms and thus alarm fatigue. Today, however, there exists no publicly available dataset or process that routinely collects information on alarm actionability, whether an alarm triggered a medical intervention or not—a key feature for developing meaningful ML models for alarm management. Case-based manual annotation is too slow and resource intensive for large amounts of data. In a multidisciplinary, consensus-based approach, we defined pre-processing steps and a rule-based annotation method to classify alarms as either actionable or non-actionable based on data from the patient data management system. Our annotation method will serve in the future to semi-automatically, retrospectively, and time-savingly label large amounts of alarms using patient data to generate annotated datasets for ML models in alarm fatigue research. We present our experience in developing the annotation method and provide resources that we generated, such as rule sets and data mappings. These could be used by others to prepare data for future ML projects, even beyond the topic of alarms.
Citation
Please cite as:
Klopfenstein SAI, Flint AR, Heeren P, Prendke M, Chaoui A, Ocker T, Chromik J, Arnrich B, Balzer F, Poncette AS
Developing a Scalable Annotation Method for Large Datasets That Enhances Alarms With Actionability Data to Increase Informativeness: Mixed Methods Approach