Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Serious Games

Date Submitted: May 6, 2022
Date Accepted: Jul 21, 2022

The final, peer-reviewed published version of this preprint can be found here:

Breathing as an Input Modality in a Gameful Breathing Training App (Breeze 2): Development and Evaluation Study

Lukic YX, Teepe GW, Fleisch E, Kowatsch T

Breathing as an Input Modality in a Gameful Breathing Training App (Breeze 2): Development and Evaluation Study

JMIR Serious Games 2022;10(3):e39186

DOI: 10.2196/39186

PMID: 35972793

PMCID: 9428773

Breathing as Input Modality in a Gameful Breathing Training App: Development and Evaluation of Breeze 2

  • Yanick Xavier Lukic; 
  • Gisbert Wilhelm Teepe; 
  • Elgar Fleisch; 
  • Tobias Kowatsch

ABSTRACT

Background:

Slow-paced breathing training can have beneficial effects on physiological and psychological well-being. Unfortunately, usage statistics indicate that adherence to breathing training apps is low. Recent work suggests that gameful breathing training may help to overcome this challenge.

Objective:

This study aims to introduce and evaluate Breeze 2, an updated version of the gameful breathing training app Breeze. It adds an improved appearance, a tutorial, the possibility to set specific training parameters, procedural generation of the visual biofeedback environment, and a novel real-time acoustic breathing detection algorithm that detects inhalation, exhalation, and non-breathing sounds (including silence).

Methods:

The breathing detection algorithm was developed using deep transfer learning and features an additional heuristic that prolongs detected exhalations to stabilize the algorithm's predictions. We evaluated Breeze 2 with thirty participants (14 females, Mage=29.77, SDage=7.33). Each participant performed two breathing training sessions with Breeze 2. In one session, the breathing detection used audio captured from headphones, and in the other session, it used audio from the smartphone's microphone. Participants answered questions regarding user engagement (UES-SF), perceived effectiveness (PE), perceived relaxation effectiveness (PRE), and perceived breathing detection accuracy (PDA). We used Wilcoxon-signed rank tests to compare UES-SF, PE, and PRE against neutral scores. To assess whether participants under- or overestimated the actual detection performance, we correlated PDA with the actual multi-class balanced accuracy and examined difference plots. We conducted a repeated-measures analysis of variance (ANOVA) to investigate the model's differences in balanced accuracy with and without the heuristic and when classifying data captured from headphones and smartphone microphones. To account for potential breathing sound differences between men and women, we controlled for between-subject effects of participants' gender.

Results:

Our results show scores significantly higher than neutral scores for UES-SF (W=459, P<.001), PE (W=465, P<.001), and PRE (W=358, P<.001). PDA correlated significantly with the multi-class balanced accuracy of the model (r=0.51, P<.001). Difference plots indicated that participants overestimated the model's performance when it performed poorly and underestimated it when it performed well. Furthermore, we found that the heuristic improved the model's balanced accuracy significantly (F(1,25)=10.25, P=.004) and that the model performed better on data captured from smartphone microphones than from headphones (F(1,25)=16.77, P<.001). We did not observe any significant between-subject effects of gender. The model alone reached a multi-class balanced accuracy of 74%.

Conclusions:

Most participants perceived Breeze 2 as engaging and effective. Furthermore, the breathing detection worked well for most participants, as indicated by the perceived and true detection accuracy. In future work, we aim to use the collected breathing sounds to improve the breathing detection regarding its stability and performance. We also plan to employ Breeze 2 as an intervention tool in various studies targeting the prevention and management of NCDs.


 Citation

Please cite as:

Lukic YX, Teepe GW, Fleisch E, Kowatsch T

Breathing as an Input Modality in a Gameful Breathing Training App (Breeze 2): Development and Evaluation Study

JMIR Serious Games 2022;10(3):e39186

DOI: 10.2196/39186

PMID: 35972793

PMCID: 9428773

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.