Accepted for/Published in: JMIR Mental Health
Date Submitted: Jul 3, 2021
Date Accepted: Oct 8, 2021
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
In search of state and trait emotion markers in mobile-sensed language: a field study
ABSTRACT
Background:
Emotions and mood are important for our overall well-being. The search for continuous, effortless emotion prediction methods is, therefore, an important field of study. Mobile sensing provides a promising tool and can capture one of the most telling signs of emotions: language.
Objective:
The aim of this study is to examine the separate and combined predictive value of mobile-sensed language data sources for detecting both momentary emotional experience as well as global individual differences in emotional traits and depression.
Methods:
In a two-week experience sampling method study, we collected self-report emotion ratings and voice recordings 10 times/day, continuous keyboard activity, and trait depression severity. We correlated state and trait emotions/depression and language, distinguishing between speech content (spoken words), speech form (voice acoustics), writing content (written words), and writing form (typing dynamics). We also investigated how well these features predict state and trait emotions using cross-validation to select features and a hold-out set for validation.
Results:
Overall, reported emotions and mobile-sensed language demonstrated weak correlations. Most significant correlations were found between speech content and state emotions and speech form and state emotions, ranging to 0.25. Speech content provided the best predictions for the state emotions. None of the trait emotion-language correlations remained significant after correction. Among the emotions studied, valence and happiness displayed the most significant correlations and the highest predictive performance.
Conclusions:
While using mobile-sensed language as emotion marker shows some promise, correlations and predictive R²s are low.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.