Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Effects of Cognitive States on Momentary Response Biases in an Ecological Momentary Assessment Study
ABSTRACT
Background:
Ecological momentary assessments (EMAs) are a widely used method in health and psychological research to assess people’s thoughts, emotions, and behaviours in daily life. However, EMAs are affected by several response biases including compliance, , careless, and delayed responses, which can compromise data quality and threaten validity. Although some design and contextual factors influencing these biases have been identified, the role of momentary cognitive states (e.g., stress, fatigue, affect) remains underexplored.
Objective:
This study examined how cognitive states at the moment of responding influenced participants’ compliance, careless responding, delayed responding to EMAs.
Methods:
We conducted a secondary analysis using data from the COBRA study, a prospective observational cohort study on health behaviours in Singapore. The dataset included 29’797 EMA responses from 617 Singaporean adults who were prompted to complete six smartphone-based surveys daily for nine days. Using mixed-effects regression models, we examined how five cognitive states (stress, fatigue, hunger, positive affect, and sleep quality) predicted compliance, careless responding, and response delay, while adjusting for demographic and temporal covariates.
Results:
Overall compliance at the next prompt was high (92%), and no cognitive states were significantly associated with compliance. Careless responding was more likely at higher levels of stress and hunger, and less likely at higher levels of sleep quality, fatigue, and positive affect. Several demographic and temporal factors such as age, time of day, and number of missed prior prompts also significantly influenced response behaviors.
Conclusions:
This study demonstrates that cognitive states significantly influence careless and delayed responding in EMA studies, but they do not impact compliance. Our findings highlight the need to consider participants’ cognitive states as potential sources of systematic bias, particularly in studies investigating stress, hunger, and affective states. Future EMA research should therefore incorporate strategies to detect and mitigate response biases, such as tracking those variables and using just-in-time delivered warnings, rewards, and educational messages.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.