Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR mHealth and uHealth

Date Submitted: May 24, 2020
Date Accepted: Oct 30, 2020

The final, peer-reviewed published version of this preprint can be found here:

A Real-Time Eating Detection System for Capturing Eating Moments and Triggering Ecological Momentary Assessments to Obtain Further Context: System Development and Validation Study

Bin Morshed M, Kulkarni SS, Li R, Saha K, Nachman L, Lu H, Roper LG, De Choudhury M, De Barbaro K, Ploetz T, Abowd GD

A Real-Time Eating Detection System for Capturing Eating Moments and Triggering Ecological Momentary Assessments to Obtain Further Context: System Development and Validation Study

JMIR Mhealth Uhealth 2020;8(12):e20625

DOI: 10.2196/20625

PMID: 33337336

PMCID: 7775824

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

A Real-Time Eating Detection System for Capturing Eating Behaviors In-the-Wild

  • Mehrab Bin Morshed; 
  • Samruddhi Shreeram Kulkarni; 
  • Richard Li; 
  • Koustuv Saha; 
  • Lama Nachman; 
  • Hong Lu; 
  • Leah Galante Roper; 
  • Munmun De Choudhury; 
  • Kaya De Barbaro; 
  • Thomas Ploetz; 
  • Gregory D. Abowd

ABSTRACT

Background:

Eating behavior has a significant impact on the wellbeing of an individual. Such behavior comprises not only when an individual is eating, but also various contextual factors such as with whom and where an individual is eating, what kind of food they are having, to name but a few. Despite the significance of such factors, most automated eating detection systems are not designed to capture contextual factors.

Objective:

This paper describes a semi-automated eating detection system that leverages the Ecological Momentary Assessment (EMA) questions to capture contextual factors upon detecting when an individual is eating. Our validation study demonstrates the efficacy of the system by deploying it in-the-wild among college students.

Methods:

The eating detection system was deployed among 28 college students at a US institution over a period of three weeks. The participants reported various contextual information through EMAs triggered when the eating detection system correctly detected a meal episode. The EMA questions were designed after conducting a survey study with 162 students from the same campus. Responses from EMAs were used to define exclusion criteria.

Results:

Among the total consumed meals, 90% of breakfast, 99% of lunch, and 98% of dinner episodes were detected by our novel eating detection system. The eating detection system showed a high accuracy by capturing 95.67% of the meals out of 1,259 meals consumed by the participants. The eating detection classifier shows a precision of 80%, recall of 96%, and F1 of 87%. We found that over 99% of the meals were consumed with distractions. Such eating behavior is considered “unhealthy” and can lead to overeating and uncontrolled weight gain. Significant portions of meals were consumed alone (54.09%) in dorm rooms or apartment housing (31.19%). Our participants self-reported 63% of their meals as healthy. Together, these results have implications for designing technologies to encourage healthy eating behavior. interventions.

Conclusions:

The presented eating detection system is the first of its kind to leverage EMAs to capture the eating context, which has significant implications for wellbeing research. We reflect on the contextual data that has been gathered by our system and discuss how these insights can be used to design individual-specific


 Citation

Please cite as:

Bin Morshed M, Kulkarni SS, Li R, Saha K, Nachman L, Lu H, Roper LG, De Choudhury M, De Barbaro K, Ploetz T, Abowd GD

A Real-Time Eating Detection System for Capturing Eating Moments and Triggering Ecological Momentary Assessments to Obtain Further Context: System Development and Validation Study

JMIR Mhealth Uhealth 2020;8(12):e20625

DOI: 10.2196/20625

PMID: 33337336

PMCID: 7775824

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.