Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR mHealth and uHealth

Date Submitted: Apr 12, 2024
Date Accepted: Aug 27, 2024

The final, peer-reviewed published version of this preprint can be found here:

Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behavior Using Deep Learning: Cross-Sectional Study

Stankoski S, Kiprijanovska I, Gjoreski M, Panchevski F, Sazdov B, Sofronievski B, Cleal A, Fatoorechi M, Nduka C, Gjoreski H

Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behavior Using Deep Learning: Cross-Sectional Study

JMIR Mhealth Uhealth 2024;12:e59469

DOI: 10.2196/59469

PMID: 39325528

PMCID: 11467608

Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behaviour using Deep Learning: Cross-Sectional Study

  • Simon Stankoski; 
  • Ivana Kiprijanovska; 
  • Martin Gjoreski; 
  • Filip Panchevski; 
  • Borjan Sazdov; 
  • Bojan Sofronievski; 
  • Andrew Cleal; 
  • Mohsen Fatoorechi; 
  • Charles Nduka; 
  • Hristijan Gjoreski

ABSTRACT

Background:

Gaining insight into people's dietary habits is crucial for designing effective interventions aimed at promoting a healthy lifestyle. Automatic monitoring of food intake offers the opportunity to mitigate the significant limitations associated with traditional self-reporting approaches.

Objective:

The aim of this study is to introduce a technique for automated detection of chewing activity and identification of eating segments utilizing data from optical tracking sensors embedded within smart glasses.

Methods:

Utilizing a deep learning framework, the system analyses facial muscle movements indicative of chewing, leveraging patented OCO™ sensors. To account for the temporal dependence of chewing events in real-life scenarios, a Hidden Markov Model (HMM) is integrated, allowing to infer eating segments in real-life. The study comprehensively explores the impact of sensor positions over different facial muscles, window sizes, and various deep learning architectures on detection performance, evaluating the system's performance across controlled and real life settings.

Results:

The extensive evaluations show that our method for automatic chewing detection achieves precision of 0.92, recall of 0.89, and F1 score of 0.91 in a laboratory setting with 126 participants and precision of 0.95, recall of 0.82, and F1-score of 0.88 in a real-life setting with 8 participants.

Conclusions:

This research contributes significantly to the advancement of dietary monitoring technology by introducing a non-invasive tool for tracking eating behavior. The promising results demonstrated by the presented method in both laboratory and real-life settings underscores its potential for practical application in diverse contexts.


 Citation

Please cite as:

Stankoski S, Kiprijanovska I, Gjoreski M, Panchevski F, Sazdov B, Sofronievski B, Cleal A, Fatoorechi M, Nduka C, Gjoreski H

Controlled and Real-Life Investigation of Optical Tracking Sensors in Smart Glasses for Monitoring Eating Behavior Using Deep Learning: Cross-Sectional Study

JMIR Mhealth Uhealth 2024;12:e59469

DOI: 10.2196/59469

PMID: 39325528

PMCID: 11467608

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.