Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Human Factors

Date Submitted: Sep 14, 2022
Open Peer Review Period: Sep 14, 2022 - Nov 9, 2022
Date Accepted: Feb 11, 2023
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Detecting Medication-Taking Gestures Using Machine Learning and Accelerometer Data Collected via Smartwatch Technology: Instrument Validation Study

Odhiambo CO, Ablonczy L, Wright Pâ, Corbett CF, Reichardt S, Valafar H

Detecting Medication-Taking Gestures Using Machine Learning and Accelerometer Data Collected via Smartwatch Technology: Instrument Validation Study

JMIR Hum Factors 2023;10:e42714

DOI: 10.2196/42714

PMID: 37140971

PMCID: 10196892

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Detecting Medication Gestures Using Machine Learning and Accelerometer Data Collected Via Smartwatch Technology: A Feasibility Study

  • Chrisogonas Odero Odhiambo; 
  • Luke Ablonczy; 
  • Pamela ‎J. Wright; 
  • Cynthia F. Corbett; 
  • Sydney Reichardt; 
  • Homayoun Valafar

ABSTRACT

Background:

Medication adherence is a complex human behavior associated with chronic condition self-management. Medication adherence is a global public health challenge, as only about 50% of people adhere to their medication regimes. Smartphone apps and reminders have shown promising results in promoting medication adherence. However, practical mechanisms to determine whether a medication has been taken or not, once people are reminded, have been elusive. Emerging smartwatch technology may more objectively, unobtrusively, and automatically detect the medication-taking than currently available methods.

Objective:

This study aimed to examine the feasibility of detecting natural medication-taking gestures using smartwatches.

Methods:

Recruited participants (N=28) ranged in age (20 to 60 years) and comprised 57.0% males and 43.0% females. The majority were college students (71.4%), single (86.0%), and working at least part-time (61.0%). The sample represented racial diversity with 4% African American, 43% Asian, 43% White, and 10% reported two or more races1. Most participants were right-hand dominant (82%), while only 1 participant (4%) was ambidextrous. During data collection, each participant recorded at least five protocol-guided (scripted) medication-taking events (sMTE) and at least ten natural instances of medication-taking events (nMTE) per day for 5 days. Using a smartwatch, the accelerometer data was recorded for each session at 25Hz of sampling rate. The raw recordings were scrutinized by a team member to validate the accuracy of self-reports. The validated data were used to train an Artificial Neural Network (ANN) to detect a medication-taking activity. The training and testing data included previously recorded accelerometer data from smoking, eating, and jogging activities in addition to the medication-taking data recorded in this work. The accuracy of the model to identify medication-taking was evaluated by comparing the ANN’s output to the actual output.

Results:

In total, 2,800 medication-taking gestures (1400 natural plus 1400 scripted gestures) were used to train the network. During the testing session, 560 nMTE events that were not previously presented to the ANN were used to assess the network. Various metrics, such as accuracy, precision, and recall, were calculated to confirm the performance of the network. The trained ANN exhibited an average True-Positive performance of 96.5% and an average True-Negative performance of 94.5%. The network exhibited less than 5% error in incorrect classification of the medication-taking gestures.

Conclusions:

Smartwatch technology can provide an accurate, non-intrusive means of monitoring human behaviors such as natural medication-taking gestures. The use of machine learning algorithms combined with modern sensing devices may significantly improve medication adherence and monitoring.


 Citation

Please cite as:

Odhiambo CO, Ablonczy L, Wright Pâ, Corbett CF, Reichardt S, Valafar H

Detecting Medication-Taking Gestures Using Machine Learning and Accelerometer Data Collected via Smartwatch Technology: Instrument Validation Study

JMIR Hum Factors 2023;10:e42714

DOI: 10.2196/42714

PMID: 37140971

PMCID: 10196892

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.