Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Cancer

Date Submitted: Mar 28, 2023
Open Peer Review Period: Mar 28, 2023 - May 23, 2023
Date Accepted: Sep 25, 2023
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Open-Source, Step-Counting Algorithm for Smartphone Data Collected in Clinical and Nonclinical Settings: Algorithm Development and Validation Study

Straczkiewicz M, Keating NL, Thompson E, Matulonis UA, Campos SM, Wright AA, Onnela JP

Open-Source, Step-Counting Algorithm for Smartphone Data Collected in Clinical and Nonclinical Settings: Algorithm Development and Validation Study

JMIR Cancer 2023;9:e47646

DOI: 10.2196/47646

PMID: 37966891

PMCID: 10687676

Validation of an open-source step counting algorithm for smartphone data collected in clinical and non-clinical settings

  • Marcin Straczkiewicz; 
  • Nancy L Keating; 
  • Embree Thompson; 
  • Ursula A Matulonis; 
  • Susana M Campos; 
  • Alexi A Wright; 
  • Jukka-Pekka Onnela

ABSTRACT

Background:

Step counts are increasingly used in public health and clinical research to assess wellbeing, lifestyle, and health status. However, estimating step counts using commercial activity trackers has several limitations, including a lack of reproducibility, generalizability, and scalability. Smartphones are a potentially promising alternative, but their step-counting algorithms require robust validation that accounts for temporal sensor body location, individual gait characteristics, and heterogeneous health states.

Objective:

Our goal was to evaluate an open-source step-counting method for smartphones under various measurement conditions against step counts estimated from data collected simultaneously from different body locations (“internal” validation), manually ascertained ground truth (“manual” validation), and step counts from a commercial activity tracker (Fitbit Charge 2) in patients with advanced cancer (“wearable” validation).

Methods:

We used eight independent datasets collected in controlled, semi-controlled, and free-living environments with different devices (primarily Android smartphones and wearable accelerometers) carried at typical body locations. Five datasets (N=103) were used for internal validation, two datasets (N=107) for manual validation, and one dataset (N=45) used for wearable validation. In each scenario, step counts were estimated using a previously published step-counting method for smartphones that uses raw sub-second level accelerometer data. We calculated mean bias and limits of agreement (LoA) between step count estimates and validation criteria using Bland-Altman analysis.

Results:

In the internal validation datasets, participants performed 751.7±581.2 (mean±SD) steps, and the mean bias was -7.2 steps (LoA -47.6, 33.3) or -0.5%. In the manual validation datasets, the ground truth step count was 367.4±359.4 steps while the mean bias was -0.4 steps (LoA -75.2, 74.3) or 0.1 %. In the wearable validation dataset, Fitbit devices indicated mean step counts of 1931.2±2338.4, while the calculated bias was equal to -67.1 steps (LoA -603.8, 469.7) or a difference of 0.3 %.

Conclusions:

This study demonstrates that our open-source step counting method for smartphone data provides reliable step counts across sensor locations, measurement scenarios, and populations, including healthy adults and patients with cancer.


 Citation

Please cite as:

Straczkiewicz M, Keating NL, Thompson E, Matulonis UA, Campos SM, Wright AA, Onnela JP

Open-Source, Step-Counting Algorithm for Smartphone Data Collected in Clinical and Nonclinical Settings: Algorithm Development and Validation Study

JMIR Cancer 2023;9:e47646

DOI: 10.2196/47646

PMID: 37966891

PMCID: 10687676

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.