Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR mHealth and uHealth

Date Submitted: Mar 30, 2020
Date Accepted: Jun 25, 2020

The final, peer-reviewed published version of this preprint can be found here:

Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review

Fuller D, Colwell E, Low J, Orychock K, Tobin MA, Simango B, Buote R, Heerden DV, Luan H, Cullen K, Slade L, Taylor NGA

Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review

JMIR Mhealth Uhealth 2020;8(9):e18694

DOI: 10.2196/18694

PMID: 32897239

PMCID: 7509623

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Systematic Search of the Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate

  • Daniel Fuller; 
  • Emily Colwell; 
  • Jonathan Low; 
  • Kassia Orychock; 
  • Melissa Ann Tobin; 
  • Bo Simango; 
  • Richard Buote; 
  • Desiree Van Heerden; 
  • Henry Luan; 
  • Kim Cullen; 
  • Logan Slade; 
  • Nathan G A Taylor

ABSTRACT

Background:

Consumer-wearable activity trackers are small electronic devices that record fitness and health-related measures. The purpose of this systematic review is to examine the validity and reliability of commercial wearables in measuring step count, heart rate, and energy expenditure.

Objective:

To outline and summarize information about the validity and reliability of wearables in measuring step count, heart rate, and energy expenditure in any population

Methods:

We identified devices to be included in the review. Database searches were conducted in PubMed, Embase, and SPORTDiscus, and only included articles published in the English language up to May 2019. Studies were excluded if they did not identify the device used and if they did not examine the validity and/or reliability of a device. Studies including the general population and all special populations were included. We operationalized validity as criterion (as compared to other measures) and construct (degree to which device is measuring what it purports) validity. Reliability measures focused on intradevice and interdevice reliability.

Results:

We included 158 publications examining 9 different commercial wearable device brands. Fitbit was by far the most studied brand. In lab-based settings Fitbit, Apple Watch, and Samsung appeared to measure steps accurately. Heart rate was more variable with Apple Watch and Garmin being the most accurate, and Fitbit tending towards underestimation. For energy expenditure, no brand was accurate. We also examined validity between devices within a specific brand.

Conclusions:

Commercial wearable devices are accurate in measuring steps and heart rate in lab based settings, but this varies by the manufacturer and device type. Devices are constantly being upgraded and redesigned to new models, suggesting the need for more current reviews and research. Clinical Trial: NA


 Citation

Please cite as:

Fuller D, Colwell E, Low J, Orychock K, Tobin MA, Simango B, Buote R, Heerden DV, Luan H, Cullen K, Slade L, Taylor NGA

Reliability and Validity of Commercially Available Wearable Devices for Measuring Steps, Energy Expenditure, and Heart Rate: Systematic Review

JMIR Mhealth Uhealth 2020;8(9):e18694

DOI: 10.2196/18694

PMID: 32897239

PMCID: 7509623

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.