Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Research Protocols

Date Submitted: Oct 16, 2019
Date Accepted: Jan 14, 2020

The final, peer-reviewed published version of this preprint can be found here:

Determining the Agreement Between an Automated Respiratory Rate Counter and a Reference Standard for Detecting Symptoms of Pneumonia in Children: Protocol for a Cross-Sectional Study in Ethiopia

Ward C, Baker K, Marks S, Getachew D, Habte T, McWhorter C, Labarre P, Howard-Brand J, Miller NP, Jebessa S, Petzold M, Kallander K

Determining the Agreement Between an Automated Respiratory Rate Counter and a Reference Standard for Detecting Symptoms of Pneumonia in Children: Protocol for a Cross-Sectional Study in Ethiopia

JMIR Res Protoc 2020;9(4):e16531

DOI: 10.2196/16531

PMID: 32238340

PMCID: 7163412

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Determining the agreement between an automated respiratory rate counter and a reference standard for detecting symptoms of pneumonia in children: study protocol for a cross-sectional study in Ethiopia

  • Charlotte Ward; 
  • Kevin Baker; 
  • Sarah Marks; 
  • Dawit Getachew; 
  • Tedila Habte; 
  • Cindy McWhorter; 
  • Paul Labarre; 
  • Jonathan Howard-Brand; 
  • Nathan P Miller; 
  • Solomie Jebessa; 
  • Max Petzold; 
  • Karin Kallander

ABSTRACT

Background:

Acute respiratory infections (ARIs), primarily pneumonia, are the leading infectious cause of under-five mortality worldwide. Manually counting respiratory rate (RR) for 60 seconds using an ARI timer is commonly practiced by community health workers to detect fast breathing, an important sign of pneumonia. However, correctly counting breaths manually and classifying the RR is challenging, often leading to inappropriate treatment. A potential solution is to introduce RR counters which count and classify RR automatically.

Objective:

This study aims to determine how the RR count of an Automated Respiratory Infection Diagnostic Aid (ARIDA) agrees with the count of an expert panel of paediatricians counting RR by reviewing a video of the child’s chest for 60 seconds (reference standard), for children under five years of age with cough and/or difficult breathing.

Methods:

A cross-sectional study aiming to enrol 290 children 0-59 months presenting to paediatric in- and out-patient departments at a teaching hospital in Addis Ababa, Ethiopia was conducted. Enrolment occurred between April and May 2017. Once enrolled, children participated in at least one of three types of RR evaluations: 1) agreement – to measure the RR count of ARIDA in comparison to the reference standard, 2) consistency – to measure the agreement between two ARIDA devices strapped to one child and 3) RR fluctuation – to measure RR count variability over time after ARIDA attachment as measured by a manual count. The agreement and consistency of expert clinicians (ECs) counting RR for the same child with the Mark 2 (MK2) ARI timer for 60 seconds was also measured in comparison to the reference standard.

Results:

Primary outcomes were 1) mean difference between ARIDA and reference standard RR count (agreement) and 2) mean difference between RR counts obtained by two ARIDA devices started simultaneously (consistency).

Conclusions:

Study strengths included the design allowing for comparison between both ARIDA and the EC with the reference standard RR count. A limitation is that exactly the same set of breaths were not compared between ARIDA and the reference standard since ARIDA can take longer than 60 seconds to count RR. Also, manual RR counting, even when aided by a video of the child’s chest movements, is subject to human error and can result in low inter-rater reliability. Further work is needed to reach global consensus on the most appropriate reference standard and an acceptable level of agreement, to provide Ministries of Health with evidence to make an informed decision on whether to scale up new automated RR counters. Clinical Trial: www.clinicaltrials.gov, identifier NCT03067558


 Citation

Please cite as:

Ward C, Baker K, Marks S, Getachew D, Habte T, McWhorter C, Labarre P, Howard-Brand J, Miller NP, Jebessa S, Petzold M, Kallander K

Determining the Agreement Between an Automated Respiratory Rate Counter and a Reference Standard for Detecting Symptoms of Pneumonia in Children: Protocol for a Cross-Sectional Study in Ethiopia

JMIR Res Protoc 2020;9(4):e16531

DOI: 10.2196/16531

PMID: 32238340

PMCID: 7163412

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.