Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Oct 25, 2024
Open Peer Review Period: Oct 24, 2024 - Nov 8, 2024
Date Accepted: Dec 23, 2024
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Metrics for Evaluating Telemedicine in Randomized Controlled Trials: Scoping Review

Sugawara Y, Hirakawa Y, Iwagami M, Inokuchi R, Wakimizu R, Nangaku M

Metrics for Evaluating Telemedicine in Randomized Controlled Trials: Scoping Review

J Med Internet Res 2025;27:e67929

DOI: 10.2196/67929

PMID: 39889298

PMCID: 11829184

Metrics for Evaluating Telemedicine in Randomized Controlled Trials: A Scoping Review

  • Yuka Sugawara; 
  • Yosuke Hirakawa; 
  • Masao Iwagami; 
  • Ryota Inokuchi; 
  • Rie Wakimizu; 
  • Masaomi Nangaku

ABSTRACT

Background:

Telemedicine includes the provision of any type of medical, diagnostic, or treatment-related service using telecommunications technology. Researches regarding telemedicine are increasing, however; it remains unclear how we should assess the usefulness and the limitation of telemedicine in the randomized controlled trials. It was also undefined which metrics to be used as cross-disciplinary indicators when comparing telemedicine with face-to-face care.

Objective:

This review aims to provide an overview of the general and crossdisciplinarity metrics used in comparing telemedicine with in-person care in randomized controlled trials. This study also aims to identify indicators that have not been evaluated and to suggest which ones should be used in future clinical trials.

Methods:

In the databases of MEDLINE and Embase, publications that met the inclusion criteria were searched according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) guidelines for a systematic scoping review. English original articles that dealt with randomized controlled trials comparing some form of telemedicine with face-to-face care were included, covering the period from January 2019 to March 2024. Basic study information and general metrics used in these studies were summarized.

Results:

Among 2,275 articles identified by the initial search, 79 were included in the final analysis. The commonly-used metrics that could be used across medical specialties were divided into the following three categories: (1) patient-centeredness (N = 67 [84.8%]) including patient satisfaction, patients’ work, and quality of life, (2) patient outcomes (N = 57 [72.2%]), i.e., general clinical parameters including death, admission, and adverse events, and (3) cost-effectiveness (N = 40 [50.6%]) including cost assessment and quality-adjusted life year. There were 25 studies (31.6%) that evaluated all of the three categories. Only a few studies (N = 7 [8.9%]) evaluated the metrics regarding staff convenience.

Conclusions:

There was a great variation among studies in which metrics were used. Even when disease-specific indicators are used, it was suggested that general indicators be used as well, to make it easier for people in other areas to understand the results. It was additionally suggested that indicators be set up to cover all the commonly-used three categories of measures: patient outcomes, patient-centeredness, and cost-effectiveness. In considering the further spread of telemedicine, it may be necessary to evaluate the convenience of staff. Standardization of evaluation metrics is desired for future clinical trials and studies.


 Citation

Please cite as:

Sugawara Y, Hirakawa Y, Iwagami M, Inokuchi R, Wakimizu R, Nangaku M

Metrics for Evaluating Telemedicine in Randomized Controlled Trials: Scoping Review

J Med Internet Res 2025;27:e67929

DOI: 10.2196/67929

PMID: 39889298

PMCID: 11829184

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.