Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: May 21, 2023
Date Accepted: Jan 29, 2024

The final, peer-reviewed published version of this preprint can be found here:

The Digital Therapeutics Real-World Evidence Framework: An Approach for Guiding Evidence-Based Digital Therapeutics Design, Development, Testing, and Monitoring

Kim M, Patrick K, Nebeker C, Godino J, Stein S, Klasnja P, Perski O, Viglione C, Coleman A, Hekler E

The Digital Therapeutics Real-World Evidence Framework: An Approach for Guiding Evidence-Based Digital Therapeutics Design, Development, Testing, and Monitoring

J Med Internet Res 2024;26:e49208

DOI: 10.2196/49208

PMID: 38441954

PMCID: 10951831

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

The Digital Therapeutics Real World Evidence Framework: An approach for guiding evidence-based DTx design, development, testing, and monitoring

  • Meelim Kim; 
  • Kevin Patrick; 
  • Camille Nebeker; 
  • Job Godino; 
  • Spencer Stein; 
  • Predrag Klasnja; 
  • Olga Perski; 
  • Clare Viglione; 
  • Aaron Coleman; 
  • Eric Hekler

ABSTRACT

Digital Therapeutics (DTx) are seen as a promising way to provide safe, effective, accessible, sustainable, scalable, and equitable approaches to advance individual, population, and public health. Developing DTx is inherently complex in that DTx may include multiple interacting components, such as tools to support activities like medication adherence, health behavior goal-setting or self-monitoring, and algorithms that adapt provision of these according to individual needs. While myriad frameworks exist for different parts of the DTx lifecycle, to date, no single unifying framework exists to guide DTx evidence production. The purpose of this paper is to fill this gap. Specifically, we propose the DTx Real-World Evidence (RWE) Framework to provide a pragmatic, iterative, milestone-driven approach for producing RWE for DTx. While it incorporates insights from multiple fields, it uses, as its starting foundation, the Obesity-Related Behavioral Intervention Trials (ORBIT) model, but with explicit adaptations established for DTx. The DTx RWE Framework has two key elements. The first is recommendations on the use of real-world data (RWD) across the DTx lifecycle to support identifying unmet needs, establish real-world benchmarks, support on-going monitoring, and, over time, enable more rapid and resource efficient development and testing based on RWD. The second is a flowchart, which maps onto the four-phase development model as delineated by ORBIT for behavioral interventions (which was adapted from the original phases used for pharmaceuticals) but includes key adaptations relevant to RWE production for DTx. The intended audiences for this are entities that develop and market DTx and thus need RWD and community-serving organizations such as healthcare organizations and public health departments that can provide RWD. We offer the DTx RWE Framework as a unified approach that integrates best practices to evidence production for DTx, which can be used now to guide the actions of DTx companies and community-serving organizations. With that said, regulators of DTx could also consider drawing on the DTx RWE Framework to improve guidance related to DTx evidence production.


 Citation

Please cite as:

Kim M, Patrick K, Nebeker C, Godino J, Stein S, Klasnja P, Perski O, Viglione C, Coleman A, Hekler E

The Digital Therapeutics Real-World Evidence Framework: An Approach for Guiding Evidence-Based Digital Therapeutics Design, Development, Testing, and Monitoring

J Med Internet Res 2024;26:e49208

DOI: 10.2196/49208

PMID: 38441954

PMCID: 10951831

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.