JMIR Publications

ABSTRACT

Background:

Despite the emergence of app evaluation tools, there remains no well-defined process receptive to diverse local needs, rigorous standards, and current content. The need for such a process to assist in the implementation of app evaluation across all medical fields is evident. Such a process has the potential to increase engagement of stakeholders and catalyze interest and engagement with present-day app evaluation models. To address this need, we developed and pilot tested the Technology Evaluation and Assessment Criteria for Health apps (TEACH-apps).

Objective:

Introduce an implementation process for health app evaluation

Methods:

Tailoring a well-known implementation framework, Replicating Effective Programs, we present a new process to approach the challenges faced in implementing app evaluation tools today. As a culmination of our experience implementing this process and feedback from stakeholders, we present the four-part process to aid the implementation of mobile health technology. This paper outlines the theory, evidence, and initial versions of the process.

Results:

TEACH-apps is designed to be broadly useable and widely applicable across all fields of health. The process is comprised of four parts: 1) Pre-Conditions (e.g. gathering apps and considering local needs), 2) Pre-Implementation (e.g. customizing criteria and offering digital skills training), 3) Implementation (e.g. evaluating apps and creating educational handouts), and 4) Maintenance and Evolution (e.g. repeating the process every 90 days and updating content). TEACH-apps has been tested internally at our hospital and there is growing interest at partnering healthcare facilities to test the system at their sites.

Conclusions:

This implementation framework introduces a process that equips stakeholders, clinicians, and users with the foundational tools to make informed decisions around app use and increase app evaluation engagement. Application of this process may lead to the selection of more culturally appropriate and clinically relevant tools in healthcare.