Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Jan 12, 2020
Date Accepted: Jun 3, 2020
Date Submitted to PubMed: Aug 21, 2020
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
An online guide for eHealth evaluation approaches: a systematic scoping review and concept mapping study
ABSTRACT
Background:
Despite the increase in use and high expectations of digital health solutions, scientific evidence about the effectiveness and other aspects such as usability and accuracy is lagging behind. eHealth solutions are complex interventions and in order to evaluate complex interventions, a wide array of evaluation approaches is needed that are capable to answer the many different questions that arise during the consecutive study phases of eHealth development and implementation. However, evaluators seem to struggle choosing suitable evaluation approaches in relation to a specific study phase.
Objective:
The objective of this project was to compose a structured overview of the existing eHealth evaluation approaches, aiming to assist eHealth evaluators with selecting a suitable approach for evaluating their eHealth solution at a specific evaluation study phase.
Methods:
Three consecutive steps were followed. Step 1 was a systematic scoping review, summarizing existing eHealth evaluation approaches. Step 2 was a concept mapping study asking eHealth researchers about approaches for evaluating eHealth. In step 3, the results of step 1 and 2 were used to develop an ‘eHealth evaluation cycle’ and subsequently compose the online ‘eHealth methodology guide’.
Results:
The scoping review yielded 57 articles describing 50 unique evaluation approaches. The concept mapping study questioned 43 eHealth researchers, resulting in 48 unique approaches. After removing duplicates, 75 unique evaluation approaches remained. Thereafter, an ‘eHealth evaluation cycle’ was developed, consisting of six evaluation study phases from ‘development’ to ‘implementation’. Finally, the ‘eHealth methodology guide’ was composed by assigning the 75 evaluation approaches to the specific study phases of the ‘eHealth evaluation cycle’.
Conclusions:
75 unique evaluation approaches were found in literature and suggested by eHealth researchers, and served as content for the online ‘eHealth methodology guide’. By assisting evaluators in selecting a suitable evaluation approach in relation to a specific study phase of the ‘eHealth evaluation cycle’, the guide aims to enhance quality, safety and successful long-term implementation of novel eHealth solutions.
Citation
