Accepted for/Published in: Interactive Journal of Medical Research
Date Submitted: Sep 16, 2018
Open Peer Review Period: Sep 20, 2018 - Oct 4, 2018
Date Accepted: Aug 2, 2019
(closed for review but you can still tweet)
To what extent are allergy-specific online training programmes based on quality criteria for online health information: thematic content evaluation
ABSTRACT
Background:
Allergic diseases such as allergic asthma, rhinitis and atopic eczema are widespread and are a considerable burden on the healthcare system. Still, many individuals do not seek regular treatment, or rely on self-treatment. Particularly those with mild to moderate symptoms, online training programmes may be quite helpful, not at least because they can be accessed and used easily. While such services are promising, they need to be based on the best available evidence and quality criteria for evidence-based health information.
Objective:
This study aimed to assess a sample of allergy-specific “online training programmes” – i.e. interactive, feedback-oriented online training platforms promoting health-related behavioural change and improvement of personal skills – regarding a) general characteristics, aims, and target groups, and b) the extent to which these tools take online health information quality criteria into account.
Methods:
Online training programmes were selected via an initial Google search. In parallel, we searched English and German websites of medical and public health services such as the European Centre for Allergy Research Foundation (German), Asthma UK, and Anaphylaxis Canada. For analysis, an assessment matrix was developed based on a) established guidelines for online health information (e.g. JAMA Benchmarks; DISCERN criteria; HON code) and b) a database search of related studies. The items (n=44) covered aspects related to a) content (completeness, transparency, evidence), b) structure (data safety, qualification of trainers/authors) and c) impact (effectiveness, user perspective, integration into healthcare). Three researchers independently analysed interventions. SPSS 23 was used to calculate sum scores for each OTP to assess the coverage of the above-named categories.
Results:
On average, the analysed online training programmes (n=15) covered 37% of the quality criteria (sum score 33 of 88). 7 OTPs covered more than 40%, the highest score being 49% (n=1). 5 OTPs covered 30%–40% of all rated criteria; the rest covered fewer (n=3; lowest score 24%). Criteria relating to intervention (58%), content (49%), and data safety (60%) were more often considered, as opposed to user safety (10%), qualification of staff (10%), effectiveness (16%), and user perspective (45%). Also, in 13 of 15 OTPs at least 3 categories and their respective criteria were not covered at all (0%). The evidence base of OTPs was scored according to their use of scientific research (46%), regular information update (53%) and transparent provision of sources (33%). Specific descriptions of the quality of sources and strength of evidence were absent.
Conclusions:
Online training programmes should be based much more thoroughly on quality criteria and available evidence. Also, criteria for development and evaluation may need improvement. The inclusion of users, communication research, healthcare professionals, and developer perspectives are crucial to adapt current services to user preferences, and to address methodological, technical and content-related challenges.
Citation
Per the author's request the PDF is not available.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.