JMIR Publications

ABSTRACT

Background:

There is growing evidence highlighting a significant gap between mental health and wellbeing needs and available support. Digital interventions, such as mental health apps, have been identified as an appropriate medium for addressing the problem. However, a number of apps are being developed and made available without the relevant evidence base. Thus, there is a need to conduct user testing and early evaluations of new apps to provide sufficient information for users and prescribers.

Objective:

The primary aim of this feasibility study is to describe the acceptability, engagement, and preliminary outcomes of using an app (Paradym) designed to promote emotional wellbeing and positive mental health.

Methods:

This is a mixed methods single-arm study with a pre- and post- design, aggregate with digital analytics data. We anonymously collected real world data on demographics, mental health and wellbeing, and usability and acceptance using validated questionnaires and open ended-questions. Participants were asked to download the app and use the intervention for a minimum of 2 weeks before completing follow up measures. Google Analytics was used to record levels of engagement with the app. Chi Square and t-tests were conducted to analyze quantitative data, and a thematic analysis approach was adopted for qualitative data.

Results:

A total of 116 participants accessed the study, of which 91 users downloaded the app. The sample was diverse in terms of ethnicity (43.5% belonging to minority ethnic groups) and included majority females (67.24%) between the ages 18-25 from the USA. Participants who completed the study (n=34) provided favorable feedback in terms of the app’s content, functionality and underlying principles. Although usability feedback varied across items, a high percentage of participants found that the app was easy to use. Based on descriptive data, the mean mental health and wellbeing scores improved. Post hoc analyses indicated that the reduction in PHQ-9 depression scores (t33 = -2.16) and the change in scores on one of the wellbeing measures (WHO-5) (t33 = 2.87) were statistically significant. No adverse events were reported and anxiety levels of the participants were found to be mild during the intervention period.

Conclusions:

The findings of this study are encouraging and potentially show preliminary evidence of effectiveness. The findings also suggest scope for further research with underrepresented groups, such as ethnic minority populations. Furthermore, the research provides valuable information for future app upgrades and further evaluations of the intervention. Clinical Trial: Eisenstadt A, Liverpool S. User Testing Service Evaluation. doi:10.17605/OSF.IO/TVJBA.