JMIR Publications

ABSTRACT

Background:

Current e-Learning evaluation focuses on learners’ knowledge gain, satisfaction, perceptions and attitudes; few assess the implementation outcomes of e-Learning resources in teaching and learning.

Objective:

In this study, we used the RE-AIM (Reach, Effectiveness, Adoption, Implementation and Maintenance) framework to systematically evaluate the implementation outcomes of reusable learning objects (RLOs) in the context of healthcare education.

Methods:

In the ACORD project, we developed and implemented 23 RLOs across three Malaysian universities for medical, pharmacy and biomedical curricula. Implementation and dissemination strategies were employed. Data were collected using a self-administered online questionnaire and Google Analytics.

Results:

The study reported a cumulative RLO access of 7622 users from 48 countries (Reach). Users rated RLOs as very helpful (70.1%) or helpful (29.0%). Pre- and post-assessments showed a significant improvement in the knowledge score (21 RLOs, p<0.05) and confidence level (17 RLOs, p<0.05) (Effectiveness). All three Malaysian universities adopted the RLOs in the fields of professional development, primary care medicine, medicine, pediatrics, nursing, pharmacy and biomedicine (Adoption). The percentage of users who completed the RLOs ranged from 5.6-84.4% with non-bounced users (users who viewed more than one page) ranging from 16.3-81.5% (Implementation). In the four months following the completion of the ACORD project, a total of 2107 users accessed the RLOs (Maintenance).

Conclusions:

We systematically evaluated the implementation of e-Learning resources using the RE-AIM framework, informing future strategies to integrate e-Learning innovations in real-world teaching and learning practices.