JMIR Publications

ABSTRACT

Background:

The COVID-19 pandemic prevented many medical specialist programmes across the world from conducting certification examinations. However, the Colleges of Medicine of South Africa (CMSA), which is responsible for conducting all specialist and sub-specialist certification examinations in South Africa, continued conducting examinations despite the pandemic.

Objective:

The study was conducted to determine the success and challenges of conducting SOEs using Zoom, with a special focus on acceptability of this examination format to candidates.

Methods:

The CMSA hosted 2933 candidates undertaking examinations for 95 diploma, specialist and sub-specialist qualifications. Of these, 2176 candidates participated in examinations requiring SOEs which amounted to 7226 individual Zoom calls. A survey was conducted during the first cycle of examinations in 2020 to assess the acceptability of the examination format to candidates.

Results:

Pass rates ranged from 82% to 96% for the respective qualifications across two examination cycles. The overall pass rate for these 2 examination cycles was higher than that of the previous 6 examination cycles for the CMSA. The majority of 542 candidates who completed the survey felt that it was a fair examination method that tested their clinical reasoning and insight appropriately. They also felt that the case scenarios were of adequate complexity, and that the material was well presented.

Conclusions:

This ambitious undertaking has demonstrated that virtual, case-based SOEs are a feasible and acceptable examination option. It is anticipated that the positive outcome of this study, the significant time and cost savings to candidates, examiners and the organization will motivate member colleges to support the ongoing use of virtual SOEs as part of the composite examination package.