JMIR Publications

ABSTRACT

Background:

The Objective Structured Clinical Examination (OSCE) is a prevalent method for evaluating clinical competence in medical education. As OSCEs become increasingly standardized and resource-intensive, alternative evaluation methods are being explored, particularly owing to the limited availability of certified examiners. However, few studies have investigated whether wearable technologies can effectively support OSCE assessment. Wearable devices may present a viable solution for recording and assessing clinical skills from the examiner’s perspective.

Objective:

This pilot study, conducted in 2024, aimed to investigate the feasibility and utility of a neck-mounted wearable camera for recording OSCE scenarios and to evaluate the assessability of clinical performance based on the obtained footage.

Methods:

Nine experienced medical educators participated in a simulated OSCE scenario involving ECG lead placement. All participants completed the initial live assessment and post-use questionnaire, while 8 completed the subsequent video-based reassessment. The authors utilized video recordings from both a fixed camera and a neck-mounted camera (THINKLET®) to assess the evaluability of each OSCE item. Following a washout period, evaluators re-assessed the recorded sessions. The authors analyzed interrater agreement using percent agreement and Cohen’s κ coefficient. A post-evaluation questionnaire captured evaluators’ experiences with the wearable device.

Results:

Cohen’s κ ranged from 0.258 to 0.913 (mean: 0.67), indicating substantial overall agreement. Visibility of fine motor skills, particularly in ECG electrode placement, appeared to be enhanced when using the neck-mounted camera, as inferred from higher assessment completion rates compared to fixed-camera recordings (odds ratio = 11.69; P < .001). Evaluators reported generally positive experiences with the device, although some noted issues with comfort, posture restriction, and limited visibility at low angles.

Conclusions:

This pilot study suggested that neck-mounted wearable cameras may enhance flexibility and visual accuracy in OSCE assessment, supporting their potential role in supplementing current evaluation practices. Further research is needed to standardize usage and address technical challenges.