JMIR Publications

ABSTRACT

Background:

Access to screening continues to be a barrier for the early detection of diabetic retinopathy (DR). Primary care-based DR screening could improve access, but operational challenges, such as cost and workflow management, hamper the widespread adoption of retinal camera systems in primary care clinics in the US.

Objective:

To develop and evaluate a retinal screening system suitable for integration into a primary care workflow.

Methods:

We developed a non-mydriatic, 45-degree field imaging retinal camera system, the Verily Numetric Retinal Camera (VNRC), able to generate high fidelity retinal images enabled by on-device intelligent features. The VNRC output flows into cloud-based software that accepts and routes digitized images for grading. We evaluated the performance and usability of the VNRC with two studies. A retrospective performance study compared the performance of VNRC against a reference camera (Crystalvue NFC-700) as well as the correlation between VNRC capture status and gradability (as determined by ophthalmologist graders). The usability study simulated a primary care setting for a combined cohort of trained and untrained users (corresponding to patients in the simulation) and operators (corresponding to healthcare personnel in the simulation), where respondents completed a questionnaire about their user experience after attempting to capture images with the VNRC.

Results:

In the comparative performance study (N=108, K=206 images), a total of 98.5% of images captured by the VNRC were graded as sufficient for clinical interpretation compared to 97.1% of Crystalview NFC-700 images (difference in proportion was 0.015, 95% CI: -0.007 - 0.033). In the quality control algorithm evaluation (N = 172, K = 343 images), we found a positive association (φ =0.53) between gradability status (gradable/non-gradable) as determined by ophthalmologists and the capture status (recapture not-needed/needed) as determined by the VNRC quality control algorithm. In the usability study, (n=15 users, and n=30 operators), all participating users (15/15) indicated that they were able to have both eyes screened easily. Most users and operators indicated agreement (from somewhat agree to strongly agree) with statements describing the imaging process as intuitive (15/15 [100%] and 29/30 [96.7%]), comfortable (15/15 [100%] and 30/30 [100%]), and allowing for a positive experience (15/15 [100%] and 30/30) [100%], of users and operators, respectively.

Conclusions:

Our findings about the performance and usability of this retinal camera system support its deployment as an integrated end-to-end retinal service for primary care. These results warrant additional studies to fully characterize real-world usability across a wider and diverse set of primary care clinics. Clinical Trial: NA