Accepted for/Published in: JMIR Medical Informatics
Date Submitted: Nov 24, 2020
Open Peer Review Period: Nov 23, 2020 - Jan 18, 2021
Date Accepted: Jun 3, 2021
(closed for review but you can still tweet)
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Effects of Background Color, Flash and Exposure Value on the Accuracy of Smartphone-Based Pill Recognition System Using Deep Convolutional Neural Network
ABSTRACT
Background:
It is difficult to develop a drug image recognition system due to the difference of the pill color influenced by external environmental factors such as the illumination or presence of flash.
Objective:
In this study, we wanted to see how the difference in color between the reference image and the real-world image affects the accuracy in pill recognition under 12 real-world conditions according to the background colors, presence of flash, and exposure values (EV).
Methods:
We used 19 medications with different features of colors, shapes, and dosages. The average color difference was calculated based on the color distance between the reference image and the real-world image.
Results:
In the case of the black background, as the exposure value lowered, the accuracy of top-1 and top-5 increased independently of the presence of flash. The top-5 accuracy in black background increased from 26.8% to 72.6% with the flash on and from 29.5% to 76.8% with the flash off as EV decreased as well. On the other hand, top-5 accuracy was 62.1% to 78.4% in white background with the flash on. The best top-1 accuracy was 51.1 % in the white background, flash on, and EV+2.0. The best top-5 accuracy was 78.4% in the white background, flash on, and EV0.
Conclusions:
The accuracy generally increased as the color difference decreased except in the case of black background and EV-2.0. This study reveals that the background colors, presence of flash, and exposure values in real-world conditions are important factors affecting the performance of a pill recognition model.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.