Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Jan 7, 2021
Date Accepted: Feb 1, 2021
Date Submitted to PubMed: Mar 5, 2021

The final, peer-reviewed published version of this preprint can be found here:

Preferences for Artificial Intelligence Clinicians Before and During the COVID-19 Pandemic: Discrete Choice Experiment and Propensity Score Matching Study

Liu T, Tsang W, Xie Y, Tian K, Huang F, Chen Y, Lau O, Feng G, Du J, Chu B, Shi T, Zhao J, Cai Y, Hu X, Akinwunmi B, Huang J, Zhang CJ, Ming WK

Preferences for Artificial Intelligence Clinicians Before and During the COVID-19 Pandemic: Discrete Choice Experiment and Propensity Score Matching Study

J Med Internet Res 2021;23(3):e26997

DOI: 10.2196/26997

PMID: 33556034

PMCID: 7927951

Preference for artificial intelligence medicine before and during COVID-19 pandemic: Discrete choice experiment with propensity score matching

  • Taoran Liu; 
  • Winghei Tsang; 
  • Yifei Xie; 
  • Kang Tian; 
  • Fengqiu Huang; 
  • Yanhui Chen; 
  • Oiying Lau; 
  • Guanrui Feng; 
  • Jianhao Du; 
  • Bojia Chu; 
  • Tingyu Shi; 
  • Junjie Zhao; 
  • Yiming Cai; 
  • Xueyan Hu; 
  • Babatunde Akinwunmi; 
  • Jian Huang; 
  • Casper JP Zhang; 
  • Wai-Kit Ming

ABSTRACT

Background:

Artificial intelligence (AI) has potential uses in relieving the public health pressure caused by the pandemic. In the case of a shortage of medical resources caused by the pandemic, whether people’s preference for AI doctors and traditional clinicians has changed is worth exploring.

Objective:

We aim to quantify and compare people’s preference for AI medicine and traditional clinicians before and during the COVID-19 pandemic to check whether people’s preference is affected by the pressure of pandemic.

Methods:

The propensity score matching (PSM) method was applied to match two different groups of respondents recruited in 2017 and 2020 with similar demographic characteristics. A total of 2048 respondents (1520 from 2017 and 528 from 2020) completed the questionnaire and were included in the analysis. The Multinomial Logit Model (MNL) and Latent Class Model (LCM) were used to explore people’s preferences for different diagnosis methods.

Results:

Among these respondents, 84.7% in 2017 and 91.3% in 2020 were confident that AI diagnosis would outperform human clinician diagnoses in the future. Both groups of respondents matched from 2017 and 2020 attached most importance to the attribute ‘accuracy’, and they prefer the combined diagnosis of AI and human clinicians (2017: odds ratio [OR] 1.645; 95% CI 1.535,1.763, p < 0.001; 2020: OR 1.513, 95% CI 1.413, 1.621, p < 0.001, Reference level: Clinician). LCM identified three classes with different attribute priorities. In Class 1, the preference for combination diagnosis and accuracy remains constant in 2017 and 2020, and higher accuracy (e.g., 2017 OR for 100% 1.357; 95% CI 1.164, 1.581) is preferred. In Class 2, the 2017 matched data is also very similar to class 2 in 2020, AI combined with human clinicians (2017: OR 1.204, 95% CI 1.039, 1.394, p = 0.011; 2020: OR 2.009, 95% CI 1.826, 2.211, p < 0.001, Reference level: Clinician) and 20 minutes (2017: OR 1.349, 95% CI 1.065, 1.708, p < 0.001; 2020: OR 1.488, 95% CI 1.287, 1.721, p < 0.001, Reference level, 0 min) of outpatient waiting time were consistently preferred. In Class 3, the respondents in 2017 and 2020 had different preferences for diagnosis method; respondents in Class 3 of 2017 prefer clinicians, whereas respondents in Class 3 of 2020 prefer AI diagnosis. As for the latent class segmented according to different sexes, all of the male and female respondent classes from 2017 and 2020 rank accuracy as the most important attribute.

Conclusions:

Individual preference for clinical diagnosis between AI and human clinicians were mostly unaffected due to the pandemic. Diagnosis accuracy and expense for diagnosis were of the most important attributes of choice of the type of diagnosis. These findings can provide guidance for policymaking relevant to the development of AI-based healthcare.


 Citation

Please cite as:

Liu T, Tsang W, Xie Y, Tian K, Huang F, Chen Y, Lau O, Feng G, Du J, Chu B, Shi T, Zhao J, Cai Y, Hu X, Akinwunmi B, Huang J, Zhang CJ, Ming WK

Preferences for Artificial Intelligence Clinicians Before and During the COVID-19 Pandemic: Discrete Choice Experiment and Propensity Score Matching Study

J Med Internet Res 2021;23(3):e26997

DOI: 10.2196/26997

PMID: 33556034

PMCID: 7927951

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.