Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Apr 12, 2021
Open Peer Review Period: Apr 12, 2021 - Jun 7, 2021
Date Accepted: Sep 22, 2021
Date Submitted to PubMed: Nov 22, 2021
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

A Markerless 2D Video, Facial Feature Recognition–Based, Artificial Intelligence Model to Assist With Screening for Parkinson Disease: Development and Usability Study

Hou X, Wang Y, Wang X, Zhao J, Zhu X, Zhang Y, Su J

A Markerless 2D Video, Facial Feature Recognition–Based, Artificial Intelligence Model to Assist With Screening for Parkinson Disease: Development and Usability Study

J Med Internet Res 2021;23(11):e29554

DOI: 10.2196/29554

PMID: 34806994

PMCID: 8663465

A markerless 2D video of facial features recognition based artificial intelligence model to assist Parkinson’s disease screening

  • Xinyao Hou; 
  • Yanping Wang; 
  • Xinyi Wang; 
  • Jiahao Zhao; 
  • Xiaobo Zhu; 
  • Yu Zhang; 
  • Jianbo Su

ABSTRACT

Background:

Mask face is a characteristic clinical manifestation of Parkinson's disease (PD), but subjective evaluations from different clinicians often show low consistency owing to lacking accurate detection technology. With the objective of making monitoring easier and more accessible, we developed a markerless 2D video of facial features recognition based artificial intelligence (AI) model to assess facial features of PD patients and aimed to investigate how AI could help neurologists improve PD early diagnostic performance.

Methods:

We collected 140 videos of facial expressions of 70 PD patients and 70 healthy controls from three hospitals. We developed and tested the AI model that performs mask face recognition of PD patients based on the acquisition and evaluation of facial features including geometric features and texture features, using a single 2D video camera. The diagnostic performance of AI model was compared with 5 neurologists.

Results:

Experimental results show that our AI models can achieve feasible and effective facial feature recognition ability to assist PD diagnosis. The precision and F1 values of PD diagnosis can reach 83% and 86%, using geometric features and texture features, respectively. When these two features are combined, a F1 value of 88% can be reached. Further, the facial features of patients with PD were not affected by the motor and non-motor symptoms of PD.

Conclusions:

PD patients commonly exhibit facial features. Video of facial features recognition based AI model can provide a valuable tool to assist PD diagnosis and potential of realizing remote monitoring on patients’ condition especially on the COVID-19 pandemic.


 Citation

Please cite as:

Hou X, Wang Y, Wang X, Zhao J, Zhu X, Zhang Y, Su J

A Markerless 2D Video, Facial Feature Recognition–Based, Artificial Intelligence Model to Assist With Screening for Parkinson Disease: Development and Usability Study

J Med Internet Res 2021;23(11):e29554

DOI: 10.2196/29554

PMID: 34806994

PMCID: 8663465

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.