Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: JMIR mHealth and uHealth

Date Submitted: May 8, 2026
Open Peer Review Period: May 8, 2026 - Jul 3, 2026
(currently open for review)

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Predicting Cognitive Decline and Mental Health Conditions through Human Movement Analysis with Computer Vision: A Scoping Review

  • Tse Chun Heng; 
  • Zun Xiong Ritesh Deo; 
  • Oliver Roberts; 
  • Yasmin Munro; 
  • Khoi T. N. Nguyen; 
  • Karen Sui Geok Chua; 
  • Bryan Yijia Tan; 
  • Ananda Sidarta; 
  • Pablo Cruz-Gonzalez

ABSTRACT

Background:

Computer vision (CV) technologies are increasingly applied to gait and movement analysis to assess cognitive decline and mental health conditions. By extracting physical biomarkers such as gait and posture, CV offers a non-invasive, scalable approach for early identification of cognitive and psychosocial changes.

Objective:

This scoping review aims to explore how CV-based methods use physical biomarkers to predict cognitive and mental health outcomes.

Methods:

A scoping review was conducted in accordance with the Arksey and O’Malley framework and reported using PRISMA-ScR guidelines. Searches were performed across Medline, Embase, Web of Science, IEEE Xplore, and PubMed. Eligible studies were randomised controlled trials, cohort, or longitudinal studies involving human participants, both healthy and those with underlying pathology. Included studies used CV to analyse physical biomarkers for predicting cognitive or mental health outcomes, with objective comparators. Data were extracted on study characteristics, populations, CV methodologies, motion tasks, biomarkers, and outcomes.

Results:

Following study selection, 41 studies were selected. Most used markerless motion capture, pose estimation, or deep learning. Temporospatial features were the most commonly analysed biomarkers. Cognitive decline, depression, anxiety, and psychosocial well-being were frequently targeted outcomes. Many studies found significant links between these biomarkers and cognitive or mental health outcomes. They also proposed predictive models, most commonly classification or regression frameworks, compared to validated screening tools. These models aim to support early identification.

Conclusions:

Computer vision offers a promising approach to predicting cognitive and mental health outcomes. Future work should emphasise standardisation, clinical validation, and broader population applications.


 Citation

Please cite as:

Heng TC, Deo ZXR, Roberts O, Munro Y, Nguyen KTN, Chua KSG, Tan BY, Sidarta A, Cruz-Gonzalez P

Predicting Cognitive Decline and Mental Health Conditions through Human Movement Analysis with Computer Vision: A Scoping Review

JMIR Preprints. 08/05/2026:100699

DOI: 10.2196/preprints.100699

URL: https://preprints.jmir.org/preprint/100699

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.