Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: JMIR mHealth and uHealth

Date Submitted: Jun 1, 2026
Open Peer Review Period: Jun 4, 2026 - Jul 30, 2026
(closed for review but you can still tweet)

NOTE: This is an unreviewed Preprint

Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).

Peer review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.

Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).

Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.

Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.

Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Privacy-Preserving Mobile 3D Face Tracking for Objective Assessment of Empathic Facial Reactivity: Observational Study

  • Cem Doğdu; 
  • Leon Nissen; 
  • Luca Kleineidam; 
  • Carolin Miklitz; 
  • Johanna Knöferle; 
  • Klaus Fliessbach; 
  • Lena Marth; 
  • Johannes Levin; 
  • Elisabeth Kasper; 
  • Andreas Hermann; 
  • Karin Graf; 
  • Sarah Anderl-Straub; 
  • Zeljko Uzelac; 
  • Annika Spottke; 
  • Gabor C. Petzold; 
  • Isabel Dziobek; 
  • Stefan R. Schweinberger; 
  • Stephan Jonas; 
  • Michael Wagner; 
  • Anja Schneider; 
  • Lara Marie Reimer

ABSTRACT

Background:

Psychiatric and neurological conditions are often accompanied by alterations in empathic resonance with emotional states of others, yet objective measures of affective empathy remain limited in clinical practice. Mobile and privacy-preserving facial expression analysis can provide a scalable approach for assessing spontaneous empathic reactivity in research and clinical practice.

Objective:

This paper aimed to evaluate an established iOS-based, computationally efficient and privacy-preserving facial expression assessment of empathy using mobile 3D face tracking during established static and dynamic empathy paradigms.

Methods:

We integrated Apple ARKit-based 3D facial landmark extraction from an iPad True-Depth assisted camera into a multidimensional empathy assessment in 32 healthy adults. Participants viewed affect-laden pictures from the Multifaceted Empathy Test-core-2 and emotional film clips while facial blend shapes with semantically meaningful labels (eg, cheekSquint, eyeSquint) were extracted in real time. Linear mixed-effects models tested valence-specific reactivity, temporal modulation, task-demand effects, and associations with subjective empathy ratings, trait-empathy questionnaires, age, and sex. Hierarchical clustering examined co-activation patterns among blend shapes.

Results:

Positive stimuli elicited valence-specific facial reactivity, including increased smile-related activations (eg, mouthSmile: β=.241, P<.001) and reduced negative-valence expressions (eg, mouthFrown: β=.131, P<.001) during positive trials, consistent with emotional contagion. Reactivity showed dynamic temporal patterns, and film clips elicited stronger responses than static images for several positive-expression blend shapes. Hierarchical clustering revealed coherent blend shape co-activations. Facial reactivity was associated with subjective affective empathy ratings, empathic-trait questionnaires, and demographic variables.

Conclusions:

Mobile 3D face tracking captured subtle, spontaneous, and temporally dynamic facial reactivity during integrated empathy tasks while preserving privacy by avoiding raw video storage. This mHealth approach provides a scalable, clinically translatable framework for objective assessment of affective empathy and supports future implementation in neuropsychiatric research and mobile assessment.


 Citation

Please cite as:

Doğdu C, Nissen L, Kleineidam L, Miklitz C, Knöferle J, Fliessbach K, Marth L, Levin J, Kasper E, Hermann A, Graf K, Anderl-Straub S, Uzelac Z, Spottke A, Petzold GC, Dziobek I, Schweinberger SR, Jonas S, Wagner M, Schneider A, Reimer LM

Privacy-Preserving Mobile 3D Face Tracking for Objective Assessment of Empathic Facial Reactivity: Observational Study

JMIR Preprints. 01/06/2026:103254

DOI: 10.2196/preprints.103254

URL: https://preprints.jmir.org/preprint/103254

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.