Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
Generative AI Audiovisual Phenotyping for Measuring Communication, Shared Decision Making, and Trust: Usability Study
Shely Khaikin;
Vineet Tiruvadi;
Jeffrey Brooks;
Alice Baird;
Anne-Catherine Grela-Mpoko;
Lindsey Hoffman;
Jadyn Crossley;
Menachem Leasy;
Jaime Fineman;
Margot Savoy;
Laura Igarabuza;
Anuradha Paranjape;
Cheryl Y. S. Foo;
Michael L. Birnbaum;
Yaara Zisman-Ilani
ABSTRACT
This usability pilot using multimodal digital phenotyping of facial expressions, speech prosody, and language demonstrated that patients with depression often displayed negative nonverbal emotional cues despite reporting positive patient-provider communication and shared decision making experiences, suggesting digital phenotyping may better predict engagement than traditional self-reports.
Citation
Please cite as:
Khaikin S, Tiruvadi V, Brooks J, Baird A, Grela-Mpoko AC, Hoffman L, Crossley J, Leasy M, Fineman J, Savoy M, Igarabuza L, Paranjape A, Foo CYS, Birnbaum ML, Zisman-Ilani Y
Machine Learning–Based Audiovisual Phenotyping for Measuring Communication, Shared Decision-Making, and Trust