Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Mental Health

Date Submitted: Feb 14, 2024
Date Accepted: Aug 11, 2024

The final, peer-reviewed published version of this preprint can be found here:

The Most Effective Interventions for Classification Model Development to Predict Chat Outcomes Based on the Conversation Content in Online Suicide Prevention Chats: Machine Learning Approach

Salmi S, Mérelle S, Gilissen R, van der Mei R, Bhulai S

The Most Effective Interventions for Classification Model Development to Predict Chat Outcomes Based on the Conversation Content in Online Suicide Prevention Chats: Machine Learning Approach

JMIR Ment Health 2024;11:e57362

DOI: 10.2196/57362

PMID: 39326039

PMCID: 11467604

The most effective interventions during online suicide prevention chats: Machine Learning Study

  • Salim Salmi; 
  • Saskia Mérelle; 
  • Renske Gilissen; 
  • Rob van der Mei; 
  • Sandjai Bhulai

ABSTRACT

Background:

To provide optimal care in a suicide prevention helpline, it is important to know what contributes to positive or negative effects on help seekers. Helplines can often be contacted through chat services, which produce large amounts of text data, to use in large-scale analysis.

Objective:

We trained a machine learning classification model and identify which counsellor utterances have the most impact on its outputs.

Methods:

From August 2021 until January 2023, help seekers (N=6903) scored themselves on factors known to be associated with suicidality (like hopelessness, feeling entrapped, will to live, etc) before and after a chat conversation of the suicide prevention helpline in the Netherlands (113 Suicide Prevention). Machine learning text analysis was used to predict help seeker scores on these factors. The model was interpreted, to show which messages of the helpers in a conversation contributed to the prediction.

Results:

According to the machine learning model, positive affirmations and expressing involvement of helpers contributed to improved scores of help seekers. Use of macros and ending the conversation prematurely, due to the help seeker being in an unsafe situation, had negative effects on help seekers.

Conclusions:

This study reveals insights for improving helpline conversations, emphasizing the value of an evocative style with questions, positive affirmations, and practical advice. It also underscores the potential of machine learning in helpline analysis.


 Citation

Please cite as:

Salmi S, Mérelle S, Gilissen R, van der Mei R, Bhulai S

The Most Effective Interventions for Classification Model Development to Predict Chat Outcomes Based on the Conversation Content in Online Suicide Prevention Chats: Machine Learning Approach

JMIR Ment Health 2024;11:e57362

DOI: 10.2196/57362

PMID: 39326039

PMCID: 11467604

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.