JMIR Publications

ABSTRACT

Background:

This article contends that the responsible AI approach—which is the dominant ethics approach ruling most regulatory and ethical guidance—falls short because it overlooks the impact of AI on human relationships. Focusing only on responsible AI principles reinforces a narrow concept of accountability and responsibility of companies developing AI. This article proposes that integrating the ethics of care approach can offer a more comprehensive regulatory and ethical framework that addresses AI’s impact on human relationships. This dual approach is essential for the effective regulation of AI in the domain of mental health care. The article delves into the emergence of the new “therapeutic” area facilitated by AI-based bots, which operate without a therapist. The article highlights the difficulties involved, mainly the absence of a defined duty of care towards users, and shows how implementing ethics of care can establish clear responsibilities for developers. It also sheds light on the potential for emotional manipulation and the risks involved. In conclusion, the article proposes a series of considerations grounded in the ethics of care for the developmental process of AI-powered therapeutic tools.

Objective:

To suggest a new framework for regulating AI in mental health care based on the ethics of care

Methods:

theoretical analysis

Results:

Ethics of care principles formulated for regulating AI in mental healthcare and a suggested mechanism for ethical evaluation for implementing AI-bots (without a therapist) in mental healthcare

Conclusions:

Responsible AI is not sufficient for regulating AI in mental healthcare as it overlooks emotions and relationships, and a dual approach (both responsible AI approach and ethics of care approach) is needed to regulate AI in mental healthcare in an effective way