Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Jun 6, 2025
Open Peer Review Period: Jun 8, 2025 - Aug 3, 2025
Date Accepted: Dec 3, 2025
(closed for review but you can still tweet)
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Enhancing LGBTQ+ Inclusivity in an AI-Powered Sexual Health Chatbot: A User-Centered Design Approach Through a Nonprofit-Academic Partnership
ABSTRACT
Background:
Despite the growing use of digital platforms for sexual health education, many tools fail to meet the needs of LGBTQ+ adolescents, who often lack access to inclusive, affirming resources. Artificial intelligence (AI)–enabled chatbots have emerged as promising tools to address these gaps, but concerns remain around bias, usability, and trustworthiness–particularly for queer and trans youth.
Objective:
This paper describes the development and implementation of an academic-nonprofit partnership between Northwestern University and Planned Parenthood Federation of America (PPFA) to adapt Roo, PPFA’s AI-powered sexual health chatbot, for LGBTQ+ teens.
Methods:
As part of a larger hybrid effectiveness-implementation trial, the research team collaborated with PPFA to create a customized instance of Roo and gathered feedback from a Youth Advisory Council (YAC) of LBGTQ+ teens via a private Discord server. Using a participatory, research-through-design approach, we analyzed structured qualitative feedback with rapid qualitative analysis to identify content gaps, usability concerns, and trust-related issues.
Results:
Participants expressed both skepticism and curiosity about AI’s role in delivering sexual health information, offering critical insights on the chatbot’s language, trustworthiness, and relevance. Teens identified key limitations in Roo’s inclusivity, tone, and interface, particularly around trans-specific content, conversational depth, and stigma reduction. These findings informed targeted content updates, interface refinements, and transparency improvements, implemented by PPFA to enhance Roo for broader use.
Conclusions:
Academic-nonprofit collaborations can leverage participatory methods to enhance digital health tools in real-world contexts. LGBTQ+ teens served not only as testers but as co-designers, shaping the chatbot’s evolution and surfacing broader lessons about trust, AI literacy, and health equity. This partnership offers a scalable model for integrating community voice into the development, evaluation, and implementation of inclusive, AI-enabled health technologies.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.