Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Research Protocols

Date Submitted: Dec 6, 2024
Date Accepted: Jun 18, 2025

The final, peer-reviewed published version of this preprint can be found here:

Identifying and Reducing Stigmatizing Language in Home Health Care With a Natural Language Processing–Based System (ENGAGE): Protocol for a Mixed Methods Study

Zhang Z, Gupta P, Potts-Thompson S, Prescott L, Morrison M, Sittig S, McDonald MV, Raymond C, Taylor JY, Topaz M

Identifying and Reducing Stigmatizing Language in Home Health Care With a Natural Language Processing–Based System (ENGAGE): Protocol for a Mixed Methods Study

JMIR Res Protoc 2025;14:e69753

DOI: 10.2196/69753

PMID: 40998318

PMCID: 12511817

Identifying and reducing stigmatizing language in home healthcare: Protocol for the ENGAGE study

  • Zhihong Zhang; 
  • Pallavi Gupta; 
  • Stephanie Potts-Thompson; 
  • Laura Prescott; 
  • Morgan Morrison; 
  • Scott Sittig; 
  • Margaret V. McDonald; 
  • Chase Raymond; 
  • Jacquelyn Y. Taylor; 
  • Maxim Topaz

ABSTRACT

Background:

Stigmatizing language is prevalent in clinical notes, adversely affecting patient care quality. Natural language processing (NLP) is a promising technology for analyzing millions of clinical notes in electronic health records.

Objective:

This study proposes an NLP-driven ENGAGE system to automatically identify and replace stigmatizing language.

Methods:

This mixed-method study will extract electronic health record (EHR) data for patients admitted to two large, diverse home healthcare (HHC) organizations between January 2019, and December 2021. The study will be conducted in four aims: Aim 1 will refine the ontology of stigmatizing language in HHC by (a) interviewing a diverse sample of HHC nurses and patients to identify terms to avoid, and (b) analyzing clinical notes from various U.S. regions to categorize stigmatizing language. Aim 2 will determine the best NLP approach for accurately identifying stigmatizing language by training algorithms and comparing their performance to human annotations. Aim 3 will analyze the prevalence of stigmatizing language based on patients’ race and ethnicity using adjusted statistical analyses of a sample of approximately half a million HHC patients (34% racial and ethnic minorities). Aim 4 will develop the NLP-driven ENGAGE system by (a) testing NLP methods (rule-based, “Delete, Retrieve, Generate,” and transformers) for suggesting alternative wording, and (b) designing and refining the user interface for clinical trial preparation.

Results:

This study was funded by the National Institute on Minority Health and Health Disparities. Recruitment, enrollment, and data curation are ongoing.

Conclusions:

This study will leverage extensive data sources to examine stigmatizing language in HHC settings, contributing to developing systems to effectively reduce such language among HHC nurses. Clinical Trial: NA


 Citation

Please cite as:

Zhang Z, Gupta P, Potts-Thompson S, Prescott L, Morrison M, Sittig S, McDonald MV, Raymond C, Taylor JY, Topaz M

Identifying and Reducing Stigmatizing Language in Home Health Care With a Natural Language Processing–Based System (ENGAGE): Protocol for a Mixed Methods Study

JMIR Res Protoc 2025;14:e69753

DOI: 10.2196/69753

PMID: 40998318

PMCID: 12511817

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.