Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Jun 14, 2025
Open Peer Review Period: Jun 15, 2025 - Aug 10, 2025
Date Accepted: Aug 8, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Digital Hostility Toward LGBTQIA+ Research Recruitment on Social Media Using Topic Modeling and Sentiment Analysis of Facebook Comments: Quantitative Content Analysis Study

Rodriguez VJ, Peterson B, Benhayoun A, Liu Q

Digital Hostility Toward LGBTQIA+ Research Recruitment on Social Media Using Topic Modeling and Sentiment Analysis of Facebook Comments: Quantitative Content Analysis Study

J Med Internet Res 2025;27:e79080

DOI: 10.2196/79080

PMID: 40921069

PMCID: 12455171

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

The Dark Side of Visibility: Hostile Social Media Responses to LGBTQIA+ Research and Implications for Researchers

  • Violeta J. Rodriguez; 
  • Brett Peterson; 
  • Ashley Benhayoun; 
  • Qimin Liu

ABSTRACT

Abstract

Background:

LGBTQIA+ researchers and participants frequently encounter hostility in online environments, particularly on social media platforms where public commentary on research advertisements can foster stigmatization. Despite a growing body of work on researcher harassment, little empirical research has examined the actual content and emotional tone of public responses to LGBTQIA+-focused research recruitment.

Objective:

This study aimed to analyze the thematic patterns and sentiment of social media comments directed at LGBTQIA+ research recruitment advertisements, in order to better understand how online stigma is communicated and how it may impact both researchers and potential participants.

Methods:

A total of 994 publicly visible Facebook comments posted in response to LGBTQIA+ recruitment ads (January–May 2024) were collected and analyzed. Text preprocessing included tokenization, stop-word removal, and lemmatization. Latent Dirichlet Allocation (LDA) was used to identify latent themes across the dataset. Sentiment analysis was conducted using the Bing Liu and NRC lexicons, with scores ranging from -1 (most negative) to 1 (most positive). Linguistic Inquiry and Word Count (LIWC) was employed to quantify psychological and moral language features. Comments were also manually coded into four audience target groups (researchers, LGBTQIA+ community, general public, other commenters), and language category differences were analyzed using one-way ANOVAs with Bonferroni corrections.

Results:

Topic modeling identified three key themes: (1) “Transitions, Health, and Gender Dysphoria,” (2) “Negative and Confrontational Language,” and (3) “Religious and Ideological Debates.” Topic 2 had the highest average prevalence (γ = 0.486). Sentiment analysis revealed negative mean sentiment scores for all three topics: Topic 1 (-0.41), Topic 2 (-0.21), and Topic 3 (-0.35). No topic exhibited a statistically significant predominance of positive sentiment. A one-way ANOVA showed significant differences in linguistic tone across target groups: negative tone (F(3, 990) = 12.84, P < .001), swearing (F(3, 990) = 16.07, P < .001), and anger-related language (F(3, 990) = 9.45, P < .001), with the highest levels found in comments directed at researchers. Comments targeting LGBTQIA+ individuals showed higher references to mental illness, morality, and threats to children. While a small proportion of comments offered affirming responses, they were embedded in adversarial exchanges and did not offset the broader negativity.

Conclusions:

This study documents a persistently hostile online environment for LGBTQIA+ research, where researchers are frequently dehumanized and LGBTQIA+ identities are pathologized. These findings reinforce stigma communication models and suggest a need for institutional responses that include mental health support, enhanced moderation tools, and policy advocacy. Future research should investigate how hostile discourse affects researcher well-being and recruitment outcomes, and evaluate interventions to foster more respectful engagement with LGBTQIA+ studies.


 Citation

Please cite as:

Rodriguez VJ, Peterson B, Benhayoun A, Liu Q

Digital Hostility Toward LGBTQIA+ Research Recruitment on Social Media Using Topic Modeling and Sentiment Analysis of Facebook Comments: Quantitative Content Analysis Study

J Med Internet Res 2025;27:e79080

DOI: 10.2196/79080

PMID: 40921069

PMCID: 12455171

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.