Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Sep 5, 2023
Date Accepted: May 16, 2024

The final, peer-reviewed published version of this preprint can be found here:

Social Media Authentication and Users’ Assessments of Health Information: Random Assignment Survey Experiment

Neely S, Witkowski K

Social Media Authentication and Users’ Assessments of Health Information: Random Assignment Survey Experiment

JMIR Form Res 2024;8:e52503

DOI: 10.2196/52503

PMID: 38980714

PMCID: 11267113

Social Media Authentication and User’ Assessments of Health Information: A Random Assignment Survey Experiment

  • Stephen Neely; 
  • Kaila Witkowski

ABSTRACT

Background:

In an effort to signal the authenticity of user accounts, social networking sites (SNS) such as Facebook and Twitter utilize visual heuristics (blue checkmarks) to signify whether accounts are verified. While verification markers are generally well recognized (and often coveted) by SNS users, relatively little is known about how they affect users’ perceptions of accuracy or their likelihood of engaging with online information. This is particularly true in the case of information posted by medical experts and healthcare professionals.

Objective:

This study employs an experimental survey design to assess the affect of verification markers on SNS users’ assessments accuracy, as well as their proclivity to recirculate health information or “follow” verified medical experts in their social network.

Methods:

A survey experiment, utilizing random assignment, was conducted on a representative sample of 534 adult SNS users in the State of Florida. Two separate experimental scenarios exposed users to vaccine-related posts from verified medical experts on Twitter. In each case, the original post contained a platform issued verification marker (treatment group) which was subsequently edited out of the image as an experimental control. For each scenario, respondents were randomly assigned to either the treatment or control group, and responses to three follow-up questions were assessed through a series of chi-square analyses, as well as two logit regression models. Responses were fielded using a stratified, quota sampling approach to ensure representativeness of the state’s population based on age, gender, race, ethnicity, and political affiliation.

Results:

Users assessments of information accuracy were not significantly impacted by the presence or absence of verification markers, and users exposed to the experimental treatment (verification marker) were not significantly more likely to repost the message or “follow” the author. While verification makers did not influence user’ assessments or subsequent behaviors, reliance on social media for health-related information and political affiliation were significant predictors of accuracy assessments in both experimental scenarios. In Scenario 1 – which included a post addressing COVID-19 vaccine efficacy – users who relied on social media “a great deal” for health information were 2 times more likely to assess the post as accurate (OR = 2.033, 95% CI = 1.129 – 3.661, P = .018). In Scenario 2 – which included a post about measles vaccines – registered Republicans were nearly 6 times less likely to assess the post as accurate (OR = 0.171, 95% CI = 0.097 – 0.299, P ≤ .001).

Conclusions:

For health professionals and medical experts wishing to leverage social networks to combat misinformation and spread reliable health-related content, verification markers appear to offer little by way of added value. Based on prior research, other heuristics and communication strategies are likely to yield better results. Clinical Trial: n/a


 Citation

Please cite as:

Neely S, Witkowski K

Social Media Authentication and Users’ Assessments of Health Information: Random Assignment Survey Experiment

JMIR Form Res 2024;8:e52503

DOI: 10.2196/52503

PMID: 38980714

PMCID: 11267113

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.