Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Sep 6, 2024
Open Peer Review Period: Sep 9, 2024 - Nov 4, 2024
Date Accepted: Apr 30, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Analysis of the Political Viewpoint of Policy Statements From Professional Medical Organizations Using ChatGPT With GPT-4: Cross-Sectional Study

Knudsen B, Madkour A, Cholli P, Haslam A, Prasad V

Analysis of the Political Viewpoint of Policy Statements From Professional Medical Organizations Using ChatGPT With GPT-4: Cross-Sectional Study

JMIR Form Res 2025;9:e66204

DOI: 10.2196/66204

PMID: 40513086

PMCID: 12205260

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Analysis of the political viewpoint of policy statements from professional medical organizations using ChatGPT 4.0

  • Ben Knudsen; 
  • Amr Madkour; 
  • Preetam Cholli; 
  • Alyson Haslam; 
  • Vinay Prasad

ABSTRACT

Background:

Professional medical organizations publish policy statements that are used to impact legislation or address societal issues. Many organizations are nonpartisan, yet it is uncertain whether their policy statements balance liberal and conservative values. We determined the political viewpoint (liberal vs conservative) of policy statements from six organizations: American Academy of Pediatrics (AAP), American College of Surgeons (ACS), American Psychiatric Association (APA), American College of Obstetricians and Gynecologists (ACOG), American College of Physicians (ACP), and American Academy of Family Physicians (AAFP).

Objective:

To evaluate the political alignment of policy statements from six influential medical organizations including: AAP, ACS, APA, ACOG, ACP, AAFP.

Methods:

Between 12/2023 – 2/2024, policy statements from the six organizations were identified and evaluated using ChatGPT 4.0, to remove bias. Each statement was pasted into a new ChatGPT session following the phrase, “Does this text align with a liberal or conservative viewpoint?” Two authors reviewed each response and categorized the statement as: liberal; probably liberal (PL); neutral; probably conservative (PC); conservative.

Results:

One third of policy statements were found to be aligned with a political ideology (529/1592). Among these, 516 (98%) were liberal or PL and 13 (2%) were conservative or PC. For each organization, among policy statements with a political leaning, the percentage of liberal or PL statements was: 100% – AAP; 100% – ACOG; 100% – ACS; 99% – APA; 97% – AAFP; 96% – ACP.

Conclusions:

One in three policy statements from these six professional organizations are politically partisan. Among these, positions are 40-times more likely to be liberal or PL than conservative or PC. Whether or not organizations are politically neutral and seek viewpoint diversity warrants further exploration.


 Citation

Please cite as:

Knudsen B, Madkour A, Cholli P, Haslam A, Prasad V

Analysis of the Political Viewpoint of Policy Statements From Professional Medical Organizations Using ChatGPT With GPT-4: Cross-Sectional Study

JMIR Form Res 2025;9:e66204

DOI: 10.2196/66204

PMID: 40513086

PMCID: 12205260

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.