Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: Journal of Medical Internet Research

Date Submitted: Nov 24, 2025
Open Peer Review Period: Nov 25, 2025 - Jan 20, 2026
(closed for review but you can still tweet)

NOTE: This is an unreviewed Preprint

Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).

Peer review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.

Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).

Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.

Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.

Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Transforming Cancer Care Qualitative Data Analytics: Leveraging NLP to Uncover Insights from Big Qualitative Data

  • Jay Patel; 
  • Laura A Siminoff; 
  • Maria D Thomson

ABSTRACT

Background:

Qualitative research methods offer vital insights into how patients make treatment decisions, but these approaches are labor-intensive, limited by small samples, and difficult to scale. Natural Language Processing (NLP) provides a promising solution by automating the analysis of large volumes of unstructured clinical text, improving efficiency and enabling deeper understanding of complex interactions in cancer care.

Objective:

The objective of this study was to develop, test, and validate a Natural Language Processing (NLP) application capable of transforming large-scale qualitative clinical communication data into structured formats, thereby reducing the need for manual coding.

Methods:

Using 434 transcripts of physician–patient encounters collected from a prior study, we evaluated the feasibility of advanced NLP methods to analyze cancer care communication.

Results:

Transformer-based models demonstrated strong performance in extracting clinically relevant information, with RoBERTa achieving the highest F1 score (76%), outperforming both BERT (71%) and the rule-based SpaCy baseline (36%).

Conclusions:

These findings underscore the advantages of context-aware transformer architectures, which are better suited to capturing the complexity of medical dialogues than traditional rule-based approaches. Notably, while transformers provided the greatest accuracy, results also suggest the value of hybrid systems that integrate rule-based precision with the contextual depth of transformer models. Such approaches may be especially useful for capturing longer conversational sequences, such as emotional expressions, question–answer exchanges, and multi-topic utterances. Overall, this study demonstrates the potential of NLP to improve the efficiency and scalability of clinical communication analysis, expand institutional capacity to deliver standardized feedback, and enable large-scale, multi-site research on communication processes in cancer care. Clinical Trial: N/A


 Citation

Please cite as:

Patel J, Siminoff LA, Thomson MD

Transforming Cancer Care Qualitative Data Analytics: Leveraging NLP to Uncover Insights from Big Qualitative Data

JMIR Preprints. 24/11/2025:88404

DOI: 10.2196/preprints.88404

URL: https://preprints.jmir.org/preprint/88404

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.