Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Previously submitted to: JMIR Formative Research (no longer under consideration since May 21, 2026)

Date Submitted: Oct 13, 2025

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Cross-Specialty Analysis of Japanese Perinatal EHR Narratives Using Large Language Models: Documentation Asymmetry and the Classification of Depressive States

  • Kiyoto Hashimoto; 
  • Noriko Kudo; 
  • Tomohiro Nishiyama; 
  • Minami Kinouchi; 
  • Keita Kawai; 
  • Norio Ozaki; 
  • Eiji Aramaki

ABSTRACT

Background:

The perinatal period is associated with an elevated risk for depressive disorders, making timely identification a public health priority. Collaboration between obstetrics and psychiatry often remains suboptimal in clinical practice. A potential contributor to this gap is information asymmetry across specialties—qualitative and quantitative imbalances in how psychiatric symptoms are documented in electronic health records (EHRs).

Objective:

To quantify cross-specialty asymmetries in perinatal EHR documentation and to evaluate the performance of large language model (LLM)–based approaches for classifying depressive states from heterogeneous clinical narratives.

Methods:

We retrospectively collected Japanese-language EHR notes for 94 pregnant or postpartum patients with a history of psychiatric consultation from a single center. We compared the prevalence of symptom mentions by author specialty. Using stratified sampling, we then selected a cohort of 20 patients to benchmark multiple LLM-based inference pipelines for depressive-state classification. The best-performing pipeline combined LLM outputs with a rule-based layer encoding clinical knowledge for final adjudication.

Results:

Documentation practices differed markedly by clinical specialty. Mentions of “depression” were approximately 30-fold less frequent in notes authored by the obstetrics team compared with those by psychiatrists. Despite this documentation bias, the top-performing pipeline achieved an F1-score of 0.750 (95% CI 0.500–0.917) for classifying depressive states.

Conclusions:

This study highlights the potential of LLMs to classify depressive states from heterogeneous EHRs despite significant documentation asymmetry. However, effective clinical deployment will require both technical advances (eg, bias-aware modeling) and organizational efforts to improve documentation quality and interspecialty information sharing.


 Citation

Please cite as:

Hashimoto K, Kudo N, Nishiyama T, Kinouchi M, Kawai K, Ozaki N, Aramaki E

Cross-Specialty Analysis of Japanese Perinatal EHR Narratives Using Large Language Models: Documentation Asymmetry and the Classification of Depressive States

JMIR Preprints. 13/10/2025:85547

DOI: 10.2196/preprints.85547

URL: https://preprints.jmir.org/preprint/85547

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.