Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Oct 4, 2025
Open Peer Review Period: Oct 5, 2025 - Nov 30, 2025
Date Accepted: Jun 3, 2026
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Large Language Model–Assisted Annotation Framework for Cross-Platform Analysis of Online Autism Communities: Implications for Parent Education and Digital Support

Xu Y, Ma J, Hu Y, Liu Y, Chen Y, Feng W, Zhang C, Zhang L, Zhang X, Huang R

Large Language Model–Assisted Annotation Framework for Cross-Platform Analysis of Online Autism Communities: Implications for Parent Education and Digital Support

J Med Internet Res 2026;28:e85290

DOI: 10.2196/85290

PMID: 42430199

LLM-Assisted Annotation Framework for Cross Platform Analysis of Autism Online Communities: Implications for Parent Education and Digital Support

  • Yifan Xu; 
  • Jianhao Ma; 
  • Yujia Hu; 
  • Yixue Liu; 
  • Yu Chen; 
  • Wei Feng; 
  • Changwei Zhang; 
  • Lei Zhang; 
  • Xuening Zhang; 
  • Ruochen Huang

ABSTRACT

Background:

Online health communities (OHCs) are key channels for families of children with autism spectrum disorder (ASD) to obtain information and psychosocial support. Platform heterogeneity, as reflected in differences between open peer forums and physician and patient portals, may shape parental decisions, yet comparable evidence from China remains limited. Large language models (LLMs) can accelerate transparent, scalable topic coding and help surface caregiver-relevant content at scale.

Objective:

To characterize health information needs, topic distributions, and poster roles across an open forum (Baidu Tieba) and a physician and patient platform (Chunyu Doctor) under a unified schema, and to implement and validate an LLM assisted, human in the loop annotation workflow oriented to caregiver education and service navigation.

Methods:

We implemented an innovative LLM assisted annotation framework for large scale content analysis. We analyzed an open community (8,097 threads; 68,576 replies; 76,284 nested replies; 11,118 users) and a physician and patient platform (197 consultations; 4,639 dialogue turns). Using human open coding, we first developed a unified taxonomy for topics and poster identities. An LLM assisted annotation framework was implemented using DeepSeek to generate candidate topic and identity labels under the unified schema; all outputs were verified and corrected by human coders to produce the final dataset.

Results:

In the open forum, family caregivers were the primary posters (68.24% , 2,432/3,564), with visible commercial rehabilitation actors (13.05%, 465/3,564) and few self-reported autistic individuals (2.50%, 89/3,564). Dominant topics were “Sharing/Case sharing” (27.47%, 2,171/7,904) and “Science popularization” (14.25%, 1,126/7,904); help-seeking concentrated on “Autism diagnosis” (13.09%, 1,035/7,904). On the physician–patient platform, medical topics focused on symptoms, treatment, diagnosis, and examinations, while “psychological support” remained salient (11.53%, 253/2,194).

Conclusions:

The analysis identifies (1) caregiver dominated participation in open forums, (2) focused clinical questioning in physician and patient consultations, and (3) noticeable activity from commercial rehabilitation providers in open spaces. In light of these findings, we recommend establishing a transparent evaluation mechanism for commercial rehabilitation services and strengthening linkages between doctor and patient exchange platforms and open forums to improve topic quality and caregiver access to reliable, plain language materials. The LLM assisted, human verified workflow proved feasible and transparent for large scale OHC analysis in this context and can support subsequent content curation and moderation; all reported results derive from human confirmed labels rather than automated decisions.


 Citation

Please cite as:

Xu Y, Ma J, Hu Y, Liu Y, Chen Y, Feng W, Zhang C, Zhang L, Zhang X, Huang R

Large Language Model–Assisted Annotation Framework for Cross-Platform Analysis of Online Autism Communities: Implications for Parent Education and Digital Support

J Med Internet Res 2026;28:e85290

DOI: 10.2196/85290

PMID: 42430199

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.