Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Mar 25, 2026
Date Accepted: Jul 31, 2026
What Provider FAQs Miss: Evaluating Unmet ADHD Information Needs Through Comparison with Online Community Posts Using LLM-Assisted Semantic Analysis
ABSTRACT
Background:
Attention-deficit/hyperactivity disorder (ADHD) is a prevalent neurodevelopmental disorder that affects functioning and quality of life across the lifespan. Despite extensive online information, patients and caregivers continue to report unmet needs, particularly regarding diagnosis, treatment, medication effects, comorbidities, and long-term management. Provider-generated FAQs are widely used but may not reflect concerns expressed in online communities.
Objective:
To assess (1) semantic coverage of provider-generated ADHD FAQs for online community questions, (2) topics among low-similarity questions, and (3) differences in response style between provider-generated and community responses using LLM-assisted analysis.
Methods:
ADHD-related questions from a Korean online community were compared with provider-generated FAQs. Sentence embedding–based semantic similarity analysis estimated coverage and identified matched and unmatched questions. Unmatched questions were analyzed using the LimTopic framework (BERTopic with LLM-assisted summarization). High-similarity FAQ–community pairs were examined using LLM-assisted content classification.
Results:
At the optimal threshold, 88.8% (4,427/4,988) of questions were matched, with coverage concentrated in 18 FAQs. Topic modeling identified 18 clusters consolidated into five unmet need categories. Provider-generated responses were predominantly informational and neutral, whereas community responses more often included emotional and experiential elements.
Conclusions:
Despite high overall coverage, structural concentration and residual gaps indicate persistent unmet needs. Differences in response style suggest informational adequacy and communicative resonance represent distinct dimensions of alignment, supporting the need for more responsive, consumer-centered ADHD information strategies.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.