Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Jun 12, 2024
Open Peer Review Period: Jun 19, 2024 - Aug 14, 2024
Date Accepted: Jan 16, 2025
(closed for review but you can still tweet)
Leveraging Large Language Models to Study Infectious Diseases Based on Self-reporting Tweets: A Web Service to Monitor COVID-19 Trend
ABSTRACT
Background:
We built a publicly available database of COVID-19-related tweets and extracted information about symptoms and recovery cycles from self-reported tweets. We presented the results of our analysis of infection, reinfection, recovery, and long-term effects of COVID-19 on a weekly- refreshing visualization website.
Objective:
We built a publicly available database of COVID-19-related tweets and extracted information about symptoms and recovery cycles from self-reported tweets. We presented the results of our analysis of infection, reinfection, recovery, and long-term effects of COVID-19 on a weekly- refreshing visualization website.
Methods:
We used X (formerly Twitter) to collect COVID-related data, from which 9 native-English-speaking annotators annotated a training dataset of COVID-positive self-reporters. We then used large language models to identify positive self-reporters from other unannotated tweets. We employed the Hibert transform to calculate the lead of the prediction curve ahead of the reported curve. Finally, we presented our findings on symptoms, recovery, reinfections, and long-term effects of COVID-19 on the website Covlab.
Results:
We collected 9.8 million tweets related to COVID-19 between January 1, 2020, and April 1, 2024, including 469,491 self-reported cases. The predicted number of infection cases by our model is 7.63 days ahead of the official report. In addition to common symptoms, we identified some symptoms that were not included in the list from the Centers for Disease Control and Prevention, such as lethargy and hallucinations. Repeat infections were commonly occurring, with rates of second and third infections at 7.49% and 1.37%, respectively, whereas 0.45% also reported that they had been infected more than 5 times. The average time to recovery has decreased over the years.
Conclusions:
Although with some biases and limitations, self-reported tweet data serve as a valuable complement to clinical data, especially in the post-pandemic era dominated by mild cases. Our online analytic platform can play a significant role in continuously tracking COVID-19, finding new uncommon symptoms, detecting and monitoring the manifestation of long-term effects, and providing necessary insights to the public and decision-makers.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.