Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Jun 12, 2024
Open Peer Review Period: Jun 19, 2024 - Aug 14, 2024
Date Accepted: Jan 16, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Leveraging Large Language Models for Infectious Disease Surveillance—Using a Web Service for Monitoring COVID-19 Patterns From Self-Reporting Tweets: Content Analysis

Xie J, Zhang Z, Zeng S, Hilliard J, An G, Tang X, Jiang L, Yu Y, Wan XF, Xu D

Leveraging Large Language Models for Infectious Disease Surveillance—Using a Web Service for Monitoring COVID-19 Patterns From Self-Reporting Tweets: Content Analysis

J Med Internet Res 2025;27:e63190

DOI: 10.2196/63190

PMID: 39977859

PMCID: 11888100

Leveraging Large Language Models to Study Infectious Diseases Based on Self-reporting Tweets: A Web Service to Monitor COVID-19 Trend

  • Jiacheng Xie; 
  • Ziyang Zhang; 
  • Shuai Zeng; 
  • Joel Hilliard; 
  • Guanghui An; 
  • Xiaoting Tang; 
  • Lei Jiang; 
  • Yang Yu; 
  • Xiu-Feng Wan; 
  • Dong Xu

ABSTRACT

Background:

We built a publicly available database of COVID-19-related tweets and extracted information about symptoms and recovery cycles from self-reported tweets. We presented the results of our analysis of infection, reinfection, recovery, and long-term effects of COVID-19 on a weekly- refreshing visualization website.

Objective:

We built a publicly available database of COVID-19-related tweets and extracted information about symptoms and recovery cycles from self-reported tweets. We presented the results of our analysis of infection, reinfection, recovery, and long-term effects of COVID-19 on a weekly- refreshing visualization website.

Methods:

We used X (formerly Twitter) to collect COVID-related data, from which 9 native-English-speaking annotators annotated a training dataset of COVID-positive self-reporters. We then used large language models to identify positive self-reporters from other unannotated tweets. We employed the Hibert transform to calculate the lead of the prediction curve ahead of the reported curve. Finally, we presented our findings on symptoms, recovery, reinfections, and long-term effects of COVID-19 on the website Covlab.

Results:

We collected 9.8 million tweets related to COVID-19 between January 1, 2020, and April 1, 2024, including 469,491 self-reported cases. The predicted number of infection cases by our model is 7.63 days ahead of the official report. In addition to common symptoms, we identified some symptoms that were not included in the list from the Centers for Disease Control and Prevention, such as lethargy and hallucinations. Repeat infections were commonly occurring, with rates of second and third infections at 7.49% and 1.37%, respectively, whereas 0.45% also reported that they had been infected more than 5 times. The average time to recovery has decreased over the years.

Conclusions:

Although with some biases and limitations, self-reported tweet data serve as a valuable complement to clinical data, especially in the post-pandemic era dominated by mild cases. Our online analytic platform can play a significant role in continuously tracking COVID-19, finding new uncommon symptoms, detecting and monitoring the manifestation of long-term effects, and providing necessary insights to the public and decision-makers.


 Citation

Please cite as:

Xie J, Zhang Z, Zeng S, Hilliard J, An G, Tang X, Jiang L, Yu Y, Wan XF, Xu D

Leveraging Large Language Models for Infectious Disease Surveillance—Using a Web Service for Monitoring COVID-19 Patterns From Self-Reporting Tweets: Content Analysis

J Med Internet Res 2025;27:e63190

DOI: 10.2196/63190

PMID: 39977859

PMCID: 11888100

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.