JMIR Publications

ABSTRACT

Background:

There are several benefits associated with online survey research methodology in sensitive research areas with adolescents and young adults (AYAs). For example, geographic reach, including rural communities; larger sample sizes, increased participant access; increased privacy; cost saving; time; access to hidden, marginalized or stigmatized populations; and use of fewer resources for both participants and researchers. With these benefits, however, come challenges: intentionally fraudulent or duplicate entries are particularly concerning and are the focus of this systematic review.

Objective:

This review seeks to assess the state of the literature on online survey research using social media recruitment among AYAs by reviewing studies that discuss best practices for this methodology. We then use examples from studies conducted by our research team to situate the findings of this review and provide additional recommendations for online survey research with AYAs.

Methods:

The following databases were searched: PubMed, APA PsycInfo on EBSCOhost, APA PsycArticles on EBSCOhost, and Web of Science. In each database, the following search terms and Boolean operators were used: (Adolescen* OR young adult*) AND (online survey OR online recruit* OR social media recruit*) AND (fraud OR best practices OR scam* OR lessons learned). We applied filters for date of publication (2015-2025) and language (English). Searches were first completed in January 2025, with additional searches in March, September, and November 2025 to check for new publications. Selection Criteria Only original, peer-reviewed studies were included in this review. Additional criteria included language (English), location (United States) and date (published during or after 2015). Only studies with adolescent or young adult (AYA) subjects were included. Data Collection and Analysis We extracted the following items from each study: Participants, Methodology, Recruitment platforms, Survey platforms, Research topic area (i.e., suicide, health behaviors, sexual abuse), and Recommendations. After reviewing the full text and extracting data, we summarized each study and then synthesized the “best practices” for survey research among AYA using online social media recruitment as recommended in these studies. We used NIH Quality Assessment Tool for Observational and Cohort and Cross-Sectional Studies to assess risk of bias.

Results:

Our review included a final sample of n=4 studies. Records included in this review suggest a variety of fraud detection/prevention methods when collecting online data from children, adolescents, and young adults. The methods mentioned include utilizing built-in Qualtrics features (n=2), tracking IP address (n=3), reviewing data for unusual or extreme responses (n=2), honesty and grammar checks (n=1), a multi-phased screening approach utilizing personally-identifiable information (n=1), monitoring email (n=2), reviewing time to completion (n=1) and checking zip code (n=1).

Conclusions:

There is limited research examining best practices for conducting online surveys with adolescent and young adult populations using social media recruitment strategies despite advantages with this methodology and risk for fraud. Common recommendations for fraud detection and prevention include recording IP addresses to track and flag duplicate responses and manually reviewing the data for email address, demographic, or survey item response anomalies. Fraudulent data collected on critical public health concerns among AYA populations provides an inaccurate picture of the problem and may result in inadequate spending, awareness, training, policy and prevention efforts which, at best, mask the extent of the issue or, at worst, exacerbate these health concerns among young people. Understanding the etiology and impact of complex public health problems affecting AYAs is critical for informing innovative and effective prevention and intervention services and programs.