Between December 2023 and March 2024, the study team administered a national, cross-sectional survey to an online panel of participants aged 13-24 years through Qualtrics. . Recruitment initially aimed for a 3:2 ratio of participants aged 13‐17 and 18‐24-years; however, this restriction was lifted on February 9, 2024, due to low response rates among younger participants. Sampling quotas were used to align sex and race/ethnicity distributions with the latest US Census data. Of 27,525 individuals who accessed the survey, 12,919 were ineligible, 8,064 were excluded for providing incomplete responses, and 1216 were excluded for failing quality checks (eg, completing the survey in under half the median time).

The participants (N=5326) had a mean age of 18.4 (SD 3.2) years; 3013 (56.6%) identified as female, and 3207 (60.2%) were non-Hispanic White. Approximately one-quarter (1418; 26.6%) of participants had used an e-cigarette in the past 30 days, 970 (18.2%) had used an e-cigarette but not in the past 30 days, and 2938 (55.2%) had never used an e-cigarette.

The study was approved by Stanford University’s School of Medicine IRB (Protocol Number IRB-54761). We collected e-consent from participants 18 years and above and assent from participants under 18 years for this anonymous survey (with a waiver of documentation of parental consent). Each participant could complete the survey only once and received up to US $5 or a panel-specific incentive.

E-cigarette use status was measured by asking participants whether they had ever used a nicotine e-cigarette, even one or two puffs. Response options included “yes, in the past 30 days,” “yes, but not in the past 30 days,” and “no.”

Participants were shown two images of a fictitious pop-up tagged as “trusted resources” with a link to “vaping–related information” from the Centers for Disease Control and Prevention (CDC), World Health Organization (WHO), and United Nations Children’s Fund (UNICEF) (Figure 1). They were then asked what they would think about seeing this pop-up appear when: (1) searching for vaping on social media (“Imagine you were searching for vaping on social media and a link came up like in the image shown below. What would you think?”) and (2) looking at social media posts in their feed (“Imagine you were looking at social media posts and a link came up like in the image shown below. What would you think?”). Eight response options exhibiting 4 positive and 4 negative or neutral perceptions were provided; participants could select all that applied (see list of all perceptions in tabulated results). Additionally, participants had the option to select ‘other’ and write-in their own response. We also asked participants where they would prefer a link or trusted resource to appear.

Descriptive analyses examined the proportion of participants endorsing individual perceptions as well as two or more positive and negative or neutral sentiments. Chi-square analyses were used to examine differences in the proportion of participants endorsing individual perceptions as well as two or more positive and negative or neutral perceptions across age groups (13‐18 y vs 19‐24 y) and by e-cigarette use status (those who have never used vs those who have used; those who have used in the past 30 d vs those who used but not in the past 30 d). A significance level of P<.05 was used to determine if the proportions differed statistically between groups (ie, one group was more or less likely to endorse a particular perception than the other).

Among participants who viewed a pop-up intended to appear while searching for information on e-cigarettes (n=5186), positive sentiments endorsed were: the pop-up was good for checking health-related information (24.9%), might help prevent misinformation (24.2%), provided useful information about e-cigarettes that is a click away (23.2%), and would help to share information with peers (15.1%) (Table 1). Negative or neutral sentiments endorsed included: usually ignoring such notifications (27.3%), not trusting the pop-up (22.2%), perceiving that it would not help with the real problem that lies with sellers online or on social media (16.6%), and believed that it was for people who did not really know anything about vaping (15.7%). When asked about searching for information, 20.8% endorsed two or more positive sentiments and 13.3% endorsed two or more negative or neutral sentiments (P<.001).

While viewing e-cigarette–related posts, a pop-up intended to appear in their feed (n=5189), positive sentiments endorsed by participants included that the pop-up was good to check health-related information (21.9%), might help prevent misinformation (21.3%), provided useful information about e-cigarettes that was a click away (21.2%), and would help to share information with peers (14.7%). Negative or neutral sentiments endorsed were that they usually ignore such notifications (27.2%); would not trust it (22.1%); it would not help with the real problem, which is sellers online or on social media (16.6%); and that it is for people who did not really know anything about vaping (16.8%). While viewing e-cigarette-related posts, 17.6% endorsed two or more positive sentiments and 13.3% endorsed two or more negative or neutral sentiments (P<.001).

While searching for “vaping” on social media, 13‐18-year-old participants were more likely to endorse two or more positive perceptions compared to 19‐24-year old participants (22.0% vs 19.2%, respectively). Furthermore, 13‐18-years old participants were more likely to think the pop-up offered useful information just a click away (24.5% vs 21.6%) and less likely to believe that the pop-up was for people who did not know anything about vaping (14.3% vs 17.5%) compared to 19‐24-year-old participants. Participants who had never used e-cigarettes compared to those who had ever used (23.6% vs 17.3%) and those with e-cigarette use>30 days ago compared to those with past-30-day use (19.8% vs 15.6%) were more likely to endorse two or more positive perceptions while searching for e-cigarette information. Participants who had never used e-cigarettes were significantly more likely to find pop-ups good for checking health-related information about e-cigarettes (27.5% vs 21.8%), helpful in preventing misinformation (26.0% vs 22.0%), and useful in providing information about e-cigarettes that was a click away (24.5% vs 21.7%) compared to those who ever used. Moreover, those who had never used e-cigarettes were more likely to say they would not trust the pop-up (24.4% vs 19.4%) and less likely to say they usually ignored notifications on social media (25.6% vs 29.5%) compared to those who had ever used them. Participants who used e-cigarettes >30 days ago were more likely to say that the pop-up may help prevent misinformation compared to those with past-30-day use (25.0% vs 19.9%, respectively).

While viewing social media posts in their feed, 13‐18-year-old participants were more likely to say they usually ignored such notifications (28.9% vs 25.0%) and were less likely to think that the pop-up was for people who did not know anything about vaping (15.7% vs 18.3%) compared to 19‐24-year-olds. Participants who had never used e-cigarettes compared to those who had used (19.7% vs 15.0%), and those with use >30 days ago compared to those with past-30-day use (16.9% vs 13.7%) were more likely to endorse two or more positive perceptions. Those who had never used e-cigarettes were more likely to say the pop-up was good to check health-related information about vaping (23.2% vs 20.2%) and may prevent misinformation (19.3% vs 22.9%) compared to those who have ever used. In addition, participants who never used e-cigarettes compared to those who had ever used (24.3% vs 19.2%) and those who had used>30 days ago compared to those with past-30-day use (21.5% vs 17.7%) were more likely to say they would not trust the pop-up.

When asked where they would prefer a link or a trusted resource to appear (n=5,136), 25.2% participants indicated below the post but above comments, 20.7% at the top of the post with the post slightly greyed out, 19.6% as the next post, reel, or TikTok, 18.8% as a pop-up, and 15.8% below the post and comments.