This paper is in the following e-collection/theme issue:

Pilot studies (non-ehealth) (65) Mental Health Issues in Adolescence (442) Depression and Mood Disorders; Suicide Prevention (1363)

Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/54288, first published .
Measuring Population-Level Adolescent Mental Health Using a Single-Item Indicator of Experiences of Sadness and Hopelessness: Cross-Sectional Study

Measuring Population-Level Adolescent Mental Health Using a Single-Item Indicator of Experiences of Sadness and Hopelessness: Cross-Sectional Study

Measuring Population-Level Adolescent Mental Health Using a Single-Item Indicator of Experiences of Sadness and Hopelessness: Cross-Sectional Study

Authors of this article:

Jorge Verlenden1 Author Orcid Image ;   Sanjana Pampati1 Author Orcid Image ;   Melissa Heim Viox2 Author Orcid Image ;   Nancy Brener1 Author Orcid Image ;   Laima Licitis3 Author Orcid Image ;   Patricia Dittus1 Author Orcid Image ;   Kathleen Ethier1 Author Orcid Image
Article Authors Cited by Tweetations Metrics

    Original Paper

    1Division of Adolescent and School Health, National Center for Chronic Disease Prevention and Health Promotion, Centers for Disease Control and Prevention, Atlanta, GA, United States

    2NORC, University of Chicago, Chicago, IL, United States

    3Oak Ridge Institute for Science and Education, Oak Ridge, TN, United States

    Corresponding Author:

    Jorge Verlenden, PhD

    Division of Adolescent and School Health

    National Center for Chronic Disease Prevention and Health Promotion

    Centers for Disease Control and Prevention

    Chamblee Campus

    4770 Buford Highway

    Atlanta, GA, 30341

    United States

    Phone: 1 404 498 6018

    Email: nlx7@cdc.gov


    Background: Population-level monitoring of adolescent mental health is a critical public health activity used to help define local, state, and federal priorities. The Youth Risk Behavior Surveillance System includes a single-item measure of experiences of sadness or hopelessness as an indicator of risk to mental health. In 2021, 42% of high school students reported having felt sad or hopeless for 2 weeks or more during the past 12 months. The high prevalence of US high school students with this experience has been highlighted in recent studies and media reports.

    Objective: This study seeks to examine associations between this single-item measure of experiences of sadness or hopelessness with other indicators of poor mental health including frequent mental distress and depressive symptoms.

    Methods: We analyzed survey data from a national sample of 737 adolescents aged 15-19 years as a part of the Teen and Parent Surveys of Health. Participants were recruited from AmeriSpeak, a probability-based panel designed to be representative of the US household population. Feeling sad or hopeless was operationalized as a “yes” response to the item, “During the past 12 months, did you ever feel so sad or hopeless almost every day for 2 weeks or more in a row that you stopped doing some usual activities?” Unadjusted and adjusted prevalence ratios (aPRs) were calculated to examine associations between the single-item measure of having felt sad or hopeless almost every day for 2 weeks with moderate to severe depressive symptoms, frequent mental distress, and functional limitation due to poor mental health. Adjusted models controlled for age, race and ethnicity, sex assigned at birth, and sexual identity.

    Results: Overall, 17.3% (unweighted: 138/735) of adolescents reported that they felt sad or hopeless for 2 weeks or more during the past 12 months, 30.2% (unweighted: 204/716) reported moderate to severe depressive symptoms, 18.4% (unweighted: 126/732) reported frequent mental distress, and 15.4% (unweighted: 107/735) reported functional limitation due to poor mental health. After adjusting for demographics, adolescents who reported that they felt sad or hopeless for 2 weeks or more were 3.3 times as likely to report moderate to severe depressive symptoms (aPR 3.28, 95% CI 2.39-4.50), 4.8 times as likely to indicate frequent mental distress (aPR 4.75, 95% CI 2.92-7.74), and 7.8 times as likely to indicate mental health usually or always interfered with their ability to do things (aPR 7.78, 95% CI 4.88-12.41).

    Conclusions: Associations between having felt sad or hopeless for 2 weeks or more and moderate to severe depressive symptoms, frequent mental distress, and functional limitation due to poor mental health suggest the single-item indicator may represent relevant symptoms associated with poor mental health and be associated with unmet health needs. Findings suggest the single-item indicator provides a population-level snapshot of adolescent experiences of poor mental health.

    JMIR Form Res 2024;8:e54288

    doi:10.2196/54288

    Keywords

    adolescents; mental health; surveillance; teens; sadness; hopelessness 


    Population-level monitoring of adolescent mental health is a critical public health activity [1]. Data from health surveillance systems of children and adolescents are used to track mental health trends, identify factors that influence mental health outcomes, and inform public health–related decision-making [2]. National surveillance systems, such as the Youth Risk Behavior Surveillance System (YRBSS), National Survey of Children’s Health, and the National Survey on Drug Use and Health, include various measures of child and adolescent mental health. No single surveillance system captures all aspects of adolescent mental health (eg, disorders, mental health concerns, or suicide), and no single indicator can summarize the many dimensions of mental health [3]. However, by harmonizing across data systems and furthering our understanding of what each data system and measure captures, a more complete picture of adolescent mental health can be established. Indeed, a number of studies have evaluated mental health measures in public health surveillance systems through descriptive comparisons of responses across items and data systems [3-5].

    One such measure of poor adolescent mental health that has received growing attention in recent studies and media reports is a single-item measure of experiences of sadness or hopelessness [6,7]. Since 1999, the Centers for Disease Control and Prevention’s (CDC) YRBSS has included this single-item measure [8]. In 2021, 42% of high school students reported having felt sad or hopeless for 2 weeks or more during the past 12 months, and the prevalence of this experience significantly increased from 2011 to 2021 [9]. Further, disparities in this experience by sex, race/ethnicity, sexual identity, and sex of sexual contacts have been documented [9].

    This descriptive study seeks to expand the understanding of this single-item measure by examining its alignment with established measures of poor mental health.


    Overview

    We analyzed survey data from a national sample of 737 adolescents aged 15-19 years. Data were collected by NORC at the University of Chicago, May to September 2022, as part of the Teen and Parent Surveys of Health (TAPS). Participants were recruited from AmeriSpeak, a probability-based panel designed to be representative of the US household population. Selected US households are sampled using area probability and address-based sampling from the NORC National Sample Frame to form the AmeriSpeak general adult panel. Recruitment occurs by US mail, telephone, and field interviews. In addition to the general adult panel, there are also subpanels of specific populations, including the AmeriSpeak teen panel of adolescents aged 13-17 years [7]. Adolescent TAPS participants were recruited in three ways. First, adolescents aged 18-19 years were directly recruited from the AmeriSpeak general adult panel. Second, adolescents aged 15-17 years were recruited from the AmeriSpeak teen panel. Third, we identified panelists who were parents of adolescents aged 15-17 who could consent for their child to participate in TAPS, even if they were not members of the AmeriSpeak teen panel. Panel recruitment and methodology have been published elsewhere [7,8].

    Ethical Considerations

    Participants received the equivalent of US $20 in AmeriPoints, redeemable for a gift card [7,8]. Teens aged 15-17 years required parental consent to participate. Parents also received the equivalent of US $2 in AmeriPoints for completing the screener and consent survey. This activity was reviewed by the CDC and conducted consistent with applicable federal law and CDC policy; the study was also reviewed and approved by NORC’s Institutional Review Board (IRB protocol 20.07.10, project 8644). The survey was conducted confidentially.

    Measures

    The analysis included four indicators of poor mental health: (1) felt sad or hopeless, based on a Yes response to the YRBSS item, “During the past 12 months, did you ever feel so sad or hopeless almost every day for 2 weeks or more in a row that you stopped doing some usual activities?”; (2) depressive symptoms, measured using the 8-item Patient Health Questionnaire (PHQ-8) for adolescents using a cutoff score of ≥10 to indicate moderate to severe depressive symptoms versus none, minimal, or mild [9,10]; (3) frequent mental distress, dichotomized as always or most of the time versus sometimes, rarely, or never for the question, “During the past 30 days, how often was your mental health not good? (Mental health includes stress, anxiety, and depression)”; and (4) functional limitation due to poor mental health, based on a response of always or usually versus sometimes, rarely, or never to the question, “During the past 12 months, how often has your mental health interfered with your ability to do things other young people your age do?” The PHQ-8 is established as a valid diagnostic and severity measure of depressive symptoms and is used in clinical and population studies to assess symptoms indicative of depressive disorders [9-12]. Items 3 and 4 were derived from a health-related quality of life measure and have demonstrated validity and reliability for population health surveillance [13,14].

    Analysis

    The following demographic characteristics were examined: sex assigned at birth, age, race/ethnicity, and sexual identity. We present the weighted prevalence of each indicator of poor mental health overall and by demographic characteristics. Missing observations were excluded in calculations for each variable. To examine associations between feeling sad or hopeless and the other indicators of poor mental health, we used predicted margins in logistic regression to calculate prevalence ratios and adjusted prevalence ratios (aPRs), adjusting for demographics and accounting for the complex survey design.


    Overall, 17.3% (unweighted: 138/735) of adolescents reported feeling sad or hopeless for 2 weeks or more during the past 12 months, 30.2% (unweighted: 204/716) reported moderate to severe depressive symptoms, 18.4% (unweighted: 126/732) reported frequent mental distress, and 15.4% (unweighted: 107/735) reported functional limitation due to poor mental health (Table 1).

    Adolescents reporting that they had felt sad or hopeless had 3.3 times the prevalence of moderate to severe depressive symptoms (aPR 3.28, 95% CI 2.39-4.50), 4.8 times the prevalence of frequent mental distress (aPR 4.75, 95% CI 2.92-7.74), and 7.8 times the prevalence of functional limitation due to poor mental health (aPR 7.78, 95% CI 4.88-12.41) compared to those not reporting sadness or hopelessness (Table 2).

    Table 1. Percent distribution of demographic characteristics of adolescent respondents by having felt sad or hopeless almost every day for 2 weeks (past 12 months), moderate to severe depressive symptoms (past 2 weeks), frequent mental distress (past 30 days), and functional limitation due to poor mental health usually or always (past 12 months)a.

    		Overall, nFelt sad or hopeless almost every day for 2 weeks (past 12 months)b, n (%)Moderate to severe depressive symptoms, PHQ-8c score ≥10 (past 2 weeks)d, n (%)Frequent mental distress (past 30 days)e, n (%)Functional limitation due to poor mental health usually or always (past 12 months)f, n (%)
    Total737138 (17.3)204 (30.2)126 (18.4)107 (15.4)
    Sex assigned at birthg

    		Female39296 (20.8)138 (38.5)87 (22.8)75 (19.4)

    		Male33739 (13.5)63 (21.4)39 (14.5)32 (11.8)
    Age (years)

    		15-1752993 (15.1)123 (24.4)77 (14.0)64 (13.1)

    		18-1920845 (21.1)81 (39.6)49 (25.8)43 (19.2)
    Race/ethnicityh

    		White, non-Hispanic37264 (15.5)100 (29.8)55 (15.5)52 (15.9)

    		Black, non-Hispanic12321 (18.4)30 (23.0)19 (20.4)15 (14.9)

    		Hispanic/Latino15336 (23.5)53 (36.3)35 (25.4)25 (17.4)

    		All other races, non-Hispanic8917 (9.7)21 (26.8)17 (13.5)15 (8.9)
    Sexual identityi

    		Lesbian/gay2911 (36.5)13 (41.2)7 (18.4)10 (31.1)

    		Straight/heterosexual56177 (13.7)124 (26.6)79 (17.4)61 (13.4)

    		Bisexual7526 (34.0)36 (53.2)20 (27.1)16 (22.5)

    		Another identity/unsure7224 (21.1)31 (32.7)20 (17.4)20 (18.7)

    aTable shows unweighted numbers (n) and weighted percentages (%). Missing observations were excluded in the calculation of percentages for each variable.

    bFelt sad or hopeless is based on a “Yes” response to the question “During the past 12 months, did you ever feel so sad or hopeless almost every day for 2 weeks or more in a row that you stopped doing some usual activities?”

    cPHQ-8: 8-item Patient Health Questionnaire.

    dHaving moderate to severe depressive symptoms is based on a sum score of ≥10 on the PHQ-8 and aligns with depressive symptom severity cutoff guidelines for the PHQ, measuring number and frequency of symptoms experienced in the past 14 days.

    eFrequent mental distress is based on a response of “Always” or “Most of the time” to the question “During the past 30 days, how often was your mental health not good? (Mental health includes stress, anxiety, and depression).” Response options were “Always,” “Most of the time,” “Sometimes,” “Rarely,” and “Never.”

    fFunctional limitation due to poor mental health is based on response of “Always” or “Usually” to the question “During the past 12 months, how often has your mental health interfered with your ability to do things other young people your age do?” Response options were “Always,” “Usually,” “Sometimes,” “Rarely,” or “Never.”

    gAdolescents reported sex at birth in response to the survey question: “What sex were you assigned at birth, on your original birth certificate?”

    hAll other races category included American Indian, Alaska Native, Native Hawaiian or Pacific Islander, some other race, or selected more than one race category.

    iSexual identity was based on response to the question “Which of the following best represents yourself?” Adolescents selected from the following response options: “Lesbian or gay”; “Straight, that is, not lesbian or gay”; “Bisexual”; “Something else”; “I don’t know the answer.” Responses of “Something else” or “I don’t know the answer” were coded as “Another identity/Unsure.”

    Table 2. Associations between adolescent report of having felt sad or hopeless almost every day for 2 weeks (past 12 months) and moderate to severe depressive symptoms (past 2 weeks), frequent mental distress (past 30 days), and functional limitation due to poor mental health usually or always (past 12 months).

    		Moderate to severe depressive symptoms (PHQ-8a score ≥10; past 2 weeks)bFrequent mental distress (past 30 days)cFunctional limitation due to poor mental health usually or always (past 12 months)d

    		Weighted percentage (%)ePRf (95% CI)aPRg (95% CI)hWeighted percentage (%)PR (95% CI)aPR (95% CI)Weighted percentage (%)PR (95% CI)aPR (95% CI)

    		YesNo

    		YesNo

    		YesNo

    Felt sad or hopeless almost every day for two weeks, past 12 monthsi

    		Yes74.525.53.59 (2.65-4.86) 3.28 (2.39-4.50)55.045.05.05 (3.11-8.18)4.75 (2.92-7.74)56.044.08.02 (4.93-13.04)7.78 (4.88-12.41)

    		No20.779.3ReferenceReference10.989.1ReferenceReference7.093.0ReferenceReference

    aPHQ-8: 8-item Patient Health Quetionnaire.

    bHaving moderate to severe depressive symptoms is based on a sum score of ≥10 on the PHQ-8 and aligns with depressive symptom severity cutoff guidelines for the PHQ, measuring number and frequency of symptoms experienced in the past 14 days.

    cFrequent mental distress is based on a response of “Always” or “Most of the time” to the question “During the past 30 days, how often was your mental health not good? (Mental health includes stress, anxiety, and depression).” Response options were “Always,” “Most of the time,” “Sometimes,” “Rarely,” and “Never.”

    dFunctional limitation due to poor mental health is based on response of “Always” or “Usually” to the question “During the past 12 months, how often has your mental health interfered with your ability to do things other young people your age do?” Response options were “Always,” “Usually,” “Sometimes,” “Rarely,” or “Never.”

    eTable shows weighted row percentages (%). Missing observations were excluded in calculations for each variable.

    fPR: prevalence ratio.

    gaPR: adjusted prevalence ratio.

    hAdjusted for age, race and ethnicity, sex assigned at birth, and sexual identity.

    iFelt sad or hopeless is based on a “Yes” response to the question “During the past 12 months, did you ever feel so sad or hopeless almost every day for 2 weeks or more in a row that you stopped doing some usual activities?”


    Our study identified strong associations between having felt sad or hopeless and having moderate to severe depressive symptoms, frequent mental distress, and functional limitation due to poor mental health. Results suggest the single-item YRBSS measure offers a depiction of poor mental health among adolescents and support its use in population studies.

    Mental health is a broad concept that includes a range of functioning across various contexts and environments [3]. Clinical mental health assessments, especially for children and adolescents, often involve a multicomponent process that includes structured tests and interviews with multiple informants [9,15]. However, use of single-item indicators or concise item sets is essential to reducing respondent burden in the collection of public health surveillance data [3-5]. Strengths of the YRBSS measure include its brevity and plain language, along with its association with other indicators of poor mental health that suggest unmet mental health needs, which together support its utility as a population-level measure for adolescents. Future research might examine associations between the YRBSS item and other mental health measures as well as compare responses by demographic characteristics.

    Several limitations of our study must be acknowledged. First, we used data from a small sample of adolescents recruited from a panel, and we found prevalence of having felt sad or hopeless among this sample to be far lower than the national prevalence found in the 2021 YRBSS cycle [8,9]. Although data were weighted to represent the US household population, generalizability to the US adolescent population may be limited. Second, because the survey was administered in English, experiences of teens with limited English proficiency may not be represented. Third, parental consent was required for teens aged 15-17 years to participate, which may introduce selection bias. Fourth, recall periods varied for the sets of questions comprising the mental health indicators thereby limiting our ability to compare experiences within the same time frame.

    Population-level monitoring of adolescent health behaviors is a critical public health activity that helps ensure awareness of changing needs of adolescents and helps support priority-setting for public health programming [1-3,16]. The associations between having felt sad or hopeless for 2 weeks or more and moderate to severe depressive symptoms, frequent mental distress, and functional limitation due to poor mental health suggest the single-item indicator may represent relevant symptoms associated with poor mental health and be associated with unmet health needs. Findings from this study support the value of this item for use in population studies of adolescents and can enhance understanding of results of the YRBSS moving forward.

    Acknowledgments

    This study was funded, in part, by the Centers for Disease Control and Prevention (CDC) contract task order number 75D30119F06605 to NORC at the University of Chicago. This project was also supported by an appointment to the Research Participation Program at the CDC, administered by the Oak Ridge Institute for Science and Education through an inter-agency agreement between the U.S. Department of Energy and the CDC. The authors acknowledge that the copyright of this study is held under the provisions of the U.S. Government’s contract rights.

    Disclaimer

    The findings and conclusions in this report are those of the authors and do not necessarily represent the official position of the Centers for Disease Control and Prevention (CDC).

    Conflicts of Interest

    None declared.

    1. Lyerla R, Stroup DF. Toward a public health surveillance system for behavioral health. Public Health Rep. 2018;133(4):360-365. [FREE Full text] [CrossRef] [Medline]
    2. Mpofu JJ, Underwood JM, Thornton JE, Brener ND, Rico A, Kilmer G, et al. Overview and methods for the youth risk behavior surveillance system - United States, 2021. MMWR Suppl. Apr 28, 2023;72(1):1-12. [FREE Full text] [CrossRef] [Medline]
    3. Bitsko RH, Claussen AH, Lichstein J, Black LI, Jones SE, Danielson ML, et al. Contributor. Mental health surveillance among children - United States, 2013-2019. MMWR Suppl. Feb 25, 2022;71(2):1-42. [FREE Full text] [CrossRef] [Medline]
    4. Zablotsky B, Weeks J, Terlizzi E, Madans J, Blumberg S. Assessing anxiety and depression: a comparison of national health interview survey measures. Natl Health Stat Report. Jul 2022;(172):1-17. [FREE Full text] [Medline]
    5. Hedden S, Gfroerer J, Barker P, Smith S, Pemberton MR, Saavedra LM, et al. Comparison of NSDUH mental health data and methods with other data sources. In: CBHSQ Data Review. Rockville, MD. Substance Abuse and Mental Health Services Administration; Feb 2012.
    6. Ghorayshi A, Roni C. Teen girls report record levels of sadness, C.D.C. finds. The New York Times. Feb 13, 2023. URL: https://www.nytimes.com/2023/02/13/health/teen-girls-sadness-suicide-violence.html [accessed 2023-08-24]
    7. Anderson J. Parents are almost as depressed and anxious as teens. TIME. Aug 08, 2023. URL: https://time.com/6302430/teenagers-mental-health-parents/ [accessed 2024-08-24]
    8. Youth online. Centers for Disease Control and Prevention. URL: https://nccd.cdc.gov/Youthonline/App/Default.aspx [accessed 2024-08-24]
    9. Youth risk behavior survey: data summary and trends report: 2011-2021. Centers for Disease Control and Prevention. 2023. URL: https://www.cdc.gov/healthyyouth/data/yrbs/pdf/YRBS_Data-Summary-Trends_Report2023_508.pdf [accessed 2023-04-01]
    10. Probability-based survey infrastructure for polling U.S. teens. AmeriSpeak. Apr 07, 2020. URL: https://tinyurl.com/4ua6y5xu [accessed 2024-08-24]
    11. NORC University of Chicago. AmeriSpeak. URL: https://www.amerispeak.org/ [accessed 2023-08-28]
    12. Walter HJ, Abright AR, Bukstein OG, Diamond J, Keable H, Ripperger-Suhler J, et al. Clinical practice guideline for the assessment and treatment of children and adolescents with major and persistent depressive disorders. J Am Acad Child Adolesc Psychiatry. May 2023;62(5):479-502. [CrossRef] [Medline]
    13. Richardson L, McCauley E, Grossman D, McCarty CA, Richards J, Russo JE, et al. Evaluation of the Patient Health Questionnaire-9 Item for detecting major depression among adolescents. Pediatrics. Dec 2010;126(6):1117-1123. [FREE Full text] [CrossRef] [Medline]
    14. Kroenke K, Strine TW, Spitzer RL, Williams JBW, Berry JT, Mokdad AH. The PHQ-8 as a measure of current depression in the general population. J Affect Disord. Apr 2009;114(1-3):163-173. [CrossRef] [Medline]
    15. Johnson JG, Harris ES, Spitzer RL, Williams JB. The patient health questionnaire for adolescents: validation of an instrument for the assessment of mental disorders among adolescent primary care patients. J Adolesc Health. Mar 2002;30(3):196-204. [CrossRef] [Medline]
    16. Taylor VR. Measuring healthy days: population assessment of health-related quality of life. Centers for Disease Control and Prevention. Nov 2000. URL: https://stacks.cdc.gov/view/cdc/6406 [accessed 2023-08-24]

    ‎
    aPR: adjusted prevalence ratio
    CDC: Centers For Disease Control and Prevention
    PHQ-8: 8-item Patient Health Questionnaire
    TAPS: Teen and Parent Surveys of Health
    YRBSS: Youth Risk Behavior Surveillance System

    Edited by A Mavragani; submitted 03.11.23; peer-reviewed by D Courtney, D Levine; comments to author 22.02.24; revised version received 29.04.24; accepted 12.06.24; published 26.07.24.

    Copyright

    ©Jorge Verlenden, Sanjana Pampati, Melissa Heim Viox, Nancy Brener, Laima Licitis, Patricia Dittus, Kathleen Ethier. Originally published in JMIR Formative Research (https://formative.jmir.org), 26.07.2024.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.