This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (2491) Depression and Mood Disorders; Suicide Prevention (1392) Adoption and Change Management of eHealth Systems (731) Innovations in Mental Health Systems (398) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1565)

Published on in Vol 6, No 9 (2022): September

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/39787, first published .
Waiting Lists for Psychotherapy and Provider Attitudes Toward Low-Intensity Treatments as Potential Interventions: Survey Study

Waiting Lists for Psychotherapy and Provider Attitudes Toward Low-Intensity Treatments as Potential Interventions: Survey Study

Waiting Lists for Psychotherapy and Provider Attitudes Toward Low-Intensity Treatments as Potential Interventions: Survey Study

Authors of this article:

Allison Peipert1 Author Orcid Image ;   Anne C Krendl1 Author Orcid Image ;   Lorenzo Lorenzo-Luaces1 Author Orcid Image
Article Authors Cited by (11) Tweetations (10) Metrics

    Original Paper

    Department of Psychological and Brain Sciences, Indiana University Bloomington, Bloomington, IN, United States

    Corresponding Author:

    Lorenzo Lorenzo-Luaces, PhD

    Department of Psychological and Brain Sciences

    Indiana University Bloomington

    1101 E 10th St

    Bloomington, IN, 47405

    United States

    Phone: 1 812 855 2012

    Email: lolorenz@indiana.edu


    Background: Common mental disorders, including depression and anxiety, are leading causes of disability worldwide. Digital mental health interventions, such as web-based self-help and other low-intensity treatments (LITs) that are not digital (eg, bibliotherapy), have the potential to reach many individuals by circumventing common barriers present in traditional mental health care. It is unclear how often LITs are used in clinical practice, or whether providers would be interested in their use for treatment waiting lists.

    Objective: The aims of this study were to (1) describe current practices for treatment waiting lists, (2) describe providers’ attitudes toward digital and nondigital LITs for patients on a waiting list, and (3) explore providers’ willingness to use digital and nondigital LITs and their decisions to learn about them.

    Methods: We surveyed 141 practicing mental health care providers (eg, therapists and psychologists) and provided an opportunity for them to learn about LITs.

    Results: Most participants reported keeping a waiting list. Few participants reported currently recommending digital or nondigital LITs, though most were willing to use at least one for patients on their waiting list. Attitudes toward digital and nondigital LITs were neutral to positive. Guided digital and nondigital LITs were generally perceived to be more effective but less accessible, and unguided interventions were perceived to be less effective but more accessible. Most participants selected to access additional information on LITs, with the most popular being web-based self-help.

    Conclusions: Results suggest providers are currently not recommending LITs for patients on treatment waiting lists but would be willing to recommend them. Future work should explore barriers and facilitators to implementing digital and nondigital LITs for patients on treatment waiting lists.

    JMIR Form Res 2022;6(9):e39787

    doi:10.2196/39787

    Keywords

    psychotherapy; CBT; cognitive behavioral therapy; behavior therapy; digital mental health; self-help; support group; mental health; digital health; eHealth; low-intensity intervention; survey; waiting list; health system; health care delivery; health care professional; care provider; bibliotherapy; attitude; perception; digital intervention; web-based intervention; depression; anxiety; mental disorder 


    Common mental disorders (CMDs), such as depression, anxiety, and insomnia, are leading causes of disability worldwide [1-3] and a significant burden to the health care system [4]. Mental health needs have increased with the COVID-19 pandemic, such that approximately 3 in 10 adults in the United States report clinically elevated anxiety or depression symptoms—a number that may have tripled since 2019 [5]. Effective treatments exist for CMDs, including psychotherapy and pharmacotherapy. However, despite the prevalence of CMDs and the efficacy of existing treatments, few people with mental health concerns receive any form of treatment [6,7].

    Barriers related to receiving traditional psychotherapy or other forms of treatment include time availability, lack of financial resources (including insurance coverage), stigma, and low provider availability [6,8]. During the COVID-19 pandemic, many of these barriers have been amplified, particularly provider availability and waiting time for treatment. Increased delays in treatment have been reported across a number of health service areas, including oncology, elective surgery, and general health care [9,10]. Waiting lists are used by providers as the demand for services often surpasses provider capacity. Generally, this involves individuals seeking treatment to be placed on a list prior to receiving a scheduled appointment or scheduling appointments far in the future. Existing work suggests that treatment waiting lists are commonly used for mental health services, but there is substantial variability in their design and management [11]. A relatively agreed-upon feature of waiting lists is that they are associated with a rather long time waiting for psychological services, raising a number of ethical issues, and forcing individuals to seek out alternate services.

    Waiting to receive treatment for mental health specifically can have detrimental effects. For example, waiting for treatment can be associated with increased symptom severity, including symptom deterioration [12]. Additionally, a greater waiting time is associated with a lower likelihood of ultimately engaging with the treatment [13]. Finally, the pretreatment waiting times may also be associated to worse patient engagement even once patients initiate treatment [14,15], decreased probability of improvement with treatment, and increased risk of dropout [13,16]. Patients themselves also identify waiting for treatment as a barrier to care, with some studies reporting negative psychological and behavioral outcomes when placed on treatment waiting lists for mental health care [17].

    Current efforts to address barriers to mental health treatment have made little impact on the burden of mental health. For example, research in places where the number of mental health providers has increased show public health burdens of mental illness remain unchanged [18]. Furthermore, some researchers report the public health burden of CMDs, such as mood and anxiety disorders, would show little reduction even if the number of providers doubled instantly [6]. These findings suggest that the current model of mental health care needs to change in order to accommodate the burden of CMDs [7].

    Various low-intensity treatments (LITs) exist that are relatively scalable and have demonstrated efficacy for depression, anxiety, and other CMDs. Many of these LITs can be used with additional guidance by a professional or paraprofessional (ie, guided) or can be self-guided by the individual user (ie, unguided) and can be accessed through a digital or nondigital platform. Although face-to-face therapy is one of the most well-studied treatments for CMDs, both guided and unguided LITs have been proven to be effective relative to controls like waiting lists and care as usual [19-22]. In general, unguided self-help is better than control groups (eg, sham internet applications and care as usual), and guided self-help is more efficacious than both controls and unguided self-help [23], with guided self-help appearing to have similar efficacy to face-to-face therapy [24]. One commonly studied nondigital LIT is bibliotherapy, a form of self-help using print materials [25]. Meta-analyses of randomized controlled trials of bibliotherapy for depression support its efficacy, yielding large mean effect sizes [19,20]. Guided and unguided digital mental health interventions (DMHIs), including internet-based cognitive behavioral therapy (iCBT) or mental health apps, are effective at treating depression relative to controls like waiting lists and care as usual [24,26]. Together, these studies suggest that LITs provide a tenable and effective treatment alternative for people with CMDs.

    Despite research supporting the efficacy of digital and nondigital LITs, it is unclear to what extent they are used in clinical practice [27]. We propose that one place where digital and nondigital LITs may be impactful is in the provision of services to individuals waiting for treatment [28]. The period in which people are waiting for psychological services is an important time for intervention because individuals have already overcome some barriers to treatment seeking, including stigma and the lack of contact with a mental health provider, only to be faced with another barrier (ie, time waiting without receiving services). Schleider et al [28] made a similar observation in a small open trial, where they offered a nondigital LIT to patients on a waiting list. We could not identify a study where provider attitudes toward digital or nondigital LITs for patients on waiting lists were explored.

    There is limited research on the use of LITs for patients on waiting lists; however, preliminary studies have supported the feasibility of implementing mental health apps for patients waiting for treatment [29,30]. Other researchers have explored barriers and facilitators of DMHI implementation in clinical practice more broadly. In one study comparing implementers and nonimplementers of iCBT, the two groups differed significantly in their perceived knowledge, confidence in when to recommend iCBT, perception of technical problems, organizational resources, and patient referral process allowing for iCBT inclusion [27]. Thus, there may be differences in the perceptions and attitudes of those who choose to implement versus those who choose not to implement digital and nondigital LITs, such as iCBT, in their practice. However, we know little about general attitudes toward LITs and, specifically, their potential to be implemented in clinical practice for patients on a waiting list. This is important for two reasons. First, extensive work has shown that attitudes predict behavior [31]; thus, negative attitudes toward digital and nondigital LITs may predict reduced willingness to endorse them. Second, identifying the factors that dissociate between willingness and unwillingness to implement digital and nondigital LITs could inform how future work should shape interventions to promote providers’ LIT use, particularly for practices with prohibitively long wait lists.

    The aims of our study were the following: (1) describing current practices surrounding waiting lists, including how often they are used and what providers do with individuals on their waiting lists (aim 1); (2) describing providers’ attitudes toward digital and nondigital LITs for patients on their waiting lists (aim 2); and (3) exploring predictors of providers’ willingness to use digital and nondigital LITs and their decisions to learn more about them (aim 3).


    We surveyed currently practicing mental health care providers on their attitudes toward LITs, including guided and unguided bibliotherapy and DMHIs. Additionally, we included a behavioral task that provided an option for participants to receive additional information about LITs.

    Recruitment and Eligibility

    Participants were recruited using a survey link posted via emails to professional organization listserves, specifically the American Psychological Association Division 29—Society for the Advancement of Psychotherapy, the Association for Behavioral and Cognitive Therapies, and social media (ie, Twitter). The survey, which was advertised as a survey on “waiting lists and possible resources,” began with a Study Information Sheet outlining the purpose of the research, eligibility criteria, limits of confidentiality, risks and benefits, and compensation. Participants were eligible to participate if they identified as being (1) over the age of 18 years, (2) a practicing licensed mental health care professional, and (3) currently providing at least 1 hour of clinical services per week. We required participants to have to conduct at least an hour of clinic work to ensure participants were currently providing at least some clinical services, but we did not limit the study to those whose only duties were clinical work.

    We received 145 survey responses. Two responses were removed after being determined to be from the same individual. Two responses were removed for not providing responses to all questions. The remaining 141 participants were included in data analysis.

    Ethics Approval

    Study procedures were approved by Indiana University Bloomington’s Human Subjects and Institutional Review Board (10503).

    Data

    The survey, which can be found in the Open Science Framework website [32], was divided into 4 sections. Section 1 collected demographic information (eg, age, gender, race, and ethnicity) and clinical background (eg, state or country of licensure, level of education, clinical practice setting, psychotherapy theoretical orientation, satisfaction with clinical work, years of clinical experience, and average hours of clinical services provided per week).

    Section 2 was designed to address aim 1 of our study. In this section, participants were asked to provide information on their current waiting list practices. This included whether their current clinical setting kept a treatment waiting list (vs not keeping a waiting list or scheduling appointments several months in advance), the estimated time patients spent on a waiting list, the effect of the COVID-19 pandemic on waiting time, and current actions taken for patients on a treatment waiting list.

    In section 3, participants were provided with a brief description of the following LITs: unguided bibliotherapy, guided bibliotherapy, unguided web-based self-help, guided web-based self-help, and patient support groups. We chose these LITs because they have been relatively well researched, and research suggests they are effective. Descriptions of each LIT type were provided to ensure that respondents were equally familiar with each intervention. To address aim 2 of our study, for each LIT, respondents were asked to rate their perceived effectiveness (eg, “I believe this option would be effective for patients on a treatment waiting list”), availability (eg, “I believe this option is available and accessible to use with patients on my waiting list”), and willingness to use LIT (eg, “I am willing to use this modality for patients on a waiting list”). Responses were given on a 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree).

    Section 4 addressed aim 3 of our study by asking respondents if they would like to receive any additional information about the following LITs: bibliotherapy, web-based self-help, or patient support groups. They were subsequently offered information on each LIT, and we tracked which participants chose to receive more information (ie, whether they engaged in information-seeking behavior).

    Missing Data

    Missingness in demographic and clinical variables was relatively low (0%-1.4%), with the exception of age (13.5%). Missingness in the attitude variables was greater (10.6%-12.1%), reflecting survey dropout (ie, participants who answered no subsequent questions). We completed regression analyses with the original data set and an imputed data set. The latter imputed missing values for all variables included in the regression analyses using a machine learning algorithm with random forests using the R package “missForest” [33].

    Statistical Analysis

    Analyses were conducted using the R programming language (version 4.2.1; the R Core Team) [34]. To describe waiting list practices, we present response frequencies and descriptive statistics (aim 1). We compared descriptive statistics and response frequencies of providers’ perceived efficacy, availability and accessibility, as well as willingness to use the different LITs (aim 2).

    To explore predictors of willingness to use digital and nondigital LITs (aim 3), we ran 5 linear regressions, one for each LIT under consideration. Willingness to use each specific intervention was regressed on demographic information (ie, gender, age, and education), professional background (ie, theoretical orientation and practice setting), and clinical variables (ie, the use of a waiting list, clinical satisfaction, and clinical hours per week). In these models, an average “willingness” response variable was included in the regression to control for participant willingness to use other interventions, excluding the one being predicted. Regressions were completed using the original data set and the imputed data set.

    To explore predictors of information seeking for digital and nondigital LITs (aim 3), we conducted a series of regressions to explore demographic, professional background and attitudinal predictors of requesting additional information. Specifically, we conducted 3 binomial logistic regressions with the dependent variables of requesting additional information (ie, selecting information vs not selecting information) on the following: (1) web-based self-help, (2) bibliotherapy, and (3) patient support groups. Each model included demographic information (eg, gender, education, and age), clinical variables (eg, theoretical orientation, clinical satisfaction, years of experience, clinical hours, and presence of a waiting list), modality-specific attitudes (eg, willingness to use the specific intervention and perceived availability and accessibility of the specific intervention), and controls for overall rating tendency (eg, average willingness to use other interventions and average availability or accessibility of other interventions).

    Transparency and Openness

    We report how we determined our sample, all data exclusions, all manipulations, and all measures in the study. All data, analysis code, and research materials are available on the Open Science Framework website [32]. This study’s design and its analysis were not preregistered. No other papers currently use these data.


    Sample Characteristics

    Demographic and clinical variables of the sample are summarized in Table 1. The sample primarily included female, non-Hispanic, White participants. Participants’ average age was about 39 years. Most participants in the sample had a PhD degree and were prescribed to an orientation (eg, cognitive or third-wave behavioral therapy) related to cognitive behavioral therapy (CBT). About half of the participants were employed in a private practice setting with an average of 10 (SD=10.4) years of clinical experience.

    Table 1. Demographic and clinical variables of 141 providers who responded to a survey of waiting lists and low-intensity treatments.
    DemographicsValues
    Age (years), mean (SD)39.2 (10.1)
    Gender, n (%)

    		Female92 (65.2)

    		Male45 (31.9)

    		Nonbinary2 (1.4)

    		No answer2 (1.4)
    Race or ethnicity, n (%)

    		Non-Hispanic White115 (81.5)

    		Non-Hispanic Black1 (0.7)

    		Hispanic7 (5)

    		Asian6 (4.3)

    		AIANa, MENAb, NHPIc, or other6 (4.3)

    		Multiracial6 (4.3)
    Education, n (%)

    		Associate of Arts degree1 (0.7)

    		Bachelor of Arts degree3 (2.1)

    		Master of Arts degree17 (12.1)

    		PhD99 (70.2)

    		PsyD18 (12.8)

    		Other3 (2.1)
    Private practice (vs no private practice), n (%)71 (50.7)
    Clinical orientation—CBTd (vs other), n (%)125 (88.7)
    Clinical satisfaction, n (%)

    		Not satisfied0 (0)

    		Slightly satisfied7 (5)

    		Neutral23 (16.4)

    		Very satisfied80 (57.1)

    		Extremely satisfied30 (21.4)
    Clinical experience (years), mean (SD)10.4 (10.4)
    Clinical hours per week, mean (SD)18.3 (10.9)

    aAIAN: American Indian or Alaska Native.

    bMENA: Middle Eastern or North African.

    cNHPI: Native Hawaiian or Pacific Islander.

    dCBT: cognitive behavioral therapy.

    Waiting List Characteristics

    The majority of survey respondents (n=94, 69.1%) endorsed keeping a formal treatment waiting list (Table 2) with the estimated waiting time averaging about 13 weeks. Others reported not keeping a waiting list but scheduling patients “a couple of months in advance” (n=23, 16.9%). Most of the respondents who endorsed keeping a waiting list also noted their estimated waiting time had been impacted by the COVID-19 pandemic (n=68, 73%) and estimated waiting times around 9 weeks prior to the pandemic.

    The majority of participants who kept a waiting list or scheduled patients for months in advance endorsed taking names or contact information, completing an unstructured brief assessment, and providing referrals. Few reported completing a structured assessment or provided brief psychoeducation, and even fewer (n=13-20, <20%) reported providing information on apps, books, or support groups.

    Table 2. Features of treatment waiting lists for 141 providers who responded to our survey on waiting lists and low-intensity treatments.
    CharacteristicsValuesMissing values, n (%)
    Waiting list kept, n (%)5 (3.5)

    		Yes94 (69.1)

    		No23 (16.9)

    		No, but scheduling appointments months in advance19 (14)
    Impacted by COVID-19, n (%)1 (1.1)

    		Yes68 (73.1)

    		No25 (26.9)
    Wait time, mean (SD)

    		Current wait time (weeks)12.8 (10.6)

    		Pre–COVID-19 wait time (weeks)9.4 (11.7)
    Waiting list resources used by therapists who kept a waiting list (n=106), n (%)7 (6.2)

    		Name or contact information101 (95)

    		Unstructured assessment77 (72.6)

    		Structured assessment24 (22.6)

    		Referrals (psychology or psychiatry)88 (83)

    		Brief psychoeducation29 (27.4)

    		Books17 (16)

    		Apps13 (12.3)

    		Support groups20 (18.9)

    		Other9 (8.5)

    Attitudes Toward Digital and Nondigital Low-Intensity Treatments

    Figure 1 shows respondents’ ratings of willingness to use, perceived efficacy, and availability of different interventions. Average responses were generally between 3 (“neutral”) and 4 (“somewhat agree”). The exception to this was the perceived low accessibility and availability of patient support groups (mean 2.9, SD 1.2). Average attitudes were highly correlated; specifically, the willingness to use LITs was related to its perceived efficacy (r122= 0.76, 95% CI 0.67-0.83; P<.001).

    ‎
    Figure 1. Willingness to use, perceived availability, and perceived efficacy of different low-intensity interventions presented to 141 mental health providers. Box plot indicates median and interquartile range. Triangle and error bars indicate mean values and 95% CI. Violin plot shows distribution of the data.
    View this figure

    Predictors of Willingness to Use an Intervention

    We used multiple linear regressions to identify demographic, clinical, waiting list, and attitude variables predicting participants’ ratings of willingness to use a LIT (Table S1 in Multimedia Appendix 1). Across models, averaged willingness to use other LITs predicted the specific likelihood of willingness to use another LIT. For example, the willingness to use unguided bibliotherapy was strongly predicted by the average willingness to use support groups, guided bibliotherapy, and web-based self-help (β=.65, 95% CI 0.45-0.84).

    Other predictors of willingness to use a LIT varied across the LITs probed. Compared to individuals in other practice settings, individuals in private practice were more willing to use unguided bibliotherapy (β=.22, 95% CI 0.02-0.42) and less willing to use guided bibliotherapy (β=–.20, 95% CI –0.35 to –0.04). Additionally, individuals who reported a CBT theoretical orientation (vs not reporting one) were more willing to use unguided web-based self-help (β=.22, 95% CI 0.08-0.35). There were no consistent significant predictors of willingness to use support groups. More detailed information is presented in Table S1 in Multimedia Appendix 1.

    Information Seeking About Digital and Nondigital Low-Intensity Treatments

    Most (n=85, 70%) respondents indicated they would like to receive additional information about at least one of these modalities: web-based self-help (n=78, 63%), bibliotherapy (n=66, 53%), or support groups (n=61, 50%). We explored demographic, clinical, waiting list, and attitude variables predicting participants’ responses to receive additional information. Overall, there were few strong predictors of information seeking for LITs (Table 3 and Table 4). Willingness to use the specific LIT was predictive of information seeking for web-based self-help (odds ratio [OR]=2.20, 95% CI 1.20-4.28) and bibliotherapy (OR=1.66, 95% CI 1.02-2.80). Relative to individuals in other practice settings, individuals in private practice were more likely to seek information for web-based self-help (OR=5.33, 95% CI 1.48-23.42). There were no consistent predictors of seeking information about support groups.

    Table 3. Logistic regression analyses predicting providers’ information seeking for low-intensity interventions from demographic, clinical, and practice predictors in original data sets.
    Original data (N=104)Web-based self-helpBibliotherapySupport groups

    		ORa (95% CI)ZbP valueOR (95% CI)ZP valueOR (95% CI)ZP value
    Intercept0.16 (0.00-8.08)–0.91.360.56 (0.01-31.65)–0.28.780.11 (0.00-5.37)–1.10.27
    Availability (specific)0.71 (0.41-1.20)–1.23.220.94 (0.55-1.58)–0.23.820.98 (0.66-1.43)–0.12.90
    Willingness (specific)2.20 (1.20-4.28)2.45.01c1.66 (1.02-2.80)1.99.05c1.24 (0.77-2.01)0.87.38
    Availability (general)1.51 (0.77-3.04)1.19.231.08 (0.55-2.14)0.22.830.97 (0.52-1.79)–0.11.91
    Willingness (general)1.29 (0.59-2.84)0.65.511.64 (0.84-3.38)1.41.161.70 (0.88-3.44)1.54.12
    Age0.97 (0.92-1.01)–1.36.170.99 (0.94-1.04)–0.46.640.97 (0.93-1.02)–1.13.26
    Female (vs male)0.41 (0.12-1.20)–1.57.120.84 (0.31-2.24)–0.35.730.69 (0.27-1.75)–0.78.44
    Doctorate (vs AA/BA/MAd)1.50 (0.30-6.76)0.52.601.38 (0.33-5.55)0.45.652.20 (0.56-9.21)1.12.26
    Keeps a waitlist (vs not)2.52 (0.64-10.25)1.33.181.36 (0.41-4.64)0.50.620.51 (0.14-1.72)–1.07.29
    Clinical satisfaction (1-5)0.84 (0.39-1.77)–0.46.650.56 (0.27-1.10)–1.64.101.00 (0.51-1.99)0.01.99
    Clinical hours1.00 (0.96-1.05)0.20.841.00 (0.96-1.05)0.20.850.99 (0.95-1.03)–0.50.62
    Private practice (vs other)5.33 (1.48-23.46)2.40.01c2.52 (0.84-8.32)1.60.112.14 (0.72-6.84)1.34.18
    CBTe (vs other orientation)0.95 (0.20-4.42)–0.06.950.41 (0.09-1.74)–1.18.241.75 (0.41-8.28)0.74.46

    aOR: odds ratio.

    bZ statistic from specific model term in logistic regression.

    cP values are significant when P<.05.

    dAA/BA/MA: Associate of Art degree/ Bachelor of Arts degree/Master of Arts degree.

    eCBT: cognitive behavioral therapy.

    Table 4. Logistic regression analyses predicting providers’ information seeking for low-intensity interventions from demographic, clinical, and practice predictors in imputed data sets.
    Imputed data (N=141)Eb-based self-helpBibliotherapySupport groups

    		ORa (95% CI)ZbP valueOR (95% CI)ZP valueOR (95% CI)ZP value
    Intercept0.05 (0.00-1.23)–1.79.070.12 (0.00-3.20)–1.25.210.17 (0.01-3.42)–1.15.25
    Availability (specific)0.79 (0.47-1.27)–0.96.341.01 (0.62-1.61)0.03.980.96 (0.67-1.36)–0.25.8
    Willingness (specific)1.95 (1.17-3.38)2.48.01c1.50 (0.98-2.32)1.87.061.45 (0.98-2.19)1.81.07
    Availability (general)1.74(0.95-3.27)1.78.081.42 (0.76-2.73)1.10.271.13 (0.65-1.97)0.42.68
    Willingness (general)1.14 (0.59-2.17)0.40.691.48 (0.81-2.77)1.270.201.24 (0.69-2.27)0.42.48
    Age0.98 (0.93-1.02)–1.06.291.00 (0.95-1.04)–0.15.880.98 (0.94-1.02)–0.92.36
    Female (vs male)0.57 (0.21-1.44)–1.16.241.00 (0.41-2.42)0.01.990.75 (0.34-1.64)–0.71.48
    Doctorate (vs AA/BA/MAd)0.79 (0.28-2.14)–0.46.650.84 (0.33-2.06)–0.39.700.96 (0.40-2.26)–0.09.93
    Keeps a waitlist (vs not)3.32 (1.10-10.30)2.12.03c2.63 (0.94-7.73)1.81.070.91 (0.33-2.47)–0.18.86
    Clinical satisfaction (1-5)1.21 (0.66-2.25)0.62.540.79 (0.44-1.40)–0.81.421.18 (0.69-2.01)0.60.55
    Clinical hours1.00 (0.96-1.05)0.14.891.01 (0.97-1.05)0.28.780.99 (0.95-1.03)–0.55.58
    Private practice (vs other)2.85 (1.06-8.42)2.00.05c1.34 (0.55-3.38)0.64.521.18 (0.50-2.86)0.37.71
    CBTd (vs other orientation)0.75 (0.19-2.59)–0.45.650.37 (0.09-1.30)–1.48.141.07 (0.33-3.39)0.12.90

    aOR: odds ratio.

    bZ statistic from specific model term in logistic regression.

    cP values are significant when P<.05.

    dAA/BA/MA: Associate of Art degree/ Bachelor of Arts degree/Master of Arts degree.

    dCBT: cognitive behavioral therapy.


    Principal Findings

    The aims of this study were to describe current waiting list practices (aim 1), describe providers’ attitudes toward digital and nondigital LITs for patients on their waiting lists (aim 2), and explore predictors of providers’ willingness to use digital and nondigital LITs and their decisions to learn more about them (aim 3). Most providers (n=94, 69%) endorsed keeping a treatment waiting list. Among those who said they do not, nearly half (n=19, 45%) reported scheduling patients in the “distant future,” for example, 2-3 months away. Thus, most (n=113, 83%) providers in this sample had an opportunity to use LITs with people waiting for treatment. However, fewer than 20% (n=13-20) reported having recommended books, apps, or support groups for patients on a waiting list. The majority of those who endorsed maintaining a waiting list noted the estimated waiting time for their patients to access treatment was high and had increased since the COVID-19 pandemic. The difference in the average estimated waiting time currently and prior to the pandemic was on average about a month, with a significant increase, suggesting patients have experienced an increased delay in accessing mental health care since the onset of the pandemic.

    This study has a number of limitations to consider. First, the generalizability of the study results may be limited due to the relatively small sample size and the representativeness of our study sample, which consisted primarily of CBT-oriented providers. However, our sample was relatively similar to the gender and racial or ethnic demographic characteristics of the psychology workforce in the United States [35], and CBT theoretical orientations have become the most popular among providers [36,37]. Additionally, it is possible that providers who are more interested in digital or nondigital LITs may have been more likely to participate in the study, resulting in a biased rating of attitudes relative to the population of mental health providers. Provider estimates of waiting times may likewise be biased or inaccurate in other ways. Previous research on waiting times for psychological services suggests that average waiting time ranges from 2-3 weeks to 2-3 months [38,39], but this varies across studies. Future studies could explore alternative methods, including the “secret shopper” methods, to get more accurate data on waiting lists and estimated waiting times. Lastly, this study assessed providers’ limited attitudes toward the listed interventions, specifically their perceptions of the intervention efficacy, accessibility, and their willingness to use it. Future research should investigate more detailed perceptions of these interventions through, for example, qualitative interviews to identify specific barriers and facilitators to digital and nondigital LIT implementation and use.

    Despite its limitations, this study has notable strengths. To our knowledge, this is the first survey of providers to assess attitudes toward digital and nondigital LITs for patients on a waiting list. Additionally, beyond assessing attitudes, we also provided an opportunity to learn more about digital and nondigital LITs and assessed participants’ decisions to request additional information. Most providers were not currently recommending digital or nondigital LITs for patients on their waiting list, but attitudes toward the interventions were neutral to positive. Most were willing to use at least one intervention for patients on their waiting list. We found no evidence that providers had more positive attitudes regarding digital versus nondigital interventions. Generally, guided interventions were seen as more effective but less accessible than unguided interventions, which, in turn, were seen as less effective but more accessible. Together, these findings support our proposal that dissemination and implementation of digital and nondigital LITs (eg, bibliotherapy or DMHIs) while patients are on waiting lists could be a promising strategy to reduce the burden of untreated CMDs.

    Although we found few significant predictors of attitudes and information seeking, we found that practice setting (ie, private practice vs other settings) was a predictor of attitudes and behaviors toward LITs. Individuals in private practice were more willing to use unguided bibliotherapy compared to individuals in other practice settings but were less willing to use guided bibliotherapy and unguided web-based self-help. Interestingly, at the end of our survey, individuals in private practice were more willing to learn about web-based self-help resources compared to individuals in other practice settings. These findings may reflect a knowledge gap wherein individuals in private practice currently do not perceive themselves to know which DMHIs to turn to, a barrier reported by other mental health providers [27,40,41], and hence they are less willing to use them. In addition to private practice setting, CBT theoretical orientation was predictive of willingness to use unguided web-based self-help. This finding may reflect the recent increase in iCBTs in research and practice settings, many of which are self-guided [42,43]. Increasing knowledge about digital and nondigital LITs and disseminating the interventions that individual providers are willing to use may be a useful way of increasing the reach of LITs [44]. One strategy to increase the use of LITs on treatment waiting lists would be to target the dissemination and implementation of digital and nondigital LITs to individuals who already have positive attitudes toward them—in our study, CBT practitioners and people with private practices. Alternatively, researchers could study interventions to increase the willingness to use digital and nondigital LITs by those not predisposed to using them, for example people who are not CBT practitioners.

    Conclusions

    We investigated treatment waiting lists and attitudes toward LITs for patients in waiting lists. Most providers appear to keep a waiting list, but most of them do not provide LITs to individuals on their waiting lists. In general, attitudes toward using LITs for patients in waiting lists were positive. Future research should investigate manipulating attitudes toward digital and nondigital LITs as well as structural barriers that may influence their use. For example, regarding individuals in private practice, who may be less likely to recommend guided LITs, qualitative data from our participants and from other studies [45] highlight questions about providers’ legal and ethical liability related to giving LIT guidance for participants on their waiting lists (eg, “I think one might assume a level of risk if participating in guided exercises but not therapy associated with their office”). Additionally, providers may be more, rather than less, likely to recommend LITs to patients with different features (eg, less severe symptoms) [46]. The perceived efficacy of an intervention also seems to be a major correlate of its use, so interventions that educate providers about LIT research are also worth exploring. Future work should clarify the nature of liability when recommending digital and nondigital LITs, as this may be an obstacle to uptake.

    Acknowledgments

    The authors would like to thank the participants for their time and thoughtful responses to the survey questions.

    This research was partially funded by the National Institute of Mental Health (grant T32MH103213; PI: Hetrick), which provided support for AP and grants (KL2TR002530 and UL1TR002529; PI: Shekhar) from the National Institutes of Health, National Center for Advancing Translational Sciences, Clinical and Translational Sciences Award, which provided support for LLL, as well as the National Institute on Aging (R01AG070931-02; PI: ACK).

    Data Availability

    No other papers currently use these data. Study data, code, and survey materials can be accessed on the Open Science Framework website [32].

    Conflicts of Interest

    LLL has received consulting fees from Happify Health Inc, who had no role in this study. The funders had no role in the drafting of the manuscript.

    ‎
    Multimedia Appendix 1

    Supplementary Table S1.

    DOCX File , 25 KB
    1. Baxter AJ, Vos T, Scott KM, Ferrari AJ, Whiteford HA. The global burden of anxiety disorders in 2010. Psychol Med 2014 Jan 22;44(11):2363-2374. [CrossRef]
    2. James S, Abate D, Abate K, Abay S, Abbafati C, Abbasi N, et al. . [CrossRef]
    3. Whiteford HA, Degenhardt L, Rehm J, Baxter AJ, Ferrari AJ, Erskine HE, et al. Global burden of disease attributable to mental and substance use disorders: findings from the Global Burden of Disease Study 2010. The Lancet 2013 Nov;382(9904):1575-1586. [CrossRef]
    4. Greenberg PE, Fournier A, Sisitsky T, Pike CT, Kessler RC. The economic burden of adults with major depressive disorder in the United States (2005 and 2010). J Clin Psychiatry 2015 Feb 25;76(02):155-162. [CrossRef]
    5. Prevention C. Anxiety and depression, household pulse survey. CDC.   URL: https://www.cdc.gov/nchs/covid19/pulse/mental-health.htm [accessed 2021-12-14]
    6. Kazdin AE, Blase SL. Rebooting psychotherapy research and practice to reduce the burden of mental illness. Perspect Psychol Sci 2011 Jan 03;6(1):21-37. [CrossRef] [Medline]
    7. Kazdin AE. Addressing the treatment gap: a key challenge for extending evidence-based psychosocial interventions. Behav Res Ther 2017 Jan;88:7-18. [CrossRef] [Medline]
    8. Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med 2013 Aug 09;44(6):1303-1317. [CrossRef]
    9. Uimonen M, Kuitunen I, Paloneva J, Launonen AP, Ponkilainen V, Mattila VM. The impact of the COVID-19 pandemic on waiting times for elective surgery patients: a multicenter study. PLoS One 2021 Jul 6;16(7):e0253875 [FREE Full text] [CrossRef] [Medline]
    10. Kutikov A, Weinberg DS, Edelman MJ, Horwitz EM, Uzzo RG, Fisher RI. A war on two fronts: cancer care in the time of COVID-19. Ann Intern Med 2020 Jun 02;172(11):756-758. [CrossRef]
    11. Brown SA, Parker JD, Godding PR. Administrative, clinical, and ethical issues surrounding the use of waiting lists in the delivery of mental health services. J Behav Health Serv Res 2002 May;29(2):217-228. [CrossRef] [Medline]
    12. Cuijpers P, Karyotaki E, Ciharova M, Miguel C, Noma H, Furukawa TA. The effects of psychotherapies for depression on response, remission, reliable change, and deterioration: a meta-analysis. Acta Psychiatr Scand 2021 Sep 04;144(3):288-299 [FREE Full text] [CrossRef] [Medline]
    13. Krendl AC, Lorenzo-Luaces L. Identifying peaks in attrition after clients initiate mental health treatment in a university training clinic. Psychol Serv 2022 Aug;19(3):519-526. [CrossRef] [Medline]
    14. Swift JK, Whipple JL, Sandberg P. A prediction of initial appointment attendance and initial outcome expectations. Psychotherapy (Chic) 2012 Dec;49(4):549-556. [CrossRef] [Medline]
    15. Reitzel LR, Stellrecht NE, Gordon KH, Lima EN, Wingate LR, Brown JS, et al. Does time between application and case assignment predict therapy attendance or premature termination in outpatients? Psychol Serv 2006 Feb;3(1):51-60. [CrossRef]
    16. Steinert C, Stadter K, Stark R, Leichsenring F. The effects of waiting for treatment: a meta-analysis of waitlist control groups in randomized controlled trials for social anxiety disorder. Clin Psychol Psychother 2017 May 22;24(3):649-660. [CrossRef] [Medline]
    17. Punton G, Dodd AL, McNeill A. 'You're on the waiting list': an interpretive phenomenological analysis of young adults' experiences of waiting lists within mental health services in the UK. PLoS One 2022 Mar 18;17(3):e0265542 [FREE Full text] [CrossRef] [Medline]
    18. Jorm AF, Patten SB, Brugha TS, Mojtabai R. Has increased provision of treatment reduced the prevalence of common mental disorders? Review of the evidence from four countries. World Psychiatry 2017 Mar 26;16(1):90-99 [FREE Full text] [CrossRef] [Medline]
    19. Cuijpers P. Bibliotherapy in unipolar depression: a meta-analysis. J Behav Ther Exp Psychiatry 1997 Jun;28(2):139-147. [CrossRef]
    20. Gregory RJ, Schwer Canning S, Lee TW, Wise JC. Cognitive bibliotherapy for depression: a meta-analysis. Prof Psychol Res Pr 2004 Jun;35(3):275-280. [CrossRef]
    21. Andersson G, Carlbring P, Titov N, Lindefors N. Internet interventions for adults with anxiety and mood disorders: a narrative umbrella review of recent meta-analyses. Can J Psychiatry 2019 Jul 16;64(7):465-470 [FREE Full text] [CrossRef] [Medline]
    22. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther 2018 Jan 07;47(1):1-18. [CrossRef] [Medline]
    23. Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med 2010 Apr 21;40(12):1943-1957. [CrossRef]
    24. Cuijpers P, Noma H, Karyotaki E, Cipriani A, Furukawa TA. Effectiveness and acceptability of cognitive behavior therapy delivery formats in adults with depression: a network meta-analysis. JAMA Psychiatry 2019 Jul 01;76(7):700-707 [FREE Full text] [CrossRef] [Medline]
    25. Williams C. Use of written cognitive–behavioural therapy self-help materials to treat depression. Adv psychiatr treat 2018 Jan 02;7(3):233-240. [CrossRef]
    26. Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry 2017 May 01;74(4):351-359. [CrossRef] [Medline]
    27. Brantnell A, Woodford J, Baraldi E, van Achterberg T, von Essen L. Views of implementers and nonimplementers of internet-administered cognitive behavioral therapy for depression and anxiety: survey of primary care decision makers in Sweden. J Med Internet Res 2020 Aug 12;22(8):e18033 [FREE Full text] [CrossRef] [Medline]
    28. Schleider JL, Sung J, Bianco A, Gonzalez A, Vivian D, Mullarkey M. Open pilot trial of a single-session consultation service for clients on psychotherapy wait-lists. PsyArXiv Preprint published online in Jan 15, 2021. [CrossRef]
    29. Levin ME, Hicks ET, Krafft J. J Am Coll Health 2022 Jan 09;70(1):165-173. [CrossRef] [Medline]
    30. Hentati A, Forsell E, Ljótsson B, Lindefors N, Kraepelien M. A self-guided and monitored digital problem-solving intervention for patients with symptoms of depression or anxiety on the waiting list for treatment in routine psychiatric care: feasibility study. BJPsych Open 2022 Feb 08;8(2):e43 [FREE Full text] [CrossRef] [Medline]
    31. Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process 1991 Dec;50(2):179-211. [CrossRef]
    32. Peipert A. Waiting lists for psychotherapy and provider attitudes towards low-intensity interventions. PsyArXiv Preprint posted online May 3, 2022. [CrossRef]
    33. Tang F, Ishwaran H. Random forest missing data algorithms. Stat Anal Data Min 2017 Dec 13;10(6):363-377 [FREE Full text] [CrossRef] [Medline]
    34. The R language and environment for statistical computing.: R Core Team; 2017.   URL: https://www.R-project.org [accessed 2022-05-22]
    35. Lin L, Stamm K, Christidis P. Demographics of the US psychology workforce: findings from the 2007-16 American Community Survey. APA 2018:3-12. [CrossRef]
    36. Norcross JC, Karpiak CP. Clinical psychologists in the 2010s: 50 years of the APA division of clinical psychology. Clin Psychol 2012 Mar;19(1):1-12. [CrossRef]
    37. Norcross JC, Sayette MA, Pomerantz AM. Doctoral training in clinical psychology across 23 years: Continuity and change. J Clin Psychol 2018 Mar 20;74(3):385-397. [CrossRef] [Medline]
    38. Steinman KJ, Shoben AB, Dembe AE, Kelleher KJ. How long do adolescents wait for psychiatry appointments? Community Ment Health J 2015 Oct 25;51(7):782-789. [CrossRef] [Medline]
    39. Blech B, West JC, Yang Z, Barber KD, Wang P, Coyle C. Availability of network psychiatrists among the largest health insurance carriers in Washington, D.C. Psychiatr Serv 2017 Oct 01;68(9):962-965. [CrossRef] [Medline]
    40. Miller KE, Kuhn E, Yu J, Owen JE, Jaworski BK, Taylor K, et al. Use and perceptions of mobile apps for patients among VA primary care mental and behavioral health providers. Prof Psychol Res Pr 2019 Jun;50(3):204-209. [CrossRef]
    41. Cliffe B, Croker A, Denne M, Stallard P. Clinicians' use of and attitudes towards technology to provide and support interventions in child and adolescent mental health services. Child Adolesc Ment Health 2020 May 11;25(2):95-101. [CrossRef] [Medline]
    42. Aguilera A, Muench F. There's an app for that: information technology applications for cognitive behavioral practitioners. Behav Ther (N Y N Y) 2012 May;35(4):65-73 [FREE Full text] [Medline]
    43. Wasil AR, Palermo EH, Lorenzo-Luaces L, DeRubeis RJ. Is there an app for that? A review of popular apps for depression, anxiety, and well-being. Cogn Behav Pract 2021 Oct (forthcoming). [CrossRef]
    44. Michie S, Atkins L, West R. The Behaviour Change Wheel: A guide to Designing Interventions. Great Britain: Silverback Publishing; 2014.
    45. Borgueta AM, Purvis CK, Newman MG. Navigating the ethics of Internet-guided self-help interventions. Clin Psychol (New York) 2018 Jul;25(2):e12235 [FREE Full text] [CrossRef] [Medline]
    46. Lorenzo-Luaces L, DeRubeis RJ, Bennett IM. Primary care physicians' selection of low-intensity treatments for patients with depression. Fam Med 2015;47(7):511-516. [Medline]

    ‎
    CBT: cognitive behavioral therapy
    CMD: common mental disorder
    DMHI: digital mental health intervention
    iCBT: internet-based cognitive behavioral therapy
    LIT: low-intensity treatment
    OR: odds ratio

    Edited by A Mavragani; submitted 23.05.22; peer-reviewed by S Schueller, K Matsumoto; comments to author 03.07.22; revised version received 19.07.22; accepted 22.08.22; published 16.09.22

    Copyright

    ©Allison Peipert, Anne C Krendl, Lorenzo Lorenzo-Luaces. Originally published in JMIR Formative Research (https://formative.jmir.org), 16.09.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.