Published on in Vol 6, No 7 (2022): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/38005, first published .
Improvements in Depression Outcomes Following a Digital Cognitive Behavioral Therapy Intervention in a Polychronic Population: Retrospective Study

Improvements in Depression Outcomes Following a Digital Cognitive Behavioral Therapy Intervention in a Polychronic Population: Retrospective Study

Improvements in Depression Outcomes Following a Digital Cognitive Behavioral Therapy Intervention in a Polychronic Population: Retrospective Study

Original Paper

Corresponding Author:

Aarathi Venkatesan, PhD

Vida Health

100 Montgomery St, Ste 750

San Francisco, CA, 94104

United States

Phone: 1 14159891017

Email: aarathi.venkatesan@vida.com


Background: Digital mental health interventions have shown promise in reducing barriers to effective care for depression. Depression and related mental disorders are known to be highly comorbid with common chronic physical conditions, such as obesity and type 2 diabetes. While some research has explored the interaction dynamics of treating populations living with both mental and physical disorders, very little is known about such dynamics in digital care.

Objective: We aimed to examine the effectiveness of a 12-week, therapist-supported, app-based cognitive behavioral therapy program in improving symptoms of depression and anxiety. The studied population included adults with a heavy burden of chronic physical disease, including obesity and type 2 diabetes.

Methods: A total of 1512 participants with at least moderate depression were enrolled. The treatment cohort consisted of 831 (54.96%) participants who completed a follow-up assessment. The program included structured lessons and tools (ie, exercises and practices) and offered one-on-one weekly video counseling sessions with a licensed therapist for 12 weeks and monthly sessions thereafter. The clinically validated 8-item Patient Health Questionnaire (PHQ-8) and the 7-item Generalized Anxiety Disorder scale (GAD-7) were used to assess depression and anxiety, respectively. Linear mixed-effects modeling was employed to examine changes in depression and anxiety over time. Given correlation among various measures of program usage, a composite variable for depth of usage was used to analyze the correlation between usage and changes in depressive symptoms. Body weight changes from baseline were assessed primarily with digitally connected scales.

Results: Out of 831 participants in the treatment cohort, 74.5% (n=619) showed a clinically significant reduction in depressive symptom severity after 12 weeks, where follow-up PHQ-8 scores had shifted downward by at least one diagnostic category. In total, 67.5% (n=561) of the participants showed a reliable improvement in PHQ-8 scores as measured by the reliable change index. There was an average reduction of 5.9 (SD 5.2) points (P<.001) between baseline and follow-up. Greater program usage was correlated with greater likelihood of reliable improvement in depressive symptoms (odds ratio 1.3, 95% CI 1.1-1.5; P=.002). An exploratory analysis of body weight changes with a multilevel, mixed-effect model suggested that reliable improvement in depressive symptoms at follow-up was associated with significantly greater weight loss at 9 months (β=–1.11, P=.002).

Conclusions: The results provide further support that digital interventions can support clinically meaningful improvements in depression. Some form of synergy in treatment of comorbid depression and obesity or diabetes could be studied in future research. The study was limited by postintervention participant attrition as well as the retrospective observational study design.

JMIR Form Res 2022;6(7):e38005

doi:10.2196/38005

Keywords



In 2016, mental health disorders affected more than 1 billion people worldwide [1]. Among mental health disorders, clinical depression carries a lifetime risk of 15% to 18% [2] and has the strongest association with disability-adjusted life years, a global benchmark of disease burden [1,2]. Depression is also the psychiatric condition most strongly associated with suicide [3]. The relationships among clinical depression, well-being, and health care costs have been well documented, with costs of care for patients living with depression higher across spending categories [4,5].

It has been estimated from nationally representative surveys that the prevalence of depressive symptoms in the United States increased 3-fold during the COVID-19 pandemic, with the majority of those affected already having been at elevated risk [6]. Simultaneously, the pandemic has accelerated the adoption of digital technology to deliver health care, particularly for mental health, and highlighted the promise of remotely delivered health services when traditional models may not have been available or accessible [7].

Digital mental health interventions (DMHIs) are potentially scalable and effective treatment solutions for mental health. Although research evaluating the effectiveness of DMHIs notes significant heterogeneity in terms of study design, clinical model, and intervention characteristics, meta-analytic reviews of smartphone-based interventions have observed a clinically significant treatment effect compared to both wait-list and active controls for depression and anxiety symptoms [8-10].

There is considerable research consensus that cognitive behavioral therapy (CBT) is a highly effective therapeutic modality for the treatment of clinical depression and anxiety because of relatively short intervention durations with strong outcomes [11,12]. Specifically, CBT-based digital interventions were associated with a significantly greater reduction in depression compared to non-CBT therapeutic approaches (eg, mindfulness, psychoeducation, and mood monitoring) [9]. In the context of DMHIs, digital CBT interventions appear to be equivalent to face-to-face interventions in terms of treatment efficacy [13-16]. Furthermore, a recent assessment of digital CBT offerings that evaluated patient preference, cost savings, and clinical benefit concluded that a provider-guided digital CBT program was likely the most effective approach for depression and anxiety compared to self-guided and face-to-face interventions [17].

In addition to evaluating the efficacy of CBT-based digital interventions, there has been growing research interest in exploring their mechanisms, particularly in the role of program engagement in DMHIs. Recently, Chien et al [18] employed a machine learning–based approach to explore patterns of engagement with a digital CBT program and their relationship with improvements in depression and anxiety. While the study did identify five distinct classes of program engagement, from low to high engagement, all classes were all positively associated with clinical improvement. Higher engagement classes were associated with greater improvement in depressive symptoms, so a possible dose-response effect was suggested.

However, it has been observed that user engagement can be difficult to define and measure [19]. Where usage generally measures observable actions, engagement implies some subjective experience of the digital intervention with a focus on the quality of the experience [20,21]. Furthermore, as Torous et al [22] note, usage over time, a commonly used measure of engagement, cannot distinguish a user whose mental health needs have been met by an app with a single instance of usage from one who needs repeated access for support.

One app feature that has been previously operationalized as a measure of DMHI engagement is lesson completion [23]. Lessons are typically brief pieces of evidence-based content intended to support a skill or health habit. They can also serve a crucial function in mental health interventions, digital or otherwise. CBT, in particular, emphasizes the practice of skills in between sessions by way of “homework assignments” or lessons in order to reinforce practices such as cognitive reappraisal [24]. Kazantzis et al [25] observed a stronger treatment effect size for CBT-based therapeutic interventions that incorporated homework when compared to interventions without a homework component. Lesson completion has also been used as a measure of treatment adherence and has shown a positive association with improvements in depression and anxiety [17,25-29]. It has been noted that the ubiquity of smartphones and the flexibility of the technology enables access to extensive content, on demand or needs based, that is difficult to replicate in traditional delivery models [28,30].

Lastly, an often-overlooked dimension of clinical depression, particularly in the context of DMHIs, is its frequent co-occurrence with chronic health conditions, such as type 2 diabetes and obesity [31-33]. Among other aspects, depression is known to hamper self-care and medication adherence [33]. Cross-sectional research suggests a 1.18 times greater likelihood of depressive symptoms in individuals with obesity than in those without [34]. Similarly, the risk of prediabetes and related measures appears to be markedly elevated among those newly diagnosed with depression [35,36]. This relationship tends to be stronger among women [34,35]. In their meta-analytic review of collaborative care to treat depression and diabetes in tandem, Atlantis et al [31] observed significant improvements in both depression and glycemic management with tandem treatment. Another systematic review showed that psychological interventions tailored for people with diabetes were effective in improving both glycemic management (ie, hemoglobin A1c [HbA1c]) and elevated diabetes distress [37]. There are indications that the relationship between chronic conditions and depression are bidirectional, with an increased incidence of diabetes among those with diagnosed depression [38-40]. Many app-based health interventions have a singular health focus (eg, depression, weight, or diabetes management), making it more challenging to fully understand the impact and the influence of co-occurring conditions on treatment adherence and health outcomes [41].

In sum, research suggests that CBT-based DMHIs are feasible and effective solutions for depression and anxiety disorders [42-44]. There are some preliminary indications that the extent of program usage may influence treatment adherence and outcomes [45]. There remain open research questions on how intervention type, mode of delivery, and mechanisms may affect treatment outcomes. There has also been less focus on DMHIs in populations living with co-occurring depression and chronic health conditions.

In this study, we evaluated the Vida CBT Program for moderate depression and anxiety in a polychronic adult population, that is, one with a high prevalence of chronic health conditions. Vida Health is a Health Insurance Portability and Accountability Act–compliant, app-based platform for management of both mental and physical health that combines tailored content with counseling by licensed therapists and other health education specialists. The platform is available directly to consumers or as a benefit from select employers and health plans. The primary objective of this study was to assess changes in depression following a 12-week digital CBT program: the Vida CBT Program. We hypothesized that participants who completed the program would show a reduction in depressive symptoms and that measures of program usage would be positively associated with these improvements. As part of a preliminary exploratory analysis, we also evaluated changes in weight among participants concurrently enrolled in a Vida physical health program. We suspected that improvements in depression would be positively associated with stronger weight loss.


Study Design

This study used a single-arm, retrospective design to evaluate changes in depression and anxiety following the Vida CBT Program.

Ethics Approval

The study protocol and informed consent statement was reviewed and approved by the Western Institutional Review Board Inc (protocol No. 20192591), an independent institutional review board. All data were fully anonymized prior to data analysis. Informed consent statements were sent to participants upon enrollment in the Vida CBT Program.

Measures

The 8-item Patient Health Questionnaire (PHQ-8) was used to assess severity of depressive symptoms. The following standard scoring cutoffs were applied to classify depressive symptom severity: 0 to 4 (asymptomatic or minimal), 5 to 9 (mild), 10 to 14 (moderate), 15 to 19 (moderately severe), and 20 or higher (severe). Anxiety symptoms were assessed using the 7-item Generalized Anxiety Disorder scale (GAD-7) using the following standard score cutoffs to classify anxiety symptom severity: 0 to 4 (asymptomatic or minimal), 5 to 10 (mild), 11 to 17 (moderate), and 18 or higher (severe). The PHQ-8 and GAD-7 are widely used in clinical settings and have shown robust reliability and validity [39,40]. The assessments were administered in the app automatically at program start, week 6, week 12, and every 3 months thereafter for up to 1 year. Participants were encouraged to complete the survey on the day of receipt but had the option to complete the assessment at any point during the 2 weeks following receipt, after which the survey would disappear until the next assessment time point. Therapists also had the option of sending the instrument to the participant at any point during the intervention as they deemed clinically appropriate.

Body weight was a secondary outcome measure in this study. Weight outcomes were either recorded via a connected wireless scale or self-reported by the participant using a logging tool available in the Vida Health app. Participants could either sync their personal wireless scale to the app or order a digitally connected scale via the app.

Study Sample and Recruitment

The study was open to adults, 18 years of age or older, who were fluent in English and had access to a smartphone or tablet. Participants were recruited between September 2019 and January 2021 using a combination of emails, mailers, and phone outreach efforts. The Vida Health app is available to individuals across the United States and can be downloaded from the Apple App Store or Google Play. Participants were drawn from several insurance plans and employers for whom Vida Health was offered as a covered benefit.

Upon downloading the app, participants completed a brief intake questionnaire that included name, contact information, basic demographics (ie, age, gender, height, and weight), and existing health conditions. Participants were offered a variety of health domains to focus on. Some participants chose to begin the Vida CBT Program directly. Others began in the Vida digital programs for weight loss or diabetes management described previously [46,47]. Participants received and completed an intake PHQ-8, and those with a score of 10 or greater (moderate depression) were included in the study. All participants also completed a baseline GAD-7 assessment. Eligible participants were paired with a licensed therapist based on their state of residence and preferred times for consultations. Therapists were mental health professionals working for Vida Health, licensed by their state’s respective licensure board. Participants with severe depression (PHQ-8 score ≥20) or severe anxiety (GAD-7 score ≥15) were ineligible for the Vida CBT Program and were referred to alternative sources of care. Additional exclusion criteria included eating disorders, substance use disorder, suicidality, homicidality, acute posttraumatic stress disorder, and episodes of mania or psychosis. Participants who presented with any of the above symptoms during the intervention were referred for care outside of Vida Health. Participants who chose to enroll initially in weight loss or diabetes management programs and were then screened into the Vida CBT Program had the option to continue both programs simultaneously.

Therapeutic Approach and Intervention

A fundamental focus of CBT is to address maladaptive thinking patterns by understanding the associations among thoughts, emotions, and behaviors [48]. As part of the Vida CBT Program, participants received structured multimedia (ie, audio, video, or text) lessons, activities, and practices within the app. Based on core CBT principles, such as guided discovery and conscious re-evaluation, these lessons were designed to increase awareness of one’s thinking patterns and support the practice of alternative, adaptive thoughts [24]. Ahead of their initial consultation with a Vida therapist, participants completed an informed consent form for psychotherapy that detailed their rights to confidentiality and limits to confidentiality, including mandated reporting requirements as stipulated by the therapist’s licensing board and state regulations. At the initial consultation, therapists performed a comprehensive biopsychosocial assessment that included a review of previous treatments and diagnoses, current presenting problem, and symptoms. Participants could communicate with their therapist using live video or audio consultations as well as with asynchronous messaging in the app.

Following the intake, therapists documented their initial diagnostic impressions and developed individualized treatment plans with short-term and long-term goals. Participants were offered weekly video or audio consultations with their therapist for the first 12 weeks and shorter monthly follow-up sessions thereafter for up to 1 year. Each therapist consultation comprised setting goals and homework activities for the upcoming week along with a review of strategies for further cultivating concepts and skills learned from earlier sessions. In between sessions, participants could complete assigned homework and use a thought tracker in the app. Lessons, once shared, remained available in the app for the participant to review and revisit concepts. The thought tracker feature allowed participants to record current thoughts using a Likert scale to assist in identifying, evaluating, and restructuring distorted thought patterns. In program weeks 10 through 12, therapists worked with participants to create a Wellness Recovery Action Plan intended to support maintenance of acquired skills and improved functioning and to prevent relapse [49]. Select screenshots from the program are shown in Figure 1.

Figure 1. Screenshots from the Vida CBT Program. CBT: cognitive behavioral therapy.
View this figure

Participants who were concurrently enrolled in a program for chronic disease management also worked with an additional Vida provider (ie, a certified health coach or registered dietitian) who could collaborate on care with the relevant therapist. As in the Vida CBT Program, they were offered synchronous consultations weekly for up to 12 weeks and monthly thereafter for up to 1 year. All providers received extensive training on motivational interviewing, an approach that leverages improving perceived self-efficacy and autonomy to facilitate healthy behavior change [50]. Additionally, participants received app content covering topics such as nutrition, exercise, and medication adherence. All content was informed by evidence-based research and literature on health behavior change as described previously [46,47,51].

Statistical Plan

Change in depression, based on PHQ-8 scores, between baseline and follow-up was the primary dependent variable. We performed a paired, 2-tailed t test to assess if there was a significant change in PHQ-8 scores from baseline. We used a second paired t test to evaluate changes in anxiety scores among participants who scored in the moderate anxiety range at baseline (ie, GAD-7 score ≥11). Mean normalization was applied to all continuous predictors (eg, age). A Boolean variable was created for the presence of co-occurring anxiety (1 = baseline GAD-7 score ≥11). Gender was also coded as a binary variable (1 = female). Since we could not assume that all therapists were equally effective, all regression analyses were conducted using a cluster-robust approach with therapist as a cluster group variable [52]. The reliable change index (RCI) for depression and anxiety was also computed. RCI, a commonly used measure in psychometrics, is the ratio of the difference in pre-post assessment scores to the standard error of measurement [47,48]. An RCI score of 1.96 or higher (ie, 1 above the 95% CI) is regarded as an indication of reliable, statistically meaningful change [53].

To explore the interaction between program usage and changes in depression, we tabulated five program features that broadly encompass the program experience: number of therapist consultations, number of messages sent to the therapist, number of “core” lessons opened, number of thoughts logged, and total number of content pieces opened. Core lessons were those related to fundamental CBT concepts (eg, cognitive restructuring, behavioral activation, and techniques for addressing maladaptive thinking) [24]. Data exploration revealed a right skew for each of the usage factors, that is, a subpopulation of participants who used the app features quite extensively. In order to retain these heavy app users, but to limit their influence on downstream analyses, all usage factors were right-winsorized at the 99th percentile [54]. The treatment cohort showed a notable female predominance, a finding not unusual in studies of mental health service use in the United States [55-57]. In this study, in order to adjust for this, the established technique of oversampling was employed, wherein 715 participants were drawn at random from the 116 participants who did not identify as female [58,59].

Finding, as expected, that features of program usage were correlated, we constructed a composite variable to limit collinearity. Participants were assigned an ordinal variable from 0 to 5, where 1 unit was assigned for each usage feature in which the participant was above the 25th percentile. Thus, someone with a depth-of-usage score of 5 had activity above the 25th percentile in each of the usage factors, while a score of 0 indicated usage within the 25th percentile across all usage features. We chose the 25th percentile as it empirically separated users into high and low usage categories without selecting only for the right tail of usage as alluded above. With reliable change as the binary dependent variable (1 = reliable improvement in depression symptoms), a cluster-robust logistic regression evaluated the relationship depth of usage and improvement in depression symptoms. Controls included therapist cluster, baseline PHQ-8 score, gender, presence of anxiety, and age.

A supplementary analysis evaluating changes in weight outcomes among participants concurrently enrolled in the Vida weight loss program was conducted. Analysis was restricted to participants who had been enrolled for at least 6 months and had logged weight at least twice in that period. A linear, mixed-effects model was used to address potential heterogeneity in the frequency and number of weight logs by participants and provider-level differences [60]. Percent change in weight from baseline was regressed on the following fixed factors: program time (in months), baseline BMI category (obesity or overweight), and reliable change (1 = reliable improvement in PHQ-8 scores; 0 = no reliable improvement) [61]. Participants and providers were specified in the model as random factors.

All data preparation and analyses were performed using Python (version 3.7.9; Python Software Foundation) and Stata (version 16.1; StataCorp LLC).


Overview

A total of 1512 participants enrolled in the Vida CBT Program between September 2019 and January 2021. A schematic of the participant flow is presented in Figure 2. Of those, 54.96% (n=831) had a follow-up PHQ-8 assessment between weeks 6 and 12 and were considered part of the treatment cohort. Analyses evaluating changes in depression scores from baseline were restricted to the treatment cohort. The remainder of the study cohort, equal to 45.04% (n=681) of the participants, failed to complete a follow-up PHQ-8 during the assessment window. These participants were excluded from the primary analyses; however, we performed a supplementary intention-to-treat (ITT) analysis to evaluate overall changes in PHQ-8 scores from baseline across the entire cohort. Among those without a valid follow-up, 71.5% (487/681) did not have any assessment after their baseline. For these members, a baseline carryforward approach was employed. The remaining 28.5% (194/681) of the participants completed an assessment before finishing 6 program weeks. For these members, a last-value carryforward approach was applied.

Baseline characteristics of the study cohort are reported in Table 1. In addition to depression, the entire study cohort self-reported living with at least one chronic physical health condition (ie, type 2 diabetes, cardiovascular disease, or obesity). There were no significant differences in baseline PHQ-8 scores between the treatment and incomplete groups at baseline (t1510=1.2, P=.22). There was a significantly lower rate of comorbid anxiety, defined as a GAD-7 score of 11 or higher, among participants in the treatment cohort (χ21=19.5, P<.001). A 2-tailed chi-square analysis indicated that there were significantly more women in the treatment cohort compared to the program noncompleter group (χ21=7.1, P=.01). There were also more participants concurrently enrolled in a health coaching program for a chronic condition in the treatment cohort (χ21=171.1, P<.001). Lastly, we observed a significant average difference in age of 2.3 years between the treatment cohort (mean 48.5, SD 11.4 years) and noncompleters (mean 46.2, SD 12.4 years; t1510=–3.8, P<.001).

Figure 2. A schematic of the participant flow. CBT: cognitive behavioral therapy; PHQ-8: 8-item Patient Health Questionnaire.
View this figure
Table 1. Demographic characteristics of the treatment and intention-to-treat study cohorts.
CharacteristicIncomplete data (n=681)Treatment (n=831)Total (N=1512)
Participants (N=1512), n (%)681 (45.0)831 (55.0)1512 (100)
Gender, n (%)

Female552 (81.1)715 (86.0)1267 (83.8)

Male127 (18.7)113 (13.6)240 (15.9)

Not disclosed2 (0.3)3 (0.4)5 (0.3)
Age in years, mean (SD)46.2 (12.4)48.5 (11.4)47.5 (11.9)
Baseline PHQ-8a score, mean (SD)14.6 (3.3)14.4 (3.4)14.5 (3.3)
Has anxiety (GAD-7b score ≥11), n (%)467 (68.6)478 (57.5)945 (62.5)
Enrolled in physical health program, n (%)360 (52.9)697 (83.9)1057 (69.9)
Chronic physical health condition, n (%)

Obesity554 (81.4)723 (87.0)1277 (84.5)

Cardiovascular disease367 (53.9)503 (60.5)870 (57.5)

Diabetes316 (46.4)468 (56.3)784 (51.9)

aPHQ-8: 8-item Patient Health Questionnaire; depressive symptom severity by score is classified as follows: 0 to 4 (asymptomatic or minimal), 5 to 9 (mild), 10 to 14 (moderate), 15 to 19 (moderately severe), and 20 or higher (severe).

bGAD-7: 7-item Generalized Anxiety Disorder scale; a score of ≥11 indicates moderate to severe anxiety.

Principal Results

Out of 831 participants in the treatment cohort, 74.5% (n=619) showed a clinically significant reduction in depressive symptom severity in 12 weeks, where follow-up PHQ-8 scores had shifted downward by at least one diagnostic category. A total of 67.5% (n=561) of the treatment cohort participants showed a reliable improvement in PHQ-8 scores as measured by the RCI. There was an average reduction of 5.9 (SD 5.2) points between baseline and follow-up (Table 2). A 2-tailed, paired t test revealed a significant reduction in scores between baseline and follow-up (t830=32.9, P<.001). A cluster-robust linear regression examining the association between change in PHQ-8 scores and baseline scores, co-occurrence of anxiety, gender, age, and concurrent enrollment in physical health revealed a significant inverse relationship between baseline and change in PHQ-8 scores (β=–1.7, P<.001). That is, greater baseline depression severity was, unsurprisingly, associated with greater reduction of depression at follow-up. We observed that the co-occurrence of anxiety was associated with a smaller reduction in depression scores (β=1.33, P<.001). In supplementary analyses, a 2-tailed, paired t test including the entire ITT cohort, using carryforward as above, indicated a slightly attenuated but still significant reduction in PHQ-8 scores at follow-up (mean –3.6, SD 4.99; t1511=29.1, P<.001).

Among the 478 participants with moderate anxiety or higher at baseline (ie, GAD-7 score ≥11), 89.7% (n=429) provided a follow-up assessment between weeks 6 and 12. A paired t test revealed a significant average reduction in anxiety scores of 6.1 (SD 5.4) points from baseline (t428=22.96, P<.001; Table 2). Additionally, 57.7% (n=276) of these participants had a reliable improvement in anxiety scores from baseline. A cluster-robust linear regression showed that higher baseline GAD-7 scores were associated with greater reductions in anxiety scores at follow-up (β=–3.5, P<.001). Age, gender, and baseline PHQ-8 scores were not significantly associated with anxiety score changes.

Table 2. Estimated marginal means of PHQ-8 and GAD-7 scores at baseline and follow-up.
Assessment type and time pointScore, estimated marginal mean (bootstrapped 95% CI)
PHQ-8a

Baseline14.4 (14.2-14.6)

Follow-up (12 weeks)8.5 (8.1-8.8)
GAD-7b

Baseline14.8 (14.5-15.0)

Follow-up (12 weeks)8.8 (8.3-9.3)

aPHQ-8: 8-item Patient Health Questionnaire; depressive symptom severity by score is classified as follows: 0 to 4 (asymptomatic or minimal), 5 to 9 (mild), 10 to 14 (moderate), 15 to 19 (moderately severe), and 20 or higher (severe).

bGAD-7: 7-item Generalized Anxiety Disorder scale; anxiety symptom severity by score is classified as follows: 0 to 4 (asymptomatic or minimal), 5 to 10 (mild), 11 to 17 (moderate), and 18 or higher (severe).

Program Usage Outcomes

Program usage was evaluated in the treatment cohort across a set of five program features: number of therapist consultations, number of messages sent to the therapist, number of times core lesson content was accessed, number of thoughts logged via the thought tracking tool, and number of program-related content cards viewed. As expected, there were notable correlations among these program usage factors, with Pearson coefficients ranging from 0.17 to 0.43 (Table 3).

In order to limit collinearity while evaluating the association between program usage and changes in depressive symptoms, we created a composite feature of overall depth of usage. For each usage feature, a score of 1 was assigned when activity for that specific feature was above the 25th percentile of the distribution. We then summed across each of the factors. Thus, depth-of-usage scores could range from 0 to 5, with a score of 5 indicating usage in excess of the 25th percentile of activity across the features, and a score of 0 indicating usage below the 25th percentile across the features. As noted above, the data were then resampled to adjust for the female predominance in the treatment cohort. From the resulting balanced cohort of 1430 participants, a cluster-robust logistic model controlling for age, gender, co-occurrence of anxiety (ie, baseline GAD-7 score ≥11), and baseline PHQ-8 score revealed a significant association between depth of usage and likelihood of reliable improvement in depression scores at follow-up (odds ratio [OR] 1.3, 95% CI 1.1-1.5; P=.002). In other words, greater usage across the platform was associated with improvement in depression symptom severity. The summary statistics for the features of program usage were as follows: mean number of therapist consultations was 7.04 (SD 3.4), mean number of messages sent to the therapist was 33.2 (SD 46.9), mean number of times core lesson content was accessed was 39.2 (SD 33), mean number of thoughts logged via the thought tracking tool was 13.6 (SD 16.5), and mean number of program-related content cards viewed was 8.35 (SD 12.4).

Table 3. Correlation analysis (Pearson r and 2-tailed P value) among the features of program usage (n=831).
VariableConsultsMessagesLessons openedThoughts loggedContent viewed
Consults

r10.29a0.26a0.26a0.17a

P valueb<.001<.001<.001<.001
Messages

r0.29a10.33a0.43a0.31a

P value<.001<.001<.001<.001
Lessons opened

r0.26a0.33a10.44a0.35a

P value<.001<.001<.001<.001
Thoughts logged

r0.26a0.43a0.44a10.28a

P value<.001<.001<.001<.001
Content viewed

r0.17a0.31a0.35a0.28a1

P value<.001<.001<.001<.001

aThe correlation is significant at a significance level of .05 (2-tailed).

bNot applicable.

Exploratory Weight

We performed additional analyses to explore changes in body weight and diabetes management among participants simultaneously enrolled in the Vida CBT Program and a physical health program.

For body weight, in order to provide adequate time for meaningful clinical change, the analysis was restricted to the 595 participants with overweight or obesity (ie, BMI ≥25) who had been enrolled for at least 6 months and had logged weight at least twice in the period with the latest weight coming at least 2 months after the initial enrollment. Out of these participants, 86.6% (n=515) had a baseline BMI indicative of obesity and 13.4% (n=80) had a baseline BMI indicative of overweight. This population logged a total of 34,469 body weight values. Out of these entries, 83.17% (n=28,667) were logged using a wireless connected scale, and the remainder were entered manually by the participant. The majority of the participants (n=387, 65.0%) had logged their most recent weight in the ninth program month. The most recent weight was logged at least in the eighth program month for 78.8% (n=469) of the participants and at least in the sixth program month for 89.2% (n=531) of them.

To account for heterogeneity in the number and frequency of weight logs among participants, as well as to handle the nested structure of the data (ie, weight observations nested within participants who were nested within providers), a multilevel mixed-effects model was used to evaluate changes in body weight across participants. Fixed factors in the model were time (program month), baseline BMI category (obesity or overweight), and reliable change in depressive symptoms (1 = reliable improvement in PHQ-8 scores; 0 = no reliable improvement). Random factors included participants and providers. We observed a significant effect of program time on percent weight loss (β=–0.37, P<.001). Baseline weight had a small but significant inverse association with weight loss such that higher baseline weight was associated with greater percent weight loss (β=–0.01, P=.002). As shown in Figure 3, reliable improvement in depression symptoms at follow-up was associated with significantly greater weight loss at 9 months (β=–1.11, P=.002).

Figure 3. Estimated marginal means and SEs of average percent weight loss as a function of program month and reliable change in depression symptoms. A value of 1 represents reliable improvement in PHQ-8 scores and 0 represents no reliable improvement. PHQ-8: 8-item Patient Health Questionnaire.
View this figure

Principal Findings

The aim of this retrospective study was to evaluate the therapist-supported, digitally delivered Vida CBT Program for the treatment of moderate depression in an adult population. The treatment cohort of 831 participants with baseline PHQ-8 scores of 10 or greater were enrolled in the digital intervention and provided at least one follow-up assessment 6 to 12 weeks into the program. We observed a significant reduction in depression scores at follow-up (mean –5.9, SD 5.2), with 74.5% of participants shifting downward in symptom severity by at least one diagnostic category. A similar pattern of reduction was observed for anxiety scores among participants who had moderate anxiety (mean –6.1, SD 5.4). Supplementary ITT analysis that included the entire cohort of 1512 participants with baseline data or last-value carryforward showed a slightly attenuated but still significant reduction in PHQ-8 scores at follow-up.

Examining the relationship between program usage and improvement in depression symptoms revealed that participants who more extensively used features across the platform had a modestly greater likelihood of reliable improvement in depression scores at follow-up (OR 1.3, 95% CI 1.1-1.5). This limited dose-response relationship was seen in the context of highly right-skewed usage data overall.

Drawn largely from a medically complex adult population, cardiometabolic conditions, particularly diabetes and obesity, were highly prevalent in this population. Given the very high burden of metabolic disease in this population and the availability of interventions for these conditions on the Vida platform, although the study was not specifically designed for this, we wanted to explore these relationships in order to prepare for future research.

Our preliminary analyses showed significantly greater reduction in body weight among participants who had a reliable improvement in depression symptoms compared to those who did not show symptom improvement at follow-up. As Figure 3 illustrates, this trend was consistent throughout the program tenure and culminated in a mean body weight change of 4.5% (SD 6.3; reliable improvement in PHQ-8 scores) versus 1.5% (SD 6.1; no reliable improvement in PHQ-8 scores) at month 9 of the program.

As with much of the literature, it is impossible to infer causation from these results, but it opens a hypothesis for future research that there may be opportunities for synergy in the treatment of co-occurring mental and metabolic disorders [37,62]. Given the massive and overlapping burden of these diseases in the US population, if such synergy could be realized through efficient, digitally delivered interventions, it would certainly be welcome.

Comparison With Prior Work

The principal finding of improvements in depressive symptoms is consistent with the broader body of research on digitally delivered CBT programs for the treatment of mild to moderate depression and anxiety [9]. This finding reinforces, in a larger population, similar results previously published from the Vida CBT Program [23].

The relationship between program usage and outcomes in digital interventions, broadly, and DMHIs, in particular, remains a rich area of research. While this study was not designed to evaluate this, our results are consistent with several similar studies suggesting a limited dose-response phenomenon. That is, greater usage seems to correlate with improved outcomes but may not do so monotonically, as participants self-regulate their usage to their needs, needs that are difficult for a researcher to observe with any meaningful precision [18,63-66].

Throughout the literature, interrelations among treatments for comorbid mental and physical disorders have been noted before. The direction of causality is unclear and, indeed, may be expected to run in both directions; that is, depression and anxiety may contribute to obesity and diabetes just as much as the reverse is true. In some cases, other factors may be driving both [62,67-69]. Preliminary research in this vein has, like this study, shown some hint of synergistic treatment effects in traditional care settings [70-72].

Limitations

This study had several important limitations. The lack of a control group and the retrospective design prevents drawing any causal inferences. Missing follow-up data was also a challenge, with data unavailable for 45.0% of the overall cohort (Table 1). We attempted to mitigate this limitation with an ITT analysis using baseline data or last-value carryforward as appropriate. While this still showed a significant relationship, the improvement in depression scores was weaker when accounting for those participants.

The gender imbalance across the study cohort was notable, with 83.8% females overall and 86.0% in the treatment group. At the overall level, this is a well-characterized phenomenon of care use, particularly for mental health, in North America and Europe. Despite seemingly comparable prevalence of mental distress by gender, ratios of 2 women for every man seeking care are not unusual in the literature [73,74]. The US National Institute of Mental Health has even sponsored campaigns to address barriers to males seeking mental health care, and there is literature on this phenomenon’s underlying causes [56,75]. In this study, there was also a small but significant increase in the proportion of females in the treatment group. It may have been that whatever phenomenon inhibits males from seeking care, in general, also made males in this study less likely to follow up with treatment and assessment. This and the difference in age between the two groups could represent some self-selection of participants into the treatment group who were more likely to improve. While the ITT analysis attempts to adjust for this, some bias remains a possibility. More broadly, the limited uptake of the Vida intervention by males may limit its generalizability in a larger population.

This study was not specifically designed to investigate changes in body weight and glycemic control as related to improvements in depression and was underpowered to detect a change in HbA1c. Future research is certainly needed to explore these potential relationships. Causality in any such relationship, should it bear out, could take any possible form and would need careful study to dissect.

Conclusions

This study provides further evidence that CBT-based DMHIs can be effective tools in treating symptoms of depression and anxiety. Improvements by whole diagnostic categories were common in this cohort. Usage of the platform correlated with improved outcomes in a pattern consistent with participants self-regulating usage to their individual needs. Furthermore, this was seen in a population with a very high prevalence of co-occurring physical disorders. More research is required to determine if there may be opportunities for synergistic treatment of mental and physical disorders through a similar modality.

Acknowledgments

We are deeply indebted to the hard work of all the therapists, dietitians, and health coaches who supported these participants. We are grateful to Chris Mosunic for helpful comments on the manuscript.

Authors' Contributions

AV and MS conceived and designed the study. MM led the intervention design. AV, PR, and BF acquired, analyzed, and interpreted the data. AV and MS drafted, structured, and edited the manuscript. All authors discussed the results and contributed to the final manuscript.

Conflicts of Interest

All authors are current or former employees of Vida Health and hold share options.

  1. Rehm J, Shield KD. Global burden of disease and the impact of mental and addictive disorders. Curr Psychiatry Rep 2019 Feb 07;21(2):10. [CrossRef] [Medline]
  2. Bromet E, Andrade LH, Hwang I, Sampson NA, Alonso J, de Girolamo G, et al. Cross-national epidemiology of DSM-IV major depressive episode. BMC Med 2011 Jul 26;9:90 [FREE Full text] [CrossRef] [Medline]
  3. Bachmann S. Epidemiology of suicide and the psychiatric perspective. Int J Environ Res Public Health 2018 Jul 06;15(7):1425 [FREE Full text] [CrossRef] [Medline]
  4. Simon GE, VonKorff M, Barlow W. Health care costs of primary care patients with recognized depression. Arch Gen Psychiatry 1995 Oct;52(10):850-856. [CrossRef] [Medline]
  5. Kessler RC. The costs of depression. Psychiatr Clin North Am 2012 Mar;35(1):1-14 [FREE Full text] [CrossRef] [Medline]
  6. Ettman CK, Abdalla SM, Cohen GH, Sampson L, Vivier PM, Galea S. Prevalence of depression symptoms in US adults before and during the COVID-19 pandemic. JAMA Netw Open 2020 Sep 01;3(9):e2019686 [FREE Full text] [CrossRef] [Medline]
  7. Doraiswamy S, Abraham A, Mamtani R, Cheema S. Use of telehealth during the COVID-19 pandemic: Scoping review. J Med Internet Res 2020 Dec 01;22(12):e24087 [FREE Full text] [CrossRef] [Medline]
  8. Firth J, Torous J, Nicholas J, Carney R, Rosenbaum S, Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J Affect Disord 2017 Aug 15;218:15-22 [FREE Full text] [CrossRef] [Medline]
  9. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: A meta-analysis of randomized controlled trials. World Psychiatry 2017 Oct;16(3):287-298 [FREE Full text] [CrossRef] [Medline]
  10. Philippe TJ, Sikder N, Jackson A, Koblanski ME, Liow E, Pilarinos A, et al. Digital health interventions for delivery of mental health care: Systematic and comprehensive meta-review. JMIR Ment Health 2022 May 12;9(5):e35159 [FREE Full text] [CrossRef] [Medline]
  11. Garrido S, Millington C, Cheers D, Boydell K, Schubert E, Meade T, et al. What works and what doesn't work? A systematic review of digital mental health interventions for depression and anxiety in young people. Front Psychiatry 2019;10:759 [FREE Full text] [CrossRef] [Medline]
  12. Jonsson U, Bertilsson G, Allard P, Gyllensvärd H, Söderlund A, Tham A, et al. Psychological treatment of depression in people aged 65 years and over: A systematic review of efficacy, safety, and cost-effectiveness. PLoS One 2016;11(8):e0160859 [FREE Full text] [CrossRef] [Medline]
  13. Luo C, Sanger N, Singhal N, Pattrick K, Shams I, Shahid H, et al. A comparison of electronically-delivered and face to face cognitive behavioural therapies in depressive disorders: A systematic review and meta-analysis. EClinicalMedicine 2020 Jul;24:100442 [FREE Full text] [CrossRef] [Medline]
  14. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs face-to-face cognitive behavior therapy for psychiatric and somatic disorders: An updated systematic review and meta-analysis. Cogn Behav Ther 2018 Jan;47(1):1-18. [CrossRef] [Medline]
  15. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: A meta-analysis. PLoS One 2010 Oct 13;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
  16. Weisel KK, Fuhrmann LM, Berking M, Baumeister H, Cuijpers P, Ebert DD. Standalone smartphone apps for mental health-A systematic review and meta-analysis. NPJ Digit Med 2019;2:118 [FREE Full text] [CrossRef] [Medline]
  17. Health Quality Ontario. Internet-delivered cognitive behavioural therapy for major depression and anxiety disorders: A health technology assessment. Ont Health Technol Assess Ser 2019;19(6):1-199 [FREE Full text] [Medline]
  18. Chien I, Enrique A, Palacios J, Regan T, Keegan D, Carter D, et al. A machine learning approach to understanding patterns of engagement with internet-delivered mental health interventions. JAMA Netw Open 2020 Jul 01;3(7):e2010791 [FREE Full text] [CrossRef] [Medline]
  19. Ng MM, Firth J, Minen M, Torous J. User engagement in mental health apps: A review of measurement, reporting, and validity. Psychiatr Serv 2019 Jul 01;70(7):538-544 [FREE Full text] [CrossRef] [Medline]
  20. O'Brien HL, Toms EG. What is user engagement? A conceptual framework for defining user engagement with technology. J Am Soc Inf Sci Technol 2008 Apr;59(6):938-955. [CrossRef]
  21. Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: A systematic review using principles from critical interpretive synthesis. Transl Behav Med 2017 Jun;7(2):254-267 [FREE Full text] [CrossRef] [Medline]
  22. Torous J, Michalak EE, O'Brien HL. Digital health and engagement-looking behind the measures and methods. JAMA Netw Open 2020 Jul 01;3(7):e2010918 [FREE Full text] [CrossRef] [Medline]
  23. Venkatesan A, Rahimi L, Kaur M, Mosunic C. Digital cognitive behavior therapy intervention for depression and anxiety: Retrospective study. JMIR Ment Health 2020 Aug 26;7(8):e21304 [FREE Full text] [CrossRef] [Medline]
  24. Beck JS. Cognitive Behavior Therapy: Basics and Beyond. 3rd edition. New York, NY: The Guilford Press; 2021.
  25. Kazantzis N, Whittington C, Zelencich L, Kyrios M, Norton PJ, Hofmann SG. Quantity and quality of homework compliance: A meta-analysis of relations with outcome in cognitive behavior therapy. Behav Ther 2016 Sep;47(5):755-772. [CrossRef] [Medline]
  26. Tang W, Kreindler D. Supporting homework compliance in cognitive behavioural therapy: Essential features of mobile apps. JMIR Ment Health 2017 Jun 08;4(2):e20 [FREE Full text] [CrossRef] [Medline]
  27. Aguilera A, Ramos Z, Sistiva D, Wang Y, Alegria M. Homework completion via telephone and in-person cognitive behavioral therapy among Latinos. Cognit Ther Res 2018 Jun;42(3):340-347 [FREE Full text] [Medline]
  28. Callan JA, Dunbar Jacob J, Siegle GJ, Dey A, Thase ME, DeVito Dabbs A, et al. CBT MobileWork©: User-centered development and testing of a mobile mental health application for depression. Cognit Ther Res 2020 Sep 25;45(2):287-302. [CrossRef]
  29. Kazantzis N, Brownfield NR, Mosely L, Usatoff AS, Flighty AJ. Homework in cognitive behavioral therapy: A systematic review of adherence assessment in anxiety and depression (2011-2016). Psychiatr Clin North Am 2017 Dec;40(4):625-639. [CrossRef] [Medline]
  30. Callan JA, Wright J, Siegle GJ, Howland RH, Kepler BB. Use of computer and mobile technologies in the treatment of depression. Arch Psychiatr Nurs 2017 Jun;31(3):311-318. [CrossRef] [Medline]
  31. Atlantis E, Fahey P, Foster J. Collaborative care for comorbid depression and diabetes: A systematic review and meta-analysis. BMJ Open 2014 Apr 12;4(4):e004706 [FREE Full text] [CrossRef] [Medline]
  32. Moussavi S, Chatterji S, Verdes E, Tandon A, Patel V, Ustun B. Depression, chronic diseases, and decrements in health: Results from the World Health Surveys. Lancet 2007 Sep 08;370(9590):851-858. [CrossRef] [Medline]
  33. Lin EHB, Katon W, Von Korff M, Rutter C, Simon GE, Oliver M, et al. Relationship of depression and diabetes self-care, medication adherence, and preventive care. Diabetes Care 2004 Sep;27(9):2154-2160. [CrossRef] [Medline]
  34. Carey M, Small H, Yoong SL, Boyes A, Bisquera A, Sanson-Fisher R. Prevalence of comorbid depression and obesity in general practice: A cross-sectional survey. Br J Gen Pract 2014 Mar;64(620):e122-e127 [FREE Full text] [CrossRef] [Medline]
  35. Markowitz S, Friedman MA, Arent SM. Understanding the relation between obesity and depression: Causal mechanisms and implications for treatment. Clin Psychol 2008 Mar;15(1):1-20. [CrossRef]
  36. Watson KT, Simard JF, Henderson VW, Nutkiewicz L, Lamers F, Nasca C, et al. Incident major depressive disorder predicted by three measures of insulin resistance: A Dutch cohort study. Am J Psychiatry 2021 Oct 01;178(10):914-920. [CrossRef] [Medline]
  37. Schmidt CB, van Loon BJP, Vergouwen ACM, Snoek FJ, Honig A. Systematic review and meta-analysis of psychological interventions in people with diabetes and elevated diabetes-distress. Diabet Med 2018 Jun 13:1157-1172. [CrossRef] [Medline]
  38. Mezuk B, Eaton WW, Albrecht S, Golden SH. Depression and type 2 diabetes over the lifespan: A meta-analysis. Diabetes Care 2008 Dec;31(12):2383-2390 [FREE Full text] [CrossRef] [Medline]
  39. Golden SH, Lazo M, Carnethon M, Bertoni AG, Schreiner PJ, Diez Roux AV, et al. Examining a bidirectional association between depressive symptoms and diabetes. JAMA 2008 Jun 18;299(23):2751-2759 [FREE Full text] [CrossRef] [Medline]
  40. Aarts S, van den Akker M, van Boxtel MPJ, Jolles J, Winkens B, Metsemakers JFM. Diabetes mellitus type II as a risk factor for depression: A lower than expected risk in a general practice setting. Eur J Epidemiol 2009;24(10):641-648 [FREE Full text] [CrossRef] [Medline]
  41. Wang E, Zweig M. A defining moment for digital behavioral health: Four market trends. Rock Health. 2021 Mar 15.   URL: https://rockhealth.com/insights/a-defining-moment-for-digital-behavioral-health-four-market-trends/ [accessed 2021-11-03]
  42. Cuijpers P, Marks IM, van Straten A, Cavanagh K, Gega L, Andersson G. Computer-aided psychotherapy for anxiety disorders: A meta-analytic review. Cogn Behav Ther 2009;38(2):66-82. [CrossRef] [Medline]
  43. Ebert DD, Zarski A, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: A meta-analysis of randomized controlled outcome trials. PLoS One 2015;10(3):e0119895 [FREE Full text] [CrossRef] [Medline]
  44. Richards D, Richardson T. Computer-based psychological treatments for depression: A systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342. [CrossRef] [Medline]
  45. Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: Systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res 2018 Jun 06;20(6):e199 [FREE Full text] [CrossRef] [Medline]
  46. Silberman JM, Kaur M, Sletteland J, Venkatesan A. Outcomes in a digital weight management intervention with one-on-one health coaching. PLoS One 2020;15(4):e0232221 [FREE Full text] [CrossRef] [Medline]
  47. Zimmermann G, Venkatesan A, Rawlings K, Scahill MD. Improved glycemic control with a digital health intervention in adults with type 2 diabetes: Retrospective study. JMIR Diabetes 2021 Jun 02;6(2):e28033 [FREE Full text] [CrossRef] [Medline]
  48. Fenn K, Byrne M. The key principles of cognitive behavioural therapy. InnovAiT 2013 Sep 06;6(9):579-585. [CrossRef]
  49. Copeland ME. Wellness Recovery Action Plan. Updated edition. Sudbury, MA: Human Potential Press, Advocates for Human Potential, Inc; 2018:1-144.
  50. Miller WR, Rollnick S. Motivational Interviewing: Helping People Change. 3rd edition. New York, NY: The Guilford Press; 2012.
  51. Hood KK, Hilliard M, Piatt G, Ievers-Landis CE. Effective strategies for encouraging behavior change in people with diabetes. Diabetes Manag (Lond) 2015;5(6):499-510 [FREE Full text] [Medline]
  52. Cameron AC, Miller DL. A practitioner’s guide to cluster-robust inference. J Hum Resour 2015 Apr 28;50(2):317-372. [CrossRef]
  53. Guhn M, Forer B, Zumbo BD. Reliable change index. In: Michalos AC, editor. Encyclopedia of Quality of Life and Well-Being Research. Dordrecht, the Netherlands: Springer; 2014:5459-5462.
  54. Hastings C, Mosteller F, Tukey JW, Winsor CP. Low moments for small samples: A comparative study of order statistics. Ann Math Stat 1947 Sep;18(3):413-426. [CrossRef]
  55. Sagar-Ouriaghli I, Godfrey E, Bridge L, Meade L, Brown JSL. Improving mental health service utilization among men: A systematic review and synthesis of behavior change techniques within interventions targeting help-seeking. Am J Mens Health 2019;13(3):1-18 [FREE Full text] [CrossRef] [Medline]
  56. Addis ME, Mahalik JR. Men, masculinity, and the contexts of help seeking. Am Psychol 2003 Jan;58(1):5-14. [CrossRef] [Medline]
  57. Wang PS, Lane M, Olfson M, Pincus HA, Wells KB, Kessler RC. Twelve-month use of mental health services in the United States: Results from the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005 Jun;62(6):629-640. [CrossRef] [Medline]
  58. Deming WE. An essay on screening, or on two-phase sampling, applied to surveys of a community. Int Stat Rev 1977 Apr;45(1):29. [CrossRef]
  59. Vaughan R. Oversampling in health surveys: Why, when, and how? Am J Public Health 2017 Aug;107(8):1214-1215. [CrossRef] [Medline]
  60. Laird NM, Ware JH. Random-effects models for longitudinal data. Biometrics 1982 Dec;38(4):963-974. [Medline]
  61. Centers for Disease Control and Prevention. 2021 Jun 17.   URL: https://www.cdc.gov/obesity/adult/defining.html [accessed 2022-03-03]
  62. Renn BN, Feliciano L, Segal DL. The bidirectional relationship of depression and diabetes: A systematic review. Clin Psychol Rev 2011 Dec;31(8):1239-1246. [CrossRef] [Medline]
  63. Oser M, Wallace ML, Solano F, Szigethy EM. Guided digital cognitive behavioral program for anxiety in primary care: Propensity-matched controlled trial. JMIR Ment Health 2019 Apr 04;6(4):e11981 [FREE Full text] [CrossRef] [Medline]
  64. Donkin L, Hickie IB, Christensen H, Naismith SL, Neal B, Cockayne NL, et al. Rethinking the dose-response relationship between usage and outcome in an online intervention for depression: Randomized controlled trial. J Med Internet Res 2013 Oct 17;15(10):e231 [FREE Full text] [CrossRef] [Medline]
  65. Saul JE, Amato MS, Cha S, Graham AL. Engagement and attrition in internet smoking cessation interventions: Insights from a cross-sectional survey of "one-hit-wonders". Internet Interv 2016 Sep;5:23-29 [FREE Full text] [CrossRef] [Medline]
  66. Ainsworth B, Steele M, Stuart B, Joseph J, Miller S, Morrison L, et al. Using an analysis of behavior change to inform effective digital intervention design: How did the PRIMIT website change hand hygiene behavior across 8993 users? Ann Behav Med 2017 Jun;51(3):423-431 [FREE Full text] [CrossRef] [Medline]
  67. Pouwer F, Schram MT, Iversen MM, Nouwen A, Holt RIG. How 25 years of psychosocial research has contributed to a better understanding of the links between depression and diabetes. Diabet Med 2020 Mar;37(3):383-392. [CrossRef] [Medline]
  68. Nouwen A, Adriaanse MC, van Dam K, Iversen MM, Viechtbauer W, Peyrot M, European Depression in Diabetes (EDID) Research Consortium. Longitudinal associations between depression and diabetes complications: A systematic review and meta-analysis. Diabet Med 2019 Dec;36(12):1562-1572. [CrossRef] [Medline]
  69. Harding KA, Pushpanathan ME, Whitworth SR, Nanthakumar S, Bucks RS, Skinner TC. Depression prevalence in type 2 diabetes is not related to diabetes-depression symptom overlap but is related to symptom dimensions within patient self-report measures: A meta-analysis. Diabet Med 2019 Dec;36(12):1600-1611. [CrossRef] [Medline]
  70. Lutes LD, Cummings DM, Littlewood K, Solar C, Carraway M, Kirian K, et al. COMRADE: A randomized trial of an individually tailored integrated care intervention for uncontrolled type 2 diabetes with depression and/or distress in the rural southeastern US. Contemp Clin Trials 2018 Jul;70:8-14. [CrossRef] [Medline]
  71. Goldstein LA, Mehling WE, Metzler TJ, Cohen BE, Barnes DE, Choucroun GJ, et al. Veterans group exercise: A randomized pilot trial of an integrative exercise program for veterans with posttraumatic stress. J Affect Disord 2018 Feb;227:345-352. [CrossRef] [Medline]
  72. Brieler JA, Lustman PJ, Scherrer JF, Salas J, Schneider FD. Antidepressant medication use and glycaemic control in co-morbid type 2 diabetes and depression. Fam Pract 2016 Feb;33(1):30-36. [CrossRef] [Medline]
  73. Kessler RC, Demler O, Frank RG, Olfson M, Pincus HA, Walters EE, et al. Prevalence and treatment of mental disorders, 1990 to 2003. N Engl J Med 2005 Jun 16;352(24):2515-2523 [FREE Full text] [CrossRef] [Medline]
  74. Galdas PM, Cheater F, Marshall P. Men and health help-seeking behaviour: Literature review. J Adv Nurs 2005 Mar;49(6):616-623. [CrossRef] [Medline]
  75. Rochlen AB, McKelley RA, Pituch KA. A preliminary examination of the "Real Men. Real Depression" campaign. Psychol Men Masc 2006 Jan;7(1):1-13. [CrossRef]


CBT: cognitive behavioral therapy
DMHI: digital mental health intervention
GAD-7: 7-item Generalized Anxiety Disorder scale
HbA1c: hemoglobin A1c
ITT: intention-to-treat
OR: odds ratio
PHQ-8: 8-item Patient Health Questionnaire
RCI: reliable change index


Edited by A Mavragani; submitted 15.03.22; peer-reviewed by R Pine, A Joseph, A Tannoubi; comments to author 09.05.22; revised version received 27.05.22; accepted 08.06.22; published 05.07.22

Copyright

©Aarathi Venkatesan, Benjamin Forster, Prasanna Rao, Melissa Miller, Michael Scahill. Originally published in JMIR Formative Research (https://formative.jmir.org), 05.07.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.