Original Paper
Abstract
Background: Anxiety disorders and depression are prevalent disorders with high comorbidity, leading to greater chronicity and severity of symptoms. Given the accessibility to treatment issues, more evaluation is needed to assess the potential benefits of fully automated self-help transdiagnostic digital interventions. Innovating beyond the current transdiagnostic one-size-fits-all shared mechanistic approach may also lead to further improvements.
Objective: The primary objective of this study was to explore the preliminary effectiveness and acceptability of a new fully automated self-help biopsychosocial transdiagnostic digital intervention (Life Flex) aimed at treating anxiety and/or depression, as well as improving emotional regulation; emotional, social, and psychological well-being; optimism; and health-related quality of life.
Methods: This was a real-world pre-during-post-follow-up feasibility trial design evaluation of Life Flex. Participants were assessed at the preintervention time point (week 0), during intervention (weeks 3 and 5), at the postintervention time point (week 8), and at 1- and 3-month follow-ups (weeks 12 and 20, respectively).
Results: The results provided early support for the Life Flex program in reducing anxiety (Generalized Anxiety Disorder 7), depression (Patient Health Questionnaire 9), psychological distress (Kessler 6), and emotional dysregulation (Difficulties in Emotional Regulation 36) and increasing emotional, social, and psychological well-being (Mental Health Continuum—Short Form); optimism (Revised Life Orientation Test); and health-related quality of life (EQ-5D-3L Utility Index and Health Rating; all false discovery rate [FDR]<.001). Large within-group treatment effect sizes (range |d|=0.82 to 1.33) were found for most variables from pre- to postintervention assessments and at the 1- and 3-month follow-up. The exceptions were medium treatment effect sizes for EQ-5D-3L Utility Index (range Cohen d=−0.50 to −0.63) and optimism (range Cohen d=−0.72 to −0.79) and small-to-medium treatment effect size change for EQ-5D-3L Health Rating (range Cohen d=−0.34 to −0.58). Changes across all outcome variables were generally strongest for participants with preintervention clinical comorbid anxiety and depression presentations (range |d|=0.58 to 2.01) and weakest for participants presenting with nonclinical anxiety and/or depressive symptoms (|d|=0.05 to 0.84). Life Flex was rated as acceptable at the postintervention time point, and participants indicated that they enjoyed the transdiagnostic program and biological, wellness, and lifestyle-focused content and strategies.
Conclusions: Given the paucity of evidence on fully automated self-help transdiagnostic digital interventions for anxiety and/or depressive symptomatology and general treatment accessibility issues, this study provides preliminary support for biopsychosocial transdiagnostic interventions, such as Life Flex, as a promising future mental health service delivery gap filler. Following large-scale, randomized controlled trials, the potential benefits of fully automated self-help digital health programs, such as Life Flex, could be considerable.
Trial Registration: Australian and New Zealand Clinical Trials Registry ACTRN12615000480583; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=368007
doi:10.2196/43385
Keywords
Introduction
Background
Anxiety disorders (ADs) and depression are highly prevalent emotional disorders [
] that cause considerable disability and societal costs [ , ], with <50% of people experiencing these disorders accessing support [ , ]. Comorbidity rates are high within ADs and between ADs and depression (ranging between 40% and 80%) [ ]. Furthermore, comorbidities are associated with greater chronicity, severity, and a more complicated clinical course [ - ].Frontline treatments for ADs and/or depression include face-to-face psychological therapy, pharmacotherapy, or a combination of these. A large body of evidence demonstrates that anxiety and depression can be effectively treated using cognitive behavioral therapy (CBT). Meta-analytic studies indicate that face-to-face CBT yields uncontrolled effect sizes of around 0.90 for various ADs [
] and 0.82 for depression [ ].Research also suggests that ADs and depression have the same underlying transdiagnostic structure, described by the internalizing-externalizing model [
], that informs treatment. A large amount of growing evidence indicates that transdiagnostic treatments (treatments that simultaneously treat more than one disorder, such as ADs and depression) are effective. For example, a recent meta-analytic study found similar effects for disorder-specific interventions (Cohen d=0.95) and transdiagnostic interventions (Hedges g=1.06) on anxiety measures [ ].To date, transdiagnostic programs for ADs and/or depression have largely used either a more traditional CBT framework or the Unified Treatment Protocol (UP) for the emotional disorders [
- ]. Transdiagnostic programs are also characterized as being either theory based (one size fits all) or tailored (individualizing a treatment to a specific person based on their unique comorbidities). The defining feature of theory-based transdiagnostic treatments (sometimes called shared mechanistic transdiagnostic interventions) is that they are developed to target the common processes (or mechanisms) that underlie the development and maintenance of emotional disorders [ ]. The main foci of transdiagnostic CBT interventions are on changing psychopathological cognition and behaviors, and the UP additionally considers the role of negative emotions (teaching people to become more aware of, and better regulate, their negative emotions) when treating anxiety and depression.Although disorder-specific CBT and transdiagnostic interventions have traditionally been delivered face-to-face, they have also been administered on the web. Given treatment barriers, such as cost, stigma, long waitlists, travel or convenience, and preference for self–management-oriented delivery models of care, digitally based mental health interventions have provided greater treatment choices [
] and are a cost-effective alternative [ ] to disorder-specific and transdiagnostic treatments delivered face-to-face. Digital translations of largely single-disorder–focused CBT-based psychological treatments have been established as an effective alternative to face-to-face delivery [ , ]. For example, a meta-analytic study by Andrews et al [ ] on web-based interventions for depression or one of the ADs yielded a controlled effect size of 0.88. Furthermore, a recent meta-analytic study found that therapist-assisted transdiagnostic digital treatments for anxiety and depression yielded uncontrolled effect sizes of 0.96 for both depression and anxiety outcomes [ ].However, the bulk of transdiagnostic digital interventions evaluated to date have involved some kind of therapist support and/or researcher contact (eg, to conduct clinical assessments). Although the inclusion of a therapist (or researcher contact) has been found to increase adherence to digital intervention programs, it is also more costly to operate and far less scalable [
]. Given the high prevalence and associated disability of ADs and/or depression and the limited resources available to treat every person with such disorders, evaluating the effectiveness and acceptability of fully automated self-help transdiagnostic digital interventions is timely.At present, there appears to be four key areas to explore further when it comes to digital transdiagnostic programs: (1) testing fully automated self-help transdiagnostic versions, (2) testing transdiagnostic comorbidity effects, (3) testing transdiagnostic preventative effects, and (4) exploring the expansion of current transdiagnostic intervention content based on scientific advancements.
First, to date, almost no studies have investigated the potential effectiveness of a fully automated self-help transdiagnostic digital intervention for anxiety and/or depression symptoms (ie, those with no direct contact with a therapist and/or researcher). The only published study found was by Batterham et al [
], which evaluated their FitMindKit video-based CBT transdiagnostic web-based program. Significant effects were found on depressive, panic, and/or anxiety symptoms relative to an attention control condition from pre- to postintervention periods (over 4 weeks). However, although the Batterham et al [ ] trial was a large (N=1986) and robust study including the attention control condition, there was no follow-up assessment following the postintervention assessment.Second, although there have been dozens of studies evaluating transdiagnostic digital interventions, their impact on improving comorbidity symptoms has received far less examination [
, ]. For example, FitMindKit evaluation by Batterham et al [ ] was one of many transdiagnostic studies that did not directly assess any comorbidity intervention outcome effects. Given that the core function of a transdiagnostic program is to simultaneously treat different disorders, investigating comorbidity intervention effects, where possible, is much needed.Third, in relation to the potential preventative effects of transdiagnostic interventions, people with nonclinical subthreshold anxiety and/or depressive symptom levels are typically left untreated despite the experience of some impairment, distress, and potential worsening of symptoms [
]. Given the risk that these people can have in developing a clinical form of emotional disorders, offering people early intervention via transdiagnostic treatment protocols (especially via self-help formats) could be of benefit by acting as an indicated prevention activity and therefore should be explored further [ , ]. To date, 1 group [ ] has reported on the preventative effects of a transdiagnostic digital program (with therapist assistance) on adolescents (N=30). Schmitt et al [ ] found that symptoms of self-reported anxiety and depression, clinician-rated symptom severity, and self-reported and parent-reported severity of the main problems had significantly improved over time; however, further investigation was required.Fourth, in reference to expanding transdiagnostic program offerings, although UP considers cognitive, behavioral, and emotional mechanisms to underlie emotional disorders, it does not include teachings around increasing positive affect (rather it focuses on reducing negative affect or deficits). To date, 1 group [
] has extended their CBT+Emotional Regulation transdiagnostic digital program by adding content and strategies to specifically enhance positive affect. When comparing their transdiagnostic intervention plus positive affect–based modules to a version without the positive affect modules, they found consistently larger treatment effect sizes for the transdiagnostic intervention plus a positive affect module extension program relative to their standard transdiagnostic protocol (although no significant difference was found between the 2 conditions).Furthermore, given the recent theory formulation and evidence around the links between chronic stress and the development and maintenance of anxiety and/or depression [
, ], it may prove beneficial to include coverage around allostasis (the biological mechanism behind the deactivation of the stress response) [ , ]; heart rate variability (a psychophysiological marker of mental and physical well-being) [ , ]; and allostatic load (being the regular activation of the stress response and/or not managing the deactivation of the stress response, which can lead to poor psychological and physical ill health effects because of stress response activation wear and tear on the body) [ , , ].Nonpharmacological biologically focused interventions (ie, lifestyle-based interventions that work on enabling brain plasticity; increase heart rate variability; and decrease allostatic load, such as increasing physical activity, brain and gut nutrition, mindfulness, and sleep hygiene) are showing promise in reducing anxiety and depressive symptoms [
, - ] and could serve as an adjuvant therapy to more traditional CBT and UP strategies (eg, breathing control, progressive muscle relaxation, cognitive appraisal, acceptance techniques, and emotional regulation strategies). Consideration could also be given to explaining the concept of brain or neural plasticity [ - ] within the transdiagnostic intervention. This concept can offer a more concrete explanation of the possibility of change (biologically, cognitively, emotionally, and behaviorally) and how such changes occur.Objective
The primary aim of this study was to explore the feasibility of a new fully automated self-help biopsychosocial transdiagnostic digital intervention (Life Flex), which aims to treat anxiety and/or depression, as well as improve emotional regulation; emotional, social, and psychological well-being; optimism; and health-related quality of life by measuring possible intervention outcome changes over time. The secondary aim of this study was to consider any potential comorbidity and preventative intervention effects of the Life Flex program, and the third aim was to explore participants’ quantitative and qualitative responses around the acceptability of the Life Flex intervention, including the expansion of the biologically focused and positive affect content.
Our primary exploratory questions were as follows: (1) Do participants show significant decreases in measures of anxiety and depression (primary outcomes) from preintervention to postintervention and at the 1- and 3-month follow-up assessments? (2) Do participants show improvements in emotional regulation; psychological distress; emotional, social, and psychological well-being; optimism; and health-related quality of life from preintervention to postintervention and at the 1- and 3-month follow-up assessments? And (3) Do participants rate the Life Flex program as acceptable?
Methods
Participants
Participants were recruited via health websites. Inclusion criteria were that the participants must be aged ≥18 years, have interest in undertaking a mental health digital intervention focused on anxiety and/or depressive symptoms, have internet access, and provide web-based informed consent. Of the 347 initial registrations, 79 (22.8%) participants did not complete the preassessment questionnaires (n=64, 81% signed up and did not return to complete the preassessment questionnaires; and n=15, 19% of participants started the preassessment questionnaires but did not complete it), leaving 268 (77.2%) study participants. However, 27 (10.1%) of the 268 participants were later removed, as they self-identified as being nongenuine program participants (eg, health care practitioners interested in the program for their patients and IT developers wanting to see the program). The final sample consisted of 241 adults. Following the completion of the digital preintervention assessment questionnaires, participants were immediately given access to the Life Flex digital health program.
Design
Life Flex was tested using a pre-during-post-follow-up single-arm feasibility trial design. Data were collected at week 0 (preintervention period), weeks 3 and 5 of the intervention (during intervention assessments), the postintervention period (week 8), and 1-month (week 12) and 3-month (week 20) follow-ups. This study reported the outcome data collected at all time points.
Ethics Approval
This study was approved by the Federation University Human Research Ethics Committee (approval A15-005) and was preregistered with the Australian and New Zealand Clinical Trials Registry (ACTRN12615000480583). All participants gave their consent to participate in the study by reading a Plain Language Information Statement on the web and clicking a checkbox stating that “I have read the Plain Language Information Statement and I agree to the above conditions.” All data were deidentified before analysis.
Intervention
Life Flex was specifically designed to provide people with information and strategies to address their anxiety and/or depressive symptoms and contains 6 core modules, plus an Introduction module delivered over 7 weeks. Each module takes approximately 25 minutes to complete. In addition, to reinforce the module-based information, there are 20 to 30 minutes of offline activities each week. Offline activities include applying the concepts and techniques discussed in the modules such as self-monitoring depressive and anxiety symptoms, undertaking one of the increasing biological and wellness flexibility intervention strategies, monitoring emotions and thoughts, and undertaking a gradual exposure or behavioral activation activity. Participants also received various automated emails (eg, to remind them to log on and when to complete the intervention assessments). Modules include text, graphics, audio, video, editable forms, interactive quizzes and games (eg, brain training), and downloads. The intervention is accessible via web, mobile, or tablet devices, and module release used a stage-release design (sequential release of each module following the completion of the previous one). Participants could continue to use the Life Flex program outside of scheduled assessments over a 20-week period. A summary of these modules is provided in
.Measures
Outcome Measures
Web-based questionnaires were scheduled at the preintervention time point (week 0), postintervention time point (week 8), and 1-month (week 12) and 3-month (week 20) follow-ups, except for the Generalized Anxiety Disorder 7 (GAD-7) and Patient Health Questionnaire 9 (PHQ-9), which were also administered during the intervention (weeks 3 and 5).
Exploration of Preliminary Effectiveness
Primary Outcome Measures
The GAD-7 [
] is a 7-item scale, with scores ranging from 0 to 21, and is used to measure generalized anxiety, with higher scores reflecting higher anxiety, using a clinical cutoff of 8. The PHQ-9 [ ] is a 9-item scale, with scores ranging from 0 to 27, and is used to measure depression, with higher scores reflecting higher depressive symptoms, with a clinical cutoff of 10.Secondary Outcome Measures
The Kessler 6 (K-6) [
] is a 6-item scale, with scores ranging from 10 to 30, and is used to measure psychological distress, with higher scores reflecting higher distress, with scores between 10 and 15 categorized as “Likely to be well.” The Difficulties in Emotional Regulation 36 (DERS-36) [ ] is a 36-item scale, with scores ranging from 36 to 180, and is used to measure emotional regulation, with higher scores reflecting greater levels of dysregulation. The Mental Health Continuum—Short Form (MHC-SF) [ ] is a 14-item scale, with scores ranging from 0 to 70, and is used to measure emotional, social, and psychological well-being, with higher scores reflecting greater well-being. The Revised Life Orientation Test (R-LOT) [ ] is a 10-item scale, with scores ranging from 0 to 24, and is used to measure optimism, with higher scores reflecting higher optimism. The EQ-5D-3L [ ] is a 5-item scale, with scores converted to a utility index score (EQ-5D-3L Utility Index), and is used to measure quality of life, with lower utility index scores reflecting poorer quality of life. The sixth question asks the person to rate their current health state (EQ-5D-3L Health Rating) from 0 to 100, with higher ratings reflecting greater health.Acceptability
The Treatment Acceptability and Satisfaction Questionnaire (TAS-Q; self-developed) was used to measure participants’ satisfaction with the intervention at the postintervention time point. Eight single-item multiple-choice questions were asked regarding program acceptability and credibility (eg, How would you rate the quality of the Life Flex program?) and satisfaction (eg, In an overall, general sense, how satisfied are you with the Life Flex program?). Each item used a 4-point (eg, Yes, definitely; Yes, generally; No, not really; and No, definitely not) or 5-point (Very satisfied, Satisfied, Neutral, Dissatisfied, and Very dissatisfied; or Very Poor, Poor, Fair, Good, and Excellent) Likert scale. There were also open-text response questions asking participants what they believed were the best and worst parts of the Life Flex digital health program.
In addition, a 7-item Treatment Expectancy and Credibility/Acceptability Scale [
] was administered at the preintervention time point, with a total score ranging from 0 to 70 and higher scores indicating higher intervention expectancy and credibility and acceptability. A range of single-item questions were asked to gather participant characteristics, for example, age, gender, income, sexual orientation, alcohol and drug use, current panic disorder, social AD, specific phobia, posttraumatic stress disorder, and obsessive-compulsive disorder symptoms.Statistical Analysis
Overview
shows the missing data patterns across the intervention program timeline. Given the considerable missing data pattern, we opted not to use multiple imputations. However, our available data suggest that they would represent the entire sample of the study (Sensitivity Analysis section).
Exploration of Preliminary Intervention Effects
All analyses were performed using Stata (version 17; StataCorp) and SPSS (version 29; IBM Corp). Categorical data were presented as numeric and percentage forms, and continuous data were presented as mean (SD) where relevant. Independent 2-tailed t tests and chi-square tests (
) were used to compare the mean difference between the groups (complete data set vs missing data set grouping). ANOVAs ( ) were used to compare the mean difference between preintervention clinical diagnostic presentation subgroups (anxiety, depression, comorbid, and nonclinical) on the baseline outcome measures. Categorical variables related to sociodemographic characteristics ( ) across preintervention clinical diagnostic presentation subgroups were compared by using ANOVAs and chi-square tests.Treatment effects from preintervention to during, postintervention, and follow-up assessments were evaluated using Mann-Kendall trend statistics. Cohen d [
] classification scheme (small effect=0.2, medium effect=0.5, and large effect=0.8) was applied to index and interpret the standardized difference size. We adjusted for multiple testing using the false discovery rate (FDR). Here, findings with FDR<.05 were considered statistically significant. We used FDR, as our study design was explorative in nature and significant results may provide useful recommendations for future research [ - ]. Bonferroni-based adjustments are problematic in terms of irrelevant null hypothesis and increased type II error [ ].Diagnostic Presentation Subgroupings
Participants were categorized using the clinical disorder cutoff scores from the GAD-7 and PHQ-9. Participants scoring ≥8 on the GAD-7 and ≥10 on the PHQ-9 were categorized as having clinical comorbid anxiety and depression; those with a GAD-7 score of ≥8 but a PHQ-9 score <10 were categorized as having clinical anxiety only; those with a PHQ-9 score of ≥10 but a GAD-7 score <8 were categorized as having clinical depression only; and those with scores <8 on the GAD-7 and <10 on the PHQ-9 were categorized as nonclinical anxiety and/or depression. On classification, we continued to assess treatment effects from preintervention to during, postintervention, and follow-up assessments by subgroups using Cohen d metrics.
Sensitivity Analysis
Given that imputation for missing data was not performed, the sensitivity analysis was conducted indirectly by testing whether completer and missing data differed in terms of clinical characteristics and demographics. As there was no significant difference in demographics between the 2 subsets of data (
), the completer data therefore appear to adequately represent the planned sample. However, in future research, when large numbers of later time points are reached, we suggest undertaking multiple imputation using chained equations and then compare completer data and data after multiple imputation using chained equations to validate the findings.Power Analysis
The required target sample size was determined using G*Power [
]. Conservatively, assuming a small-medium effect (ie, G*Power F test=0.25), the significance set at 5% (P=.05), and the power at 80%, a minimum sample of 83 was required to demonstrate statistical significance on the primary outcome measures. This number included a 50% attrition rate. However, although our initial scheduled assessment number (n=241) for preintervention assessment was much higher than required, participant completion of all the subsequent 5 scheduled assessments following preintervention assessment did not reach 83. Future research when investigating the effectiveness of a fully automated self-help version of Life Flex should bear this in mind when calculating power.Attrition
In terms of attrition, 9.1% (22/241) of the participants failed to access the program modules. In terms of scheduled assessment completions, 58.1% (140/241) of the participants failed to complete at least 1 scheduled assessment following the preintervention assessment.
shows the participant flow through the trial.Results
Participant Characteristics
The average age was 43.1 (SD 13.2; range 18-79) years. Of the 241 participants involved in this study, most were female (n=156, 64.7%), were born (n=188, 78%) and residing (n=231, 95.9%) in Australia, were heterosexual (n=201, 83.4%), had obtained a bachelor’s degree (n=105, 43.6%) or higher, had a GAD-7 score≥8 (n=162, 67.2%) and PHQ-9 score≥10 (n=158, 65.6%), and had never used illicit drugs (n=163, 67.6%). Almost half of the participants (117/241, 48.5%) took psychotropic medication, whereas most (153/241, 63.5%) accessed physical health services and less than half (98/241, 40.7%) accessed mental health services in the last 4 weeks.
provides the trial study participant characteristics. Participant characteristics and intervention outcomes at baseline by clinical diagnostic presentation subgroups are presented in and , respectively.Preliminary Intervention Outcome Effects
and display the results of the outcome measures across the scheduled assessment time points, and shows a visual representation of these results. Here, all 8 outcome variables showed an overall significant mean change at every assessment time point relative to their preintervention mean (FDRs remained constant compared with P values). The 2 primary outcome measures (GAD-7 and PHQ-9) changed from preintervention time point relative to each subsequent scheduled assessment, demonstrating a large treatment effect size change from week 5 for GAD-7 and week 8 for PHQ-9 onward (ranging from Cohen d=0.84 to 1.33). The secondary measures of psychological distress (K-6); emotional regulation (DERS-36); and emotional, social, and psychological well-being (MHC-SF) also showed mean changes over time, with postintervention assessment and both follow-ups (1 and 3 months) demonstrating a large treatment effect size change (ranging from |d|=0.82 to 1.18). The remaining secondary measures, R-LOT and quality of life (EQ-5D-3L Utility Index and Health Rating), displayed small-to-medium treatment effect size changes, ranging from Cohen d=−0.34 to −0.79, as well as one large treatment effect size change on the R-LOT at 1 month follow-up (Cohen d=−0.90).
Preintervention time point: week 0 (n=241), mean (SD) | During the intervention | Postintervention time point: week 8 (n=58-61), mean (SD) | 1-month follow-up: week 12 (n=41), mean (SD) | 3-month follow-up: week 20 (n=34-35), mean (SD) | |||||
Week 3 (n=66), mean (SD) | Week 5 (n=44), mean (SD) | ||||||||
GAD-7a | 11.51 (5.68) | 8.41 (4.84) | 6.43 (3.98) | 5.66 (5.01) | 6.15 (5.06) | 5.17 (4.87) | |||
PHQ-9b | 12.94 (6.81) | 9.61 (6.42) | 8.55 (5.50) | 6.68 (6.58) | 7.27 (6.47) | 6.88 (6.17) | |||
Kessler 6 | 16.88 (5.92) | N/Ac | N/A | 12.08 (5.48) | 11.68 (5.04) | 11.00 (5.02) | |||
DERS-36d | 103.08 (25.17) | N/A | N/A | 81.37 (29.44) | 77.98 (28.53) | 73.41 (25.54) | |||
MHC-SFe | 30.61 (14.10) | N/A | N/A | 43.80 (17.24) | 45.17 (16.91) | 42.82 (17.16) | |||
R-LOTf | 11.40 (5.04) | N/A | N/A | 15.15 (5.87) | 16.00 (5.47) | 15.38 (5.03) | |||
EQ-5D-3L Utility Index | 0.70 (0.20) | N/A | N/A | 0.82 (0.20) | 0.82 (0.16) | 0.80 (0.20) | |||
EQ-5D-3L Health Rating | 62.02 (20.31) | N/A | N/A | 73.67 (19.94) | 69.15 (24.80) | 73.26 (19.47) |
aGAD-7: Generalized Anxiety Disorder 7.
bPHQ-9: Patient Health Questionnaire 9.
cN/A: not applicable.
dDERS-36: Difficulties in Emotional Regulation 36.
eMHC-SF: Mental Health Continuum—Short Form.
fR-LOT: Revised Life Orientation Test.
Week 0 vs 3, Cohen d (95% CI) | Week 0 vs 5, Cohen d (95% CI) | Week 0 vs 8, Cohen d (95% CI) | Week 0 vs 12, Cohen d (95% CI) | Week 0 vs 20, Cohen d (95% CI) | P valuea | FDRb | |
GAD-7c | 0.56 (0.29 to 0.84) | 0.93 (0.60 to 1.26) | 1.05 (0.76 to 1.35) | 0.96 (0.62 to 1.30) | 1.33 (0.77 to 1.50) | <.001 | <.001 |
PHQ-9d | 0.50 (0.22 to 0.77) | 0.66 (0.34 to 0.99) | 0.93 (0.63 to 1.22) | 0.84 (0.50 to 1.18) | 0.90 (0.53 to 1.27) | <.001 | <.001 |
Kessler 6 | N/Ae | N/A | 0.82 (0.53 to 1.11) | 0.90 (0.56 to 1.23) | 1.01 (0.64 to 1.38) | <.001 | <.001 |
DERS-36f | N/A | N/A | 0.83 (0.54 to 1.12) | 0.98 (0.64 to 1.32) | 1.18 (0.80 to 1.55) | <.001 | <.001 |
MHC-SFg | N/A | N/A | −0.89 (−1.18 to −0.60) | −1.00 (−1.34 to −0.66) | −0.84 (−1.21 to −0.48) | <.001 | <.001 |
R-LOTh | N/A | N/A | −0.72 (−1.01 to −0.43) | −0.90 (−1.24 to −0.56) | −0.79 (−1.16 to −0.43) | <.001 | <.001 |
EQ-5D-3L Utility Index | N/A | N/A | −0.58 (−0.78 to −0.29) | −0.63 (−0.96 to −0.29) | −0.50 (−0.87 to −0.14) | <.001 | <.001 |
EQ-5D-3L Health Rating | N/A | N/A | −0.58 (−0.87 to −0.29) | −0.34 (−0.67 to −0.01) | −0.56 (−0.92 to −0.19) | <.001 | <.001 |
aP value was based on Mann-Kendall test.
bFDR: false recovery rate.
cGAD-7: Generalized Anxiety Disorder 7.
dPHQ-9: Patient Health Questionnaire 9.
eN/A: not applicable.
fDERS-36: Difficulties in Emotional Regulation 36.
gMHC-SF: Mental Health Continuum—Short Form.
hR-LOT: Revised Life Orientation Test.
Preliminary Comorbidity and Prevention Intervention Outcome Effects
, and , and display the results of the outcome measures across the scheduled assessment time points when categorizing the participants by their preintervention clinical diagnostic presentation (clinical anxiety only, clinical depression only, clinical comorbid anxiety and depression, and nonclinical anxiety and/or depression) to examine both the comorbidity and preventative intervention effects of Life Flex. The results indicated that even after adjusting for multiple tests, Life Flex produced significant changes for all measures for 2 subgroups, anxiety only (GAD-7, FDR<.001; PHQ-9, FDR<.001; K-6, FDR<.001; DERS-36, FDR=.004; MHC-SF, FDR=.01; R-LOT, FDR<.001; EQ-5D-3L Utility Index, FDR=.02; and EQ-5D-3L Health Rating, FDR=.04) and comorbid anxiety and depression (GAD-7, FDR<.001; PHQ-9, FDR<.001; K-6, FDR<.001; DERS-36, FDR<.001; MHC-SF, FDR<.001; R-LOT, FDR<.001; EQ-5D-3L Utility Index, FDR<.001; and EQ-5D-3L Health Rating, FDR<.001). The depression-only group showed significant changes in 4 measures, GAD-7 (FDR=.02), PHQ-9 (FDR<.002), K-6 (FDR=.02), and MHC-SF (FDR=.02). However, Life Flex did not result in preventative intervention effects for the nonclinical subgroup on any outcome measures. The treatment effect sizes for the clinical comorbid subgroup were large for every outcome measure at every time point, except for the EQ-5D-3L Health Rating, in which a medium effect size was observed at the postintervention and 1-month follow-up assessments.
Preintervention: week 0 (n=241) | Postintervention: week 8 (n=58-61) | 1-month follow-up: week 12 (n=41) | 3-month follow-up: week 20 (n=34-35) | |||||||||||||||||
Values, n (%) | Values, mean (SD) | Values, n (%) | Values, mean (SD) | Values, n (%) | Values, mean (SD) | Values, n (%) | Values, mean (SD) | |||||||||||||
GAD-7a | ||||||||||||||||||||
Anxiety | 26 (10.8) | 12.35 (3.53) | 9 (14.8) | 4.78 (2.33) | 7 (17.1) | 5.86 (1.86) | 5 (14.3) | 4.40 (2.70) | ||||||||||||
Depression | 23 (9.5) | 5.43 (1.67) | 6 (9.8) | 4.00 (4.77) | 5 (12.2) | 3.20 (2.59) | 5 (14.3) | 3.60 (2.88) | ||||||||||||
Comorbid | 136 (56.4) | 15.03 (4.13) | 34 (55.7) | 6.56 (6.08) | 24 (58.5) | 6.88 (6.15) | 19 (54.3) | 6.26 (5.88) | ||||||||||||
Nonclinical | 56 (23.2) | 5.05 (1.86) | 12 (19.7) | 4.58 (2.43) | 5 (12.2) | 6.00 (3.54) | 6 (17.1) | 3.67 (3.72) | ||||||||||||
PHQ-9b | ||||||||||||||||||||
Anxiety | 26 (10.8) | 6.81 (2.25) | 9 (15) | 3.89 (3.52) | 7 (17.1) | 3.29 (2.50) | 5 (14.7) | 3.00 (2.35) | ||||||||||||
Depression | 26 (10.8) | 12.91 (3.26) | 6 (10) | 6.83 (8.73) | 5 (12.2) | 6.40 (6.54) | 5 (14.7) | 6.80 (6.98) | ||||||||||||
Comorbid | 136 (56.4) | 17.37 (4.94) | 33 (55) | 8.33 (7.43) | 24 (58.5) | 8.79 (7.37) | 19 (55.9) | 8.00 (6.76) | ||||||||||||
Nonclinical | 56 (23.2) | 5.05 (2.54) | 12 (20) | 4.17 (2.52) | 5 (12.2) | 6.40 (3.21) | 5 (14.7) | 6.60 (5.41) | ||||||||||||
K-6c | ||||||||||||||||||||
Anxiety | 26 (10.8) | 12.92 (2.87) | 9 (15) | 9.78 (1.56) | 7 (17.1) | 10.00 (0.82) | 5 (14.7) | 8.40 (1.67) | ||||||||||||
Depression | 23 (9.5) | 15.04 (3.57) | 6 (10) | 11.83 (6.62) | 5 (12.2) | 12.00 (5.29) | 5 (14.7) | 12.20 (7.82) | ||||||||||||
Comorbid | 136 (56.4) | 20.53 (4.73) | 33 (55) | 13.24 (6.49) | 24 (58.5) | 11.92 (5.77) | 19 (55.9) | 11.21 (4.89) | ||||||||||||
Nonclinical | 56 (23.2) | 10.63 (2.73) | 12 (20) | 10.75 (2.56) | 5 (12.2) | 12.60 (5.22) | 5 (14.7) | 11.60 (5.03) | ||||||||||||
DERS-36d | ||||||||||||||||||||
Anxiety | 26 (10.8) | 95.88 (19.37) | 9 (15.3) | 79.00 (21.43) | 7 (17.1) | 73.71 (20.34) | 5 (14.7) | 70.00 (23.77) | ||||||||||||
Depression | 23 (9.5) | 92.04 (20.76) | 6 (10.2) | 70.17 (36.68) | 5 (12.2) | 81.80 (22.58) | 5 (14.7) | 74.00 (28.30) | ||||||||||||
Comorbid | 136 (56.4) | 114.21 (21.49) | 32 (54.2) | 85.63 (33.74) | 24 (58.5) | 81.04 (33.44) | 19 (55.9) | 74.79 (29.51) | ||||||||||||
Nonclinical | 56 (23.2) | 83.93 (23.07) | 12 (20.3) | 77.42 (21.38) | 5 (12.2) | 65.40 (16.56) | 5 (14.7) | 71.00 (7.97) | ||||||||||||
MHC-SFe | ||||||||||||||||||||
Anxiety | 26 (10.8) | 38.42 (11.93) | 9 (15) | 44.44 (10.69) | 7 (17.1) | 51.57 (10.21) | 5 (14.7) | 47.80 (13.29) | ||||||||||||
Depression | 23 (9.5) | 27.83 (11.01) | 6 (10) | 46.00 (21.42) | 5 (12.2) | 40.60 (18.81) | 5 (14.7) | 43.80 (17.12) | ||||||||||||
Comorbid | 136 (56.4) | 24.93 (12.14) | 33 (55) | 42.36 (20.02) | 24 (58.5) | 46.08 (17.43) | 19 (55.9) | 43.89 (19.64) | ||||||||||||
Nonclinical | 56 (23.2) | 41.95 (12.22) | 12 (20) | 46.17 (10.99) | 5 (12.2) | 36.40 (20.07) | 5 (14.7) | 32.80 (7.79) | ||||||||||||
R-LOTf | ||||||||||||||||||||
Anxiety | 26 (10.8) | 13.08 (4.99) | 9 (15.3) | 16.78 (4.27) | 7 (17.1) | 19.57 (3.05) | 5 (14.7) | 19.00 (5.39) | ||||||||||||
Depression | 23 (9.5) | 12.09 (3.60) | 6 (10.2) | 15.17 (5.88) | 5 (12.2) | 14.80 (3.96) | 5 (14.7) | 12.60 (4.98) | ||||||||||||
Comorbid | 136 (56.4) | 10.01 (4.99) | 32 (54.2) | 14.81 (6.76) | 24 (58.5) | 15.33 (6.15) | 19 (55.9) | 15.16 (5.01) | ||||||||||||
Nonclinical | 56 (23.2) | 13.71 (4.63) | 12 (20.3) | 14.83 (4.61) | 5 (12.2) | 15.40 (5.03) | 5 (14.7) | 15.40 (3.91) | ||||||||||||
ED-5D-3L Utility Index | ||||||||||||||||||||
Anxiety | 26 (10.8) | 0.77 (0.11) | 9 (15.5) | 0.88 (0.11) | 7 (17.1) | 0.79 (0.19) | 5 (14.7) | 0.86 (0.08) | ||||||||||||
Depression | 23 (9.5) | 0.75 (0.11) | 6 (10.3) | 0.77 (0.23) | 5 (12.2) | 0.87 (0.13) | 5 (14.7) | 0.74 (0.31) | ||||||||||||
Comorbid | 136 (56.4) | 0.61 (0.19) | 31 (53.4) | 0.77 (0.23) | 24 (58.5) | 0.81 (0.17) | 19 (55.9) | 0.79 (0.19) | ||||||||||||
Nonclinical | 56 (23.2) | 0.86 (0.14) | 12 (20.7) | 0.90 (0.11) | 5 (12.2) | 0.87 (0.12) | 5 (14.7) | 0.85 (0.23) | ||||||||||||
ED-5D-3L Health Rating | ||||||||||||||||||||
Anxiety | 26 (10.8) | 71.46 (10.89) | 9 (15.5) | 78.33 (10.31) | 7 (17.1) | 71.14 (28.82) | 5 (14.7) | 81.60 (11.63) | ||||||||||||
Depression | 23 (9.5) | 60.70 (16.16) | 6 (10.3) | 79.17 (18.28) | 5 (12.2) | 80.60 (11.15) | 5 (14.7) | 57.00 (34.74) | ||||||||||||
Comorbid | 136 (56.4) | 54.86 (21.41) | 31 (53.4) | 69.29 (23.46) | 24 (58.5) | 67.50 (24.16) | 19 (55.9) | 74.53 (17.11) | ||||||||||||
Nonclinical | 56 (23.2) | 75.55 (12.69) | 12 (20.7) | 78.75 (14.60) | 5 (12.2) | 62.80 (34.41) | 5 (14.7) | 76.40 (5.46) |
aGAD-7: Generalized Anxiety Disorder 7.
bPHQ-9: Patient Health Questionnaire 9
cK-6: Kessler 6.
dDERS-36: Difficulties in Emotional Regulation 36.
eMHC-SF: Mental Health Continuum—Short Form.
fR-LOT: Revised Life Orientation Test.
Week 0 vs 3, Cohen d (95% CI) | Week 0 vs 5, Cohen d (95% CI) | Week 0 vs 8, Cohen d (95% CI) | Week 0 vs 12, Cohen d (95% CI) | Week 0 vs 20, Cohen d (95% CI) | P valuea | FDRb | ||
GAD-7c | ||||||||
Anxiety | 1.24 (0.35 to 2.13) | 2.07 (0.95 to 1.46) | 2.31 (1.36 to 3.23) | 1.98 (1.00 to 2.94) | 2.32 (1.78 to 3.43) | <.001 | <.001 | |
Depression | 0.04 (−0.86 to 0.94) | 0.26 (−0.95 to 1.46) | 0.56 (−0.35 to 1.47) | 1.21 (0.18 to 2.22) | 0.96 (−0.05 to 1.95) | .01 | .02 | |
Comorbid | 1.16 (0.78 to 1.53) | 1.85 (1.39 to 2.30) | 1.85 (1.42 to 2.27) | 1.82 (1.34 to 2.30) | 2.01 (1.47 to 2.53) | <.001 | <.001 | |
Nonclinical | −0.07 (−0.65 to 0.52) | 0.16 (−0.59 to 0.90) | 0.24 (−0.39 to 0.86) | −0.47 (−1.39 to 0.45) | 0.67 (−0.19 to 1.51) | .39 | .48 | |
PHQ-9d | ||||||||
Anxiety | 1.15 (0.26 to 2.02) | 0.81 (−0.18 to 1.78) | 1.12 (0.31 to 1.91) | 1.53 (0.61 to 2.44) | 1.69 (0.62 to 2.72) | <.001 | <.001 | |
Depression | 1.31 (0.34 to 2.26) | 0.99 (−0.26 to 2.21) | 1.27 (0.30 to 2.22) | 1.65 (0.57 to 2.70) | 1.51 (0.44 to 2.54) | <.001 | .002 | |
Comorbid | 0.91 (0.54 to 1.28) | 1.47 (1.03 to 1.90) | 1.64 (1.22 to 2.06) | 1.60 (1.13 to 2.07) | 1.81 (1.28 to 2.33) | <.001 | <.001 | |
Nonclinical | 0.18 (−0.41 to 0.76) | −0.25 (−0.99 to 0.49) | 0.35 (−0.28 to 0.97) | −0.52 (−1.44 to 0.40) | −0.55 (−1.46 to 0.38) | .85 | .85 | |
K-6e | ||||||||
Anxiety | N/Af | N/A | 1.20 (0.38 to 2.01) | 1.12 (0.26 to 2.00) | 1.65 (0.59 to 2.69) | <.001 | <.001 | |
Depression | N/A | N/A | 0.75 (−0.18 to 1.66) | 0.78 (−0.21 to 1.77) | 0.63 (−0.36 to 1.61) | .01 | .02 | |
Comorbid | N/A | N/A | 1.42 (1.01 to 1.83) | 1.76 (1.28 to 2.23) | 1.96 (1.43 to 2.49) | <.001 | <.001 | |
Nonclinical | N/A | N/A | −0.05 (−0.67 to 0.58) | −0.67 (−1.59 to 0.26) | −0.33 (−1.25 to 0.59) | .47 | .54 | |
DERS-36g | ||||||||
Anxiety | N/A | N/A | 0.85 (0.06 to 1.63) | 1.13 (0.24 to 2.01) | 1.29 (0.27-2.29) | .002 | .004 | |
Depression | N/A | N/A | 0.95 (0.01 to 1.88) | 0.49 (−0.49 to 1.46) | 0.82 (−0.18 to 1.80) | .06 | .09 | |
Comorbid | N/A | N/A | 1.18 (0.77 to 1.58) | 1.40 (0.94 to 1.86) | 1.75 (1.22 to 2.26) | <.001 | <.001 | |
Nonclinical | N/A | N/A | 0.29 (−0.34 to 0.91) | 0.82 (−0.11 to 1.74) | 0.58 (−0.35 to 1.50) | .045 | .07 | |
MHC-SFh | ||||||||
Anxiety | N/A | N/A | −0.52 (−1.28 to 0.25) | −1.13 (−2.00 to −0.24) | −0.77 (−1.74 to 0.21) | .007 | .01 | |
Depression | N/A | N/A | −1.34 (−2.30 to −0.36) | −1.02 (−2.02 to −0.01) | −1.31 (−2.33 to −0.27) | .014 | .02 | |
Comorbid | N/A | N/A | −1.25 (−1.65 to −0.84) | −1.62 (−2.09 to −1.15) | −1.43 (−1.94 to −0.92) | <.001 | <.001 | |
Nonclinical | N/A | N/A | −0.35 (−0.98 to 0.28) | 0.43 (−0.49 to 1.35) | 0.76 (−0.16 to 1.69) | .58 | .62 | |
R-LOTi | ||||||||
Anxiety | N/A | N/A | −0.77 (−1.54 to 0.02) | −1.39 (−2.28 to −0.48) | −1.17 (−2.17 to −0.16) | <.001 | <.001 | |
Depression | N/A | N/A | −0.75 (−1.66 to 0.18) | −0.74 (−1.72 to 0.25) | −0.13 (−1.10 to 0.84) | .22 | .28 | |
Comorbid | N/A | N/A | −0.90 (−1.29 to −0.50) | −1.03 (−1.48 to −0.58) | −1.03 (−1.52 to −0.54) | <.001 | <.001 | |
Nonclinical | N/A | N/A | −0.24 (−0.87 to 0.38) | −0.36 (−1.27 to −0.56) | −0.38 (−1.28 to 0.55) | .42 | .49 | |
EQ-5D-3L Utility Index | ||||||||
Anxiety | N/A | N/A | −1.01 (−1.80 to −0.21) | −0.19 (−1.02 to 0.65) | −0.80 (−1.77 to 0.19) | .01 | .02 | |
Depression | N/A | N/A | −0.12 (−1.02 to 0.78) | −1.03 (−2.03 to −0.01) | 0.07 (−0.90 to 1.04) | .16 | .21 | |
Comorbid | N/A | N/A | −0.80 (−1.20 to −0.40) | −1.04 (−1.49 to −0.59) | −0.92 (−1.41 to −0.42) | <.001 | <.001 | |
Nonclinical | N/A | N/A | −0.28 (−0.90 to 0.35) | −0.07 (−0.98 to 0.85) | 0.12 (−0.80 to 1.03) | .54 | .60 | |
EQ-5D-3L Health Rating | ||||||||
Anxiety | N/A | N/A | −0.64 (−1.41 to 0.14) | 0.02 (−0.81 to 0.85) | −0.92 (−1.90 to 0.07) | .02 | .04 | |
Depression | N/A | N/A | −1.11 (−2.05 to −0.16) | −1.28 (−2.30 to −0.25) | 0.18 (−0.79 to 1.15) | .04 | .05 | |
Comorbid | N/A | N/A | −0.66 (−1.06 to −0.26) | −0.58 (−1.02 to −0.14) | −0.94 (−1.43 to −0.45) | <.001 | <.001 | |
Nonclinical | N/A | N/A | −0.25 (−0.87 to 0.38) | 0.84 (−0.09 to 1.76) | −0.07 (−0.98 to 0.85) | .68 | .70 |
aP value was based on Mann-Kendall test.
bFDR: false recovery rate.
cGAD-7: Generalized Anxiety Disorder 7.
dPHQ-9: Patient Health Questionnaire 9.
eK-6: Kessler 6.
fN/A: not applicable.
gDERS-36: Difficulties in Emotional Regulation 36.
hMHC-SF: Mental Health Continuum—Short Form.
iR-LOT: Revised Life Orientation Test.
Program Use
Of the 241 participants, 219 (90.9%) logged in at least once and viewed at least some of the Introduction module; 161 (66.8%) completed the Introduction module; 91 (37.8%) completed module 1 (Increasing Biological Flexibility); 60 (24.9%) completed module 2 (Increasing Emotional Flexibility); 37 (15.4%) completed module 3 (Increasing Thinking Flexibility); 31 (12.9%) completed module 4 (Increasing Behavioral Flexibility); 22 (9.1%) completed module 5 (Increasing Wellness Flexibility); and 13 (5.4%) completed module 6 (Increasing Life Flexibility).
Postintervention Acceptability and Qualitative Intervention Impressions
Overview
Participants were asked to rate the program using 8 multiple-choice questions and to discuss the best and worst parts of the Life Flex program after the intervention.
Posttreatment Acceptability and Satisfaction (TAS-Q) Ratings (n=51)
When asked to rate the quality of the Life Flex program, 88% (45/51) of the participants rated it as good to excellent; when asked whether they received the right kind of information and strategies, 94% (48/51) of the participants said yes; when asked to what extent Life Flex met their needs, 90% (46/51) of the participants said “some” to “all” of their needs were met; when asked if they would recommend Life Flex to a friend, 96% (49/51) of the participants said yes; when asked about how satisfied they were with the amount of information they received, 90% (46/51) of the participants said they were satisfied to very satisfied; when asked about how much the Life Flex program had helped them to effectively deal with their problems, 88% (45/51) of the participants said that it helped them; when asked overall, in a general sense, how satisfied they were with the Life Flex program, 80% (41/51) of the participants said they were satisfied to highly satisfied; and when asked if they would return to Life Flex into the future if required, 88% (45/51) of the participants said yes.
Posttreatment Qualitative Life Flex Intervention Responses (n=51)
When participants were asked about the best parts of the Life Flex intervention, common responses included great information and strategies, activities, videos explaining things, choice in strategies, holistic focus, brain plasticity information, the inclusion of the biological explanations of depression and anxiety, guidance to help them move forward, ability to self-pace, mood monitoring, the quality of the information (well-explained and comprehensive), learning more about emotions, genuine caring expressed in content, and the variety of presentation formations. When asked about the worst parts of the Life Flex intervention, common responses included not enough reminders, need for a better self-monitoring tool, no access to a hard copy version of the Life Flex intervention, content being somewhat wordy at times, limited intervention feedback on how they were going, no accessibility without an internet connection, and the lack of mobile app version.
Exploration of Qualitative Impressions of the Transdiagnostic Intervention Content Expansion (n=81)
We explored the participants’ impressions of the first Life Flex module (the Introduction module), which provides them with an overview and summary of the entire program (
) and an introduction to the key theories (eg, CBT and positive psychology) and concepts (eg, brain plasticity and allostasis; including video explainers). In the following paragraph, we present the results of the participants’ review of this module (ie, at the beginning of each module, participants were able to optionally undertake a brief review of the previous module. This provided an opportunity for both the participant and the study researchers to receive feedback on the previous module).For the review of the Introduction module, we received 98 entries, with 17 (17%) duplicates (leaving n=81, 83%, entries from different participants). When asked what participants found most useful within the Introduction module, we observed that many of the entries were general nonspecific comments (ie, described participants’ general impressions such as “a good introduction/summary/overview, clear/informative” of the intervention). However, when looking at specific responses, the most common themes were as follows: (1) the introduction to the brain plasticity and biology of stress response information and videos (23 specific comments); (2) motivational interviewing–related activities (eg, pros and cons activity, things I would like to change, commitment plan; 15 specific comments) and (3) the recommended positive affect–focused offline activity (successful events or positive self-statements; 13 specific comments).
provides examples of some of the comments.Representative specific qualitative statements made about the useful aspects of the Introduction module.
Representative qualitative statements by theme
- Brain plasticity and stress response
- “The realisation that I can change my brain and that I need not be a victim of my ill health and mood. That i (sic) am capable.”
- “The information (or reiteration) of neural plasticity and that it’s possible to change the way one’s brain function and there is no need to feel stuck with the status quo.”
- “The simple explanation of the possibility of changing the way the brain processes.”
- “I found it useful to read about the flexibility & plasticity of the brain and that through using certain strategies I can change my negative thought loop.”
- “Helpful to reinforce the notion that things can change and that the brain can be rewired positively.”
- “It made me aware of aspects of my condition I did not know—how we are physically and mentally conditioned to react the way we do, and can change that response.”
- “Gave a good indication of what to expect in the program. The emphasis on the notion that change comes from changing neural pathways and that the exercises in the program are designed to help effect that change, is positive and motivating.”
- “1. The discussion of primitive, middle and frontal brain relationships. 2. The concepts of sympathetic and parasympathetic nervous systems.”
- Motivational interviewing activities
- “The opportunity to write things down and commit to a plan. The opportunity to revisit those thoughts.”
- “The pros and cons section was also very helpful—it was really important for me to acknowledge to myself my fear of failure.”
- “I very much liked the information provided as it was clear and yet simple. I also liked the idea of a contract and the setting of parameters to help me follow through on the program.”
- “Knowing change its (sic) possible and how to initiate the change. The introduction made me excited to continue.”
- [W]riting (sic) down what I wanted to get from this and why.”
- “All of it was, writing down what I wanted to achieve from the course.”
- Recommended offline activities (positive affect focus)
- “I liked the selection of your encouragement (positive event or positive statement) to focus on. It might sounds (sic) silly but having the choice and selecting something for you made me feel a lot more in control of/involved in the process.”
- “The affirmation—'I can change my brain’ has really stuck with me.”
- “[W]riting [sic] down the event that I felt good about, and remembering it several times a day was extremely powerful. I felt good about myself, and stopped the negative thoughts that I was having as well.”
- “Positive affirmations led to me standing up for myself a bit more.”
- “It explained the programme and how it is believed that changes to thought patterns can occur. It provided an opportunity for reflection and a tool of focusing on a positive statement which I have been using when my brain gets too busy.”
- “Generating 3 things to say to self at intervals throughout day = seems like a good thing to do.”
Discussion
Principal Findings
The main aim of this study was to explore the potential effectiveness and acceptability feasibility of Life Flex, a fully automated self-help biopsychosocial transdiagnostic digital health intervention designed to decrease anxiety and/or depression. Significant reductions were found in both primary outcome measures (anxiety and depression) from preintervention assessment through to the 3-month follow-up. The secondary outcomes also showed significant improvements, including reduced psychological distress and improved emotion regulation; emotional, social, and psychological well-being; optimism; and health-related quality of life. This overall improvement in the primary outcomes in this study is consistent with those seen in other transdiagnostic digital programs with therapist assistance. For example, in a meta-analysis by Newby et al [
], therapist-assisted transdiagnostic digital treatments for anxiety and/or depression yielded uncontrolled effect sizes of 0.96. Life Flex’s within-group treatment effect sizes at the postintervention time point and 1- and 3-month follow-ups ranged between Cohen d=0.96 and Cohen d=1.33 for anxiety and Cohen d=0.84 and Cohen d=0.93 for depression. Although a direct comparison is impossible, Batterham et al [ ] also reported significant between-group changes in the PHQ-9 and other anxiety-related measures (panic and social anxiety) using their self-help transdiagnostic digital program, relative to an attentional control condition, and the results are similar to our results (albeit within-group changes in depression and anxiety). Overall, it is encouraging to observe such similar effect size changes in our digital intervention relative to digital plus therapist-supported transdiagnostic interventions (or even face-to-face), and this provide early support that for some people, a fully automated self-help transdiagnostic digital approach to address anxiety and/or depression can be possible.The second aim was to group participants based on their preintervention clinical diagnostic presentation and to evaluate possible comorbidities and preventative intervention effects. When evaluating the diagnostic subgroupings against the primary and secondary outcome measures, those with clinical comorbid presentations appeared to improve the most, whereas those with nonclinical subthreshold presentations improved the least. The clinical comorbidity intervention effect sizes obtained in this study at the postintervention time point or follow-up were larger (between Cohen d=1.82 and Cohen d=2.01 for anxiety and between Cohen d=1.60 and Cohen d=1.81 for depression for the comorbidity subgroup), relative to the analysis results for the whole group (between Cohen d=0.96 and Cohen d=1.33 for anxiety and between Cohen d=0.84 and Cohen d=0.93 for depression).
However, in terms of preventative intervention effects, no significant changes were found in the primary or secondary outcome measures in the nonclinical subgroup. Therefore, unlike the adolescent transdiagnostic digital intervention study results obtained by Schmitt et al [
], Life Flex did not produce preventative intervention effects for anxiety and depression. In terms of core differences between the 2 studies, the study by Schmitt et al [ ] included therapist assistance (and researcher contact), and their intervention was tested on adolescents. Overall, the preliminary results suggest that Life Flex has good clinical comorbidity intervention outcome effects but no preventative outcome intervention effects. Further investigation is therefore required using longer follow-up periods and the inclusion of a control condition to best test for any possible preventative intervention effects, as well as to serve as a replication study for the comorbidity intervention effects.The third and final aim of the study was to measure postintervention program acceptability, including participant impressions of the content expansion, using both quantitative and qualitative responses. The results suggest that Life Flex was well received by participants. In general, participants found the program quality to be high, and their satisfaction with the program meant that they were also willing to recommend it to a friend (96.1%) and return to it in the future if required (88.3%). However, some of the qualitative responses about the worst parts of the program suggested room for improvement (eg, adding more reminders, developing a more useful self-monitoring tool, decreasing wordiness, and increasing program progress information). In relation to transdiagnostic program content expansion and based on qualitative responses (review of Introduction module and postintervention TAS-Q data), it would appear that the biologically based concepts and positive affect and well-being content, as well as the addition (and choice) of the increasing biological and wellness flexibility strategies, were welcomed, beneficial, and enjoyable additions. However, whether these additions contributed to significant intervention outcome changes is unknown and will require formal testing in the future.
Although UP and CBT are effective transdiagnostic treatments for emotional disorders, they are driven by a psychological framework that focuses largely on emotion, cognition, and behavior. Nonpharmacological biologically focused interventions (ie, lifestyle interventions that work on enabling brain plasticity and decreasing allostatic load on the body, such as increasing physical activity and brain and gut nutrition) that improve emotional regulation [
] and increase positive emotions [ ] do show promise as useful additions based on the general results of this study. Therefore, more dismantling research on transdiagnostic intervention content and their associated mechanisms of change is required to hopefully arrive at the most time-efficient, effective, and adherent self-help transdiagnostic digital intervention protocol possible. In addition, future studies might also consider collecting blood biomarkers to test for potential biological changes alongside psychological changes. For example, increasing physical activity has been shown to modulate several core biomarkers of neuroprogression, including neurotrophins and oxidative stress [ , ], as well as decrease self-reported symptoms of depression [ ] and anxiety [ ].Limitations
Although this was a feasibility trial, a limitation of this study was the absence of a control condition, which makes it impossible to conclude whether the results of the Life Flex intervention were due to time passing, the use of other forms of support, or nonspecific effects. In addition, as with any intervention research, this study suffers from self-selection bias, limiting the generalizability of its findings. Moreover, as this study tested a fully automated self-help digital intervention, conducting clinical assessments to confirm the diagnosis would have voided the real-world, self-help elements of the study. However, the diagnosis relied on validated diagnostic self-report measures (GAD-7 and PHQ-9), which can be subjective. Furthermore, a longer follow-up period would have assisted in better measuring the longer-term maintenance and possible preventative intervention effects. Another limitation was the low scheduled assessment completion rate following the preintervention assessment. Although this is not uncommon for fully automated self-help digital health intervention trials [
], correction to the data set is typically required, such as multiple imputation. However, given the higher-than-expected amount of missing data in this feasibility trial, we used the completer analysis data to demonstrate potential effectiveness and acceptability feasibility. Our comparison of the observed demographics between completer and missing data demonstrated no significant difference, which suggests that the data would be missing at random, providing greater confidence in the results reported. However, caution (and further replication) must be exercised when considering these preliminary results.Conclusions
In summary, the results of this trial are promising, despite the absence of a control condition, self-selection bias, and reliance on self-report measures for diagnosis, as this study represents real-world conditions that provide people with direct access to their intervention of choice. Given the potential rise of mental health issues associated with more recent global events (eg, pandemic and economic downturn), the introduction of this scalable, fully automated self-help biopsychosocial transdiagnostic digital intervention is timely and could have widespread benefits. Although the exploratory results found in this trial are encouraging, studies that include comparator conditions are required. Importantly, 2 subsequent Life Flex studies have recently been completed (with comparator randomized conditions) and are currently being written up or have recently been accepted by the Journal of Medical Internet Research [
].In addition, since completing this exploratory feasibility trial, we have updated the Life Flex program (now housed within the HealthZone digital platform) to address qualitative feedback received from this study (eg, a new interactive self-monitoring tool with wearable data integration, which includes several just-in-time intervention algorithms, more reminders, visual summary progress feedback, and the editing of some content to decrease wordiness). Furthermore, given the role that motivation and self-efficacy plays in engagement and behavior change, especially in the context of fully automated self-help digital programs, in one of our current trials, we have added a digital conversational (chat) agent to increase engagement by supporting those who experience difficulties with motivation and/or self-efficacy while undertaking the program. The conversational agent was based on the transtheoretical model of behavior change and incorporated motivational interviewing and positive psychological techniques. It is hoped that the introduction of this digital agent will also act as a pseudoform of social support, representing another step toward a more engaging self-help digital program.
In conclusion, given the convenience and availability of digital interventions, this fully automated self-help transdiagnostic intervention is a potential way to address the accessibility of treatment options for anxiety and/or depression. However, further investigation using large-scale randomized controlled trials is required.
Acknowledgments
The authors would like to thank the participants in this trial, consumer and content expert reviewers and acknowledge the contributions of Sue Lauder, Gemma Munro, and Rachelle Bridges. The authors would also like to acknowledge the programming work of Asher Leslie and Lewis Lakerink in the creation of the digital platform.
Data Availability
The raw, nonidentifiable data supporting the conclusions of this paper will be made available by the corresponding author, following a request to Federation University Human Research Ethics Committee for access to these data (as per the study’s approved ethical application).
Conflicts of Interest
BK was one of the primary creators of the Life Flex digital mental health program. BK received no personal income from the Life Flex program.
Description of Life Flex digital health introduction and core modules.
DOCX File , 16 KB
Missing data pattern of key variables across time.
DOC File , 68 KB
Distribution of the sociodemographic and clinical characteristics comparing participants who completed all scheduled assessments (complete data set) versus participants who did not (missing data set).
DOC File , 209 KB
Descriptive of outcomes at preintervention by clinical diagnostic presentation subgroup.
DOC File , 57 KB
Sociodemographic and clinical characteristics of the sample at preintervention by clinical diagnostic presentation subgroup.
DOC File , 178 KB
Study characteristics at preintervention (N=241).
DOCX File , 23 KB
Descriptive of intervention outcomes at the scheduled during intervention assessment time point by preintervention clinical diagnostic presentation subgroup.
DOCX File , 20 KBReferences
- Vigo D, Thornicroft G, Atun R. Estimating the true global burden of mental illness. Lancet Psychiatry 2016 Feb;3(2):171-178. [CrossRef] [Medline]
- Baxter AJ, Vos T, Scott KM, Ferrari AJ, Whiteford HA. The global burden of anxiety disorders in 2010. Psychol Med 2014 Aug;44(11):2363-2374. [CrossRef] [Medline]
- Ferrari AJ, Charlson FJ, Norman RE, Patten SB, Freedman G, Murray CJ, et al. Burden of depressive disorders by country, sex, age, and year: findings from the global burden of disease study 2010. PLoS Med 2013 Nov;10(11):e1001547 [FREE Full text] [CrossRef] [Medline]
- National Study of Mental Health and Wellbeing: summary statistics on key mental health issues including the prevalence of mental disorders and the use of services. Australian Bureau of Statistics. 2022 Jul 22. URL: https://www.abs.gov.au/statistics/health/mental-health/national-study-mental-health-and-wellbeing/latest-release#use-of-services [accessed 2022-09-22]
- Burgess PM, Pirkis JE, Slade TN, Johnston AK, Meadows GN, Gunn JM. Service use for mental health problems: findings from the 2007 National Survey of Mental Health and Wellbeing. Aust N Z J Psychiatry 2009 Jul;43(7):615-623. [CrossRef] [Medline]
- Kessler RC, Chiu WT, Demler O, Merikangas KR, Walters EE. Prevalence, severity, and comorbidity of 12-month DSM-IV disorders in the National Comorbidity Survey Replication. Arch Gen Psychiatry 2005 Jun;62(6):617-627 [FREE Full text] [CrossRef] [Medline]
- Rapaport MH, Clary C, Fayyad R, Endicott J. Quality-of-life impairment in depressive and anxiety disorders. Am J Psychiatry 2005 Jun;162(6):1171-1178. [CrossRef] [Medline]
- Hofmeijer-Sevink MK, Batelaan NM, van Megen HJ, Penninx BW, Cath DC, van den Hout MA, et al. Clinical relevance of comorbidity in anxiety disorders: a report from the Netherlands Study of Depression and Anxiety (NESDA). J Affect Disord 2012 Mar;137(1-3):106-112 [FREE Full text] [CrossRef] [Medline]
- Butler AC, Chapman JE, Forman EM, Beck AT. The empirical status of cognitive-behavioral therapy: a review of meta-analyses. Clin Psychol Rev 2006 Jan;26(1):17-31. [CrossRef] [Medline]
- Gloaguen V, Cottraux J, Cucherat M, Blackburn IM. A meta-analysis of the effects of cognitive therapy in depressed patients. J Affect Disord 1998 Apr;49(1):59-72. [CrossRef] [Medline]
- Krueger RF, Eaton NR. Transdiagnostic factors of mental disorders. World Psychiatry 2015 Feb;14(1):27-29 [FREE Full text] [CrossRef] [Medline]
- Pearl SB, Norton PJ. Transdiagnostic versus diagnosis specific cognitive behavioural therapies for anxiety: a meta-analysis. J Anxiety Disord 2017 Mar;46:11-24. [CrossRef] [Medline]
- Ellard KK, Fairholme CP, Boisseau CL, Farchione TJ, Barlow DH. Unified protocol for the transdiagnostic treatment of emotional disorders: protocol development and initial outcome data. Cogn Behav Pract 2010 Feb;17(1):88-101 [FREE Full text] [CrossRef] [Medline]
- Barlow DH, Farchione TJ, Fairholme CP, Ellard KK, Boisseau CL, Allen LB, et al. Unified Protocol for Transdiagnostic Treatment of Emotional Disorders: Therapist Guide. Oxford, UK: Oxford University Press; 2011.
- Barlow DH, Farchione T. Applications of the Unified Protocol for Transdiagnostic Treatment of Emotional Disorders. Oxford, UK: Oxford University Press; Aug 2017.
- Sauer-Zavala S, Gutner CA, Farchione TJ, Boettcher HT, Bullis JR, Barlow DH. Current definitions of "Transdiagnostic" in treatment development: a search for consensus. Behav Ther 2017 Jan;48(1):128-138. [CrossRef] [Medline]
- Benefits of e-mental health treatments and interventions. The Royal Australian & New Zealand College of Psychiatrists. 2019 Mar. URL: https://tinyurl.com/yy6dckxz [accessed 2020-09-28]
- Donker T, Blankers M, Hedman E, Ljótsson B, Petrie K, Christensen H. Economic evaluations of internet interventions for mental health: a systematic review. Psychol Med 2015 Dec;45(16):3357-3376. [CrossRef] [Medline]
- Andersson G. Internet-delivered psychological treatments. Annu Rev Clin Psychol 2016;12:157-179. [CrossRef] [Medline]
- Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010 Oct 13;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
- Newby JM, McKinnon A, Kuyken W, Gilbody S, Dalgleish T. Systematic review and meta-analysis of transdiagnostic psychological treatments for anxiety and depressive disorders in adulthood. Clin Psychol Rev 2015 Aug;40:91-110 [FREE Full text] [CrossRef] [Medline]
- Batterham PJ, Calear AL, Farrer L, Gulliver A, Kurz E. Efficacy of a transdiagnostic self-help internet intervention for reducing depression, anxiety, and suicidal ideation in adults: randomized controlled trial. J Med Internet Res 2021 Jan 22;23(1):e22698 [FREE Full text] [CrossRef] [Medline]
- González-Robles A, Díaz-García A, Miguel C, García-Palacios A, Botella C. Comorbidity and diagnosis distribution in transdiagnostic treatments for emotional disorders: a systematic review of randomized controlled trials. PLoS One 2018 Nov 15;13(11):e0207396 [FREE Full text] [CrossRef] [Medline]
- Schaeuffele C, Schulz A, Knaevelsrud C, Renneberg B, Boettcher J. CBT at the crossroads: the rise of transdiagnostic treatments. J Cogn Ther 2020 Nov 20;14(1):86-113 [FREE Full text] [CrossRef]
- Schmitt JC, Valiente RM, García-Escalera J, Arnáez S, Espinosa V, Sandín B, et al. Prevention of depression and anxiety in subclinical adolescents: effects of a transdiagnostic internet-delivered CBT program. Int J Environ Res Public Health 2022 Apr 28;19(9):5365 [FREE Full text] [CrossRef] [Medline]
- Díaz-García A, González-Robles A, García-Palacios A, Fernández-Álvarez J, Castilla D, Bretón JM, et al. Negative and positive affect regulation in a transdiagnostic internet-based protocol for emotional disorders: randomized controlled trial. J Med Internet Res 2021 Feb 01;23(2):e21335 [FREE Full text] [CrossRef] [Medline]
- McEwen BS, Akil H. Revisiting the stress concept: implications for affective disorders. J Neurosci 2020 Jan 02;40(1):12-21 [FREE Full text] [CrossRef] [Medline]
- Khan S, Khan RA. Chronic stress leads to anxiety and depression. Ann Psychiatry Ment Health 2017;5(1):1091 [FREE Full text] [CrossRef]
- McEwen BS. Protective and damaging effects of stress mediators. N Engl J Med 1998 Jan 15;338(3):171-179. [CrossRef] [Medline]
- McEwen BS. Allostasis and allostatic load: implications for neuropsychopharmacology. Neuropsychopharmacology 2000 Feb;22(2):108-124. [CrossRef] [Medline]
- Kemp AH, Quintana DS. The relationship between mental and physical health: insights from the study of heart rate variability. Int J Psychophysiol 2013 Sep;89(3):288-296. [CrossRef] [Medline]
- Thayer JF, Lane RD. A model of neurovisceral integration in emotion regulation and dysregulation. J Affect Disord 2000 Dec;61(3):201-216. [CrossRef] [Medline]
- McEwen BS. Physiology and neurobiology of stress and adaptation: central role of the brain. Physiol Rev 2007 Jul;87(3):873-904 [FREE Full text] [CrossRef] [Medline]
- Opie RS, Jacka FN, Marx W, Rocks T, Young C, O'Neil A. Designing lifestyle interventions for common mental disorders: what can we learn from diabetes prevention programs? Nutrients 2021 Oct 25;13(11):3766 [FREE Full text] [CrossRef] [Medline]
- Jacka FN, O'Neil A, Opie R, Itsiopoulos C, Cotton S, Mohebbi M, et al. A randomised controlled trial of dietary improvement for adults with major depression (the 'SMILES' trial). BMC Med 2017 Jan 30;15(1):23 [FREE Full text] [CrossRef] [Medline]
- Moylan S, Eyre HA, Maes M, Baune BT, Jacka FN, Berk M. Exercising the worry away: how inflammation, oxidative and nitrogen stress mediates the beneficial effect of physical activity on anxiety disorder symptoms and behaviours. Neurosci Biobehav Rev 2013 May;37(4):573-584. [CrossRef] [Medline]
- Rosemberg MS, Granner J, Li Y, Seng JS. A scoping review of interventions targeting allostatic load. Stress 2020 Sep;23(5):519-528 [FREE Full text] [CrossRef] [Medline]
- Møller AR. Neural Plasticity and Disorders of the Nervous System. Cambridge, UK: Cambridge University Press; 2010.
- Siegel DJ. The Mindful Therapist – A Clinician′s Guide to Mindsight and Neural Integration (Norton Series on Interpersonal Neurobiology). New York, NY, USA: W W Norton & Company; 2010.
- Siegel DJ. The Developing Mind: How Relationships and the Brain Interact to Shape Who We Are. 2nd edition. New York, NY, USA: Guilford Press; 2012.
- Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
- Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [CrossRef] [Medline]
- Kessler RC, Barker PR, Colpe LJ, Epstein JF, Gfroerer JC, Hiripi E, et al. Screening for serious mental illness in the general population. Arch Gen Psychiatry 2003 Feb;60(2):184-189. [CrossRef] [Medline]
- Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the difficulties in emotion regulation scale. J Psychopathol Behav Assess 2004 Mar;26:41-54 [FREE Full text] [CrossRef]
- Keyes CL. Social well-being. Soc Psychol Q 1998 Jun;61(2):121-140 [FREE Full text] [CrossRef]
- Scheier MF, Carver CS, Bridges MW. Distinguishing optimism from neuroticism (and trait anxiety, self-mastery, and self-esteem): a reevaluation of the Life Orientation Test. J Pers Soc Psychol 1994 Dec;67(6):1063-1078. [CrossRef] [Medline]
- Rabin R, de Charro F. EQ-5D: a measure of health status from the EuroQol group. Ann Med 2001 Jul;33(5):337-343. [CrossRef] [Medline]
- Devilly GJ, Borkovec TD. Psychometric properties of the credibility/expectancy questionnaire. J Behav Ther Exp Psychiatry 2000 Jun;31(2):73-86. [CrossRef] [Medline]
- Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd edition. Hillsdale, NJ, USA: Lawrence Erlbaum Associates; 1988.
- Benjamini Y, Hochberg Y. On the adaptive control of the false discovery rate in multiple testing with independent statistics. J Educ Behav Stat 2000 Mar;25(1):60-83 [FREE Full text] [CrossRef]
- Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Series B Stat Methodol 2018 Dec 05;57(1):289-300 [FREE Full text] [CrossRef]
- Korthauer K, Kimes PK, Duvallet C, Reyes A, Subramanian A, Teng M, et al. A practical guide to methods controlling false discoveries in computational biology. Genome Biol 2019 Jun 04;20(1):118 [FREE Full text] [CrossRef] [Medline]
- Perneger TV. What's wrong with Bonferroni adjustments. BMJ 1998 Apr 18;316(7139):1236-1238 [FREE Full text] [CrossRef] [Medline]
- Erdfelder E, Faul F, Buchner A. GPOWER: a general power analysis program. Behav res meth instrum comput 1996 Mar;28(1):1-11 [FREE Full text] [CrossRef]
- Hofmann SG, Sawyer AT, Fang A, Asnaani A. Emotion dysregulation model of mood and anxiety disorders. Depress Anxiety 2012 May;29(5):409-416. [CrossRef] [Medline]
- Seligman ME, Csikszentmihalyi M. Positive psychology. An introduction. Am Psychol 2000 Jan;55(1):5-14. [CrossRef] [Medline]
- Chilton WL, Marques FZ, West J, Kannourakis G, Berzins SP, O'Brien BJ, et al. Acute exercise leads to regulation of telomere-associated genes and microRNA expression in immune cells. PLoS One 2014 Apr 21;9(4):e92088 [FREE Full text] [CrossRef] [Medline]
- Stanton R, Reaburn P. Exercise and the treatment of depression: a review of the exercise program variables. J Sci Med Sport 2014 Mar;17(2):177-182. [CrossRef] [Medline]
- Klein B, Meyer D, Austin DW, Kyrios M. Anxiety online: a virtual clinic: preliminary outcomes following completion of five fully automated treatment programs for anxiety disorders and symptoms. J Med Internet Res 2011 Nov 04;13(4):e89 [FREE Full text] [CrossRef] [Medline]
- Andrews B, Klein B, Van Nguyen H, Corboy D, McLaren S, Watson S. Efficacy of a digital mental health biopsychosocial transdiagnostic intervention with or without therapist-assistance for adults with anxiety and depression: an adaptive randomised clinical trial. J Med Internet Res (forthcoming) 2023 Apr 5:45135 [FREE Full text] [CrossRef]
Abbreviations
AD: anxiety disorder |
CBT: cognitive behavioral therapy |
DERS-36: Difficulties in Emotional Regulation 36 |
FDR: false discovery rate |
GAD-7: Generalized Anxiety Disorder 7 |
K-6: Kessler 6 |
MHC-SF: Mental Health Continuum—Short Form |
PHQ-9: Patient Health Questionnaire 9 |
R-LOT: Revised Life Orientation Test |
TAS-Q: Treatment Acceptability and Satisfaction Questionnaire |
UP: Unified Treatment Protocol |
Edited by A Mavragani; submitted 17.10.22; peer-reviewed by A Al-Asadi Ari, H Hallenbeck; comments to author 08.12.22; revised version received 12.12.22; accepted 03.04.23; published 30.05.23
Copyright©Britt Klein, Huy Nguyen, Suzanne McLaren, Brooke Andrews, Kerrie Shandley. Originally published in JMIR Formative Research (https://formative.jmir.org), 30.05.2023.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.