Published on in Vol 7 (2023)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/44138, first published .
Outcomes of a Live Messaging, Blended Care Coaching Program Among Adults With Symptoms of Anxiety: Pragmatic Retrospective Cohort Study

Outcomes of a Live Messaging, Blended Care Coaching Program Among Adults With Symptoms of Anxiety: Pragmatic Retrospective Cohort Study

Outcomes of a Live Messaging, Blended Care Coaching Program Among Adults With Symptoms of Anxiety: Pragmatic Retrospective Cohort Study

Original Paper

1Lyra Health, Burlingame, CA, United States

2Department of Psychological Sciences, Northern Arizona University, Flagstaff, AZ, United States

3Department of Pediatrics, Emory University School of Medicine, Atlanta, GA, United States

Corresponding Author:

Jocelynn T Owusu, MPH, PhD

Lyra Health

287 Lorton Avenue

Burlingame, CA, 94010

United States

Phone: 1 877 505 7147

Email: jowusu@lyrahealth.com


Background: Anxiety disorders are common and can be debilitating. In addition, various barriers exist that can hinder access to adequate care. Coaching that is grounded in evidence-based interventions and delivered via synchronous (ie, live) text-based messaging could potentially increase the reach of mental health services among populations who select this modality instead of other services (eg, face-to-face coaching and psychotherapy). In addition, the delivery of live messaging coaching within a blended care model has the potential to combine the benefits of coaching with those of evidence-based digital mental health tools.

Objective: This real-world study evaluates the anxiety and satisfaction outcomes of live messaging coaching blended with digital tools (ie, digital exercises and activities).

Methods: This was a retrospective cohort study of 121 adults with moderate levels of anxiety symptoms at the beginning of coaching (Generalized Anxiety Disorder-7 [GAD-7] scores: range 8-14). Participants received an employer-offered blended messaging coaching (BMC) program, and those who opted to receive all live coaching sessions via text-based messaging were included. Anxiety symptom severity was regularly measured by using the GAD-7 scale. Using growth curve models, the change in GAD-7 scores over the course of BMC was evaluated, as were the effects of text-based coaching sessions on GAD-7 scores. The proportion of participants that had a reliable improvement in anxiety symptom severity (GAD-7 score reduction of ≥4) or subclinical symptom severity (GAD-7 score of <8) at the end of care was also estimated. Participants also self-reported their likelihood of recommending their live messaging coach to someone with similar needs.

Results: At baseline, the average GAD-7 score was 9.88 (SD 1.80). Anxiety symptom severity significantly decreased with each week in the BMC program (week: b=−1.04; P<.001), and the rate of decline in anxiety symptom severity decreased over time (week2: b=0.06; P<.001). Each live messaging coaching session was associated with significantly lower anxiety symptom severity during the week of the coaching session (b=−1.56; P<.001) and the week immediately following the session (b=−1.03; P<.001). Overall, 86% (104/121) of participants had subclinical symptom severity or a reliable reduction in anxiety symptom severity by the end of care. Further, 33.1% (40/121) of participants reported coaching satisfaction levels; of the 40 participants in this subset, 37 (92.5%) were likely or extremely likely to recommend their live messaging coach.

Conclusions: BMC that provides coaching sessions via live messaging can be beneficial for adults with moderate symptoms of anxiety who qualify for and self-select this care modality. Large-scale studies with longer follow-ups are needed.

JMIR Form Res 2023;7:e44138

doi:10.2196/44138

Keywords



As some of the most prevalent mental disorders worldwide [1], anxiety disorders are a significant public health problem. Anxiety disorders are associated with various adverse outcomes, including greater workplace presenteeism (ie, working while unwell) and absenteeism [2], as well as the greater use of health care services [3]. Despite the existence of efficacious treatments for anxiety disorders, such as psychotherapy [4], most adults in the United States and around the world do not receive care [5,6]. The prevalence of anxiety disorders, coupled with low rates of care seeking, magnifies the need for innovative treatment approaches that reduce potential barriers to accessing care.

Coaching services have been in use for decades [7] and have become more common in recent years [8]. Coaching has been described as a goal-focused approach that fosters development in multiple areas (eg, interpersonal and professional areas) through the collaboration between the coach and the client [9,10]. Although coaching generally does not have a clinical focus [11], coaching programs have been associated with improvements in general well-being (eg, burnout and mental health symptoms) [12], though some results vary [13]. Nonetheless, prior research has also found that live video coaching delivered within a blended care model (ie, video-based coaching combined with internet modules) was associated with significant reductions in anxiety and depression symptoms among adults with moderate symptom severity at the beginning of care [14]. Coaching also holds promise in preventing mental health conditions [15]. There are numerous similarities between coaching and traditional therapy [7], particularly among programs grounded in evidence-based approaches (eg, cognitive behavioral coaching) [16]. Yet, these services differ in several ways. For example, coaching philosophies build on a belief that clients are whole and resourceful and, in practice, place a greater emphasis on person-centered approaches for exploring unrealized strengths in order to maximize self-development [7]. Coaching may also be less stigmatizing than therapy for some [7,9], and stigma is a barrier to mental health care [17]. For these reasons, it is possible that some eligible individuals with mild to moderate levels of psychological distress, including anxiety, may prefer coaching over traditional psychotherapy.

Although coaching can be provided remotely, it is commonly provided in person. Logistical challenges to accessing in-person mental health care can include transportation as well as inconveniences related to timing and location [18]. Telemental health approaches, including text-based care, may address these challenges [19]. Text-based care has the added benefit of potentially allowing for more discretion and greater convenience [20], in addition to possibly allowing for more internal reflection than face-to-face sessions [20,21]. Therapy delivered via synchronous live messaging is associated with improvements in depression and anxiety [20,21]. However, its evidence is limited, and the effectiveness of live text-based coaching is even less established. Additionally, in light of research showing that video-based blended care coaching may improve mental well-being as well as symptoms of anxiety and depression [14,22], there is the possibility that text-based blended care coaching may also be effective for individuals.

Although text-based coaching may provide another care option for those who select this modality instead of currently available treatments for anxiety, there is insufficient evidence on its effectiveness. Therefore, the primary aim of this study was to assess the anxiety outcomes of an evidence-based program, in which coaching sessions were delivered via synchronous messaging (ie, live messaging coaching), among adults with moderate levels of anxiety symptoms. More specifically, this study assessed changes in anxiety symptom severity over the course of a live blended messaging coaching (BMC) program (ie, live messaging coaching combined with digital tools) and at the end of care. As a secondary objective, participants’ satisfaction with their live messaging coach was also evaluated. The results of this study will generate preliminary evidence on the potential utility of a live BMC program as an alternative mode of mental health care delivery for adults living with moderate anxiety symptoms.


Study Overview

This retrospective cohort analysis included adults (aged ≥18 years) who took part in a live BMC program that was delivered by Lyra Clinical Associates with administrative support from Lyra Health. All participants in the BMC program received coaching sessions via live messaging as opposed to video-based coaching sessions. The BMC program was provided to employees and their dependents by employers as a mental health benefit. Participants were employed by 45 unique companies that covered a variety of industry sectors. All participants were self-referred.

Ethical Considerations

The data used for this retrospective cohort analysis were deidentified, and this study was deemed exempt by the WCG IRB (Western Institutional Review Board-Copernicus Group; Puyallup, Washington). Because data were collected as a part of routine quality control for care offered by Lyra Clinical Associates, participants did not receive any compensation for either their engagement in the coaching program or the completion of assessments.

Participants

The inclusion and exclusion criteria for the blended care coaching program were described in previous research [14,22]. To summarize, potential participants were routed to the blended care coaching program through a web-based triage process involving the use of predictive modeling, as described elsewhere [22], and completed an initial battery of assessments for establishing baseline severity and appropriateness for services that included the Generalized Anxiety Disorder-7 (GAD-7) scale and the Patient Health Questionnaire-9 (PHQ-9) scale [23,24]. Participants were excluded from the program if their initial GAD-7 score was ≥15, their initial PHQ-9 score was ≥12, or their initial GAD-7 score ranged from 12 to 14 and their initial PHQ-9 score was ≥10 [14]. Additional criteria for exclusion included (1) any past hospitalizations for psychiatric reasons, (2) suicidal or homicidal ideation in the past 6 months, (3) current symptoms of posttraumatic stress disorder, (4) extensive alcohol or psychoactive substance use, (5) current violence in a relationship, (6) disclosure of concerns that mandated reporting to an external agency (eg, child or older adult abuse), or (7) individuals currently receiving treatment from a therapist.

Participants self-selected their coaching modality (ie, live messaging or live video-based coaching sessions). This study only included participants who chose to receive all coaching sessions via live messaging (ie, BMC). In addition, only participants with moderate levels of anxiety symptoms were included. Such participants were defined as those who scored ≥8 on the GAD-7 scale [25] and met the additional, previously described GAD-7 criteria on a valid baseline assessment (N=274). Participants were excluded from the analytic sample if they were escalated to therapy after the first live coaching session (eg, care needs were determined to be out of scope for BMC or participant self-referred to therapy; n=97). Of note, baseline GAD-7 scores were not significantly different between participants included in the final analytic sample (mean 9.88, SD 1.80) and those who were escalated to therapy (mean 10.12, SD 1.91; t200.38=0.95; P=.35; Multimedia Appendix 1 provides additional demographics of participants who were escalated to therapy). Participants were also excluded if they did not have a valid baseline GAD-7 score (n=7), did not have any follow-up GAD-7 scores (n=43), or only had invalid follow-up GAD-7 scores (n=6). In order to be included in the analytic sample (ie, valid scores), baseline GAD-7 scores needed to be collected within 2 weeks of the first coaching session and before the second coaching session. Follow-up GAD-7 scores were considered valid only if they were collected ≤5 weeks after the last coaching session. In addition, only ongoing GAD-7 scores that were collected within 1 SD of the average duration of the care received during the BMC program (ie, ≤9.4 weeks after the first coaching session) were included in the analytic sample. The final study sample size included 121 individuals (Figure 1).

Figure 1. Participant flowchart. BMC participants were defined as those who received all coaching sessions via live messaging over the entire course of the coaching program. BMC: blended messaging coaching; GAD-7: Generalized Anxiety Disorder-7 scale.

Blended Live Messaging Coaching Program

Program Description

The BMC program followed a 6-session model, and participants had the option to extend the program by an additional 6 coaching sessions with clinical approval (eg, because additional coaching goals were identified that were within the scope of the BMC program). Although the intended cadence of sessions was weekly or biweekly, with the tapering of sessions over time, there were no limitations on the duration of the BMC program. However, the overall length of the BMC program was subject to the total number of sessions available as part of the benefits offered by employers, which varied across different companies. Live messaging sessions were scheduled in advance and delivered via synchronous messaging between coaches and participants for a duration of 45 minutes. Participants had the option to transition to video coaching at any time (Figure 2). During live messaging sessions, coaches supported participants who wanted to enhance their mental and emotional well-being and make meaningful changes in their lives through the exchange of text messages. The specific objective of a coaching episode was co-designed by coaches and clients based on individualized needs. Coaches introduced a personalized selection of evidence-based skills and principles derived from cognitive behavioral therapy (CBT) [26], acceptance and commitment therapy (ACT) [27], and mindfulness-based stress reduction [28] while adhering to the core competencies outlined by the International Federation of Coaching, including the use of powerful questioning, planning, and goal setting [29]. The core skills and principles that were potentially offered, which are described in more detail elsewhere [22], included cognitive reappraisal and defusion techniques, values exploration, distress tolerance, mindful awareness, acceptance, opposite action, and effective communication. The introduction of skills and principles was determined by the coach and based on client case conceptualization. For example, when supporting a client struggling with anxiety in social settings, a coach may use cognitive reappraisal techniques to address the catastrophizing of social outcomes; mindful awareness practices to support the observation of internal experiences leading up to, during, and after social interactions; acceptance-based strategies to challenge the avoidance of valued social settings; distress tolerance techniques for in-the-moment coping in high-intensity circumstances; and values exploration as a reason for engaging in anxiety-provoking situations.

Figure 2. Live messaging coaching platform screen.

Between live messaging sessions, coaches had the option of sharing digital activities, such as video lessons, exercises, and handouts, to enhance in-session learnings and promote the out-of-session practice of key skills. The assignment of digital activities was personalized based on the participant goals and needs identified during the sessions. The activities included a variety of digital video lessons, exercises (eg, digitized versions of CBT worksheets), and handouts that introduced core CBT, dialectical behavior therapy, and ACT principles. Coaches provided written feedback on completed digital exercises and could engage in asynchronous messaging to provide additional support as needed, with an expected response time of 24 to 48 hours.

Coaching Training

The blended care coaching training program was described in a prior study [22]. Briefly, all coaches received approximately 60 hours of training in evidence-based techniques during an onboarding phase and participated in ongoing learning and development requirements to maintain mastery of skills. The curriculum comprised live didactic instruction on core intervention skills and case conceptualization, the review of supplemental videos and recorded demonstrations, and skills practice in a small group format and an individual format. Specific attention was given to a case conceptualization approach rooted in the ACT tradition, with a focus on psychological flexibility as a contributor to mental well-being [22]. Coaches were encouraged to think broadly about client concerns, reflect on stuck points within the core intervention skills described above, and identify approaches for skills introduction based on client presentation.

Coaches who offered the live messaging modality received an additional 15 hours of training in the delivery of an effective, impactful coaching session via written text. Building on the foundational curriculum described above, coaches demonstrated competencies in delivering evidence-based techniques in a live messaging format during a dress rehearsal session that was conducted prior to seeing clients. Coaches also received clinical consultations as needed from a clinical team of licensed mental health professionals and participated in ongoing group consultations for the duration of the time in which they offered the modality. The clinical team provided broad oversight of program quality and model fidelity through ad hoc session reviews.

Measures

Demographic data, including age, gender, and race and ethnicity, were self-reported by participants. Over the course of the BMC program, the GAD-7 scale was delivered to participants prior to scheduled coaching sessions in order to evaluate changes in anxiety symptoms. The GAD-7 scale is a 7-item self-report measure of anxiety symptom severity with strong psychometric properties [23,25]. Each item is scored on a Likert-like scale ranging from 0 (“not at all”) to 3 (“nearly every day”). Total scores on the GAD-7 scale range from 0 to 21, with higher scores indicating greater anxiety symptom severity. A GAD-7 score of ≥8 is an optimal cutoff for identifying those with generalized anxiety disorder [25]. Reliable improvement was defined as a reduction of ≥4 points from the baseline GAD-7 assessment to the final GAD-7 assessment, which aligned with the reliable change index for the GAD-7 scale that was calculated in prior research [30,31]. Recovery was defined as a final GAD-7 score <8, which is indicative of subclinical anxiety symptom severity.

Participants' satisfaction with coaching sessions was evaluated by using the following modified 1-item measure [32]: “How likely are you to recommend your Lyra coach to someone with needs similar to yours?” The response options were “Extremely unlikely,” “Unlikely,” “Neutral,” “Likely,” and “Extremely likely.” This study assessed the responses that were collected after participants’ final live messaging coaching session.

Statistical Analysis

Baseline descriptive characteristics were calculated. In addition, the average time spent in the BMC program was measured (in weeks), as was the average number of live messaging coaching sessions completed. The average number of sessions completed per week was calculated per person (ie, number of coaching sessions completed ÷ weeks in BMC) and then averaged across the entire sample. Simple change scores (final GAD-7 score − baseline GAD-7 score) were subjected to a 2-tailed paired samples t test, and changes in anxiety symptoms across the course of the BMC program were evaluated through a series of individual growth curve models [33], using the lme4 library in R 3.6.3 (R Foundation for Statistical Computing) [34]. Symptom trajectories were modeled by using a linear-quadratic base function (week + week2) . In addition, models included participant-level (level 1) random effects for the intercept, linear component (week), and quadratic component (week2) of the growth function, as well as a random effect for the intercept at the provider (ie, coach) level (level 2). The association between coaching session engagement and GAD-7 outcomes was also evaluated by entering the number of sessions completed during the previous 7 days and the previous 8 to 14 days as time-varying covariates. Finally, participant age and gender were incorporated as time-invariant covariates for predicting symptoms at baseline.


Participant Characteristics

On average, participants were aged 34.00 (SD 9.57; median 33.00; range 19-68) years. A majority of the sample self-identified as female (95/121, 78.5%), while 21.5% (26/121) self-identified as male. Of the 121 participants, 14 (11.6%) self-reported as Asian or Pacific Islander, 4 (3.3%) self-reported as Black or African American, 9 (7.4%) self-reported as Hispanic or Latino, 9 (7.4%) reported multiple racial and ethnic groups, 83 (68.6%) self-reported as White, and 2 (1.7%) did not disclose their race and ethnicity or had an unknown race and ethnicity.

Engagement and Coaching Satisfaction

Table 1 reports participants’ engagement characteristics and coaching satisfaction levels. The 121 participants who met inclusion criteria attended an average of 3.21 (SD 2.04; median 3.00) coaching sessions and were engaged in care for an average of 3.61 (SD 3.58; median 2.86) weeks. On average, participants completed 0.70 (SD 0.63; median 0.71) coaching sessions per week in BMC. The majority of participants were assigned at least one digital lesson (113/121, 93.4%) or digital exercise (99/121, 81.8%).

Overall, 33.1% (40/121) of participants reported their level of satisfaction with their coach. The mean differences in pre-post GAD-7 scores were not significantly different between those who reported satisfaction levels (mean difference 6.00, SD 3.69) and those who did not (mean difference 4.86, SD 3.66; t77.21=−1.60; P=.11). Among participants who reported satisfaction levels, most were likely (12/40, 30%) or extremely likely (25/40, 62.5%) to recommend their coach to someone with similar needs.

Table 1. Blended messaging coaching (BMC) characteristics (N=121).
CharacteristicsValue
BMC duration, mean (SD)

Number of coaching sessions3.21 (2.04)

Duration of BMC (weeks)3.61 (3.58)

Number of coaching sessions per week in BMC0.70 (0.63)
Assigned digital lessons, n (%)113 (93.4)
Assigned digital exercises, n (%)99 (81.8)
Likelihood of recommending coaching, n (%)40 (33.1)a

Extremely unlikely1 (2.5)

Unlikely0 (0)

Neutral2 (5)

Likely12 (30)

Extremely likely25 (62.5)

aNumber and proportion of participants that responded to the measure “How likely are you to recommend your Lyra coach to someone with needs similar to yours?”

Paired Samples t Test

Participants reported an average GAD-7 score of 9.88 (SD 1.80) at baseline and an average GAD-7 score of 4.64 (SD 3.41) at their final assessment, resulting in an average change of 5.24 (SD 3.70) points. A paired samples t test confirmed that this mean difference was statistically significant (t120=15.59; P<.001), and the standardized effect size was large (Hedges g=1.89).

Growth Curve Modeling

Estimates of fixed effects for the growth curve models are provided in Table 2. Model 1 was composed only of the time variables (week and week2) used to specify the growth function, and the corresponding coefficients indicated an estimated GAD-7 score bintercept of 8.47 (95% CI 8.14-8.80) at week 0. The average initial decline of GAD-7 scores was statistically significant (bweek=−1.43; 95% CI −1.64 to −1.22; P<.001), and that decline became significantly shallower (less negative) over time (bweek2=0.11; 95% CI 0.08-0.13; P<.001). Models 2 and 3 incorporated the number of coaching sessions attended during the last 7 days and the number of sessions attended during the prior 8 to 14 days as time-varying covariates. Model 2 found that each coaching session attended during the prior week was associated with significantly lower GAD-7 scores (bsessions 7=−1.26; 95% CI −1.74 to −0.78; P<.001), and model 3 found unique negative associations for sessions attended during the past week (bsessions 7=−1.56; 95% CI −2.05 to −1.06; P<.001) and sessions attended over the previous 8 to 14 days (bsessions 8 to 14=−1.03; 95% CI −1.53 to −0.52; P<.001). The inclusion of age and gender in model 3 did not significantly improve model fit, as determined by a likelihood ratio test (χ22=2.01; P=.34).

A likelihood ratio test revealed that including the random effects for the week2 coefficient resulted in a significant improvement in model fit, relative to the model 3 specification that included only random effects for the intercept and week terms (χ23=11.91, P=.01). The provider-level (ie, coach-level) random effect was estimated at 0, and likelihood ratio tests indicated that the inclusion of this parameter did not improve model fit (all P values ≥.99); however, sensitivity analyses revealed that omitting this effect had no impact on the fixed effect coefficients that were of primary interest. Parameter estimates for random effects are provided in Table 2, and the results of sensitivity analyses for comparing different configurations of random effects are reported in Multimedia Appendix 2.

Table 2. Growth curve modeling of anxiety symptoms (Generalized Anxiety Disorder-7 scale).

Model 1Model 2Model 3
Fixed effects

Intercept


Coefficient (95% CI)8.47 (8.14 to 8.80)8.76 (8.41 to 9.10)9.00 (8.64 to 9.36)


t50.7050.1048.97


P value<.001<.001<.001

Week


Coefficient (95% CI)−1.43 (−1.64 to −1.22)−1.31 (−1.53 to −1.10)−1.04 (−1.29 to −0.80)


t−13.09−11.96−8.21


P value<.001<.001<.001

Week2


Coefficient (95% CI)0.11 (0.08 to 0.13)0.09 (0.06 to 0.12)0.06 (0.03 to 0.09)


t7.206.093.71


P value<.001<.001<.001

Sessions (last 7 days)


Coefficient (95% CI)N/Aa−1.26 (−1.74 to −0.78)−1.56 (−2.05 to −1.06)


tN/A−5.14−6.19


P valueN/A<.001<.001

Sessions (last 8-14 days)


Coefficient (95% CI)N/AN/A−1.03 (−1.53 to −0.52)


tN/AN/A−3.97


P valueN/AN/A<.001
Random effects, variance (SD)

Participant-level effects


Intercept0.909 (0.953)1.045 (1.022)1.096 (1.047)


Week0.315 (0.561)0.339 (0.582)0.353 (0.594)


Week20.004 (0.063)0.005 (0.067)0.005 (0.070)

Provider-level (ie, coach-level) effects


Intercept0 (0)0 (0)0 (0)

Residual effects4.748 (2.179)4.365 (2.089)4.177 (2.044)
Log likelihood−1150.62−1138.01−1130.33
Akaike information criterion2323.242300.022286.65
Bayesian information criterion2369.342350.312341.13

aN/A: not applicable.

Reliable Improvement and Recovery

Table 3 reports end-of-care reliable improvement and recovery outcomes. By the end of the BMC program, 68.6% (83/121) of participants had a reliable improvement in their symptoms of anxiety (ie, GAD-7 score decreased by ≥4 points from the baseline assessment). Furthermore, 83.5% (101/121) of participants had subclinical levels of anxiety symptoms (ie, GAD-7 score of <8), and 66.1% (80/121) of participants experienced reliable improvement and had anxiety symptom severity drop to subclinical levels. Overall, 86% (104/121) had final GAD-7 scores that indicated reliable improvement or recovery.

Table 3. Reliable improvement and recovery in symptoms of anxiety (GAD-7a scale).

Participants (N=121), n (%)
Reliable improvementb83 (68.6)
Recoveryc101 (83.5)
Reliable improvement and recoveryd80 (66.1)
Reliable improvement or recoverye104 (86)

aGAD-7: Generalized Anxiety Disorder-7.

bA ≥4 decrease on the final GAD-7 assessment from the baseline GAD-7 assessment.

cA final GAD-7 score of <8.

dA ≥4 decrease on the final GAD-7 assessment from the baseline GAD-7 assessment and a final GAD-7 score of <8.

eA ≥4 decrease on the final GAD-7 assessment from the baseline GAD-7 assessment or a final GAD-7 score of <8.


This study found that a live BMC program was associated with significant improvements in symptoms of anxiety among adults with moderate symptoms at the beginning of care. The effect size of the average pre-post GAD-7 score change was large (Hedges g=1.89). In addition, by the end of the coaching program, 86% (104/121) of participants either had a reliable improvement in anxiety symptom severity or experienced a reduction in anxiety symptom severity to subclinical levels. The reliable improvement or recovery rate observed in this study aligned with that of a prior study on the blended care coaching program, which evaluated outcomes when coaching sessions were delivered via live video sessions and found that 88.4% of participants with elevated anxiety symptoms at baseline (ie, GAD-7 score of ≥8) recovered or had a reliable reduction in symptoms by the end of blended care coaching [14]. Our preliminary study suggests that BMC is a comparable option for adults with moderate symptoms of anxiety who opt for this care modality instead of live video blended care coaching.

This study adds to the body of mental health research on synchronous messaging interventions that include text-based therapy [35] by evaluating outcomes of a live messaging coaching program grounded in evidence-based practices. Importantly, the BMC program evaluated in this study complemented live messaging coaching sessions with between-session asynchronous messaging support and digital tools. Because coaching delivered via live messaging may provide an additional treatment option for those with mild to moderate symptom severity, future research should examine the unique components of the coaching modality that contribute to symptom improvement, including differences between synchronous and asynchronous messaging and differences between blended and nonblended live messaging coaching programs.

On average, participants completed 3.2 sessions of coaching over a span of 3.6 weeks. Each live messaging coaching session was associated with statistically significant reductions in anxiety symptoms during the same week of the session and the following week. In addition to the number of sessions, the effects of the quantity and content of the messages exchanged should be examined in future research efforts. These factors could influence coaching outcomes, as well as the relationship between the coach and the client. Prior research has found an association between coaching working alliance and numerous outcomes [36], including participants’ satisfaction with coaching and self-efficacy. In this study, over 90% (37/40, 92.5%) of participants who self-reported coaching satisfaction levels indicated that they were likely or extremely likely to recommend their coach. However, due to the high nonresponse rate, more research is needed to elucidate BMC satisfaction levels. Future studies should also determine the extent to which satisfaction levels influence outcomes of live messaging coaching programs.

The major strengths of this study include the evaluation of live messaging coaching under real-world conditions and the assessment of anxiety symptoms with a validated clinical measure. However, this study had several limitations. Although the observational nature of this study increases the generalizability of the findings, causal statements cannot be made about the live messaging program’s relationship with outcomes in the absence of a randomized controlled design. The sample size was relatively small for a real-world study. Because this program was provided as a mental health benefit to employed individuals and their dependents, the generalizability of the findings to populations outside of this sample are unknown. The generalizability is also limited because a large proportion of the eligible sample was excluded, and the sample was limited to those who remained in BMC for their entire course of care. However, the exclusion of those who were escalated to therapy calls attention to a strength of the program—the ability to triage participants who were not candidates for coaching (eg, those with more severe symptoms) to therapy. Furthermore, a benefit of including those who only received live BMC in this study was the ability to account for potential differential outcomes among those who received more than 1 care modality. As mentioned previously, only 33.1% (40/121) of participants self-reported their level of satisfaction with their coach. Although there was not a statistically significant difference in the average pre-post GAD-7 score change between those who reported coaching satisfaction levels and those who did not (P=.11), these findings may still be prone to nonresponse bias. Finally, although ad hoc sessions reviews were performed to assess model fidelity, there were no formal coaching fidelity measures. Therefore, this study was unable to systematically assess the extent to which coaches adhered to evidence-based approaches.

In summary, this study suggests that BMC may be beneficial for adults who are candidates for coaching and present with moderate levels of anxiety symptoms. As a program that provides another care option for those experiencing symptoms of anxiety, a large-scale outcome evaluation is warranted. Future research should also evaluate outcomes after a longer follow-up postcare period and assess program effectiveness for additional conditions (eg, depression and stress). The extent to which working alliance is established and contributes to outcomes in a BMC program also warrants further investigation, especially given the brief duration of BMC and the unique treatment delivery method. Finally, to optimize outcomes, research on program mechanisms of change is also needed.

Data Availability

Because the blended messaging coaching program is an employer-offered mental health benefit, the data sets generated and analyzed during this study are not publicly available.

Conflicts of Interest

JTO, PW, SFS, JLL, CC, and AL are salaried employees of Lyra Health and have been granted equity in Lyra Health. SFS and CC are also salaried employees of Lyra Clinical Associates. REW serves as a paid consultant to Lyra Health.

Multimedia Appendix 1

Participant characteristics of subsample escalated to therapy.

DOCX File , 14 KB

Multimedia Appendix 2

Sensitivity analyses (comparison of growth curve model random effects).

DOCX File , 14 KB

  1. World Health Organization. Depression and other common mental disorders: Global health estimates. World Health Organization.   URL: https://apps.who.int/iris/bitstream/handle/10665/254610/WHO-MSD-MER-2017.2-eng.pdf [accessed 2023-01-10]
  2. Deady M, Collins DAJ, Johnston DA, Glozier N, Calvo RA, Christensen H, et al. The impact of depression, anxiety and comorbidity on occupational outcomes. Occup Med (Lond) 2022 Jan 13;72(1):17-24. [CrossRef] [Medline]
  3. Horenstein A, Heimberg RG. Anxiety disorders and healthcare utilization: A systematic review. Clin Psychol Rev 2020 Nov;81:101894. [CrossRef] [Medline]
  4. Bandelow B, Sagebiel A, Belz M, Görlich Y, Michaelis S, Wedekind D. Enduring effects of psychological treatments for anxiety disorders: meta-analysis of follow-up studies. Br J Psychiatry 2018 Jun;212(6):333-338. [CrossRef] [Medline]
  5. Alonso J, Liu Z, Evans-Lacko S, Sadikova E, Sampson N, Chatterji S, WHO World Mental Health Survey Collaborators. Treatment gap for anxiety disorders is global: Results of the World Mental Health Surveys in 21 countries. Depress Anxiety 2018 Mar;35(3):195-208 [FREE Full text] [CrossRef] [Medline]
  6. Olfson M, Blanco C, Wall MM, Liu SM, Grant BF. Treatment of common mental disorders in the United States: Results from the National Epidemiologic Survey on Alcohol and Related Conditions-III. J Clin Psychiatry 2019 May 28;80(3):18m12532 [FREE Full text] [CrossRef] [Medline]
  7. Hart V, Blattner J, Leipsic S. Coaching versus therapy: A perspective. Consulting Psychology Journal: Practice and Research 2001;53(4):229-237. [CrossRef]
  8. Neenan M. Introduction to the special issue on cognitive-behavioural coaching. J Ration Emot Cogn Behav Ther 2008 Feb 27;26:1-2. [CrossRef]
  9. McKelley RA, Rochlen AB. The practice of coaching: Exploring alternatives to therapy for counseling-resistant men. Psychol Men Masc 2007;8(1):53-65. [CrossRef]
  10. Grant AM, Cavanagh MJ, Parker HM, Passmore J. The state of play in coaching today: A comprehensive review of the field. In: Hodgkinson GP, Ford JK, editors. International Review of Industrial and Organizational Psychology 2010, Volume 25. Hoboken, New Jersey: John Wiley & Sons Ltd; Mar 01, 2010:125-167.
  11. Grant AM. The impact of life coaching on goal attainment, metacognition and mental health. Soc Behav Pers 2003 Jan 01;31(3):253-263. [CrossRef]
  12. Theeboom T, Beersma B, van Vianen AEM. Does coaching work? A meta-analysis on the effects of coaching on individual level outcomes in an organizational context. J Posit Psychol 2013 Sep 13;9(1):1-18. [CrossRef]
  13. Gyllensten K, Palmer S. Can coaching reduce workplace stress? A quasi-experimental study. International Journal of Evidence Based Coaching and Mentoring 2005;3(2):75-85.
  14. Wu MS, Chen SY, Wickham RE, O'Neil-Hart S, Chen C, Lungu A. Outcomes of a blended care coaching program for clients presenting with moderate levels of anxiety and depression: Pragmatic retrospective study. JMIR Ment Health 2021 Oct 21;8(10):e32100 [FREE Full text] [CrossRef] [Medline]
  15. Palmer S, Gyllensten K. How cognitive behavioural, rational emotive behavioural or multimodal coaching could prevent mental health problems, enhance performance and reduce work related stress. J Ration Emot Cogn Behav Ther 2008 Mar 4;26:38-52. [CrossRef]
  16. Neenan M. From cognitive behaviour therapy (CBT) to cognitive behaviour coaching (CBC). J Ration Emot Cogn Behav Ther 2008 Feb 23;26:3-15. [CrossRef]
  17. Mojtabai R, Olfson M, Sampson NA, Jin R, Druss B, Wang PS, et al. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol Med 2011 Aug;41(8):1751-1761 [FREE Full text] [CrossRef] [Medline]
  18. Harvey AG, Gumport NB. Evidence-based psychological treatments for mental disorders: modifiable barriers to access and possible solutions. Behav Res Ther 2015 May;68:1-12 [FREE Full text] [CrossRef] [Medline]
  19. Schwartzman CM, Boswell JF. A narrative review of alliance formation and outcome in text-based telepsychotherapy. Pract Innov (Wash D C) 2020 Jun;5(2):128-142 [FREE Full text] [CrossRef]
  20. Cohen GE, Kerr BA. Computer-mediated counseling: An empirical study of a new mental health treatment. Computers in Human Services 1999;15(4):13-26. [CrossRef]
  21. Kessler D, Lewis G, Kaur S, Wiles N, King M, Weich S, et al. Therapist-delivered internet psychotherapy for depression in primary care: a randomised controlled trial. Lancet 2009 Aug 22;374(9690):628-634. [CrossRef] [Medline]
  22. Lungu A, Boone MS, Chen SY, Chen CE, Walser RD. Effectiveness of a cognitive behavioral coaching program delivered via video in real world settings. Telemed J E Health 2021 Jan;27(1):47-54 [FREE Full text] [CrossRef] [Medline]
  23. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
  24. Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [CrossRef] [Medline]
  25. Plummer F, Manea L, Trepel D, McMillan D. Screening for anxiety disorders with the GAD-7 and GAD-2: a systematic review and diagnostic metaanalysis. Gen Hosp Psychiatry 2016;39:24-31. [CrossRef] [Medline]
  26. Barlow DH, Farchione TJ, Sauer-Zavala S, Latin HM, Ellard KK, Bullis JR, et al. Unified Protocol for Transdiagnostic Treatment of Emotional Disorders: Therapist Guide (2 Edn). New York, NY: Oxford University Press; Nov 2017.
  27. Hayes SC, Strosahl KD, Wilson KG. Acceptance and Commitment Therapy 2nd Edition: The Process and Practice of Mindful Change. New York, NY: Guilford Press; 2011.
  28. Kabat-Zinn J, Hanh TN. Full Catastrophe Living: Using the Wisdom of Your Body and Mind to Face Stress, Pain, and Illness. New York, NY: Delta; 2009.
  29. International Coaching Federation. Updated ICF core competencies. International Coaching Federation. 2019 Oct.   URL: https:/​/coachingfederation.​org/​app/​uploads/​2021/​07/​Updated-ICF-Core-Competencies_English_Brand-Updated.​pdf [accessed 2023-01-10]
  30. Gyani A, Shafran R, Layard R, Clark DM. Enhancing recovery rates: lessons from year one of IAPT. Behav Res Ther 2013 Sep;51(9):597-606 [FREE Full text] [CrossRef] [Medline]
  31. Jacobson NS, Truax P. Clinical significance: a statistical approach to defining meaningful change in psychotherapy research. J Consult Clin Psychol 1991 Feb;59(1):12-19. [CrossRef] [Medline]
  32. Reichheld FF. The one number you need to grow. Harv Bus Rev 2003 Dec;81(12):46-54, 124. [Medline]
  33. Singer JD, Willett JB. Applied Longitudinal Data Analysis: Modeling Change and Event Occurrence. New York, NY: Oxford University Press; 2003.
  34. Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. J Stat Softw 2015;67(1):1-48. [CrossRef]
  35. Hoermann S, McCabe KL, Milne DN, Calvo RA. Application of synchronous text-based dialogue systems in mental health interventions: Systematic review. J Med Internet Res 2017 Jul 21;19(8):e267 [FREE Full text] [CrossRef] [Medline]
  36. Graßmann C, Schölmerich F, Schermuly CC. The relationship between working alliance and client outcomes in coaching: A meta-analysis. Hum Relat 2019 Feb 22;73(1):35-58 [FREE Full text] [CrossRef]


ACT: acceptance and commitment therapy
BMC: blended messaging coaching
CBT: cognitive behavioral therapy
GAD-7: Generalized Anxiety Disorder-7
PHQ-9: Patient Health Questionnaire-9


Edited by A Mavragani; submitted 08.11.22; peer-reviewed by JC Perez, J Eastwood; comments to author 29.11.22; revised version received 20.12.22; accepted 22.12.22; published 01.02.23

Copyright

©Jocelynn T Owusu, Pam Wang, Robert E Wickham, Sarah F Smith, Jennifer L Lee, Connie Chen, Anita Lungu. Originally published in JMIR Formative Research (https://formative.jmir.org), 01.02.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.