This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (2491) Innovations in Mental Health Systems (398) Users' and Patients' Needs for Mental Health Services (409) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1565)

Published on in Vol 6, No 5 (2022): May

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/36203, first published .
Digital Mental Health Intervention Plus Usual Care Compared With Usual Care Only and Usual Care Plus In-Person Psychological Counseling for Orthopedic Patients With Symptoms of Depression or Anxiety: Cohort Study

Digital Mental Health Intervention Plus Usual Care Compared With Usual Care Only and Usual Care Plus In-Person Psychological Counseling for Orthopedic Patients With Symptoms of Depression or Anxiety: Cohort Study

Digital Mental Health Intervention Plus Usual Care Compared With Usual Care Only and Usual Care Plus In-Person Psychological Counseling for Orthopedic Patients With Symptoms of Depression or Anxiety: Cohort Study

Authors of this article:

Ashwin J Leo1 Author Orcid Image ;   Matthew J Schuelke2 Author Orcid Image ;   Devyani M Hunt3 Author Orcid Image ;   J Philip Miller2 Author Orcid Image ;   Patricia A Areán4 Author Orcid Image ;   Abby L Cheng3 Author Orcid Image
Article Authors Cited by (12) Tweetations (5) Metrics

    Original Paper

    1Washington University in St Louis School of Medicine, St Louis, MO, United States

    2Division of Biostatistics, Washington University in St Louis School of Medicine, St Louis, MO, United States

    3Division of Physical Medicine and Rehabilitation, Department of Orthopaedic Surgery, Washington University in St Louis School of Medicine, St Louis, MO, United States

    4Department of Psychiatry and Behavioral Sciences, University of Washington, Seattle, WA, United States

    Corresponding Author:

    Abby L Cheng, MD, MPHS

    Division of Physical Medicine and Rehabilitation

    Department of Orthopaedic Surgery

    Washington University in St Louis School of Medicine

    Box MSC 8233-0004-05

    660S S Euclid Ave

    St Louis, MO, 63110

    United States

    Phone: 1 3147472823

    Email: ChengAL@wustl.edu


    Background: Depression and anxiety frequently coexist with chronic musculoskeletal pain and can negatively impact patients’ responses to standard orthopedic treatments. Nevertheless, mental health is not routinely addressed in the orthopedic care setting. If effective, a digital mental health intervention may be a feasible and scalable method of addressing mental health in an orthopedic setting.

    Objective: We aimed to compare 2-month changes in mental and physical health between orthopedic patients who received a digital mental health intervention in addition to usual orthopedic care, those who received usual orthopedic care only (without a specific mental health intervention), and those who received in-person care with a psychologist as part of their orthopedic treatment plan.

    Methods: In this single-center retrospective cohort study involving ancillary analysis of a pilot feasibility study, 2-month self-reported health changes were compared between a cohort of orthopedic patients who received access to a digital mental health intervention (Wysa) and 2 convenience sample comparison cohorts (patients who received usual orthopedic care without a specific mental health intervention and patients who received in-person care with a psychologist as part of their orthopedic treatment plan). All patients were 18 years or older and reported elevated symptoms of depression or anxiety at an orthopedic clinic visit (Patient-Reported Outcomes Measurement Information System [PROMIS] Depression or Anxiety score ≥55). The digital intervention was a multi-component mobile app that used chatbot technology and text-based access to human counselors to provide cognitive behavioral therapy, mindfulness training, and sleep tools, among other features, with an emphasis on behavioral activation and pain acceptance. Outcomes of interest were between-cohort differences in the 2-month longitudinal changes in PROMIS Depression and Anxiety scores (primary outcomes) and PROMIS Pain Interference and Physical Function scores (secondary outcomes).

    Results: Among 153 patients (mean age 55, SD 15 years; 128 [83.7%] female; 51 patients per cohort), patients who received the digital mental health intervention showed clinically meaningful improvements at the 2-month follow-up for all PROMIS measures (mean longitudinal improvement 2.8-3.7 points; P≤.02). After controlling for age and BMI, the improvements in PROMIS Depression, Pain Interference, and Physical Function were meaningfully greater than longitudinal changes shown by patients who received usual orthopedic care (mean between-group difference 2.6-4.8 points; P≤.04). Improvements in PROMIS Physical Function were also meaningfully greater than longitudinal changes shown by patients who received in-person psychological counseling (mean between-group difference 2.4 points; P=.04).

    Conclusions: Patients who received a digital mental health intervention as part of orthopedic care reported greater 2-month mean improvements in depression, pain interference, and physical function than patients who received usual orthopedic care. They also reported a greater mean improvement in physical function and comparable improvements in depression, anxiety, and pain interference compared with orthopedic patients who received in-person psychological counseling.

    JMIR Form Res 2022;6(5):e36203

    doi:10.2196/36203

    Keywords

    digital health; mental health; depression; anxiety; chronic pain; musculoskeletal; orthopedic 


    Background

    Symptoms of depression and anxiety commonly coexist with chronic musculoskeletal pain. When this occurs, traditional mental health treatments are less effective in reducing psychological impairment, and traditional musculoskeletal treatments are less effective in addressing physical symptoms [1-5]. Specifically within the field of orthopedic care, pre-existing symptoms of depression or anxiety are associated with poor outcomes, such as worse postintervention physical functioning, increased postoperative opioid use, and reduced return-to-work rates [6-8]. Awareness of this phenomenon is growing, but mental health screening and intervention is still not considered a standard part of orthopedic care [9]. Barriers include orthopedic providers’ lack of time and available mental health resources to offer; patients’ financial resources, transportation, time, and stigma-related barriers to seeking mental health care, especially in person; and a national shortage of qualified mental health providers [9-11].

    A digital mental health intervention is a promising tool to improve access to mental health care because it is not affected by many of the barriers that limit in-person care. That is, providers can easily refer patients to a digital resource because it is not limited by physical location or wait times, and patient challenges related to transportation, time, and fear of stigma are reduced and, in some cases, eliminated by enabling access to care without requiring travel to an in-person provider [12,13]. Furthermore, in a single-arm prospective pilot study, we demonstrated that delivery of a digital mental health intervention (Wysa) within an outpatient orthopedic care setting is feasible and preliminary effectiveness analyses are promising [14].

    Outside the orthopedic setting, existing evidence supports the effectiveness of digital mental health interventions, but the effect size varies depending on the comparison arm, for instance, an inactive “usual care” or waitlist control group, or an active “gold standard” in-person counseling treatment group [15-17]. Therefore, the literature repeatedly calls for more comparison between digital mental health interventions and real-world treatment alternatives, both in the general population of people with symptoms of depression and anxiety and in those with coexisting symptoms of chronic pain [12,18-21]. To further understand the potential for introducing a digital mental health intervention within the context of orthopedic care, clinical improvements observed in our pilot study need to be compared to improvements made by comparable patients who received usual orthopedic care (without a dedicated mental health intervention) and by patients who received in-person mental health care as part of their orthopedic treatment plan. This added information would provide insight regarding whether a digital mental health intervention provides added clinical benefit compared with usual orthopedic care, and if so, whether that benefit is less than, equivalent to, or even superior to in-person mental health care that is offered in a similar setting.

    Objective

    The purpose of this study was to compare 2-month changes in mental and physical health between orthopedic patients who received a digital mental health intervention (Wysa) in addition to usual orthopedic care, those who received usual orthopedic care only (without any specific mental health intervention), and those who received in-person care with a psychologist as part of their orthopedic treatment plan. We hypothesized that compared with patients who received usual care, orthopedic patients who were also provided a digital mental health intervention would report greater improvements in mental and physical health at a 2-month follow-up. Additionally, we hypothesized that compared with orthopedic patients who established in-person care with a psychologist, orthopedic patients who were provided a digital mental health intervention would report comparable improvements in mental and physical health at a 2-month follow-up.


    Study Design

    This was a retrospective study that involved ancillary analysis of data collected from a single-arm pilot feasibility study and other existing medical record data (ClinicalTrials.gov NCT04640090) [14]. All patients were evaluated within the orthopedic department of a single tertiary care academic medical center (Washington University) in the United States between 2017 and 2021.

    Ethics Approval

    Washington University institutional review board approval was obtained prior to data collection (IRB #202005219).

    Participants

    General Eligibility Criteria

    All study participants were adults aged 18 years or older who presented to a nonoperative subspecialty-trained orthopedic provider for evaluation and management of musculoskeletal pain. As part of usual care, all patients who present to the orthopedic department of the study institution complete Patient-Reported Outcomes Measurement Information System (PROMIS) Depression and Anxiety measures prior to clinician evaluation. Only patients who self-reported elevated symptoms of depression or anxiety, as defined by scores of 55 or above on either measure or both measures, were eligible.

    Digital Mental Health Intervention (Wysa) Cohort

    The primary cohort of interest included patients who enrolled in a single-arm, prospective cohort, pilot feasibility study in which they received 2 months of complimentary access to a digital mental health intervention (Wysa), in addition to their usual orthopedic care. The intervention and this cohort have previously been described [14]. In brief, Wysa is a multi-component mobile app based on the principles of cognitive behavioral therapy, mindfulness, and motivational interviewing [22-24]. It includes an artificial intelligence–based “chatbot” conversational agent and text-based access to human “coach” counselors who have master’s degrees in psychology. A commercial version of the app exists, but for the pilot study, additional novel features were incorporated to specifically tailor the experience for people with chronic pain. Additional features were based on the principles of behavioral activation and pain acceptance [25-30]. These patients were recruited for the pilot study between December 8, 2020, and July 14, 2021. Patients who were planning to start in-person psychological treatment were excluded from the pilot study, and only 51 of 61 (84%) enrolled patients who completed 2-month PROMIS follow-up assessments were eligible for this ancillary analysis. While the majority of patients engaged with the intervention multiple times during the study period [14], lack of engagement with the intervention was not an exclusion criterion.

    Usual Orthopedic Care Cohort

    The Wysa cohort was compared to a “usual orthopedic care” cohort, which was a convenience sample of patients who presented to the same orthopedic clinics as those who enrolled in the prospective Wysa study but on days during which recruitment for the Wysa study was not occurring. In these clinics, “usual orthopedic care” most commonly includes physical therapy, medications (eg, nonsteroidal anti-inflammatory drugs, oral steroids, and neuropathic pain medications), and steroid injections, as appropriate. Other less commonly recommended procedures include radiofrequency ablation, manual massage, and acupuncture. These patients could have been presenting for a new or follow-up evaluation (just like in the Wysa cohort), but their orthopedic management plan could not have included any dedicated mental health management, such as counseling or a digital intervention. Furthermore, follow-up PROMIS Depression and Anxiety scores had to be documented in the medical record between 1 and 3 months after the initial evaluation. If scores from multiple dates were available, the scores closest to a 2-month follow-up duration were selected for analysis. Patients who presented for an acute injury or a procedure were excluded. Patients in this cohort were identified consecutively via a reverse chronological medical record review until a sample size of 51 patients (matching the Wysa cohort) was reached. As a result, the baseline clinic date for patients in this cohort spanned September 16, 2021, to December 10, 2021, with a mean follow-up time of 56 (SD 9) days.

    In-Person Psychological Counseling (“Gold Standard”) Cohort

    The Wysa cohort was also compared to a “gold standard” cohort that received in-person psychological counseling as part of the orthopedic treatment plan. This was also a convenience sample of patients who presented to the same orthopedic clinics as those who enrolled in the prospective Wysa study. However, as part of their orthopedic treatment plan, they initiated in-person psychological counseling with a licensed clinical psychologist having over 20 years of experience. The psychologist delivered cognitive behavioral therapy, motivational interviewing, and mindfulness and deep breathing training, as indicated, during treatment sessions. This unique service was available through a lifestyle medicine–based center within the study institution’s orthopedic department [31]. The center’s purpose is to help patients manage musculoskeletal conditions by addressing underlying lifestyle habits and biopsychosocial comorbidities that contribute to musculoskeletal pain. To be eligible for this study, patients in this cohort had to have completed their evaluation with the psychologist within 2 weeks of completing baseline PROMIS Depression and Anxiety measures, and they had to have completed at least one follow-up session with the psychologist prior to the follow-up date designated for this study. For patients with PROMIS scores at numerous time points, scores obtained closest to the initial psychology evaluation and to a 2-month follow-up duration were selected for analysis. Patients were identified consecutively via a reverse chronological medical record review until a sample size of 51 patients (matching the Wysa cohort) was reached. As a result, the baseline clinic date for patients in this cohort spanned August 21, 2017, to September 20, 2021, with a mean follow-up time point of 62 (SD 19) days later.

    Variables

    As previously described, PROMIS scores from the Wysa cohort were collected prospectively during the pilot feasibility study. The rest of the data from all 3 cohorts were obtained from a medical record review of information collected as standard care during patients’ clinical encounters. All data extraction from patients’ medical records was performed by a single study team member (AJL). Patients’ self-reported mental and physical health was measured using the PROMIS Computer Adaptive Test (CAT) Adult Depression v1.0, Anxiety v1.0, Pain Interference v1.1, and Physical Function v2.0 measures [32-36]. PROMIS scores were normalized to the general US population, with a mean of 50 and SD of 10. Higher scores represent “more” of the domain [37]. For example, high scores on PROMIS Depression are unfavorable, but high scores on PROMIS Physical Function are favorable. Descriptive variables collected included demographics (age, sex, race, ethnicity, and Area Deprivation Index [38,39]), BMI, pain location and duration, and medical history (hypertension, hyperlipidemia, heart disease, lung disease, diabetes, sleep apnea, depression, and anxiety).

    Outcomes

    The primary outcomes were the between-cohort differences in 2-month longitudinal change in PROMIS Depression and Anxiety scores. The secondary outcomes were the between-cohort differences in 2-month longitudinal change in PROMIS Pain Interference and Physical Function scores. Minimum clinically meaningful effect sizes were a priori set to match thresholds used in the pilot feasibility study, which were determined from previously published literature in conservatively managed orthopedic patients with chronic musculoskeletal pain. Minimum meaningful effect sizes were defined as at least 3.2 points on PROMIS Depression, 3.0 points on PROMIS Anxiety, 2.0 points on PROMIS Pain Interference, and 2.2 points on PROMIS Physical Function [40-42]. Between-cohort differences in baseline descriptive variables were examined, as well.

    Statistical Analysis

    Univariate descriptive statistics per cohort were calculated for all baseline study variables. Differences between the “digital mental health intervention” cohort and each of the 2 comparison cohorts (“usual orthopedic care” and “in-person psychological counseling”) were calculated as either mean differences via Welch 2-sample t tests or percentage differences via 2-sample t tests for equality of proportions with Yates’ continuity correction. Average within-person changes in PROMIS scores in each cohort were calculated using paired t tests. Comparisons of the 2-month change in PROMIS scores between the “digital mental health intervention” cohort and each of the 2 comparison cohorts were assessed with linear mixed models. Mean longitudinal changes in health were estimated via slope coefficients, and comparisons of slopes were tested with time by cohort interaction terms. Initially, age and BMI (as a marker for metabolic health) were added to the models as covariates because these baseline characteristics were different between cohorts. However, these adjustments failed to alter the models in a statistically or clinically meaningful way, so unadjusted models are reported. Missing baseline descriptive data were omitted from relevant analyses. One participant in the “in-person psychological counseling” cohort was missing the follow-up PROMIS Depression score. Median imputation was performed for this single value. Significance was a priori set at P<.05. The sample size for each cohort was set to match the available sample size of the Wysa cohort. Data were collected using Research Electronic Data Capture (REDCap) [43,44], and statistical analyses were performed using R (v4.0.2, R Core Team).


    Patient Characteristics

    Of the 153 patients included, the mean age was 55 (SD 15) years (range 18-86 years), and 128 (83.7%) were female. Compared with the cohort that received usual orthopedic care, patients who received the digital mental health intervention (Wysa) had a higher prevalence of sleep apnea (14/51, 27% vs 5/50, 10%; percent difference 18%, 95% CI 1%-34%; P=.05), but otherwise, had similar demographic, musculoskeletal, and medical characteristics (Table 1). Compared with the cohort that received in-person counseling, patients who received the digital mental health intervention were somewhat younger (mean age 53.2 vs 59.5 years; mean difference −6.4 years, 95% CI −12.0 to −0.4; P=.03), were less likely to have low back pain (28/51, 55% vs 42/51, 82%; percent difference −28%, 95% CI −47% to −8%; P=.006), had a lower BMI (indicative of obesity; mean 29.1 kg/m2 vs 38.1 kg/m2; mean difference −9.0, 95% CI −12.1 to −6.0; P<.001), and had a lower prevalence of both hypertension (21/50, 42% vs 36/47, 77%; percent difference −35%, 95% CI −55% to −14%; P=.001) and sleep apnea (14/51, 27% vs 28/50, 56%; percent difference −29%, 95% CI −49% to −8%; P=.007). There were no meaningful between-cohort differences in the proportion of patients who had a documented diagnosis of depression or anxiety.

    Table 1. Sociodemographic and medical history characteristics in the 3 cohorts of patients.
    CharacteristicDigital mental health intervention (n=51)Usual orthopedic care (n=51)In-person psychological counseling (n=51)

    		Value, mean (SD) or n/N (%)Value, mean (SD) or n/N (%)MDa (95% CI) or % Diffb (95% CI)cP valuecValue, mean (SD) or n/N (%)MD (95% CI) or % Diff (95% CI)cP valuec
    Age (years)53.2 (14.6)52.7 (15.6)−0.4 (−6.3 to 5.5).8959.5 (14.1)6.4 (0.4 to 12.0).03
    Sex







    		Female44/51 (86)43/51 (84)−2% (−18 to 14)>.9941/51 (80)−6% (−22 to 11).60

    		Male7/51 (14)8/51 (16)2% (−14 to 18)>.9910/51 (20)6% (−11 to 22).60
    Race







    		White46/51 (90)43/51 (84)−6% (−21 to 9).5541/51 (80)−10% (−25 to 6).26

    		Black5/51 (10)6/51 (12)2% (−12 to 16)>.998/51 (16)6% (−9 to 21).55

    		Asian0/51 (0)1/51 (2)2% (−4 to 8)>.991/51 (2)2% (−4 to 8)>.99

    		Other0/51 (0)1/51 (2)2% (−4 to 8)>.991/51 (2)2% (−4 to 8)>.99
    Ethnicity







    		Hispanic2/51 (4)0/51 (0)−4% (−11 to 3).481/51 (2)−2% (−11 to 7)>.99

    		Not Hispanic49/51 (96)51/51 (100)4% (−3 to 11).4850/51 (98)2% (−7 to 11)>.99
    Area Deprivation Indexd







    		Quartile 1 (least deprived)17/51 (33)12/51 (24)−10% (−29 to 10).3818/51 (35)2% (−18 to 22)>.99

    		Quartile 216/51 (31)23/51 (45)14% (−7 to 34).2219/51 (37)6% (−15 to 26).68

    		Quartile 310/51 (20)9/51 (18)−2% (−19 to 15)>.999/51 (18)−2% (−19 to 15)>.99

    		Quartile 4 (most deprived)8/51 (16)7/51 (14)−2% (−18 to 147)>.995/51 (10)−6% (−21 to 9).55
    Pain duration (years)6.8 (8.2)8.1 (6.5)1.4 (−1.6 to 4.3).368.4 (7.3)1.6 (−1.5 to 4.7).30
    Pain locatione







    		Low back28/51 (55)31/51 (61)6% (−15 to 27).6942/51 (82)28% (8 to 47).006

    		Leg38/51 (75)37/51 (73)−2% (−21 to 17)>.9943/51 (84)10% (−8 to 27).33

    		Neck16/51 (31)11/51 (22)−10% (−29 to 9).379/51 (18)−14% (−32 to 5).17

    		Arm14/51 (27)10/51 (20)−8% (−26 to 11).489/51 (18)−10% (−28 to 8).34

    		Generalized pain5/51 (10)4/51 (8)−2% (−15 to 11)>.997/51 (14)4% (−11 to 18).76
    BMI (kg/m2)29.1 (7.2)26.9 (6.4)−2.3 (−4.9 to 0.4).1038.1 (8.4)9.0 (6.0 to 12.1)<.001
    Medical history







    		Hypertension21/50 (42)20/48 (42)0% (−20 to 20)>.9936/47 (77)35% (14 to 55).001

    		Hyperlipidemia31/49 (63)30/48 (64)−1% (−21 to 19)>.9936/46 (78)15% (−5 to 35).17

    		Cardiovascular disease7/50 (14)8/50 (16)2% (−14 to 18)>.999/50 (18)4% (−12 to 20).79

    		Lung disease5/51 (10)4/51 (8)−2% (−15 to 11)>.996/50 (12)2% (−12 to 16).97

    		Diabetes5/48 (10)6/47 (13)2% (−13 to 17).9713/46 (28)18% (0 to 36).053

    		Sleep apnea14/51 (27)5/50 (10)−18% (−34 to −1).0528/50 (56)29% (8 to 49).007

    		Depression33/50 (66)33/50 (66)0% (−19 to 19)>.9937/49 (76)10% (−10 to 230).41

    		Anxiety36/50 (72)38/49 (78)6% (−14 to 25).6936/46 (78)6% (−13 to 26).64

    aMD: mean difference.

    b% Diff: percent difference.

    cAll bivariate analyses involve comparisons with the “digital mental health intervention” group.

    dThe national Area Deprivation Index is a neighborhood-level measure of social disadvantage based on a person’s US Census Block Group [38,39].

    eSome patients reported multiple pain locations.

    Primary Outcomes: Mental Health

    On average, patients who received the digital mental health intervention showed clinically meaningful improvements in PROMIS Depression (mean longitudinal change −3.5 points, 95% CI −5.9 to −1.1; P=.006) and Anxiety (−3.7 points, 95% CI −5.9 to −1.4; P=.002) scores at the 2-month follow-up, whereas patients who received usual orthopedic care did not show clinically meaningful improvements in these measures, and patients who received in-person psychological counseling only showed meaningful improvements in PROMIS Depression scores (−3.8 points, 95% CI −5.9 to −1.6; P=.001) (Table 2). Furthermore, patients who received the digital mental health intervention showed meaningfully greater mean improvements in PROMIS Depression (but not Anxiety) scores than patients who received usual orthopedic care (mean between-group difference −4.8 points, 95% CI −7.6 to −1.9; P=.001), and there were no statistically significant or clinically meaningful between-group differences in longitudinal improvements in PROMIS Depression or Anxiety scores between patients who received the digital mental health intervention and those who received in-person psychological counseling (Table 3; Figures 1 and 2). Adjusting for age and BMI did not have a statistically or clinically meaningful effect on these results.

    Table 2. Mental and physical health changes (measured by the Patient-Reported Outcomes Measurement Information System) across a 2-month follow-up in the 3 cohorts of patients (n=51 for each patient cohort).
    PROMISa domainbBaseline score, mean (SE)2-month follow-up score, mean (SE)Within-group longitudinal change, mean (95% CI)P value
    Depression




    		Digital mental health intervention58.2 (6.8)54.7 (8.7)−3.5 (−5.9 to −1.1).006

    		Usual orthopedic care54.0 (7.1)55.3 (6.6)1.3 (−2.9 to 0.4).12

    		In-person psychological counseling52.3 (9.9)48.4 (10.7)−3.8 (−5.9 to −1.7).001
    Anxiety




    		Digital mental health intervention61.7 (5.8)58.0 (7.8)−3.7 (−5.9 to −1.4).002

    		Usual orthopedic care61.1 (5.8)59.1 (7.0)−2.0 (−3.6 to −0.4).02

    		In-person psychological counseling54.7 (10.4)52.9 (11.5)−1.8 (−3.7 to 0.1).06
    Pain Interference




    		Digital mental health intervention64.9 (6.4)62.1 (7.0)−2.8 (−5.2 to −0.4).02

    		Usual orthopedic care66.0 (5.2)65.8 (5.0)−0.2 (−1.4 to 1.1).77

    		In-person psychological counseling64.7 (6.4)63.1 (6.4)−1.6 (−3.0 to −0.2).03
    Physical Function




    		Digital mental health intervention36.1 (6.5)39.5 (6.7)3.3 (1.3 to 5.4).002

    		Usual orthopedic care35.1 (6.9)35.7 (6.6)0.6 (−1.0 to 2.3).45

    		In-person psychological counseling34.1 (6.1)35.0 (5.9)1.0 (−0.1 to 2.0).08

    aPROMIS: Patient-Reported Outcomes Measurement Information System.

    bHigher scores on PROMIS Depression, Anxiety, and Pain Interference indicate worse symptoms. Higher scores on PROMIS Physical Function indicate better function. Clinically meaningful effect sizes are defined as at least 3.2 points for PROMIS Depression, 3.0 points for Anxiety, 2.0 points for Pain Interference, and 2.2 points for Physical Function [40-42].

    Table 3. Between-group differences in 2-month mental and physical health symptom changes in the 3 cohorts of patients.
    PROMISa domainbDigital mental health intervention (n=51)Usual orthopedic care (n=51)In-person psychological counseling (n=51)

    		Mean longitudinal changeMean longitudinal changeMean between-group differencec95% CIcP valuecMean longitudinal changeMean between-group differencec95% CIcP valuec
    Depressiond−3.51.3−4.8−7.6 to −1.9.001−3.80.3−2.6 to 3.2.83
    Anxiety−3.7−2.0−1.6−4.3 to 1.1.23−1.8−1.9−4.5 to 0.8.18
    Pain Interference−2.8−0.2−2.6−5.1 to −0.2.04−1.6−1.2−3.6 to 1.2.34
    Physical Function3.30.62.70.5 to 5.0.021.02.40.2 to 4.7.04

    aPROMIS: Patient-Reported Outcomes Measurement Information System.

    bClinically meaningful effect sizes are defined as at least 3.2 points for PROMIS Depression, 3.0 points for Anxiety, 2.0 points for Pain Interference, and 2.2 points for Physical Function [40-42].

    cAll bivariate analyses involve comparisons with the “digital mental health intervention” group.

    dOne participant in the “in-person psychological counseling” cohort was missing the follow-up PROMIS Depression score. Median imputation was performed for this single value.

    ‎
    Figure 1. Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Depression scores over a 2-month follow-up in patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. Error bars represent standard error.
    View this figure
    ‎
    Figure 2. Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Anxiety scores over a 2-month follow-up in patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). Error bars represent standard error.
    View this figure

    Secondary Outcomes: Physical Health

    On average, patients who received the digital mental health intervention showed clinically meaningful improvements in PROMIS Pain Interference (mean longitudinal change −2.8 points, 95% CI −5.2 to −0.4; P=.02) and Physical Function (3.3 points, 95% CI 1.3 to 5.4; P=.002) scores at the 2-month follow-up, whereas patients who received usual orthopedic care or in-person psychological counseling in conjunction with usual orthopedic care did not show meaningful improvements in these measures (Table 2). Furthermore, patients who received the digital mental health intervention showed meaningfully greater mean improvements in PROMIS Pain Interference scores than patients who received usual orthopedic care (mean between-group difference −2.6 points, 95% CI −5.1 to −0.2; P=.04), and they showed meaningfully greater mean improvements in PROMIS Physical Function scores than patients in either comparison cohort (mean between-group differences 2.4-2.7 points; P=.02 to .04) (Table 3; Figures 3 and 4). Adjusting for age and BMI did not have a statistically or clinically meaningful effect on these results.

    ‎
    Figure 3. Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Pain Interference scores over a 2-month follow-up in orthopedic patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. Error bars represent standard error.
    View this figure
    ‎
    Figure 4. Mean longitudinal change in Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function scores over a 2-month follow-up in orthopedic patients who, as part of orthopedic care, were provided a digital mental health intervention (Wysa) (n=51) (green circles), received usual orthopedic care (n=51) (blue triangles), or received “gold standard” in-person care with a psychologist (n=51) (purple squares). The triangle within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and usual orthopedic care cohort. The square within a circle signifies a between-cohort difference in the longitudinal change between the digital mental health intervention cohort and “gold standard” in-person psychological counseling cohort. Error bars represent standard error.
    View this figure

    Principal Findings

    To understand the potential benefit of introducing a digital mental health intervention in the context of orthopedic care for patients with coexisting symptoms of depression or anxiety, it is necessary to understand (1) the added clinical benefit of this intervention compared with usual orthopedic care, and (2) the clinical benefit of this intervention relative to the benefit achieved via usual orthopedic care supplemented by in-person counseling with a psychologist. In this retrospective cohort study, compared with patients who received usual orthopedic care, patients who also received a digital mental health intervention reported meaningfully greater 2-month mean improvements in depression (mean PROMIS between-group difference −4.8 points, 95% CI −7.6 to −1.9; P=.001), pain interference (−2.6 points, 95% CI −5.1 to −0.2; P=.04), and physical function (2.7 points, 95% CI 0.5 to 5.0; P=.02). Compared with patients who initiated in-person psychological counseling as part of their orthopedic treatment plan, patients who received a digital mental health intervention reported a meaningfully greater mean improvement in physical function (2.4 points, 95% CI 0.2 to 4.7; P=.04) and comparable improvements in depression, anxiety, and pain interference. These between-group differences were present even after controlling for baseline between-group differences in age and BMI.

    Strengths and Limitations

    This study adds clinical context to our previously reported finding that it is feasible to deliver a digital mental health intervention in the setting of orthopedic care [14]. In other words, the primary strength of this study is the comparison of outcomes between orthopedic patients who received a digital mental health intervention, a “usual care” cohort, and a “gold standard” in-person psychological counseling cohort, especially because psychological counseling is still rarely prescribed in the context of orthopedic care.

    The primary study limitations relate to the retrospective design and between-cohort baseline differences. Nonrandomized study designs have inherent limitations that can affect results. These include possible selection bias, differential attrition, regression to the mean, effects by unmeasured confounding variables (eg, concomitant orthopedic and mental health interventions), potential undetected interaction effects, and temporal/historical bias. Because patients who received the digital mental health intervention were actively enrolled into the research study while comparison cohorts were retrospectively selected as convenience samples, the digital intervention cohort could have been subject to healthy participant bias (in which increased activation in their health care could have contributed to greater health-related improvements). Furthermore, only 51 of 61 participants who completed 2-month follow-up measures in the digital intervention prospective study could be included in this longitudinal analysis, which also could have contributed to healthy participant bias. Additionally, the “usual orthopedic care” cohort could have been biased toward patients who were not showing satisfactory improvements and therefore returned to the clinic for a follow-up visit to determine the next steps. Similarly, it is possible that patients who received in-person psychological counseling as part of their orthopedic treatment plan had more “treatment-resistant” symptoms than patients in the other cohorts because in our experience, patients who choose this biopsychosocial lifestyle medicine approach to orthopedic care report feeling “at the end of their rope” and have often already tried many standard orthopedic treatments. A difference-in-differences quasiexperimental design was adopted, rather than propensity score matching, so that baseline between-group differences could be explored and because the number of potentially eligible patients for the in-person psychological counseling cohort was limited. Nevertheless, the vast majority of baseline characteristics were not significantly different between the cohorts, and baseline PROMIS scores for the digital intervention cohort were comparable (and at times worse) than the comparison cohorts, which would suggest that the digital intervention cohort was not experiencing less severe symptoms at baseline. While worse baseline scores provide more “room to improve,” the digital intervention cohort did not have worse baseline scores for any of the between-group differences that were found to be statistically significant.

    Finally, generalizability is a limitation of this single-center study conducted at a tertiary care center. In order for a digital mental health intervention to be feasibly offered in an orthopedic setting, clinical providers need to support the initiative, and mental health screening needs to be a standard part of a patient’s evaluation, as is the case at the study institution.

    Comparison With Prior Work

    Our findings are consistent with previous large randomized controlled trials and meta-analyses that have demonstrated the effectiveness of digital interventions for improving symptoms of depression, anxiety, and even pain-related impairment in people with chronic pain who have been recruited from pain management clinics, primary care clinics, and community/internet referral sources [20,21,45-47]. To our knowledge, though, this is the first study to specifically evaluate the effectiveness of a digital mental health intervention that was introduced in the setting of an orthopedic clinic, which is not typically a setting where mental health is a focus. We find it encouraging that, similar to studies of participants among the general population, orthopedic patients who received a digital mental health intervention reported favorable mental and physical health outcomes compared with those who received no active mental health treatment and at least comparable outcomes to those who initiated in-person care with a psychologist [15-17,48]. Our results add to the body of literature showing that the impact of pain on a person’s daily functioning and quality of life (ie, pain interference) can be improved by cognitive behavioral techniques, such as cognitive restructuring and addressing maladaptive thought patterns, regardless of the person’s level of physical function [49,50]. However, it was somewhat surprising that patients in this study who received usual orthopedic care did not make meaningful improvements in physical health. This could be related to (1) the inherent characteristics of nonoperative orthopedic patients who have multiple orthopedic clinic visits within a span of 2 months (eg, to address persistently bothersome symptoms), and (2) the difficulty of treating chronic pain (many years), especially when the interplay between mental health and chronic pain has not been sufficiently addressed. Nevertheless, it is encouraging that patients who received the digital mental health intervention made physical, as well as mental, health improvements even when the usual orthopedic care cohort did not.

    Directions for Future Study

    Further investigation regarding the effectiveness of incorporating a digital mental health intervention into orthopedic care should include (1) a longer follow-up duration because depression and anxiety are chronic conditions; (2) dedicated evaluation of the intervention’s impact on sleep because pain and insomnia reciprocally affect each other and because digital cognitive behavioral interventions can be effective for insomnia [51-53]; and (3) more detailed information regarding concomitant orthopedic and mental health interventions, which are pursued during the intervention period. To obtain further insight, a fully powered, prospective, randomized controlled trial is needed.

    Conclusions

    Patients who received a digital mental health intervention as part of their orthopedic care reported greater 2-month mean improvements in depression, pain interference, and physical function than patients who received usual orthopedic care without any specific mental health intervention. They also reported a greater mean improvement in physical function and comparable improvements in depression, anxiety, and pain interference compared with patients who initiated in-person psychological counseling as part of their orthopedic treatment plan. These differences met clinically meaningful thresholds and suggest that when orthopedic patients endorse elevated symptoms of depression or anxiety, incorporation of a digital mental health intervention into orthopedic care may improve patients’ physical and mental health outcomes relative to standard orthopedic care. Furthermore, improvements may be comparable to those achieved on incorporation of in-person psychological counseling. These retrospective findings warrant further investigation using a prospective randomized design.

    Acknowledgments

    This study was funded by a Washington University/BJC HealthCare Big Ideas innovation grant. Work on this study was also supported by the National Institutes of Health (NIH) (K23AR074520) and the Doris Duke Charitable Foundation (ALC), and use of Research Electronic Data Capture (REDCap) was supported by a Clinical and Translational Science Award (CTSA) Grant (UL1 TR000448) and a Siteman Comprehensive Cancer Center and National Cancer Institute (NCI) Cancer Center Support Grant (P30 CA091842). The authors have no other financial disclosures. The study team purchased participant access codes for Wysa’s novel version tailored for people with chronic pain (which is not commercially available). Wysa provided participants’ deidentified app usage data to the study team free of charge. Data were linked to individual users via randomly generated codes, and only Washington University study personnel had access to the participant keys. No personally identifiable data were shared with Wysa by the study team or vice versa. The content of this manuscript was written solely by the study authors, independent of Wysa.

    Authors' Contributions

    AJL contributed to follow-up data collection and writing of the manuscript. MJS performed the statistical analysis and contributed to writing the manuscript. DMH contributed to participant recruitment, data collection, and editing of the manuscript. JPM and PAA contributed to the statistical methods, data presentation, and editing of the final manuscript. ALC conceived of the study idea, supervised the entire project, and contributed to writing the final version of the manuscript.

    Conflicts of Interest

    None declared.

    1. Zelaya C, Dahlhamer J, Lucas J, Connor E. Chronic Pain and High-impact Chronic Pain Among U.S. Adults, 2019. NCHS Data Brief 2020 Nov(390):1-8. [Medline]
    2. The Burden of Musculoskeletal Diseases in the United States (BMUS), Fourth Edition. United States Bone and Joint Initiative. 2020.   URL: http://www.boneandjointburden.org [accessed 2022-04-27]
    3. Gambassi G. Pain and depression: the egg and the chicken story revisited. Arch Gerontol Geriatr 2009;49 Suppl 1:103-112. [CrossRef] [Medline]
    4. DeVeaugh-Geiss AM, West SL, Miller WC, Sleath B, Gaynes BN, Kroenke K. The adverse effects of comorbid pain on depression outcomes in primary care patients: results from the ARTIST trial. Pain Med 2010 May;11(5):732-741. [CrossRef] [Medline]
    5. Ang DC, Bair MJ, Damush TM, Wu J, Tu W, Kroenke K. Predictors of pain outcomes in patients with chronic musculoskeletal pain co-morbid with depression: results from a randomized controlled trial. Pain Med 2010 Apr;11(4):482-491. [CrossRef] [Medline]
    6. Cheng AL, Schwabe M, Doering MM, Colditz GA, Prather H. The Effect of Psychological Impairment on Outcomes in Patients With Prearthritic Hip Disorders: A Systematic Review and Meta-analysis. Am J Sports Med 2020 Aug;48(10):2563-2571. [CrossRef] [Medline]
    7. Alattas SA, Smith T, Bhatti M, Wilson-Nunn D, Donell S. Greater pre-operative anxiety, pain and poorer function predict a worse outcome of a total knee arthroplasty. Knee Surg Sports Traumatol Arthrosc 2017 Nov;25(11):3403-3410 [FREE Full text] [CrossRef] [Medline]
    8. Lee H, Hübscher M, Moseley GL, Kamper SJ, Traeger AC, Mansell G, et al. How does pain lead to disability? A systematic review and meta-analysis of mediation studies in people with back and neck pain. Pain 2015 Jun;156(6):988-997. [CrossRef] [Medline]
    9. Vranceanu AM, Beks RB, Guitton TG, Janssen SJ, Ring D. How do Orthopaedic Surgeons Address Psychological Aspects of Illness? Arch Bone Jt Surg 2017 Jan;5(1):2-9 [FREE Full text] [Medline]
    10. Andrade LH, Alonso J, Mneimneh Z, Wells JE, Al-Hamzawi A, Borges G, et al. Barriers to mental health treatment: results from the WHO World Mental Health surveys. Psychol Med 2014 Apr;44(6):1303-1317 [FREE Full text] [CrossRef] [Medline]
    11. Weil TP. Insufficient dollars and qualified personnel to meet United States mental health needs. J Nerv Ment Dis 2015 Apr;203(4):233-240. [CrossRef] [Medline]
    12. Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther 2018 Jan;47(1):1-18. [CrossRef] [Medline]
    13. Lattie EG, Adkins EC, Winquist N, Stiles-Shields C, Wafford QE, Graham AK. Digital Mental Health Interventions for Depression, Anxiety, and Enhancement of Psychological Well-Being Among College Students: Systematic Review. J Med Internet Res 2019 Jul 22;21(7):e12869 [FREE Full text] [CrossRef] [Medline]
    14. Leo AJ, Schuelke MJ, Hunt DM, Metzler JP, Miller JP, Areán PA, et al. A Digital Mental Health Intervention in an Orthopedic Setting for Patients With Symptoms of Depression and/or Anxiety: Feasibility Prospective Cohort Study. JMIR Form Res 2022 Feb 21;6(2):e34889 [FREE Full text] [CrossRef] [Medline]
    15. Firth J, Torous J, Nicholas J, Carney R, Rosenbaum S, Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J Affect Disord 2017 Aug 15;218:15-22 [FREE Full text] [CrossRef] [Medline]
    16. Linardon J, Cuijpers P, Carlbring P, Messer M, Fuller-Tyszkiewicz M. The efficacy of app-supported smartphone interventions for mental health problems: a meta-analysis of randomized controlled trials. World Psychiatry 2019 Oct;18(3):325-336 [FREE Full text] [CrossRef] [Medline]
    17. Versluis A, Verkuil B, Spinhoven P, van der Ploeg MM, Brosschot JF. Changing Mental Health and Positive Psychological Well-Being Using Ecological Momentary Interventions: A Systematic Review and Meta-analysis. J Med Internet Res 2016 Jun 27;18(6):e152 [FREE Full text] [CrossRef] [Medline]
    18. Hollis C, Sampson S, Simons L, Davies EB, Churchill R, Betton V, et al. Identifying research priorities for digital technology in mental health care: results of the James Lind Alliance Priority Setting Partnership. The Lancet Psychiatry 2018 Oct;5(10):845-854. [CrossRef] [Medline]
    19. Lau N, Waldbaum S, Parigoris R, O'Daffer A, Walsh C, Colt SF, et al. eHealth and mHealth Psychosocial Interventions for Youths With Chronic Illnesses: Systematic Review. JMIR Pediatr Parent 2020 Nov 10;3(2):e22329 [FREE Full text] [CrossRef] [Medline]
    20. Schlicker S, Baumeister H, Buntrock C, Sander L, Paganini S, Lin J, et al. A Web- and Mobile-Based Intervention for Comorbid, Recurrent Depression in Patients With Chronic Back Pain on Sick Leave (Get.Back): Pilot Randomized Controlled Trial on Feasibility, User Satisfaction, and Effectiveness. JMIR Ment Health 2020 Apr 15;7(4):e16398 [FREE Full text] [CrossRef] [Medline]
    21. Scott W, Chilcot J, Guildford B, Daly-Eichenhardt A, McCracken LM. Feasibility randomized-controlled trial of online Acceptance and Commitment Therapy for patients with complex chronic pain in the United Kingdom. Eur J Pain 2018 Apr 28:1236. [CrossRef] [Medline]
    22. Wysa.   URL: https://wysa.io/ [accessed 2022-04-27]
    23. Henrich JF, Gjelsvik B, Surawy C, Evans E, Martin M. A randomized clinical trial of mindfulness-based cognitive therapy for women with irritable bowel syndrome-Effects and mechanisms. J Consult Clin Psychol 2020 Apr;88(4):295-310. [CrossRef] [Medline]
    24. la Cour P, Petersen M. Effects of mindfulness meditation on chronic pain: a randomized controlled trial. Pain Med 2015 Apr;16(4):641-652. [CrossRef] [Medline]
    25. Jensen MP, Ehde DM, Day MA. The Behavioral Activation and Inhibition Systems: Implications for Understanding and Treating Chronic Pain. J Pain 2016 May;17(5):529.e1-529.e18. [CrossRef] [Medline]
    26. Kratz AL, Davis MC, Zautra AJ. Pain acceptance moderates the relation between pain and negative affect in female osteoarthritis and fibromyalgia patients. ann. behav. med 2007 Sep;33(3):291-301. [CrossRef]
    27. McCracken LM. Learning to live with the pain: acceptance of pain predicts adjustment in persons with chronic pain. Pain 1998;74(1):21-27. [CrossRef]
    28. McCracken LM, Keogh E. Acceptance, mindfulness, and values-based action may counteract fear and avoidance of emotions in chronic pain: an analysis of anxiety sensitivity. J Pain 2009 Apr;10(4):408-415. [CrossRef] [Medline]
    29. Pinto-Gouveia J, Costa J, Marôco J. The first 2 years of rheumatoid arthritis: the influence of acceptance on pain, physical limitation and depression. J Health Psychol 2015 Jan;20(1):102-112. [CrossRef] [Medline]
    30. Vowles KE, McCracken LM, Eccleston C. Processes of change in treatment for chronic pain: the contributions of pain, acceptance, and catastrophizing. Eur J Pain 2007 Oct;11(7):779-787. [CrossRef] [Medline]
    31. Prather H, Fogarty AE, Cheng AL, Wahl G, Hong B, Hunt D. Feasibility of an intensive interprofessional lifestyle medicine program for patients with musculoskeletal conditions in the setting of lifestyle-related chronic disease. PM R 2021 Oct 28:12728. [CrossRef] [Medline]
    32. Pilkonis PA, Choi SW, Reise SP, Stover AM, Riley WT, Cella D, PROMIS Cooperative Group. Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): depression, anxiety, and anger. Assessment 2011 Sep;18(3):263-283 [FREE Full text] [CrossRef] [Medline]
    33. Schalet BD, Pilkonis PA, Yu L, Dodds N, Johnston KL, Yount S, et al. Clinical validity of PROMIS Depression, Anxiety, and Anger across diverse clinical samples. J Clin Epidemiol 2016 May;73:119-127 [FREE Full text] [CrossRef] [Medline]
    34. Amtmann D, Cook KF, Jensen MP, Chen W, Choi S, Revicki D, et al. Development of a PROMIS item bank to measure pain interference. Pain 2010 Jul;150(1):173-182 [FREE Full text] [CrossRef] [Medline]
    35. Cook KF, Jensen SE, Schalet BD, Beaumont JL, Amtmann D, Czajkowski S, et al. PROMIS measures of pain, fatigue, negative affect, physical function, and social function demonstrated clinical validity across a range of chronic conditions. J Clin Epidemiol 2016 May;73:89-102 [FREE Full text] [CrossRef] [Medline]
    36. Schalet BD, Hays RD, Jensen SE, Beaumont JL, Fries JF, Cella D. Validity of PROMIS physical function measured in diverse clinical samples. J Clin Epidemiol 2016 May;73:112-118 [FREE Full text] [CrossRef] [Medline]
    37. Cella D, Yount S, Rothrock N, Gershon R, Cook K, Reeve B, PROMIS Cooperative Group. The Patient-Reported Outcomes Measurement Information System (PROMIS): progress of an NIH Roadmap cooperative group during its first two years. Med Care 2007 May;45(5 Suppl 1):S3-S11 [FREE Full text] [CrossRef] [Medline]
    38. Kind AJH, Jencks S, Brock J, Yu M, Bartels C, Ehlenbach W, et al. Neighborhood socioeconomic disadvantage and 30-day rehospitalization: a retrospective cohort study. Ann Intern Med 2014 Dec 02;161(11):765-774 [FREE Full text] [CrossRef] [Medline]
    39. Singh GK. Area deprivation and widening inequalities in US mortality, 1969-1998. Am J Public Health 2003 Jul;93(7):1137-1143. [CrossRef] [Medline]
    40. Lee AC, Driban JB, Price LL, Harvey WF, Rodday AM, Wang C. Responsiveness and Minimally Important Differences for 4 Patient-Reported Outcomes Measurement Information System Short Forms: Physical Function, Pain Interference, Depression, and Anxiety in Knee Osteoarthritis. J Pain 2017 Sep;18(9):1096-1110 [FREE Full text] [CrossRef] [Medline]
    41. Kroenke K, Yu Z, Wu J, Kean J, Monahan PO. Operating characteristics of PROMIS four-item depression and anxiety scales in primary care patients with chronic pain. Pain Med 2014 Nov;15(11):1892-1901 [FREE Full text] [CrossRef] [Medline]
    42. Chen CX, Kroenke K, Stump TE, Kean J, Carpenter JS, Krebs EE, et al. Estimating minimally important differences for the PROMIS pain interference scales: results from 3 randomized clinical trials. Pain 2018 Apr;159(4):775-782 [FREE Full text] [CrossRef] [Medline]
    43. Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, REDCap Consortium. The REDCap consortium: Building an international community of software platform partners. J Biomed Inform 2019 Jul;95:103208 [FREE Full text] [CrossRef] [Medline]
    44. Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform 2009 Apr;42(2):377-381 [FREE Full text] [CrossRef] [Medline]
    45. Bhatia A, Kara J, Janmohamed T, Prabhu A, Lebovic G, Katz J, et al. User Engagement and Clinical Impact of the Manage My Pain App in Patients With Chronic Pain: A Real-World, Multi-site Trial. JMIR Mhealth Uhealth 2021 Mar 04;9(3):e26528 [FREE Full text] [CrossRef] [Medline]
    46. Moman RN, Dvorkin J, Pollard EM, Wanderman R, Murad MH, Warner DO, et al. A Systematic Review and Meta-analysis of Unguided Electronic and Mobile Health Technologies for Chronic Pain-Is It Time to Start Prescribing Electronic Health Applications? Pain Med 2019 Nov 01;20(11):2238-2255. [CrossRef] [Medline]
    47. Bailey JF, Agarwal V, Zheng P, Smuck M, Fredericson M, Kennedy DJ, et al. Digital Care for Chronic Musculoskeletal Pain: 10,000 Participant Longitudinal Cohort Study. J Med Internet Res 2020 May 11;22(5):e18250 [FREE Full text] [CrossRef] [Medline]
    48. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry 2017 Oct;16(3):287-298 [FREE Full text] [CrossRef] [Medline]
    49. Ikemoto T, Miki K, Matsubara T, Wakao N. Psychological Treatment Strategy for Chronic Low Back Pain. Spine Surg Relat Res 2019;3(3):199-206 [FREE Full text] [CrossRef] [Medline]
    50. Borisovskaya A, Chmelik E, Karnik A. Exercise and Chronic Pain. Adv Exp Med Biol 2020;1228:233-253. [CrossRef] [Medline]
    51. Juan W, Rui L, Wei-Wen Z. Chronic neck pain and depression: the mediating role of sleep quality and exercise. Psychol Health Med 2020 Sep;25(8):1029-1035. [CrossRef] [Medline]
    52. Afolalu EF, Ramlee F, Tang NKY. Effects of sleep changes on pain-related health outcomes in the general population: A systematic review of longitudinal studies with exploratory meta-analysis. Sleep Med Rev 2018 Jun;39:82-97 [FREE Full text] [CrossRef] [Medline]
    53. Soh HL, Ho RC, Ho CS, Tam WW. Efficacy of digital cognitive behavioural therapy for insomnia: a meta-analysis of randomised controlled trials. Sleep Med 2020 Nov;75:315-325. [CrossRef] [Medline]

    ‎
    PROMIS: Patient-Reported Outcomes Measurement Information System

    Edited by A Mavragani; submitted 11.02.22; peer-reviewed by R Ho, M Bair; comments to author 30.03.22; revised version received 30.03.22; accepted 18.04.22; published 04.05.22

    Copyright

    ©Ashwin J Leo, Matthew J Schuelke, Devyani M Hunt, J Philip Miller, Patricia A Areán, Abby L Cheng. Originally published in JMIR Formative Research (https://formative.jmir.org), 04.05.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.