Original Paper
Abstract
Background: Stress is an emotional response caused by external triggers and is a high-prevalence global problem affecting mental and physical health. Several different digital therapeutic solutions are effective for stress management. However, there is limited understanding of the association between relaxation components and stress levels when using a digital app.
Objective: This study investigated the contribution of relaxation tools to stress levels over time. We hypothesized that participation in breathing exercises and cognitive behavioral therapy–based video sessions would be associated with a reduction in stress levels. We also hypothesized a significant reduction specifically in participants’ perceived sense of burden and lack of productivity when engaged with breathing exercises and video sessions.
Methods: Stress levels were evaluated in a real-world data cohort using a behavioral health app for digital intervention and monitoring change. This retrospective real-world analysis of users on a mobile platform–based treatment followed users (N=490) who started with moderate and above levels of stress and completed at least 2 stress assessments. The levels of stress were tracked throughout the first 10 weeks. A piecewise mixed effects model was applied to model the trajectories of weekly stress mean scores in 2 time segments (1-6 weeks and 6-10 weeks). Next, a simple slope analysis was used for interpreting interactions probing the moderators: breathing exercises and video sessions. Piecewise mixed-effects models were also used to model the trajectories of specific perceived stress item rates in the stress questionnaire in the 2 segments (1-6 weeks and 6-10 weeks) and whether they are moderated by the relaxation engagements. Simple slope analysis was also used here for the interpretation of the interactions.
Results: Analysis revealed a significant decrease in stress symptoms (β=–.25; 95% CI –0.32 to –0.17; P<.001) during the period of 1-6 weeks of app use that was maintained during the period of 6-10 weeks. Breathing exercises significantly moderated the reduction in stress symptoms during the period of 1-6 weeks (β=–.07; 95% CI –0.13 to –0.01; P=.03), while engagement in digital video sessions did not moderate stress scores. Engagement in digital video sessions, as well as breathing exercises, significantly moderated the reduction in perceived sense of burden and lack of productivity during weeks 1-6 and remained stable during weeks 6-10 on both items.
Conclusions: This study sheds light on the association between stress level reduction and specific components of engagement in a digital health app, breathing exercises, and cognitive behavioral therapy–based video sessions. Our findings provide a basis for further investigation of current and moderating factors that contribute to the personalization of digital intervention. In addition, results may aid in developing a more comprehensive understanding of how digital intervention tools work for mental health and for whom they are most effective.
doi:10.2196/50506
Keywords
Introduction
Stress is defined as an emotional or physical reaction typically caused by an external trigger [
, ] and is known to be a high-prevalence global problem, negatively affecting mental and physical health [ ]. According to Gallup 2019 Global Emotions Report, the percentage of the American population who experienced stress (55%) is one of the highest in the world, as compared to the global average of 35% [ , ]. Furthermore, it is reported that distress levels have only increased during the COVID-19 pandemic due to health concerns, altered everyday life routines [ ], and the unpredictability of its future implications [ ]. A recent US stress survey conducted, reports an elevated average reported stress level from prepandemic levels [ ]. Moreover, an alarming proportion of adults reported that stress has an impact on their day-to-day functioning, with more than a quarter (27%) saying that most days they are so stressed they cannot function [ ].Stress has a major impact on managing daily life, as everyone experiences it in varying forms every day [
]. According to the American Psychological Association’s 2014 Work and Well-Being Survey, 31% of employed adults indicated that they felt tense or stressed out during the workday [ ]. Several studies investigating the understanding of how employee health impacts work performance have found stress can cause burnout, absenteeism, and reduced efficiency and performance [ ], which can negatively impact the organization [ ]. Yet, some resources can be implemented to help meet the pressures and demands faced at work [ ].There is evidence of improvements in health status due to workplace wellness programs for mental health [
, ]. In the past decade, the delivery of digital interventions has become increasingly popular; these interventions target common mental health illnesses [ ] within the workplace due to their easy implementation [ ]. Web-based interventions are shown to offer several advantages that may overcome some of the limitations of face-to-face approaches [ ] as they are accessible through any internet-connected device. Among the working population, these interventions could especially benefit those who do not seek regular mental health treatment because of negative perceptions of mental health needs in the workplace [ ].It is reported that a substantial proportion of adults with common mental disorders fail to receive treatment [
]. The barriers thought to impede appropriate mental health care seeking have been well documented in the literature [ , ]. Many patients experience accessibility issues such as prolonged wait times, cost, clinic location, and transportation [ ]. Others report that the stigma associated with mental illness diagnosis is the main reason that decreases their willingness to seek treatment [ ]. Thus, digital interventions have the potential to overcome many of the barriers associated with seeking and accessing mental health care [ ] and to provide increased convenience for patients allowing them access to care at any time.Furthermore, digital health solutions aim to foster patient empowerment [
, ] by encouraging them to be proactive in the care process. These interventions allow people the right guidance and support for self-management, consequently addressing their own health-related goals [ ]. Digital solutions also enable users to be better informed about their health, share experiences, assess and monitor specified health states, reach treatment, and improve communication between them and health care professionals [ ].In recent years, there has been an increase in the delivery of digital therapeutics targeting common mental health conditions [
, ]. Depression and anxiety, which have the highest prevalence among mental health conditions, are at the forefront of these targeted programs [ ]. Previous research has demonstrated the efficacy of web-based interventions on the prevention and management of these conditions [ , ] and these conditions were even reported as efficacious as traditional face-to-face treatments [ ].Most treatment provided in behavioral health apps uses module-based sessions and the teaching of coping and management strategies based on cognitive behavioral therapy (CBT) principles, problem-solving therapy, and psychoeducation [
, ]. The digital application of CBT is showing promising results in the treatment of depression and anxiety disorders [ ]. Additional research suggests that a successful approach to addressing digital health interventions is through a multicomponent design [ ], using features such as tailored messages, reporting of thoughts, feelings, or behaviors [ ]; relaxations features [ ]; integrated therapist contact and other supplementary worksheets and engagements [ ].Notwithstanding that stress itself is not defined as a disorder, it can lead to major psychological and physical implications that could place people at risk for illness [
, ]. Given that stress represents a major threat to public health, effective and scalable solutions to accommodate the demand for stress-management interventions are needed [ ]. The concept of “stress management” refers to the emotional, psychological, and behavioral methods used to develop skills to manage and reduce stress [ ]. Several types of stress management interventions have been reported to be effective at reducing stress levels, such as CBT, time management, relaxation, and meditation exercises [ ]. However, applying these self-help skills to achieve improvement requires motivation and self-discipline.One of the easiest methods for managing stress-related symptoms is deep breathing exercises [
]; these exercises have been proposed as first-line and supplemental treatments for emotional disorders [ ]. Several studies reported that the use of different breathing techniques showed significant improvement in mood states and perceived stress [ , ] resulting in an effective improvement in the management of stress in daily life [ ]. Slow and deep breathing can have a significant impact on reducing stress feelings and activating the relaxation response. This exercise is efficient as it reduces the ventilation in the dead space of the lungs and decreases the effect of stress and strain on the body by shifting the balance toward the parasympathetic system [ ].In recent years, the number of studies on digitally delivered stress management has been rising, yet the overall effect of specific formats of treatment delivery remains unclear [
]. Moreover, existing web-based stress management programs differ in various aspects such as type, content, and guidance, and this may influence their efficacy [ ].A recurring element described in the literature is video-based self-administrated intervention programs, which are mainly rooted in a CBT framework [
, ]. Previous studies reported that video-based CBT has shown effectiveness for anxiety, sexual pain, and insomnia [ - ]. However, these video-based programs have not yet been integrated into the treatment of stress in a digital form. This method is described as a third waveform of CBT [ ], which is characterized by concepts such as acceptance and mindfulness that focus on the person’s relationship to thought and emotions [ ].In their meta-analysis review of digital mindfulness-based interventions, Spijkerman et al [
] suggested that these interventions can be effective in reducing perceived stress. Mindfulness is a complete therapy that can minimize stress levels and improve psychological well-being because it includes various components of relaxation, such as yoga, deep breathing techniques, and focusing attention [ ]. However, despite the abundance of digital mindfulness-based interventions and considering the structured variability [ ], it is presently unknown whether different components of these interventions are effective.In summary, although there has been an established body of research evaluating the efficacy of mobile app platforms for stress management, there has been less focus on the effectiveness of engagement with specific components and relaxation strategies for stress reduction. The purpose of this study is to evaluate the effect of a relaxation engagement digital behavioral health app on perceived stress. Our primary hypothesis is that in users with moderate-to-high stress levels, improvements in stress scores will be observed during the initial weekly period of the intervention and will be followed by maintenance for several weeks after. We hypothesized that engagement with certain digital components would moderate the reduction in stress levels. Specifically, we hypothesized that breathing exercises and video sessions would moderate stress levels’ reduction. We also anticipated a significant reduction in the perceived sense of burden and perceived level of productivity ranking as these measures were designed to reflect a change in perceived stress levels over time.
Methods
Behavioral Health App
The Dario Health behavioral health app is essentially a modular tool delivering emotion-focused support designed to apply to a range of mental health conditions. Members generally have access to the Dario Health behavioral health platform as part of their employee or health plan benefits. A clinically based screening tool assesses each person’s needs and guides users to the most efficient support. The app provides several CBT programs including depression, anxiety, anger, stress, and substance use, and can be used as a self-guided intervention or with the help of a certified coach. The structure of each program includes conceptual videos, textual skills, breathing exercises, and monitoring progress tools. This study focuses on tracking cohorts of users with stress scores measured by their responses to the stress questionnaire.
The stress program begins with a psychology education module about stress, identifying symptoms, as well as how it presents itself physically, mentally, and emotionally. The program includes short CBT-based and empirically supported whiteboard educational videos, introducing skills such as understanding the impact of stress, coping strategies, identifying stress signs and symptoms, and stress-related behaviors. By increasing the awareness of the individuals’ thoughts and feelings and gradually explaining specific situations leading to stress, these modules provide a way to promote stress self-management. During these skills-based sessions, various techniques are introduced to assist with reducing stress such as relaxation exercises, breathing exercises, monitoring progress, and coaching. The content is delivered to engage the users and appealingly convey information. Relaxation exercises provide a digital experience including audio or video sessions of mindfulness, muscle relaxation techniques, and automatic thoughts and emotions regulation.
The breathing exercises are instructed as a short up to 5-minute audio guide; each one educates about a different technique, that is, progressive muscle relaxation, diaphragmatic breathing, or 4-7-8 breathing.
Coaching is introduced to users for support and assistance and people who choose to obtain coaching services via the app.
Measures
Stress levels were assessed over 10 weeks using a stress questionnaire. The questionnaire that objectifies the degree of stress severity is a 5-item self-reported, in-app delivered questionnaire. Each of the 5 items is scored from 0 (not at all) to 3 (nearly every day;
). The questionnaire aims to assess an individual’s level of stress and the factors contributing to it. The questionnaire items reflect perceived stress such as a sense of burden, lack of productivity, and symptoms of stress such as lack of sleep, body tension, and irritability. As a severity measure, scores range from 0 (absent of stress symptoms) to 15 (severe stress levels). Stress scores of ≤5, 6-10, and >10 represent low, moderate, and high stress levels, respectively. Internal reliability testing of the questionnaire demonstrated an acceptable internal reliability with a Cronbach α of 0.73 [ ].Item | Questionnaire | Scoring |
1 | Have you felt overwhelmed or stressed about important responsibilities? | 0=“Not at all” 1=“Several days” 2=“More than half the days” 3=“Nearly every day” |
2 | What about feeling as though you were not as productive as you should\'ve been? | 0=“Not at all” 1=“Several days” 2=“More than half the days” 3=“Nearly every day” |
3 | Had trouble sleeping because your mind was racing or worrying? | 0=“Not at all” 1=“Several days” 2=“More than half the days” 3=“Nearly every day” |
4 | Felt tension in your neck, back, or shoulders? | 0=“Not at all” 1=“Several days” 2=“More than half the days” 3=“Nearly every day” |
5 | Felt noticeably more irritable, restless, or agitated than usual? | 0=“Not at all” 1=“Several days” 2=“More than half the days” 3=“Nearly every day” |
Independent variables were included in the analysis as potential moderating factors such as app sessions, videos, breathing exercises, and coaching interactions.
All data were transferred and stored in compliance with HIPAA (Health Insurance Portability and Accountability Act) requirements, using MongoDB or BigQuery database services. All data were anonymized before extraction for this study.
Users
A retrospective data evaluation study was performed on the Dario database.
The stress cohort consisted of a group of 490 users who used the Dario Behavioral Health platform between 2019 and 2022. The population included users who started at a moderate and above level of stress (stress questionnaire score >5) and those who completed at least two stress assessments. The sample included 388 (79%) women, 95 (19%) men, and 7 (2%) others. The age distribution was as follows: ≤35 (38%), 36-55 (49%), 56-65 (12%), and 66-76 (1%) years. The average baseline score of the stress questionnaire was 9.8 (SD 2.7; median 10, IQR 4). The weekly average time of app use observed in this cohort was 26.4 minutes (SD 39.2; median 14, IQR 21)
Ethical Considerations
All data used for the analysis were anonymized before extraction for this study. This study received an exemption from the institutional review board. Ethical & Independent Review Services [
], a professional review board, issued the institutional review board exemption for this study (21235 - 01#).Statistical Analysis
A classical linear longitudinal model assumes a single-slope growth pattern for changes in an outcome variable across time. In contrast, piecewise‐based mixed effects models allow flexibility in the modeling of variable change trajectories across time [
]. Previous studies consistently demonstrated a 2-stage dynamic of clinical outcomes associated with digital interventions: an initial improvement is followed by stabilization of the outcome [ , ].Following a visualization of the distribution of the stress estimates over time, a piecewise cutoff point for the model slopes was chosen at 6 weeks of product use, assuming a change in the time-related stress severity level trajectory after 6 weeks considering previous research as well [
, ]. Such a behavior including 2 trajectories is in line with our previous research on digital follow-up measures in chronic conditions management [ , ].Here, a piecewise mixed effects model was conducted to model the trajectory of the stress questionnaire mean score in 2 segments to allow the data to exhibit different linear trends over different periods. We tested whether digital engagement moderated 2 piecewise time trajectories in stress (1-6 weeks and 6-10 weeks). The model included a person-based random intercept and random slope for the time trajectory after the piecewise cutoff. Simple slope analysis was used for the interpretation of the interactions probing the moderators at 1 SD below (low engagement) and 1 SD above (high engagement) the average.
Next, we used mixed model analysis to model the trajectory of questions 1 and 2 rates (
) in the stress questionnaire in the 2 segments (1-6 weeks and 6-10 weeks). Moreover, we tested whether these scores were moderated by engagement with specific components in the app. The models included a random intercept and random slope of the time trajectory. Simple slope analysis was used for the interpretation of the interactions probing the moderators at 1 SD below (low engagement) and 1 SD above (high engagement) the average.Results
First Analysis: Stress Score Reduction Is Associated With Breathing Exercises
In total, 90% (441/490) of the users improved or maintained their stress level over this study’s period, that is, remained at a moderate level or improved from moderate or high to a low level of stress.
Piecewise mixed model analysis revealed a significant decrease in stress levels (β=–.25; 95% CI –0.32 to –0.17; P<.001) during the period of weeks 1-6. There were no significant time-related trends in stress during the period of weeks 6-10 (β=.00; 95% CI –0.21 to 0.22; P=.98).
A demonstrates time-related fluctuations in stress levels.Breathing exercises significantly moderated the reduction in stress score during the period of weeks 1-6 (β=–.07; 95% CI –0.13 to –0.01; P=.03). The weekly average number of breathing exercises completed is 1.55 (2.34 SD). Users with increased breathing exercise completion (+1 SD) demonstrated stronger reduction in stress score (β=–.45; 95% CI –0.64 to –0.25; P<.001) compared to users who completed fewer breathing exercises (–1 SD), that was not significant (β=–.13; 95% CI –0.32 to 0.05; P=.15). Breathing exercise did not moderate the time trajectory of stress levels during the period of weeks 6-10 (β=–.02; 95% CI –0.23 to 0.19; P=.87).
B presents low and high levels of breathing exercise engagement, showing a significant reduction in stress levels only for users with high engagement, while the decrease for users with low engagement was not significant.
The engagement in digital video sessions did not significantly moderate stress score during both segments of time (β=–.01; 95% CI –0.03 to 0.00; P=.14 and β=–.03; 95% CI –0.11 to 0.04; P=.37 to week 1-6 and 6-10 accordingly).
Second Analysis: Improvement in Perceived Stress Is Moderated by Digital Video Sessions
Overview
The perceived stress level was reflected by items 1 and 2 in the questionnaire.
Question 1: “Have you felt overwhelmed or stressed about important responsibilities?”
Piecewise mixed model analysis revealed that breathing exercises significantly moderated the reduction in question 1 ranking during the period of weeks 1-6 (β=–.02; 95% CI –0.04 to –0.01; P=.009). Breathing exercises did not moderate the time trajectory of question 1 ranking during weeks 6-10 (β=–.00; 95% CI –0.06 to 0.06; P=.91). The weekly average number of breathing exercises completion is 1.55 (2.34 SD). Users with increased breathing exercise engagement (+1 SD) demonstrated a stronger reduction in perceived stress prompted by important responsibilities (β=–.13; 95% CI –0.19 to –0.08; P<.001) compared to users who were less engaged in breathing exercises (–1 SD), that was not significant (β=–.02; 95% CI –0.07 to 0.03; P=.40).
Further piecewise mixed model analysis revealed that engagement in digital video sessions significantly moderated the reduction in question 1 ranking during the period of weeks 1-6 (β=–.01; 95% CI –0.01 to –0.00; P=.02), yet no significant reduction was seen during the period of 6-10 weeks (β=–.00; 95% CI –0.02 to 0.02; P=.91). The weekly average number of video session completion is 6.38 (8.59 SD). In addition, it was found that users who completed a higher number of video sessions (+1 SD) demonstrated a greater reduction in question 1 rank (β=–.13; 95% CI –0.19 to –0.07; P<.001) compared to those who were less engaged (–1 SD) with video sessions (β=–.02; 95% CI –0.08 to 0.03; P=.38).
Question 2: “What about feeling as though you were not as productive as you should’ve been?”
A piecewise mixed model has shown that the completion of breathing exercises has also significantly moderated the reduction of question 2 ranking in the stress questionnaire during the period of weeks 1-6 (β=–.02; 95% CI –0.04 to –0.00; P=.04); however, the period of 6-10 weeks was not significant (β=.01; 95% CI –0.05 to 0.07; P=.64). The weekly average number of breathing exercises completion is 1.55 (2.34 SD). Users with an increased number of completed breathing exercises (+1 SD) displayed a significant reduction in the question 2 ranking (β=–.07; 95% CI –0.13 to –0.01; P=.02), while in users who completed fewer breathing exercises (–1 SD), the reduction was not significant (β=.02; 95% CI –0.04 to 0.07; P=.55).
Here as well, an additional piecewise mixed model has demonstrated that engagement in video sessions significantly moderated the reduction in question 2 rank during weeks 1-6 (β=–.01; 95% CI –0.01 to –0.00; P=.01), yet no significant reduction was found in weeks 6-10 (β=.00; 95% CI –0.02 to 0.02; P=.84). The weekly average number of video session completion is 6.38 (8.59 SD). Furthermore, results from the simple slope analysis showed that users with increased engagement in video sessions (+1 SD) were significantly associated with improvement in question 2 rank (β=–.08; 95% CI –0.14 to –0.02, P=.01), compared to users with lower engagement (–1 SD) to video sessions (β=.03; 95% CI –0.02 to 0.08; P=.27).
Discussion
Principal Results
The Dario Health behavioral health stress program delivers an optimized solution that combines videos, textual skills, breathing exercises, and interaction with a coach to improve the users’ emotional wellness. The goal of this study was to assess changes in stress outcomes over time among users with moderate and above levels of stress scores at baseline. This study tested the effect of digital therapeutic use on stress levels over time, using a specific engagement instrument for stress conditions. Piecewise mixed model analysis indicated a significant decrease in stress levels during the period of the first 6 weeks of product use and maintained during the period from 6 to 10 weeks with no significant time-related trends. Engagement in breathing exercises significantly moderated the reduction in stress levels during weeks 1-6. During the period of 6-10 weeks, the reduced level of stress was maintained, and there were no significant time-related trends. An additional piecewise mixed model revealed that engagement in video sessions significantly moderated the reduction of perceived stress as shown by a decreased sense of burden (question 1) and a decreased lack of productivity (question 2), during weeks 1-6. It is worth noting that stress can have various causes and effects, and everyone experiences stress differently. However, a sense of burden and lack of productivity are commonly associated with stress, and identifying and acknowledging them can help individuals take steps to manage their stress levels and improve their well-being.
This real-world analysis presents new evidence regarding the dynamic efficacy of digital therapeutic solutions for people with moderate to high stress levels. The results are consistent with previous research that observed improvements in mental health metrics following digital, app-based interventions [
, , ]. Our findings also provide insight into the nonlinear nature of stress level reduction during the first 10 weeks of a digital behavioral health program by showing the direct association with breathing exercises during the improvement stage in the first 6 weeks and emphasizing the key role of breathing exercises on stress reduction. In the next 6-10 weeks, the reduced levels of stress are maintained indicating that experiencing the use of a behavioral health digital program is a sustainable approach that may create a positive environment leading to a meaningful change. A nonlinear effect of digital therapeutics has previously been demonstrated in studies of mental health recovery via digital therapeutic intervention [ , ]. Additionally, the nonlinear effect of chronic condition management has been previously demonstrated in studies of chronic condition management such as glucose levels in diabetes, blood pressure, and pain level changes over time [ , , ].The study of nonlinear change requires multiple assessments over time and examination of the individual trajectories of variables [
, ]. If the variables of interest are assessed frequently over the course of product use, processes can be examined to better understand what facilitates and inhibits change. In this study, we examined time course data moving beyond the question of whether stress level change occurs and toward an understanding of how change occurs. A piecewise mixed model analysis indicated a significant decrease in stress level during the period of the first 6 weeks of product use and maintained during the period from 6 to 10 weeks with no significant time-related trends. This real-world intervention may have captured how change in coping may occur. In other words, people initially improve by learning to cope more effectively with stress but that needs to be incorporated, so this change can occur over only a limited period before it can be truly integrated. Based on current findings it appears that it takes 6 weeks to learn and then 6-10 weeks to integrate before becoming a changed behavior.Although this real-world study does not relate to gender-specific experiences, it is notable that the gender ratio predominantly consists of women by 79% (388/490). Per previous studies, women are more likely to use e-mental health programs, designed features, and practices to reduce symptoms of stress or depression although they do not differ in terms of their general internet use [
]. The prevalence of major depressive episodes in women is about 2 times higher than that in men [ ]. This could be explained by the existence of gender norms, men are less likely than women to disclose mental health symptoms and often delay seeking help until symptoms become severe [ , ]. From the social role perspective, women often have a multitasking agenda hence, efficiency and convenience of treatment may be more regarded [ , ].In terms of physiological aspects, men and women were not seen to differ in terms of breathing practice and integrative body-mind training for dealing with stress conditions [
].To date, there have been very few large-scale studies examining the effectiveness of digital therapeutic interventions for emotional disorders delivered in real-world settings [
- ]. There is also limited quantitative literature on the associations between the program components and direct methods with clinical outcomes [ ].We hypothesized that breathing techniques may be an enhanced method to address and reduce the bodily and mental processes associated with stress. Breathing exercises are an easily taught and practiced direct method, and they can realize almost immediate benefits and therefore allow for greater behavioral change. Stress causes sympathetic activation; the sympathetic nervous system is 1 of the 2 branches of the autonomic nervous system [
]. The sympathetic nervous system plays a critical role in the body’s response to stress. When it is activated, it triggers the “fight or flight” response, which prepares the body for immediate action in response to a perceived threat or danger [ ]. The sympathetic nervous system is activated by the hypothalamus in response to a threat, which triggers the release of hormones such as adrenaline and noradrenaline [ ]. Therefore, various physiological responses are caused such as increased heart rate, blood pressure, and respiratory rate, as well as the release of glucose from the liver to provide energy for the body’s response [ ]. Our findings demonstrated that engagement with breathing exercises significantly moderated the reduction in stress levels during the period of weeks 1-6. Slow and deep breathing is known to activate the parasympathetic nervous system.Stress can have various causes and effects, and everyone experiences stress differently. However, a perceived sense of burden and a perceived lack of productivity are commonly associated with stress. Identifying and acknowledging these stress-related feelings are the first steps in taking proactive measures to address them. Therefore, we also hypothesized that the ranking of the two items in the questionnaire, that is, (1) “Have you felt overwhelmed or stressed about important responsibilities?” and “(2) What about feeling as though you were not as productive as you should’ve been?” would be associated with engagement with certain digital components. We assumed that an improvement in perceived stress is reflected by the ways those 2 items would be linked to product use when combining video sessions with digital tools. Our findings showed that both items’ rankings 1 and 2 were moderated by engagement in video sessions as well as in breathing exercises. Engagement with CBT-based video sessions has the potential to be effective and efficient in treating symptoms of mental health conditions in real-world settings [
- ]. Managing stress and handling challenges are obtained by learning how to cope with stress in day-to-day life and adjusting it to the level of stress necessary for optimal functioning. The video sessions explain the core concepts of problem-solving and decision-making to reduce burden and modulate perceptions of responsibilities.One of the strategies that helped to manage stress and improve well-being is setting realistic goals and prioritizing tasks [
]. Offering content and recommendations about breaking down tasks into manageable steps and setting realistic goals that combat the style of perfectionistic thinking possibly helped individuals to reduce feelings of burden and increase productivity reflected in items 1 and 2 in the questionnaire.It was consistently demonstrated in our findings that breathing exercises moderated the improvement of the general stress score and the ranking of items 1 and 2 as well. Breathing exercises have a significant impact on reducing perceived stress and promoting relaxation [
, ]. Deep breathing exercises, such as diaphragmatic breathing or belly breathing, engage the diaphragm muscle and stimulate the parasympathetic nervous system. The parasympathetic nervous system is the other branch of the autonomic nervous system, and it is responsible for promoting rest, relaxation, and digestion [ ]. It has been demonstrated that during respiration, inspiration inhibits sympathetic nervous system activity [ ]. Therefore, breathing techniques could be used as first-line and supplemental treatments for stress and emotional disorders [ , ]. Deep breathing exercises can help slow down the heart rate, bringing it closer to a calm and regular rhythm, contributing to a feeling of relaxation [ ]. By consciously focusing on deep breaths and consciously relaxing the muscles, breathing exercises help release tension and promote a sense of physical relaxation [ ]. During breathing exercise oxygen supply is increased supporting better delivery of oxygen to the body’s tissues, including the brain [ ]. It can improve mental clarity, focus, and overall well-being. Lastly, engaging in breathing exercises requires focusing attention on the breath. This helps shift the focus away from stressors, worries, and racing thoughts, promoting a mindful state of being in the present moment. Mindfulness has been shown to reduce stress and enhance overall psychological well-being [ ].Recent reviews in the field of mental health programs highlight the need for research that goes beyond examining the overall effects of such programs. Instead, there is a call for more nuanced investigations that delve into the associations between specific components or building blocks of these programs and the clinical outcomes observed. This approach aims to comprehend the relative contributions of various activities within digital health management protocols. Researchers and digital health organizations can gain a deeper understanding of what works best in digital health management protocols and improve the effectiveness of mental health interventions [
, ].Our findings indicate that breathing exercises and CBT-based video sessions help people lower their stress levels. These findings suggest that increasing digital engagement to specific activities in a lower engaged population may be an efficient way to optimize digital platforms supporting patients with moderate levels of stress. New models of care and digital tools have the potential to transform health care by increasing accessibility, promoting patient-centered care, improving timeliness, enhancing equity, and optimizing efficiency. Digital tools can empower patients to take an active role in their health care journey. This shift toward patient-centered care promotes collaboration and empowers individuals to make informed choices about their health [
, ].We expect that the analytical approach applied in this study will be beneficial for personalizing interventions and optimizing incentivization planning. This information could be used to further personalize outreach to encourage users to maintain their personal critical level of mental health activities. More research is required to further understand the current and potential moderating factors of digital intervention tools for mental health and how independent use of these tools facilitates the care of patients with day-to-day stress levels.
Limitations
In this study, we used a single-arm design that analyzed retrospective real-world data that lacked a comparison group or control group, contained a self-selection bias, and lacked randomization. While this design allowed us to explore the association between digital relaxation tools and stress levels, we acknowledge the limitation of not having a control group. The lack of a control group restricts our ability to establish causal relationships and control potential confounding variables. Future research efforts could consider incorporating a control group to further validate and extend the implications of our findings. Additionally, we acknowledged the gender distribution predominantly consisting of 79% (388/490) women that may potentially influence the results and interpretation of the results. However, women have higher rates of anxiety and depression and use more digital treatment [
, ], therefore our results may be specifically applicable to the real world. In other words, the real-world population of women who have more anxiety and depression may be better served with the use of a mobile app. Although this study’s research topics are not related to gender-specific experiences, future research should strive for a more balanced gender representation. It is also possible that people who chose to use digital therapeutic instruments were those who were most motivated to make a change in their conditions. These factors could limit the generalizability and create a challenge for drawing causal conclusions. The time scale was designed to reflect a weekly interval change over 10 weeks; however, the relationships of interest in this study could be potentially investigated in different scales emphasizing daily or monthly outcomes. Owing to the difficulty in tracking daily changes in stress levels, most real-world studies focus on weekly fluctuations.Stress level was the key outcome assessed in this study by using a stress questionnaire constructed by our internal experts. This questionnaire demonstrated a Cronbach α value of 0.73, an adequate reliability coefficient, as >0.70 is considered a measure of internal consistency [
, ]. It was decided to use our stress questionnaire although the Perceived Stress Scale-14, a 14-item scale, is the most widely used for measuring perceived stress [ ] since it has fewer items and may be more useful in increasing the answer rate among platform users.Conclusions
This study provided evidence that an increase in mental health management via digital engagement, specifically with relaxation tools, can help reduce stress levels over time. Although stress can be experienced in various forms, it is established that using an app as an integrated part of the health self-management process significantly improves clinical outcomes. It was demonstrated that breathing exercises have a significant impact on promoting relaxation. From a behavioral perspective, engaging with CBT content helps recognize stress causes and provides strategies to self-manage the feelings of burden, ultimately improving well-being. These findings provide a basis for encouraging users to take an active role and make informed choices about their health. Future work is needed to investigate current and other potential moderating factors and to develop a more comprehensive understanding of the importance of the app, how digital intervention tools work for mental health, and for whom they are most effective. This knowledge will guide the development and implementation of personalized and evidence-based digital interventions, ultimately improving mental health outcomes for individuals in a variety of contexts.
Conflicts of Interest
IB-A, OM, EB, and YF-H are employees of Dario Health. MDR and DLH are members of the Dario Health Scientific Advisory Board. OM is a stock and option holder of Dario Health.
References
- Stress and your health. MedlinePlus Medical Encyclopedia. URL: https://medlineplus.gov/ency/article/003211.htm [accessed 2023-06-07]
- What's the difference between stress and anxiety? American Psychological Association. URL: https://www.apa.org/topics/stress/anxiety-difference [accessed 2023-03-28]
- Mcdoniel S, Chmelik S. Sensate® Somacoustics: a new wave for stress management. Volume I. BioSelf Technology, Ltd. 2022. URL: https://www.researchgate.net/publication/362805482_SensateR_Somacoustics_A_New_Wave_for_Stress_ Management_Volume_I?channel=doi&linkId=62ffc696e3c7de4c346ae251&showFulltext=true [accessed 2024-03-01]
- Ray J. Americans' stress, worry and anger intensified in 2018. Gallup. 2019. URL: https://news.gallup.com/poll/249098/americans-stress-worry-anger-intensified-2018.aspx [accessed 2023-03-30]
- Alhasani M, Mulchandani D, Oyebode O, Orji R. A systematic review of persuasive strategies in stress management apps. CEUR-WS.org. URL: https://ceur-ws.org/Vol-2662/BCSS2020_paper4.pdf [accessed 2024-03-01]
- Pfeifer LS, Heyers K, Ocklenburg S, Wolf OT. Stress research during the COVID-19 pandemic and beyond. Neurosci Biobehav Rev. 2021;131:581-596. [FREE Full text] [CrossRef] [Medline]
- Stress in America 2022: concerned for the future, beset by inflation. American Psychological Association. URL: https://www.apa.org/news/press/releases/stress/2022/concerned-future-inflation [accessed 2023-03-28]
- Schwabe L, Joëls M, Roozendaal B, Wolf OT, Oitzl MS. Stress effects on memory: an update and integration. Neurosci Biobehav Rev. 2012;36(7):1740-1749. [CrossRef] [Medline]
- Tetrick LE, Winslow CJ. Workplace stress management interventions and health promotion. Annu Rev Organ Psychol Organ Behav. 2015;2(1):583-603. [FREE Full text] [CrossRef]
- Hannigan B, Edwards D, Burnard P. Stress and stress management in clinical psychology: findings from a systematic review. J Ment Health. 2004;13(3):235-245. [CrossRef]
- Xie Y, Tian J, Jiao Y, Liu Y, Yu H, Shi L. The impact of work stress on job satisfaction and sleep quality for couriers in China: the role of psychological capital. Front Psychol. 2021;12:730147. [FREE Full text] [CrossRef] [Medline]
- Michie S. Causes and management of stress at work. Occup Environ Med. 2002;59(1):67-72. [FREE Full text] [CrossRef] [Medline]
- Howarth A, Quesada J, Silva J, Judycki S, Mills PR. The impact of digital health interventions on health-related outcomes in the workplace: a systematic review. Digit Health. 2018;4:2055207618770861. [FREE Full text] [CrossRef] [Medline]
- Beiwinkel T, Eißing T, Telle NT, Siegmund-Schultze E, Rössler W. Effectiveness of a web-based intervention in reducing depression and sickness absence: randomized controlled trial. J Med Internet Res. 2017;19(6):e213. [FREE Full text] [CrossRef] [Medline]
- Stratton E, Lampit A, Choi I, Calvo RA, Harvey SB, Glozier N. Effectiveness of eHealth interventions for reducing mental health conditions in employees: a systematic review and meta-analysis. PLoS One. 2017;12(12):e0189904. [FREE Full text] [CrossRef] [Medline]
- Moe-Byrne T, Shepherd J, Merecz-Kot D, Sinokki M, Naumanen P, Hakkaart-van Roijen L, et al. Effectiveness of tailored digital health interventions for mental health at the workplace: a systematic review of randomised controlled trials. PLOS Digit Health. 2022;1(10):e0000123. [FREE Full text] [CrossRef] [Medline]
- Heber E, Ebert DD, Lehr D, Cuijpers P, Berking M, Nobis S, et al. The benefit of web- and computer-based interventions for stress: a systematic review and meta-analysis. J Med Internet Res. 2017;19(2):e32. [FREE Full text] [CrossRef] [Medline]
- Mojtabai R, Olfson M, Sampson NA, Jin R, Druss B, Wang PS, et al. Barriers to mental health treatment: results from the National Comorbidity Survey Replication. Psychol Med. 2011;41(8):1751-1761. [FREE Full text] [CrossRef] [Medline]
- Sickel AE, Seacat JD, Nabors NA. Mental health stigma update: a review of consequences. Adv Mental Health. 2014;12(3):202-215. [CrossRef]
- Renton T, Tang H, Ennis N, Cusimano MD, Bhalerao S, Schweizer TA, et al. Web-based intervention programs for depression: a scoping review and evaluation. J Med Internet Res. 2014;16(9):e209. [FREE Full text] [CrossRef] [Medline]
- Hafen E, Kossmann D, Brand A. Health data cooperatives—citizen empowerment. Methods Inf Med. 2014;53(2):82-86. [CrossRef] [Medline]
- van Roessel I, Reumann M, Brand A. Potentials and challenges of the health data cooperative model. Public Health Genomics. 2018;20(6):321-331. [FREE Full text] [CrossRef] [Medline]
- van Olmen J. The promise of digital self-management: a reflection about the effects of patient-targeted e-Health tools on self-management and wellbeing. Int J Environ Res Public Health. 2022;19(3):1360. [FREE Full text] [CrossRef] [Medline]
- Murray E, Hekler EB, Andersson G, Collins LM, Doherty A, Hollis C, et al. Evaluating digital health interventions: key questions and approaches. Am J Prev Med. 2016;51(5):843-851. [FREE Full text] [CrossRef] [Medline]
- Lecomte T, Potvin S, Corbière M, Guay S, Samson C, Cloutier B, et al. Mobile apps for mental health issues: meta-review of meta-analyses. JMIR mHealth uHealth. 2020;8(5):e17458. [FREE Full text] [CrossRef] [Medline]
- Leong QY, Sridhar S, Blasiak A, Tadeo X, Yeo G, Remus A, et al. Characteristics of mobile health platforms for depression and anxiety: content analysis through a systematic review of the literature and systematic search of two app stores. J Med Internet Res. 2022;24(2):e27388. [FREE Full text] [CrossRef] [Medline]
- Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev. 2012;32(4):329-342. [CrossRef] [Medline]
- Griffiths KM, Farrer L, Christensen H. The efficacy of internet interventions for depression and anxiety disorders: a review of randomised controlled trials. Med J Aust. 2010;192(S11):S4-S11. [CrossRef] [Medline]
- Yan K, Yusufi MH, Nazari N. Application of unified protocol as a transdiagnostic treatment for emotional disorders during COVID-19: an internet-delivered randomized controlled trial. World J Clin Cases. 2022;10(24):8599-8614. [FREE Full text] [CrossRef] [Medline]
- Dang A, Arora D, Rane P. Role of digital therapeutics and the changing future of healthcare. J Family Med Prim Care. 2020;9(5):2207-2213. [FREE Full text] [CrossRef] [Medline]
- Fitzpatrick KK, Darcy A, Vierhile M. Delivering cognitive behavior therapy to young adults with symptoms of depression and anxiety using a fully automated conversational agent (Woebot): a randomized controlled trial. JMIR Ment Health. 2017;4(2):e19. [FREE Full text] [CrossRef] [Medline]
- Salleh MR. Life event, stress and illness. Malays J Med Sci. 2008;15(4):9-18. [FREE Full text] [Medline]
- Ahmad TB, Meriç M. The effect of an online psychoeducational stress management program on international students' ability to cope and adapt. Perspect Psychiatr Care. 2021;57(4):1673-1684. [CrossRef] [Medline]
- Barrett K, Stewart I. A preliminary comparison of the efficacy of online Acceptance and Commitment Therapy (ACT) and Cognitive Behavioural Therapy (CBT) stress management interventions for social and healthcare workers. Health Soc Care Community. 2021;29(1):113-126. [CrossRef] [Medline]
- Jerath R, Crawford MW, Barnes VA, Harden K. Self-regulation of breathing as a primary treatment for anxiety. Appl Psychophysiol Biofeedback. 2015;40(2):107-115. [CrossRef] [Medline]
- Perciavalle V, Blandini M, Fecarotta P, Buscemi A, Di Corrado D, Bertolo L, et al. The role of deep breathing on stress. Neurol Sci. 2017;38(3):451-458. [CrossRef] [Medline]
- Kluge MG, Maltby S, Walker N, Bennett N, Aidman E, Nalivaiko E, et al. Development of a modular stress management platform (Performance Edge VR) and a pilot efficacy trial of a bio-feedback enhanced training module for controlled breathing. PLoS One. 2021;16(2):e0245068. [FREE Full text] [CrossRef] [Medline]
- Naik GS, Gaur GS, Pal GK. Effect of modified slow breathing exercise on perceived stress and basal cardiovascular parameters. Int J Yoga. 2018;11(1):53-58. [FREE Full text] [CrossRef] [Medline]
- Shabahang R, Aruguete MS, McCutcheon L. Video-based cognitive-behavioral intervention for COVID-19 anxiety: a randomized controlled trial. Trends Psychiatry Psychother. 2021;43(2):141-150. [FREE Full text] [CrossRef] [Medline]
- Cavanagh K, Churchard A, O'Hanlon P, Mundy T, Votolato P, Jones F, et al. A randomised controlled trial of a brief online mindfulness-based intervention in a non-clinical population: replication and extension. Mindfulness (N Y). 2018;9(4):1191-1205. [FREE Full text] [CrossRef] [Medline]
- Riboldi I, Cavaleri D, Calabrese A, Capogrosso CA, Piacenti S, Bartoli F, et al. Digital mental health interventions for anxiety and depressive symptoms in university students during the COVID-19 pandemic: a systematic review of randomized controlled trials. Rev Psiquiatr Salud Ment. 2023;16:47-58. [FREE Full text] [CrossRef] [Medline]
- Ost LG. Efficacy of the third wave of behavioral therapies: a systematic review and meta-analysis. Behav Res Ther. 2008;46(3):296-321. [CrossRef] [Medline]
- Spijkerman MPJ, Pots WTM, Bohlmeijer ET. Effectiveness of online mindfulness-based interventions in improving mental health: a review and meta-analysis of randomised controlled trials. Clin Psychol Rev. 2016;45:102-114. [FREE Full text] [CrossRef] [Medline]
- Komariah M, Ibrahim K, Pahria T, Rahayuwati L, Somantri I. Effect of mindfulness breathing meditation on depression, anxiety, and stress: a randomized controlled trial among university students. Healthcare (Basel). 2023;11(1):26. [FREE Full text] [CrossRef] [Medline]
- Venkatesan A, Krymis H, Scharff J, Waber A. Changes in perceived stress following a 10-week digital mindfulness-based stress reduction program: retrospective study. JMIR Form Res. 2021;5(5):e25078. [FREE Full text] [CrossRef] [Medline]
- Tavakol M, Dennick R. Making sense of Cronbach's alpha. Int J Med Educ. 2011;2:53-55. [FREE Full text] [CrossRef] [Medline]
- Ethical & Independent Review Services (E&I). URL: https://www.eandireview.com/ [accessed 2020-08-23]
- Kohli N, Peralta Y, Zopluoglu C, Davison ML. A note on estimating single-class piecewise mixed-effects models with unknown change points. Int J Behav Dev. 2018;42(5):518-524. [CrossRef]
- Moshe I, Terhorst Y, Philippi P, Domhardt M, Cuijpers P, Cristea I, et al. Digital interventions for the treatment of depression: a meta-analytic review. Psychol Bull. 2021;147(8):749-786. [CrossRef] [Medline]
- Fairburn CG, Patel V. The impact of digital technology on psychological treatments and their dissemination. Behav Res Ther. 2017;88:19-25. [FREE Full text] [CrossRef] [Medline]
- Maeng D, Cornell AE, Nasra GS. Utilization of an employee behavioral health program and its effects on outcomes for depression and anxiety disorders. J Occup Environ Med. 2019;61(10):812-817. [CrossRef] [Medline]
- Kunkle S, Yip M, Ξ W, Hunt J. Evaluation of an on-demand mental health system for depression symptoms: retrospective observational study. J Med Internet Res. 2020;22(6):e17902. [FREE Full text] [CrossRef] [Medline]
- Fundoiano-Hershcovitz Y, Bacher D, Ritholz MD, Horwitz DL, Manejwala O, Goldstein P. Blood pressure monitoring as a digital health tool for improving diabetes clinical outcomes: retrospective real-world study. J Med Internet Res. 2022;24(2):e32923. [FREE Full text] [CrossRef] [Medline]
- Fundoiano-Hershcovitz Y, Horwitz DL, Tawil C, Cohen O, Goldstein P. The two-stage therapeutic effect of posture biofeedback training on back pain and the associated mechanism: a retrospective cohort study. Front Physiol. 2022;13:958033. [FREE Full text] [CrossRef] [Medline]
- Hayes AM, Laurenceau JP, Feldman G, Strauss JL, Cardaciotto L. Change is not always linear: the study of nonlinear and discontinuous patterns of change in psychotherapy. Clin Psychol Rev. 2007;27(6):715-723. [FREE Full text] [CrossRef] [Medline]
- Fundoiano-Hershcovitz Y, Hirsch A, Dar S, Feniger E, Goldstein P. Role of digital engagement in diabetes care beyond measurement: retrospective cohort study. JMIR Diabetes. 2021;6(1):e24030. [FREE Full text] [CrossRef] [Medline]
- Barkham M, Stiles WB, Shapiro DA. The shape of change in psychotherapy: longitudinal assessment of personal problems. J Consult Clin Psychol. 1993;61(4):667-677. [CrossRef] [Medline]
- Smail-Crevier R, Powers G, Noel C, Wang J. Health-related internet usage and design feature preference for e-mental health programs among men and women. J Med Internet Res. 2019;21(3):e11224. [FREE Full text] [CrossRef] [Medline]
- Patten SB, Williams JVA, Lavorato DH, Wang JL, McDonald K, Bulloch AGM. Descriptive epidemiology of major depressive disorder in Canada in 2012. Can J Psychiatry. 2015;60(1):23-30. [FREE Full text] [CrossRef] [Medline]
- Swami V. Mental health literacy of depression: gender differences and attitudinal antecedents in a representative British sample. PLoS One. 2012;7(11):e49779. [FREE Full text] [CrossRef] [Medline]
- Judd F, Komiti A, Jackson H. How does being female assist help-seeking for mental health problems? Aust N Z J Psychiatry. 2008;42(1):24-29. [CrossRef] [Medline]
- Marton C, Choo CW. A review of theoretical models of health information seeking on the web. J Doc. 2012;68(3):330-352. [CrossRef]
- Chen J, Hou X, Zhao W. Research on the model of consumer health information seeking behavior via social media. Int J Commun, Netw Syst Sci. 2016;9(8):326-337. [FREE Full text] [CrossRef]
- Ma X, Yue ZQ, Gong ZQ, Zhang H, Duan NY, Shi YT, et al. The effect of diaphragmatic breathing on attention, negative affect and stress in healthy adults. Front Psychol. 2017;8:874. [FREE Full text] [CrossRef] [Medline]
- Teachman BA, Drabick DAG, Hershenberg R, Vivian D, Wolfe BE, Goldfried MR. Bridging the gap between clinical research and clinical practice: introduction to the special section. Psychotherapy (Chic). 2012;49(2):97-100. [FREE Full text] [CrossRef] [Medline]
- Lehtimaki S, Martic J, Wahl B, Foster KT, Schwalbe N. Evidence on digital mental health interventions for adolescents and young people: systematic overview. JMIR Ment Health. 2021;8(4):e25847. [FREE Full text] [CrossRef] [Medline]
- Bry LJ, Chou T, Miguel E, Comer JS. Consumer smartphone apps marketed for child and adolescent anxiety: a systematic review and content analysis. Behav Ther. 2018;49(2):249-261. [FREE Full text] [CrossRef] [Medline]
- Vis C, Kleiboer A, Prior R, Bønes E, Cavallo M, Clark SA, et al. Implementing and up-scaling evidence-based eMental health in Europe: the study protocol for the MasterMind project. Internet Interv. 2015;2(4):399-409. [FREE Full text] [CrossRef]
- Understanding the stress response. Harvard Health Publishing. 2020. URL: https://www.health.harvard.edu/staying-healthy/understanding-the-stress-response [accessed 2023-05-22]
- Sympathetic nervous system—an overview. ScienceDirect. URL: https://www.sciencedirect.com/science/article/abs/pii/B9780123739476003706 [accessed 2023-05-22]
- Stress effects on the body. American Psychological Association. URL: https://www.apa.org/topics/stress/body [accessed 2023-05-22]
- Gratzer D, Khalid-Khan F. Internet-delivered cognitive behavioural therapy in the treatment of psychiatric illness. CMAJ. 2016;188(4):263-272. [FREE Full text] [CrossRef] [Medline]
- Owusu JT, Wang P, Wickham RE, Cottonham DP, Varra AA, Chen C, et al. Blended care therapy for depression and anxiety: outcomes across diverse racial and ethnic groups. J Racial Ethn Health Disparities. 2023;10(6):2731-2743. [FREE Full text] [CrossRef] [Medline]
- Lungu A, Jun JJ, Azarmanesh O, Leykin Y, Chen CEJ. Blended care-cognitive behavioral therapy for depression and anxiety in real-world settings: pragmatic retrospective study. J Med Internet Res. 2020;22(7):e18723. [FREE Full text] [CrossRef] [Medline]
- Manso M, Schmelz J, Aloia T. ERAS-anticipated outcomes and realistic goals. J Surg Oncol. 2017;116(5):570-577. [CrossRef] [Medline]
- Breathing exercises for stress. National Health Service England. URL: https://www.nhs.uk/mental-health/self-help/guides-tools-and-activities/breathing-exercises-for-stress/ [accessed 2023-05-22]
- Dempsey JA, Sheel AW, St Croix CM, Morgan BJ. Respiratory influences on sympathetic vasomotor outflow in humans. Respir Physiol Neurobiol. 2002;130(1):3-20. [CrossRef] [Medline]
- Seals DR, Suwarno NO, Dempsey JA. Influence of lung volume on sympathetic nerve discharge in normal humans. Circ Res. 1990;67(1):130-141. [CrossRef] [Medline]
- How breathing exercises can boost your physical performance. AIA. URL: https://www.aia.com/en/health-wellness/healthy-living/healthy-body/Breathing-exercise-benefits [accessed 2023-05-22]
- The circulatory system and oxygen transport. Regulation of Tissue Oxygenation. URL: https://www.ncbi.nlm.nih.gov/books/NBK54112/ [accessed 2023-05-22]
- Bartlett L, Buscot MJ, Bindoff A, Chambers R, Hassed C. Mindfulness is associated with lower stress and higher work engagement in a large sample of MOOC participants. Front Psychol. 2021;12:724126. [FREE Full text] [CrossRef] [Medline]
- Rosenlund M, Kinnunen UM, Saranto K. The use of digital health services among patients and citizens living at home: scoping review. J Med Internet Res. 2023;25:e44711. [FREE Full text] [CrossRef] [Medline]
- Whealin JM, Jenchura EC, Wong AC, Zulman DM. How veterans with post-traumatic stress disorder and comorbid health conditions utilize eHealth to manage their health care needs: a mixed-methods analysis. J Med Internet Res. 2016;18(10):e280. [FREE Full text] [CrossRef] [Medline]
- Nunnally JC. Psychometric Theory. New York, NY. McGraw-Hill; 1967.
- Lee EH. Review of the psychometric evidence of the perceived stress scale. Asian Nurs Res (Korean Soc Nurs Sci). 2012;6(4):121-127. [FREE Full text] [CrossRef] [Medline]
- Ribeiro Santiago PH, Nielsen T, Smithers LG, Roberts R, Jamieson L. Measuring stress in Australia: validation of the perceived stress scale (PSS-14) in a national sample. Health Qual Life Outcomes. 2020;18(1):100. [FREE Full text] [CrossRef] [Medline]
Abbreviations
CBT: cognitive behavioral therapy |
HIPAA: Health Insurance Portability and Accountability Act |
Edited by A Mavragani; submitted 04.07.23; peer-reviewed by B Johansson; comments to author 06.10.23; revised version received 12.10.23; accepted 27.02.24; published 19.03.24.
Copyright©Inbar Breuer-Asher, Marilyn D Ritholz, David L Horwitz, Omar Manejwala, Ephraim Behar, Yifat Fundoiano-Hershcovitz. Originally published in JMIR Formative Research (https://formative.jmir.org), 19.03.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.