Published on in Vol 5, No 7 (2021): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/27436, first published .
Determining Acceptance of e-Mental Health Interventions in Digital Psychodiabetology Using a Quantitative Web-Based Survey: Cross-sectional Study

Determining Acceptance of e-Mental Health Interventions in Digital Psychodiabetology Using a Quantitative Web-Based Survey: Cross-sectional Study

Determining Acceptance of e-Mental Health Interventions in Digital Psychodiabetology Using a Quantitative Web-Based Survey: Cross-sectional Study

Original Paper

Clinic for Psychosomatic Medicine and Psychotherapy, LVR-University Hospital Essen, University of Duisburg Essen, Essen, Germany

Corresponding Author:

Mirjam Damerau, MSc

Clinic for Psychosomatic Medicine and Psychotherapy

LVR-University Hospital Essen, University of Duisburg Essen

Virchowstr. 174

Essen, 45147

Germany

Phone: 49 201 438755 228

Email: mirjam.damerau@uni-due.de


Background: Diabetes is a very common chronic disease that exerts massive physiological and psychological burdens on patients. The digitalization of mental health care has generated effective e-mental health approaches, which offer an indubitable practical value for patient treatment. However, before implementing and optimizing e-mental health tools, their acceptance and underlying barriers and resources should be first determined for developing and establishing effective patient-oriented interventions.

Objective: This study aims to assess the acceptance of e-mental health interventions among patients with diabetes and explore its underlying barriers and resources.

Methods: A cross-sectional study was conducted in Germany from April 9, 2020, to June 15, 2020, through a web-based survey for which patients were recruited via web-based diabetes channels. The eligibility requirements were adult age (18 years or older), a good command of the German language, internet access, and a diagnosis of diabetes. Acceptance was measured using a modified questionnaire, which was based on the well-established Unified Theory of Acceptance and Use of Technology (UTAUT) and assessed health-related internet use, acceptance of e-mental health interventions, and its barriers and resources. Mental health was measured using validated and established instruments, namely the Generalized Anxiety Disorder Scale-7, Patient Health Questionnaire-2, and Distress Thermometer. In addition, sociodemographic and medical data regarding diabetes were collected.

Results: Of the 340 participants who started the survey, 261 (76.8%) completed it and the final sample comprised 258 participants with complete data sets. The acceptance of e-mental health interventions in patients with diabetes was overall moderate (mean 3.02, SD 1.14). Gender and having a mental disorder had a significant influence on acceptance (P<.001). In an extended UTAUT regression model (UTAUT predictors plus sociodemographics and mental health variables), distress (β=.11; P=.03) as well as the UTAUT predictors performance expectancy (β=.50; P<.001), effort expectancy (β=.15; P=.001), and social influence (β=.28; P<.001) significantly predicted acceptance. The comparison between an extended UTAUT regression model (13 predictors) and the UTAUT-only regression model (performance expectancy, effort expectancy, social influence) revealed no significant difference in explained variance (F10,244=1.567; P=.12).

Conclusions: This study supports the viability of the UTAUT model and its predictors in assessing the acceptance of e-mental health interventions among patients with diabetes. Three UTAUT predictors reached a notable amount of explained variance of 75% in the acceptance, indicating that it is a very useful and efficient method for measuring e-mental health intervention acceptance in patients with diabetes. Owing to the close link between acceptance and use, acceptance-facilitating interventions focusing on these three UTAUT predictors should be fostered to bring forward the highly needed establishment of effective e-mental health interventions in psychodiabetology.

JMIR Form Res 2021;5(7):e27436

doi:10.2196/27436

Keywords



Background

Diabetes is a common chronic disease that exerts a heavy physiological and psychological burden on patients. In 2017, approximately 451 million adult patients were affected worldwide, and the number is steadily increasing [1]. As diabetes is considered to be “one of the most psychologically demanding of chronic medical illnesses” [2], the integration of psychological care in the management of diabetes is crucial [3,4].

Living with diabetes means facing day-to-day challenges and complications resulting in considerable emotional distress [5], which can lead to a higher risk of psychological disorders. Indeed, patients with diabetes show disproportionately higher rates of psychological disorders than those without diabetes [5], including depression and anxiety [6,7]. Considering psychological comorbidity, diabetes mellitus is often accompanied by depression (18.8%-24%) [8-10]. They occur twice as frequently together as predicted by chance alone and worsen each other because of underlying biological and behavioral mechanisms such as diabetes-related symptoms and sleep disorders [11,12]. A meta-analysis including more than 50,000 participants confirmed the major role of depression as a comorbidity of diabetes, and found that participants with type 2 diabetes had significantly higher depression rates than those without diabetes (17.6% vs 9.8%; odds ratio 1.6, 95% CI 1.2-2.0) [13]. Regarding the prevalence of anxiety, a systematic review found that 14% of patients with diabetes who participated in clinical studies with generalized anxiety disorder and 27% with subsyndromal anxiety disorder [14]. Considering that 40% of their participants expressed the elevated symptoms of anxiety (N=1283 in 7 studies), anxiety turned out to be a major mental health threat to people with diabetes.

The psychological vulnerability of people with diabetes manifests itself in the heightened risks of psychological disorders; for example, the risk of developing depression is 24% higher in patients with type 2 diabetes than in individuals without diabetes [15]. However, diabetes and mental health appear to exert a bidirectional effect on each other because poor mental health is associated with an increased risk of developing type 2 diabetes [16]. Psychological support and self-empowerment are crucial, as diabetes impairs the psychological well-being and quality of life [17]. Although diabetes-related self-management education programs can reduce diabetes-related as well as emotional distress [5,18], help foster self-efficacy [18] and have proven their effectiveness [19] and cost-effectiveness [20] as demonstrated by web-based structured education programs, they are still not implemented to a sufficient extent in routine diabetes care [21]. Therefore, improving diabetes-related knowledge and self-care practices should be a major goal in diabetes management to reduce the risks of developing and chronifying psychological disorders [5,22].

The digitalization of mental health care has generated effective e-mental health approaches, which have an indubitable practical value for patient treatment [23-26]. The effects of e-mental health interventions for some mental disorders are comparable with those of a traditional face-to-face therapy [26]. Nonetheless, web-based interventions offer several advantages that cannot be provided by offline interventions, for example, offering an anonymous, low-threshold, cost-effective, time- and location-flexible alternative [27]. However, limited accessibility, negative treatment expectancies, and concerns about anonymity create serious challenges in the implementation of e-mental health approaches. To date, existing e-mental health interventions have mainly focused on psychosomatic inpatients and provide information and interactive tasks based on cognitive behavioral, psychodynamic, or acceptance and commitment therapy [28]. Unfortunately, clinical e-mental health interventions are still scarce and are not well known among patients in Germany [29]. Although patients with diabetes can make use of several apps and at least some (web-based) diabetes education programs that help in disease management [30,31], only a few web-based e-mental health interventions exist. A recent systematic review from 2021 found 9 studies offering digital interventions for psychological comorbidities in patients with diabetes [32]. Two of these studies were conducted in Germany [33,34] and both offered the guided self-help web-based intervention GET.ON Mood Enhancer Diabetes for depression in people with diabetes. Furthermore, 7 out of these 9 studies found the offered e-mental health intervention to be effective in terms of improvements in depressive symptoms [33-39] and 4 found the intervention effective with respect to diabetes (specific emotional) distress [34,37-39]. Given the current situation concerning the COVID-19 pandemic, the need for innovative and easily accessible approaches in psychological care is evident and has also increased. There is a scientific consensus that depression, anxiety, sleeping problems, and stress have increased over the course of the ongoing pandemic [40-45]. With the knowledge of the vulnerability of people with diabetes and in light of the pandemic and its mental health implications, we conducted a study to investigate the acceptance of e-mental health interventions in patients with diabetes.

As previous research suggests that patients with diabetes having depression symptoms might have a low motivation to participate in a screening program or psychological care [46], the acceptance of (future) interventions is a major variable that research should be considered. Thus, before implementing and optimizing e-mental health tools, their acceptance and underlying barriers and resources should first be examined and understood. In terms of usefulness, even the best intervention can only be beneficial to those patients using it. Therefore, the determinants of acceptance and uptake of e(-mental) health interventions need to be further analyzed. The research on eHealth acceptance has harnessed the Unified Theory of Acceptance and Use of Technology (UTAUT) for assessing the predictors of behavioral intention and acceptance [28,47-51]. The UTAUT model contributed to the analysis of factors that influence the acceptance of e-mental health interventions in patients with diabetes [52]. This model and its e-mental health specific extensions [28,52] enabled researchers to tailor interventions properly to specific patient groups, because acceptance-influencing determinants were known from analysis with the UTAUT. Unfortunately, barely any validation of the UTAUT has been investigated in e-mental health programs for patients with diabetes. However, there is some evidence in disease management programs. For example, a survey of 116 patients with diabetes used the UTAUT model to identify the factors that influence the acceptance of telemedicine services. Researchers have found that performance expectancy (PE), effort expectancy (EE), and social influence (SI) are significant factors that contribute to the acceptance of telemedicine services for diabetes management. In addition, gender and age were identified as moderators between PE and acceptance as predicted by the UTAUT model [53].

The UTAUT postulates four core predictors: PE, EE, SI, and facilitating conditions (FC) [54]. Acceptance itself is operationalized as behavioral intention, which is predicted by the first three core predictors, whereas actual use is predicted by behavioral intention and FC. PE describes the degree to which an individual believes that using a system will be helpful. EE is defined as the degree of ease associated with the use of a system. SI describes the degree to which an individual perceives that important other, such as family or friends, would approve of the use of the system. FC are defined as the degree to which an individual believes that an organizational and technical infrastructure exists to support the use of a system. By applying UTAUT as a method of measuring acceptance, the notable values of explained variance (70%) can be achieved [54]. To prove external validity and generalizability, UTAUT needs to be explored in different target groups. Given the massive physiological and psychological burdens caused by diabetes, this study focused on investigating the acceptance of e-mental health interventions in a sample of patients with diabetes.

Objectives

This study aims to determine the acceptance of e-mental health interventions among patients with diabetes and explore the underlying factors influencing patients’ intentions to use such interventions. The acceptance of e-mental health interventions is associated with sociodemographic characteristics such as gender, age, and education [28,55] and mental health, such as anxiety and current or past mental disorders [48,55]. Therefore, we extended the UTAUT model and added sociodemographic, medical, and validated mental health variables as the direct predictors of acceptance. In addition, this study aims to examine the viability of the UTAUT model with its three predictors of acceptance (PE, EE, and SI) in assessing patients with diabetes’ acceptance of e-mental health interventions and to investigate whether this extended UTAUT model proves to be superior and more effective. Furthermore, an additional goal is to examine whether age and gender modulate the relationship of PE, EE, SI and acceptance, respectively, as postulated by the UTAUT [54]. Thus, the following research questions are addressed:

  1. To what extent do patients with diabetes accept e-mental health interventions and does acceptance differ significantly regarding sociodemographic or medical characteristics of the participants?
  2. Is the proposed extended UTAUT model suitable to predict the acceptance of e-mental interventions in patients with diabetes and which factors are significant predictors?
  3. Is the proposed extended UTAUT model superior to the UTAUT model and do age and gender modulate the relationship between each UTAUT predictor and acceptance?

Answers to the research questions above might contribute to the process of implementing and improving e-mental health interventions. Especially during the ongoing COVID-19 pandemic, these results may be beneficial to individuals with mental health problems or those at a higher risk of developing psychological disorders.


Study Design and Participants

A cross-sectional study was conducted to assess the acceptance of e-mental health interventions and its underlying predictors in patients with diabetes. The Checklist for Reporting Results of Internet E-Surveys was used to report the methods and results of our web-based open survey [56]. From April 9 to June 15, 2020, participants were recruited via web-based diabetes channels and social media. The eligibility requirement was adult age (18 years or older), a good command of the German language, internet access, and a diagnosis of diabetes. All participants gave electronic informed consent before the survey began and were told about the length of time of the survey, which took approximately 15 minutes to complete. Participation was anonymous and voluntary, and the participants could withdraw from it at any time without harm. No financial compensation was offered, and no personal information was collected or stored. Of the 340 participants, 261 (76.8%) completed the survey, thereby forming the total sample of 261 participants. Three participants who stated not to have diabetes were excluded; hence, the final sample comprised 258 participants (192/258, 74.4% female and 66/258, 26.6% male) with complete cases. Multiple entries from the same individual were prevented by using cookies. The study was conducted in accordance with the Declaration of Helsinki and approved by the ethics committee of the medical faculty of the University Duisburg-Essen (19-89-47-BO).

Measures

Overview

The web-based survey contained items on sociodemographic, medical, and mental health data. In addition, we used the validated and well-established UTAUT questionnaire, which assesses health-related internet use, acceptance of eHealth interventions, and barriers and resources of eHealth use [54], and modified it to our research questions based on previous adaptations (Textbox 1). To assess mental health, validated measures were used, such as the Patient Health Questionnaire-2 (PHQ-2) [57], the Generalized Anxiety Disorder Scale-7 (GAD-7) [58], and the Distress Thermometer (DT) [59].

Adapted items of the Unified Theory of Acceptance and Use of Technology model and references of original studies. Italicized verbalizations have been adapted.

Behavioral Intention (=acceptance)

  • “I would like to try a psychological web-based intervention.” [52,60,61]
  • “I would use a psychological web-based intervention if offered to me.” [52,60,61]
  • “I would recommend a psychological web-based intervention to my friends.” [48]

Social Influence

  • “People close to me would approve the use of a psychological web-based intervention.” [52,54,60,61]
  • “My general practitioner would approve the application of a psychological web-based intervention.” [52,60,61]
  • “My friends would approve a psychological web-based intervention.” [28]

Performance Expectancy

  • “A psychological web-based intervention could improve my general well-being.” [52,60,61]
  • “A psychological web-based intervention could help me with distress.” [52,60,61]
  • “A psychological web-based intervention could help me improve my personal (psychological) health.” [52,60,61]

Effort Expectancy

  • “The use of a psychological web-based intervention would not be an additional burden to me.” (Self-constructed)
  • “A psychological web-based intervention would be easy to operate and comprehend.” [49,52,54,60,61]
  • “I could arrange using a psychological web-based intervention in my everyday life.” [28]
Textbox 1. Adapted items of the Unified Theory of Acceptance and Use of Technology model and references of original studies. Italicized verbalizations have been adapted.
Sociodemographic and Medical Data

Sociodemographic and medical data were assessed using items on gender, age, marital status, having children (aged<18 years), educational level, occupational status, and community size. Age was measured in six categories (18-24, 25-34, 35-44, 45-54, 55-64, and 65 or above). Regarding their medical condition, participants were asked whether they had a mental disorder, diabetes type, how well their diabetes was controlled, how their diabetes was treated, and since when they knew of their diabetes diagnosis. In terms of diabetes treatment, participants could state whether their diabetes was treated with oral medication, insulin, other treatment methods, or not treated, and multiple answers were possible.

Acceptance and UTAUT Predictors

Acceptance was operationalized as behavioral intention in accordance with the UTAUT and was measured using three items (Textbox 1). In terms of its specific content, acceptance was defined as the acceptance of a general psychological web-based intervention, which had neither been specified and tailored to patients with diabetes nor offered during this study or later. The underlying UTAUT predictors PE, EE, and SI were measured using three items each (Textbox 1). Answers were indicated on a 5-point Likert scale ranging from 1 (totally disagree) to 5 (totally agree). As FC are based on the UTAUT just as a predictor of use (use behavior) and not acceptance itself [54], FC have not been included in the statistical analyses. Cronbach α values in this study were .87 for acceptance, .96 for PE, .81 for EE and .87 for SI, proving a high internal consistency.

GAD-7 Anxiety

The GAD-7 comprises seven items measuring the frequency of anxiety symptoms over the past 2 weeks on a 4-point Likert scale (0=never to 3=nearly every day). According to previous validation samples, a sum score of ≥5, ≥10, and ≥15 points to mild, moderate, and severe generalized anxiety symptoms, respectively. This assessment instrument has demonstrated high reliability and validity in health care and research [58]. Cronbach α in this study was .91, indicating a high internal consistency.

PHQ-2 Depressive Symptoms

The PHQ-2 comprises two items that screen the frequency of depressive symptoms over the past 2 weeks on a 4-point Likert scale (0=never to 3=nearly every day). A sum score of ≥3 serves as a cutoff for major depressive symptoms [57]. In our study, the internal consistency was sufficient, with Cronbach α=.84.

DT Distress

The DT [59] involves one visual analog scale from 0 (no distress) to 10 (extreme distress) experienced in the past week. A score of ≥4 indicated increased psychological distress [62].

The items were not randomized or alternated among individuals. The participants were able to change and review their responses while answering. Only completely answered questionnaires could be sent off and were analyzed.

Statistical Analyses

Overview

Data analysis was performed using SPSS 26 (IBM), the macro process by Andrew F Hayes (version 3.3) [63] and the software R [64] (version 3.6.3; R Foundation for Statistical Computing). The level of significance was set at α=.05 (two-sided tests) except for two-tailed t tests and analysis of variances (ANOVAs; see Research Question 1). First, the internal consistencies and descriptive statistics were calculated. Second, general acceptance was computed and its distribution was assessed (research question 1). In accordance with previous research [28], acceptance (1-5) was categorized by mean in low (1-2.34), moderate (2.35-3.67), and high (3.68-5) acceptance, and the respective frequencies were calculated.

Research Question 1: Acceptance and Its Differences by Sociodemographic and Medical Data

Next, the means of acceptance were compared between groups regarding sociodemographic and medical data using t tests and ANOVAs to include variables with multiple categories (research question 1). Bonferroni correction was applied to keep the α error low for multiple pairwise comparisons. To prevent the inflation of the α error caused by multiple t tests and ANOVAs, we adjusted the respective α level for each t test and each ANOVA. For each t test, the level of significance was .017 and .007 for each ANOVA.

The normal distribution of acceptance was examined with the Kolmogorov-Smirnov test, skewness, and kurtosis and graphically via a histogram including a normal distribution curve. All these measures detected violations against a normal distribution. Parametric tests were still performed for two reasons. First, according to the central limit theorem, the sampling distribution of the mean of a variable can be safely assumed to be normal if the variable and its mean are normally distributed in the population and the sample size is sufficiently large. We consider our sample size of 258 to be sufficient, because some literature suggests that such an effect already emerges with a sample size of n=30 [65]. In addition, other researchers found acceptance distributions that did not seem to differ from the normal distribution [48], thereby indicating that variable acceptance might be normally distributed in the population. Second, t tests and ANOVAs are considered to be robust against violations assuming normal distribution [66].

Research Question 2: Predictors of Acceptance

Using multiple hierarchical regression analyses, the predictive models of acceptance were tested and compared (research question 2). The following predictors were included blockwise: (1) sociodemographic and medical variables, (2) mental health variables, and (3) UTAUT predictors. The categorical variable age was dummy coded before being included in the regression analyses; the category with the highest n (age 45-54, n=70) was used as a reference. In addition, the full model was tested against a restricted model (UTAUT predictors only) (research question 3). No multicollinearity could be detected, because all values of the variance inflation factor were <5. To examine the normality of residuals, the Kolmogorov-Smirnov test was computed (P=.20) and q-q plots were visually inspected; both showed no signs of violations against normality. Homoscedasticity was proven based on a scatter plot of the standardized residuals and adjusted predicted values.

Research Question 3: UTAUT Versus Full Regression Model and Moderator Analyses

In the final step, bootstrapped moderation analyses (model 1) were performed with acceptance as the dependent variable; UTAUT predictors PE, EE, and SI as the respective independent variable; and age or gender as a potential moderator (research question 3). The number of bootstrap samples was set to 10,000. Independent variables were centered, because the value 0 was not defined on a 5-point Likert scale ranging from 1 (totally disagree) to 5 (totally agree).


Sociodemographic and Medical Data

Of the 258 participants, 192 (74.4%) women and 66 (25.6%) men participated in the study. Most participants (n=234, 90.7%) were middle age (25-64 years), whereas the most frequent age category was 45-54 years (70/258, 27.1%). Marital status was classified as either mostly married or in a relationship (174/258, 67.4%). The majority (200/258, 77.5%) had no children aged <18 years. Our sample was highly educated, because 62.5% (162/258) had higher education entrance qualifications or university education; most were employed (160/258, 62%). The community size was nearly balanced, meaning that none of the four community size categories occurred predominantly. Table S1 in Multimedia Appendix 1 provides a comprehensive summary of sociodemographic information.

A mental disorder was present in 27.5% (71/258) participants. Regarding the type of diabetes, 67.4% (174/258) participants had type 1 diabetes, 28.7% (74/258) patients had type 2 diabetes, and 3.9% (10/258) had other types of diabetes. In total, 49.6% (128/258) participants rated their diabetes control as being good and 5.4% (14/258) as not good. In terms of medical treatment for diabetes, 76% (196/258) used oral medication, 84.1% (217/258) injected insulin, 3.9% (10/258) had other treatment, and 3.5% (9/258) had no treatment. On average, patients had known of their diabetes disease for approximately 17 years (mean 16.98, SD 13.64).

The GAD-7 (mean 6.12, SD 5.20) measures revealed that 29.1% (75/258) of participants had mild, 16.6% (43/258) had moderate, and 7.8% (20/258) had severe anxiety symptoms (Tables S2-S4 in Multimedia Appendix 1). The analyses of measures of PHQ-2 (mean 1.52, SD 1.75) and DT (mean 4.72, SD 2.90) resulted in 21.7% (56/258) and 65.9% (170/258) participants, respectively, reaching the cutoff values of 3 and 4, respectively (Tables S2-S4 in Multimedia Appendix 1). Further information about GAD-7, PHQ-2, and DT measures stratified by gender, age, and diabetes type are displayed in the Multimedia Appendix 1 (Tables S2-S7).

Research Question 1: Acceptance and Its Differences by Sociodemographic and Medical Data

The general acceptance of e-mental health interventions was moderate, with a mean of 3.02 (SD 1.14). Its distribution can be roughly estimated as one-third for each category; 34.1% (88/258) participants showed low, 37.2% (96/258) showed moderate, and 28.7% (74/258) showed high acceptance. Acceptance differed significantly between female and male participants (t256=4.21; P<.001), with a higher acceptance in women than in men. Having a psychological illness was also significantly associated with higher acceptance ratings (t256=−4.47; P<.001). No differences in acceptance regarding age groups, marital status, having children aged under 18 years, educational status, occupational status, community size, diabetes type, and diabetes control were observed. Table S1 in Multimedia Appendix 1 illustrates acceptance scores as a function of sociodemographic and medical data.

Research Question 2: Predictors of Acceptance

The multiple hierarchical regression analysis revealed that the sociodemographic and medical variables included in the first step explained 14.2% of the variance in acceptance (R²=0.142; F7,250=5.903; P<.001). Therefore, gender (β=−.20; P=.001) and having a mental disorder (β=.24; P<.001) significantly predicted acceptance. The mental health variables included in the second step (R²=0.204; F10,247=6.347; P<.001) significantly increased the explained variance (ΔR²=0.063; F3,247=22.166; P<.001), even though none of these variables were significant predictors of acceptance. However, generalized anxiety (GAD-7) was very close to statistical significance (P=.05). The UTAUT predictors included in the last step (R²=0.770; F13,244=62.966; P<.001) changed the explained variance significantly by 56.6% (ΔR²=0.566; F3,244=200.451; P<.001), further resulting in a total percentage of explained variance of 77%. PE (β=.50; P<.001), EE (β=.15; P=.001), and SI (β=.28; P<.001) significantly predicted acceptance. In addition, the DT was a significant predictor of acceptance in the full regression model (β=.11; P=.03). Table 1 presents the regression parameters of the hierarchical regression model of acceptance.

Table 1. Hierarchical regression model of acceptance. N=258.a
PredictorStandardized coefficient βUnstandardized coefficient β, BTDetermination coefficient, R²Changes in R², ΔR²P value
Step 1: sociodemographic and medical predictors0.1420.142

Gender−.204−.533−3.368

.001

Ageb−.053, .083−.327, .260−0.696, 1.193

.42

Mental disorder.240.6124.056

<.001
Step 2: mental health variables0.2040.063

GAD-7c.216.0471.934

.05

PHQ-2d−.028−.018−0.273

.76

Distress Thermometer [59].119.0471.383

.17
Step 3: UTAUTe predictors0.7700.566

Performance expectancy.503.48710.340

<.001

Effort expectancy.150.1813.366

.001

Social influence.282.3286.268

<.001

aIn Steps 2 and 3, only the newly included variables are presented.

bAge was measured in categories and therefore has been included as a dummy variable. The category with the highest n (age: 45-54 years, n=70) was used as a reference. For β, B, and T minima, the maxima of each group contrast are presented. The P value was aggregated using the statistical software R; no single P value of each contrast reached statistical significance.

cGAD-7: Generalized Anxiety Disorder Scale-7 [58].

dPHQ-2: Patient Health Questionnaire-2 [57].

eUTAUT: Unified Theory of Acceptance and Use of Technology.

Research Question 3: UTAUT Versus Full Regression Model and Moderator Analyses

The comparison between our extended UTAUT model (13 predictors) and the UTAUT-only model (three predictors) revealed no significant difference in explained variance in acceptance (F10,244=1.567; P=.12).

Several moderation analyses have been computed to prove whether age and gender work as moderators, as postulated by the UTAUT [54]. None of them turned out to be statistically significant. Thus, neither gender nor age moderated the relationship between acceptance and the respective UTAUT predictor PE (gender: P=.61, F1,254=0.269; age: P=.34, F1,254=0.922), EE (gender: P=.33, F1,254=0.962; age: P=.28, F1,254=1.162), or SI (gender: P=.10, F1,254=2.726; age: P=.53, F1,254=0.400).


Principal Findings

This study examined the acceptance of e-mental health interventions among patients with diabetes and explored factors influencing patients’ intention to use such interventions. The overall acceptance of e-mental health interventions was moderate. Acceptance was associated with gender and mental illness, because women and participants with mental illness had a significantly higher acceptance than men and participants without a stated mental disorder. No difference in acceptance regarding other sociodemographic and medical data were observed, whereas diabetes type only failed to show a statistical significance based on an adapted level of significance (see Statistical Analyses section). In the full regression model, the acceptance of e-mental health interventions was significantly predicted by mental health variable distress (DT) as well as the UTAUT predictors PE, EE, and SI. The UTAUT predictors (restricted model with UTAUT predictors only) reached a similar explained variance (75%) in acceptance as the full regression model (13 predictors). Neither gender nor age were moderators of the relationship between each UTAUT predictor and acceptance, which contradicts one postulation of the UTAUT [54].

Comparison With Previous Work

Our results confirm the high psychological vulnerability of patients with diabetes, which previous studies had emphasized [5-15], as approximately 21.7% (56/258) and 65.9% (170/258) of our participants expressed indications of major depression (PHQ-2≥3) and elevated distress (DT≥4), respectively. Measures of the GAD-7 showed that 16.7% (43/258; GAD-7≥10) and 7.8% (20/258; GAD-7≥15) had moderate and severe levels of anxiety, respectively.

Despite the proven high psychological vulnerability of patients with diabetes, for example, the increased risk of developing depressive symptoms caused by, for example, heavy demands and major distress or medical complications and constraints this disease and its treatment poses [67,68], research on determining the acceptance of e-mental health interventions, which could have provided help flexibly, and its underlying barriers and resources have been scarce. In particular, research using validated measures (eg, UTAUT) assessing the acceptance of e-mental health interventions in people with diabetes has been lacking. To our knowledge, only one study took on this major research subject [52] and conducted important research groundwork by doing so. Nevertheless, our study was imperative and is of great significance for the following reasons. First, their focus was on determining acceptance and examining the effectiveness of an offered acceptance-facilitating intervention (AFI) and not on assessing acceptance and its predictors and testing the viability of the UTAUT model. Second, the sample size of patients with diabetes was smaller, and the study was conducted 7 years ago. Third, their measurement methods implied noteworthy deficiencies; although relying on the UTAUT, FC were regarded as a predictor of acceptance, and not just a predictor of use [54]. In addition, behavioral intention as an operational construct of acceptance is measured using four items instead of three, which is also discordant to the UTAUT [54]. In particular, by deviating in this matter and adding a fourth self-generated item covering willingness to pay for e-mental health interventions, the authors diverge from previous research and respective UTAUT adaptations [28,47,49], not taking advantage of the viability and validity of the UTAUT and its adaptations to the field of e-(mental) health acceptance.

As stated above, the research group investigated patients with diabetes’ behavioral intention to use internet-based interventions for depression [52]. The measured acceptance ratings differed from our results (mean 3.02, SD 1.14). Transforming their acceptance scale (4-20) to our acceptance scale (1-5), the average acceptance was lower than that observed in our diabetes sample (control group: mean 2.42, SD 1.07; intervention group: mean 2.64, SD 1.18), but the variance was comparable. Different selection methods may have contributed to these differences. In contrast to the recruitment in the aforementioned study, recruitment was conducted via the internet, resulting in a sample of patients with diabetes that may have been more open to and interested in e-mental health interventions. On the other hand, the passage of time and increasing digitalization and experiences with and knowledge of e(-mental) health tools may also have accounted for these differences. In addition, by adding a fourth finance-based self-generated item of behavioral intention, acceptance ratings might not be comparable. Contrary to the expectations of the researchers, their AFI had no significant effect on acceptance and its predictors. However, subgroup analyses revealed a significant effect for female participants and yielded a trend for younger (<59), depressed, diabetes-related distressed participants, and for those with a low frequency of internet usage to benefit from their AFI [52]. Therefore, future AFIs should probably be tailored to the specific needs of the respective subpopulations.

Studies assessing the acceptance of e-mental health interventions in general found the following variables to be significantly associated with acceptance: gender [55], age [55], education [55], anxiety [48], internet anxiety [48], prior e-mental health use [55,69], and current or past mental disorders [55]. An investigation of acceptance of a web-based aftercare in a mixed inpatient sample with subgroups from different medical clinics revealed that acceptance was significantly associated with (younger) age, (higher) education, stress due to permanent availability, private internet access, and prior eHealth use [28]. With regard to a diabetes-specific web-based platform for patients with type 2 diabetes, stating interest was significantly associated with being male, younger age, higher education, and shorter duration of type 2 diabetes [70].

In line with previous research, acceptance ratings in this study were significantly associated with gender and current or past mental illness. However, contrary to previous studies [25,52], acceptance ratings in this study were significantly higher for women than for men. Age and educational background were not significantly associated with acceptance. Nevertheless, acceptance in this study showed a descriptive trend toward a higher acceptance in younger participants.

Exploring the underlying predictors of eHealth acceptance, previous research adapted the UTAUT and identified the following significant predictors: the UTAUT predictors PE [28,50,51,71], EE [28,50,51,71] and SI [28,50,51] and other predictors namely perceived reliability [51], stress due to permanent availability [28], perceived security [71], technology anxiety [50], and resistance to change [50]. FC are the fourth core predictors of UTAUT, which is supposed to significantly predict the actual usage, but not the behavioral intention (=acceptance) [54]. However, some studies incorporated FC as a fourth UTAUT predictor of acceptance [28,50,51,71], generating inconsistent results. In 2 studies, FC was a significant predictor of acceptance, whereas others were not. In case of significance, its predictive value can be regarded as rather low, for example, reaching correlations of r=0.12 with acceptance [71].

Our results support the viability of UTAUT in determining e-mental health acceptance. The proportion of explained variance by PE, EE, and SI was high in this study (75%) and comparable with those of the original UTAUT validation study (70%) [54]. Confirming previous research, in this study PE was the key predictor of acceptance [28,49,50,54,72].

Acceptance operationalized as behavioral intention can be regarded as a significant and highly valid predictor of actual usage behavior. According to the UTAUT, behavioral intention is a significant predictor of actual use, and both correlate with r=0.59 [54]. In addition, prior eHealth research emphasized the major role of acceptance regarding a valid prediction of the actual eHealth usage: predicting the usage of mobile health services, behavioral intention had a significant effect and reached notable standardized regression coefficients of β=.415 [50] and β=.372 [51] in the respective structural model. Moreover, acceptance can predict the future use of eHealth interventions, as higher ratings of acceptance led to higher use of an unguided web-based intervention for chronic pain [48]. Nevertheless, the majority of studies on e(-mental) health acceptance do not measure its actual use (eg, uptake rate of an offered intervention), and if so, usage behavior was assessed retrospectively. To prove the prospective validity of acceptance, future research should include actual use and uptake rates as an outcome measure and assess acceptance in advance.

Comparing the acceptance and use of eHealth in terms of significant associations with sociodemographic variables, the findings appear to be similar. For both age and education, significant associations are generated, as younger age and higher educational level are associated with higher acceptance and higher use [28,55,70,73-75]. In contrast to acceptance, eHealth use was found to be associated with income and living conditions, finding that not living alone and higher income were associated with higher usage behavior [73,74]. Gender with regard to eHealth use has resulted in inconsistent results. A recent review found 8 studies with no significant association between gender and eHealth use and 5 studies stating a significant association between gender and eHealth use in patients with chronic diseases [73]. Increasing the heterogeneity of these results, 3 of the 5 studies found that being female is associated with an increased usage behavior, whereas 2 studies revealed that males showed a higher use of eHealth services.

These heterogeneous findings are of central importance, as they are a valid reminder of the limitations of research on eHealth acceptance and eHealth use and the variety of (unknown) underlying factors. In our understanding, the following factors may influence the acceptance and use of eHealth and should be regarded in terms of interpreting research results: measurement method (eg, UTAUT or not), recruitment method (web-based or not), sociodemographic characteristics (gender, age, education, income, and living conditions), duration of illness, user type (inpatient, outpatient, staff, and public), technical type of delivery (app, mobile, tablet, and laptop), guidance (unguided vs guided), target population (healthy, type of illness, and chronic disease), type of eHealth service (intervention program, education, communication, and technical devices), and the specificity of the eHealth service (general health, general mental health, and specific for current disease).

Limitations

The following limitations should be considered while interpreting the results. First, because our study was a web-based survey, patients were required to have internet access. As the probability of internet access declines with age [76], we received a younger diabetes sample than that present in the general population. Consequently, we had more patients with type 1 diabetes (174/258, 67.4%) than patients with type 2 diabetes (74/258, 28.7%), because type 2 is an acquired form of diabetes in older age. Therefore, our sample does not reflect the typical distribution of 90% of patients with type 2 diabetes [77]. The composition of the investigated sample was mostly female (approximately 192/258, 75%). Owing to this selection bias, the generalizability of our results may be reduced.

Second, these compositional specifications may not only limit generalizability, but also bias acceptance ratings, because participants recruited via the internet may be more open to and interested in e-mental health interventions. In addition, female patients had significantly higher acceptance ratings than male patients. Furthermore, in a descriptive view, younger patients had higher acceptance ratings than older patients. In addition, acceptance may be overestimated, because patients with type 1 diabetes showed a higher acceptance than patients with type 2 diabetes, but only in a descriptive view based on our adapted level of significance of 0.007 (see Statistical Analyses).

Third, all data were self-reported. This method is prone to the common method bias because of the shared method variance [78]. Counteracting this limitation, the instruments used had a sufficient internal reliability, the survey had a short length, and the patients were well-educated because these points are known to mitigate the common method bias.

Fourth, we measured acceptance as the behavioral intention, which corresponds to previous studies [28,48,49,51,54,79-81]. However, direct conclusions from the intention to use an e-mental health intervention to its actual usage cannot be drawn because of the intention-behavior gap [82]. Thus, acceptance can be assessed as a predictive function of behavioral intention, and previous studies have proven its validity [48,50,51,54].

Fifth, our study design was based on assessing mental health only through symptom-based measures, which were oriented on diagnostic criteria. Although we used established and validated measures, which is one strength of our study (PHQ-2, DT, and GAD-7), it could also be beneficial to include the mental health–related quality of life measures.

Sixth, the cross-sectional study design is not suited to identify and account for factors and predictors of acceptance and use of eHealth interventions that may interact or change over time and depend on technological progress. In addition, because of the cross-sectional design, no statements can be made regarding causality.

To overcome these limitations, future research should add the uptake rate as an outcome measure and focus on assessing acceptance and its barriers and resources in a longitudinal design with different target groups and a balanced composition of gender and age. Furthermore, future research should add health-related quality of life measures to investigate how predictive these measures can be regarding e-mental health acceptance and if those might be even more predictive than symptom-based validated measures of mental health. Moreover, qualitative or mixed methods research could help identify the unknown predictors of e-mental health acceptance and therefore add richness to the understanding of underlying barriers and resources of e-mental health acceptance in general, particularly for e-mental health interventions in patients with diabetes.

Conclusions

This study supports the viability of the UTAUT model and its predictors in assessing the acceptance of e-mental health interventions in patients with diabetes. The UTAUT model, comprising the predictors of PE, EE, and SI, reached a notable amount of explained variance in the acceptance of 75%. This UTAUT model was compared with a full model including 13 predictors including sociodemographic, medical, and mental health variables and explained a similar variance in acceptance.

To conclude, the UTAUT model (here, 9 items) turned out to be a very useful and efficient method for measuring the e-mental health acceptance of patients with diabetes. Due to the close link between acceptance and use, AFIs should be fostered to bring forward the establishment of effective e-mental health interventions in psychodiabetology. These AFIs should focus on PE, EE, and SI to increase the acceptance of easily accessible and location-flexible e-mental health interventions, which are even more vitally needed these days given the ongoing pandemic and in light of the high (psychological) vulnerability of patients with diabetes.

However, future research should also include the actual use behavior as an outcome measure to test the (prospective) validity of acceptance predictions for the actual use of e-mental health interventions.

Authors' Contributions

AB initiated and conceptualized the study. MD, JB, and JS performed the statistical analyses, interpreted the data, and wrote the manuscript. Data acquisition and statistical analyses were performed by AS, KS, JB, and JS. AS, KS, HD, and VM actively participated in the interpretation of the data and edited the manuscript. AB, MT, and EMS made major contributions to the study’s conception and design, actively participated in the interpretation of data, and revised the manuscript critically for important subject-specific content. All authors contributed to the study and approved the final version of the manuscript.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Statistical data tables of differences in acceptance and prevalence of anxiety, depressive symptoms, and distress.

DOC File , 184 KB

  1. Cho N, Shaw J, Karuranga S, Huang Y, da Rocha Fernandes J, Ohlrogge A, et al. IDF Diabetes Atlas: global estimates of diabetes prevalence for 2017 and projections for 2045. Diabetes Res Clin Pract 2018 Apr;138:271-281. [CrossRef] [Medline]
  2. Cox DJ, Gonder-Frederick L. Major developments in behavioral diabetes research. J Consult Clin Psychol 1992;60(4):628-638. [CrossRef]
  3. Snoek FJ, Skinner TC. Psychological counselling in problematic diabetes: does it help? Diabet Med 2002 Apr;19(4):265-273. [CrossRef] [Medline]
  4. Ivbijaro GO. Mental health and chronic physical illnesses: the need for continued and integrated care - World Mental Health Day 2010. Ment Health Fam Med 2010 Sep;7(3):127 [FREE Full text] [Medline]
  5. Rubin RR, Peyrot M. Psychological issues and treatments for people with diabetes. J Clin Psychol 2001 Apr;57(4):457-478. [CrossRef] [Medline]
  6. Tan K, Chan G, Eric H, Maria A, Norliza M, Oun B, et al. Depression, anxiety and stress among patients with diabetes in primary care: a cross-sectional study. Malays Fam Physician 2015;10(2):9-21 [FREE Full text] [Medline]
  7. Kruse J, Schmitz N, Thefeld W, German National Health Interview and Examination Survey. On the association between diabetes and mental disorders in a community sample: results from the German National Health Interview and Examination Survey. Diabetes Care 2003 Jun;26(6):1841-1846. [CrossRef] [Medline]
  8. Goldney RD, Phillips PJ, Fisher LJ, Wilson DH. Diabetes, depression, and quality of life: a population study. Diabetes Care 2004 May;27(5):1066-1070. [CrossRef] [Medline]
  9. Semenkovich K, Brown ME, Svrakic DM, Lustman PJ. Depression in type 2 diabetes mellitus: prevalence, impact, and treatment. Drugs 2015 Apr;75(6):577-587. [CrossRef] [Medline]
  10. van Steenbergen-Weijenburg KM, de Vroege L, Ploeger RR, Brals JW, Vloedbeld MG, Veneman TF, et al. Validation of the PHQ-9 as a screening instrument for depression in diabetes patients in specialized outpatient clinics. BMC Health Serv Res 2010 Aug 12;10:235 [FREE Full text] [CrossRef] [Medline]
  11. Reddy P, Philpot B, Ford D, Dunbar JA. Identification of depression in diabetes: the efficacy of PHQ-9 and HADS-D. Br J Gen Pract 2010 Jun;60(575):e239-e245 [FREE Full text] [CrossRef] [Medline]
  12. Holt RI, de Groot M, Golden SH. Diabetes and depression. Curr Diab Rep 2014 Jun;14(6):491 [FREE Full text] [CrossRef] [Medline]
  13. Ali S, Stone MA, Peters JL, Davies MJ, Khunti K. The prevalence of co-morbid depression in adults with type 2 diabetes: a systematic review and meta-analysis. Diabet Med 2006 Nov;23(11):1165-1173. [CrossRef] [Medline]
  14. Grigsby AB, Anderson RJ, Freedland KE, Clouse RE, Lustman PJ. Prevalence of anxiety in adults with diabetes. J Psychosom Res 2002 Dec;53(6):1053-1060. [CrossRef]
  15. Nouwen A, Winkley K, Twisk J, Lloyd CE, Peyrot M, Ismail K, European Depression in Diabetes (EDID) Research Consortium. Type 2 diabetes mellitus as a risk factor for the onset of depression: a systematic review and meta-analysis. Diabetologia 2010 Dec;53(12):2480-2486 [FREE Full text] [CrossRef] [Medline]
  16. Smith KJ, Deschênes SS, Schmitz N. Investigating the longitudinal association between diabetes and anxiety: a systematic review and meta-analysis. Diabet Med 2018 Jun;35(6):677-693 [FREE Full text] [CrossRef] [Medline]
  17. Debono M, Cachia E. The impact of diabetes on psychological well being and quality of life. The role of patient education. Psychol Health Med 2007 Oct;12(5):545-555. [CrossRef] [Medline]
  18. Poduval S, Marston L, Hamilton F, Stevenson F, Murray E. Feasibility, acceptability, and impact of a web-based structured education program for type 2 diabetes: real-world study. JMIR Diabetes 2020 Jan 6;5(1):e15744 [FREE Full text] [CrossRef] [Medline]
  19. Murray E, Sweeting M, Dack C, Pal K, Modrow K, Hudda M, et al. Web-based self-management support for people with type 2 diabetes (HeLP-Diabetes): randomised controlled trial in English primary care. BMJ Open 2017 Sep 27;7(9):e016009 [FREE Full text] [CrossRef] [Medline]
  20. Li J, Parrott S, Sweeting M, Farmer A, Ross J, Dack C, et al. Presence-teleop virtcost-effectiveness of facilitated access to a self-management website, compared to usual care, for patients with type 2 diabetes (help-diabetes): randomized controlled trial. J Med Internet Res 2018 Jun 8;20(6):e201 [FREE Full text] [CrossRef] [Medline]
  21. Zhou Y, Liao L, Sun M, He G. Self-care practices of Chinese individuals with diabetes. Exp Ther Med 2013 Apr;5(4):1137-1142 [FREE Full text] [CrossRef] [Medline]
  22. Beck J, Greenwood DA, Blanton L, Bollinger ST, Butcher MK, Condon JE, 2017 Standards Revision Task Force. 2017 national standards for diabetes self-management education and support. Diabetes Educ 2018 Feb;44(1):35-50. [CrossRef] [Medline]
  23. Barak A, Hen L, Boniel-Nissim M, Shapira N. A comprehensive review and a meta-analysis of the effectiveness of internet-based psychotherapeutic interventions. J Technol Hum Serc 2008 Jul 3;26(2-4):109-160. [CrossRef]
  24. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010 Oct 13;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
  25. Andersson G. Internet-delivered psychological treatments. Annu Rev Clin Psychol 2016;12:157-179. [CrossRef] [Medline]
  26. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry 2014 Oct;13(3):288-295 [FREE Full text] [CrossRef] [Medline]
  27. Hedman E, Andersson E, Ljótsson B, Andersson G, Rück C, Lindefors N. Cost-effectiveness of Internet-based cognitive behavior therapy vs cognitive behavioral group therapy for social anxiety disorder: results from a randomized controlled trial. Behav Res Ther 2011 Nov;49(11):729-736. [CrossRef] [Medline]
  28. Hennemann S, Beutel ME, Zwerenz R. Drivers and barriers to acceptance of web-based aftercare of patients in inpatient routine care: a cross-sectional survey. J Med Internet Res 2016 Dec 23;18(12):e337 [FREE Full text] [CrossRef] [Medline]
  29. Eichenberg C, Ott R. Klinisch-psychologische Intervention im internet. Psychotherapeut 2011 Jun 10;57(1):58-69. [CrossRef]
  30. Pal K, Eastwood SV, Michie S, Farmer AJ, Barnard ML, Peacock R, et al. Computer-based diabetes self-management interventions for adults with type 2 diabetes mellitus. Cochrane Database Syst Rev 2013 Mar 28(3):CD008776 [FREE Full text] [CrossRef] [Medline]
  31. Tang PC, Overhage JM, Chan AS, Brown NL, Aghighi B, Entwistle MP, et al. Online disease management of diabetes: engaging and motivating patients online with enhanced resources-diabetes (EMPOWER-D), a randomized controlled trial. J Am Med Inform Assoc 2013 May 1;20(3):526-534 [FREE Full text] [CrossRef] [Medline]
  32. Maisto M, Diana B, Di Tella S, Matamala-Gomez M, Montana JI, Rossetto F, et al. Digital interventions for psychological comorbidities in chronic diseases-a systematic review. J Pers Med 2021 Jan 6;11(1):- [FREE Full text] [CrossRef] [Medline]
  33. Schlicker S, Weisel KK, Buntrock C, Berking M, Nobis S, Lehr D, et al. Do nonsuicidal severely depressed individuals with diabetes profit from internet-based guided self-help? Secondary analyses of a pragmatic randomized trial. J Diabetes Res 2019;2019:2634094 [FREE Full text] [CrossRef] [Medline]
  34. Ebert DD, Nobis S, Lehr D, Baumeister H, Riper H, Auerbach RP, et al. The 6-month effectiveness of Internet-based guided self-help for depression in adults with Type 1 and 2 diabetes mellitus. Diabet Med 2017 Jan;34(1):99-107. [CrossRef] [Medline]
  35. Wayne N, Perez DF, Kaplan DM, Ritvo P. Health coaching reduces hba1c in type 2 diabetic patients from a lower-socioeconomic status community: a randomized controlled trial. J Med Internet Res 2015 Oct 5;17(10):e224 [FREE Full text] [CrossRef] [Medline]
  36. Naik AD, Hundt NE, Vaughan EM, Petersen NJ, Zeno D, Kunik ME, et al. Effect of telephone-delivered collaborative goal setting and behavioral activation vs enhanced usual care for depression among adults with uncontrolled diabetes: a randomized clinical trial. JAMA Netw Open 2019 Aug 2;2(8):e198634 [FREE Full text] [CrossRef] [Medline]
  37. Clarke J, Sanatkar S, Baldwin PA, Fletcher S, Gunn J, Wilhelm K, et al. A web-based cognitive behavior therapy intervention to improve social and occupational functioning in adults with type 2 diabetes (the springboard trial): randomized controlled trial. J Med Internet Res 2019 May 21;21(5):e12246 [FREE Full text] [CrossRef] [Medline]
  38. van Bastelaar KM, Pouwer F, Cuijpers P, Riper H, Snoek FJ. Web-based depression treatment for type 1 and type 2 diabetic patients: a randomized, controlled trial. Diabetes Care 2011 Feb;34(2):320-325 [FREE Full text] [CrossRef] [Medline]
  39. Bond GE, Burr RL, Wolf FM, Feldt K. The effects of a web-based intervention on psychosocial well-being among adults aged 60 and older with diabetes: a randomized trial. Diabetes Educ 2010;36(3):446-456. [CrossRef] [Medline]
  40. Bäuerle A, Teufel M, Musche V, Weismüller B, Kohler H, Hetkamp M, et al. Increased generalized anxiety, depression and distress during the COVID-19 pandemic: a cross-sectional study in Germany. J Public Health (Oxf) 2020 Nov 23;42(4):672-678 [FREE Full text] [CrossRef] [Medline]
  41. Forte G, Favieri F, Tambelli R, Casagrande M. The enemy which sealed the world: effects of covid-19 diffusion on the psychological state of the Italian population. J Clin Med 2020 Jun 10;9(6):- [FREE Full text] [CrossRef] [Medline]
  42. Wang C, Pan R, Wan X, Tan Y, Xu L, Ho CS, et al. Immediate psychological responses and associated factors during the initial stage of the 2019 coronavirus disease (covid-19) epidemic among the general population in China. Int J Environ Res Public Health 2020 Mar 6;17(5):- [FREE Full text] [CrossRef] [Medline]
  43. Huang Y, Zhao N. Generalized anxiety disorder, depressive symptoms and sleep quality during COVID-19 outbreak in China: a web-based cross-sectional survey. Psychiatry Res 2020 Jun;288:112954 [FREE Full text] [CrossRef] [Medline]
  44. Rajkumar RP. COVID-19 and mental health: a review of the existing literature. Asian J Psychiatr 2020 Aug;52:102066 [FREE Full text] [CrossRef] [Medline]
  45. Teufel M, Schweda A, Dörrie N, Musche V, Hetkamp M, Weismüller B, et al. Not all world leaders use Twitter in response to the COVID-19 pandemic: impact of the way of Angela Merkel on psychological distress, behaviour and risk perception. J Public Health (Oxf) 2020 Aug 18;42(3):644-646 [FREE Full text] [CrossRef] [Medline]
  46. Fleer J, Tovote KA, Keers JC, Links TP, Sanderman R, Coyne JC, et al. Screening for depression and diabetes-related distress in a diabetes outpatient clinic. Diabet Med 2013 Jan;30(1):88-94. [CrossRef] [Medline]
  47. IJzerman RV, van der Vaart R, Evers AW. Internet-based cognitive behavioral therapy among psychologists in a medical setting: a survey on implementation. J Med Internet Res 2019 Aug 9;21(8):e13432 [FREE Full text] [CrossRef] [Medline]
  48. Lin J, Faust B, Ebert DD, Krämer L, Baumeister H. A web-based acceptance-facilitating intervention for identifying patients' acceptance, uptake, and adherence of internet- and mobile-based pain interventions: randomized controlled trial. J Med Internet Res 2018 Aug 21;20(8):e244 [FREE Full text] [CrossRef] [Medline]
  49. Liu L, Miguel Cruz A, Rios Rincon A, Buttar V, Ranson Q, Goertzen D. What factors determine therapists' acceptance of new technologies for rehabilitation – a study using the Unified Theory of Acceptance and Use of Technology (UTAUT). Disabil Rehabil 2015;37(5):447-455. [CrossRef] [Medline]
  50. Hoque R, Sorwar G. Understanding factors influencing the adoption of mHealth by the elderly: an extension of the UTAUT model. Int J Med Inform 2017 May;101:75-84. [CrossRef] [Medline]
  51. Alam M. Using the utaut model to determine factors affecting acceptance and use of mobile health (mhealth) services in bangladesh. Journal of studies in social sciences. Journal of Stud Soc Sci 2018;17(2):137-172.
  52. Baumeister H, Nowoczin L, Lin J, Seifferth H, Seufert J, Laubner K, et al. Impact of an acceptance facilitating intervention on diabetes patients' acceptance of Internet-based interventions for depression: a randomized controlled trial. Diabetes Res Clin Pract 2014 Jul;105(1):30-39. [CrossRef] [Medline]
  53. Rho MJ, Kim HS, Chung K, Choi IY. Factors influencing the acceptance of telemedicine for diabetes management. Cluster Comput 2014 Mar 12;18(1):321-331. [CrossRef]
  54. Venkatesh, Morris, Davis, Davis. User acceptance of information technology: toward a unified view. MIS Q 2003;27(3):425. [CrossRef]
  55. Crisp DA, Griffiths KM. Participating in online mental health interventions: who is most likely to sign up and why? Depress Res Treat 2014;2014:790457 [FREE Full text] [CrossRef] [Medline]
  56. Eysenbach G. Improving the quality of web surveys: the checklist for reporting results of internet e-surveys (cherries). J Med Internet Res 2004 Sep 29;6(3):e34 [FREE Full text] [CrossRef] [Medline]
  57. Löwe B, Kroenke K, Gräfe K. Detecting and monitoring depression with a two-item questionnaire (PHQ-2). J Psychosom Res 2005 Feb;58(2):163-171. [CrossRef] [Medline]
  58. Löwe B, Decker O, Müller S, Brähler E, Schellberg D, Herzog W, et al. Validation and standardization of the Generalized Anxiety Disorder Screener (GAD-7) in the general population. Med Care 2008 Mar;46(3):266-274. [CrossRef] [Medline]
  59. Mehnert A, Müller D, Lehmann C, Koch U. Die deutsche Version des NCCN Distress-Thermometers. Zeitschrift für Psychiatrie, Psychologie und Psychotherapie 2006 Jan;54(3):213-223. [CrossRef]
  60. Ebert DD, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internet-based mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord 2015 May 1;176:9-17. [CrossRef] [Medline]
  61. Baumeister H, Seifferth H, Lin J, Nowoczin L, Lüking M, Ebert D. Impact of an acceptance facilitating intervention on patients' acceptance of internet-based pain interventions: a randomized controlled trial. Clin J Pain 2015 Jun;31(6):528-535. [CrossRef] [Medline]
  62. Hinz A, Mitchell AJ, Dégi CL, Mehnert-Theuerkauf A. Normative values for the distress thermometer (DT) and the emotion thermometers (ET), derived from a German general population sample. Qual Life Res 2019 Jan;28(1):277-282. [CrossRef] [Medline]
  63. Hayes A. Introduction to Mediation, Moderation, and Conditional Process Analysis: a Regression-based Approach. Second Edition. New York, London: The Guilford Press; 2018.
  64. R: a Language and Environment for Statistical Computing. R Foundation for Statistical Computing. 2018.   URL: https://www.r-project.org/ [accessed 2021-01-02]
  65. The Assumption(s) of Normality.   URL: http://www2.psychology.uiowa.edu/faculty/mordkoff/GradStats/part%201/I.07%20normal.pdf [accessed 2021-01-02]
  66. Wilcox R. Introduction to Robust Estimation and Hypothesis Testing. Amsterdam: Elsevier; 2012.
  67. Fisher L, Skaff MM, Mullan JT, Arean P, Glasgow R, Masharani U. A longitudinal study of affective and anxiety disorders, depressive affect and diabetes distress in adults with Type 2 diabetes. Diabet Med 2008 Sep;25(9):1096-1101 [FREE Full text] [CrossRef] [Medline]
  68. Golden SH, Lazo M, Carnethon M, Bertoni AG, Schreiner PJ, Diez Roux AV, et al. Examining a bidirectional association between depressive symptoms and diabetes. J Am Med Assoc 2008 Jun 18;299(23):2751-2759 [FREE Full text] [CrossRef] [Medline]
  69. Gun SY, Titov N, Andrews G. Acceptability of Internet treatment of anxiety and depression. Australas Psychiatry 2011 Jun;19(3):259-264. [CrossRef] [Medline]
  70. Roelofsen Y, Hendriks SH, Sieverink F, Landman GW, Groenier KH, Bilo HJ, et al. Differences between patients with type 2 diabetes mellitus interested and uninterested in the use of a patient platform (e-vitadm-2/zodiac-41). J Diabetes Sci Technol 2014 Mar;8(2):230-237 [FREE Full text] [CrossRef] [Medline]
  71. Cimperman M, Makovec Brenčič M, Trkman P. Analyzing older users' home telehealth services acceptance behavior-applying an Extended UTAUT model. Int J Med Inform 2016 Jun;90:22-31. [CrossRef] [Medline]
  72. Taiwo A, Downe A. The theory of user acceptance and use of technology (UTAUT): A meta-analytic review of empirical findings. J Theor Appl Inf Technol 2013;49(1):- [FREE Full text]
  73. Reiners F, Sturm J, Bouw LJ, Wouters EJ. Sociodemographic factors influencing the use of ehealth in people with chronic diseases. Int J Environ Res Public Health 2019 Feb 21;16(4):- [FREE Full text] [CrossRef] [Medline]
  74. Drewes C, Kirkovits T, Schiltz D, Schinkoethe T, Haidinger R, Goldmann-Posch U, et al. Ehealth acceptance and new media preferences for therapy assistance among breast cancer patients. JMIR Cancer 2016 Sep 14;2(2):e13 [FREE Full text] [CrossRef] [Medline]
  75. Duplaga M. The acceptance of e-health solutions among patients with chronic respiratory conditions. Telemed J E Health 2013 Sep;19(9):683-691 [FREE Full text] [CrossRef] [Medline]
  76. Morris A, Goodman J, Brading H. Internet use and non-use: views of older users. Univ Access Inf Soc 2006 Nov 18;6(1):43-57. [CrossRef]
  77. Deutscher Gesundheitsbericht Diabetes 2020: Die Bestandsaufnahme 2019. Deutsche Diabetes Gesellschaft (DGD).   URL: https:/​/www.​deutsche-diabetesgesellschaft.de/​fileadmin/​user_upload/​06_Gesundheitspolitik/​03_Veroeffentlichungen/​05_Gesundheitsbericht/​2020_Gesundheitsbericht_2020.​pdf [accessed 2021-02-01]
  78. Conway JM, Lance CE. What reviewers should expect from authors regarding common method bias in organizational research. J Bus Psychol 2010 May 22;25(3):325-334. [CrossRef]
  79. Hoogenbosch B, Postma J, de Man-van Ginkel JM, Tiemessen NA, van Delden JJ, van Os-Medendorp H. Use and the Users of a Patient Portal: Cross-Sectional Study. J Med Internet Res 2018 Sep 17;20(9):e262 [FREE Full text] [CrossRef] [Medline]
  80. Senft N, Abrams J, Katz A, Barnes C, Charbonneau DH, Beebe-Dimmer JL, et al. Ehealth activity among african american and white cancer survivors: a new application of theory. Health Commun 2020 Mar;35(3):350-355 [FREE Full text] [CrossRef] [Medline]
  81. Apolinário-Hagen J, Menzel M, Hennemann S, Salewski C. Acceptance of mobile health apps for disease management among people with multiple sclerosis: web-based survey study. JMIR Form Res 2018 Dec 12;2(2):e11977 [FREE Full text] [CrossRef] [Medline]
  82. Bhattacherjee A, Sanford C. The intention–behaviour gap in technology usage: the moderating role of attitude strength. Behav Info Technol 2009 Jul;28(4):389-401. [CrossRef]


AFI: acceptance-facilitating intervention
ANOVA: analysis of variance
DT: Distress Thermometer
EE: effort expectancy
FC: facilitating conditions
GAD-7: Generalized Anxiety Disorder Scale-7
PE: performance expectancy
PHQ-2: Patient Health Questionnaire-2
SI: social influence
UTAUT: Unified Theory of Acceptance and Use of Technology


Edited by G Eysenbach; submitted 25.01.21; peer-reviewed by S Liu, N Subedi, S Skovlund; comments to author 30.03.21; revised version received 21.05.21; accepted 31.05.21; published 30.07.21

Copyright

©Mirjam Damerau, Martin Teufel, Venja Musche, Hannah Dinse, Adam Schweda, Jil Beckord, Jasmin Steinbach, Kira Schmidt, Eva-Maria Skoda, Alexander Bäuerle. Originally published in JMIR Formative Research (https://formative.jmir.org), 30.07.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.