Published on in Vol 6, No 11 (2022): November

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/30285, first published .
Identifying Personality Characteristics and Indicators of Psychological Well-Being Associated With Attrition in the Motivation Makes the Move! Physical Activity Intervention: Randomized Technology-Supported Trial

Identifying Personality Characteristics and Indicators of Psychological Well-Being Associated With Attrition in the Motivation Makes the Move! Physical Activity Intervention: Randomized Technology-Supported Trial

Identifying Personality Characteristics and Indicators of Psychological Well-Being Associated With Attrition in the Motivation Makes the Move! Physical Activity Intervention: Randomized Technology-Supported Trial

Original Paper

1Department of Sport and Exercise Medicine, Clinicum, Faculty of Medicine, University of Helsinki, Helsinki, Finland

2Cicero Learning, Faculty of Educational Sciences, University of Helsinki, Helsinki, Finland

3Cognitive Brain Research Unit, Department of Psychology and Logopedics, University of Helsinki, Helsinki, Finland

4Obstetrics and Gynecology, University of Helsinki and Helsinki University Hospital, Helsinki, Finland

5Neurovascular Research Laboratory, School of Kinesiology, Western University, London, ON, Canada

6Division of Sport and Exercise Medicine, Department of Family Practice, University of British Columbia, Vancouver, BC, Canada

7Center for Studies in Family Medicine, Schulich School of Medicine and Dentistry, Western University, London, ON, Canada

8Clinic for Sports and Exercise Medicine, Foundation for Sports and Exercise Medicine, Helsinki, Finland

Corresponding Author:

Kaisa Kaseva, PhD

Department of Sport and Exercise Medicine, Clinicum

Faculty of Medicine

University of Helsinki

Alppikatu 2

Helsinki, 00530

Finland

Phone: 358 443077737

Email: kaisa.kaseva@helsinki.fi


Background: Data attrition has been a common problem in longitudinal lifestyle interventions. The contributors to attrition in technology-supported physical activity interventions have not been thoroughly studied.

Objective: The present study examined the roles of personality characteristics and indicators of psychological well-being in data attrition within a technology-supported, longitudinal intervention study with overweight adults.

Methods: Participants (N=89) were adults from the Motivation Makes the Move! intervention study. Data attrition was studied after a 3-month follow-up. Participants’ personality characteristics were studied using the Short Five self-report questionnaire. Psychological well-being indicators were assessed with the RAND 36-item health survey, Positive and Negative Affect Schedule, and Beck Depression Inventory. Logistic regression analyses were conducted to assess the risk of discontinuing the study. The analyses were adjusted for sex, age, study group, and educational status.

Results: At the 3-month follow-up, 65 of 89 participants (73% of the initial sample) had continued in the study. Participants’ personality characteristics and indicators of psychological well-being were not associated with the risk of dropping out of the study (all P values >.05). The results remained the same after covariate controls.

Conclusions: Participant attrition was not attributable to personality characteristics or psychological well-being in the Motivation Makes the Move! study conducted with overweight adults. As attrition remains a challenge within longitudinal, technology-supported lifestyle interventions, attention should be paid to the potentially dynamic natures of personality and psychological well-being, as well as other elements beyond these.

Trial Registration: ClinicalTrials.gov NCT02686502; https://clinicaltrials.gov/ct2/show/NCT02686502

JMIR Form Res 2022;6(11):e30285

doi:10.2196/30285

Keywords



Cardiovascular diseases are the leading cause of premature death worldwide. Overweight and obesity have been recognized as among the most severe risk factors for these diseases. According to the World Health Organization, more than 1 billion people worldwide are overweight (BMI ≥ 25), and more than 300 million are obese (BMI ≥ 30) [1]. Overweight and obesity may also be associated with comorbidities, referring to a person’s vulnerability to other illnesses and diseases. Comorbidity may also refer to interactions between illnesses that can worsen the course of both. For instance, due to the possibility of unprecedented outbreaks of infectious diseases (eg, COVID-19), it is of utmost importance to pay attention to the prevention of risk factors, such as obesity, that are likely to contribute to the development of comorbidities.

Along with genes, unhealthy lifestyles are among the most prominent contributors to overweight and subsequent negative health outcomes. Physical inactivity has been recognized as one of the primary contributors to overweight and obesity [2,3]. Recently, it has been suggested that even small improvements in physical fitness reduce the risk of coronary heart disease and that any amount of physical activity is beneficial for overall health [4]. Despite this knowledge, the prevalence of obesity has increased during the last 3 decades, and therefore, there is a need to pay attention to, as well as target research resources toward, physical activity in preventing and hindering the epidemic of obesity [5].

Recently, many physical activity and exercise promotion actions and interventions have been designed to prevent the development of obesity and other health risk factors. Some physical activity interventions aiming to increase healthy physical activity habits among overweight people have demonstrated favorable results, but equivocal results regarding expected outcomes also exist [6]. Recently, technological innovations have been regarded as promising tools to optimize the effectiveness of interventions by improving intervention delivery and adherence to participation [7,8]. In addition, eHealth and mobile health (mHealth) technologies allow collection of reliable, comprehensive, and diverse information about the users’ physical activity and can reach large populations quickly [9-11]. Many technology-based health interventions have proved to be efficient in increasing physical activity, contributing to weight loss, and improving overall health [12,13].

Along with the creation of valid study designs, the effectiveness of research is related to participants’ commitment to the completion of studies. Attrition in longitudinal studies and interventions refers to participants dropping out of the study before its completion or stopping use of the program or application during participation [14]. High attrition is a common issue in longitudinal physical activity interventions and a major challenge to the validity of the research [15,16]. In addition to a variety of individual factors, psychological qualities have been suggested to be important contributors to health behaviors, as well as to participation in and commitment to interventions [17,18]. Further assessment of these factors could improve the effectiveness of interventions [17].

Personality characteristics have been regarded as among the most essential contributors to behavioral choices [19]. Personality reflects individual differences in thinking, feeling, and behaving, and it matures through age. In the widely acknowledged 5-factor model of personality (ie, the “Big Five” model), personality characteristics are categorized into 5 broader continuums [20,21]. Individuals scoring high in neuroticism tend to experience negative emotions, such as anger, fear, and stress. In contrast, individuals high in extraversion tend to exhibit positive emotions, including cheerfulness and enthusiasm. Conscientious individuals have been characterized as diligent, organized, and disciplined, and display planned, rather than spontaneous, behaviors. Individuals high in openness to experience are open-minded and creative, whereas those high in agreeableness tend to exhibit kindness, cooperativeness, and positivity in interpersonal relations [20]. The psychobiological theory of personality has introduced a 7-factor model, including 4 dimensions of temperament (novelty seeking, harm avoidance, reward dependence, and persistence) that are regarded as individuals’ inherited, reactive tendencies, and 3 dimensions of character (self-directedness, cooperativeness, and self-transcendence) that mature through age [22,23]. Both the 5- and 7-factor paradigms of personality have also been applied within recent physical activity interventions.

High levels of openness to experience, as well as hedonistic orientation, have been shown to relate favorably to attitudes toward health behavior interventions [24,25]. Reward dependence, which correlates highly with extraversion and agreeableness [26], has been shown to play a role in determining high success rates in therapy-induced weight management [27]. Persons who were successful at achieving weight loss in a weight-loss program had a lower novelty-seeking trait, which correlates positively with conscientiousness [23], than those who did not reach their goals [28]. Personality seems to also play a role in becoming interested in participating in technology-based interventions [29], but more evidence on personality’s role in the commitment to such interventions is needed.

Along with personality, the level of psychological well-being, referring to a person’s experience of their own well-being, is associated with the commitment to a healthy lifestyle, as well as the commitment to lifestyle interventions [18,30]. The concept of health-related quality of life refers to a person's evaluation of their physical and mental health over time [31], and it can be regarded as one of the most essential contributors to psychological well-being. Past research has demonstrated that higher levels of health-related quality of life also contribute to increased physical activity [32]. Comparably, studies have indicated that experiencing limitations related to physical and psychological functionality, negative thinking, and moods can become barriers to completing lifestyle interventions and managing obesity [30]. Furthermore, research has shown that experiencing depressive symptoms, which may result from prolonged focus on negative thinking and feelings, can contribute to dropout in weight-loss trials [33].

Along with the aforementioned psychological attributes, some studies have found that males seem to discontinue studies more often than females [30,34,35], and that older people tend to drop out of studies earlier than younger people [30]. Lower educational background has also been shown to contribute to dropout from obesity management studies, although there are also results that conflict with this [30]. The above-mentioned demographic factors, as well as personality and well-being related factors, have been addressed in examinations of attrition in previous longitudinal lifestyle interventions [36]. Regarding technology-based interventions, more evidence concerning the role of individual factors in committing to interventions is needed [14]. This research should target subgroups, in particular those with a severe risk of disease, such as people with overweight and obesity [30].

The present study examined the potential contribution of personality characteristics and psychological well-being to attrition within the technology-supported lifestyle intervention Motivation Makes the Move! (MoMaMo!) that was designed to reduce overweight and obesity and subsequent negative health outcomes. Based on evidence derived from previous weight management interventions, we hypothesized that scoring high in agreeableness, extraversion, and conscientiousness would reduce the risk of attrition in this technology-supported intervention. Furthermore, we hypothesized that persons who have experienced challenges with their psychological well-being would have a higher risk of dropping out from the study. Along with examining these hypotheses, we also test whether the potential findings are robust after controlling for participants’ age, sex, study group (personalized intervention vs general guidelines), and educational status. Since we consider that program adherence (in contrast with attrition) is necessary to achieve successful outcomes in interventions, we consider this study as a highly important starting point for the MoMaMo! project. This study strives to provide evidence on whether personality characteristics and psychological well-being measured at baseline should be taken under consideration in future technology-assisted lifestyle interventions to support participants’ commitment to the completion of such interventions.


Design of the Study

MoMaMo! was a part of the Bits of Health program, supported by Business Finland, the national governmental agency to support technological development and innovation [37]. MoMaMo! was registered at ClinicalTrials.gov (protocol record TYH2016215, NCT02686502). Recruitment for the study started in April 2016 and the last follow-ups were performed in April 2020.

The overarching aim of the MoMaMo! study was to decrease and prevent sedentary lifestyles and obesity and subsequent health consequences among physically inactive and overweight or obese people. Furthermore, the study aimed to develop and validate lasting and individualized IT- and mHealth-assisted behavior change methodologies and practices for citizen engagement in health, well-being, and prevention of diseases. Specifically, the study aimed to quantify benefits and mechanisms of individualized exercise training in comparison with general guidelines. It also strived for identifying key elements to increase the adherence to and effectiveness of an individualized physical activity intervention and weight management program incorporating mHealth and other health technology.

The primary outcome measure in the MoMaMo! study was maximal oxygen uptake (VO2max). VO2max is a key parameter of cardiorespiratory fitness and an independent risk factor for several noncommunicable diseases and symptoms; it is associated with health-related quality of life [4]. VO2max was assessed during a step-incremental cycle ergometer test (until volitional fatigue) with breath-by-breath alveolar gas exchange and pulmonary ventilation measurements. The highest 30-second moving average was calculated to obtain VO2max.

Recruitment and Participants

Voluntary subjects were aged 18 to 40 years at entry, had BMI ≥ 27.5, had a referral from a physician for a consultation with a lifestyle clinic due to physical inactivity and overweight or obesity, and were deemed suitable for exercise testing and training. The subjects were recruited from different health care institutions in the Helsinki metropolitan area (Figure 1). In detail, participant recruitment was conducted by local public and private occupational health clinics by internet advertisement and recommendations by physicians. In addition, participants were recruited from the local University of Applied Sciences by internet advertisements. Exclusion criteria included the presence of a neurological or psychiatric disorder, use of medication influencing glucose homeostasis (except insulin) or autonomic nervous system function (eg, β-blockers or selective serotonin reuptake inhibitors), pregnancy, physical disability, substance abuse, significant co-operation difficulties, smoking, and severe anemia. The initial sample consisted of 89 subjects, of which 34 (38%) were men and 55 (62%) were women.

Figure 1. Flow diagram of the study (N=89).
View this figure

MoMaMo! Intervention

The participants (N=89) were randomized into 3 groups. The principal investigator of the study generated the random allocation sequence. Research nurses, who were in charge of scheduling laboratory visit times, randomly allocated the participants to groups after the participants agreed to voluntarily participate in the study. A blinded draw of a paper containing the numbers 1, 2a, or 2b was performed to randomly allocate participant to group 1 (the general guidelines group), 2a (the individualized intervention group), or 2b (the highly individualized intervention group).

Group 1 visited the laboratory 3 times. During the first visit, the participants’ height, weight, and body composition were assessed. The participants filled out self-report questionnaires on physical activity, psychology, and music use, as well as their work productivity and activity impairment. During the second visit, a physician examined each subject to ensure their suitability for exercise testing and training. Thereafter, each subject performed a step-incremental cardiopulmonary exercise test on a cycle ergometer (Monark Ergomedic 839 E, Monark Exercise AB) until voluntary fatigue. Data included recordings of pulmonary ventilation (Triple V, Jaeger Mijnhardt), alveolar gas exchange (Oxycon Pro), electrocardiography (ECG; PowerLab, AD Instruments) and the ratio of perceived exertion (RPE). On the third visit, blood tests were done, and the subjects received brief feedback on their results and measured health outcomes. Furthermore, group 1 subjects were provided general guidelines for a healthy diet and physical activity [38,39].

Groups 2a and 2b underwent the same measurements as group 1. Group 2a subjects also performed a submaximal step-incremental cycle ergometer test with ECG and RPE recordings during an additional visit. After completing all measurements, a personalized feedback meeting was organized for each subject in groups 2a and 2b. In this final meeting, each group 2a and group 2b subject received healthy lifestyle habit advice and an exercise prescription based on their results and their own preferences. For group 2a, a submaximal cycle ergometer test was used to personalize the exercise prescription. Thus, an estimate of maximal oxygen consumption (VO2max), work-rate specific heart rate, and RPE were used to personalize the volume and intensity of the exercise prescription. For group 2b, measured VO2max, determined ventilatory thresholds, heart rate response, and RPE during a maximal cycle ergometer test were used to provide a highly individualized exercise prescription. The purpose of using the simpler exercise test for the exercise prescriptions given to group 2a was to examine its usefulness in comparison with the more highly detailed cardiopulmonary exercise test given to group 2b.

To support the participants’ own planning and follow-up of their physical activity, exercise training, and other health behaviors, subjects in groups 2a and 2b were instructed to use smartphone apps. Sports Tracker (Amer Sports Digital Services Oy) with a heart rate belt (Suunto Oy) was used to guide and record exercise training, Argus (Azumio Inc) or its equivalent to count daily steps, Emotion Tracker (F8) to assess emotions, and Weight Diary (CurlyBrace Apps Ltd) or its equivalent to measure weight. The study web page provided further instructions and support for training. A 3-month Spotify gift card, along with example playlists, was provided to the subjects assigned to groups 2a and 2b to motivate their exercise training and support relaxation. The participants were instructed to fill out a web-based food diary (Nutri-Flow Oy) for ≥3 days at the beginning of intervention. The diary provided an analysis of nutritional habits, along with personalized feedback for suggested modifications. Subjects in groups 2a and 2b were also encouraged to report their training and weight loss on the study website (note the website was functional for the study duration and is presently not accessible) [40].

Sample size determination and power calculation (G*Power, Universität Kiel) were based on the expected increase in VO2max (the primary outcome measure in the MoMaMo! study) after a 3-month exercise intervention in groups 1, 2a, and 2b. Our a priori hypothesis was that both the individualized (group 2a) and highly individualized (group 2b) interventions would induce a similar increase in VO2max and be more beneficial than the intervention based on general guidelines (group 1). Therefore, groups 2a and 2b were considered as a single group (group 2) in comparisons with group 1. Based on the literature and our previous data, we assumed that there would be a similar initial VO2max value of 25 (SD 2.5) mL/kg/min (representing a poor or very poor classification) in all groups [41,42]. Our hypothesis was that VO2max would increase 15% in group 2 and 5% in group 1. To determine a priori differences between 2 independent means, a 2-tailed t test with α error probability = .05, power = 0.80, and effect size d=0.92, we needed 20 subjects in both groups. Due to an assumed attrition rate of 30% in the overweight or obese subjects and with a goal to also perform comparisons between groups 2a and 2b, we sought to recruit and randomize 33 subjects into each group, for a total of 99 subjects.

Final collected data came from 89 participants, including 22 (25%) participants in group 1, who received general guidelines on physical activity and nutrition, and 67 (75%) participants in group 2, who received combined individualized exercise and physical activity prescriptions, a food diary, and the health technology apps described above (Figure 1). The study procedure and its reporting followed the CONSORT (Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth) statement [43].

Psychological Questionnaires

Participants’ personality characteristics were assessed with the Short Five (S5) personality assessment [21]. This measure is designed to assess personality traits, including neuroticism, extraversion, openness to experience, agreeableness, and conscientiousness. Each dimension consists of 6 items, with higher scores reflecting higher levels of each trait. The scale ranges from –3 (the description is completely wrong/false) to 3 (the description is completely right or true). The sum scores of these 6 items were calculated. The reliability estimates (Cronbach α) were α=.84 for neuroticism, α=.75 for extraversion, α=.55 for openness to experience, α=.72 for agreeableness, and α=.65 for conscientiousness, indicating acceptable internal consistency for the items within each dimension. The major advantage of the S5 is that it allows for a detailed description of personality traits with a relatively small number of items compared to other instruments that assess the same components of personality [21]. This instrument has previously demonstrated good validity within general adult populations and correlates well with other measures of personality, including the NEO-Five-Factor Inventory [21].

Participants’ psychological well-being was studied with the RAND 36-item health survey, consisting of a set of quality-of-life measures. This measure is designed to capture the following health concepts: physical functioning, bodily pain, role limitations due to physical health challenges, role limitations due to emotional problems, emotional well-being, social functioning, vitality (energy and fatigue), and perceptions of general health [44]. Higher scores within the scale reflect a more favorable health state. In the present study, the reliability of the subscales ranged from good to excellent (physical functioning: α=.72; role limitations due to physical health challenges: α=.68; role limitations due to personal or emotion-related problems: α=.78; vitality: α=.78; emotional well-being: α=.79; social functioning: α=.91; bodily pain: α=.76; and general health perceptions: α=.73). In previous studies, this instrument has been demonstrated to be valid in general adult populations [31,44].

Participants’ mood was examined using the Positive and Negative Affect Schedule (PANAS). PANAS is a 20-item self-reported measure consisting of two 10-item scales, one for positive affect and one for negative affect. Participants were requested to rate single-word items describing positive or negative emotions. Higher scores reflected higher intensity of an emotion (1 indicated “not at all” and 5 indicated “extremely”). One missing value within each scale was allowed when calculating the scores. PANAS has been regarded as reliable and valid in previous studies [45]. Within the present study, Cronbach α for the scale assessing positive affectivity was α=.83, and the corresponding value for the scale for negative affectivity was α=.86.

Participants’ depressive symptoms were assessed using the Beck Depression Inventory II (BDI-II) [46]. The BDI-II assesses 21 symptoms with a severity range from 0 (no symptoms) to 3 (severe level of depressive symptoms). A sum score of all items was computed for each participant (Table 1 shows descriptive statistics); no missing items were allowed. The reliability estimate (Cronbach α) for the depressive symptom scores was α=.90. The BDI-II has been demonstrated to be a valid instrument [46-48] and is an acknowledged standard in the measurement of depressive mood [46-48]. This instrument has also been demonstrated to be a useful screening tool for future risk for depression [46,47]. Each study group completed the above-mentioned self-administered questionnaires.

Table 1. Frequencies, percentages, and attrition rates of study variables.
VariablesParticipants at month 0, nParticipants at month 3, n (%)Attrition rate, n (%)
Study group

Group 12215 (68)7 (32)

Group 26750 (75)17 (25)

Total8965 (73)24 (27)
Sex

Men3427 (79)7 (21)

Women5538 (69)17 (31)

Total8965 (73)24 (27)
Educational background

Vocational school2411 (46)13 (54)

Lower academic degree3529 (83)6 (17)

Academic degree2724 (89)3 (11)

Total8664 (74)22 (26)
Psychological measures

Personality8864 (73)24 (27)

RAND-368965 (73)24 (27)

Positive and Negative Affect Schedule8965 (73)24 (27)

Beck Depression Inventory II8361 (73)22 (27)

Statistical Analyses

Statistical analyses focused on assessing attrition with respect to the participants’ self-reported personality characteristics and psychological well-being at the 3-month follow-up. The analyses were conducted using SPSS versions 25 and 27 (IBM Corp). Descriptive statistics of the data are presented as frequencies, percentages, means, and standard deviations in Tables 1-4. The minimum and maximum values are also reported in Tables 2-4.

Table 2. Mean values of personality characteristics in continuing (n=64) and dropout (n=24) groups of participants at the 3-month follow-up.
VariablesContinuing group (n=64)Dropout group (n=24)

Minimum-maximumMean (SD)Minimum-maximumMean (SD)
Neuroticism–29.00 to 19.00–8.28 (12.65)–33.00 to 18.00–6.13 (14.39)
Extraversion19.00 to 30.007.31 (11.63)–14.00 to 26.008.75 (11.40)
Openness–2.00 to 35.0014.34 (8.42)–12.00 to 27.0011.04 (9.56)
Agreeableness–13.00 to 32.0016.13 (10.17)–7.00 to 32.0014.92 (8.94)
Conscientiousness–4.00 to 33.0015.98 (9.02)–8.00 to 33.0015.25 (10.17)
Table 3. Mean values of psychological well-being indicators in continuing (n=61-65) and dropout (n=22-24) groups at the 3-month follow-up.
VariablesContinuing group (n=61-65)Dropout group (n=22-24)

Minimum-maximumMean (SD)Minimum-maximumMean (SD)
Physical functioning50.00-100.0091.23 (8.66)60.00-100.0091.25 (11.06)
Role limitations (physical)0.00-100.0089.62 (22.49)50.00-100.0093.75 (15.20)
Role limitations (psychological)0.00-100.0082.05 (31.22)0.00-100.0075.00 (37.11)
Vitality (energy/fatigue)20.00-100.0059.38 (16.83)20.00-85.0056.88 (21.51)
Emotional well-being36.00-100.0075.22 (13.68)44.00-96.0073.33 (15.72)
Social functioning25.00-100.0086.15 (16.55)37.50-100.0084.90 (21.17)
Bodily pain22.50-100.0078.35 (19.32)32.50-100.0074.38 (17.39)
General health perceptions16.67-87.5055.26 (16.49)25.00-87.5059.72 (17.71)
Positive mood16.00-44.0030.46(6.01)21.00-40.0030.29 (5.47)
Negative mood10.00-30.0013.74 (4.47)10.00-26.0014.46 (4.97)
Symptoms of depression0.00-28.007.49 (6.37)0.00-29.007.55 (7.32)
Table 4. Mean values of psychological well-being indicators with square root transformations in continuing (n=61-65) and dropout (n=22-24) groups at the 3-month follow-up.
VariablesContinuing group (n=61-65)Dropout group (n=22-24)

Minimum-maximumMean (SD)Minimum-maximumMean (SD)
Physical functioning1.00-7.142.82 (1.37)1.00-6.402.66 (1.66)
Role limitations (physical)1.00-10.052.28 (2.50)1.00-7.141.85 (2.00)
Symptoms of depression0.00-5.292.47 (1.20)0.00-5.392.36 (1.44)

The attrition analyses were conducted using hierarchical logistic regressions. Traditional statistical analysis methods have been used in previous longitudinal lifestyle interventions when examining attrition-related questions [36]. In the present study, the associations between the main predictors and the outcome, in other words, whether personality characteristics and indicators of psychological well-being contributed to attrition at the 3-month follow-up, were studied first (Table 5). Furthermore, the analyses were adjusted for the participants’ sex, age, study group (group 1 vs group 2), and educational status (1 indicating vocational school or high school, 2 indicating a lower academic degree, and 3 indicating a higher academic degree) to test the robustness of the results (Table 6). The potential confounding factors were added to the models in the first step, and the main predictors in the second step (Table 6). The predictive power (Nagelkerke R2) of the models is reported in Tables 5 and 6. For detailed estimates regarding the confounding factors, see Multimedia Appendix 1 (Tables S1-S16).

Table 5. Personality characteristics and indicators of psychological well-being predicting attrition at the 3-month follow-up.
VariablesBSEP valueOR95% CINagelkerke R2
Personality characteristics

Neuroticism0.010.02.491.010.98-1.050.01

Extraversion0.010.02.601.010.97-1.050.01

Openness–0.040.03.120.960.91-1.010.04

Agreeableness–0.010.02.610.990.94-1.040.00

Conscientiousness–0.010.03.740.990.94-1.040.00
Indicators of psychological well-beinga

Physical functioning–0.070.17.670.930.67-1.290.00

Role limitations (physical)–0.090.11.450.920.74-1.150.01

Role limitations (psychological)–0.010.01.370.990.98-1.010.01

Vitality (energy/fatigue)–0.010.01.560.990.97-1.020.01

Emotional well-being–0.010.02.580.990.96-1.020.01

Social functioning–0.0040.01.771.000.97-1.020.00

Bodily pain–0.010.01.380.990.97-1.010.01

General health perceptions0.020.02.271.020.99-1.050.02

Positive mood–0.010.04.901.000.92-1.080.00

Negative mood0.030.05.511.030.94-1.140.01

Symptoms of depression–0.070.20.730.930.63-1.380.00

aSquare root transformations were applied to predictors of physical functioning, role limitations (physical), and symptoms of depression.

Table 6. Personality characteristics and psychological well-being predicting attrition at the 3-month follow-up after adjusting for covariates.
VariablesBSEP valueOR95% CINagelkerke R2
Personality characteristics

Neuroticism–0.030.03.260.970.92-1.020.27

Extraversion0.030.03.261.030.98-1.090.28

Openness0.020.03.460.980.92-1.040.27

Agreeableness–0.020.03.530.980.93-1.040.27

Conscientiousness0.020.03.501.020.96-1.090.27
Indicators of psychological healtha

Physical functioning–0.130.19.500.880.61-1.270.27

Role limitations (physical)–0.120.12.350.890.70-1.130.28

Role limitations (psychological)–0.0030.01.711.000.98-1.010.27

Vitality (energy/fatigue)0.000.02.951.000.97-1.030.27

Emotional well-being0.010.02.761.010.97-1.050.27

Social functioning0.000.02.931.000.97-1.040.27

Bodily pain–0.0010.01.971.000.97-1.030.27

General health perceptions0.030.02.081.031.00-1.070.31

Positive mood0.060.05.291.060.95-1.180.28

Negative mood0.010.06.991.000.88-1.130.27

Symptoms of depression–0.380.25.130.680.42-1.120.31

aSquare root transformations were applied to predictors of physical functioning, role limitations (physical), and symptoms of depression.

Ethics Approval

Subjects gave their written informed consent prior to participating in the study. The study conformed to the Declaration of Helsinki and was approved by the Ethics Committee (approval number 384/13/03/00/2015) of the Hospital District of Helsinki and Uusimaa, Helsinki, Finland.


Of the 89 participants who were allocated to the intervention group (groups 2a and 2b, together comprising group 2), 65 (73%) participated in the 3-month follow-up. Tables 1-4 show further information on attrition rates and study variables. When the distributions of the variables were viewed within the whole sample, the distributions of personality factors were approximately symmetric. Regarding the psychological well-being indicators, the variable reflecting physical functioning was negatively skewed (skewness –1.75, kurtosis 4.47), as was the variable reflecting role limitations due to physical health challenges (skewness –2.49, kurtosis 5.95). The variable reflecting depressive symptoms was positively skewed (skewness 1.41, kurtosis 2.04). Skewness and kurtosis values exceeding the absolute value of 2 were considered as indicating severe nonnormality, and square root transformations were performed for these variables (Table 4). Considering other variables in RAND-36 and PANAS, no severe skewness was detected. A total of 77 of the 83 participants (93%) experienced only a minimal or small number of depressive symptoms (original scores 0-18), while 6 (7%) of the 83 participants experienced a moderate number of depressive symptoms (original scores 19-29). No information on severe depressive symptoms (original scores >30) was detected.

The examined personality characteristics and indicators of psychological well-being did not predict the risk for dropping out from the study at the 3-month follow-up (all P values >.05) (Table 5). The results remained the same when potential confounding factors, including age, sex, study group, and educational status, were adjusted for in the analyses (all P values >.05; Table 6). Perceptions of general health approached significance; in other words, health perceptions marginally predicted dropout from the study after covariate controls (P=.08; Table 6). Estimates for each confounder can be found in Multimedia Appendix 1 (Tables S1-S16).


Principal Findings

The health-technology assisted MoMaMo! study focused on physically inactive overweight and obese men and women who were at risk for a permanent physically inactive lifestyle and lifestyle-related chronic diseases. We focused on assessing whether participant personality characteristics and indicators of psychological well-being contributed to attrition within the MoMaMo! study and whether these factors should be taken into consideration more carefully in future interventions to support adults’ commitment to technology-based intervention programs.

Our results showed that 65 (73%) of the 89 initially recruited participants were still participating at the 3-month follow-up. Similar, and also lower, adherence rates have been demonstrated in other longitudinal weight management interventions [27,49]. Specifically, participant attrition rates from eHealth interventions have previously been shown to exceed 20% [50]. Here, the examined personality dimensions of neuroticism, extraversion, openness to experience, agreeableness, and conscientiousness were not associated with the risk of dropping out from the study after the 3-month follow-up. Furthermore, the indicators of psychological well-being were not associated with the risk of attrition. All the results remained nonsignificant after adjusting for participant age, sex, study group, and educational status.

At present, studies on attrition in technology-based exercise intervention contexts are limited. Based on previous research [27], we carefully draw a hypothesis that scoring high in agreeableness and extraversion might reduce the risk of attrition. Our findings did not align with the evidence found by De Panfilis and colleagues [27] that characteristics related to agreeableness and extraversion (ie, reward dependence) may reduce the risk of dropping out in behavioral weight-loss interventions. Our study, however, is in the same direction as De Panfilis and colleague’s [27] conclusion that personality as a whole seems to not be involved in whether subjects attend interventions associated with behavioral change (eg, weight loss). Some previous evidence has also indicated that scoring low in novelty seeking, which has been shown to correlate with conscientiousness [23], is associated with the completion of longitudinal weight management interventions [28]. Based on this, we expected that scoring high in conscientiousness might be associated with study adherence in MoMaMo! However, this characteristic was not related to the outcome. One possibility for our study’s differences in relation to previous results could be that certain personality dimensions might be associated with later dropout [27]; in other words, personality-related dropout may occur after a longer period than 3 months. It has also been speculated that people who voluntarily join lifestyle programs have optimistic expectations for the program, and therefore their personality differences may not contribute to dropout at the beginning of the intervention [28]. Additionally, it has been suggested that there could be differences in lean and obese persons’ personality characteristics, making the results from different samples vary [28]. In conclusion, our results suggest that commitment to the present technology-assisted physical activity intervention at the 3-month follow-up was not linked to any specific personality characteristics in the overweight adults.

Previous studies have indicated that a lower level of health-related quality of life (eg, experiences of health and physical limitations), negative thoughts and moods, and depressive symptoms could contribute to participant attrition [30,33]. Participants’ expectations and emotions regarding technology-based interventions may also contribute to attrition [51]. Based on this evidence, it seems that people’s personal resources related to well-being might be a key element in completing projects such as lifestyle interventions. In the present study, participants scored high in dimensions reflecting positive affect or mood. Positive mood has previously been shown to predict adherence to interventions [30]. Furthermore, almost all participants (77/83, 93%) experienced only minimal or mild depressive symptoms, and no results on severe depressive symptoms were found. This might be the reason our results differed from those of Goode et al [33], who suggested that experiencing depression contributes to attrition. Taken together, we did not gain evidence for the contribution of the examined indicators of psychological well-being to dropout in the present study.

In addition to the above speculation, it is also possible that the designed intervention features in the technology-supported MoMaMo! trial were, in their current from, suitable for the recruited participants’ characteristics, so that dropout could not be attributed to their personality or levels of psychological well-being. Our findings suggest that the psychological qualities do not contribute to discontinuation of the technology-based lifestyle intervention program among overweight adults, and that tailoring interventions more carefully to personality and well-being levels may not be needed in supporting participants’ adherence to technology-assisted interventions during a 3-month period.

Potential causes of the relatively high attrition rate (27%) in our study remain, however, obscure. It has been stated that motivating users for behavior change before guiding them through action planning [35] could support their adherence to lifestyle interventions. The role of social support, such as integrating face-to-face intervention delivery strategies to technology-based intervention programs, may be a contributor to participants’ motivation to commit to these studies [52]. Individuals may also be more likely to drop out of trials if they do not meet weight loss goals [53]. Use of positive reinforcement may also be beneficial, especially in cases where reaching outcomes requires time (eg, losing weight) [51]. Based on these perspectives, it seems possible that more attention should be paid to motivational factors, referring to the inner states that energize and direct behaviors. At present, examination of the effectiveness of the MoMaMo! study is ongoing, and future studies on attrition could focus on assessing motivational elements beyond the present research, such as on participants’ meeting intervention goals.

Limitations

This study focused on assessing the potential role of personality and psychological well-being in study attrition. Other factors, such as physical or social circumstances (eg, sudden outbreaks of disease or lack of social support) and those related to meeting goals were not assessed. Furthermore, specific study variables, including psychological well-being, were studied only in the beginning of the intervention. As psychological well-being, along with many other factors relating to human experience, fluctuates over time, it will be important to address the dynamic nature of this phenomenon in relation to study attrition (eg, using survival analyses) in future studies. Additionally, we cannot be absolutely certain whether the participants who did not come to the laboratory follow-up tests quit only the study or also their intervention program at the individual level. That is, they may or may not have continued changing or improving their lifestyles after they discontinued their participation in the MoMaMo! study. Although all the instruments’ subscales were considered acceptable according to general rules, openness to experience had poor reliability (Cronbach α=.55). Some studies have demonstrated similar α values when optimal subset items reflecting personality dimensions were researched [54]. Generally, the α coefficient reliability has been high in this instrument’s validation studies [21]. Furthermore, due to the relatively high attrition rate, some of the analyses performed in the study may lack statistical power. Consequently, these study results can be regarded only as directional. Studies with larger sample sizes and longer follow-up periods are needed to confirm our results.

Strengths

We were able to study attrition with a well-validated set of psychological questionnaires. To our knowledge, this is one of the first studies assessing attrition in technology-supported, longitudinal lifestyle interventions conducted in overweight or obese adults. Our study is also one of the first to provide information on the role of participant psychological profiles in technology-supported interventions that aim at increasing physical activity and VO2max.

Conclusions

The personality characteristics and indicators of psychological well-being examined in this study did not contribute to participant attrition in the technology-supported MoMaMo! lifestyle intervention conducted in overweight adults. As attrition remains a challenge within longitudinal, technology-supported lifestyle interventions, attention should be paid to the potentially dynamic nature of personality and psychological well-being, as well as to elements beyond these.

Acknowledgments

The study was funded by Business Finland (575/31/2015), University of Helsinki, Ministry of Education and Culture (Finland), Helsinki Deaconess Institute, Diaconia University of Applied Sciences, Terveystalo Oyj (former Diacor Terveyspalvelut Oy), HUR Oy, Firstbeat Technologies Oy, Nukute Oy, Suunto Oy, Amer Sports Digital Services Oy, Nutri-Flow Oy, F8 Helsinki Oy, Diamond (TYH2016215), and Amer Cultural Foundation. We gratefully acknowledge Sanni Malander and Laura Ginström for data acquisition and coding.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Detailed estimates for the confounding factors.

DOCX File , 62 KB

Multimedia Appendix 2

CONSORT-eHEALTH checklist (V 1.6.2).

PDF File (Adobe PDF File), 93 KB

  1. Van Camp G. Cardiovascular disease prevention. Acta Clinica Belgica 2014 Aug 31;69(6):407-411. [CrossRef]
  2. Booth F, Roberts C, Laye M. Lack of exercise is a major cause of chronic diseases. Compr Physiol 2012 Apr;2(2):1143-1211 [FREE Full text] [CrossRef] [Medline]
  3. Warburton DE, Nicol CW, Bredin SSD. Health benefits of physical activity: the evidence. CMAJ 2006 Mar 14;174(6):801-809 [FREE Full text] [CrossRef] [Medline]
  4. Physical Activity Guidelines for Americans, 2nd ed. US Dept of Health and Human Services. 2018.   URL: https://health.gov/sites/default/files/2019-09/Physical_Activity_Guidelines_2nd_edition.pdf [accessed 2022-08-16]
  5. Wiklund P. The role of physical activity and exercise in obesity and weight management: Time for critical appraisal. J Sport Health Sci 2016 Jun;5(2):151-154 [FREE Full text] [CrossRef] [Medline]
  6. Bonomi AG, Westerterp KR. Advances in physical activity monitoring and lifestyle interventions in obesity: a review. Int J Obes (Lond) 2012 Feb 17;36(2):167-177. [CrossRef] [Medline]
  7. Zhao J, Freeman B, Li M. Can mobile phone apps influence peoples health behavior change? An evidence review. J Med Internet Res 2016 Oct 31;18(11):e287 [FREE Full text] [CrossRef] [Medline]
  8. Krukowski R, Tilford J, Harvey-Berino J, West D. Comparing behavioral weight loss modalities: incremental cost-effectiveness of an internet-based versus an in-person condition. Obesity (Silver Spring) 2011 Aug;19(8):1629-1635 [FREE Full text] [CrossRef] [Medline]
  9. Eapen ZJ, Peterson ED. Can mobile health applications facilitate meaningful behavior change?: Time for answers. JAMA 2015 Sep 22;314(12):1236-1237. [CrossRef] [Medline]
  10. Denscombe M. Item non‐response rates: a comparison of online and paper questionnaires. Int J Soc Res Methodol 2009 Oct;12(4):281-291. [CrossRef]
  11. Davies CA, Spence JC, Vandelanotte C, Caperchione CM, Mummery W. Meta-analysis of internet-delivered interventions to increase physical activity levels. Int J Behav Nutr Phys Act 2012 Apr 30;9(1):52 [FREE Full text] [CrossRef] [Medline]
  12. Watson S, Woodside JV, Ware LJ, Hunter SJ, McGrath A, Cardwell CR, et al. Effect of a web-based behavior change program on weight loss and cardiovascular risk factors in overweight and obese adults at high risk of developing cardiovascular disease: Randomized controlled trial. J Med Internet Res 2015 Jul 16;17(7):e177 [FREE Full text] [CrossRef] [Medline]
  13. Rathbone AL, Prescott J. The use of mobile apps and SMS messaging as physical and mental health interventions: Systematic review. J Med Internet Res 2017 Aug 24;19(8):e295 [FREE Full text] [CrossRef] [Medline]
  14. Eysenbach G. The law of attrition. J Med Internet Res 2005 Mar 31;7(1):e11 [FREE Full text] [CrossRef] [Medline]
  15. Geraghty AWA, Torres LD, Leykin Y, Pérez-Stable EJ, Muñoz RF. Understanding attrition from international Internet health interventions: a step towards global eHealth. Health Promot Int 2013 Sep 10;28(3):442-452 [FREE Full text] [CrossRef] [Medline]
  16. Dragana B, Vesna GJ, Veljko J, Dragan Z, Milica L. Baseline sociodemographic characteristics of participants and dropout in web-based weight reduction program in Serbia. Front Public Health 2016;4. [CrossRef]
  17. Rhodes R, Boudreau P. Physical activity and personality traits. In: Braddick O, editor. Oxford Research Encyclopedia of Psychology. Oxford, UK: Oxford University Press; 2017.
  18. Biddle S, Fox K, Boutcher S. Physical Activity and Psychological Well-being. London, UK: Routledge; 2003.
  19. Raynor DA, Levine H. Associations between the five-factor model of personality and health behaviors among college students. J Am Coll Health 2009 Jul;58(1):73-82. [CrossRef]
  20. McCrae R, Costa P. The five-factor theory of personality. In: Handbook of Personality: Theory and Research (3rd ed). New York, NY: Guilford Press; 2008.
  21. Konstabel K, Lönnqvist J, Walkowitz G, Konstabel K, Verkasalo M. The ‘Short Five’ (S5): Measuring personality traits using comprehensive single items. Eur J Pers 2012 Jan 01;26(1):13-29. [CrossRef]
  22. Cloninger CR, Svrakic DM, Przybeck TR. A psychobiological model of temperament and character. Arch Gen Psychiatry 1993 Dec 01;50(12):975-990. [CrossRef] [Medline]
  23. De Fruyt F, Van De Wiele L, Van Heeringen C. Cloninger's psychobiological model of temperament and character and the five-factor model of personality. Pers Individ Differ 2000 Sep;29(3):441-452. [CrossRef]
  24. Sundfør HB, Fyhri A. A push for public health: the effect of e-bikes on physical activity levels. BMC Public Health 2017 Oct 16;17(1):809 [FREE Full text] [CrossRef] [Medline]
  25. Wilson KE, Dishman RK. Personality and physical activity: A systematic review and meta-analysis. Pers Individ Differ 2015 Jan;72:230-242. [CrossRef]
  26. Jokela M, Hintsa T, Hintsanen M, Keltikangas‐Järvinen L. Adult temperament and childbearing over the life course. Eur J Pers 2020 Dec 02;24(2):151-166. [CrossRef]
  27. De Panfilis C, Torre M, Cero S, Salvatore P, Dall'Aglio E, Marchesi C, et al. Personality and attrition from behavioral weight-loss treatment for obesity. Gen Hosp Psychiatry 2008 Nov;30(6):515-520. [CrossRef] [Medline]
  28. Sullivan S, Cloninger CR, Przybeck TR, Klein S. Personality characteristics in obesity and relationship with successful weight loss. Int J Obes (Lond) 2007 Apr 5;31(4):669-674 [FREE Full text] [CrossRef] [Medline]
  29. de Vries RAJ, Truong KP, Zaga C, Li J, Evers V. A word of advice: how to tailor motivational text messages based on behavior change theory to personality and gender. Pers Ubiquit Comput 2017 Jun 15;21(4):675-687. [CrossRef]
  30. Burgess E, Hassmén P, Pumpa KL. Determinants of adherence to lifestyle intervention in adults with obesity: a systematic review. Clin Obes 2017 Jun 15;7(3):123-135. [CrossRef] [Medline]
  31. Häkkinen A, Rinne M, Vasankari T, Santtila M, Häkkinen K, Kyröläinen H. Association of physical fitness with health-related quality of life in Finnish young men. Health Qual Life Outcomes 2010 Jan 29;8(1):15 [FREE Full text] [CrossRef] [Medline]
  32. Bize R, Johnson JA, Plotnikoff RC. Physical activity level and health-related quality of life in the general adult population: a systematic review. Prev Med 2007 Dec;45(6):401-415. [CrossRef] [Medline]
  33. Goode RW, Ye L, Sereika SM, Zheng Y, Mattos M, Acharya SD, et al. Socio-demographic, anthropometric, and psychosocial predictors of attrition across behavioral weight-loss trials. Eat Behav 2016 Jan;20:27-33 [FREE Full text] [CrossRef] [Medline]
  34. Van't Riet J, Crutzen R, De Vries H. Investigating predictors of visiting, using, and revisiting an online health-communication program: A longitudinal study. J Med Internet Res 2010 Sep 02;12(3):e37 [FREE Full text] [CrossRef] [Medline]
  35. Van der Mispel C, Poppe L, Crombez G, Verloigne M, De Bourdeaudhuij I. A self-regulation-based eHealth intervention to promote a healthy lifestyle: Investigating user and website characteristics related to attrition. J Med Internet Res 2017 Jul 11;19(7):e241 [FREE Full text] [CrossRef] [Medline]
  36. Kaseva K, Pulkki-Råback L, Elovainio M, Pahkala K, Keltikangas-Järvinen L, Hintsanen M, et al. Psychological wellbeing in 20-year-old adults receiving repeated lifestyle counselling since infancy. Acta Paediatr 2015 Aug 29;104(8):815-822. [CrossRef] [Medline]
  37. Business Finland.   URL: https://www.businessfinland.fi/en/for-finnish-customers/home [accessed 2022-07-27]
  38. Garber C, Blissmer B, Deschenes M, Franklin B, Lamonte M, Lee IM, American College of Sports Medicine. American College of Sports Medicine position stand. Quantity and quality of exercise for developing and maintaining cardiorespiratory, musculoskeletal, and neuromotor fitness in apparently healthy adults: guidance for prescribing exercise. Med Sci Sports Exerc 2011 Jul;43(7):1334-1359. [CrossRef] [Medline]
  39. American College of Sports Medicine. ACSM's Resource Manual for Guidelines for Exercise Testing and Prescription (7th ed). Baltimore, MD: Wolters Kluwer Health, Lippincott Williams & Wilkins; 2014.
  40. VTT Technical Research Centre of Finland Ltd. 2016.   URL: https://www.vttresearch.com/en [accessed 2022-08-31]
  41. Lunt H, Draper N, Marshall HC, Logan FJ, Hamlin MJ, Shearman JP, et al. High intensity interval training in a real world setting: a randomized controlled feasibility study in overweight inactive adults, measuring change in maximal oxygen uptake. PLoS One 2014 Jan 13;9(1):e83256 [FREE Full text] [CrossRef] [Medline]
  42. Lamprecht M, Obermayer G, Steinbauer K, Cvirn G, Hofmann L, Ledinski G, et al. Supplementation with a juice powder concentrate and exercise decrease oxidation and inflammation, and improve the microcirculation in obese women: Randomised controlled trial data. Br J Nutr 2013 Apr 16;110(9):1685-1695. [CrossRef]
  43. Welcome to the CONSORT Website. CONSORT: Transparent Report of Trials.   URL: http://www.consort-statement.org/ [accessed 2022-08-16]
  44. Ware JE, Sherbourne CD. The MOS 36-item short-form health survey (SF-36). Med Care 1992;30(6):473-483. [CrossRef]
  45. Watson D, Clark LA, Tellegen A. Development and validation of brief measures of positive and negative affect: The PANAS scales. J Pers Soc Psychol 1988;54(6):1063-1070. [CrossRef]
  46. Beck A, Steer R, Brown G. Manual for the Beck Depression Inventory-II. San Antonio, TX: Psychological Corporation; 1996.
  47. Storch EA, Roberti JW, Roth DA. Factor structure, concurrent validity, and internal consistency of the Beck Depression Inventory-Second Edition in a sample of college students. Depress Anxiety 2004;19(3):187-189. [CrossRef] [Medline]
  48. Wang Y, Gorenstein C. Psychometric properties of the Beck Depression Inventory-II: A comprehensive review. Braz J Psychiatry 2013 Dec;35(4):416-431. [CrossRef] [Medline]
  49. Tobi P, Estacio EV, Yu G, Renton A, Foster N. Who stays, who drops out? Biosocial predictors of longer-term adherence in participants attending an exercise referral scheme in the UK. BMC Public Health 2012 May 11;12(1):347 [FREE Full text] [CrossRef] [Medline]
  50. Neve MJ, Collins CE, Morgan PJ. Dropout, nonusage attrition, and pretreatment predictors of nonusage attrition in a commercial web-based weight loss program. J Med Internet Res 2010 Dec 14;12(4):e69 [FREE Full text] [CrossRef] [Medline]
  51. Short CE, Vandelanotte C, Dixon MW, Rosenkranz R, Caperchione C, Hooker C, et al. Examining participant engagement in an information technology-based physical activity and nutrition intervention for men: the manup randomized controlled trial. JMIR Res Protoc 2014 Jan 03;3(1):e2 [FREE Full text] [CrossRef] [Medline]
  52. Du H, Venkatakrishnan A, Youngblood GM, Ram A, Pirolli P. A group-based mobile application to increase adherence in exercise and nutrition programs: A factorial design feasibility study. JMIR Mhealth Uhealth 2016 Jan 15;4(1):e4 [FREE Full text] [CrossRef] [Medline]
  53. Yackobovitch-Gavan M, Steinberg DM, Endevelt R, Benyamini Y. Factors associated with dropout in a group weight-loss programme: A longitudinal investigation. J Hum Nutr Diet 2015 Feb 14;28 Suppl 2:33-40. [CrossRef] [Medline]
  54. Konstabel K, Lönnqvist JE, Leikas S, García Velázquez R, Qin H, Verkasalo M, et al. Measuring single constructs by single items: Constructing an even shorter version of the "Short Five" personality inventory. PLoS One 2017 Aug 11;12(8):e0182714 [FREE Full text] [CrossRef] [Medline]


BDI-II: Beck Depression Inventory II
CONSORT: Consolidated Standards of Reporting Trials of Electronic and Mobile Health Applications and Online Telehealth
ECG: electrocardiography
mHealth: mobile health
MoMaMo!: Motivation Makes the Move!
PANAS: Positive and Negative Affect Schedule
RPE: ratio of perceived exertion
S5: Short Five
VO2max: maximal oxygen uptake


Edited by A Mavragani; submitted 16.05.21; peer-reviewed by D Saleh, Y Zhou; comments to author 17.09.21; revised version received 01.03.22; accepted 02.06.22; published 25.11.22

Copyright

©Kaisa Kaseva, Mari Tervaniemi, Enni Heikura, Kaisamari Kostilainen, Maritta Pöyhönen-Alho, J Kevin Shoemaker, Robert J Petrella, Juha E Peltonen. Originally published in JMIR Formative Research (https://formative.jmir.org), 25.11.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.