Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/50850, first published .
Web-Based Emotion Regulation Training for Sexual Health: Randomized Controlled Trial

Web-Based Emotion Regulation Training for Sexual Health: Randomized Controlled Trial

Web-Based Emotion Regulation Training for Sexual Health: Randomized Controlled Trial

Original Paper

1Institute for Health and Behaviour, Department of Behavioural and Cognitive Sciences, University of Luxembourg, Esch-sur-Alzette, Luxembourg

2Conectare Neuropsi, Porto Alegre, Brazil

3Institute of Psychology, University of Lausanne, Lausanne, Switzerland

4Department of Behavioural Science and Learning, Department of Biomedical and Clinical Sciences, Linköping University, Linköping, Sweden

5Department of Clinical Neuroscience, Karolinska Institute, Stockholm, Sweden

Corresponding Author:

Vinicius Jobim Fischer, PhD

Institute for Health and Behaviour

Department of Behavioural and Cognitive Sciences

University of Luxembourg

11, Porte des Sciences

Esch-sur-Alzette, L-4366

Luxembourg

Phone: 352 46 66 44 9740

Email: viniciusjfischer@gmail.com


Background: Effective emotional regulation (ER) skills are important for sexual function, as they impact emotional awareness and expression during sexual activity, and therefore, satisfaction and distress. Emotion regulation interventions may offer a promising approach to improve sexual health. Web-based emotion regulation may be a therapeutic strategy for men and women with sexual health concerns. Nevertheless, there is a scarcity of intervention trials investigating its effects in this context, much less using the internet.

Objective: This study aims to investigate the effects of a web-based emotion regulation training program for sexual function in both men and women.

Methods: The participants were recruited based on their self-reported sexual problems, which for men was defined by a score of <25 on the International Index Erectile Function (IIEF) and for women by a score of <26.55 on the Female Sexual Function Index (FSFI). The final sample included 60 participants who were randomized to either a web-based emotion regulation training for sexual function or to a waitlist control group. The treatment consisted of an 8-week web-based emotion regulation training for sexual function. The participants were assessed at baseline, post intervention, and the 3-month follow-up.

Results: Of the 60 participants included, only 6 completed all 3 assessment points (n=5, 20% in the treatment group and n=1, 5% in the waitlist control group) after receiving the intervention. At follow-up, there were no significant differences between groups in any measure. Among the intervention completers, large-to-moderate within-group effect sizes were observed between the assessment points on measures of emotion regulation, depression, lubrication, orgasm, thoughts of sexual failure, and abuse during sexual activity. The adherence rate was very low, limiting the generalizability of the findings.

Conclusions: Participants who completed the intervention showed improvements in both sexual function domains and emotion regulation. Nonetheless, due to a high dropout rate, this trial failed to collect sufficient data to allow for any conclusions to be drawn on treatment effects.

Trial Registration: ClinicalTrials.gov NCT04792177; https://clinicaltrials.gov/study/NCT04792177

JMIR Form Res 2024;8:e50850

doi:10.2196/50850

Keywords



Background

Sexual dysfunctions involve difficulty in the ability to respond sexually or obtain sexual pleasure and are common and often disabling conditions [1]. Their etiology is multifactorial and encompasses biopsychosocial factors [2]. Throughout the lifespan, it has been estimated that 40% to 45% of adult women and 20% to 30% of adult men in the general population fulfill the criteria for at least 1 sexual dysfunction [3]. As an example, in the last available national survey in the United Kingdom, 51.2% of women and 41.6% of men who had sex in the last year reported at least 1 sexual problem [4].

The cognitive-affective model of sexual dysfunctions [5] posits that both healthy individuals and those with physical or mental conditions respond differently to sexual situations. While men and women without sexual dysfunctions respond to sexual situations with positive affect, expectations of success, and perception of control, those with sexual dysfunctions respond with anxiety, negative affect, and expectations of failure. In addition, preoccupations about erection and disengagement/thoughts about failure in men and lack of erotic thoughts in women have been found to be negatively correlated with sexual arousal. Across both sexes, sadness and disillusion are negatively associated with sexual arousal [6].

Emotion regulation (ER), the process by which emotions are generated, experienced, and used [7], has also been associated with sexual response cycle difficulties (arousal, lubrication, orgasm, pain, erection, and ejaculation) in both men and women [8-11]. Taking into consideration the high prevalence rates of emotion regulation difficulties and the high comorbidity of sexual disorders with other mental disorders [12], studies are needed to address ER interventions for sexual dysfunctions. The few studies investigating the effects of ER interventions have reported positive results, such as a reduction in sexual compulsivity, drug use, HIV risk behaviors, anxiety, and depression [13], and improvements in sexual functioning and quality of life [14].

Learning effective ER skills is important for sexual function, as they impact emotional awareness and expression during sexual activity, and, therefore, satisfaction and distress [15]. There is evidence that adaptive ER strategies are associated with better sexual function and mental health (anxiety and depression) [6] and reduced sensitivity and reactivity to negative stimuli [15].

Psychosexual interventions have been shown to be effective in treating sexual disorders [16]. They combine several interventions to address disorders experienced by both sexes. Generally, they are based on cognitive and behavioral interventions but can also include couple and systemic therapy components [17]. Most often, psychosexual therapies based on cognitive behavior therapy include (1) psychoeducation about sexual function, (2) cognitive challenges to negative sexual attitudes and distortions, and (3) behavioral activation via sex therapy–specific techniques [18]. The benefits of psychosexual therapies not only involve functional aspects but can also improve other domains of life, such as personal well-being and relationship quality and satisfaction [19,20].

Sexual dysfunctions are often perceived as sensitive, embarrassing, and potentially stigmatizing by those concerned. The relative anonymity of web-based approaches may offer an opportunity to attend therapy sessions in an environment that is perceived as safer and more private, while not requiring much investment of time for both the therapist and the client [21-23].

In general, web-based psychological interventions have been found to be effective in treating a range of conditions. The potential benefits of web-based interventions include their anonymity, availability, and convenience of pace/time [24]. In addition, web-based interventions can support active learning via interactive components [25].

To date, only a few studies have investigated the effects of web-delivered interventions for sexual dysfunctions. None of these studies included ER training. In one study, a treatment program for various sexual dysfunctions led to improvements in sexual functioning in 67% (n=39) of the participants, with improvements maintained at 1-month follow-up [26]. Similarly, treatment was found to be superior to a waitlist control condition in a study on internet-delivered sex therapy for erectile dysfunction [27] and in a study comparing web-delivered cognitive behavioral therapy (CBT) to an internet discussion forum control group [28].

Despite the importance of ER for sexual function, web-based ER interventions have, to our knowledge, not been developed and tested to any greater extent in people with sexual dysfunction. Therefore, this study aims to tackle this gap in the literature as the first ER web-based intervention designed to improve sexual function.

Aim

This study aimed to investigate the effects of a web-based ER training program for sexual function in male and female participants experiencing sexual dysfunction named TREPS (Portuguese acronym for Emotion Regulation Training for Sexual Health). The training was provided in the form of an 8-week web-based program with therapist support via email on a secure treatment platform. We expected that TREPS group participants would show improvements in self-reported outcomes compared to the waitlist control group.


Overview

Participants were recruited from the general public via the internet. Advertisements concerning the project and invitations to take part in the study were disseminated using social media (Facebook and Instagram) for 4 months, targeting the Brazilian Portuguese–speaking population. Additionally, participants of a previous web-based survey known as the Sexual Health and Emotion Regulation (SHER) study who had volunteered to participate in future studies were also contacted.

The following inclusion criteria were used: (1) access to a computer/tablet or phone with an internet connection; (2) between 18 and 65 years of age; (3) fluent in Brazilian Portuguese; (4) self-reported sexual problems, as assessed in men by a score of <25 on the International Index Erectile Function (IIEF) and in women by a score of <26.5 on the Female Sexual Function Index (FSFI); and (5) in a stable relationship for at least the preceding last 3 months. The exclusion criteria were: (1) medical conditions that could interfere with the intervention, (eg, diabetes, cancer, and cardiovascular issues) or (2) currently receiving psychological or psychiatric treatment.

Figure 1 illustrates the recruitment steps according to the CONSORT (Consolidated Standards of Reporting Trials) guidelines. After providing informed consent on the platform, the volunteers filled out a screening questionnaire to see if they met the inclusion criteria. For those whose responses indicated suitability for participation in the study, a phone contact was established to verify their eligibility and motivation to participate in the study. Following this, the included participants completed a baseline questionnaire.

Figure 1. CONSORT (Consolidated Standards of Reporting Trials) flow diagram of the participant inclusion process.

Two separate block-randomization lists were created via a computer-generated (SealedEnvelope) block-randomization procedure (comprising a block size of 4 for 2 groups) with a 1:1 randomization ratio. The computer-generated sequence was generated by an independent researcher who was not involved in the trial. The actual allocation of participants to the TREPS intervention group or the waitlist control group was conducted by a clinical psychologist who was not involved in the project. Moreover, the researchers did not influence the allocation of the participants.

After randomization, the TREPS intervention group received the emotion regulation training for sexual function for 8 weeks, while the waitlist control group received no intervention. Both primary and secondary outcomes were assessed online on the study website at baseline, end of treatment, and the 3-month follow-up.

Ethical Considerations

All study procedures were approved by the Ethics Review Panel of the University of Luxembourg (ERP-20-029 SHER). The study was also registered on ClinicalTrials.gov (NCT04792177), and the protocol was published [29]. Prior to taking part in this study, the participants provided electronic informed consent. Personal data collected in this study included information about sociodemographic characteristics and sexual and mental health. To ensure confidentiality, the data collected were pseudonymized and a unique identifier was generated so that participants’ identities could not be disclosed. No compensation was offered to the participants.

Measures

Primary Outcome

The primary outcome measures were IIEF and FSFI scores for the male and female participants, respectively. The main reason for using these scores as main outcomes was that both have shown good reliability and validity for the Brazilian-speaking population [30,31]. For the IIEF, a cut-off score of 25 has been found to discriminate between diagnosis and no diagnosis [32], while for the FSFI, the respective score is 26.55 [33,34].

The IIEF is a 15-item, self-administered questionnaire for assessing sexual functioning in men [35]. Answers are given on a 6-point Likert scale. The IIEF encompasses 5 different domains of sexual functioning: erectile function, orgasm function, sexual desire, intercourse satisfaction, and overall satisfaction. Ferraz and Cicconelli [36] translated and adapted the scale to Brazilian Portuguese. Its psychometric properties have been reported by Gonzáles et al [30].

The FSFI is a 19-item questionnaire for the assessment of sexual functioning in women in the domains of sexual functioning (eg, sexual arousal, orgasm, satisfaction, and pain) [37]. Answers are provided using a 5-point Likert scale. Hentschel et al [31] translated and validated the FSFI into Portuguese.

Secondary Outcomes

The secondary outcome measures encompassed questionnaires about sexual function, mental health (anxiety and depression), ER, sexual self-perception, and thoughts during sexual activity. Sexual function was assessed with both the Sexual Quotient (SQ), using both the female [38] and male versions [39]. The SQ is a brief and comprehensive tool comprising 10 items that are answered on a scale from 0 (never) to 5 (always). It addresses general sexual function, stages of the sexual response cycle (desire, arousal, orgasm), and sexual satisfaction. Scores range between 0 and 100, with a score of ≤60 indicating sexual dysfunction.

Depression and anxiety symptoms were assessed via the Patient Heath Questionnaire-9 (PHQ-9) and the Generalized Anxiety Disorder-7 (GAD-7). Both instruments are frequently used self-report diagnostic tools for assessing mental health disorders.

The PHQ-9 [40] is a 9-item screening instrument that also provides an assessment of depression severity. The diagnostic validity of the tool has been established for its Brazilian version [41].

The GAD-7 [42] is a brief self-report measure specifically developed to assess generalized anxiety disorder. It has good reliability, as well as criterion, construct, factorial, and procedural validity. The Brazilian version has satisfactory psychometric properties [43].

The Difficulties in Emotion Regulation Scale (DERS) was used to assess ER. It covers several facets of ER, including difficulties relevant to an individual’s (1) acceptance of emotional responses, (2) ability to engage in goal-directed behavior under distress, (3) ability to control impulsive behaviors when distressed, (4) access to ER strategies, and (5) emotional clarity. Participants rate their degree of agreement with each statement on a scale from 1 (almost never; 0 to 10%) to 5 (almost always; 91 to 100%). The DERS was developed by Gratz and Roemer [44] and validated in Brazil by Miguel et al [45], with its psychometric properties confirmed by Cancian et al [46].

To assess sexual self-perception, the Sexual Self-Schema Scale (SSSS) was used [47]. It consists of 30 items assessing respondents’ perception of themselves as a sexual person compared to others of the same gender and age. Answers are provided using a 5-point Likert scale ranging from 1 (not at all descriptive of me) to 5 (very much descriptive of me). The psychometric properties of its Brazilian version have been found to be satisfactory [48].

To assess sexual thoughts during sexual activity, the Sexual Modes Questionnaire (SMQ) and its Automatic Thoughts subscale [49] were used. This self-report scale consists of 30 items in the male version and 33 items in the female version. Respondents are asked to rate the frequency, ranging from 1 (never) to 5 (always), with which they have experienced specific automatic thoughts during sexual activity. The psychometric properties of its Brazilian-adapted version have been evaluated [48].

Intervention

The intervention consisted of 8 weekly modules delivered via the internet using a secure web-based contact handling system (eg, similar to internet banking) [50]. Each module consisted of a video presentation, texts, and an exercise (homework) to complete during the week. Access to the intervention modules was granted weekly on the same day, and participants were expected to report homework assignments to the therapist until the day before the next module. The participants were able to contact the therapist via the web-based platform and could expect a reply within 24 hours. No face-to-face or telephone contact with the research team was allowed during the intervention (except for technical problems). Table 1 summarizes the contents of the modules.

Table 1. Summary of the intervention modules.
Time frameModuleContent
Week 1Psychoeducation on sexual functionThis module covers information about sexuality, the sexual response cycle (desire, excitement, plateau, orgasm, resolution), and the main difficulties that men and women may face in their sexual function, such as erectile dysfunction, premature ejaculation, desire disorders, pain disorders, and anorgasmia. It also differentiates the psychological characteristics of a functional sexual response from a dysfunctional sexual response and clarifies the difference between sexual function and sexual satisfaction [51].
Week 2Psychoeducation on emotions and emotional regulationThis module defines emotions, their evolutionary aspects, emotion functions, emotion response cycles, emotion components (physical sensations, thoughts, and behaviors), and the long-term consequences of maintaining an emotional state for a longer period. It also defines pleasant and unpleasant emotions, the relationship between unpleasant emotions and avoidance behaviors, and avoidance strategies (emotional suppression, distraction, and behavioral avoidance) [52-54].
Week 3Relaxation strategies: breathing and muscle relaxationThis module goes over the common physiological responses to anxiety and stress (eg, increases in heart rate, respiration, and muscle tension) and teaches 2 relaxation strategies: breathing relaxation and progressive muscle relaxation [52-54].
Week 4Cognitive flexibilityThis module refers to the rational component of emotion regulation. It aims to conceptualize and enhance cognitive flexibility. Moreover, the triad situation-thought-emotion is explained and detailed through the concepts of what distinguishes thoughts and interpretations, and what automatic thoughts and cognitive distortions are. The identification of negative thought patterns and the most common cognitive distortions related to sexuality are described [52-54].
Week 5Nonjudgmental awarenessThis module aims to teach participants to experience their emotions in the present moment in a nonjudgmental way. The module also differentiates between experiencing an unpleasant emotion from experiencing an unpleasant emotion resulting from negative beliefs and reactions (snowball effect) [52-54].
Week 6Self-acceptance and compassionThis module focuses on 2 psychological concepts necessary for better emotion management: acceptance and self-compassion. These are important in order not to avoid emotional experiences and to diminish self-criticism associated with sexual difficulties [52-54].
Week 7Emotion analysisThis module presents a step-by-step flowchart of how to identify emotions when experiencing them. By identifying emotions properly, we can facilitate effective emotion regulation. The flowchart comprises 6 items to pay attention to when identifying an emotion: (1) emotion, (2) event-trigger situation, (3) evaluation/interpretation, (4) physical sensations, (5) previous similar experiences, and (6) behavior [52-54].
Week 8Sexual emotional exposuresThis module summarizes all the previous modules and suggests a series of sexual experiences where participants pay attention to emotions experienced during the sexual activities (exposure). This gradual approach diminishes the risk of intense emotions and avoidant behaviors. By succeeding with the exposure and obtaining pleasure during the activities, feelings of danger/discomfort diminish, and more adaptive evaluations arise, facilitating the identification and modification of emotional behaviors.

The supporting clinician was a clinical psychologist and a European-certified psychosexologist. The waitlist control group received the same treatment at the end of the 3-month follow-up assessment.

Data Analysis

The baseline data present normal univariate distribution according to skewness (−2 to 2) and kurtosis (−7 to 7). The sociodemographic characteristics of the 2 groups were compared using chi-square tests. Next, a 1-way analysis of variance (ANOVA) on outcome variables was performed to examine group differences at baseline. Mann-Whitney U tests were carried out to compare the 2 groups (intervention and control) at baseline, at the end of intervention (T1), and at follow-up (T2). Given the large amount of missing data (over 80%), we did not impute missing data or estimate missing data using mixed model analyses [33]. All participants who received the intervention and completed the 3 assessment points were compiled and analyzed for within-group efficacy estimation. A within-group nonparametric Fisher test was run to assess pre-post changes. Data were considered significant at a P<.05.

For the parametric analysis, the effect size was calculated using Cohen d. For the nonparametric analysis, effect sizes were calculated using η2 [55]. All statistical analyses were conducted with SPSS software (version 20.0; IBM Corp).


Participants’ Characteristics

Initially, 60 participants completed the baseline questionnaires and were randomly assigned to one of 2 groups (intervention and waitlist control). Due to the high dropout rate and incomplete measures, we decided to merge the groups to compensate to some extent for the small sample size at post intervention. Table 2 shows the characteristics of the participants who fully adhered to the intervention and completed all the assessments (baseline, end of intervention, and 3-month follow-up).

Table 2. Participants’ sociodemographic characteristics.
CharacteristicsIntervention group (n=30)Control group (n=30)
Age (years), mean (SD)30 (6.81)31.3 (6.03)
Relationship duration (years), mean (SD)7.60 (5.81)6.66 (5.84)
Countryofresidence, n (%)

Brazil28 (93)28 (93)

Other2 (7)2 (7)
Gender, n (%)

Female29 (97)29 (97)

Male1 (3)1 (3)
Sexualorientation, n (%)

Heterosexual22 (73)26 (87)

Homosexual0 (0)1 (3)

Bisexual7 (23)3 (10)

Asexual0 (0)0 (0)

None of the above1 (3)0 (0)
Relationship status, n (%)

Single22 (73)7 (23)

Informal partnership7 (23)3 (10)

Civic/formal partnership0 (0)6 (20)

Married1 (3)14 (47)
Education, n (%)

Upper secondary8 (27)4 (13)

Tertiary/university22 (73)26 (87)
Occupation, n (%)

Student (university)4 (13)0 (0)

Working full-time16 (53)14 (47)

Working part-time4 (13)4 (13)

Housewife/househusband2 (7)2 (7)

Owner/independent3 (10)7 (23)

Unemployed/jobseeker1 (3)2 (7)

Intervention Adherence

Intervention adherence was assessed by examining the number of participants who accessed the platform and opened the weekly modules. More participants completed the-end-of-intervention and follow-up assessments than those who completed all the intervention modules. Taking into consideration the total number of participants included in the study, adherence to the different modules varied between 14 (n=2) and 76.6% (n=23). The mean number of modules completed within the 8 weeks was 3.2 in the intervention group and 3 in the control group (after they had completed their intervention). Table 3 summarizes the number of participants who read and watched the modules.

Table 3. Adherence to the weekly modules.
ModuleGroup 1: intervention (n=30), n (%)

Group 2: controla (n=20), n (%)
123 (77)16 (80)
214 (47)14 (70)
39 (30)13 (65)
49 (30)9 (45)
57 (23)4 (20)
65 (17)3 (15)
73 (10)2 (10)
85 (17)2 (10)

aWhen the intervention was offered to the second group, only 20 (67%) of the initial 30 participants completed the questionnaire and were therefore considered as the second intervention group.

An open-ended question section was used for the participants who completed the study, asking for suggestions and comments. A total of 3 topics emerged: (1) self-confidence, (2) influence on our emotional state of how we imagine others are seeing us, and (3) sexual repression during childhood and adolescence and its consequences in adult life. In addition, 1 participant suggested that the video materials should be longer.

Between-Group Analysis

When comparing the intervention group (n=12, 40%) and the waitlist control group (n=16, 80%), statistically significant differences were found at baseline regarding the subscales about automatic thoughts of abuse (intervention: mean 21.47, SD 7.98; waitlist control: mean 15.40, SD 5.40; P=.004; d=0.81) and lack of partner attention (intervention: mean 13.20, SD 4.80; P=.03; d=0.61). At the end of the intervention (T1), differences were found regarding orgasm capacity and frequency in the intervention group (n=6, 20%) (mean 3.09, SD 2.54) and waitlist control (n=10, 50%) (mean 2.50, SD 1.47; P=.04; η2=2.58), as well as automatic thoughts of failure (intervention group: mean 4.43, SD 3.50; waitlist control: mean 9.33, SD 2.61; P=.01; η2=1.08).

Multimedia Appendix 1 presents the between-group comparisons at the 3 assessment time points.

Within-Group Analyses

The intervention effect size calculation was conducted by combining all participants who completed the intervention and the 3-month follow-up assessment (n=5). The results indicated large within-group effect sizes for some of the outcome measures related to improvements in ER (DERS total score, η2=0.95; DERS goals, η2=0.94; DERS nonacceptance, η2=0.76), depression (PHQ-9, η2=0.73), orgasm (FSFI: orgasm η2=1.25), lubrification (FSFI: lubrication, η2=0.98), and failure automatic thoughts in a sexual context (EPA: failure, η2=0.95).

Medium effect sizes were found on all other factors of the DERS (η2=ranging from 0.50 to 0.68), anxiety (GAD-7, η2=0.43), arousal and partner connection in terms of the female version of the SQ (SQf; arousal and connection, η2=0.34), preliminaries (SQf: preliminaries, η2=0.38), abuse automatic thoughts in a sexual context (EPA: abuse, η2=0.38), and sexual self-schema (SSSS: loving/warm, η2=0.34)

Table 4 summarizes the within-group calculations.

Table 5 shows sexual function symptom scores for each participant who completed at least 2 assessment points.

Table 4. Within-group analysis after the follow-up.
Variables and scalesMean (SD)P valueEffect size (η2)
FSFIa sum15.93 (10.31)N/AbN/A

FSFI: Desire2.63 (1.48)>.990

FSFI: Arousal2.56 (2.02)N/AN/A

FSFI: Lubrication2.68 (2.25).380.98

FSFI: Orgasm2.38 (1.91).141.25

FSFI: Satisfaction2.64 (1.71)N/AN/A

FSFI: Pain3.14 (2.54).910.12
DERSc sum99.65 (24.36).020.95

DERS: Nonacceptance15.73 (6.45).060.76

DERS: Goals16.92 (4.65).020.94

DERS: Impulse14.08 (5.39).210.51

DERS: Awareness15.65 (5.06).090.68

DERS: Strategies23.96 (8.12).210.50

DERS: Clarity13.31 (3.79).140.60
EPAd: Abuse14.65 (7.10).370.38
EPA: Passivity control7.65 (4.77).570.23
EPA: Negative self-image13.54 (6.06).850.08
EPA: Failure7.46 (3.41).030.95
EPA: Lack of partner attention10.69 (5.15).950.03
EPA: Erotic thoughts12.85 (5.39).800.10
SSSSe: Direct/outspoken0 (0).850.09
SSSS: Loving/warm0 (0).410.34
SSSS: Reserved/conservative0 (0).800.10
SQff sum54.31 (26.73)>.990.01

SQf: Sexual desire and interest7.31 (4.36).660.19

SQf: Preliminaries3.27 (1.82).370.38

SQf: Arousal and partner connection5.81 (3.08).410.34

SQf: Comfort6.19 (3.24).750.14

SQf: Orgasm and satisfaction4.58 (2.98).810.11
PHQ-9g sum13.65 (7.94).080.73

PHQ-9: SuicideN/A.530.27

PHQ-9: Q10N/A.450.32
GAD-7h: Sum10.27 (6.13).340.43

aFSFI: Female Sexual Function Index.

bN/A: not applicable.

cDERS: Difficulties in Emotion Regulation Scale.

dEPA: Automatic Thoughts subscale, Sexual Modes Questionnaire.

eSSSS: Sexual Self-Schema Scale.

fSQf: Sexual Quotient: female version.

gPHQ-9: Patient Heath Questionnaire-9.

hGAD-7: Generalized Anxiety Disorder-7.

Table 5. Sexual function scores of participants who completed at least 2 assessments.
ParticipantBaseline (FSFIa/SQb)End of intervention (FSFI/SQ)3-month follow-up (FSFI/SQ)
13.2/8630.3/80N/Ac
217.6/40N/A2/28
311/3616.3/50N/A
412.3/32N/A15.9/N/A
520.9/4819.7/46N/A
622.1/5826.3/6230.5/70
711.4/3226.5/5622.7/56
82.4/803.2/84N/A
921.4/6030.5/64N/A
1020.8/4031.4/7218.2/46
1122.3/9022.7/86N/A

aFSFI: Female Sexual Function Index.

bSQ: Sexual Quotient.

cN/A: not applicable.


Principal Findings

This study aimed to investigate the effects of a web-based ER training program for sexual function. The trial faced a substantial dropout rate, but the preliminary results suggest that the TREPS protocol provided some improvements in relation to sexual function, albeit mainly for mental health and ER abilities. Although no significant effects were seen in the main outcome measures after the 3-month follow-up in the controlled between-group analyses, large and moderate within-group effect sizes were found for a range of components in the within-group analyses.

First, based on complete case analyses and the combined sample, large effects were found for the ER assessment as well as the depression and anxiety measures. Internet-based ER interventions for depression and emotional disorders have been shown to be efficacious with moderate-to-large between-group effect sizes [56-58]. The improvements we observed in this study are in line with those reported for face-to-face interventions focusing on mood disorders [59].

Regarding sexuality, moderate-to-large effects were found regarding the sexual components of arousal/lubrication and orgasm but not in other domains or the overall sexual function score. These sexual domains are more susceptible to individual sex practices and may have benefitted most from the intervention. This is plausible, as frustration with partners was frequently reported in participants’ responses to homework activities, and such components are associated with sexual desire, arousal, and satisfaction [60,61]. Regarding automatic thoughts in sexual activity, there were large intervention effects concerning failure and disengagement thoughts and a moderate effect concerning abuse thoughts. These findings are particularly relevant since both aspects have been suggested as the main cognitive components of sexual dysfunction in women [62,63].

Against our expectations, several factors did not allow us to strictly adhere to the published study protocol [29]. The 2 main changes concerned the follow-up, which was reduced from 6 to 3 months, and the conversion of the initially planned waitlist group into a second intervention group, assessed after receiving the intervention and 3 months later. These changes were implemented to counteract the high dropout rate in the intervention group.

Even though high attrition rates in web-based interventions for sexual function have been described in the past [29,63], the dropout rate in this study superseded those previously reported. When designing the study, precautions regarding adherence were made as suggested in the literature, such as a weekly scheduled treatment program, reminders, direct feedback, and positive messaging upon assignment completion [64,65].

Since no feedback was obtained from nonadherers, any conclusions must remain speculative. Our main hypothesis concerns the COVID-19 pandemic. The intervention was carried out during the COVID-19 outbreak, which affected Brazilians to a larger extent than other countries—by October 2021, Brazil had over 21.6 million infections and over 600 thousand deaths [66]. The number of completed modules was low, which is likely to have impacted the overall response to treatment. Among the participants, only 14% (n=7) accessed the last module, and less than 22% (n=11) accessed more than half of the intervention. Other web-based intervention studies focusing on male sexual disorders (erectile dysfunction) have reported similar findings. For instance, in one study, only 8% of the participants reached the final module, with 54% accessing just up to module 4 (out of 7) [28]. In a similar vein, a 70% dropout rate was reported for another web-based CBT program on sexual dysfunction [19].

Given the limited availability of internet interventions addressing sexual problems, further research is needed to understand the reasons behind the observed high dropout rates in the existing literature. As speculations, potential explanations can be made related to the nature of the sexual dysfunction, expectations, or outcomes.

Concerning the nature of the problem, given the personal and often taboo nature of sexuality and intimacy, it is reasonable to consider that worries about privacy or social stigma may significantly influence participant adherence to these interventions. Regarding treatment expectations, the concerned population often does not identify sexual problems as biopsychosocial complex problems. This perspective can lead to unrealistic expectations regarding the duration and effectiveness of interventions.

Regarding outcomes, individuals with sexual problems usually have misconceptions about sexual function and response. It is possible that if sufficient improvement is perceived after the psychoeducational phase (usually initial modules) of internet interventions, they might decide not to continue with the intervention.

Although adherence was low in this trial, the treatment remains easily scalable. The web-based intervention can be easily disseminated or updated at almost no cost and, therefore, is much cheaper than traditional face-to-face specialized treatments. Special attention must be paid to improving adherence.

Another important aspect concerns the unequal participation of men and women. While the TREPS training was developed for both men and women, only women participated in the study. This may be attributed to a higher level of interest among women in research studies [59,67] and related to how we recruited the participants. In addition to social media advertisements and contact with participants from a previous questionnaire study who volunteered to participate in future studies, we credited the female sample to a Brazilian female sexual health social media influencer (mainly followed by women), who shared the study on her social media account.

Limitations

First, the high dropout rate precludes any significant conclusions to be drawn from the results. Significant attrition should be addressed as a risk factor in future similar web-based ER training for sexual function. In addition, and in contrast to the potential advantages of web-based interventions (eg, anonymity, ease of access, etc), the high dropout rates in programs of this kind may indicate a serious limitation to the suitability of web-based training concerning sexual health. Second, most participants were highly educated, which affects the generalizability of the results and their scalability. Third, since the inclusion criteria were based on self-report measures, response bias and possible failures to detect interfering medical conditions not known by the participants may have occurred. Fourth, we did not assess participants’ expectations regarding the effects of the training, so it remains unclear as to whether these impacted the results.

Recommendations

For future studies, we recommend some changes in the study design and treatment components. Regarding recruitment, it would be advisable to have a referral system from a specialized sexual or mental health care service. Perhaps the recommendation of the training from a health service could improve adherence. Regarding the intervention, attention should be paid to the points raised by the intervention adherers, such as increasing the length and the amount of information provided per module. Moreover, there are currently no comparisons between web-based ER training for sexual health and face-to-face interventions. For this reason, comparisons between different intervention delivery methods such as face-to-face individual or group format interventions and web-based programs will be important. Future trials would also benefit from the inclusion of partner-related assessments.

Conclusions

Our preliminary results suggest that web-based ER training may be an effective supplementary or alternative treatment for sexual disorders. Completers of the intervention presented improvements both in sexual function domains as well as in emotion regulation. Nonetheless, due to a high dropout rate, this trial failed to collect sufficient data to allow for any conclusions to be drawn on treatment effects.

Despite its limitations, this study presents valuable information about web-based ER interventions for both mental and sexual health treatments. The improvements in ER skills, mental health, and specific sexual domains call for the further development and evaluation of such interventions. Further research is needed to better understand the feasibility and scalability of similar protocols and how male participants would respond to them.

Data Availability

The study data set generated during this investigation is not publicly available due to ethical concerns. Both the data set and the study metadata are available from the corresponding author upon request.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Between-group comparisons at baseline, end of intervention, and 3-month follow-up.

DOCX File , 34 KB

Multimedia Appendix 2

CONSORT eHEALTH Checklist (V 1.6.2).

PDF File (Adobe PDF File), 91 KB

  1. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5). Arlington, VA. American Psychiatric Association; 2013.
  2. Willi J, Burri A. Emotional intelligence and sexual functioning in a sample of Swiss men and women. J Sex Med. Oct 2015;12(10):2051-2060. [FREE Full text] [CrossRef] [Medline]
  3. Lewis RW, Fugl-Meyer KS, Corona G, Hayes RD, Laumann EO, Moreira ED, et al. Definitions/epidemiology/risk factors for sexual dysfunction. J Sex Med. Apr 2010;7(4 Pt 2):1598-1607. [CrossRef] [Medline]
  4. Mitchell KR, Mercer CH, Ploubidis GB, Jones KG, Datta J, Field N, et al. Sexual function in Britain: findings from the third National Survey of Sexual Attitudes and Lifestyles (Natsal-3). Lancet. Nov 2013;382(9907):1817-1829. [CrossRef]
  5. Barlow DH. Causes of sexual dysfunction: The role of anxiety and cognitive interference. J Consult Clin Psychol. 1986;54(2):140-148. [CrossRef]
  6. Fischer VJ, Andersson G, Billieux J, Infanti A, Vögele C. The role of emotion regulation strategies for sexual function and mental health: a cluster analytical approach. J Sex Marital Ther. Oct 12, 2023.:1-14. [CrossRef]
  7. Lumley MA, Cohen JL, Borszcz GS, Cano A, Radcliffe AM, Porter LS, et al. Pain and emotion: a biopsychosocial review of recent research. J Clin Psychol. Sep 06, 2011;67(9):942-968. [FREE Full text] [CrossRef] [Medline]
  8. Madioni F, Mammana LA. Toronto Alexithymia Scale in outpatients with sexual disorders. Psychopathology. Mar 2, 2001;34(2):95-98. [CrossRef] [Medline]
  9. Michetti PM, Rossi R, Bonanno D, De Dominicis C, Iori F, Simonelli C. Dysregulation of emotions and premature ejaculation (PE): alexithymia in 100 outpatients. J Sex Med. Sep 2007;4(5):1462-1467. [CrossRef] [Medline]
  10. Berenguer C, Rebôlo C, Costa RM. Interoceptive awareness, alexithymia, and sexual function. J Sex Marital Ther. May 20, 2019;45(8):729-738. [CrossRef] [Medline]
  11. Dubé JP, Corsini-Munt S, Muise A, Rosen NO. Emotion regulation in couples affected by female sexual interest/arousal disorder. Arch Sex Behav. Nov 29, 2019;48(8):2491-2506. [CrossRef] [Medline]
  12. Jonusiene G, Griffioen T. Psychiatric disorders and sexual dysfunctions. In: The EFS and ESSM Syllabus of Clinical Sexology. Amsterdam, the Netherlands. Medix; 2013;890-927.
  13. Parsons JT, Rendina HJ, Moody RL, Gurung S, Starks TJ, Pachankis JE. Feasibility of an emotion regulation intervention to improve mental health and reduce HIV transmission risk behaviors for HIV-positive gay and bisexual men with sexual compulsivity. AIDS Behav. Jun 29, 2017;21(6):1540-1549. [FREE Full text] [CrossRef] [Medline]
  14. de Ornelas Maia ACC, Sanford J, Boettcher H, Nardi AE, Barlow D. Improvement in quality of life and sexual functioning in a comorbid sample after the unified protocol transdiagnostic group treatment. J Psychiatr Res. Oct 2017;93:30-36. [CrossRef] [Medline]
  15. Rosen NO, Bergeron S. Genito-pelvic pain through a dyadic lens: moving toward an interpersonal emotion regulation model of women's sexual dysfunction. J Sex Res. Sep 25, 2019;56(4-5):440-461. [CrossRef] [Medline]
  16. Frühauf S, Gerger H, Schmidt HM, Munder T, Barth J. Efficacy of psychological interventions for sexual dysfunction: a systematic review and meta-analysis. Arch Sex Behav. Aug 5, 2013;42(6):915-933. [FREE Full text] [CrossRef] [Medline]
  17. Kingsberg SA, Althof S, Simon JA, Bradford A, Bitzer J, Carvalho J, et al. Female sexual dysfunction-medical and psychological treatments, committee 14. J Sex Med. Dec 2017;14(12):1463-1491. [CrossRef] [Medline]
  18. Meana M, Jones S. Developments and trends in sex therapy. Adv Psychosom Med. 2011;31:57-71. [CrossRef] [Medline]
  19. McCabe MP, Price E, Piterman L, Lording D. Evaluation of an internet-based psychological intervention for the treatment of erectile dysfunction. Int J Impot Res. Feb 28, 2008;20(3):324-330. [CrossRef] [Medline]
  20. McCabe M, Price E. Internet-based psychological and oral medical treatment compared to psychological treatment alone for ED. J Sex Med. Oct 2008;5(10):2338-2346. [CrossRef] [Medline]
  21. Cooper A, Scherer C, Mathy RM. Overcoming methodological concerns in the investigation of online sexual activities. Cyberpsychol Behav. Aug 2001;4(4):437-447. [CrossRef] [Medline]
  22. Taylor CB, Luce KH. Computer- and internet-based psychotherapy interventions. Curr Dir Psychol Sci. Jun 24, 2016;12(1):18-22. [CrossRef]
  23. Hummel SB, van Lankveld JJ, Oldenburg HS, Hahn DE, Broomans E, Aaronson NK. Internet-based cognitive behavioral therapy for sexual dysfunctions in women treated for breast cancer: design of a multicenter, randomized controlled trial. BMC Cancer. Apr 28, 2015;15(1):321. [FREE Full text] [CrossRef] [Medline]
  24. Andersson G, Titov N, Dear BF, Rozental A, Carlbring P. Internet-delivered psychological treatments: from innovation to implementation. World Psychiatry. Jan 02, 2019;18(1):20-28. [CrossRef] [Medline]
  25. Andersson G, Berger T. Internet approaches to psychotherapy: mpirical findings and future directions. In: Handbook of Psychotherapy and Behavior Change. Hoboken, NJ. Wiley; 2021;749-772.
  26. Van Diest SL, Van Lankveld JJDM, Leusink PM, Slob AK, Gijs L. Sex therapy through the internet for men with sexual dysfunctions: a pilot study. J Sex Marital Ther. May 2007;33(2):115-133. [CrossRef] [Medline]
  27. van Lankveld JDM, Leusink P, van Diest S, Gijs L, Slob AK. Internet-based brief sex therapy for heterosexual men with sexual dysfunctions: a randomized controlled pilot trial. J Sex Med. Aug 2009;6(8):2224-2236. [CrossRef] [Medline]
  28. Andersson E, Walén C, Hallberg J, Paxling B, Dahlin M, Almlöv J, et al. A randomized controlled trial of guided Internet-delivered cognitive behavioral therapy for erectile dysfunction. J Sex Med. Oct 2011;8(10):2800-2809. [CrossRef] [Medline]
  29. Fischer VJ, Andersson G, Billieux J, Vögele C. A randomized controlled trial of an Internet-based emotion regulation intervention for sexual health: study protocol. Trials. Oct 15, 2021;22(1):706. [FREE Full text] [CrossRef] [Medline]
  30. Gonzáles AI, Sties S, Wittkopf P, Mara LS, Ulbrich AZ, Cardoso FL, et al. Validation of the International Index of Erectile Function (IIFE) for use in Brazil. Arq Bras Cardiol. Aug 2013;101(2):176-182. [FREE Full text] [CrossRef] [Medline]
  31. Hentschel H, Alberton DL, Capp E, Goldim JR, Passos E. Validação do Female Sexual Function Index (FSFI) para uso em língua portuguesa. Rev HCPA. Rev HCPA. 2007;27(1):10-14.
  32. Rosen RC, Cappelleri JC, Gendrano N. The International Index of Erectile Function (IIEF): a state-of-the-science review. Int J Impot Res. Aug 05, 2002;14(4):226-244. [CrossRef] [Medline]
  33. Jakobsen JC, Gluud C, Wetterslev J, Winkel P. When and how should multiple imputation be used for handling missing data in randomised clinical trials - a practical guide with flowcharts. BMC Med Res Methodol. Dec 06, 2017;17(1):162. [FREE Full text] [CrossRef] [Medline]
  34. Wiegel M, Meston C, Rosen R. The female sexual function index (FSFI): cross-validation and development of clinical cutoff scores. J Sex Marital Ther. Jan 2005;31(1):1-20. [CrossRef] [Medline]
  35. Rosen RC, Riley A, Wagner G, Osterloh IH, Kirkpatrick J, Mishra A. The international index of erectile function (IIEF): a multidimensional scale for assessment of erectile dysfunction. Urology. Jun 1997;49(6):822-830. [CrossRef] [Medline]
  36. Ferraz M, Ciconelli M. Tradução e adaptação cultural do índice internacional de função erétil para a língua portuguesa. Rev Bras Med. 1998;55(1):35-40.
  37. Rosen R, Brown C, Heiman J, Leiblum S, Meston C, Shabsigh R, et al. The Female Sexual Function Index (FSFI): a multidimensional self-report instrument for the assessment of female sexual function. J Sex Marital Ther. Feb 02, 2000;26(2):191-208. [CrossRef] [Medline]
  38. Abdo C. Elaboração e validação do quociente sexual, versão feminina: uma escala para avaliar a função sexual da mulher. Rev Bras Med. 2006;63(9):477-482.
  39. Abdo CH. The male sexual quotient: a brief, self-administered questionnaire to assess male sexual satisfaction. J Sex Med. Mar 2007;4(2):382-389. [CrossRef] [Medline]
  40. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. JAMA. Nov 10, 1999;282(18):1737-1744. [CrossRef] [Medline]
  41. de LOF, Vilela MA, Crippa JA, Loureiro SR. Study of the discriminative validity of the PHQ-9 and PHQ-2 in a sample of Brazilian women in the context of primary health care. Perspect Psychiatr Care. Jul 2009;45(3):216-227. [CrossRef] [Medline]
  42. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med. May 22, 2006;166(10):1092-1097. [CrossRef] [Medline]
  43. Moreno AL, DeSousa DA, Souza AMFLP, Manfro GG, Salum GA, Koller SH, et al. Factor structure, reliability, and item parameters of the brazilian-Portuguese version of the GAD-7 questionnaire. Temas Psicol. 2016;24(1):367-376. [CrossRef]
  44. Gratz KL, Roemer L. Multidimensional assessment of emotion regulation and dysregulation: development, factor structure, and initial validation of the Difficulties in Emotion Regulation Scale. J Psychopathol Behav Assess. Mar 2004;26(1):41-54. [CrossRef]
  45. Miguel FK, Giromini L, Colombarolli MS, Zuanazzi AC, Zennaro A. A Brazilian investigation of the 36- and 16-item difficulties in emotion regulation scales. J Clin Psychol. Sep 2017;73(9):1146-1159. [CrossRef] [Medline]
  46. Cancian ACM, Souza LASD, Silva VHPE, Machado WDL, Oliveira MDS. Psychometric properties of the Brazilian version of the Difficulties in Emotion Regulation Scale (DERS). Trends Psychiatry Psychother. Mar 2019;41(1):18-26. [FREE Full text] [CrossRef] [Medline]
  47. Hill DB. Differences and similarities in men's and women's sexual self-schemas. J Sex Res. May 11, 2007;44(2):135-143. [CrossRef] [Medline]
  48. Lucena B. Fatores cognitivos na função sexual: adaptação transcultural e estudo psicométrico de instrumentos de medida em sexualidade [Doctoral thesis]. São Paulo, Brazil. University of São Paulo; 2019;1-124.
  49. Nobre PJ, Pinto-Gouveia J. Sexual modes questionnaire: measure to assess the interaction among cognitions, emotions, and sexual response. J Sex Res. Nov 11, 2003;40(4):368-382. [CrossRef] [Medline]
  50. Vlaescu G, Alasjö A, Miloff A, Carlbring P, Andersson G. Features and functionality of the Iterapi platform for internet-based psychological treatment. Internet Interv. Nov 2016;6:107-114. [FREE Full text] [CrossRef] [Medline]
  51. Kirana PS, Tripodi F, Reisman Y, Porst H. The EFS and ESSM Syllabus of Clinical Sexology. Amsterdam, the Netherlands. Medix; 2013.
  52. Barlow D, Farchione T, Sauer-Zavala S, Latin H, Ellard K, Bullis J. Unified Protocol for Transdiagnostic Treatment of Emotional Disorders: Therapist Guide. New York, NY. Oxford University Press; 2018.
  53. Berking M, Schwarz J. Affect Regulation Training: Handbook of Emotion Regulation. New York, NY. Springer; 2014.
  54. Berking M, Whitley R. Affect Regulation Training: A Practitioners Manual. New York, NY. Springer; 2014;A.
  55. Fritz CO, Morris PE, Richler JJ. Effect size estimates: current use, calculations, and interpretation. J Exp Psychol Gen. Feb 2012;141(1):2-18. [CrossRef] [Medline]
  56. Andrews G, Basu A, Cuijpers P, Craske M, McEvoy P, English C, et al. Computer therapy for the anxiety and depression disorders is effective, acceptable and practical health care: An updated meta-analysis. J Anxiety Disord. Apr 2018;55:70-78. [FREE Full text] [CrossRef] [Medline]
  57. Andersson G, Carlbring P, Titov N, Lindefors N. Internet interventions for adults with anxiety and mood disorders: a narrative umbrella review of recent meta-analyses. Can J Psychiatry. Jul 16, 2019;64(7):465-470. [FREE Full text] [CrossRef] [Medline]
  58. Díaz-García A, González-Robles A, García-Palacios A, Fernández-Álvarez J, Castilla D, Bretón JM, et al. Negative and positive affect regulation in a transdiagnostic internet-based protocol for emotional disorders: randomized controlled trial. J Med Internet Res. Feb 01, 2021;23(2):e21335. [FREE Full text] [CrossRef] [Medline]
  59. Meston CM, Buss DM. Why humans have sex. Arch Sex Behav. Aug 3, 2007;36(4):477-507. [CrossRef] [Medline]
  60. Brotto LA, Bitzer J, Laan E, Leiblum S, Luria M. Women's sexual desire and arousal disorders. J Sex Med. Jan 2010;7(1 Pt 2):586-614. [CrossRef] [Medline]
  61. Beck A. Beyond belief: A theory of modes, personality, and psychopathology. In: Frontiers of Cognitive Therapy. New York, NY. The Guilford Press; 1996;1-25.
  62. Nobre PJ, Pinto-Gouveia J. Cognitions, emotions, and sexual response: analysis of the relationship among automatic thoughts, emotional responses, and sexual arousal. Arch Sex Behav. Aug 25, 2008;37(4):652-661. [CrossRef] [Medline]
  63. McCabe MP, Price E. Attrition from an internet-based psychological intervention for erectile dysfunction: who is likely to drop out? J Sex Marital Ther. 2009;35(5):391-401. [CrossRef] [Medline]
  64. van DS, Sluijs E, van DL, de RD, Heerdink R, Bensing J. Patient adherence to medical treatment: a review of reviews. BMC Health Serv Res. 2007;7:55. [FREE Full text] [CrossRef] [Medline]
  65. Donkin L, Glozier N. Motivators and motivations to persist with online psychological interventions: a qualitative study of treatment completers. J Med Internet Res. Jun 2012;14(3):e91. [FREE Full text] [CrossRef] [Medline]
  66. Covid-19: casos sobem para 21,6 milhões e mortes, para 602 mil. Agencia Brasil. URL: https:/​/agenciabrasil.​ebc.com.br/​saude/​noticia/​2021-10/​covid-19-casos-sobem-para-2161-milhoes-e-mortes-para-602-mil [accessed 2022-12-02]
  67. Otufowora A, Liu Y, Young H, Egan KL, Varma DS, Striley CW, et al. Sex differences in willingness to participate in research based on study risk level among a community sample of African Americans in North Central Florida. J Immigr Minor Health. Feb 23, 2021;23(1):19-25. [FREE Full text] [CrossRef] [Medline]


ANOVA: analysis of variance
CBT: cognitive behavioral therapy
CONSORT: Consolidated Standards of Reporting Trials
DERS: Difficulties in Emotion Regulation Scale
ER: emotion regulation
FSFI: Female Sexual Function Index
GAD-7: Generalized Anxiety Disorder-7
IIEF: International Index Erectile Function
PHQ-9: Patient Heath Questionnaire-9
SHER: Sexual Health and Emotion Regulation
SMQ: Sexual Modes Questionnaire
SQ: Sexual Quotient
SQf: Sexual Quotient: female version
SSSS: Sexual Self-Schema Scale
TREPS: Emotion Regulation Training for Sexual Health (translated from Portuguese)


Edited by A Mavragani; submitted 15.08.23; peer-reviewed by M Bisby, M Schulmeyer; comments to author 20.10.23; revised version received 29.12.23; accepted 11.01.24; published 03.04.24.

Copyright

©Vinicius Jobim Fischer, Maila Rossato Holz, Joël Billieux, Gerhard Andersson, Claus Vögele. Originally published in JMIR Formative Research (https://formative.jmir.org), 03.04.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.