This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (2491) Telepsychiatry (164) Telehealth and Telemonitoring (1713) JMH Theme Issue: COVID-19 and Mental Health: Impact and Interventions (386) Digital Mental Health Interventions, e-Mental Health and Cyberpsychology (1565)

Published on in Vol 6, No 5 (2022): May

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/35535, first published .
Clinicians’ Attitudes Toward Telepsychology in Addiction and Mental Health Services, and Prediction of Postpandemic Telepsychology Uptake: Cross-sectional Study

Clinicians’ Attitudes Toward Telepsychology in Addiction and Mental Health Services, and Prediction of Postpandemic Telepsychology Uptake: Cross-sectional Study

Clinicians’ Attitudes Toward Telepsychology in Addiction and Mental Health Services, and Prediction of Postpandemic Telepsychology Uptake: Cross-sectional Study

Authors of this article:

Kristen Zentner1 Author Orcid Image ;   Graham Gaine1, 2, 3 Author Orcid Image ;   Paige Ethridge4 Author Orcid Image ;   Shireen Surood1 Author Orcid Image ;   Adam Abba-Aji3, 5 Author Orcid Image
Article Authors Cited by (5) Tweetations (2) Metrics

    Original Paper

    1Clinical Supports and Services, Addiction & Mental Health, Alberta Health Services, Edmonton, AB, Canada

    2Department of Educational Psychology, University of Alberta, Edmonton, AB, Canada

    3Department of Psychiatry, University of Alberta, Edmonton, AB, Canada

    4Department of Psychology, Glenrose Rehabilitation Hospital, Alberta Health Services, Edmonton, AB, Canada

    5Young Adult Assessment, Evaluation & Reintegration, Addiction and Mental Health, Alberta Health Services, Edmonton, AB, Canada

    Corresponding Author:

    Graham Gaine, PhD

    Clinical Supports and Services

    Addiction & Mental Health

    Alberta Health Services

    9942 108 St NW

    Edmonton, AB, T5K 2J5

    Canada

    Phone: 1 780 342 7726

    Email: graham.gaine@albertahealthservices.ca


    Background: The COVID-19 pandemic has resulted in unprecedented uptake of telepsychology services; however, clinicians have mixed attitudes toward virtual technologies.

    Objective: This study (1) explored clinicians’ experiences of and intentions to use video, telephone, and in-person services, and (2) tested the utility of the unified theory of acceptance and use of technology (UTAUT) to predict clinicians’ intentions to offer telepsychology after the COVID-19 pandemic.

    Methods: Clinician satisfaction and therapeutic alliance were compared across in-person, video, and telephone services, while technology attitudes and intention to use after the pandemic were compared across video and telephone services among 118 addiction and mental health clinicians during the COVID-19 pandemic.

    Results: Clinicians reported more positive experiences with in-person services than both virtual technologies; further, clinicians reported greater positive experiences, attitudes, and intentions to use video services than telephone services across measures. Based on the UTAUT, performance expectancy positively predicted concurrent intentions to use video services (β=0.46; P<.001) and telephone services (β=0.35; P<.001) after the pandemic. Social influence (β=0.24; P=.004) and facilitating conditions (β=0.19; P=.03) additionally predicted the intention to use telephone services.

    Conclusions: Clinicians rated in-person services more positively than virtual technologies, with video services perceived more positively than telephone services. Performance expectancy was the primary facilitator of the uptake of both virtual modalities.

    JMIR Form Res 2022;6(5):e35535

    doi:10.2196/35535

    Keywords

    mental health; telepsychology; clinician attitude; unified theory of acceptance and use of technology; therapeutic alliance 


    The COVID-19 pandemic has triggered an unprecedented shift toward virtual health care delivery [1]. Telepsychology is the provision of addiction and mental health (AMH) care from a physical distance and includes psychiatric evaluations, therapy, psychoeducation, and medication management [2]. While evidence supports the effectiveness of telepsychology [3-7], clinician hesitancy impedes uptake [5,8,9]. Because telepsychology is expected to play a continued role in service delivery after the pandemic [1,10,11], it is critical to understand clinicians’ perceptions of and attitudes toward telepsychology.

    A clinician’s experience with telepsychology may also contribute to uptake. Perceived weakened therapeutic alliance may be a contributor to poor uptake of telepsychology [4,5], with therapists perceiving poorer therapeutic alliance in virtual than in-person settings [12]. In contrast, client ratings of therapeutic alliance are comparable across virtual and in-person services [13-15]. Clinicians also remain divided in their satisfaction with telepsychology services [9,10,16,17].

    The unified theory of acceptance and use of technology (UTAUT) [18] predicts uptake of new technology into practice from the following 4 factors: (1) performance expectancy, the degree to which a technology is expected to improve performance; (2) effort expectancy, the user’s self-efficacy with the technology; (3) social influence, the perceived norms of technology use; and (4) facilitating conditions, including availability of training and technology fit [18-22]. The UTAUT is based on the theory of planned behavior, wherein attitudes predict intentions, which predict behavior [23]. While the postpandemic behavior of clinicians cannot yet be measured, their intention to use technology serves as a proxy.

    The utility of technology may vary considerably depending on whether the clinician is using telephone or videoconferencing. The literature offers comparisons of telepsychology (either telephone or video) [13,24] to in-person services, but few comparisons between telepsychology modalities. One meta-analysis indicated that videoconferencing was more effective than telephone for depression and posttraumatic stress disorder in veterans [25], yet a comparison between telepsychology modalities is a major gap in the literature.

    This study directly compared the experiences of different modalities (ie, in-person, telephone, and video) and further explored factors pertinent to the uptake of telephone- and video-based services in an AMH setting. Specifically, we predicted the following: (1) Clinicians would have the most positive experiences (ie, satisfaction and therapeutic alliance) with in-person sessions, followed by videoconferencing and then telephone; (2) Clinicians would have a greater intention to use videoconferencing than telephone after the pandemic; (3) Clinicians would have more positive technology attitudes toward video than telephone; and (4) Greater performance expectancy, effort expectancy, social influence, and facilitating conditions would predict greater clinician intentions to use virtual services after the pandemic.


    Ethics Approval

    This study was approved by the University of Alberta Health Research Ethics Board (Pro00114433).

    Procedures

    Secondary data were obtained from a virtual health program evaluation conducted from November 16 to December 21, 2020, using an online survey within the publicly funded AMH service in Alberta, Canada. Clinicians who provided services using both telephone and videoconferencing during the pandemic were included in the sample (n=118; see Table 1 for available sample characteristics). Included clinicians were in AMH practice for 13.7 years on average. They reported seeing 64.1% of their virtual clients previously in-person, with individual virtual sessions being the most frequent format (69.7%), followed by group (47.0%) and couple/family (25.4%) sessions.

    Table 1. Sociodemographic characteristics of participants.
    CharacteristicValue (N=118a), n (%)
    Clinician profession

    		Psychologist44 (37.3)

    		Social worker22 (18.6)

    		Nurse16 (13.6)

    		Occupational therapist7 (5.9)

    		Psychiatrist6 (5.1)

    		Other22 (18.6)
    Populations served (categories not mutually exclusive)

    		Children22 (18.6)

    		Adolescents32 (27.1)

    		Young adults39 (33.1)

    		Adults89 (75.4)

    		Older adults17 (14.4)

    		Families18 (15.3)
    Theoretical orientation

    		Cognitive behavioral42 (35.6)

    		Integrative/eclectic23 (19.5)

    		Existential/humanistic6 (5.1)

    		Interpersonal/systemic6 (5.1)

    		Other19 (16.1)
    Prior experience with telepsychologyb

    		Do not provide therapy22 (18.6)

    		Telephone70 (59.3)

    		Video21 (17.8)

    aOf the total 153 clinicians who completed the survey, 35 used only telephone and were excluded from the analysis to focus on the comparison between telephone and video.

    bClinicians who reported “some or quite a lot” were included in this frequency. The remaining participants reported “none or very little.”

    Measures

    Modifications to measures are displayed in Multimedia Appendix 1. Table S1 in Multimedia Appendix 1 provides the internal consistencies reported in previous literature and this study. The below measures were repeated across video, telephone, and in-person, where applicable.

    The Agnew Relationship Measure-5 (ARM-5) [26] assessed therapeutic alliance in virtual settings on a scale of 1 (strongly disagree) to 7 (strongly agree), and was modified to reflect perceived therapeutic alliance for telephone, video, and in-person sessions in general (ie, across sessions and clients).

    Clinicians rated their satisfaction with telephone, video, and in-person sessions on a custom scale of 1 (not at all satisfied) to 10 (very satisfied).

    Clinicians’ intentions to use technology after the pandemic were measured by the question, “Given the choice, I would offer telephone [video] sessions,” on a scale of 1 (strongly disagree) to 7 (strongly agree).

    The UTAUT-Therapist Version [22] assessed technology acceptance using 13 items based on the original UTAUT, on a scale of 1 (strongly disagree) to 5 (strongly agree), with subscales for performance expectancy, effort expectancy, social influence, and facilitating conditions.


    Differences Between Telephone and Video Services

    Normality assumptions were tested with the Shapiro-Wilk test, and outliers were assessed by boxplots for all analyses. Adjustments based on violated assumptions are described below.

    A one-way repeated measures analysis of variance (ANOVA) tested differences in therapeutic alliance among telephone, video, and in-person services. Epsilon (ε=0.850 [27]) adjusted for a violation of the sphericity assumption (χ22=22.359; P<.001). Therapeutic alliance was significantly different among modalities (F1.700, 197.163=46.67; P<.001; partial η2=0.287). Post-hoc analysis with a Bonferroni adjustment revealed that all pairwise differences between modalities were significant (P<.001), with in-person services having the greatest therapeutic alliance followed by video services and then telephone services (Table 2).

    Table 2. Clinicians’ attitudes toward telepsychology variables for in-person, video, and telephone services.
    VariableIn-person, mean (SD)Video, mean (SD)Telephone, mean (SD)Difference95% CI





    		LLaULb
    Satisfaction8.97 (1.22)7.12 (2.33)5.60 (2.54)



    		In-person/videoN/AcN/AN/A1.81d1.192.42

    		In-person/telephoneN/AN/AN/A3.36d2.694.02

    		Video/telephoneN/AN/AN/A1.55d0.922.18
    Therapeutic alliance6.09 (0.98)5.50 (1.05)5.18 (1.08)



    		In-person/videoN/AN/AN/A0.57d0.350.79

    		In-person/telephoneN/AN/AN/A0.91d0.641.19

    		Video/telephoneN/AN/AN/A0.34d0.150.54
    UTAUTe totalN/A3.46 (0.61)3.22 (0.56)−0.24d−0.36−0.13

    		Effort expectancyN/A3.45 (0.95)3.48 (0.76)−0.03−0.130.19

    		Performance expectancyN/A3.16 (0.78)2.82 (0.72)−0.33d−0.49−0.17

    		Social influenceN/A3.59 (0.64)3.18 (0.70)−0.41d−0.56−0.27

    		Facilitating conditionsN/A3.61 (0.68)3.40 (0.71)−0.21d−0.34−0.08
    Intention to useN/A4.59 (2.0)3.62 (2.1)−0.975d−1.332 −0.617

    aLL: lower limit.

    bUL: upper limit.

    cN/A: not applicable.

    dP<.001.

    eUTAUT: unified theory of acceptance and use of technology.

    A one-way repeated measures ANOVA tested differences between clinicians’ satisfaction with in-person, video, and telephone services. There were significant differences in clinician satisfaction across modalities (F2,228=82.32; P<.001; partial η2=0.419; Table 2). Post-hoc analysis with a Bonferroni adjustment revealed that all pairwise differences between modalities were significant (P<.001), with in-person services having the greatest satisfaction, followed by video services and then telephone services.

    A paired samples t test evaluated the difference between clinicians’ intentions to use video and telephone after the pandemic. Clinicians reported significantly greater intention to use video than telephone after the pandemic (t117=−5.393; P<.001; d=0.50; Table 2).

    A paired samples t test assessed the difference between UTAUT-T total scores for video and telephone. Clinicians reported significantly greater scores for video than telephone (t117=−4.200; P<.001; d=0.39). Paired samples t tests revealed significant differences in each of the UTAUT predictors in favor of video (P≤.001), except effort expectancy (P=.75) (Table 2).

    UTAUT Prediction of the Intention to Use

    A multiple regression was performed to predict the intention to use video, with concurrent performance expectancy, effort expectancy, social inclusion, and facilitating conditions. The model significantly predicted the intention to use video (F4,113=14.072; P<.001; adjusted R2=0.31). Performance expectancy was the only unique predictor (P<.001) (Table 3).

    A multiple regression was performed to predict the intention to use telephone, with concurrent UTAUT factors. The model significantly predicted the intention to use telephone (F4,113=24.348; P<.001; adjusted R2=0.44). Performance expectancy (P<.001), social influence (P=.004), and facilitating conditions (P=.03) were unique predictors (Table 4).

    Table 3. Multiple regression results for the intention to use video after the pandemic.
    VariableBaSE Bb95% CI for BβeR2fΔR2g



    		LLcULd


    ModelhN/AiN/AN/AN/AN/A0.580.31j
    Constant−0.771.007−2.771.23N/AN/AN/A
    Performance expectancy1.16j0.250.661.70.46jN/AN/A
    Effort expectancy0.310.25−0.180.800.15N/AN/A
    Social influence0.280.27−0.260.820.09N/AN/A
    Facilitating conditions−0.100.35−0.790.59−0.04N/AN/A

    aB: unstandardized regression coefficient.

    bSE B: standard error of the coefficient.

    cLL: lower limit.

    dUL: upper limit.

    eβ: standardized coefficient.

    fR2: coefficient of determination.

    gΔR2: adjusted R2.

    hModel: “Enter” method in SPSS Statistics.

    iN/A: not applicable.

    jP<.001.

    Table 4. Multiple regression results for the intention to use telephone after the pandemic.
    VariableBaSE Bb95% CI for BβeR2fΔR2g



    		LLcULd


    ModelhN/AiN/AN/AN/AN/A0.460.44j
    Constant−4.420.88−6.16−2.67N/AN/AN/A
    Performance expectancy1.02j0.250.511.520.35jN/AN/A
    Effort expectancy0.260.24−0.210.740.09N/AN/A
    Social influence0.73k0.250.241.230.24kN/AN/A
    Facilitating conditions0.57l0.250.061.070.19lN/AN/A

    aB: unstandardized regression coefficient.

    bSE B: standard error of the coefficient.

    cLL: lower limit.

    dUL: upper limit.

    eβ: standardized coefficient.

    fR2: coefficient of determination.

    gΔR2: adjusted R2.

    hModel: “Enter” method in SPSS Statistics.

    iN/A: not applicable.

    jP<.001.

    kP=.004.

    lP=.03.


    This study explored the differences in clinicians’ perceptions of in-person, video, and telephone services, and the prediction of the intention to use telepsychology after the pandemic. As hypothesized, clinicians had more positive experiences with in-person services, followed by video services and then telephone services across measures. Additionally, clinicians reported greater intention to continue using video services over telephone services. These findings suggest that the perceived utility of technologies varies in AMH care [25], and the merits of and attitudes toward each require consideration when integrating them into routine practice.

    Consistent with previous work, this study demonstrated the utility of the UTAUT for predicting the intention to use telephone and video technologies [12,16,22,24]. Specifically, performance expectancy was predictive of the intention to use both video and telephone services, while social influence and facilitating conditions were additionally predictive of the intention to use telephone services. Because telephone services are so different from in-person services (ie, no visual information), the intention to use may be related to how well it fits for a particular service (eg, medication refills [28]) and how much it is supported by the clinician’s profession. Thus, facilitating conditions and social influence may be more relevant to the uptake of telephone services than video services.

    The limitations of this study include its cross-sectional design, which prevents causal conclusions. Further, clinicians’ intentions to use telepsychology are a proxy for actual postpandemic technology use. In addition, the study’s small self-selected sample of public AMH clinicians, with underrepresentation of some professions and service settings, limits the generalizability of the findings. For example, our sample did not include urgent settings, where virtual care may present additional challenges [29]. While this study did not include private practitioners, its focus on public health is unique, compared with previous studies focusing primarily on private practice [1,12,16].

    In this study, clinicians reported consistently more positive experiences with video services than telephone services, suggesting that the uptake of videoconferencing will face fewer barriers than telephone; however, an overall preference for in-person sessions may result in a return to prepandemic practices. For some clinicians, misgivings about videoconferencing may stem from low performance expectancy. Education on the establishment of a strong therapeutic alliance and the effectiveness of video-based care could decrease clinician hesitancy [3,6,7,30]. Regarding telephone uptake, improved facilitating conditions, such as training, and positive social influence (ie, promotion) may aid uptake. Exploration of how clinicians’ demographic characteristics (eg, age, gender, and prior experience) relate to telepsychology uptake would clarify necessary training or support. For example, those with minimal prior experience may require greater support [24]. In conclusion, while there has been a practice shift to telepsychology during the COVID-19 pandemic, AMH clinicians will likely require ongoing support to maintain this practice change.

    Acknowledgments

    This study was made possible by the support of Addiction and Mental Health, Edmonton Zone, Alberta Health Services, and Janssen Inc.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Measure customization and reliability coefficients.

    DOCX File , 18 KB
    1. Pierce BS, Perrin PB, Tyler CM, McKee GB, Watson JD. The COVID-19 telepsychology revolution: A national study of pandemic-based changes in U.S. mental health care delivery. Am Psychol 2021 Jan;76(1):14-25. [CrossRef] [Medline]
    2. Joint Task Force for the Development of Telepsychology Guidelines for Psychologists. Guidelines for the practice of telepsychology. Am Psychol 2013 Dec;68(9):791-800. [CrossRef] [Medline]
    3. Backhaus A, Agha Z, Maglione ML, Repp A, Ross B, Zuest D, et al. Videoconferencing psychotherapy: a systematic review. Psychol Serv 2012 May;9(2):111-131. [CrossRef] [Medline]
    4. Berger T. The therapeutic alliance in internet interventions: A narrative review and suggestions for future research. Psychother Res 2017 Sep;27(5):511-524. [CrossRef] [Medline]
    5. Simpson SG, Reid CL. Therapeutic alliance in videoconferencing psychotherapy: a review. Aust J Rural Health 2014 Dec;22(6):280-299. [CrossRef] [Medline]
    6. Hilty DM, Ferrer DC, Parish MB, Johnston B, Callahan EJ, Yellowlees PM. The effectiveness of telemental health: a 2013 review. Telemed J E Health 2013 Jun;19(6):444-454 [FREE Full text] [CrossRef] [Medline]
    7. Varker T, Brand RM, Ward J, Terhaag S, Phelps A. Efficacy of synchronous telepsychology interventions for people with anxiety, depression, posttraumatic stress disorder, and adjustment disorder: A rapid evidence assessment. Psychol Serv 2019 Nov;16(4):621-635. [CrossRef] [Medline]
    8. Pierce BS, Perrin PB, McDonald SD. Pre-COVID-19 deterrents to practicing with videoconferencing telepsychology among psychologists who didn't. Psychol Serv 2022 Feb;19(1):157-166. [CrossRef] [Medline]
    9. Sammons MT, VandenBos GR, Martin JN. Psychological Practice and the COVID-19 Crisis: A Rapid Response Survey. J Health Serv Psychol 2020;46(2):51-57 [FREE Full text] [CrossRef] [Medline]
    10. Gentry MT, Puspitasari AJ, McKean AJ, Williams MD, Breitinger S, Geske JR, et al. Clinician Satisfaction with Rapid Adoption and Implementation of Telehealth Services During the COVID-19 Pandemic. Telemed J E Health 2021 Dec 19;27(12):1385-1392. [CrossRef] [Medline]
    11. Pierce BS, Perrin PB, McDonald SD. Path analytic modeling of psychologists' openness to performing clinical work with telepsychology: A national study. J Clin Psychol 2020 Jun;76(6):1135-1150. [CrossRef] [Medline]
    12. Békés V, Aafjes-van Doorn K, Zilcha-Mano S, Prout T, Hoffman L. Psychotherapists' acceptance of telepsychotherapy during the COVID-19 pandemic: A machine learning approach. Clin Psychol Psychother 2021 Nov;28(6):1403-1415 [FREE Full text] [CrossRef] [Medline]
    13. Irvine A, Drew P, Bower P, Brooks H, Gellatly J, Armitage CJ, et al. Are there interactional differences between telephone and face-to-face psychological therapy? A systematic review of comparative studies. J Affect Disord 2020 Mar 15;265:120-131 [FREE Full text] [CrossRef] [Medline]
    14. Reese R, Mecham M, Vasilj I, Lengerich A, Brown H, Simpson N, et al. The effects of telepsychology format on empathic accuracy and the therapeutic alliance: An analogue counselling session. Couns. Psychother. Res 2016 Oct 06;16(4):256-265. [CrossRef]
    15. Richards D, Viganó N. Online counseling: a narrative and critical review of the literature. J Clin Psychol 2013 Sep;69(9):994-1011. [CrossRef] [Medline]
    16. Békés V, Aafjes-van Doorn K. Psychotherapists’ attitudes toward online therapy during the COVID-19 pandemic. Journal of Psychotherapy Integration 2020 Jun;30(2):238-247 [FREE Full text] [CrossRef]
    17. Wray B, Rees C. Is there a role for videoconferencing in cognitive behavioural therapy? 2003 Presented at: 11th Australian Association for Cognitive and Behaviour Therapy State Conference; 2003; Perth, WA, Australia.
    18. Venkatesh V, Morris M, Davis G, Davis F. User Acceptance of Information Technology: Toward a Unified View. MIS Quarterly 2003;27(3):425. [CrossRef]
    19. Davis FD. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 1989 Sep;13(3):319. [CrossRef]
    20. Gamble N, Boyle C, Morris ZA. Ethical Practice in Telepsychology. Australian Psychologist 2020 Nov 12;50(4):292-298. [CrossRef]
    21. Perry K, Gold S, Shearer EM. Identifying and addressing mental health providers' perceived barriers to clinical video telehealth utilization. J Clin Psychol 2020 Jun 11;76(6):1125-1134. [CrossRef] [Medline]
    22. Békés V, Aafjes-van Doorn K, McCollum J, Prout TR, Hoffman L. The development of a self-report scale to assess therapists' acceptance of telepsychotherapy. J Clin Psychol 2021 Dec 13:23289. [CrossRef] [Medline]
    23. Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes 1991 Dec;50(2):179-211. [CrossRef]
    24. Connolly SL, Miller CJ, Lindsay JA, Bauer MS. A systematic review of providers’ attitudes toward telemental health via videoconferencing. Clinical Psychology: Science and Practice 2020 Jun 06;27(2):e12311. [CrossRef]
    25. McClellan MJ, Osbaldiston R, Wu R, Yeager R, Monroe AD, McQueen T, et al. The effectiveness of telepsychology with veterans: A meta-analysis of services delivered by videoconference and phone. Psychol Serv 2021 Feb 04:522. [CrossRef] [Medline]
    26. Cahill J, Stiles WB, Barkham M, Hardy GE, Stone G, Agnew-Davies R, et al. Two short forms of the Agnew Relationship Measure: the ARM-5 and ARM-12. Psychother Res 2012;22(3):241-255. [CrossRef] [Medline]
    27. Greenhouse SW, Geisser S. On methods in the analysis of profile data. Psychometrika 1959 Jun;24(2):95-112. [CrossRef]
    28. Probst T, Haid B, Schimböck W, Reisinger A, Gasser M, Eichberger-Heckmann H, et al. Therapeutic interventions in in-person and remote psychotherapy: Survey with psychotherapists and patients experiencing in-person and remote psychotherapy during COVID-19. Clin Psychol Psychother 2021 Jul;28(4):988-1000 [FREE Full text] [CrossRef] [Medline]
    29. Madigan S, Racine N, Cooke JE, Korczak DJ. COVID-19 and telemental health: Benefits, challenges, and future directions. Canadian Psychology/Psychologie canadienne 2021 Feb 26;62(1):5-11. [CrossRef]
    30. Rees CS, Stone S. Therapeutic Alliance in Face-to-Face Versus Videoconferenced Psychotherapy. Professional Psychology: Research and Practice 2005 Dec;36(6):649-653. [CrossRef]

    ‎
    AMH: addiction and mental health
    ANOVA: analysis of variance
    UTAUT: unified theory of acceptance and use of technology

    Edited by A Mavragani; submitted 08.12.21; peer-reviewed by V Bekes, M Feijt, X Luo; comments to author 07.02.22; revised version received 22.03.22; accepted 12.04.22; published 13.05.22

    Copyright

    ©Kristen Zentner, Graham Gaine, Paige Ethridge, Shireen Surood, Adam Abba-Aji. Originally published in JMIR Formative Research (https://formative.jmir.org), 13.05.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.