Published on in Vol 8 (2024)

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/53668, first published .
Cancer Care Supportive Text Messaging Program (Text4Hope) for People Living With Cancer and Their Caregivers During the COVID-19 Pandemic: Longitudinal Observational Study

Cancer Care Supportive Text Messaging Program (Text4Hope) for People Living With Cancer and Their Caregivers During the COVID-19 Pandemic: Longitudinal Observational Study

Cancer Care Supportive Text Messaging Program (Text4Hope) for People Living With Cancer and Their Caregivers During the COVID-19 Pandemic: Longitudinal Observational Study

Original Paper

1Department of Psychiatry, University of Alberta, Edmonton, AB, Canada

2Alberta Health Services, Addiction & Mental Health, Edmonton, Canada, Edmonton, AB, Canada

3Department of Psychiatry, Dalhousie University, Halifax, NS, Canada

Corresponding Author:

Vincent Agyapong, MD, PhD

Department of Psychiatry

Dalhousie University

5909 Veterans Memorial Lane, 8th Floor Abbie J Lane Memorial Building

QEII Health Sciences Centre

Halifax, NS, B3H 2E2

Canada

Phone: 1 7802157771

Fax:1 9024734887

Email: vn602367@dal.ca


Background: Cancer is the leading cause of death in Canada, and living with cancer generates psychological demands, including depression and anxiety among cancer survivors and caregivers. Text4Hope-Cancer Care SMS text messaging–based service was provided to people with cancer and caregivers during the COVID-19 pandemic to support their mental health.

Objective: The aim of this study is to examine the clinical effectiveness of and satisfaction with Text4Hope-Cancer Care in addressing mental health conditions among people living with cancer and caregivers.

Methods: The study was conducted in Alberta, Canada. People who were diagnosed or receiving cancer treatment and caregivers self-subscribed to receive 3-months daily supportive cognitive behavioral therapy–based SMS text messages and a web-based survey was sent at designated time points to collect clinical and nonclinical data. The Hospital Anxiety and Depression scale (HADS) was used to examine changes in anxiety and depression symptoms after receiving the service. Satisfaction with the service was assessed using a survey with a Likert scale. Descriptive and inferential statistics were used, and test significance was considered with P≤.05.

Results: Overall, 107 individuals subscribed to the service, and 93 completed the program (completion rate 93/107, 86.9%). A significant improvement in the anxiety symptoms (HADS-Anxiety [HADS-A] subscale) was reported after 3 months of Text4Hope-Cancer Care (t11=2.62; P=.02), with medium effect size (Hedges g=0.7), but not depression symptoms (HADS-Depression [HADS-D] subscale). Subscribers expressed high satisfaction and agreed that the service has helped them to cope with mental health symptoms and improve their quality of life. Most subscribers read the SMS text messages more than once (30/30, 100%); took time to reflect or took a beneficial action after reading the messages (27/30, 90%); and highly agreed (27/30, >80%) with the value of the received supportive SMS text messages as being relevant, succinct, affirmative, and positive. All subscribers recommended SMS text messaging for stress, anxiety, and depression and for cancer care support (30/30, 100%).

Conclusions: Text4Hope-Cancer Care was well-perceived and effectively addressed anxiety symptoms among people living with cancer and caregivers during the peak of the COVID-19 pandemic. This study provides evidence-based support and insight for policy and stakeholders to implement similar convenient, economic, and accessible mental health services that support vulnerable populations during crises.

International Registered Report Identifier (IRRID): RR2-10.2196/20240

JMIR Form Res 2024;8:e53668

doi:10.2196/53668

Keywords



Cancer is the leading cause of death and is responsible for 28.2% of all deaths in Canada [1]. The disease mostly affects Canadians aged 50 years and older, but it can occur at any age [1]. In 2018, 1.5 million Canadians were living with or survived cancer [1,2]. However, newly diagnosed cases are projected to increase by 40% between 2015 and 2030 [1].

Living with cancer generates ongoing psychological demands that impose a heavy toll on patients and caregivers (a person who takes care of a patient with cancer) [3]. Depression and anxiety are common mental health conditions among cancer survivors, with nearly 30% reporting clinical symptoms of depression and 40% for anxiety [4,5]. These numbers vary according to different types of cancers [4,5]. Similar results were found for caregivers, where about 1 in 2 experienced symptoms of depression and anxiety. These rates may be as high as 65% and 91% for mothers of children living with cancer [3,6].

Cancer survivors often report depression and anxiety symptoms, including the fear of the recurrence of cancer, low emotional support, social isolation, and feeling lonely or abandoned after the intensive support during the phase of the treatment [4,7-9]. Depression and anxiety symptoms negatively impact the health of cancer survivors and caregivers by eroding quality of life, decreasing treatment compliance, and increasing the risk of morbidity and mortality [4,8,10].

Several interventions have been proposed to address psychological symptoms among cancer survivors and caregivers. These interventions can include educational, cognitive, or mindfulness-based therapies which are effective in addressing mental health symptoms [11,12]. However, these interventions (eg, in-person or facilitated by trained personnel) can be costly and time-consuming when compared to mobile-based interventions (eg, internet-based cognitive behavioral therapy (iCBT) or SMS text messages) that do not require a specialist facilitator [10,13,14].

Furthermore, a major body of literature suggests that remotely delivered interventions are impactful and effective in improving mental health compared to face-to-face services [15,16]. Web-based resources have been embraced as potential solutions that can cross the likely gap between evidence-based therapies and community practice, the gap which has thrived by stigma, underrecognition of psychological symptoms and lack of trained professionals [15,17,18].

SMS text messaging has demonstrated effectiveness in the treatment and prevention of mental disorders among diverse populations [19-22]. SMS text messaging services such as Text4Support effectively reduced the risk of harm to self and other harm symptoms after 6 months of intervention in a randomized controlled trial [23] and improved distress, anxiety, and depression in clinical samples [24]. Similarly, the Text4PTSI program has achieved fidelity and significantly reduced psychological distress among public safety personnel post intervention [25,26]. SMS text message–based population-level messaging programs have reported user satisfaction rates of well over 80%, and most subscribers have reported feeling connected to support systems and improving their ability to manage anxiety, depression, and general life issues, suggesting an improvement in mental health literacy [15,27-29].

In this project, Text4Hope-Cancer Care SMS text message–based service was provided to people living with cancer and caregivers during the COVID-19 pandemic. The service aimed to support their mental health by providing a daily supportive SMS text message based on cognitive behavioral therapy (CBT) principles. The service is designed to reduce stress, anxiety, and depression symptoms associated with the pandemic among this vulnerable population. In this project, we report the results of the Text4Hope-Cancer Care program regarding its clinical effectiveness in addressing mental health conditions and the satisfaction among people living with cancer and caregivers 3 months after receiving the service.


Study Design and Setting

The study was conducted in Alberta, Canada, where patients diagnosed or receiving cancer treatment and caregivers were eligible to self-subscribe to receive a daily supportive SMS text message for 3 months. The messages were crafted with a CBT framework and were developed by a clinical psychologist, and then reviewed and revised by a multidisciplinary team of psychiatrists, mental health therapists, and counselors who work with patients with cancer and caregivers (Text4Hope-Cancer Care is part of the primary Text4Hope service, which was introduced to support the mental health of the general public during the COVID-19 pandemic among Albertans [30]).

Examples of the Text4Hope-Cancer Care messages are (1) do things you enjoy—these activities can remind you who you are and take your mind off cancer for a while; (2) advocate for your needs using assertiveness—assertiveness is being respectful to you and the other person. Be direct, nonaggressive, and specific; and (3) cancer affects the whole family—to help you and your family cope, try to maximize quality time together, communicate, and create a schedule together.

Ethical Considerations

Participation in the program was voluntary, and completion of the survey did not preclude receipt of subsequent supportive SMS text messages. Subscribers could opt out of the service at any time, and no incentives or inducements for participating in the program were offered. Further details of the methodology are described in the study protocol [31]. The study was conducted according to the guidelines of the Declaration of Helsinki. Ethics approval has been granted by the University of Alberta Health Research Ethics Board (Pro00086163).

Data Collection

Data collection was run at baseline, 6 weeks, and 3 months, and subscribers were invited to complete these surveys via a link embedded in the received SMS text message at the designated time points. Survey questions were programmed into Select Survey, a web-based survey tool [31].

Overall, 107 subscribers participated in Text4Hope-Cancer Care program during the period between March 19, 2020, and December 19, 2022, and 14 subscribers opted out of the service (14/107, 13.1%), leaving 93 who completed the service (program completion rate of 93/107, 86.9%). From Figure 1, 49 subscribers responded to the surveys across all study time points, yielding a response rate of (49/107, 45.8%). There were a total of 65 eligible surveys received (35 at baseline and 30 at follow-up time points 6 weeks and 3 months), and only 12 subscribers have completed both the baseline and follow-up surveys. Survey questions were designed based on study objectives and available evidence from peer-reviewed literature [28,29]. The survey consisted predominantly of categorical items with Likert-scale responses and few continuously rated items. The items included sociodemographic characteristics such as gender, age, ethnic background, educational level, relationship status, employment status, and housing condition; and COVID-19–related data, such as self-isolation or quarantine due to the pandemic and perspectives regarding the likelihood of contracting COVID-19. The survey additionally included items related to cancer conditions, such as the duration of cancer diagnosis, treatment received for cancer therapy, and treatment postponed due to the COVID-19 pandemic for the participants and the loved ones who were diagnosed with cancer, if any. Clinical and service satisfaction data were also collected.

Figure 1. Study flowchart.

Outcome Measures

Hospital Anxiety and Depression Scale

To assess the effectiveness of the Text4Hope-Cancer Care service, the Hospital Anxiety and Depression Scale (HADS) was used and presented with the 2 subscales HADS-Depression (HADS-D) and HADS-Anxiety (HADS-A) [32]. Each HADS subscale contains 7 items; each item has 4 responses with an ordinal score from 0 to 3 and a total score between 0 and 21 in each subscale, with higher scores denoting higher levels of anxious or depressive state [33]. Some items have reversed responses (ie, from 3 to 0 [3 items for HADS-D and 5 items for HADS-A]). The scale reports how participants felt and behaved during the past week [33]. Since the scale is devoid of items related to somatic symptoms or symptoms of severe psychiatric illness, it was designed to detect the common mental disorders of depression and anxiety in the adult population attending medical (nonpsychiatric) outpatient clinics [33-35]. A total score of 0-7 is considered normal, 8-10 is considered borderline abnormal (borderline case), and 11-21 is considered abnormal (case) [32].

Based on previous studies, the sensitivity and specificity of approximately (0.80) were achieved when a cutoff score of 8 or above was used to define caseness (defined as the possible and probable anxiety disorders and depression among patients in nonpsychiatric hospital clinics [32]), on both HADS-A and HADS-D subscales [34]. Cronbach α for HADS-A was 0.83 (ranging from 0.68 to 0.93), and for HADS-D was 0.82 (ranging from 0.67 to 0.90), and the correlation between the 2 subscales was 0.56 [34]. For this study, the mean scores of HADS subscales were used to detect the differences between the study groups and also to trace changes over time.

Satisfaction Measures

A satisfaction questionnaire was provided to collect data related to the dimensions of the study. The dimensions considered included acceptability of the service (subscriber satisfaction or experience), appropriateness (subscriber feedback related to how helpful the daily messages have been in relation to their mental health and cancer diagnosis during the COVID-19 pandemic), and subscribers’ opinion about the use of technology-based services as part of health care during crises times.

Sample Size Calculation

Using a web-based script [36], we estimated that the sample size needed to assess the effects of the daily supportive SMS text messages among patients with cancer and caregivers on the outcome variables would be 34 with a projection that the effect size for the reduction in mean HADS-D and HADS-A scores at 3 months from baseline would be 0.2, a population variance of 1.0 for each subscale mean score, a 2-sided significance level α=.05, and a power of 80% (β=.2).

Statistical Analysis

Descriptive statistics were performed, and chi-square or Fisher exact tests were used to define the distribution of categorical sociodemographic and cancer-related factors against 2 groups of subscribers. The first group (completers) refers to those who completed baseline and follow-up surveys, while the second group (noncompleters) refers to those who responded only to 1 survey. A post hoc analysis was run for the categorical variables with more than 2 response options when it showed a significant association, using adjusted residuals and z score test. A corrected P value was reported on this occasion (P value × number of comparisons). An independent 2-tailed t test was used to compare the continuous data of baseline mean scores of HADS subscales between the completers and noncompleters.

To examine the changes before and after receiving Text4Hope-Cancer Care SMS text messages for the completers group, a paired t test was used to find the difference in the mean scores of anxiety and depression HADS subscales from baseline to follow-up time points. Imputation of the missing data was applied using the Last Observation Carried Forward method, that is, the last observation (6 weeks) was carried forward (imputed) when the latest response (3 months) was missing [37]. Due to the small sample size of the completers (<20), Hedges g effect size was reported when the result showed significance.

For the satisfaction data, descriptive analysis was run with frequency and percentage for reporting data, using bar graphs. SPSS (version 28; IBM Corp) [38] was used to perform the statistical analysis and statistical test significance was considered with P≤.05.


Text4Hope-Cancer Care Subscription Information

At baseline, subscribers were asked (multiple response questions) about their source of knowledge about the Text4Hope-Cancer Care service. The majority heard about the service from a website, such as Alberta Health Services or Mental Health Foundation websites (13/35, 37.1%), followed by social media platforms, such as Facebook and Instagram (Meta Platforms; 7/35, 20.1%). The news (eg, newspaper, web-based articles, and television), advice from a health care professional, and word of mouth (eg, family, friend, and coworker) were equally reported by the subscribers (5/35, 14.3%) each. Other sources such as employers, posters, and public libraries were also reported.

Baseline and Sociodemographic Characteristics

Table 1 presents the results of sociodemographic, cancer-related, and clinical characteristics of the study sample. From the table, (16/48, 33.3%) of the participants were between 50 and 59 years inclusive. Participants were predominantly females (42/48, 87.5%), White (47/48, 97.9%), had attained postsecondary education (40/44, 90.9%), were in a relationship (35/44, 79.5%), had employment (25/44, 56.8%), and owned their homes (30/44, 68.2%).

Regarding COVID-19–related questions, nearly a third of the subscribers reported needing to self-isolate or quarantine during the pandemic (15/48, 31.3%). The majority were neutral regarding the likelihood that they will contract COVID-19 (16/35, 45.7%); however, compared to someone who has not been diagnosed with cancer and is not receiving treatment for cancer, half of the subscribers reported that they would more likely contract COVID-19 (9/18, 50%).

Regarding cancer-related data, there were 18 cancer cases and 17 caregivers responded to the survey at baseline. The duration of having a diagnosis of cancer was majorly split between less than 6 months, and 1 year or more duration (7/18, 38.9%), each. In terms of the received treatment for cancer, the highest proportions were reported for surgery (10/18, 55.6%) and chemotherapy (9/18, 50.0%). Having cancer treatment or surgery postponed due to the COVID-19 pandemic was reported by a few participants (3/18, 16.7%).

In terms of the questions related to the loved ones of the participants, most participants reported having had 3 or more loved ones diagnosed with cancer and received treatment for cancer (9/16, 56.3%); having a loved one passed away due to cancer (14/17, 82.4%); mostly were a partner or a parent (6/17, 35.3%, each); the loved one was diagnosed with cancer for 1 year or more (10/17, 58.8%); having had received either surgery and chemotherapy (6/17, 35.3%), each; and the majority reported having their loved ones’ cancer treatment or surgery postponed due to the COVID-19 pandemic (15/17, 88.2%).

Table 1. Distribution of the characteristics of the participants who responded to baseline and follow surveys (completers) and the participants who responded to only 1 survey (noncompleters).
VariableCompleters (n=12)Noncompleters (n=37)Total (N=49)Chi-square (df)/t test (df)P value
Age (years), n (%)aa.12

<400 (0)10 (28)10 (21)


40-494 (33)5 (14)9 (19)


50-595 (42)11 (31)16 (33)


≥603 (25)10 (28)13 (27)

Sex, n (%)a.99

Male1 (8)5 (14)6 (13)


Female11 (92)31 (86)42 (88)

Ethnicity, n (%)a.99

White12 (100)35 (97)47 (98)


Asian0 (0)1 (3)1 (2)

Education level, n (%)a.74

Less than high school0 (0)2 (6)2 (5)


High school diploma1 (8)1 (3)2 (5)


Postsecondary education11 (92)29 (91)40 (91)

Relationship status, n (%)0.2 (1).70

In a relationship10 (83)25 (78)35 (80)


Not in a relationship2 (17)7 (22)9 (21)

Employment status, n (%)1.5 (1).21

Employed5 (42)20 (63)25 (57)


Unemployed7 (58)12 (38)19 (43)

Housing status, n (%)a.77

Own a home8 (67)22 (69)30 (68)


Renting3 (25)5 (16)8 (18)


Living with family1 (8)5 (16)6 (14)

COVID-19 related questions, n (%)

Self-isolate or self-quarantine due to COVID-19 symptoms, recent travel, or because being in contact with someone who may have COVID-190.3 (1).59


No9 (75)24 (67)33 (69)



Yes3 (25)12 (33)15 (31)


Subscribers’ perspective regarding the likelihood that they will contract COVID-19a.53


Likely1 (8)6 (26)7 (20)



Unlikely5 (42)7 (30)12 (34)



Neutral6 (50)10 (44)16 (46)


Subscribers’ perspective regarding the likelihood that they will contract COVID-19 compared to someone who has not been diagnosed with cancer and is not receiving treatment for cancera.51


More likely3 (43)6 (55)9 (50)



As likely4 (57)3 (27)7 (39)



Less likely0 (0)2 (18)2 (11)

Cancer-related questions reported at baseline (12 completers and 23 noncompleters)

Type of subscribers, n (%)0.4 (1).56


Patients with cancer7 (58)11 (48)18 (51)



Caregivers5 (42)12 (52)17 (49)


Duration of the diagnosis with cancer, n (%)a.85


Less than 6 months ago2 (29)5 (46)7 (39)



6 months to less than 1 year ago2 (29)2 (18)4 (22)



1 year or more3 (43)4 (36)7 (39)


Cancer treatment receivedb, n (%)


Chemotherapy6 (86)3 (27)9 (50)a.049


Hormone therapy2 (29)0 (0)2 (11)a.14


Immunotherapy0 (0)0 (0)0 (0)N/AcN/A


Radiation therapy3 (43)4 (36)7 (39)a.99


Stem cell therapy0 (0)0 (0)0 (0)N/AN/A


Surgery4 (57)6 (55)10 (56)a.99


Targeted therapy2 (29)0 (0)2 (11)a.14


None0 (0)4 (36)4 (22)a.12

Having cancer treatment or surgery postponed due to the COVID-19 pandemic, n (%)a.99


Yes1 (14)2 (18)3 (17)



No5 (71)8 (73)13 (72)



Not applicable1 (14)1 (9)2 (11)


Total number of loved ones who have been diagnosed with cancer and received treatment for cancer, n (%)a.55


1-22 (67)5 (39)7 (44)



≥31 (33)8 (62)9 (56)


Having a loved one passed away due to cancer, n (%)a.99


No1 (25)2 (15)3 (18)



Yes3 (75)11 (85)14 (82)


Loved one diagnosed with cancer, n (%)a.047


Partner0 (0)6 (46)6 (35)



Parent1 (25)5 (39)6 (35)



Friend1 (25)2 (15)3 (18)



Child2 (50)0 (0)2 (12)


When was your loved one diagnosed with cancer? n (%)a.41


Less than 6 months ago1 (25)5 (39)6 (35)



6 months to less than 1 year ago1 (25)0 (0)1 (6)



1 year or more2 (50)8 (62)10 (59)


Cancer treatment received by the loved one, n (%)


Chemotherapy3 (60)3 (25)6 (35)a.28


Hormone therapy0 (0)3 (25)3 (9)a.52


Immunotherapy0 (0)1 (8)1 (6)a.99


Radiation therapy2 (40)0 (0)2 (12)a.07


Surgery3 (60)2 (17)5 (29)a.12


Targeted therapy0 (0)1 (8)1 (6)a.99


Do not know0 (0)1 (8)1 (6)a.99

Loved one having cancer treatment or surgery postponed due to the COVID-19 pandemic, n (%)a.99


Yes4 (100)11 (85)15 (88)



No0 (0)2 (15)2 (12)


Baseline HADS scores (12 completers and 21 noncompleters), mean (SD)


HADS-Dd8.83 (5.57)9.00 (5.35)N/A0.1 (31).93


HADS-Ae12.00 (4.90)12.48 (4.68)N/A0.3 (31).78

aa: Fisher exact test.

bMultiple response questions with reported relative frequency.

cN/A: not applicable.

dHADS-D: depression subscale of the Hospital Depression and Anxiety scale.

eHADS-A: anxiety subscale of the Hospital Depression and Anxiety scale.

Regarding group differences, only 2 questions from above showed significant differences between completers and noncompleters. A significantly higher proportion of completers reported receiving chemotherapy (6/12, 85.7%) compared to noncompleters (3/23, 27.3%; P=.049). Similarly, there was a significant difference regarding the loved ones who were diagnosed with cancer (P=.047). Post hoc analysis revealed that the proportion of the participants who had a child diagnosed with cancer who completed 2 (50%) surveys was significantly more than expected when compared to those who completed only 1 (0%) survey among the same group (z score=2.7; adjusted P=.03).

Regarding the clinical assessment, the independent t test revealed no significant difference between completers and noncompleters at their baseline scores of HADS-D (t31=0.09; P=.93) and HADS-A (t31= 0.28; P=.78) subscales.

Clinical Outcome Results

Table 2 shows the changes in the mean scores of the primary outcome measure subscales, HADS-D and HADS-A, after 3 months from the baseline for participants who completed both the baseline and other follow-up surveys (completers). As illustrated in Table 2, the participants recorded lower mean scores on both HADS-D and HADS-A subscales at follow-up compared to their mean scores at baseline. However, only the HADS-A subscale was statistically significant (t11=2.62; P=.02), with a medium effect size (Hedges g=0.7).

Table 2. Changes of the mean scores of HADS-Da and HADS-Ab subscales after the introduction of Text4Hope cancer care.
MeasureScores (n=12)Change from baseline, n (%)Mean difference (95% CI)P valuet test (df)Effect size (Hedges g)

Baseline score, mean (SD)Follow-up, mean (SD)




HADS-D8.83 (5.57)7.92 (3.92)0.91 (10.42)0.92 (–1.32 to 3.16).340.90 (11)0.24
HADS-A12.00 (4.90)9.67 (5.12)2.33 (19.42)2.33 (0.37 to 4.29).022.62 (11)0.70

aHADS-D: depression subscale of the Hospital Depression and Anxiety scale.

bHADS-A: anxiety subscale of the Hospital Depression and Anxiety scale.

Satisfaction Data

Overview

The feedback regarding the receptivity and satisfaction with Text4Hope cancer care service was reported by the subscribers at the follow-up time points (n=30), that is, after receiving the service.

Benefits of Text4Hope-Cancer Care SMS Text Messages

Figure 2 demonstrates participants’ satisfaction measure data in relation to their perceived mental and physical health. The figure showed that the majority of the subscribers agreed that the messages have helped them to cope with symptoms related to cancer diagnosis, including stress (23/30, 76.7%), anxiety (21/30, 70%), depression (18/30, 60%), and loneliness (17/30, 56.7%). Similarly, most participants agreed that the supportive SMS text messages helped them feel connected to a support system (25/30, 83.3%), feel hopeful that they can manage issues related to cancer diagnosis (21/30, 72.4%), and that the messages improved their overall mental well-being (23/30, 76.7%). However, only 16 (53.3%) participants agreed that the messages enhanced their quality of life.

Figure 2. Appropriateness of Text4Hope-Cancer Care SMS text messages with patients’ mental well-being and cancer diagnosis.
Receptivity of the Supportive SMS Text Messages

Figure 3A demonstrates that most subscribers agreed that the SMS text messages were always or often relevant (20/29, 69%), succinct (24/28, 85.7%), affirmative (24/29, 82.8%), and positive (27/30, 90%).

In regard to reading the SMS text messages and actions taken after, Figures 3B and 3C show that all subscribers reported reading the messages (30/30, 100%). Similarly, the majority reported their return to read the messages (27/30, 90.0%), and they agreed that after reading the messages, they took time to reflect on the messages (23/30, 76.7%).

Figure 3. Receptivity of the supportive SMS text messages. (A) Agreement that the text messages were relevant, succinct, affirmative, and positive. (B) Reading the text messages. (C) After receiving the Text4Hope cancer care text messages.
Overall Satisfaction With the Received Supportive SMS Text Messages and Preference of Their Schedule

Figure 4 shows that most subscribers were satisfied with the service (28/30, 93.3%), preferred receiving the messages once per day (22/30, 73.3%), and the majority preferred the SMS text messages for a 12-month period (13/30, 43.3%).

Figure 4. Overall satisfaction with the received supportive SMS text messages and preference of their schedule.
Opinions About the Use of Technology-Based Services as Part of Health Care

Figure 5 demonstrates that most subscribers were in agreement that everyone struggling with cancer in times of crisis, such as the COVID-19 pandemic, would recommend technology-based services as part of their health care. The top-rated recommended items were SMS text messaging for stress, anxiety, and depression (13/13, 100%); SMS text messaging for cancer care support (13/13, 100%); and telephone counseling for stress, anxiety, and depression (13/13, 100%). These were followed by consultation via telephone conferencing for physical (12/13, 92.3%) and mental health care (12/13, 92.3%); consultation via videoconferencing for mental health care (12/13, 92.3%); telephone counseling for cancer care support (12/13, 92.3%); and web-based counseling for stress, anxiety, and depression (12/13, 92.3%). Following that, web-based counseling for cancer care support was recommended by 11 (84.6%) participants. Notably, email services were relatively less preferred by the study subscribers, including email messaging and support for stress, anxiety, and depression (8/12, 66.7%), and email messaging and support for cancer care support (8/12, 66.7%).

Figure 5. Opinions about the use of technology-based services as part of health care.

Principal Findings

This study was designed to address mental health burdens among people living with cancer and caregivers in Alberta, Canada, during the COVID-19 pandemic, using the Text4Hope-Cancer Care service. The study also examined the satisfaction of the end users with the provided service. Overall, 93 subscribers completed the Text4Hope-Cancer Care program, and 49 responded to all surveys across study time points. The principal finding of this study was the significant improvement in anxiety symptoms among the people living with cancer and caregivers who received a daily message for 3 months of Text4Hope-Cancer Care service. Although there was an observed improvement in depressive symptoms after 3 months of receiving daily supportive SMS text messages, the difference was not statistically significant.

Text4Hope cancer care represents a supportive approach provided to a vulnerable population who have been already disadvantaged by their cancer diagnosis during the pandemic time, where operations were canceled, appointments and medical care was disrupted or delayed, and hospitals were closed due to national lockdowns and pandemic obligations [3,39,40]. Other research has tapped into the need for mental health support for people living with cancer and caregivers using diverse modalities, such as cognitive‐ or mindfulness‐based, acceptance and commitment, supportive‐expressive, educational, and meaning-centered psychotherapy [11,41,42].

Our findings were not different from other SMS text messaging services provided in different contexts. Text4Support, for example, has demonstrated clinical effectiveness in reducing the risk of harm to self and other harm symptoms after 6 months of intervention in a randomized controlled trial [23,24]. The findings from this study, however, contradict findings from other studies in relation to addressing depressive symptoms. In 2 randomized controlled trials that used supportive SMS text messages, patients with depression showed symptom reduction on standardized self-report scales compared to a patient group not receiving messages (with large effect sizes: Cohen d=0.85 and 0.67) [21,22]. This could be explained by the heavy toll that those who live with cancer or caregivers are experiencing, particularly, during the COVID-19 pandemic. It is, however, possible, that the participants’ baseline depression would have deteriorated across the study time points without the daily supportive SMS text messages. Due to ethical considerations, this study did not include a control group who would not have received the supportive messages during the pandemic, to compare them to those who have received the service.

During the COVID-19 pandemic, people need to feel connected to a health support system. Therefore, several initiatives that included SMS text messaging services were provided and have reported comparative effectiveness to our study. Text4Hope service was provided to support the mental health of the general public in Alberta; the service reported quite similar findings to our study, where a significant reduction in stress, anxiety, depression symptoms, and suicidal ideation was achieved [14,30,43,44]. Another related service, the Text4Hope-Addiction program, was introduced to people living with substance use disorders; the service reported significant improvement in standardized measures for craving, anxiety, and depression in subscribers [45]. Similarly, the Text4PTSI program significantly reduced psychological distress among public safety personnel postintervention [25,26].

The gap in the health care service experienced by patients living with cancer seems evident and could be attributed to the lack of social and mental health support. A recent systematic review of 33 studies has highlighted the lack of social support, among others, as an exacerbating factor within the social construct for developing depression and anxiety among older patients living with cancer [9]. Such mental health symptoms, particularly depression, are linked to increased risk of mortality among people living with cancer due to psychosocial reasons such as reduced adherence to therapy and appointments; thus, the accessibility to cancer control activities and mental health support can control cancer incidence, morbidity, and mortality rates [1,9].

Our study noticed that most of the subscribers were recently diagnosed and living with cancer for less than 1 year, compared to the caregiver group, whose loved ones were living with cancer for more than 1 year. This may reflect the critical and intense periods in which these vulnerable groups may need mental health support that can span over the duration of the disease, during its early stages, as seen with people living with cancer, or later as seen with caregivers. From the literature, it was reported that the third to fifth year after diagnosis is a period that typically requires close clinical follow-up, as well as supportive care, compared to 5 years after the diagnosis, where most survivors would likely have completed their treatment [1].

Another observation in this study is that caregivers whose children were diagnosed with cancer were more committed to completing the follow-up surveys. This was supported by the fact that childhood cancer diagnosis impacts the entire family, who in turn need mental health support [46]. Aligned with this observation, a population-based cohort study in Ontario reported that the mothers of children with cancer had an increased rate of mental health outpatient visits compared to mothers in the general population [46]. This observation has persisted over decades of follow-up, reflecting the critical needs along with the commitment of the mothers of children with cancer to the provided mental health support services.

Regarding the satisfaction with the service, study subscribers expressed a high degree of satisfaction with the service in terms of coping with mental health symptoms, such as anxiety and depression and improved overall mental well-being. The subscribers highly agreed with the value of the received supportive SMS text messages, as being relevant, succinct, affirmative, and positive. These results were not different from the satisfaction levels achieved with similar services. Among the users of Text4Mood and Text4Hope, more than 3 in 4 have also endorsed an improvement in their ability to manage anxiety, depression, and general life issues, suggesting an improvement in their resilience and mental health literacy [28,29]. Several SMS text message–based population-level SMS text messaging programs have reported user satisfaction rates of well over 80% [15,27,28]. Similarly, most of Text4Mood and Text4Hope respondents reported feeling connected to support systems, as compared to our study [28,29]. In the same context, well above 50% (16/30) of the subscribers reported that the service has improved their quality of life. This parameter is of particular importance in people living with cancer who often report marked unmet survivorship care needs that consequently compromise their quality of life [8].

Participants’ responses showed satisfaction with the SMS text messages’ content and frequency. Most subscribers read the SMS text messages more than once and took time to reflect or take beneficial action after reading the messages. A similar result was obtained with Text4Hope and Text4Mood services, where more than 1 in 5 reported returning to read the SMS text messages [28,29]. Most subscribers (13/30, 43%) preferred receiving the SMS text messages for a 12-month period, as compared to lower populations who opted for 3 (23%) or 6 (27%) months. This may reflect the significant psychological burden imposed by cancer diagnosis and the ongoing need for psychological support services that give them a sense of belonging and attachment to a health care system, particularly during the tough time of the COVID-19 pandemic. Therefore, the study participants probably opted for an extended length of the service to maintain the same sense of security and belonging.

Seeing the technology services, that could be part of the health care system, support people struggling with cancer during crisis times, SMS text messaging and phone counseling were among the top-rated care services either for mental health issues or cancer-related care. This was not surprising since, nowadays, phones represent an integral part of almost everyone’s life that could facilitate communication and provide channels of support when other conventional lines are obstructed or disrupted due to crises, such as the COVID-19 pandemic. Notably, compared to phone services, email services were relatively less preferred by the study subscribers. This could be attributed to the lack of accessibility to the internet required to access emails, particularly compared to the widely spread phones and available cellular plans.

Digital technology, therefore, introduces future opportunities to support the development of a scalable mental health workforce with the potential to leverage these technologies for integrating into mental health care, particularly for people with severe mental illness and economically disadvantaged communities [19,47,48].

Strengths and Limitations

The study is not without limitations. The low number of subscribers to the program was one of the limitations that curbed the evidence of Text4Hope cancer care to be evaluated among the rest of the community of people living with cancer and caregivers. Notwithstanding, the study reached the desired sample size as previously determined. The dropout rate of this study was aligned with other SMS text messaging services, such as Text4Hope Canada, where the dropout rate was similar (13%) and relatively higher than other web-based services (eg, iCBT) with a reported adherence rate of (52.8%) [10,43]. It is also of note that this study did not report on the time points at which the subscribers dropped out of the study (n=14); this information could have been helpful in better understanding the receptivity of the service among the targeted population and supporting the planning of future support services. Additionally, although the response rate was relatively low (49/107, 45.8%), as compared to the program completion rate (93/107, 87%), lower response rates are usually encountered with such web-based surveys, particularly when no monetary incentives were used, as the case in this study [43,49,50]. On the other hand, the relatively high response rate is one of the strengths of the study which reflects subscribers’ commitment to provide their feedback; thus, the results of the study could be generalized to all cohorts of the study.

Conclusions

Text4Hope-Ccancer Care represents the health system and community response to close the gap during the pandemic time via providing mental health support to a vulnerable sector of the community during the pandemic time. The service was well-perceived and has successfully achieved significant effectiveness in addressing anxiety symptoms among people living with cancer and caregivers during the peak time of the COVID-19 pandemic. Compared to the costly and time-consuming conventional interventions, the SMS text messaging service represents a scalable, cost-effective intervention that can be used on any mobile technology, does not require technical skills, and does not require expensive data plans. This study provides the necessary evidence-based support and insight for policy and stakeholders to implement and guide future resource allocation to convenient, economic, and accessible mental health services that support vulnerable populations during crises.

Acknowledgments

This study was supported by grants from the Mental Health Foundation, the Calgary Health Trust, the University Hospital Foundation, the Alberta Children’s Hospital Foundation, the Royal Alexandra Hospital Foundation, and the Alberta Cancer Foundation. The funder had no role in the design and conduct of the study, collection, management, analysis, interpretation of the data; preparation, review, and approval of the study; or the decision to submit the results for publication. Support for the project was received from Alberta Health Services and the University of Alberta.

Data Availability

The data sets generated and analyzed during this study are available from the corresponding author on reasonable request.

Authors' Contributions

VA performed the conceptualization. RS, WV, AG, SS, and VA performed data curation. RS and VA performed the formal analysis. VA contributed to the funding acquisition, investigation, and project administration. VA and RS contributed to the methodology. VA performed the supervision. RS contributed to writing—original draft. RS, BA, WV, AG, SS, and VA contributed to writing—review and editing.

Conflicts of Interest

None declared.

  1. Cancer statistics. Canadian Cancer Society. 2023. URL: https://cancer.ca/en/research/cancer-statistics [accessed 2023-05-10]
  2. Brenner DR, Poirier A, Woods RR, Ellison LF, Billette JM, Demers AA, et al. Projected estimates of cancer in Canada in 2022. CMAJ. 2022;194(17):E601-E607. [FREE Full text] [CrossRef] [Medline]
  3. Geng HM, Chuang DM, Yang F, Yang Y, Liu WM, Liu LH, et al. Prevalence and determinants of depression in caregivers of cancer patients: a systematic review and meta-analysis. Medicine (Baltimore). 2018;97(39):e11863. [FREE Full text] [CrossRef] [Medline]
  4. Puigpinós-Riera R, Graells-Sans A, Serral G, Continente X, Bargalló X, Domènech M, et al. Anxiety and depression in women with breast cancer: social and clinical determinants and influence of the social network and social support (DAMA cohort). Cancer Epidemiol. 2018;55:123-129. [CrossRef] [Medline]
  5. Linden W, Vodermaier A, Mackenzie R, Greig D. Anxiety and depression after cancer diagnosis: prevalence rates by cancer type, gender, and age. J Affect Disord. 2012;141(2-3):343-351. [CrossRef] [Medline]
  6. van Warmerdam J, Zabih V, Kurdyak P, Sutradhar R, Nathan PC, Gupta S. Prevalence of anxiety, depression, and posttraumatic stress disorder in parents of children with cancer: a meta-analysis. Pediatr Blood Cancer. 2019;66(6):e27677. [CrossRef] [Medline]
  7. Yi JC, Syrjala KL. Anxiety and depression in cancer survivors. Med Clin North Am. 2017;101(6):1099-1113. [FREE Full text] [CrossRef] [Medline]
  8. Wang IY, Jane SW, Hsu HC, Lin YC, Tsai WS, Young CY, et al. The longitudinal trends of care needs, psychological distress, and quality of life and related predictors in Taiwanese colorectal cancer survivors. Semin Oncol Nurs. 2023;39(4):151424. [CrossRef] [Medline]
  9. Lee ARYB, Leong I, Lau G, Tan AW, Ho RCM, Ho CSH, et al. Depression and anxiety in older adults with cancer: systematic review and meta-summary of risk, protective and exacerbating factors. Gen Hosp Psychiatry. 2023;81:32-42. [CrossRef] [Medline]
  10. Akkol-Solakoglu S, Hevey D. Internet-delivered cognitive behavioural therapy for depression and anxiety in breast cancer survivors: results from a randomised controlled trial. Psychooncology. 2023;32(3):446-456. [FREE Full text] [CrossRef] [Medline]
  11. Jassim GA, Doherty S, Whitford DL, Khashan AS. Psychological interventions for women with non-metastatic breast cancer. Cochrane Database Syst Rev. 2023;1(1):CD008729. [FREE Full text] [CrossRef] [Medline]
  12. Li J, Li C, Puts M, Wu YC, Lyu MM, Yuan B, et al. Effectiveness of mindfulness-based interventions on anxiety, depression, and fatigue in people with lung cancer: a systematic review and meta-analysis. Int J Nurs Stud. 2023;140:104447. [CrossRef] [Medline]
  13. Teo I, Krishnan A, Lee GL. Psychosocial interventions for advanced cancer patients: a systematic review. Psychooncology. 2019;28(7):1394-1407. [FREE Full text] [CrossRef] [Medline]
  14. Agyapong VIO, Shalaby R, Hrabok M, Vuong W, Noble JM, Gusnowski A, et al. Mental health outreach via supportive text messages during the COVID-19 pandemic: improved mental health and reduced suicidal ideation after six weeks in subscribers of Text4Hope compared to a control population. Int J Environ Res Public Health. 2021;18(4):2157. [FREE Full text] [CrossRef] [Medline]
  15. Shalaby R, Adu MK, El Gindi HM, Agyapong VIO. Text messages in the field of mental health: rapid review of the reviews. Front Psychiatry. 2022;13:921982. [FREE Full text] [CrossRef] [Medline]
  16. Rodriguez-Pulido F, Castillo G, Hamrioui S, Martin LD, Vazquez-Beltrán P, de la Torre-Díez I, et al. Treatment of depression in primary care with computerized psychological therapies: systematic reviews. J Med Syst. 2020;44(3):67. [CrossRef] [Medline]
  17. Niedzwiedz CL, Knifton L, Robb KA, Katikireddi SV, Smith DJ. Depression and anxiety among people living with and beyond cancer: a growing clinical and research priority. BMC Cancer. 2019;19(1):943. [FREE Full text] [CrossRef] [Medline]
  18. Fallowfield L, Ratcliffe D, Jenkins V, Saul J. Psychiatric morbidity and its recognition by doctors in patients with cancer. Br J Cancer. 2001;84(8):1011-1015. [FREE Full text] [CrossRef] [Medline]
  19. Naslund JA, Aschbrenner KA, Araya R, Marsch LA, Unützer J, Patel V, et al. Digital technology for treating and preventing mental disorders in low-income and middle-income countries: a narrative review of the literature. Lancet Psychiatry. 2017;4(6):486-500. [CrossRef]
  20. ResilienceNHope suite of supportive text messaging programs reduce stress, anxiety and depression. ResilienceNHope. URL: https://www.youtube.com/watch?v=KmaPyjCNtio [accessed 2023-03-06]
  21. Agyapong VIO, Ahern S, McLoughlin DM, Farren CK. Supportive text messaging for depression and comorbid alcohol use disorder: single-blind randomised trial. J Affect Disord. 2012;141(2-3):168-176. [CrossRef] [Medline]
  22. Agyapong VIO, Juhás M, Mrklas K, Hrabok M, Omeje J, Gladue I, et al. Randomized controlled pilot trial of supportive text messaging for alcohol use disorder patients. J Subst Abuse Treat. 2018;94:74-80. [FREE Full text] [CrossRef] [Medline]
  23. Shalaby R, Spurvey P, Knox M, Rathwell R, Vuong W, Surood S, et al. Clinical outcomes in routine evaluation measures for patients discharged from acute psychiatric care: four-arm peer and text messaging support controlled observational study. Int J Environ Res Public Health. 2022;19(7):3798. [FREE Full text] [CrossRef] [Medline]
  24. Noble JM, Vuong W, Surood S, Urichuk L, Greenshaw AJ, Agyapong VIO. Text4Support mobile-based programming for individuals accessing addictions and mental health services-retroactive program analysis at baseline, 12 weeks, and 6 months. Front Psychiatry. 2021;12:640795. [FREE Full text] [CrossRef] [Medline]
  25. Obuobi-Donkor G, Eboreime E, Bond J, Phung N, Eyben S, Hayward J, et al. An e-mental health solution to prevent and manage posttraumatic stress injuries among first responders in Alberta: protocol for the implementation and evaluation of text messaging services (Text4PTSI and Text4Wellbeing). JMIR Res Protoc. 2022;11(4):e30680. [FREE Full text] [CrossRef] [Medline]
  26. Obuobi-Donkor G, Shalaby R, Eboreime E, Agyapong B, Phung N, Eyben S, et al. Text4PTSI: a promising supportive text messaging program to mitigate psychological symptoms in public safety personnel. Int J Environ Res Public Health. 2023;20(5):4215. [FREE Full text] [CrossRef] [Medline]
  27. Agyapong VIO, Milnes J, McLoughlin DM, Farren CK. Perception of patients with alcohol use disorder and comorbid depression about the usefulness of supportive text messages. Technol Health Care. 2013;21(1):31-39. [CrossRef] [Medline]
  28. Shalaby R, Vuong W, Hrabok M, Gusnowski A, Mrklas K, Li D, et al. Gender differences in satisfaction with a text messaging program (Text4Hope) and anticipated receptivity to technology-based health support during the COVID-19 pandemic: cross-sectional survey study. JMIR Mhealth Uhealth. 2021;9(4):e24184. [FREE Full text] [CrossRef] [Medline]
  29. Agyapong VIO, Mrklas K, Juhás M, Omeje J, Ohinmaa A, Dursun SM, et al. Cross-sectional survey evaluating Text4Mood: mobile health program to reduce psychological treatment gap in mental healthcare in Alberta through daily supportive text messages. BMC Psychiatry. 2016;16(1):378. [FREE Full text] [CrossRef] [Medline]
  30. Agyapong VIO, Hrabok M, Vuong W, Gusnowski A, Shalaby R, Mrklas K, et al. Closing the psychological treatment gap during the COVID-19 pandemic with a supportive text messaging program: protocol for implementation and evaluation. JMIR Res Protoc. 2020;9(6):e19292. [FREE Full text] [CrossRef] [Medline]
  31. Agyapong VIO, Hrabok M, Shalaby R, Mrklas K, Vuong W, Gusnowski A, et al. Closing the COVID-19 psychological treatment gap for cancer patients in Alberta: protocol for the implementation and evaluation of Text4Hope-cancer care. JMIR Res Protoc. 2020;9(8):e20240. [FREE Full text] [CrossRef] [Medline]
  32. Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361-370. [CrossRef] [Medline]
  33. Annunziata MA, Muzzatti B, Bidoli E, Flaiban C, Bomben F, Piccinin M, et al. Hospital Anxiety and Depression Scale (HADS) accuracy in cancer patients. Support Care Cancer. 2020;28(8):3921-3926. [CrossRef] [Medline]
  34. Bjelland I, Dahl AA, Haug TT, Neckelmann D. The validity of the Hospital Anxiety and Depression Scale. An updated literature review. J Psychosom Res. 2002;52(2):69-77. [CrossRef] [Medline]
  35. Skapinakis P. Hospital Anxiety and Depression Scale (HADS). In: Michalos AC, editor. Encyclopedia of Quality of Life and Well-Being Research. Dordrecht, Netherlands. Springer; 2014;2930-2933.
  36. Kohn MA. Sample Size Calculators for designing clinical research. Sample Size Calculators. URL: https://sample-size.net/ [accessed 2024-03-19]
  37. Moritz S, Bartz-Beielstein T. imputeTS: time series missing value imputation in R. R J. 2017;9(1):207-218. [FREE Full text] [CrossRef]
  38. IBM Corp. IBM SPSS Statistics for Macintosh, Version 28.0. Armonk, NY. IBM Corp; 2021.
  39. Dhada S, Stewart D, Cheema E, Hadi MA, Paudyal V. Cancer services during the COVID-19 pandemic: systematic review of patient's and caregiver's experiences. Cancer Manag Res. 2021;13:5875-5887. [FREE Full text] [CrossRef] [Medline]
  40. Pujolar G, Oliver-Anglès A, Vargas I, Vázquez ML. Changes in access to health services during the COVID-19 pandemic: a scoping review. Int J Environ Res Public Health. 2022;19(3):1749. [FREE Full text] [CrossRef] [Medline]
  41. Salari N, Rezaie L, Khazaie H, Bokaee S, Ghasemi H, Mohammadi M, et al. The effect of acceptance and commitment therapy on anxiety and depression in patients with cancer: a systematic review. Curr Psychol. 2021;42(7):5694-5716. [CrossRef]
  42. Yıldız M, Terzioğlu C, Ayhan F. Psychosocial interventions aimed at family members caring for patients with cancer in the palliative period: a systematic review. Int J Nurs Knowl. 2023. [CrossRef] [Medline]
  43. Agyapong VIO, Hrabok M, Vuong W, Shalaby R, Noble JM, Gusnowski A, et al. Changes in stress, anxiety, and depression levels of subscribers to a daily supportive text message program (Text4Hope) during the COVID-19 pandemic: cross-sectional survey study. JMIR Ment Health. 2020;7(12):e22423. [FREE Full text] [CrossRef] [Medline]
  44. Agyapong VIO, Hrabok M, Shalaby R, Vuong W, Noble JM, Gusnowski A, et al. Text4Hope: receiving daily supportive text messages for 3 months during the COVID-19 pandemic reduces stress, anxiety, and depression. Disaster Med Public Health Prep. 2022;16(4):1326-1330. [FREE Full text] [CrossRef] [Medline]
  45. Obuobi-Donkor G, Shalaby R, Vuong W, Agyapong B, Hrabok M, Gusnowski A, et al. Effects of Text4Hope-addiction support program on cravings and mental health symptoms: results of a longitudinal cross-sectional study. JMIR Form Res. 2023;7:e40440. [FREE Full text] [CrossRef] [Medline]
  46. van Warmerdam J, Sutradhar R, Kurdyak P, Lau C, Pole JD, Nathan PC, et al. Long-term mental health outcomes in mothers and siblings of children with cancer: a population-based, matched cohort study. J Clin Oncol. 2020;38(1):51-62. [FREE Full text] [CrossRef] [Medline]
  47. Naslund JA, Shidhaye R, Patel V. Digital technology for building capacity of nonspecialist health workers for task sharing and scaling up mental health care globally. Harv Rev Psychiatry. 2019;27(3):181-192. [FREE Full text] [CrossRef] [Medline]
  48. Naslund JA. Digital technology for health promotion among individuals with serious mental illness. Dissertation Abstracts International: Section B: The Sciences and Engineering. 2018. URL: https://www.proquest.com/openview/b76e93803de9611c3c26664d37c1f3c2/1?pq-origsite=gscholar&cbl=18750 [accessed 2024-03-19]
  49. Meyer VM, Benjamens S, Moumni ME, Lange JFM, Pol RA. Global overview of response rates in patient and health care professional surveys in surgery: a systematic review. Ann Surg. 2022;275(1):e75-e81. [FREE Full text] [CrossRef] [Medline]
  50. Sammut R, Griscti O, Norman IJ. Strategies to improve response rates to web surveys: a literature review. Int J Nurs Stud. 2021;123:104058. [CrossRef] [Medline]


CBT: cognitive behavioral therapy
HADS: Hospital Anxiety and Depression Scale
HADS-A: Hospital Anxiety and Depression Scale-Anxiety
HADS-D: Hospital Anxiety and Depression Scale-Depression
iCBT: internet-based cognitive behavioral therapy


Edited by A Mavragani; submitted 14.10.23; peer-reviewed by N Lau; comments to author 25.01.24; revised version received 04.02.24; accepted 21.02.24; published 24.04.24.

Copyright

©Reham Shalaby, Wesley Vuong, Belinda Agyapong, April Gusnowski, Shireen Surood, Vincent Agyapong. Originally published in JMIR Formative Research (https://formative.jmir.org), 24.04.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.