This research was designed as a longitudinal cross-sectional study, which assessed participants’ satisfaction and experiences with the Text4PTSI program at 6 weeks, 3 months, and 6 months post intervention. The sample reported in this study is less than anticipated since PSPs who subscribed to the Text4PTSI program were less than 10% of the projected 5000 subscribers indicated in the published protocol.

Text4PTSI was launched in July 2021 to support PSP’s mental health in Alberta, Canada [31,32]. The targeted PSP group included emergency department health workers, paramedics, and police and law enforcement agents. This innovative program provides supportive text messages to PSP to prevent and manage posttraumatic stress disorder and other common mental health symptoms. The text messages are based on CBT principles [33]. The messages had a 160-character limit written by cognitive behavioral therapists in partnership with patients and other mental health professionals who addressed the aspects of potential psychological stress, anxiety, and depression. Examples of the text messages sent are:

Similar programs have demonstrated effectiveness in mitigating mental health symptoms like mood disorders in the general population with high user satisfaction rates. For example, a study on the impact of supportive messages among subscribers of Text4Mood reported that about 82% of the respondents felt hopeful about managing life issues and experienced an overall mental well-being [20].

Data collection procedures used in this study are described in the published study protocol [33]. In summary, PSPs enroll in the program by texting “PTSI” to 1-844-990-4343. From the day of enrollment, participants receive 1 text daily, which is unidirectional computer-programmed supportive text messages. These messages are based on CBT principles. Users are at an advantage similar to CBT sessions, where a therapist helps participants to evaluate and challenge negative thoughts, feelings, and emotions [32]. Participants are also invited to complete a web-based program evaluation at 6 weeks, 3 months, and 6 months after enrolling in the intervention. The survey generally took 5 to 10 minutes to complete using their cell phones.

Participation in the Text4PTSI program was voluntary, with no incentives. Receiving supportive messages was independent of survey completion. Participants could opt out of the program at any time by texting back the word “STOP.”

Satisfaction data were collected between September 7, 2021, and October 27, 2022. Figure 1 illustrates the participants' pathways when completing the surveys at each designated time point.

The Text4PTSI study received ethical approval from the University of Alberta Health Research Ethics Board (Pro00108966) [33]. Informed consent was implied by all study participants after they had read the web-based information leaflet, completed the web-based survey, and returned their responses.

The primary outcome measure was the participants’ overall satisfaction with the Text4PTSI program, which delivered to subscribers daily supportive text messages designed to support mental health. Responses were calculated by using subscribers’ responses to 1 question “Using any number from 0 (not at all satisfied) to 100 (very satisfied), how would you rate your overall satisfaction with Text4PTSI?”

Secondary outcomes included the perceived impacts of the program on participants’ mental health and feedback of the supportive text messages at 6 weeks, 3 months, and 6 months from enrollment. Text4PTSI participants provided feedback on the text messaging intervention by responding to questions assessing the following two focal areas:

Although reliability and validity measures for the satisfaction scale have not been assessed, the survey questions have been used in previous studies to evaluate user satisfaction with similar supportive text messaging programs [20,34].

Data were analyzed using SPSS (version 25; IBM Corp) statistical software for Windows [35]. Participants’ satisfaction data were presented as a continuous variable. We measured participants’ overall satisfaction by rating the program from 0 to 100 (0=very dissatisfied, 50=neutral, and 100=very satisfied). The data were reported as means and SDs.

We summarized the satisfaction and participants’ perception of the program at different time points (6 weeks, 3 months, and 6 months). Satisfaction data were presented as categorical variables and reported as frequency and percentages across all the study participants at all 3 time points. The average percentage of all 3 time points was then tabulated and reported.

A chi-square analysis was run to examine any differences in reporting satisfaction across the 3 time points. There was no imputation for missing data, and the results were based on completed survey responses.

As illustrated in Figure 1, participating individuals who subscribed to the Text4PTSI program were 131 which produced 100 usable individual survey responses across the 3 follow-up time points (39 at 6 weeks, 23 at 3 months, and 38 at 6 months), of which 81 respondents completed the survey. Since the expectation was that 131×3 respondents would respond to the survey at the 3 time points, the response rate yielded in this study was 25.4% (100/393). Reported demographic data are provided in Table 1. Police and law enforcement agents were the majority of respondents, followed by female (47/81, 58%), White (63/81, 78%), obtained postsecondary education (68/81, 84%), employed (71/81, 88%), in a relationship (58/81, 73%), and own home (57/81, 70%). The majority of the subscribers were between 31 and 45 years of age.

Participants rated the program by indicating their overall satisfaction on a scale of 0-100, with zero indicating very dissatisfied, 50 indicating neutral (neither satisfied nor dissatisfied), and 100 representing very satisfied. The total number of participants providing their feedback was 100, with an overall satisfaction mean score of 85.12 (SD 13.35). The descriptive analysis also recorded a mean 95% CI of 82.5-87.8. This result indicates that, overall, respondents were satisfied with the Text4PTSI program.

Table 2 represents the level of agreement regarding the Text4PTSI program and its benefits to users. Table 2 indicates 79 out of 100 (79%) survey responses agreed or strongly agreed that the supportive text messages helped cope with anxiety, 72 responses (72%) reported the messages helped them cope with depression and 54 (54%) reported the messages helped them cope with loneliness. In addition, 84 out of 100 responses (84%) agreed or strongly agreed the Text4PTSI program made participants feel connected to a support system and improved their overall mental well-being. Overall, 82 out of 100 responses (82%) indicated they felt hopeful about managing concerns with their mental health or substance use; and 77 out of 100 responses (77%) agreed or strongly agreed that supportive text messages enhanced their quality of life.

Table 3 shows participants’ perceptions of the supportive text message program 6 weeks, 3 months, and 6 months post intervention. Overall, some of the responses suggested SMS text messages were always positive, affirmative, and succinct. The supportive text messages were always inclusive and relevant to participants’ identity background (eg, age, gender, ethnicity, sexual orientation, and gender identity). Table 3 suggests that more than half of the respondents always read the SMS text messages and took time to reflect on the message while indicating and receiving the supportive text messages once daily. In comparison, 76 out of 100 responses (76%) suggested that at least sometimes they return to read the supportive text messages more than once. The supportive text messages were delivered once daily; 93 out of 100 responses (93%) indicated the majority of participants were satisfied with the frequency.

Overall, the chi-square analysis revealed no significant difference in reporting the different satisfaction items among the 3 time points.

This study presents novel findings on how PSP perceived daily supportive text messages and their receptiveness to the Text4PTSI program. The results from the study indicated high respondents’ satisfaction with the program, with a mean score of 85.12 (SD 13.35) that is similar to other studies [34,36]. Overall, the majority of survey responses agreed or strongly agreed with the intervention’s positive effect in helping participants cope with anxiety, depressive symptoms, and loneliness and feel connected to a support system postintervention. The Text4PTSI program helped most respondents feel hopeful about managing their mental health or substance use concerns, improving their overall mental well-being and quality of life.

The survey responses suggested participants were satisfied with the frequency of the messages, and 3 in 4 (75%) responses suggested participants would prefer to receive supportive text messages once daily. Similarly, the majority of responses reported that participants perceived supportive text messages as always positive, affirmative, and succinct. In addition, the supportive text messages were reported as always inclusive and relevant to 60 (60%) of the respondents’ identity background (eg, age, gender, ethnicity, sexual orientation, and gender identity), while respondents always or often read the messages and took time to reflect on the messages.

Reported satisfaction with the Text4PTSI program aligns with satisfaction with other supportive text messaging programs geared toward improving the mental health of subscribers [20,34,37]. For example, an SMS text messaging intervention program delivering a daily supportive text message during the COVID-19 pandemic reported a mean overall participant satisfaction of 8.55 [34], which is consistent with the findings from this study. Similarly, after 12 weeks of a text messaging intervention for smoking cessation, nearly 91% (40/44) of the participants expressed high satisfaction with the program [36]. These findings suggest that respondents are satisfied when supportive messages are incorporated into their care.

High satisfaction with the Text4PTSI intervention implies respondents benefit from the program and highly recommend Text4PTSI to help broadly manage the mental health burden of PSP. A study among first responders, which focused on the usage of telehealth care, reported that out of 38 individuals who were recommended to seek mental health services, about 29 (76%) agreed to adhere to treatment via web-based or telehealth means [38].

PSP often benefit from evidence-based iCBT to assist with mental health symptoms, process emotions, and address potentially traumatic or morally distressing events. Qualitative research reveals that PSP positively perceives iCBT intervention to manage their mental health concerns [28].

Our study results aligned with similar studies focused on other PSP or who use a similar texting service. Another program providing supportive care based on iCBT revealed similar results among PSP [39]. The research team reported that 87% (54/62) of PSP who participated in the iCBT program experienced high confidence in managing their mental health symptoms. Almost all 98% (61/62) agreed that the program was effective [39]. Consistent with the later study, the findings from this study demonstrated how most participants agreed that Text4PTSI helped them to cope with various mental health symptoms albeit with lower proportions. This study’s results are also slightly higher than those of a similar program [34]. The Text4Hope program, which delivered supportive interventions to individuals through texting, reported that, after 6 weeks of providing the intervention, 76% of their study sample reported that they could cope with their anxiety symptoms, 56% could cope with any depression symptoms, while 49% were able to cope with loneliness [34]. Furthermore, the effectiveness of Text4PTSI improved participants’ overall well-being, and participants reported improved quality of life with a follow-up prevalence. Supportive texting programs like Text4PTSI support the growing evidence indicating that iCBT and a supportive text message intervention can potentially improve participants’ addiction, mental health, and quality of life for most PSP [39-41]. Hence, when these supportive messages are delivered to individuals, the messages have the prospect of improving overall well-being.

Text messaging technology can help improve access to health care in an era of inadequate health resources. Six months after the Text4PTSI program, 87.2% of study responses agreed or strongly agreed that they felt connected to a support system. This result aligns with the research literature indicating how supportive text messages can expand one’s perceived support network and increase personal support systems [41]. The findings also correspond with the belief that text message technology has the prospect of delivering remote health care to people [37,42]. This result may reflect PSPs need to connect with a health care system to bridge the gap in using mental health support and services. Notwithstanding, individuals who do not sign up for such supportive text interventions may not benefit.

Recent studies indicate how mental health interventions delivered via mobile phones are positive, affirmative, and relevant [20,34,43,44]. In research where supportive text messages were delivered to manage drug addiction, users felt the messages were positive and positively impacted their way of life [45]. Consistent with our study, 99% of respondents agreed that the content of the supportive text messaging was inclusive of and relevant to their identity background and the supportive text messages addressed potential differences in age, gender, ethnicity, and gender identity. Hence, respondents were satisfied with the SMS text messages they received. These results reflect why study participants agree text messages are positive, affirmative, and relevant sources of mental health support and when these interventions are continuously delivered will positively impact the mental health of individuals.

This study included questions about how participants return to read, reflect, and take action after reading the supportive text messages they received. Reflective and impulsive processes are correlated and intentionally help individuals identify their intentions and activities and develop coping skills [46]. Across the follow-up postintervention, our study recorded a consistent increase in the positive action taken after reading supportive text messages. At 6 weeks, 3 months, and 6 months, 66.7%, 73.9%, and 84.2% of the respondents, respectively, read the text and took time to reflect on the message, while 14% read and took positive action. This is consistent with a similar study from Alberta, Canada, which provided supportive text messages primarily to patients with depressive or anxiety symptoms and others [20]. Another study providing supportive text messages during the pandemic reported that 76% of respondents read and reflected on the text [34]. In a randomized controlled trial to assess the feasibility of health intervention delivered through email or text messages, results revealed that 83% of participants in the text message group read all or almost all the messages [47]. The messages from the Text4PTSI were based on CBT and trauma therapy principles and crafted by mental health professionals along with service users, thus encouraging the participants to read and reflect on the texts. The results also may also explain why 76% at least sometimes read the messages more than once. When an intervention is acceptable and effective, patients are more likely to accept the treatment and desire to continue with the intervention [48]. Participants in our study reported being satisfied with the frequency of text messages (93%). While according to the literature, user ratings of a given service may provide limited evidence about the value of an intervention (eg, social desirability) [49], when individuals are content with the frequency and time they receive text messages, it increases their chance of engaging with the text, with approximately 91% of texts read within the first few minutes of receipt [50].

There are several limitations to the study, which need to be considered when interpreting the results. First, the web-based questionnaire to measure the satisfaction and perception of the study participant was not a validated instrument and may limit the confidence of user satisfaction rates. Second, our sample was not randomized; it would have been ideal to include a control group to compare Text4PTSI subscribers’ and nonsubscribers’ satisfaction, perception, and impact of the program on their mental health. Third, the number of first responders who subscribed to the Text4PTSI program was less than 10% of the projected 5000 subscribers indicated in the published protocol [33]. Challenges associated with the adoption and promotion of the program by first responder organizations in Alberta, despite the initiative being a government-funded program, contributed to the low uptake overall.

Fourth, the sample size of participants who completed all follow-up assessments was fairly small, which may be attributed to participants who still needed to complete the survey and those providing incomplete responses. Out of the 131 subscribers, only 81 responded to the survey. A total of 393 responses were expected during the follow-up; however, 100 survey responses were provided by participants. In addition, the low sample size may be a result of the web-based nature of the surveys. Surveys delivered via SMS text messages are less likely to retain participants for follow-up assessment than paper-based surveys [51].

Notwithstanding these limitations, the findings from our study suggest that text-based health interventions designed for PSP have high satisfaction rates and may be beneficial to improve quality of life and help bridge the gap in seeking mental health services.

Our results highlighted findings relating to the rationale for PSP’s desire to subscribe to supportive text messaging programs. The study generated important insights into the self-reported perception of supportive text messages that improved quality of life and overall mental well-being; coping with anxiety, depression, and loneliness; and being connected to a support network. These results are derived from a few samples who completed the follow-up survey; more research is needed to better understand what is happening with nonrespondents. Additionally, future randomized controlled studies are recommended to comprehensively assess the impact, user satisfaction, perception, and receptivity of the SMS text messaging intervention on PSP and can be scaled up to other occupations, and to better understand the reasons why study participants may opt not to respond to the study surveys that could assess their well-being and satisfaction with the service. Furthermore, research needs to explore possible ways that could be used to reach those who do not respond to the surveys. SMS text messages have fewer character limits, which may improve the participants’ desire to read.

The results of this study provide additional evidence for scale up and spread of supportive text message interventions for PSP and other stressful occupations.