Published on in Vol 6, No 6 (2022): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/35086, first published .
An Intervention to Connect Patients With Psychosis and Volunteers via Smartphone (the Phone Pal): Development Study

An Intervention to Connect Patients With Psychosis and Volunteers via Smartphone (the Phone Pal): Development Study

An Intervention to Connect Patients With Psychosis and Volunteers via Smartphone (the Phone Pal): Development Study

Original Paper

1Institute of Psychiatry, Psychology & Neuroscience, King's College London, London, United Kingdom

2Barts and The London School of Medicine and Dentistry, Queen Mary University of London, London, United Kingdom

3Institute of Biomedical Sciences Abel Salazar, University of Porto, Porto, Portugal

Corresponding Author:

Mariana Pinto da Costa, MD, MSc, PhD

Institute of Psychiatry, Psychology & Neuroscience

King's College London

16 De Crespigny

London, SE58AB

United Kingdom

Phone: 44 02078480002

Email: mariana.pintodacosta@gmail.com


Background: Intervention development is a critical stage. However, evidence indicates that the substandard reporting of intervention details is widespread.

Objective: This study aimed to provide an overview of the guiding frameworks, methodology, and stages for the design and construction of a new complex intervention—the Phone Pal.

Methods: The intervention development process followed the Medical Research Council framework for developing complex interventions as well as the person-based approach. The intervention was developed following the evidence synthesis of a literature review, a focus group study, and a survey after consultation and input from advisory groups with a range of stakeholders, including patients, volunteers, clinicians, and academics.

Results: The developed logic model outlines the contextual factors, intervention, mechanisms of change, and short- and long-term outcomes. The operationalized intervention required matching 1 patient with 1 volunteer to communicate with each other through a smartphone via SMS text messages, WhatsApp messages or email, and audio or video calls. Each participant was encouraged to communicate with their match at least once per week for a 12-week period using informal conversation.

Conclusions: The systematic process and theoretically sound strategy through which this intervention was developed can provide insights to future researchers on the reality of developing and preparing the operationalization of a digital intervention using multiple components.

JMIR Form Res 2022;6(6):e35086

doi:10.2196/35086

Keywords



Complex Interventions

The distinctive notion of a complex intervention has emerged since 2000 [1] through debate focused on the definitions of complex interventions and their components [2]. In particular, there is a need to identify the active ingredients [3], especially in multicomponent psychosocial interventions. It has been emphasized that the description of complex interventions is not enough [4]. In fact, the process of decision-making during research and whether relevant stakeholders are involved and how is often not described.

The 2010 CONSORT (Consolidated Standards of Reporting Trials) statement recommends that authors report interventions with “sufficient details to allow replication” [5]. However, evidence indicates that substandard reporting of intervention details is widespread [6,7], which may be due to the complexity of many nonpharmacological interventions carried out within a social context [4,8].

It has been recommended that complex interventions should be defined as being formed of parts; these may be material, human, theoretical, social, or procedural in nature and may themselves have subdivisions. These can be further stratified into higher and lower realms that exercise power individually, in combination, or as emergent properties [9]. The intervention whole refers to the intervention as a single complete entity distinct from the parts that comprise it; its existence depends on its parts. However, some approaches view the whole as being more than the component parts; thus, the parts are insufficient to explain changes in the intervention’s outcomes [10]. Intervention developers routinely elicit the views of target users in a variety of ways [11,12]. However, there is still controversy surrounding how best to do this [13].

The Phone Pal as a Case Study

Volunteering programs appear beneficial and can be encouraged as a means of integrating patients with severe mental illness (SMI) into their communities and promoting their recovery [14]. SMI typically refers to someone with a diagnosis of psychosis of >2 years, duration which impairs their functionality [15].

Social relationships constitute a complex and multidimensional construct with both structural and functional components. With respect to patients with psychosis, there is a body of literature describing their social isolation, low quality of life, low self-esteem, sedentary lifestyle, and nonsecure attachments [16-20]. Regarding volunteers, studies have suggested improvements in their quality of life and changes in their attitudes toward people with mental illness [21].

In the current era of innovation, new models of volunteering may arise using technology. These may encourage the recruitment of new kinds of volunteers and also open the possibility of remote volunteering across large distances [22]. Thus, there is an additional need for remote models that enable volunteer support using technology to connect people with mental illness to others [23].

In an empowerment model in which volunteers take an active role as proactive citizens (eg, by supporting either a neighbor or someone remotely), digital volunteering could be an invaluable public health resource for society [24]. Having a Phone Pal as an intervention establishing informal communication about daily life could provide a distinctive form of mental and social support to people with mental illness, improving their mental and physical health [25].

Objectives

The aim of this study was to report the process of development of a complex intervention (ie, the development of a logic model and the planning of its operationalization) as well as to report on the resultant intervention that was ultimately developed—the Phone Pal.


Overview

The process of developing the multicomponent behavioral intervention was performed systematically in different stages. It involved three aspects: (1) developing the logic model, (2) outlining the intervention components, and (3) operationalizing the intervention.

A logic model is a diagrammatic representation of an intervention describing anticipated delivery mechanisms (ie, how resources will be applied to ensure implementation), intervention components (ie, what is to be implemented), hypothesized mechanisms of impact (ie, how an intervention will work), and intended outcomes [26]. Logic models are commonly used to represent the causal processes through which interventions produce outcomes [27].

The development of the Phone Pal logic model followed the recommendations of the 2 guiding frameworks for this study: the UK Medical Research Council (MRC) framework for developing and evaluating complex interventions [28] and the person-based approach [29]. Both frameworks specify the importance of illustrating the theoretical processes that are expected within an intervention and its context. Figure 1 illustrates the various stages of the development pathway followed in this study.

Figure 1. Framework of methods and stages for the intervention development and testing.
View this figure

Guiding Frameworks

The MRC framework [28] is the most widely used framework for intervention development with multiple components. The MRC framework has four interlinked stages: (1) development, (2) feasibility and piloting, (3) evaluation, and (4) implementation.

This study focuses on the first stage (ie, development), which entails the assessment of the existing evidence base followed by the identification and construction of the theory relating to an intervention. This was relevant to this study, as the mechanisms of volunteering remain unclear.

The person-based approach was selected as a supplementary framework for intervention development [29]. This approach recognizes the specific contextual challenges related to engaging users with digital interventions designed for independent use. This framework argues that interventions must be appealing, easy to use, and relevant to the participants’ needs; otherwise, people will not use them.

The person-based approach also advocates that the conceptual modeling described in the MRC framework should consider specific contextual behavioral issues and challenges identified during intervention development. The creation of guiding principles is advised to address contextual challenges and inform an intervention logic model. There are two elements: (1) intervention objectives and (2) core components of the intervention that operationalize the objectives. This approach puts emphasis on component design to improve digital health intervention acceptability and engagement and suggests that all interventions should aim to promote a positive emotional experience [29].

Stages of the Intervention Development

The 4 stages of intervention development used in this study were based on the MRC framework and the person-based approach [28,29] (Multimedia Appendix 1).

Methods Involved in the Intervention Development

Overview

Different methods were used in the intervention development. Some of these activities took place concurrently (eg, the focus group study and survey) and were followed by several iterations of consultations with the advisory groups. The review was conducted between October 2015 and December 2015, the focus groups were conducted between January 2016 and September 2017, the survey was conducted between August 2016 and August 2017, and the advisory groups were consulted from February 2017 to February 2020.

Review of the Literature

A rapid narrative literature review was conducted to enable efficient mapping of the main results related to the specified field. It constitutes a useful technique for intervention development where a broad perspective of the literature is required within a limited timetable [30,31]. Key papers and theories for developing interventions and digital interventions were subsequently searched [32].

Focus Group Study

Stakeholders potentially linked to the provision of volunteering (ie, mental health professionals and volunteers) were interviewed in a focus group format to explore their views regarding the relationship formats between patients and volunteers [32]. A total of 24 focus groups were conducted with 119 participants. The process and findings of the focus groups have been described elsewhere [33,34].

Survey

Patients’ preferences with respect to contact with a volunteer were assessed through a survey that evaluated potential relationship formats between patients and volunteers and the patients’ preferred volunteer characteristics [22]. A total of 151 patients with psychosis followed in outpatient services in London were interviewed. The findings of this study have been published elsewhere [22].

Volunteer and Patient Advisory Groups

In this research, both patients and volunteers were also included as patient and public involvement advisors [35]. The lead author (MPdC) worked with organizations of volunteers and patients consulting them regarding intervention development [36,37].

The lead author collaborated with a national volunteering association, Befriending Networks [38], which is the umbrella charity for befriending services operating across the United Kingdom and beyond. In September 2017, the lead author organized an event in London that brought several volunteer organizations and volunteers together. The event raised awareness of research on volunteering in mental health and was attended by volunteers involved in charities of mental health. Many of these volunteers contributed to the focus groups conducted during this event. Following the meeting, 2 volunteers also worked with the lead author through the advisory group offering their input for the intervention development process.

To establish patient views, the lead author worked with the Service User and Carer Group Advising on Research at City University of London [39]. This group comprised 14 mental health service users who had personal experience with a variety of mental health conditions, including psychosis.

These groups were consulted throughout the intervention development phase; the meetings involved discussions based on written materials or presentations. The opinions of potential users (ie, both patients and volunteers) were sought concerning which components they thought should be included in an intervention that was aimed toward the provision of opportunities for volunteering in mental health.

The Phone Pal logic model was then developed in consultation with the advisory groups, and it explored a set of person-based intervention components and the potential outcomes that the intervention could affect aligned with the participants’ opinions on what to achieve. The groups advised on the suitability of different components and provided recommendations on the role and characteristics of patients and volunteers in this intervention.

These potential users offered important insights to establish the guiding principles of the intervention. They also discussed and specified the key components and objectives that would improve acceptability and engagement with a digital intervention.

Expert Advisory and Consultation Group

Regular meetings with a multidisciplinary team of 30 people comprising principal investigators, postdoctoral researchers, PhD students, researchers, public health experts, anthropologists, psychologists, and psychiatrists at the Unit for Social and Community Psychiatry were used to discuss the intervention development process. The lead author presented the guiding principles, and the team advised on the Phone Pal logic model development.

Evidence Synthesis

The findings emerging from the aforementioned methods were synthesized and presented to the advisory groups. Although there were divergent views on occasions, these group discussions frequently allowed one view to emerge as preferred or, on some matters, there was even consensus from the advisory group members. Further to the consultation with the advisory groups, actions were agreed upon to guide the design of key components of the intervention, the development of the logic model, and the intervention operationalization. The decisions that addressed the identified challenges were acceptable to patients and volunteers, were informed by theory, could be achieved pragmatically within this research, and were endorsed by the expert group.

Ethics Approval

The initial intervention developed was assessed, and changes were requested by the Research Ethics Committee (REC). The final intervention was approved by the REC and the Health Research Authority in the United Kingdom (REC reference 18/EE/0196; protocol 012393).


The Development of the Phone Pal Logic Model

Process for Selecting the Intervention Core Components and Objectives

The process for selecting the intervention core components and objectives was guided by the intervention guiding principles. The guiding principles of the intervention communicate how the objectives and components of the intervention address the particular contextual challenges identified during the process. After an extensive process of gathering the existing evidence, three core intervention components were outlined: (1) a match (ie, patient-volunteer), (2) remote communication, and (3) a smartphone, as depicted in Figure 2.

The objectives established were (1) to provide one-to-one access to a match, (2) to provide this access to a person remotely, and (3) to allow the communication to occur digitally. Table 1 presents the core components, intervention objectives, and contextual factors.

The following section describes the process of logic model development, portraying the decision-making for the selection of suitable intervention components—namely, the volunteers’ characteristics and role, the patients’ characteristics and role, and being connected remotely and through a smartphone—using the methods that informed them (Table 2).

Figure 2. Core components of the intervention.
View this figure
Table 1. Core components, intervention objectives, and contextual factors.
Core componentsIntervention objectivesContextual factors
A “match”Provide one-to-one access to another person—a matchPatients might be socially isolated
Remote communicationEnable the communication to occur remotelyPatients might face barriers to in-person meetings
A smartphoneProvide access to a person digitallyTechnology is integrated into people’s lives
Table 2. Components, descriptions, and methods.
ComponentBrief descriptionLiterature reviewFocus group studySurveyPatient and volunteer advisory groupsExpert advisory group
Volunteer
characteristics
To be inclusive in the definition of volunteers (ie, recruit from a variety of backgrounds and include people with and without personal mental health experience)
Volunteer roleTo provide human contact to patients, establishing informal communication between each other about daily life as part of a more symmetrical relationship
Patient
characteristics
To focus on patients with psychosis who are usually the most socially isolated group

Patient roleTo obtain human contact from volunteers, establishing informal communication between each other about daily life as part of a more symmetrical relationship
Fully remoteTo encourage participants to only communicate with each other remotely


SmartphoneTo encourage that participants communicate with each other through a smartphone
Components
Volunteer Characteristics

Volunteers have varied profiles. It was concluded from systematic reviews [40,41] that there is no typical volunteer. These variations [42] encouraged the adoption of a definition of diverse volunteers for the inclusion criteria of this study that enabled volunteer recruitment from a variety of backgrounds.

The volunteer inclusion criteria were widened, recruiting volunteers without experience of mental illness. Although peer support is a theoretical intervention that has been used in web-based psychological interventions to promote co-operation and expertise and reduce loneliness [43], it excludes volunteers who do not possess a shared characteristic.

Volunteers with personal experience of mental illness were also included in this study. Several articles document volunteers who disclose a personal psychiatric history themselves [44-46]. Such volunteers can act as role models and be an inspiration to those with a current mental illness as they are able to demonstrate that life does go on and that it is possible to cope with an SMI [44].

In addition, the patient survey demonstrated that most patients (83/148, 56.1%) were interested in a volunteer who had personal experience as a patient in mental health care [22]; these findings added weight to the decision to broaden the inclusion criteria. The focus group study also presented a range of qualities and characteristics related to volunteers. However, it did not advocate for any specific profile of volunteer; views ranged from anyone can be a volunteer to those who considered that individuals with a supporting profile and skills should be the ones providing volunteering support.

For the new intervention, the literature reinforced the decision to have broad inclusion criteria for volunteers, which could encompass a wide range of individuals with or without a possible history of mental issues. The patient and volunteer advisory groups endorsed this choice.

Role of the Volunteer

There are several variations in the potential role of volunteers described in the literature. Although overall these are referred to as social support [47], such an approach may comprise emotional, informational, appraisal, and instrumental aspects [48]. Social support has been described as a reciprocal process, where its provision may be as important as its receipt [49].

In the focus group study, stakeholders expressed strong views that the intervention should aim to overcome isolation by connecting patients to additional social contacts, thus using volunteers as instruments for modeling (ie, as a transition figure).

Of the surveyed patients interested in technology, most (32/56, 57%) thought that the aim of digital volunteering was to make a new friend and had less to do with increasing their activities. They appeared to view technology as a means of establishing contacts with other people and forming friendships. The fact that most of these patients wanted someone as a volunteer with personal experience of mental illness implied a desire to have a more symmetrical relationship.

Some of the members of the expert advisory group initially advised that the volunteers should maintain an asymmetrical role of patient support. However, in view of the feedback collected from the focus group study and the survey, most of the expert group members subsequently supported the pursuit of a new model in which a more symmetrical relationship was recommended between the 2 matched participants (ie, one that followed the guiding principles of social facilitation, social learning, social role, social comparison, and self-determination).

Encouraging relationship symmetry was a significant decision, distinguishing the current model from more traditional frameworks of befriending or peer support, which exclude people with or without mental illness, respectively. In this intervention, both were accepted as volunteers. In addition, it was deemed important to incorporate the assessment of social contacts as one of the study outcomes before and after the intervention.

With the endorsement of the patient and volunteer advisory groups, it was decided that the primary role of the volunteer in this intervention would be to offer remote human contact to patients, establishing informal communication between each other about daily life. The volunteer could be a potential role model for the patient, establishing a more symmetrical relationship. Therefore, the focus of this intervention is the patient’s and volunteer’s social interactions with each other via smartphone as opposed to being centered on being together and engaging in social activities.

Patient Characteristics and Role

The literature describes that, in people with SMI, social isolation has been linked to higher levels of delusions [50], lack of insight [51], and high hospital use [52]. Importantly, previous studies have found a significant association between loneliness and psychosis [53]. The significance of social isolation in patients with psychosis led to the decision to focus this intervention on these individuals.

The focus group study provided insights into the role of patients when outlining the character of the relationships between patients and volunteers.

The survey revealed that younger patients and those with a more recent diagnosis of psychosis were more likely to prefer digital volunteering [22]. However, another study reported that older patients with psychosis were actually more likely to engage with digital interventions [54]. In light of these data, it was opted to include adult patients of all ages in the study. This would also enable the comparison of intervention use according to age. The advisory groups endorsed these proposals for the patients’ characteristics and their role in this intervention.

Connected Remotely Through a Smartphone

The concept of volunteers and patients interacting through technology is reinforced in the literature. Technology can help connect people, especially those usually hard to reach [55]. It facilitates more frequent and flexible communication, which is the central element in a relationship. In particular, smartphones are highly portable and in widespread use, presenting new opportunities to deliver interventions, monitor behavior changes, and make communication easier between people who are far away from each other [56-58].

It has been documented that patients with psychosis value technology [59]; are interested in using smartphones [60]; and have been found to engage, adhere, and be satisfied with their use [61-63]. In fact, people with SMI were able to use and adhere to digital interventions [64] even when experiencing negative symptoms [65] and generally found such technology helpful and easy to use. A study evaluating a digital intervention in people with schizophrenia reported that noncompleters were more likely to have severe negative symptoms than completers but found no difference in the incidence of positive or depressive symptoms [66].

People have long established contact with strangers even before technology was in place. This is illustrated by the popularity of pen pal letters abroad [67]. This concept supported the decision to design a fully digital intervention and not encourage each match to meet in person during the study.

Among the array of digital tools currently available, smartphones were favored rather than alternatives such as a website or tablet. For the former option, the participants would need constant internet access; with respect to the latter, tablets are commonly larger and less portable than smartphones. The plethora of evidence relating to smartphone use, ownership, and interest in people with psychosis also influenced the decision to deliver the intervention via this modality [59-65]. It was also the most affordable option to enable remote communication between patients and volunteers.

The results from the patient survey revealed that several patients (56/151, 37.1%) were interested in receiving digital volunteering; only a few patients (20/151, 13.2%) did not use technology.

A further important consideration in relation to smartphone use was the advice from the focus group study that veered away from the idea of a separate app. An app designed specifically for people with mental illness to communicate with healthy volunteers could potentially risk a further increase in stigma. Instead, a strong recommendation was made to use the normal modalities of communication typically offered by every smartphone (eg, audio calls, video calls, written messages, and emails).

The expert advisory group endorsed the use of this totally remote style of communication to differentiate from face-to-face interactions (Multimedia Appendix 2).

Process for Selecting the Guiding Principles for the Phone Pal Logic Model

Overview

The guiding principles aim to address the contextual challenges that are likely to affect intervention delivery. They consist of 2 aspects (ie, the intervention objectives and the core components used to operationalize them), which were developed to ensure that the intervention met the volunteers’ and patients’ expectations [68].

This logic model was assembled with the contextual factors and anticipated outcomes following a process of collating existing evidence, varying theories, and conceptualizations. Table 3 illustrates the guiding principles of the intervention, hypothesized mechanisms of change, and outcomes that may be affected by intervention use. The intervention components were selected after feedback to theoretically promote engagement via role modeling and self-efficacy, as further explained.

Table 3. Guiding principles, mechanisms of change, and outcomes.
Guiding principlesMechanisms of changePatient outcomesVolunteer outcomes
Personalization, tailoring, and real-world feelEngagementSymptoms and physical activityPhysical activity
Social facilitation, social learning, social role, social comparison, and normative influenceRole modelSocial contacts and social comparisonSocial distance and social comparison
Self-monitoring, co-operation, and recognitionSelf-efficacySelf-esteem, attachments, and quality of lifeSelf-esteem and quality of life
Guiding Principles

Different guiding principles were then grouped as drivers of the 3 distinct mechanisms of change [68].

A total of 3 guiding principles were linked with engagement as a mechanism of change (ie, personalization, tailoring, and real-world feel). Personalization entails the offer of personalized content; tailoring encompasses the adaptation of the content to potential needs, interests, personality, context, or other individual factors; and the real-world feel emphasizes to the researcher or responsible organization the need to increase the intervention credibility.

In total, 5 guiding principles under the auspice of role model form the second grouping (ie, social facilitation, social learning, social role, social comparison, and normative influence). Social facilitation postulates that participants are more likely to perform a target behavior if they are aware that another person is performing the behavior along with them. Social learning describes that a participant will be more motivated to perform a target behavior if they are able to observe others performing the behavior. Social role suggests that participants will be more likely to perform a target behavior if an intervention adopts a social role. Social comparison describes that participants will have a greater motivation to perform a target behavior if they can compare their performance with that of others. Normative influence describes that an intervention can provide peer pressure to increase the likelihood that a participant will adopt a target behavior.

The 3 remaining guiding principles were linked with the mechanism of change of self-efficacy: self-monitoring, co-operation, and recognition. Self-monitoring postulates that an intervention that allows a participant to keep track of their own performance or status supports the participant to achieve their goals. Co-operation describes that an intervention can motivate participants to adopt a target behavior by leveraging humans’ natural drive to co-operate. Recognition indicates that, by offering public recognition for a participant, an intervention can increase the likelihood that the participant will adopt the target behavior.

Mechanisms of Change

The 3 mechanisms of change hypothesized in this model were engagement, role model, and self-efficacy; these are described in the following sections.

Engagement

There are different types of engagement (eg, active or passive), which are accompanied by a heterogeneity of overarching definitions and measurements [69]. The challenge of engagement has been described as one of the main issues with digital interventions [70]. Typically, initial levels of enthusiasm are only maintained for a period after which diminution of use ensues, especially when interventions are used in the real world [71]. This may be a problem given that most interventions are designed to become effective over a specific duration. In health care, motivations for compliance can be driven by perceived usefulness and achieving goals; these can facilitate the creation of habits [72].

The behavioral activation theory states that, without specific training, activation consists primarily of the scheduling of pleasant activities [73]. This was key for this intervention. An important objective was that participants were motivated by the intervention and considered it relevant to improving their condition and social context. This study aimed to have the patients engaged with the intervention, interacting with a real person—a community volunteer—who would be available to communicate with them and support them.

Role Model

A key underlying theory for this intervention is the weak ties theory, which postulates the importance of less strong ties such as acquaintances to have access to new information outside the core network [74]. A series of principles related to social support have been proposed in the Oinas-Kukkonen and Harjumaa [68] framework (ie, social learning, social comparison, and social facilitation, which involve some form of connection with others through the technology). The principles of social learning and social comparison require that the person be aware of what the other person is doing and their progress, potentially achieved by mutual sharing of achievements or witnessing them.

The intervention aimed to provide patients with access to another person (ie, a volunteer) who, through communication, could act as a role model. Theories on role model use have advocated that it can be a way of motivating people to perform novel behaviors and inspire them to set ambitious goals [75].

Although the role of volunteers has been described as to be there or do things, this view may overlap with the conceptualizations of taking a more passive or active role [14]. In this intervention, it was envisioned that a volunteer would take a somewhat active role realized through being available to communicate with the patient; participating in mutual encouragement to engage in social and physical activities; and aiming to improve their self-esteem, social contacts, and physical activity. The rationale was to motivate participants to choose and communicate through methods that suited them while remaining in contact with their usual friends, thus linking the intervention to their social world.

Self-efficacy

Typically, users of digital interventions must feel motivated and confident to independently use them. Therefore, self-determination theory [76,77] is particularly relevant to understanding how users respond to this intervention and how it differs for patients and volunteers.

Therefore, the intervention components were organized under 3 objectives relevant to the constructs of self-determination theory. This postulates that intrinsic motivation to engage in health behavior change will be enhanced by (1) supporting users’ need for autonomy and feeling self-directed; (2) increasing users’ sense of competence, control, and confidence; and (3) enhancing users’ perceived relatedness or support from the intervention.

Having a chronic mental illness (eg, psychosis) presents several challenges that create a barrier to self-efficacy and affect life quality. Self-esteem has been linked to an intrapersonal influence on self-efficacy, suggesting that increasing self-esteem may subsequently increase self-efficacy [78].

In this study, there were several decisions made to design the intervention with the objective of improving self-efficacy. This entailed the provision of 1 volunteer for each patient with whom they were matched and with whom they could communicate remotely. This allowed them to help their match and to be helped, thus improving their self-esteem and quality of life. Having an attachment to their match could enable a normative influence, co-operation, and recognition. Furthermore, to raise awareness of their physical activity, participants were also encouraged by the researchers to use an app, Accupedo, to check their step count, a further means to enhance their self-efficacy [79,80].

Phone Pal Logic Model With Intervention Contextual Factors and Outcomes

Overview

Figure 3 depicts the Phone Pal logic model together with the contextual factors and anticipated outcomes. The model embraces the different components that were selected, the guiding principles promoted, the hypothesized mechanisms of change, and how these concepts are linked to outcomes. This logic model describes the main theoretical pathways connecting the components, principles, mechanisms, and outcomes of this intervention. In reality, the various intervention components may operate on multiple principles and, therefore, multiple mechanisms. An explanation follows for the rationale of why particular components and objectives were included in this intervention.

Figure 3. Logic model with the intervention contextual factors, processes, and outcomes.
View this figure
Contextual Factors

The Phone Pal logic model encompasses the contextual factors on which the intervention has been based: (1) patients’ social isolation, low self-esteem, low quality of life, sedentary lifestyle, and nonsecure attachments; (2) smartphone features (ie, wide availability, portability, and ability to offer digital and remote modes of communication); and (3) community volunteers who provide human contact with others, establishing informal communication about daily life, and offer support, being a role model to patients.

Short-term and Long-term Outcomes

In total, 2 types of outcomes were hypothesized for both patients and volunteers. These were classified according to the time frame (ie, short-term and long-term outcomes).

For patients, potential short-term outcomes were to improve their self-esteem, social contacts, and physical activity. In the longer term, it was felt that additional outcomes could be attained (ie, improving their quality of life, attachment, social comparison, and symptom alleviation).

For volunteers, the short-term outcome goals were to witness a change in their attitudes, with a decrease in their social stigma toward people with mental illness, and to increase their physical activity. Further outcomes could be achieved over a longer timescale (eg, improvement in quality of life and social comparison).

For both patients and volunteers, it was hypothesized that, through a higher level of engagement, they would become more activated and possibly increase their physical activity.

Phone Pal Intervention

The logic model of the planned intervention conceptualized the matching of 1 patient with 1 volunteer to communicate with each other over a smartphone. The core elements were (1) the remote medium for delivery of the intervention, (2) being in contact with another person, and (3) the use of a smartphone.

Developing and Operationalizing the Phone Pal Intervention

Overview

Core components are intrinsically linked with the intervention basis; on a higher level are components that, although less fundamental than the core ones, are still part of the operationalized and envisioned intervention.

The main components describing how the intervention should be and the methods that informed them are summarized in Table 4. The methods and decisions made to operationalize the intervention are summarized in Table 5.

Table 4. Components of the intervention and the methods that informed them.
ComponentBrief descriptionLiterature reviewQualitative studySurveyPatient and volunteer advisory groupsExpert advisory group
Communication durationTo encourage participants to communicate with each other for 12 weeks


Communication frequencyTo encourage participants to communicate with each other at least once per week

Communication methodsTo encourage participants to communicate through the different methods that a smartphone provides (ie, sending messages or emails or making audio or video calls)
Communication contentTo encourage participants to have informal communication about daily life

Table 5. Subcomponents of the intervention and the methods that informed them.
ComponentBrief descriptionLiterature reviewQualitative studySurveyPatient and volunteer advisory groupsExpert advisory group
MatchingTo match 1 patient with 1 volunteer to communicate with each other during the study


Volunteer trainingTo provide training on communication, the boundaries of the relationship, and safeguarding
Patient trainingTo provide training on communication and the boundaries of the relationship


Study coordinatorTo have a study coordinator available to participants throughout the study offering access to support and supervision


Monitor communicationTo monitor the communication of the participants through the offered smartphone


Monitor physical activityTo monitor the step count of the participants through an app on the offered smartphone


Duration, Frequency, and Methods of Communication

For pragmatic reasons, a period of 3 months was chosen in line with several publications reporting interventions with a duration of 12 weeks [54,81-86]. A review identified that the level of commitment should be for a minimum of 4 hours per month [44].

The idea of the communication being tailored by each participant is deemed important to create a persuasive system [68]. Therefore, in this intervention, it was decided to leave it up to each pair to decide which communication modalities they would like to use.

In young adults with a first psychotic episode, it was noted that they preferred a combination of technologies through which to receive mental health care (eg, SMS text message, video, and audio). Among these options, SMS text messages were preferred [87].

Surveyed patients [22] proposed that contacts should be open-ended and weekly and favored SMS text messages followed by email, Skype, Facebook, and audio calls. The modality audio calls, which was not given as a separate option in the survey, was named by different patients when selecting the choice other. The methods of communication initially selected for this intervention (ie, audio calls, video calls, SMS text messages, Facebook messages, WhatsApp messages, and emails) were determined according to the results of this survey and the literature. However, Facebook messages were removed following the instructions of the REC.

It was decided to encourage participants to communicate with each other at least once per week. The participants were informed that one of the study aims was to assess how much or how little each pairing decided to communicate. The focus group study findings indicated that people varied in their attitudes toward specific communication methods. In line with the person-based approach, it was decided not to be prescriptive in this regard.

A pragmatic decision was made to give the participants full access to and choice of all possible intervention components (ie, they could choose from sending SMS text messages, WhatsApp messages, or emails or making audio and video calls). The participants could opt to interact with their match through a particular tool, and their paired match could then choose to reciprocate through the same tool or select another modality. Relinquishing control of communication modality use has been supported by previous research [88]. The lead author encouraged volunteers to take the initiative to call patients in the first instance.

The expert advisory group supported the choice of communication method as all the tools were commonly accessible on any smartphone.

While developing the intervention, the lead author was prescriptive in the duration and frequency of the communication but not in the communication modalities. In the process of operationalizing the intervention, the lead author embraced the challenge of how much or how little guidance to provide when researching a psychosocial intervention. In terms of guidance for intervention adherence and use, there can be tension between supporting autonomy while still providing clear guidance on how participants can best change their behavior. Some studies reported concerns that offering too many options can be overwhelming [89]. Bestowing complete control can result in lower intervention use than tunnelling core intervention content [90]. Some researchers suggest that tunneling is less overwhelming than allowing patients free choice [68], and it is often used in mental health interventions [91]. However, a tunnelled approach [68] in which participants are led sequentially through intervention content, usually in a predefined order or based on a needs assessment, might not always be suitable and was deemed as too imposing. In fact, the person-based approach recommends that, in general, digital interventions should aim to promote user autonomy and offer choices where possible [29].

Communication Content

In this study, communication was between 2 humans and mediated through technology—the smartphone.

The focus groups provided insights into possible suggested conversation content for this intervention. The participants were instructed to establish informal communication about daily life.

Matching Patients and Volunteers
Overview

With respect to matching, previous research on telephone peer support has matched dyads randomly [49]; it was not possible to predict which dyad members would become friends based on interviewer impressions or similarity of individual characteristics. In the Volunteering in Mental Health befriending face-to-face trial, each patient-volunteer pairing was matched based on the instincts of the volunteer coordinator [92]. In the Phone Pal study intervention, it was decided to match on a first-come, first-served basis; the patient and volunteer advisory groups agreed. Specifically, personal characteristics or preferred communication methods were not used to influence this process.

Training Volunteers

The literature reports that volunteer training is compulsory in most programs [44,46,93-96], although some volunteers receive no training [97]. What this potentially means for volunteers varies, from not sharing personal contact details or information to, alternatively, sharing personal information and introducing the patient to friends or family members [96]. Examples of topics covered include expectations and responsibilities of a volunteer, preparation for managing initial meetings, general listening skills, boundaries and guidelines, mental illness, stigma, major diagnoses and symptoms, and conflict management [44,46]. The training offered to volunteers was primarily focused on communication and managing boundaries rather than presenting surplus information about the illness or treatment. The latter was important to avoid the concerns of medicalizing or providing unnecessary clinical information, which could jeopardize the establishment of a friendly relationship.

The focus group study provided a variety of views on the advantages and disadvantages of training. Although it was deemed important that training should be provided, there was no clear consensus; some thought it unnecessary. Concerns were also expressed about potentially high expectations, overinvolvement or risk of professionalizing volunteers, and breaching confidentiality. It was advised that these issues should be addressed with adequate training and also by asking volunteers to sign a confidentiality agreement, a common practice in many volunteer programs and research studies. This covered the requirement of volunteers not to disclose information about their matched patient to third-party agencies, friends or family, or anyone outside the research team without consent from the matched patient. In addition, they were requested not to disclose unnecessary information about their volunteer role to family, friends, or colleagues. Breaching confidentiality would only be permitted if there was a risk of serious harm (eg, if a patient expressed planned criminal intent against any individual or intent with a plan to commit suicide or self-harm; if a patient was judged to be at risk of sexual, emotional, or physical abuse; or where not acting on information would increase physical or emotional risk).

Training Patients

Upon the request of the REC, customized training materials were developed for patients; these were adapted from the materials developed for volunteers. The lead author followed existing best practices to maximize the accessibility, usability, and credibility of the intervention for a wide range of people, including those with lower levels of literacy or cognitive impairments [98]. Short sentences, lists, and visual formats were used, and the training interaction was tailored to each patient where appropriate.

Role of the Study Coordinator

The literature indicated that this study had the potential to generate negative feelings in the participants. The sources could be the wait, delay or expectation that their match would make contact, or difficulties encountered in dealing with the end of the study or the end of the relationship. Some organizations provide support throughout to volunteers face to face or by using technology while covering users from a wide age range [99]. Offered volunteer supervision has been described in the form of monthly multidisciplinary meetings, one-to-one supervision sessions, or telephone support [46,95-97,100]. In a previous study, when an intervention was remote, web-based support from a staff member and occasional telephone calls were found to be essential for participants to remain in the study and continue to use the digital intervention [101].

Therefore, it was decided that a study coordinator would be available for the participants, providing one-to-one access to support and supervision whenever the participants felt it was required in addition to proactively contacting all participants once per month. This would enable the provision of constant support to volunteers, who are community laypeople who could end up facing potentially unfamiliar situations that they may not know how to deal with (eg, managing patients’ behavior or difficulties with the relationship ending). Patients equally require support, although negative symptoms could make them less proactive in contacting the study coordinator. Therefore, the lead author carried an additional work phone. The number was given to all participants, and she could be reached at any time (ie, 24 hours a day and 7 days a week). The monthly contact would routinely be through an audio call; if the participants did not respond, a message would be sent asking for their availability. Although evidence suggests that reminders can improve engagement with digital interventions, there is as yet insufficient data to indicate what types of messages are most likely to promote adherence [102-104]. It also remains unclear how people will respond to these motivational messages. What one person sees as encouraging might demotivate another [105,106].

Monitoring Communication

To improve the understanding of the interactions between patients and volunteers, a practical decision was made to monitor the communication between each pair.

Although various members of the expert advisory group initially raised ethical questions about privacy, most subsequently concurred with this choice given that it offered an additional way to ensure that the content was appropriate and did not raise any safeguarding concerns.

The option of creating a technical app for communication monitoring was initially explored. After seeking quotations from different companies, it was established that a purpose-built app would be too costly. An existing app was identified that monitored the content of written communication (SMS text messages, WhatsApp messages, and emails) and the frequency and duration of audio and video calls. Through discussions with the expert advisory group, this app was purchased and used.

Monitoring Physical Activity Through Step Count

In line with the overall aim of the intervention to facilitate improvements in the participants’ mental and physical health by establishing informal communication about daily life and encouraging healthy lifestyles [107], physical activity changes were assessed in 2 ways. First, an existing app to monitor step count was installed on the smartphones. Using this, the participants could check their step count and gain awareness of their physical activity. In addition, to address potential issues of participants not always carrying the smartphone, the International Physical Activity Questionnaire [108] was administered both at the beginning and end of the study.


Principal Findings

This study reports an innovative model of intervention development using a combined approach with the MRC framework and the person-based approach, which might be followed by other researchers developing interventions.

The Phone Pal logic model was rooted in the weak ties, behavioral activation, and self-determination theories and based on 11 guiding principles and 3 mechanisms of change (ie, engagement, role model, and self-efficacy).

The three core components linked to the logic model are (1) having a match, (2) communicating remotely, and (3) using a smartphone. Each of these components consists of parts and requires characteristics to shape its existence. The characterization of the intervention components is made up of components as well and comprises (1) volunteer characteristics, (2) patient characteristics, (3) role of the volunteer, (4) role of the patient, and (5) remote connection only through a smartphone.

For the intervention development, additional components of duration, frequency, methods, and content of communication were chosen. Finally, for the operationalization of the intervention, the following components were added: matching, training, providing a study coordinator, and monitoring the participants’ communication and physical activity.

Strengths and Limitations

A main strength of this intervention development was its systematic process and consultation involving multiple methods and experts. This addresses the literature requirement for a greater focus on the developmental stage of interventions, allowing them to adapt on implementation [109,110]. It was also informed by relevant frameworks; that is, the MRC framework [28] and the person-based approach [29]. Both endorse the rigorous execution of intervention development and recommend the use of both quantitative and qualitative approaches, encouraging the lead author to combine existing evidence and use the most appropriate methods. This is of particular importance, given the increased awareness and encouragement of the publication of the development phase of interventions [111-114]. There is a notable gap in the literature relating to the systematic design of volunteer interventions despite the research conducted in this area.

Another advantage of this approach is that the intervention development involved participant perspectives throughout in the form of advisors to the research process and as study participants. This adheres to the literature recommendations that suggest that this process ensures the success of digital interventions [115,116]. Furthermore, both frameworks also emphasize the importance of collaborating with experts and clarifying how this involvement influenced the development process [117]. This logic model has been shaped following an extensive process of evidence collation and consultation with numerous stakeholders. It is also simple enough to capture the core elements necessary for this feasibility stage.

Although this approach has several strengths, it also has limitations.

The first limitation relates to the relatively linear process of intervention development in which one process informed the next (ie, a series of studies provided information for the logic model, which subsequently influenced the intervention development and operationalization).

A further potential problem with using the volunteer and patient advisory groups is that they may try to anticipate the needs of others, which they may not do well, rather than simply reporting their own experiences and views [29].

There are also potential challenges that may be faced when developing an intervention that targets different users simultaneously albeit with patients as the primary focus. Patients and volunteers vary in their characteristics. The inclusion criteria are necessarily dissimilar, and the opinions of the 2 parties may disagree on their vision of the intervention and, therefore, influence the other’s role or adherence. They may also have different beliefs about their own and others’ mental health condition or how they feel about being in contact with others. Not only may these views vary according to their role in the intervention but they may also reflect their individual characteristics (ie, age, cultural background, health condition, digital literacy, or previous experiences). To address this, the lead author spoke with a diverse range of potential users to ensure that she had insight into as many different and relevant perspectives as possible, thus enabling the intervention to be customized for all individuals.

Although the MRC framework is the most widely used approach to intervention development, it only provides a guideline for the relevant elements and the research questions to consider. It does not provide a prescriptive approach to development methodologies related to the varying contexts in which interventions can be used. In addition, there are challenges in incorporating the user perspective. The person-based approach is not intended to replace but to complement the well-known theory-based and evidence-based approaches that incorporate behavioral science into intervention development [28,118].

A potential limitation can be rooted in the intervention complexity (ie, there are numerous different types of interactions between components, a range of behaviors required by those delivering and receiving the intervention, varied targeted levels, a variety of outcomes, and a high level of flexibility and customization of the intervention [119]). It is challenging for a logic model to accurately capture this complexity. Logic models can be used to model complex interventions that adapt to context. However, it has been suggested that more flexible and dynamic models are required [27].

In addition, for clarity, the logic model portrays the main hypothesized pathways between the components, principles, mechanisms, and outcomes of the intervention. In reality, as previously acknowledged, it is likely that the intervention components operate on multiple principles and, therefore, multiple mechanisms.

Finally, as in other psychosocial interventions, the researchers had little control on how the intervention was delivered and would rely on the participants’ descriptions to assess its implementation.

Implications for Future Research

The systematic process and theoretically sound strategy through which the intervention was developed enables other researchers to see clearly how the intervention was designed and why the components were selected in line with the contextual factors that were hypothesized as influential on the necessity and acceptability of the intervention. The logic model developed in this research is relevant to the particular contextual issues present in an intervention for people with psychosis based in London. However, this could provide future researchers with a platform for adapting this to translate to other populations and settings.

The Phone Pal logic model is hypothetical and depicts how core intervention components relate to the intervention principles and hypothesized mechanisms of change. It may not be possible to determine the exact components necessary or those that might have the most impact on the outcomes. Similarly, the mechanisms of change are not fully defined. This model might be built in future research to elucidate how and why any changes might be achieved. Future research should investigate which components contribute most or are essential to a successful intervention (eg, the remote contribution with the volunteer or having a smartphone), which components are superfluous, and how the components interact to influence outcomes [28]. Although this model recognizes the potential contextual factors affecting the acceptability and necessity of this intervention, it may be that in other contexts, different challenges may emerge, requiring the adaptation of this model and modification or substitution of the current components. Future research should explore how these components operate, which principles they promote, and the associated mechanisms. It may be plausible that other components could usefully contribute. Studies rarely specify whether the factors related to the delivery context affect which components are delivered, but the factors themselves are not always easy to capture. Whether these principles are useful targets for interventions for people with other conditions or in other settings is another topic for further investigation.

Previous logic models on volunteering [120,121] have hypothesized how volunteering may operate, focusing on the organization and requirements such as the acquisition of skills and retention of volunteers. In contrast, the logic model proposed in this study is the first to outline and place a focus on the hypothesized relationships between the patient and volunteer engaging in digital and remote communication. This may be helpful for the wider conceptualization of volunteering, distancing itself from the principle of the organization and focusing on person-to-person interactions. Previously, no specific model has been conceptualized that hypothesizes the relationships between patients and volunteers either face to face or digitally. This may inspire future research to potentially construct a model that focuses on face-to-face interactions.

The operationalization of this intervention could inform future research as it provides a clear map of the processes and outcomes of the development of a digital intervention using different components.

The main implication of this intervention development is allowing for further testing in a feasibility study before the final stages of the MRC framework—evaluation and implementation.

Conclusions

The intervention development followed the MRC framework for developing complex interventions as well as the person-based approach. The intervention was developed following the evidence synthesis of a literature review, a focus group study, and a survey after consultation with advisory groups and input from a range of stakeholders, including patients, volunteers, clinicians, and academics. The developed logic model outlines the contextual factors, intervention, and short- and long-term outcomes. The operationalized intervention required matching 1 patient with 1 volunteer to communicate with each other through a smartphone via SMS text messages, WhatsApp messages, emails, and audio or video calls. All participants were encouraged to carry the smartphone throughout the day, engage in social and physical activities, and keep in contact with their usual friends. Each participant was encouraged to communicate with their match at least once per week for a 12-week period using informal conversation. The intervention provides guidance for the duration and frequency of communication (ie, once per week) but does not provide any recommendation regarding the different communication methods (ie, SMS text messages, WhatsApp messages, emails, and audio and video calls), leaving this decision completely to each patient-volunteer pair.

The findings of this study can inform future research. It presents the initial development phases of the intervention, the map of processes and outcomes from the logic model, and the actual operationalization. Practical issues faced could provide useful insights into the reality of preparing the operationalization of a digital intervention using multiple components.

Acknowledgments

This research has been supported by the National Institute for Health Research Collaboration for Leadership in Applied Health Research and Care North Thames at Barts Health National Health Service Trust and the East London National Health Service Foundation Trust.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Overview of the 4 stages of the intervention development process using an adapted version of the Medical Research Council framework and the person-based approach.

PDF File (Adobe PDF File), 599 KB

Multimedia Appendix 2

Smartphone provided during the study.

PDF File (Adobe PDF File), 392 KB

  1. A framework for the development and evaluation of RCTs for complex interventions to improve health. Medical Research Council. 2000 Apr.   URL: https:/​/www.​ntnu.no/​wiki/​download/​attachments/​53514442/​A%20Framework%20for%20development%20and%20evaluation%20of%20RCTs%20for%20Complex%20Interventions%20to%20Improve%20Health.​pdf?version=1&modificationDate=1348243868000&api=v2 [accessed 2022-05-16]
  2. Davidson KW, Goldstein M, Kaplan RM, Kaufmann PG, Knatterud GL, Orleans CT, et al. Evidence-based behavioral medicine: what is it and how do we achieve it? Ann Behav Med 2003 Dec;26(3):161-171. [CrossRef] [Medline]
  3. Sutcliffe K, Thomas J, Stokes G, Hinds K, Bangpan M. Intervention Component Analysis (ICA): a pragmatic approach for identifying the critical features of complex interventions. Syst Rev 2015 Oct 29;4:140 [FREE Full text] [CrossRef] [Medline]
  4. Wells M, Williams B, Treweek S, Coyle J, Taylor J. Intervention description is not enough: evidence from an in-depth multiple case study on the untold role and impact of context in randomised controlled trials of seven complex interventions. Trials 2012 Jun 28;13:95 [FREE Full text] [CrossRef] [Medline]
  5. Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ 2010 Mar 23;340:c332 [FREE Full text] [CrossRef] [Medline]
  6. Pino C, Boutron I, Ravaud P. Inadequate description of educational interventions in ongoing randomized controlled trials. Trials 2012 May 18;13:63 [FREE Full text] [CrossRef] [Medline]
  7. Hoffmann TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ 2013 Sep 10;347:f3755 [FREE Full text] [CrossRef] [Medline]
  8. Hooper R, Froud RJ, Bremner SA, Perera R, Eldridge S. Cascade diagrams for depicting complex interventions in randomised trials. BMJ 2013 Nov 15;347:f6681. [CrossRef] [Medline]
  9. Clark AM. What are the components of complex interventions in healthcare? Theorizing approaches to parts, powers and the whole intervention. Soc Sci Med 2013 Sep;93:185-193. [CrossRef] [Medline]
  10. Elder-Vass D. The Causal Power of Social Structures Emergence: Structure and Agency. Cambridge, UK: Cambridge University Press; 2010.
  11. Yen PY, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc 2012;19(3):413-422 [FREE Full text] [CrossRef] [Medline]
  12. Van Velsen L, Wentzel J, Van Gemert-Pijnen JE. Designing eHealth that matters via a multidisciplinary requirements development approach. JMIR Res Protoc 2013 Jun 24;2(1):e21 [FREE Full text] [CrossRef] [Medline]
  13. Iivari J, Isomäki H, Pekkola S. The user – the great unknown of systems development: reasons, forms, challenges, experiences and intellectual contributions of user involvement. Inf Syst J 2010 Mar;20(2):109-117. [CrossRef]
  14. Pinto da Costa M, Foster R, Gillard S, Priebe S. Volunteering in mental health. In: Okpaku SO, editor. Innovations in Global Mental Health. Cham, Switzerland: Springer; 2020:1-28. [CrossRef]
  15. Ruggeri M, Leese M, Thornicroft G, Bisoffi G, Tansella M. Definition and prevalence of severe and persistent mental illness. Br J Psychiatry 2000 Aug;177:149-155. [CrossRef] [Medline]
  16. Rotondi V, Stanca L, Tomasuolo M. Connecting alone: smartphone use, quality of social interactions and well-being. J Econ Psychol 2017 Dec;63:17-26. [CrossRef]
  17. Stuckey MI, Carter SW, Knight E. The role of smartphones in encouraging physical activity in adults. Int J Gen Med 2017 Sep 12;10:293-303 [FREE Full text] [CrossRef] [Medline]
  18. Bedrov A, Bulaj G. Improving self-esteem with motivational quotes: opportunities for digital health technologies for people with chronic disorders. Front Psychol 2018 Nov 2;9:2126 [FREE Full text] [CrossRef] [Medline]
  19. Thomée S. Mobile phone use and mental health. A review of the research that takes a psychological perspective on exposure. Int J Environ Res Public Health 2018 Nov 29;15(12):2692 [FREE Full text] [CrossRef] [Medline]
  20. Aledavood T, Torous J, Triana Hoyos AM, Naslund JA, Onnela JP, Keshavan M. Smartphone-based tracking of sleep in depression, anxiety, and psychotic disorders. Curr Psychiatry Rep 2019 Jun 04;21(7):49 [FREE Full text] [CrossRef] [Medline]
  21. Abayomi O, Adelufosi A, Olajide A. Changing attitude to mental illness among community mental health volunteers in south-western Nigeria. Int J Soc Psychiatry 2013 Sep;59(6):609-612. [CrossRef] [Medline]
  22. Pinto da Costa M, Chevalier A, Farreny A, Cassidy M, Leverton M, Toner S, et al. How would patients with psychosis like to be in contact with a volunteer: face-to-face or digitally? PLoS One 2019 May 16;14(5):e0216929 [FREE Full text] [CrossRef] [Medline]
  23. Pinto da Costa M. Can social isolation caused by physical distance in people with psychosis be overcome through a Phone Pal? Eur Psychiatry 2020 May 22;63(1):e61 [FREE Full text] [CrossRef] [Medline]
  24. User empowerment in mental health – a statement by the WHO Regional Office for Europe. World Health Organization. 2010.   URL: https://www.euro.who.int/__data/assets/pdf_file/0020/113834/E93430.pdf [accessed 2022-05-16]
  25. Pinto da Costa M, Phone Pal Advisory Groups. Volunteering via smart-phone for people with psychosis-protocol of a feasibility trial. Front Psychiatry 2021 Nov 30;12:742202 [FREE Full text] [CrossRef] [Medline]
  26. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ 2015 Mar 19;350:h1258 [FREE Full text] [CrossRef] [Medline]
  27. Mills T, Lawton R, Sheard L. Advancing complexity science in healthcare research: the logic of logic models. BMC Med Res Methodol 2019 Mar 12;19(1):55 [FREE Full text] [CrossRef] [Medline]
  28. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M, Medical Research Council Guidance. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ 2008 Sep 29;337:a1655 [FREE Full text] [CrossRef] [Medline]
  29. Yardley L, Morrison L, Bradbury K, Muller I. The person-based approach to intervention development: application to digital health-related behavior change interventions. J Med Internet Res 2015 Jan 30;17(1):e30 [FREE Full text] [CrossRef] [Medline]
  30. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol 2005 Feb;8(1):19-32. [CrossRef]
  31. Khangura S, Polisena J, Clifford TJ, Farrah K, Kamel C. Rapid review: an emerging approach to evidence synthesis in health technology assessment. Int J Technol Assess Health Care 2014 Jan;30(1):20-27. [CrossRef] [Medline]
  32. Pinto da Costa M. Volunteering in mental health - towards a new model of support, in Barts and the London School of Medicine and Dentistry. Queen Mary University of London. 2020.
  33. Pinto da Costa M, Conneely M, Monteiro da Silva F, Toner S. Stakeholders' views on volunteering in mental health: an international focus group study. BMJ Open 2022 Mar 17;12(3):e052185 [FREE Full text] [CrossRef] [Medline]
  34. Pinto da Costa M. Conducting cross-cultural, multi-lingual and multi-country focus groups: guidance for researchers. Int J Qual Methods 2021 Nov 05;20:160940692110499. [CrossRef]
  35. Hoddinott P, Pollock A, O'Cathain A, Boyer I, Taylor J, MacDonald C, et al. How to incorporate patient and public perspectives into the design and conduct of research. F1000Res 2018 Jun 18;7:752 [FREE Full text] [CrossRef] [Medline]
  36. Manafò E, Petermann L, Vandall-Walker V, Mason-Lai P. Patient and public engagement in priority setting: a systematic rapid review of the literature. PLoS One 2018 Mar 2;13(3):e0193579 [FREE Full text] [CrossRef] [Medline]
  37. Goldsmith LP, Morshead R, McWilliam C, Forbes G, Ussher M, Simpson A, et al. Co-producing randomized controlled trials: how do we work together? Front Sociol 2019 Mar 29;4:21 [FREE Full text] [CrossRef] [Medline]
  38. Befriending Networks.   URL: https://www.befriending.co.uk/ [accessed 2022-05-17]
  39. Simpson A, Jones J, Barlow S, Cox L, Service User and Carer Group Advising on Research (SUGAR). Adding SUGAR: service user and carer collaboration in mental health nursing research. J Psychosoc Nurs Ment Health Serv 2014 Jan;52(1):22-30. [CrossRef] [Medline]
  40. Hallett C, Klug G, Lauber C, Priebe S. Volunteering in the care of people with severe mental illness: a systematic review. BMC Psychiatry 2012 Dec 13;12:226 [FREE Full text] [CrossRef] [Medline]
  41. Toner S, Hickling LM, Pinto da Costa M, Cassidy M, Priebe S. Characteristics, motivations and experiences of volunteer befrienders for people with mental illness: a systematic review and narrative synthesis. BMC Psychiatry 2018 Dec 04;18(1):378 [FREE Full text] [CrossRef] [Medline]
  42. Bussell H, Forbes D. Understanding the volunteer market: the what, where, who and why of volunteering. Int J Nonprofit Volunt Sect Mark 2002 Sep;7(3):244-257. [CrossRef]
  43. Naslund JA, Aschbrenner KA, Marsch LA, Bartels SJ. The future of mental health care: peer-to-peer support and social media. Epidemiol Psychiatr Sci 2016 Apr;25(2):113-122 [FREE Full text] [CrossRef] [Medline]
  44. McCorkle BH, Dunn EC, Wan YM, Gagne C. Compeer friends: a qualitative study of a volunteer friendship programme for people with serious mental illness. Int J Soc Psychiatry 2009 Jul;55(4):291-305. [CrossRef] [Medline]
  45. Mitchell G, Pistrang N. Befriending for mental health problems: processes of helping. Psychol Psychother 2011 Jun;84(2):151-169. [CrossRef] [Medline]
  46. Copello AG, Velleman RD, Howling VM. The use of volunteers as befrienders within a community alcohol team. J Subst Misuse 2009 Jul 12;3(4):189-199. [CrossRef]
  47. Faulkner M, Davies S. Social support in the healthcare setting: the role of volunteers. Health Soc Care Community 2005 Jan;13(1):38-45. [CrossRef] [Medline]
  48. Langford CP, Bowsher J, Maloney JP, Lillis PP. Social support: a conceptual analysis. J Adv Nurs 1997 Jan;25(1):95-100. [CrossRef] [Medline]
  49. Heller K, Thompson MG, Trueba PE, Hogg JR, Vlachos-Weber I. Peer support telephone dyads for elderly women: was this the wrong intervention? Am J Community Psychol 1991 Feb;19(1):53-74. [CrossRef] [Medline]
  50. Garety PA, Kuipers E, Fowler D, Freeman D, Bebbington PE. A cognitive model of the positive symptoms of psychosis. Psychol Med 2001 Feb;31(2):189-195. [CrossRef] [Medline]
  51. White R, Bebbington P, Pearson J, Johnson S, Ellis D. The social context of insight in schizophrenia. Soc Psychiatry Psychiatr Epidemiol 2000 Nov;35(11):500-507. [CrossRef] [Medline]
  52. Mgutshini T. Risk factors for psychiatric re-hospitalization: an exploration. Int J Ment Health Nurs 2010 Aug;19(4):257-267. [CrossRef] [Medline]
  53. DeNiro DA. Perceived alienation in individuals with residual-type schizophrenia. Issues Ment Health Nurs 1995;16(3):185-200. [CrossRef] [Medline]
  54. Arnold C, Villagonzalo KA, Meyer D, Farhall J, Foley F, Kyrios M, et al. Predicting engagement with an online psychosocial intervention for psychosis: exploring individual- and intervention-level predictors. Internet Interv 2019 Aug 15;18:100266 [FREE Full text] [CrossRef] [Medline]
  55. Inkster B, Stillwell D, Kosinski M, Jones P. A decade into Facebook: where is psychiatry in the digital age? Lancet Psychiatry 2016 Nov;3(11):1087-1090. [CrossRef] [Medline]
  56. Cole-Lewis H, Kershaw T. Text messaging as a tool for behavior change in disease prevention and management. Epidemiol Rev 2010;32(1):56-69 [FREE Full text] [CrossRef] [Medline]
  57. Woolford SJ, Barr KL, Derry HA, Jepson CM, Clark SJ, Strecher VJ, et al. OMG do not say LOL: obese adolescents' perspectives on the content of text messages to enhance weight loss efforts. Obesity (Silver Spring) 2011 Dec;19(12):2382-2387 [FREE Full text] [CrossRef] [Medline]
  58. Napolitano MA, Hayes S, Bennett GG, Ives AK, Foster GD. Using Facebook and text messaging to deliver a weight loss program to college students. Obesity (Silver Spring) 2013 Jan;21(1):25-31 [FREE Full text] [CrossRef] [Medline]
  59. Schrank B, Sibitz I, Unger A, Amering M. How patients with schizophrenia use the internet: qualitative study. J Med Internet Res 2010 Dec 19;12(5):e70 [FREE Full text] [CrossRef] [Medline]
  60. Ainsworth J, Palmier-Claus JE, Machin M, Barrowclough C, Dunn G, Rogers A, et al. A comparison of two delivery modalities of a mobile phone-based assessment for serious mental illness: native smartphone application vs text-messaging only implementations. J Med Internet Res 2013 Apr 05;15(4):e60 [FREE Full text] [CrossRef] [Medline]
  61. Firth J, Torous J. Smartphone apps for schizophrenia: a systematic review. JMIR Mhealth Uhealth 2015 Nov 06;3(4):e102 [FREE Full text] [CrossRef] [Medline]
  62. Gay K, Torous J, Joseph A, Pandya A, Duckworth K. Digital technology use among individuals with schizophrenia: results of an online survey. JMIR Ment Health 2016 May 04;3(2):e15 [FREE Full text] [CrossRef] [Medline]
  63. Sharp IR, Kobak KA, Osman DA. The use of videoconferencing with patients with psychosis: a review of the literature. Ann Gen Psychiatry 2011 Apr 18;10(1):14 [FREE Full text] [CrossRef] [Medline]
  64. Depp CA, Mausbach B, Granholm E, Cardenas V, Ben-Zeev D, Patterson TL, et al. Mobile interventions for severe mental illness: design and preliminary data from three approaches. J Nerv Ment Dis 2010 Oct;198(10):715-721 [FREE Full text] [CrossRef] [Medline]
  65. Kimhy D, Corcoran C. Use of Palm computer as an adjunct to cognitive-behavioural therapy with an ultra-high-risk patient: a case report. Early Interv Psychiatry 2008 Nov;2(4):234-241 [FREE Full text] [CrossRef] [Medline]
  66. Granholm E, Ben-Zeev D, Link PC, Bradshaw KR, Holden JL. Mobile Assessment and Treatment for Schizophrenia (MATS): a pilot trial of an interactive text-messaging intervention for medication adherence, socialization, and auditory hallucinations. Schizophr Bull 2012 May;38(3):414-425 [FREE Full text] [CrossRef] [Medline]
  67. Hatfield E, Rapson RL. From pen pals to chat rooms: the impact of social media on Middle Eastern Society. SpringerPlus 2015 Jun 12;4(1):254. [CrossRef] [Medline]
  68. Oinas-Kukkonen H, Harjumaa M. Persuasive Systems Design: key issues, process model, and system features. Commun Assoc Inf Syst 2009;24(1):28. [CrossRef]
  69. Ng MM, Firth J, Minen M, Torous J. User engagement in mental health apps: a review of measurement, reporting, and validity. Psychiatr Serv 2019 Jul 01;70(7):538-544 [FREE Full text] [CrossRef] [Medline]
  70. Bradstreet S. Developing engaging online interventions for people with psychosis. The Mental Elf. 2019.   URL: https:/​/www.​nationalelfservice.net/​treatment/​digital-health/​developing-engaging-online-interventions-for-people-with-psychosis/​ [accessed 2022-05-16]
  71. Fleming T, Bavin L, Lucassen M, Stasiak K, Hopkins S, Merry S. Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res 2018 Jun 06;20(6):e199 [FREE Full text] [CrossRef] [Medline]
  72. Kuo KM, Chen YC, Talley PC, Huang CH. Continuance compliance of privacy policy of electronic medical records: the roles of both motivation and habit. BMC Med Inform Decis Mak 2018 Dec 18;18(1):135 [FREE Full text] [CrossRef] [Medline]
  73. Kanter JW, Manos RC, Bowe WM, Baruch DE, Busch AM, Rusch LC. What is behavioral activation? A review of the empirical literature. Clin Psychol Rev 2010 Aug;30(6):608-620. [CrossRef] [Medline]
  74. Granovetter MS. The strength of weak ties. Am J Sociol 1973 May;78(6):1360-1380. [CrossRef]
  75. Morgenroth T, Ryan MK, Peters K. The motivational theory of role modeling: how role models influence role aspirants’ goals. Rev Gen Psychol 2015 Dec 01;19(4):465-483. [CrossRef]
  76. Deci EL, Ryan RM. The "What" and "Why" of goal pursuits: human needs and the self-determination of behavior. Psychol Inq 2000 Oct;11(4):227-268. [CrossRef]
  77. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [CrossRef] [Medline]
  78. Flay BR, Petraitis J. The theory of triadic influence: a new theory of health behavior with implications for preventive interventions. Adv Med Sociol 1994;4:19-44. [CrossRef]
  79. Bassett Jr DR, Toth LP, LaMunion SR, Crouter SE. Step counting: a review of measurement considerations and health-related applications. Sports Med 2017 Jul;47(7):1303-1315 [FREE Full text] [CrossRef] [Medline]
  80. Tison GH, Marcus GM. Will the smartphone become a useful tool to promote physical activity? Lancet Digit Health 2019 Nov;1(7):e322-e323 [FREE Full text] [CrossRef] [Medline]
  81. Evans WD, Harrington C, Patchen L, Andrews V, Gaminian A, Ellis LP, et al. Design of a novel digital intervention to promote healthy weight management among postpartum African American women. Contemp Clin Trials Commun 2019 Oct 3;16:100460 [FREE Full text] [CrossRef] [Medline]
  82. Lindsay S, Cagliostro E, Leck J, Stinson J. A 12-week electronic mentoring employment preparation intervention for youth with physical disabilities: pilot feasibility randomized controlled trial. JMIR Pediatr Parent 2019 Mar 29;2(1):e12088 [FREE Full text] [CrossRef] [Medline]
  83. McGregor KM, Crosson B, Mammino K, Omar J, García PS, Nocera JR. Influences of 12-week physical activity interventions on TMS measures of cortical network inhibition and upper extremity motor performance in older adults-a feasibility study. Front Aging Neurosci 2017 Jan 4;9:422 [FREE Full text] [CrossRef] [Medline]
  84. Peyman N, Rezai-Rad M, Tehrani H, Gholian-Aval M, Vahedian-Shahroodi M, Heidarian Miri H. Digital Media-based Health Intervention on the promotion of Women's physical activity: a quasi-experimental study. BMC Public Health 2018 Jan 15;18(1):134 [FREE Full text] [CrossRef] [Medline]
  85. Shvedko AV, Thompson JL, Greig CA, Whittaker AC. Physical Activity Intervention for Loneliness (PAIL) in community-dwelling older adults: protocol for a feasibility study. Pilot Feasibility Stud 2018 Dec 19;4:187 [FREE Full text] [CrossRef] [Medline]
  86. Tsai HH, Tsai YF. Changes in depressive symptoms, social support, and loneliness over 1 year after a minimum 3-month videoconference program for older nursing home residents. J Med Internet Res 2011 Nov 15;13(4):e93 [FREE Full text] [CrossRef] [Medline]
  87. Lal S, Dell'Elce J, Tucci N, Fuhrer R, Tamblyn R, Malla A. Preferences of young adults with first-episode psychosis for receiving specialized mental health services using technology: a survey study. JMIR Ment Health 2015 May 20;2(2):e18 [FREE Full text] [CrossRef] [Medline]
  88. Dennison L, Morrison L, Conway G, Yardley L. Opportunities and challenges for smartphone applications in supporting health behavior change: qualitative study. J Med Internet Res 2013 Apr 18;15(4):e86 [FREE Full text] [CrossRef] [Medline]
  89. Schwartz B. Self-determination. The tyranny of freedom. Am Psychol 2000 Jan;55(1):79-88. [CrossRef] [Medline]
  90. Crutzen R, Cyr D, de Vries NK. The role of user control in adherence to and knowledge gained from a website: randomized comparison between a tunneled version and a freedom-of-choice version. J Med Internet Res 2012 Mar 09;14(2):e45 [FREE Full text] [CrossRef] [Medline]
  91. Kelders SM, Kok RN, Ossebaard HC, Van Gemert-Pijnen JE. Persuasive system design does matter: a systematic review of adherence to Web-based interventions. J Med Internet Res 2012 Nov 14;14(6):e152 [FREE Full text] [CrossRef] [Medline]
  92. Priebe S, Pavlickova H, Eldridge S, Golden E, McCrone P, Ockenden N, et al. Effectiveness of one-to-one volunteer support for patients with psychosis: protocol of a randomised controlled trial. BMJ Open 2016 Aug 03;6(8):e011582 [FREE Full text] [CrossRef] [Medline]
  93. Armstrong J. How effective are minimally trained/experienced volunteer mental health counsellors? Evaluation of CORE outcome data. Couns Psychother Res 2010 Mar;10(1):22-31. [CrossRef]
  94. Kingdon DG, Turkington D, Collis J, Judd M. Befriending: cost-effective community care. Psychiatr Bull 1989;13(7):350-351. [CrossRef]
  95. McGowan B, Jowett C. Promoting positive mental health through befriending. Int J Ment Health Promot 2003;5(2):12-24. [CrossRef]
  96. Tombs D, Stowers C, Faibank S, Akrill T. A befriending service for individuals with complex, enduring mental health problems. Clin Psychol 2003 Aug;BPS Montlhy Division(28):33-36.
  97. Brackhane R, Strehl C, Wurzer I. [Lay help in rehabilitation of psychiatrically handicapped patients--report of two comparative empirical studies]. Rehabilitation (Stuttg) 1990 Nov;29(4):254-260. [Medline]
  98. Rotondi AJ, Sinkule J, Haas GL, Spring MB, Litschge CM, Newhill CE, et al. Designing websites for persons with cognitive deficits: design and usability of a psychoeducational intervention for persons with severe mental illness. Psychol Serv 2007 Aug;4(3):202-224 [FREE Full text] [CrossRef] [Medline]
  99. Sundram F, Corattur T, Dong C, Zhong K. Motivations, expectations and experiences in being a mental health helplines volunteer. Int J Environ Res Public Health 2018 Sep 27;15(10):2123 [FREE Full text] [CrossRef] [Medline]
  100. Margaret ME, Goldberg MS, Anne S, Evans SM, Katherine H, Cole SM. The utilization and training of volunteers in a psychiatric setting. Br J Soc Work 1973:55-63. [CrossRef]
  101. Lobban F, Dodd AL, Sawczuk AP, Asar O, Dagnan D, Diggle PJ, et al. Assessing feasibility and acceptability of Web-based enhanced relapse prevention for bipolar disorder (ERPonline): a randomized controlled trial. J Med Internet Res 2017 Mar 24;19(3):e85 [FREE Full text] [CrossRef] [Medline]
  102. Fry JP, Neff RA. Periodic prompts and reminders in health promotion and health behavior interventions: systematic review. J Med Internet Res 2009 May 14;11(2):e16 [FREE Full text] [CrossRef] [Medline]
  103. Whitton AE, Proudfoot J, Clarke J, Birch MR, Parker G, Manicavasagar V, et al. Breaking open the black box: isolating the most potent features of a Web and mobile phone-based intervention for depression, anxiety, and stress. JMIR Ment Health 2015 Mar 4;2(1):e3 [FREE Full text] [CrossRef] [Medline]
  104. Alkhaldi G, Hamilton FL, Lau R, Webster R, Michie S, Murray E. The effectiveness of prompts to promote engagement with digital interventions: a systematic review. J Med Internet Res 2016 Jan 08;18(1):e6 [FREE Full text] [CrossRef] [Medline]
  105. Hsu A, Blandford A. Designing for psychological change: individuals' reward and cost valuations in weight management. J Med Internet Res 2014 Jun 26;16(6):e138 [FREE Full text] [CrossRef] [Medline]
  106. Walsh S, Golden E, Priebe S. Systematic review of patients' participation in and experiences of technology-based monitoring of mental health symptoms in the community. BMJ Open 2016 Jun 21;6(6):e008362 [FREE Full text] [CrossRef] [Medline]
  107. Maj M. Physical health care in persons with severe mental illness: a public health and ethical priority. World Psychiatry 2009 Feb;8(1):1-2 [FREE Full text] [CrossRef] [Medline]
  108. Craig CL, Marshall AL, Sjöström M, Bauman AE, Booth ML, Ainsworth BE, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc 2003 Aug;35(8):1381-1395. [CrossRef] [Medline]
  109. Ling T. Evaluating complex and unfolding interventions in real time. Evaluation 2012 Jan 22;18(1):79-91. [CrossRef]
  110. Fletcher A, Jamal F, Moore G, Evans RE, Murphy S, Bonell C. Realist complex intervention science: applying realist principles across all phases of the Medical Research Council framework for developing and evaluating complex interventions. Evaluation (Lond) 2016 Jul;22(3):286-303 [FREE Full text] [CrossRef] [Medline]
  111. Biagianti B, Hidalgo-Mazzei D, Meyer N. Developing digital interventions for people living with serious mental illness: perspectives from three mHealth studies. Evid Based Ment Health 2017 Nov;20(4):98-101 [FREE Full text] [CrossRef] [Medline]
  112. Bradbury K, Steele M, Corbett T, Geraghty AW, Krusche A, Heber E, et al. Developing a digital intervention for cancer survivors: an evidence-, theory- and person-based approach. NPJ Digit Med 2019 Sep 2;2:85 [FREE Full text] [CrossRef] [Medline]
  113. Dack C, Ross J, Stevenson F, Pal K, Gubert E, Michie S, et al. A digital self-management intervention for adults with type 2 diabetes: combining theory, data and participatory design to develop HeLP-Diabetes. Internet Interv 2019 Sep;17:100241 [FREE Full text] [CrossRef] [Medline]
  114. Kassavou A, Houghton V, Edwards S, Brimicombe J, Sutton S. Development and piloting of a highly tailored digital intervention to support adherence to antihypertensive medications as an adjunct to primary care consultations. BMJ Open 2019 Jan 06;9(1):e024121 [FREE Full text] [CrossRef] [Medline]
  115. Kujala S. User involvement: a review of the benefits and challenges. Behav Inf Technol 2003 Jan;22(1):1-16. [CrossRef]
  116. De Vito Dabbs A, Myers BA, Mc Curry KR, Dunbar-Jacob J, Hawkins RP, Begey A, et al. User-centered design and interactive health technologies for patients. Comput Inform Nurs 2009;27(3):175-183 [FREE Full text] [CrossRef] [Medline]
  117. Hoddinott P. A new era for intervention development studies. Pilot Feasibility Stud 2015 Oct 26;1:36 [FREE Full text] [CrossRef] [Medline]
  118. Kok G, Schaalma H. Using theory in psychological interventions. In: Michie S, Abraham C, editors. Health Psychology in Practice. Hoboken, NJ, USA: Blackwell Publishing; 2004:203-229.
  119. Lewin S, Hendry M, Chandler J, Oxman AD, Michie S, Shepperd S, et al. Assessing the complexity of interventions within systematic reviews: development, content and use of a new tool (iCAT_SR). BMC Med Res Methodol 2017 Apr 26;17(1):76 [FREE Full text] [CrossRef] [Medline]
  120. Logic Model Volunteer project support 2015. Wikimedia. 2015.   URL: https:/​/upload.​wikimedia.org/​wikipedia/​commons/​b/​b8/​Logic_Model_Volunteer_project_support_2015_final.​pdf [accessed 2022-05-16]
  121. Volunteer Management: Using a Logic Model - The National Long-Term Care Ombudsman Resource Center. National Association of Area Agencies on Aging. 2017.   URL: https://ltcombudsman.org/uploads/files/support/vol-mgt-oct-24.pdf [accessed 2022-05-16]


CONSORT: Consolidated Standards of Reporting Trials
MRC: Medical Research Council
REC: Research Ethics Committee
SMI: severe mental illness


Edited by A Mavragani; submitted 20.11.21; peer-reviewed by J Ibrahim, M Brown; comments to author 25.01.22; revised version received 16.03.22; accepted 17.03.22; published 02.06.22

Copyright

©Mariana Pinto da Costa, Phone Pal Advisory Groups. Originally published in JMIR Formative Research (https://formative.jmir.org), 02.06.2022.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.