Original Paper
Abstract
Background: Youth in Southern Africa face a high burden of HIV and sexually transmitted infections, yet they exhibit low uptake of health care services.
Objective: The Zvatinoda! intervention, co-designed with youth, aims to increase the demand for and utilization of health services among 18-24-year-olds in Chitungwiza, Zimbabwe.
Methods: The intervention utilized mobile phone–based discussion groups, complemented by “ask the expert” sessions. Peer facilitators, supported by an “Auntie,” led youth in anonymous online chats on health topics prioritized by the participants. Feedback on youth needs was compiled and shared with health care providers. The intervention was tested in a 12-week feasibility study involving 4 groups of 7 youth each, totaling 28 participants (n=14, 50%, female participants), to evaluate feasibility and acceptability. Mixed methods process evaluation data included pre- and postintervention questionnaires (n=28), in-depth interviews with participants (n=15) and peer facilitators (n=4), content from discussion group chats and expert guest sessions (n=24), facilitators’ debrief meetings (n=12), and a log of technical challenges. Descriptive quantitative analysis and thematic qualitative analysis were conducted. The RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework was adapted to analyze and present findings on (1) reach, (2) potential efficacy, (3) adoption, (4) implementation, and (5) maintenance.
Results: Mobile delivery facilitated engagement with diverse groups, even during COVID-19 lockdowns (reach). Health knowledge scores improved from pre- to postintervention across 9 measures. Preintervention scores varied from 14% (4/28) for contraception to 86% (24/28) for HIV knowledge. After the intervention, all knowledge scores reached 100% (28/28). Improvements were observed across 10 sexual and reproductive health (SRH) self-efficacy measures. The most notable changes were in the ability to start a conversation about SRH with older adults in the family, which increased from 50% (14/28) preintervention to 86% (24/28) postintervention. Similarly, the ability to use SRH services even if a partner does not agree rose from 57% (16/28) preintervention to 89% (25/28) postintervention. Self-reported attendance at a health center in the past 3 months improved from 32% (9/28) preintervention to 86% (24/28) postintervention (potential efficacy). Chat participation varied, largely due to network challenges and school/work commitments. The key factors facilitating peer learning were interaction with other youth, the support of an older, knowledgeable “Auntie,” and the anonymity of the platform. As a result of COVID-19 restrictions, regular feedback to providers was not feasible. Instead, youth conveyed their needs to stakeholders through summaries of key themes from chat groups and a music video presented at a final in-person workshop (adoption and implementation). Participation in discussions decreased over time. To maintain engagement, introducing an in-person element was suggested (maintenance).
Conclusions: The Zvatinoda! intervention proved both acceptable and feasible, showing promise for enhancing young people’s knowledge and health-seeking behavior. Potential improvements include introducing in-person discussions once the virtual group has established rapport and enhancing feedback and dialog with service providers.
doi:10.2196/53034
Keywords
Introduction
Improving young people’s engagement with health services is important not only to reduce morbidity and mortality but also to enhance future health and well-being [
, ]. The relatively low demand for health services, combined with poor acceptability and accessibility, results in a lower uptake of preventive and treatment services among young people compared with children and adults [ , ]. In Zimbabwe, 31.9% of the population is aged 10-25 years [ ]. Young people’s health needs include preventive services (eg, young women are most at risk for new HIV infections), treatment services, and reproductive services (22% of 15-19-year-olds have started childbearing) [ ]. However, barriers to health service accessibility for young people in Zimbabwe are user fees (currently approximately US $5 per consultation at urban municipal clinics), overburdened clinics, health care providers perceived as judgmental, a tendency to seek health care only when ill, and fear of diagnosis [ , ].Despite the recognition of the importance of youth-friendly health services 2 decades ago [
], progress has been slow [ , ]. Communication between young people and health care providers regarding their health needs remains minimal [ ]. In Zimbabwe, Health Centre Committees, comprising key community leaders and stakeholders (including local and traditional leaders, village health workers, teachers, and older individuals), strengthen community-facility linkages and provide a platform to raise community preferences and needs for high-quality health care services [ ]. Despite being an underserved and growing stakeholder group, young people are underrepresented in such forums, and no formal mechanism exists to provide feedback on their needs and preferences to health care providers and decision makers.Digital health interventions, including online or phone support, are an increasingly common method to connect young people to sexual and reproductive health (SRH) information and services [
]. Systematic reviews of young people’s health have concluded that targeted digital media interventions have the potential to improve SRH knowledge and access to SRH services. However, a greater understanding of the implementation and cost-effectiveness of these interventions is needed [ , ]. The potential for digital health interventions in Zimbabwe has increased since 2020, as COVID-19 restrictions constrained in-person interventions and interactions, while young people’s health needs did not decrease. In 2018, phone ownership among 13-24-year-olds in Harare was 63%, with 11% of those without a phone reporting using a shared phone [ ]. Phone ownership increased with age, reaching 72% among 18-19-year-olds and 85% among 20-24-year-olds [ ]. Recommendations for the development of digital health interventions underscore the importance of young people’s input to ensure the success of health interventions targeting them, including involving young people from the design phase [ ]. Co-designing interventions with young people increases the likelihood of acceptability and uptake [ ].The Zvatinoda! (“What we want!” in Shona) study aimed to co-design an intervention with young people (aged 18-24 years) and key adults in their lives to improve both the demand for and uptake of essential health services by young people in Zimbabwe. This paper reports on the process evaluation of the Zvatinoda! feasibility study. The process evaluation assessed the intervention’s reach, potential efficacy, adoption, implementation, and maintenance, drawing from the RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework [
, ].Methods
Study Design
The feasibility study of the Zvatinoda! intervention was conducted over 12 weeks, from July to October 2021.
Participants
A total of 28 participants were recruited from the geographical catchment area of Zengeza and Seke North municipal clinics, located in Chitungwiza, a high-density suburb of Harare, Zimbabwe. Zengeza and Seke North are periurban satellite communities characterized by fragmented and mixed urban and rural neighborhoods, with both formal and informal housing settlements. Participants were initially recruited at youth hangouts and then through snowball sampling to purposefully include a diverse group of young people (aged 18-24 years), considering factors such as age, gender, HIV status, and disability.
Zvatinoda! Intervention
The intervention consisted of mobile phone–based discussion groups tested with 4 groups of 7 young people each, using Rocket.Chat (Rocket.Chat Holdings, Ltd.), a messaging platform that allows users to choose usernames (pseudonyms) for anonymity [
]. The intervention aimed to both generate service demand among young people and facilitate communication between them and health system stakeholders to improve the quality of health services for young people.Zvatinoda! Intervention Co-Design
The intervention was adapted from 2 previously trialed models that used anonymous mobile chats to provide peer-to-peer psychosocial support or involved an ‘Auntie’ who offered confidential information, counseling, and health service referrals in Zimbabwe [
- ]. The adapted intervention was co-designed with peer facilitators as well as key community and health system stakeholders. The co-design process included (1) community mapping through transect walks to identify risk “hotspots” and available health services; (2) in-depth interviews with young people and health service providers; (3) participatory action research workshops with 25 young people at each of the 2 study sites to prioritize health topics for the discussion curriculum, determine implementation modalities of mobile chat groups (including frequency, facilitation, and safeguarding), and identify preferred methods for providing feedback to health system stakeholders; and (4) a participatory action research workshop with 6 health care workers.The 8 peer facilitators were selected through a 4-stage process involving (1) community sensitization about the Zvatinoda! project and the role of the peer facilitators; (2) self-nomination by young people aged 18-24 years as candidates; (3) short oral presentations by candidates describing their skills, strengths, and interest in peer facilitation; and (4) community voting to select the 8 peer facilitators, conducted by community and health system stakeholders (n=7) and young people (n=39) [
].Intervention Delivery
Each mobile phone–based discussion group was facilitated by 2 peer facilitators (aged 19-24) and supervised by 1 adult research team member to address any harmful discussion content. Participants collectively decided on the best time for the mobile chat group discussions.
The discussion curriculum, developed during the participatory action research workshops, focused each week on a different health-related topic. Topics included relationships, pregnancy, family planning, sexually transmitted infections, HIV, cervical cancer, male circumcision, sexual abuse, substance abuse, mental health, gender-based violence, personal hygiene, and COVID-19. An adult guest expert joined each week for a live 1-hour chat session, during which participants could ask questions anonymously. Individuals who were unable to attend the expert chat sessions or who experienced network issues could access the discussion content later.
To include youth participants who did not have phones, all participants were provided with project phones, which could only be used for the Rocket.Chat app, and a data allowance for the duration of the intervention.
Monthly in-person and virtual feedback sessions with health care workers and community members were planned. During the co-design process, young people expressed a preference for direct feedback mechanisms to health care professionals rather than mediated feedback. A final face-to-face participatory workshop with peer facilitators, health care providers, and community members was planned to discuss young people’s health needs and potential improvements to health service delivery.
Mixed Methods Process Evaluation Data Collection
The feasibility study was evaluated using a mixed methods process evaluation. The following data sources were utilized: quantitative pre- and postintervention questionnaires (n=28), in-depth interviews with participants (n=15) and peer facilitators (n=4), discussion group chats and expert guest sessions (n=24), facilitator debrief meetings (n=12), and a log of technical challenges.
A pre- and postintervention questionnaire, programmed in Open Data Kit (Get ODK), was self-completed by all 28 participants on tablets at the beginning and end of the 12-week feasibility study. A research staff member was present to assist with any queries. The questionnaire assessed participants’ experiences with the discussion groups and measured key outcomes, including SRH literacy, SRH self-efficacy, SRH service uptake, and perceptions of the youth-friendliness of services. Additional questions on sources of SRH information, aspirations, self-esteem, and perceived social support were included in the questionnaire but are not reported in this paper.
We also invited 15 participants to participate in in-depth interviews to understand their experiences with the Zvatinoda! intervention. These interviews aimed to explore their engagement with the program, perceptions of the curriculum topics, facilitators, expert sessions, their experiences with the phones, and the perceived impact of the intervention on both themselves and young people’s health services. Interview participants were purposively selected to represent a range of ages, genders, participation levels from across the 4 groups (including both active and quieter participants), and any individuals with particularly interesting characteristics or stories. Additionally, 4 peer facilitators participated in in-depth interviews with aims similar to those of the participant interviews, but with a focus on their experiences of facilitation. These interviews were conducted by a trained qualitative researcher; lasted between 30 and 60 minutes; and were audio recorded, transcribed, and translated.
The discussion group chats were downloaded and analyzed weekly in analysis reports. These reports aimed to identify key themes discussed, record the level and type of interaction within the group, assess whether discussions remained on the agreed weekly topic, and note any challenges encountered. Each week, 2 out of the 4 groups were analyzed in detail on an alternating basis, and a higher-level analysis report summarizing the main themes from all 4 groups was prepared. The process of delivering the intervention was documented through notes from weekly facilitator debrief meetings held during the feasibility study. Additionally, a log of technical challenges was maintained throughout the study.
Data Analysis
We adapted the RE-AIM framework for analysis to assess the (1) reach, (2) potential efficacy, (3) adoption, (4) implementation, and (5) maintenance of the intervention within the feasibility study [
, ]. For reach, we evaluated the diversity of participants and the potential reach of the intervention if scaled. Given the small scale of the feasibility study, we focused on potential efficacy rather than effectiveness to assess the intervention’s impact on key outcomes for the 28 participants. For adoption, we adapted the RE-AIM framework’s focus from settings that adopt the intervention to assess adoption among participants, which was more relevant to this feasibility study. For implementation, we modified the framework to evaluate factors affecting intervention acceptability, fidelity to the intervention protocol, and the delivery of the intervention. For maintenance, we assessed the potential for the intervention to have a long-term impact.Qualitative data were coded using the 5 adapted pillars of the RE-AIM framework as main deductive themes. After familiarizing ourselves with a subset of the qualitative data, inductive subthemes were developed. For each main theme, the subthemes were introduced (
). The entire qualitative data set was coded by CRSMY using the deductive main themes and inductive subthemes, with codes remaining flexible throughout the coding process in NVivo (Lumivero; formerly QSR International). An analysis report was prepared by CRSMY and reviewed with PC, KW, and AD to assess consensus and refine the findings. This report formed the basis for the results presented in this paper. Additional quotes for each theme and subtheme are provided.- Reach
The reach of mobile interventions and representativeness.
- Potential Efficacy
Sexual and reproductive health knowledge acquired, changes in behavior, and spreading knowledge to others.
- Adoption
Challenges with mobile networks and variability in participation
- Implementation
Participants’ enjoyment of the Zvatinoda! groups, aspects of the intervention that participants valued (eg, group interaction, privacy, having project phones, and discussions being young people led and adult supported), challenges in delivering regular feedback to health care providers, and peer facilitators’ personal development through the intervention
- Maintenance
Reduced engagement at the end of the intervention and a desire for an in-person element.
Participant sociodemographic characteristics were described. Quantitative data from the pre- and postintervention questionnaires were analyzed and reported as the number and proportion of participants providing desired responses to questions on the following topics: SRH knowledge (5 questions), knowledge of SRH services (4 questions), self-efficacy in communicating about SRH (3 questions), access to SRH services and information (5 questions), condom use (2 questions), health-seeking behavior in the past 3 months (1 question), and youth-friendliness of health services during their last visit in the past 3 months (7 questions). Overall satisfaction with the health facility was measured on a scale from 0 (worst) to 10 (best) and presented as a mean score [
]. Knowledge questions were adapted from the Insaka HIV Knowledge Quiz [ ] and the Adolescents 360 Evaluation Questionnaire [ ], while youth-friendliness [ ] and stigma questions [ ] were also adapted. Quantitative analysis was conducted using Stata (version 16.1; StataCorp).Ethical Considerations
Ethics approval was obtained from the Medical Research Council of Zimbabwe (MRCZ/A/2563) and the London School of Hygiene and Tropical Medicine (LSHTM 18057). Permissions were also obtained from the Ministry of Health and Child Care, the Chitungwiza City Health Ethical Review Board, and the District Administrator’s Office. Written informed consent was obtained from all research participants, and all data were anonymized before analysis. Participants received a travel reimbursement of US $2-5 for attending data collection sessions.
Results
Reach
The intervention pilot involved 7 participants in each of 4 groups, totaling 28 participants. During the COVID-19 pandemic, the mobile-based nature of the intervention allowed it to reach young people when physical gatherings were restricted. Participants were purposively selected based on a range of characteristics, including age (18-24 years), gender, HIV status, parenting status, and disability (
). This diverse group was appreciated by participants for the variety of identities represented and the range of views expressed: “the fact that you managed to engage other young people like disabled young people...that alone moved me and that was a good experience” [Male peer facilitator, 24 years]. Including young people living with and not living with HIV in mixed groups was appreciated.Sociodemographic characteristics | Values, n (%) | |||
Sex | ||||
Female | 14 (50) | |||
Male | 14 (50) | |||
Age (years) | ||||
18-19 | 8 (29) | |||
20-21 | 11 (39) | |||
22-24 | 9 (32) | |||
Marital status | ||||
Single | 28 (100) | |||
Ever attended school | ||||
Yes | 28 (100) | |||
Occupational status | ||||
In school | 14 (50) | |||
Out of school—working | 5 (18) | |||
Out of school—not working | 9 (32) | |||
Highest educational level achieved | ||||
Secondary | 23 (82) | |||
Tertiary | 5 (18) | |||
Religion | ||||
Roman Catholic | 5 (18) | |||
Protestant | 3 (11) | |||
Pentecostal | 8 (29) | |||
Apostolic | 2 (7) | |||
Other Christian | 10 (36) | |||
Spoken language outside of the home | ||||
Shona | 24 (86) | |||
English | 4 (14) |
Potential Efficacy
Participants Acquired SRH Knowledge
Health knowledge scores improved from pre- to postintervention across 9 measures. Preintervention scores ranged from 4 out of 28 (14%) for contraception to 24 out of 28 (86%) for HIV knowledge. After the intervention, all knowledge scores reached 100% (28/28;
).Questions | Prequestionnaire (N=28), n (%) | Postquestionnaire (N=28), n (%) | |||
SRH knowledge quizb | |||||
Antiretroviral drugs are medicines that help people with HIV positivity to live healthier lives | 6 (21) | 28 (100) | |||
Using modern contraceptives to prevent unintended pregnancies is important | 24 (86) | 28 (100) | |||
There is a way for someone who has HIV to get pregnant without passing the virus on to her child | 20 (71) | 28 (100) | |||
A person can get HIV by sharing a glass of water with someone who has HIV | 26 (93) | 28 (100) | |||
Changes to normal menstrual bleeding patterns, which are caused by some contraceptives, can make a girl permanently infertile | 4 (14) | 28 (100) | |||
Knowledge of accessible SRH servicesc | |||||
Do you know of a place where you can get condoms comfortably? | 19 (68) | 28 (100) | |||
Do you know of a place where you can get access to family planning comfortably? | 20 (71) | 28 (100) | |||
Do you know of a place where you can get an HIV test comfortably? | 23 (82) | 28 (100) | |||
Is the local health facility a place where someone like you could go to get information? | 23 (82) | 28 (100) | |||
Self-efficacy to communicate about SRHd | |||||
I feel able to start a conversation with my husband/wife/boyfriend/girlfriend about SRH | 26 (93) | 28 (100) | |||
I feel able to start a conversation with my friends about SRH | 26 (93) | 27 (96) | |||
I feel able to start a conversation with older adults in my family about SRH | 14 (50) | 24 (86) | |||
Self-efficacy to access SRH services and informationd | |||||
I feel able to obtain information on SRH services and products if I need to | 25 (89) | 28 (100) | |||
I feel able to get to a place where SRH services are offered if I decide that I need them | 27 (96) | 28 (100) | |||
I feel able to obtain SRH services and products if I need them | 25 (89) | 28 (100) | |||
I feel able to use SRH services even if my husband/wife/boyfriend/girlfriend does not want me to | 16 (57) | 25 (89) | |||
I feel able to use SRH services even if older adults in my family (eg, parents, guardian, aunt/uncle) do not want me to | 19 (68) | 25 (89) | |||
I can ask a new partner to use condoms | 18 (64) | 28 (100) | |||
I can refuse sex when I do not have a condom available | 20 (71) | 28 (100) | |||
Health-seeking behaviore | |||||
Attended a local health facility for own care in the last 3 months? | 9 (32) | 24 (86) | |||
Youth-friendliness of health services (only if attended in last 3 months)f | |||||
The last time I attended for my own care, I felt I was treated with courtesy and respectg | 8/9 (89) | 22/24 (92) | |||
The last time I attended for my own care, the health care provider listened carefullyg | 7/9 (78) | 22/24 (92) | |||
The last time I attended for my own care, the health care provider explained things in an understandable wayg | 9/9 (100) | 21/24 (88) | |||
The last time I attended for my own care, I had enough time to discuss my medical problem with the health care providerg | 6/9 (67) | 19/24 (79) | |||
I have been denied SRH services because of my age, marital status, or both | 3/9 (33) | 3/24 (13) | |||
Health care workers talked badly about me because of my request for SRH services | 3/9 (33) | 2/24 (8) | |||
A health care worker disclosed my SRH status/use of SRH services without permission | 1/9 (11) | 3/24 (13) | |||
Satisfaction with health facility (mean rating out of 10)h | 5.9 | 7.0 |
aSRH: sexual and reproductive health.
bValues correspond to the number and proportion of those with correct answers.
cValues correspond to the number and proportion of those with knowledge of accessible services.
dValues correspond to the number and proportion of those who agree.
eValues correspond to the number and proportion of those saying ‘yes’.
fValues correspond to the number and proportion agreeing/strongly agreeing.
gIncludes those agreeing/strongly agreeing.
hOn a scale of 0-10, where 0=worst and 10=best.
Participants reported that their main likes included receiving information and learning about health services (
). The value and enjoyment of the intervention largely came because participants “liked the fact that we are learning something through the groups” [Female participant, 23 years]. Many participants joined the intervention specifically “to learn, I wanted to learn, I’m hungry to learn” [Female participant, 18 years]. As one participant said, “I enjoyed because I now know that I can go to the clinic and get tested for HIV for free or get screened for cervical cancer” [Female participant, 22 years]. Discussion on commonly held beliefs about SRH was particularly helpful:in the community there is a myth that if you use Jadelle [family planning method] before bearing children you won’t have children at all; they corrected that myth
[Male participant, 21 years]
Participants generally felt that the information that they learned was relevant to their personal experiences: “the topics that we discuss, these are the things that we meet in our day to day lives” [Female participant, 18 years]
Questions on experience | Male (n=14), n (%) | Female (n=14), n (%) | ||
What has your experience been of the Zvatinoda! groups? | ||||
Very positive | 12 (86) | 12 (86) | ||
Mostly positive | 2 (14) | 2 (14) | ||
Neutral/negative | 0 (0) | 0 (0) | ||
What was the main thing about participating in the Zvatinoda! groups that you really liked?a | ||||
Felt supported by a facilitator | 2 (14) | 2 (14) | ||
Felt supported by peers | 1 (7) | 0 (0) | ||
Got information | 2 (14) | 5 (36) | ||
Guest speakers | 3 (21) | 0 (0) | ||
Had peers to talk to | 1 (7) | 0 (0) | ||
Learned about health services | 5 (36) | 7 (50) | ||
Was there anything about participating in the Zvatinoda! groups that you did not like? | ||||
Yes (messages/discussion not relevant) | 1 (7) | 0 (0) | ||
No | 13 (93) | 14 (100) | ||
What changes did you make to your life since joining the Zvatinoda! discussion groups?a | ||||
Feel able to access services/information when I need them | 6 (43) | 11 (79) | ||
Attend health facility when I needed care | 5 (36) | 9 (64) | ||
Safer sex | 7 (50) | 8 (57) | ||
More supported in decision-making | 8 (57) | 5 (36) | ||
Better communication with a sexual partner about SRHb | 6 (43) | 6 (43) | ||
Took up family planning | 1 (7) | 5 (36) | ||
Better communication with family about SRH | 3 (21) | 3 (21) | ||
Have more friends | 4 (29) | 0 (0) | ||
Better diet | 1 (7) | 0 (0) | ||
Would you recommend joining a Zvatinoda! group to a friend? | ||||
Definitely yes | 12 (86) | 13 (93) | ||
Probably yes | 2 (14) | 0 (0) | ||
Probably no | 0 (0) | 1 (7) | ||
Definitely no | 0 (0) | 0 (0) |
aParticipants could choose more than 1 option.
bSRH: sexual and reproductive health.
Participants Demonstrated Changes in Behavior Following the Intervention
Many noted positive changes in health-seeking behaviors, including an increase in the proportion of those reporting the use of a health facility for their own care in the past 3 months (9/28, 32%, preintervention vs 24/28, 86% postintervention;
). Improvements were observed across 10 SRH self-efficacy measures, with the most significant changes noted in 2 areas: the ability to start a conversation about SRH with older adults in the family (preintervention: 14/28, 50% vs postintervention: 24/28, 86%) and the ability to use SRH services even if a partner does not agree (preintervention: 16/28, 57% vs postintervention: 25/28, 89%; ).Specifically, many participants reported getting an HIV test as a result of the intervention:
This topic on HIV testing it helped me because I was afraid to go and get tested. When I heard others saying that they had to go and get tested I then decided to go and get tested.
[Female participant, 18 years]
By sharing and hearing others’ experiences, participants were encouraged to engage in positive health-seeking behaviors:
Before the groups I was afraid to go to cancer screening, now that I have information, why it’s good for me and what can happen. I am confident to go for screening now I can make informed decisions.
[Male participant, 21 years]
Some participants developed increased empathy for the experiences of friends and family members affected by the issues discussed. Both participants and peer facilitators noted the long-term impact of this change: “my involvement will impact me for the whole of my life, actually” [Female peer facilitator, 23 years].
Participants Shared the Knowledge Gained Through Zvatinoda! With Their Peers
About 96% (27/28) reported they would definitely or probably recommend Zvatinoda! to a friend (
). Additionally, participants conveyed their learning from the intervention to friends and family:My friend once said her husband was abusing her, so when we did the topic about gender-based violence so I got some points which I shared with her, now she is in a good place she reported to the police.
[Male participant, 20 years]
Those who had not yet shared their learning expressed intentions and plans to do so. The process of discussing the information gained through the intervention with friends and family extended its impact beyond the participants themselves:
When we get information myself, I will go with the information I will then sit with others and discuss as youths. Then one youth will assist the other person, then that person we would have assisted will meet others and assist. So more young people will be assisted with health information from Zvatinoda!.
[Male participant, 21 years]
Participants reported increased self-efficacy in initiating conversations about SRH with older adults in their families, with rates rising from 50% (14/28) before the intervention to 86% (24/28) after the intervention (
).Adoption
Phone Network Issues Proved Challenging
The major barrier to intervention adoption was the phone network when using the project phones and the Rocket.Chat platform, which participants described as a “big challenge” [Female participant, 18 years]. This problem led to participants feeling unable to engage fully, with both participants and sometimes peer facilitators frequently arriving late to the chats. As a result, some participants were unable to engage substantively in the intervention: “the last 2 weeks I was totally absent because of the network but I managed to catch up” [Female participant, 20 years]. Phone battery problems, power cuts, and the inability to charge phones further compounded the issue. These factors added to the challenges participants faced with the intervention (
).I think because the [Rocket.Chat] App drains power, so the battery would quickly run out of power yet there were intermittent power outages [preventing charging]
[Male participant, 20 years]
Some participants were able to contribute to the conversations after the planned time, but the guest sessions, which were scheduled for specific times, presented a greater challenge:
mostly I would attend meetings but guest sessions honestly, I never attended because of the network, it was very poor
[Female participant, 20 years]
Framework pillars | Illustrative quote | ||
1. Reach | |||
|
| ||
2. Potential efficacy | |||
|
| ||
|
| ||
|
| ||
3. Adoption | |||
|
| ||
|
| ||
4. Implementation | |||
|
| ||
|
| ||
|
| ||
|
| ||
|
| ||
|
| ||
|
| ||
5. Maintenance | |||
|
| ||
|
|
aRE-AIM: Reach, Effectiveness, Adoption, Implementation, and Maintenance.
bSRH: sexual and reproductive health.
Participants attempted to manage the network challenges by using another phone, either their own or a peer facilitator’s, as a hotspot: “I sacrificed to buy my own data then I would hotspot the phone” [Female participant, 18 years]. Peer facilitators had to be flexible to accommodate varying network availability: “as facilitators, we have to use initiative sometimes, if the network poses to be a challenge we just adjust to a suitable time.” [Male peer facilitator, 23 years]. To address network issues, suggestions included changing the project phones or using WhatsApp as an alternative platform, which requires less robust network connectivity. Although WhatsApp does not provide anonymity and some participants felt that “WhatsApp is not safe” [Female participant, 18 years], it was repeatedly recommended as a solution:
WhatsApp is actually good because everyone loves WhatsApp, [and] anyone can afford data for WhatsApp and a smart phone in the urban settings
[Male participant, 23 years]
Participation Was Variable
This was the case largely due to inconsistent network connectivity and work or school commitments. As a result, some groups had very few active participants on certain weeks. On average, 5 participants actively engaged in discussions each week. Some participants and peer facilitators thereby thought the group size should be increased, thinking the groups were “too small because some of our participants are not participating” [Female participants, 18 years]. Peer facilitators tried different ways to encourage participation, including supporting each other to “try to create a free environment where everyone would be free to participate” [Female peer facilitator, 23 years].
Implementation
Factors Affecting Intervention Acceptability
Participants Enjoyed the Zvatinoda! Groups
A significant majority (24/28, 86%) reported a very positive experience (
), with one participant stating, “my experience in Zvatinoda! is excellent” [Male participant, 23 years]. A few participants, who had been involved in other youth groups, noted that “compared to other programs, I think this one is the best” [Male participant, 21 years]. The intervention overall met and exceeded participants’ expectations, with one participant expressing, “it’s what I expected, it’s even way, way more than I expected” [Male participant, 20 years].Participants Valued Group Interactions
They gained significant insights through interactions with their peers, peer facilitators, and guest speakers.
I can say whatever I think of, and others can also share their views, which makes me also gain information
[Female participant, 22 years]
The “bond” developed among participants allowed them to feel comfortable and open, enabling them to “talk about anything that we want and what we think” [Female participant, 22 years]. Through these interactions, participants encouraged each other to adopt safer SRH practices. For instance, one participant shared, “I managed to encourage more guys to get circumcised citing that I have been circumcised to just go there and they went for circumcision.” [Male participant, 20 years].
Participants Valued Privacy
The use of pseudonyms in Rocket.Chat was highly appreciated, as it provided a sense of security and enabled participants to express themselves openly.
if you are not using pseudonym names you will be shy, but, then if you are using pseudonym names, I feel free to say anything I want
[Male participant, 23 years]
This privacy allowed participants to “feel safe” [Male participant, 23 years], and “participate to the fullest without fear of being pointed out by name that you said this and that” [Male participant, 20 years]. However, as participants grew more familiar and comfortable with each other, the need for such privacy diminished.
on the first days I was uncomfortable, but through continuous interaction I know that even if were to use our real names I was still going to feel the same way.
[Female participant, 18 years]
Participants Valued Using Project Phones
Participants valued and were motivated by receiving a project phone and data to participate in the chats. As one participant put it, “I was happy that I was trusted to be given a gadget” [Female participant, 23 years]. While most felt comfortable with the phone and reported “no security issues” [Male peer facilitator, 24 years], a few expressed concerns about “feared the phone breaking down or being stolen” [Male participant, 21 years]. When asked about the phone by family members, classmates, and friends, participants were pleased to explain:
I joined this program called Zvatinoda!. It is mainly focusing on the youth giving on sexual and reproductive health education
[Male participant, 23 years]
Although understanding, participants were saddened to return the phone at the end of the intervention: “it’s quite painful because I have been used to have a phone, it’s been a part of me, but it has to be done.” [Female peer facilitator, 23 years]
Value in Delivery Led by Young People and Supported by Adults
The facilitation of the chat groups by young people was considered successful. Participants felt that “a facilitator who is of the same age with us understands us, and he knows the situations that we meet” [Female participant, 18 years]. Having a peer facilitator of a similar age allowed participants to “feel very free to say what we want; we speak our real views” [Female participant, 22 years]. However, participants also recognized the challenge that “that other team members may not respect the facilitator because we are on the same age” [Female participant, 22 years]. The peer facilitators were occasionally unreliable, arriving late to the chats or altering the scheduled times. The presence of an older moderator, often described as an “Auntie figure,” provided the necessary gravitas to the chat groups.
As young people, as youths, sometimes we might disrespect [our peer facilitator] and not get into the Rocket.Chat. But the Auntie is there to guide us: if we fail to get into the Rocket.Chat on time she is there to push us. When we have conflicts and fail to agree she is there to harmonize us.
[Female participant, 22 years]
The Auntie figure played a critical role “in making us become committed,” providing correct information, and also “to listen to our grievances” [Male participant, 21 years].
Factors Influencing Implementation Fidelity: The Regular Feedback to Health Care Providers Was Not Delivered As Planned
COVID-19 restrictions on gatherings prevented the scheduled in-person feedback meetings between young people and health care providers. Instead of the planned monthly feedback sessions, all feedback was consolidated into a single in-person meeting held after the completion of the mobile phone–based chat groups. At this in-person meeting, the peer facilitators summarized the key messages from each discussion topic. They compiled 1-page summaries that included key points from the chats on various health topics, encompassing young people’s health knowledge, needs, commitments, and commonly used slang or “youth speak” related to each topic. Participants had numerous suggestions for improving health services for young people. They recommended that “health services should be non-judgemental” [Male participant, 21 years] and that “nurses should undergo training for treating us with care” [Male participant, 23 years]. However, they also recognized that implementing some of these changes could be challenging. Perceived resistance from health care providers was noted:
these health service providers they would say ‘we have our own way of doing things so you cannot come and tell us what to do on our job’
[Male participant, 21 years]
The peer facilitators also created a music video and a spoken word performance highlighting key messages about youth health service needs. These were shared both at the feedback meeting and online. The feedback meeting provided an opportunity for the peer facilitators to directly present to health care professionals the results of the mobile phone–based chats, conveying what young people want from health services:
It’s quite a challenge but at the same time it’s an opportunity, that feeling which says I have stood in front of people telling them this and that, people who have studied this, but this time we are saying even though you studied it this is what we want.
[Female peer facilitator, 23 years]
Youth Capacity Building Through Intervention Implementation: The Peer Facilitators Developed Through Their Role in the Intervention
The peer facilitators themselves developed skills and “learnt personally” [Female peer facilitator, 23 years] through the implementation of the intervention:
It’s a good thing to be a facilitator, as in you gain a lot of things, for instance we had leadership training workshops, being taught to be a facilitator and I gained so much from there.
[Female peer facilitator, 23 years]
The peer facilitators described valuing “interacting with people” and learning to “accept diversified ideas” [Female peer facilitator, 23 years] and “not be judgemental” [Male peer facilitator, 24 years]. Through the training and experience facilitation, the peer facilitators noted that their “communication skills improved” and that they “have learnt to be leader[s]” [Male peer facilitator, 23 years]. However, when the intervention was ending, the peer facilitators expressed concerns about short-term interventions for young people, desires for continued engagement, and a fear of abandonment by programs.
Maintenance
Participant Engagement Reduced Toward the End of the Intervention
Participant engagement on Rocket.Chat declined over the 12 weeks of the intervention, as noted by peer facilitators and the “Auntie.” Initially, peer facilitators did not need to prompt participants to join discussions. However, toward the end of the intervention, there was a greater need to send reminders before group discussion sessions and expert live chats. Perceptions of the length of the intervention varied, with some participants saying “it’s just right” [Male participant, 21 years], but others saying “they are too long, I would think if we would do 8 weeks” [Male participant, 23 years]. The peer facilitators found it challenging to maintain engagement on the mobile platform over the course of the intervention, especially without an in-person component:
I think the last topics were straining because it had been a very long time without encouragement from physical meeting
[Male peer facilitator, 24 years]
Participants and Peer Facilitators Desired an In-Person Element
To maintain engagement, an in-person element was suggested by many, mixed with mobile phone–based elements: “we also want groups where we can meet live and have discussions physically not through the phone” [Female participant, 18 years]. This was felt to make the intervention more appealing and increase the trust between participants:
that is going to make us have a strong relationship then we actually participate more knowing our fellow participants I can trust them, so I have to say anything I want to say
[Male participant, 23 years]
Participants generally felt that after a few weeks of anonymity to build confidence and openness, they would be comfortable meeting in person:
sometimes we need physical meetings to discuss so that we get to know each other even though we are not using the pseudonym names.
[Male participant, 23 years]
Discussion
The Zvatinoda! digital health intervention proved acceptable and feasible, demonstrating the potential for enhancing young people’s knowledge and health-seeking behaviors through peer-to-peer learning and anonymous expert discussions. Increased knowledge led to improved health-seeking behaviors and the sharing of information with peers and family members outside the intervention. Participants valued the group interactions, the privacy of the anonymous virtual environment, and the fact that the discussions were youth led and adult supported. The pilot study’s assessment of different modalities and the impact of feedback on young people’s health care needs to service providers was limited by COVID-19 restrictions, which prevented face-to-face meetings. This component of the intervention warrants further exploration.
This study supports the evidence that mobile phone–based interventions are feasible for addressing health care gaps among young people in Southern Africa [
]. The COVID-19 pandemic has significantly increased the demand for and development of digital interventions aimed at promoting adolescent SRH globally [ ]. Given the high rate of phone ownership in Zimbabwe [ ], digital interventions have the potential to reach a broad and diverse population of young people. However, as other studies have shown, network challenges and disparities in access among rural young people can be significant barriers to facilitating access and participation [ ]. This study contributes to the literature by emphasizing the added value of the anonymity provided by the Rocket.Chat platform and the effectiveness of mobile phone–based interventions in including a diverse group of young people. The findings suggest the benefits of a hybrid approach, combining mobile phone and in-person interventions. Initially, online anonymity can help build trust, while subsequent in-person interactions can strengthen relationships and engagement.This study contributes to the evidence base by highlighting not only the value of peer-to-peer learning for young people [
], but also the critical role of adult mentorship and access to experts in enhancing youth-led interventions [ ]. Learning through the Zvatinoda! intervention was facilitated by peer-to-peer interactions, which were significantly supported by adult supervision and expertise. This support came through the adult guest expert sessions and the oversight of the chat discussions. While we advocate for youth-led interventions [ ], our findings underscore the importance of adult mentorship and involvement in such initiatives. Adult support and mentorship not only enhance the effectiveness of interventions but also provide essential safeguards for younger leaders, who often face similar pressures and vulnerabilities as the target population.While the mixed methods evaluation approach provided an in-depth understanding of the feasibility of the Zvatinoda! intervention, several limitations were noted. COVID-19 restrictions on gatherings constrained our ability to conduct the planned regular feedback sessions between young people and health care providers. Consequently, the intervention included only 1 feedback session between participants, peer facilitators, and health care workers, rather than the multiple sessions originally planned. A more regular feedback loop between young people and health care providers was considered both unusual and beneficial, warranting further investigation. Additionally, self-reported outcomes may have been influenced by social desirability bias. Lastly, as this was a feasibility study, the intervention reached only a small number of young people. Consequently, quantitative analysis was limited to descriptive statistics due to the small sample size. This also constrained our assessment of reach as a construct, so the results primarily address the potential reach of the intervention if scaled up.
The Zvatinoda! intervention demonstrates promise as a digital approach to engaging young people in Zimbabwe, enhancing their health knowledge and health-seeking behavior. The key elements contributing to its success are mobile phone–based delivery, youth-led and adult-supported peer-to-peer and expert learning, and improvements in both knowledge and health-seeking behaviors. Further development, implementation, and evaluation of the intervention are needed. Potential improvements include incorporating in-person discussions once virtual group members have established a bond and addressing network challenges through updates to phones, network settings, or app platforms.
Acknowledgments
This study was funded by the UK Medical Research Council (grant number MR/T003200/1). We thank the young people, peer facilitators, expert speakers, and stakeholders who participated in these research activities. We thank Diana Patel (Organization for Public Health Interventions and Development), Craig Carty (University of Oxford), and Joanna Busza (London School of Hygiene and Tropical Medicine) for their support with the initial proposal and development of the study methodology.
We thank the Zvatinoda Youth Advisory Group for their integral role in co-developing and delivering the intervention. The members of the Zvatinoda Youth Advisory Group are as follows: Emmanuel Chiringwaringwa, Tinayeishe Kaseke, Loveness Manja, Kudakwashe Mapuranga, Jonah Sibanda, and Kudakwashe Varelie Siziba.
Authors' Contributions
This paper was conceptualized by CRSMY, PC, NS, AK, TTC, RAF, KW, and AMD. The Youth Advisory Group (EC, TK, LM, KM, JS, and KVS) and PC conducted data collection, with support from KW and AMD. CRSMY, PC, KW, and AMD led the data analysis, with support from LL and OWD. KW, AMD, TTC, RAF, AM, NS, and AK obtained funding for the study. CRSMY led the writing of this manuscript, with PC, KW, and AMD providing substantial edits. All authors contributed to the interpretation of the results and have read and approved the final manuscript.
Conflicts of Interest
None declared.
References
- Patton GC, Sawyer SM, Santelli JS, Ross DA, Afifi R, Allen NB, et al. Our future: a Lancet commission on adolescent health and wellbeing. The Lancet. Jun 2016;387(10036):2423-2478. [CrossRef]
- World Health Organization (WHO). Health for the World's Adolescents: A Second Chance in the Second Decade. Geneva, Switzerland. WHO; 2017.
- World Health Organization (WHO). Global Accelerated Action for the Health of Adolescents (AA-HA!). WHO. Geneva, Switzerland. WHO; 2017. URL: https://www.who.int/publications/i/item/9789241512343 [accessed 2024-07-30]
- Zimbabwe National Statistical Agency (ZIMSTAT). Zimbabwe 2022 Population and Housing Census. Harare, Zimbabwe. ZIMSTAT; 2022.
- Zimbabwe National Statistics Agency (ZNSA). Zimbabwe Demographic and Health Survey. Harare, Zimbabwe. ZDHS; 2015. URL: https://dhsprogram.com/pubs/pdf/FR322/FR322.pdf [accessed 2024-07-30]
- Busza J, Dauya E, Bandason T, Mujuru H, Ferrand RA. "I don't want financial support but verbal support." How do caregivers manage children's access to and retention in HIV care in urban Zimbabwe? J Int AIDS Soc. 2014;17(1):18839. [FREE Full text] [CrossRef] [Medline]
- Chingono R, Mackworth-Young CRS, Ross D, Tshuma M, Chiweshe T, Nyamayaro C, et al. Designing routine health checkups for adolescents in Zimbabwe. J Adolesc Health. Dec 2021;69(6):940-947. [FREE Full text] [CrossRef] [Medline]
- World Health Organization (WHO). Global consultation on adolescent friendly health services: a consensus statement. WHO. Geneva, Switzerland. WHO; 2002. URL: https://healtheducationresources.unesco.org/library/documents/global-consultation-adolescent-friendly-health-services-consensus-statement [accessed 2024-07-30]
- Mazur A, Brindis CD, Decker MJ. Assessing youth-friendly sexual and reproductive health services: a systematic review. BMC Health Serv Res. Mar 27, 2018;18(1):216. [FREE Full text] [CrossRef] [Medline]
- James S, Pisa PT, Imrie J, Beery MP, Martin C, Skosana C, et al. Assessment of adolescent and youth friendly services in primary healthcare facilities in two provinces in South Africa. BMC Health Serv Res. Oct 22, 2018;18(1):809. [FREE Full text] [CrossRef] [Medline]
- Kim B, White K. How can health professionals enhance interpersonal communication with adolescents and young adults to improve health care outcomes?: systematic literature review. International Journal of Adolescence and Youth. Jul 25, 2017;23(2):198-218. [CrossRef]
- Ministry of Health and Child Care (MOHCC). The National Health Strategy for Zimbabwe 2016-2020. World Bank. Harare, Zimbabwe. MOHCC; 2016. URL: https://faolex.fao.org/docs/pdf/zim204475.pdf [accessed 2024-07-30]
- Ippoliti NB, L'Engle K. Meet us on the phone: mobile phone programs for adolescent sexual and reproductive health in low-to-middle income countries. Reprod Health. Jan 17, 2017;14(1):11. [FREE Full text] [CrossRef] [Medline]
- Feroz AS, Ali NA, Khoja A, Asad A, Saleem S. Using mobile phones to improve young people sexual and reproductive health in low and middle-income countries: a systematic review to identify barriers, facilitators, and range of mHealth solutions. Reprod Health. Jan 16, 2021;18(1):9. [FREE Full text] [CrossRef] [Medline]
- Huang K, Kumar M, Cheng S, Urcuyo AE, Macharia P. Applying technology to promote sexual and reproductive health and prevent gender based violence for adolescents in low and middle-income countries: digital health strategies synthesis from an umbrella review. BMC Health Serv Res. Nov 19, 2022;22(1):1373. [FREE Full text] [CrossRef] [Medline]
- Doyle AM, Bandason T, Dauya E, McHugh G, Grundy C, Dringus S, et al. Mobile phone access and implications for digital health interventions among adolescents and young adults in Zimbabwe: cross-sectional survey. JMIR Mhealth Uhealth. Jan 13, 2021;9(1):e21244. [FREE Full text] [CrossRef] [Medline]
- Laidlaw R, Dixon D, Morse T, Beattie TK, Kumwenda S, Mpemberera G. Using participatory methods to design an mHealth intervention for a low income country, a case study in Chikwawa, Malawi. BMC Med Inform Decis Mak. Jul 05, 2017;17(1):98-12. [FREE Full text] [CrossRef] [Medline]
- Thabrew H, Fleming T, Hetrick S, Merry S. Co-design of eHealth interventions with children and young people. Front Psychiatry. 2018;9:481. [FREE Full text] [CrossRef] [Medline]
- Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health. Sep 1999;89(9):1322-1327. [CrossRef] [Medline]
- Glasgow RE, Harden SM, Gaglio B, Rabin B, Smith ML, Porter GC, et al. RE-AIM planning and evaluation framework: adapting to new science and practice with a 20-year review. Front Public Health. 2019;7:64. [FREE Full text] [CrossRef] [Medline]
- Rocket.Chat. URL: https://rocket.chat/ [accessed 2022-10-31]
- Simpson N, Kydd A, Phiri M, Mbewe M, Sigande L, Gachie T, et al. Insaka: mobile phone support groups for adolescent pregnant women living with HIV. BMC Pregnancy Childbirth. Sep 30, 2021;21(1):663-611. [FREE Full text] [CrossRef] [Medline]
- Atujuna M, Simpson N, Ngobeni M, Monese T, Giovenco D, Pike C, et al. Khuluma: Using participatory, peer-led and digital methods to deliver psychosocial support to young people living with HIV in South Africa. Front Reprod Health. 2021;3:687677. [FREE Full text] [CrossRef] [Medline]
- Abu-Lughod L. Veiled Sentiments: Honor and Poetry in a Bedouin Society. Oakland, CA. University of California Press; 1986.
- Chimedza D, Webb K, Chitiyo V, Zidana S, Mukotekwa T, Kanhongo T. Reaching young people with mobile technology for sexual and reproductive health interventions: experiences from voices and choices project in Manicaland Province, Zimbabwe. 2015. Presented at: International Conference on AIDS and STIs in Africa (ICASA) 2015; November 29 to December 4, 2015:1-2; Harare, Zimbabwe.
- Charashika P, Mackworth-Young C, Mangombe A, Simpson N, Kydd A, Webb K. Zvatinoda! (What we want!): participatory methods for community-led formation of a youth advisory research panel in urban Zimbabwe. 2021. Presented at: International AIDS Society Conference on HIV Pathogenesis, Treatment and Prevention; July 18-21, 2021; Berlin, Germany.
- Webster TR, Mantopoulos J, Jackson E, Cole-Lewis H, Kidane L, Kebede S, et al. A brief questionnaire for assessing patient healthcare experiences in low-income settings. Int J Qual Health Care. Jun 30, 2011;23(3):258-268. [CrossRef] [Medline]
- Nsanya MK, Atchison CJ, Bottomley C, Doyle AM, Kapiga SH. Modern contraceptive use among sexually active women aged 15-19 years in North-Western Tanzania: results from the Adolescent 360 (A360) baseline survey. BMJ Open. Aug 28, 2019;9(8):e030485. [FREE Full text] [CrossRef] [Medline]
- Stangl A, Lilleston P, Mathema H, Pliakas T, Krishnaratne S, Sievwright K, et al. HPTN 071 (PopART) Study Team. Development of parallel measures to assess HIV stigma and discrimination among people living with HIV, community members and health workers in the HPTN 071 (PopART) trial in Zambia and South Africa. J Int AIDS Soc. Dec 2019;22(12):e25421. [FREE Full text] [CrossRef] [Medline]
- Bergam S, Sibaya T, Ndlela N, Kuzwayo M, Fomo M, Goldstein MH, et al. "I am not shy anymore": A qualitative study of the role of an interactive mHealth intervention on sexual health knowledge, attitudes, and behaviors of South African adolescents with perinatal HIV. Reprod Health. Dec 01, 2022;19(1):217. [FREE Full text] [CrossRef] [Medline]
- Cornelius JB, Smoot JM. The impact of technology on adolescent sexual and reproductive needs. Int J Environ Res Public Health. Jul 17, 2022;19(14):8684. [FREE Full text] [CrossRef] [Medline]
- Stangl AL, Mwale M, Sebany M, Mackworth-Young CR, Chiiya C, Chonta M, et al. Feasibility, acceptability and preliminary efficacy of Tikambisane ('let's talk to each other'): a pilot support group intervention for adolescent girls living with HIV in Zambia. J Int Assoc Provid AIDS Care. 2021;20:23259582211024772. [FREE Full text] [CrossRef] [Medline]
- Oliveras C, Cluver L, Bernays S, Armstrong A. Nothing about us without RIGHTS-meaningful engagement of children and youth: from research prioritization to clinical trials, implementation science, and policy. J Acquir Immune Defic Syndr. Aug 15, 2018;78 Suppl 1(1):S27-S31. [FREE Full text] [CrossRef] [Medline]
Abbreviations
RE-AIM: Reach, Effectiveness, Adoption, Implementation, and Maintenance |
SRH: sexual and reproductive health |
Edited by A Mavragani; submitted 23.09.23; peer-reviewed by L Chernick; comments to author 06.02.24; revised version received 26.03.24; accepted 03.04.24; published 24.09.24.
Copyright©Constance Ruth Sina Mackworth-Young, Privillage Charashika, Zvatinoda Youth Advisory Group, Leyla Larsson, Olivia Jane Wilding-Davies, Nikita Simpson, Anna Sorrel Kydd, Theonevus Tinashe Chinyanga, Rashida Abbas Ferrand, Aveneni Mangombe, Karen Webb, Aoife Margaret Doyle. Originally published in JMIR Formative Research (https://formative.jmir.org), 24.09.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.