Background: Human papillomavirus (HPV) testing detects sexually transmitted infections with oncogenic types of HPV. For many HPV-positive women, this result has negative connotations. It produces anxiety, fear of cancer or death, and disease denial. Face-to-face counseling could present many difficulties in its implementation, but a counseling mobile app could be practical and may help HPV-positive women reduce the psychosocial impact of the result, improve their knowledge of HPV and cervical cancer, and increase adherence to follow-up.
Objective: This study aims to understand HPV-tested women’s perceptions about an app as a tool to receive information and support to reduce the emotional impact of HPV-positive results. We investigated their preferences regarding app design, content, and framing.
Methods: We conducted formative research based on a user-centered design approach. We carried out 29 individual online interviews with HPV-positive women aged 30 years and over and 4 focus groups (FGs) with women through a virtual platform (n=19). We shared a draft of the app's potential screens with a provisional label of the possible content, options menus, draft illustrations, and wording. This allowed us to give women understandable triggers to debate the concepts involved on each screen. The draft content and labels were developed drawing from the health belief model (HBM) and integrative behavioral model (IBM) variables and findings of mobile health literature. We used an FG guide to generate data for the information architecture (ie, how to organize contents into features). We carried out thematic analysis using constructs from the HBM and IBM to identify content preferences and turn them into app features. We used the RQDA package of R software for data processing.
Results: We found that participants required more information regarding the procedures they had received, what HPV-positive means, what the causes of HPV are, and its consequences on their sexuality. The women mentioned fear of the disease and stated they had concerns and misconceptions, such as believing that an HPV-positive result is a synonym for cancer. They accepted the app as a tool to obtain information and to reduce fears related to HPV-positive results. They would use a mobile app under doctor or health authority recommendation. The women did not agree with the draft organization of screens and contents. They believed the app should first offer information about HPV and then provide customized content according to the users’ needs. The app should provide information via videos with experts and testimonies of other HPV-positive women, and they suggested a medical appointment reminder feature. The app should also offer information through illustrations, or infographics, but not pictures or solely text.
Conclusions: Providing information that meets women’s needs and counseling could be a method to reduce fears. A mobile app seems to be an acceptable and suitable tool to help HPV-positive women.
Worldwide, more than 600,000 new cases and 240,000 deaths occur annually due to cervical cancer (CC), which disproportionately affects socioeconomically vulnerable women . High CC mortality is related to problems across the cancer control continuum, including low screening coverage and loss to follow-up, diagnosis, and treatment [ , ]. In recent decades, human papillomavirus (HPV) testing has been developed as an alternative screening method. HPV testing has become the standard of care and a main strategy to accelerate the elimination of CC [ ]. HPV testing detects sexually transmitted infections (STIs) with oncogenic types of HPV. Triage tests are used to identify HPV-positive women who will require diagnosis and treatment. In Argentina, the prevalence of high-risk HPV among screened women is around 13% [ ]. HPV-positive women with negative triage will require rescreening in 12/18 months. Thus, infection with an oncogenic type of HPV can be detected, but positivity does not necessarily mean that the infection will cause cancer or that the woman will require treatment.
These particular characteristics of HPV results may have a negative impact on the psychosocial health of tested women [, ]. As with other STIs, HPV is often accompanied by a host of negative beliefs and may cause fear, stigma, shame, and anxiety [ , ]. HPV-positive women are usually the target of negative stereotyping and may be questioned about their sexual behavior, situations that only increase their psychological burden [ ]. HPV-positive results can also produce anxiety, fear of cancer or death, and disease denial [ - ]. Thus, HPV-positive results disrupt women’s lives [ ], characterized by uncertainty and ambiguity, and cause emotional impact and changes in their everyday life [ - ].
Relating an abnormal screening test with cancer and inevitable death can result in women being hesitant to continue follow-up procedures [, , ]. Women with high distress after abnormal screening tests are more likely to exhibit avoidant rather than adaptive coping strategies [ , , ], making it more likely for nonadherence to occur [ ]. Moreover, stigma related to the screening test result with an STI can also lead to the abandonment of follow-up and treatment [ ]. Thus, HPV’s psychosocial impact might not only diminish women’s quality of life but also reduce their ability to complete diagnosis and treatment, which are essential steps in preventing CC. There is a critical need for interventions to reduce the psychosocial impact of HPV positivity and increase women's capacity to adhere to follow-up.
Women’s negative perceptions and concerns related to a positive HPV result decrease when their information needs are met and reassuring information is provided [, ]. In addition, counseling has been extensively used for a wide range of health problems [ - ] and has been shown to increase HIV-testing rates [ , ], improve adherence to treatments [ ], increase the quality of life of patients with cancer, and facilitate informed health decisions [ ]. The World Health Organization recommends counseling as a strategy for interpersonal communication between the health care provider and the woman, as it allows women to become more informed and knowledgeable about HPV and CC prevention; offers a space to discuss sensitive topics, such as sexuality, disease, and death; and may encourage them to adopt preventive practices [ ].
However, providing person-to-person counseling to all HPV-positive women presents implementation obstacles that may affect its quality. The main limitations are that it involves 1 or even several consultations, where each is time-consuming and should be provided by well-trained providers in consultation rooms that guarantee privacy [- ]. Studies have pointed out that women often receive limited support and tools to cope with the psychosocial impact of HPV positivity, especially in settings with limited health resources [ , , ]. In addition, although prevention programs from all countries in Latin America and globally produce information materials, in general this information is often provided without considering the barriers to comprehending complex information related to HPV [ - ].
In Argentina, women have reported problems in comprehending information during result delivery [, ]. A study showed that provider communication is mainly focused on informing women of follow-up steps, leaving little to no room to address women’s concerns, such as the sexual transmission of the virus and its link with cancer [ ]. Results from a study carried out among 200 HPV-positive women showed that almost half of them considered that the information provided by health providers was confusing and lacked clarity [ ].
Therefore, women undergoing HPV testing need innovative solutions to provide them with information, counseling, and support that do not depend on extensive use of human resources and time and that may increase their autonomy in accessing patient-centered information. Mobile health (mHealth) interventions can enhance the relationship between patients and health services and have been shown to increase adherence in primary care and gynecology care settings [- ]. In particular, the use of mobile apps to communicate with patients showed the improvement of health outcomes for a wide range of health conditions, including mental health [ - ]. In cancer care, apps provide accessible information and education at minimal costs throughout the cancer care continuum [ ]. Apps have various advantages over other traditional approaches, including that they can be referenced even after the consultation and that they require less staff [ , ]. They are accepted by most patients, and they positively contribute to strengthening patients’ engagement and empowerment [ , - ].
Studies in low- and middle-income countries suggest that mHealth interventions dependent on mobile phone ownership are feasible and may reach the majority of patients in key subgroups, such as those who have low education and limited access to the health system [, ]. In Argentina, more than 84.2% of women have access to the internet through a smartphone [ ]. Reduced access to sexual health counseling has been reported for minority groups [ ]; therefore, the implementation of an app-based tool to provide women with information and support might constitute a key intervention for diminishing inequalities in CC prevention.
In this paper, we report results from formative research carried out to understand HPV-tested women’s perceptions about an app as a tool to receive information and support to reduce the emotional impact of HPV-positive results. In addition, we investigated their preferences regarding app design, content, and framing. The analysis was part of a study with the main objective of designing a user-centered counseling app aimed at reducing the psychosocial impact of HPV testing and increasing adherence to follow-up.
We relied on constructs from the health belief model (HBM)  and the integrated behavioral model (IBM) [ ]. Both have been successfully used to explain interventions linked to CC prevention and mHealth intervention [ - ]. Following these models, we posited that the intention to adhere to follow-up after a positive HPV test result is determined by changing attitudes (eg, change of fatalistic thoughts about CC prevention and reduced fear), perceived norms (eg, increased value of cancer prevention care), and self-efficacy (eg, reduced perceptions about barriers to CC prevention and increased motivation to perform follow-up procedures) [ , ]. After delivery of HPV test results, the app will provide HPV-positive women with information and emotional and practical support tools that will influence attitudes, perceived norms, and personal agency, thereby favoring functional coping strategies. It will also improve awareness and knowledge of HPV and the importance of continuing diagnosis and treatment, as well as the significance of having the skills to do so (eg, details on how, when, and where). The app can promote cues to action, which will have an effect on individual behavior by reducing the psychosocial impact and triggering an intention to continue health care [ ].
An initial version of the app’s information architecture (IA) based on the theoretical framework consisted of 3 modules (): (a) an Information module to provide women with evidence-based information in plain language messages; (b) an Emotional Support module to provide HPV-positive women with support in a way that will allow them to change negative thoughts [ , ] that lead to distress, diminished motivation, and less active self-care; and (c) a Practical Support module to provide women with tools to facilitate the continuation of the line of care, including reminders for diagnostics and treatment consultations.
The app’s design process was based on a user-centered design (UCD) approach . The UCD includes the end users’ participation as co-designers and considers their specific cultural, social, and economic background to understand their preferences of information organization, features, and navigation flow (sequences of screens and IA) [ , ].
Design of App Mock-ups
The content and labels of the app draft screens (ie, mock-ups) were designed in relation to the HBM and IBM frameworks. We also incorporated findings of a review we carried out to identify mHealth studies reporting on the development or evaluation of mHealth app components [, , ].
The draft mock-ups () consisted of 7 screens, including labels of the potential content, menus of options, and draft illustrations, as follows:
- Welcome screen: presents the app and its purpose.
- Onboarding screen: inquires about the medical indication received after the HPV-positive result. It offers the following as possible answers: “You must get a Papanicolaou (Pap) smear in 1 year,” “You must undergo a colposcopy,” “You must get a biopsy,” “You must return in 18 months,” and “You must return in 5 years.” The list of responses to this question was based on the guidelines for the prevention of CC established by the health authorities in Argentina [ ].
- Main Menu screen: presents a list of 4 options (Information, Myths and Facts, Things to Make You Feel Better, and Step-by-Step - Helpful Information). The content included on these screens was created from evidence provided by previous studies on women's knowledge and perceptions of HPV, as well as their information needs [ - , , ].
- Information screen: presents a list of topics that the app provides information about.
- Myths and Facts screen: presents a list of misconceptions about HPV and CC. The app provides information that refutes each myth.
- Things to Make You Feel Better screen: provides a list of coping strategy-oriented activities.
- Step-By-Step - Helpful Information screen: We proposed a menu with options to access useful information about the studies and to schedule reminders.
The study took place in Ituzaingó, a district located 10 km (6.2 miles) west of the city of Buenos Aires, Argentina. Ituzaingó is part of the Metropolitan Area of Buenos Aires where one-third of the country’s population lives. In 2015, HPV testing was established as a primary screening for women aged 30 years or over who were treated by the public health system. The public health system provides health care access to the population not covered by the social security sector (workers in the informal economy and their families). For the uninsured, health services are free of cost.
Eligible women were literate, aged 30 years or over, resided in Ituzaingó, and mobile phone users. We carried out a purposive sampling procedure among women HPV-tested in the past 12 months in the public health care sector. We recruited participants by phone calls during which a recruiter explained the study aims and asked for informed consent. If the woman accepted, she consented to participate in the interview and a focus group (FG). We used the Zoom platform because it allowed women to participate without sharing personal data or logging in. We used age as a stratification criterion because it was considered a crucial variable to understand differences in cellphone use . However, we did not find differences among analyzed groups. The FGs conducted were:
- FG1: 6 women aged 30-49 years
- FG2: 4 women aged ≥50 years
- FG3: 3 women aged 30-49 years
- FG4: 6 women aged ≥50 years.
The original research protocol with face-to-face FGs was designed before the onset of the COVID-19 pandemic. Due to social distancing measures, we switched to an online strategy. Online tools for data collection are suitable for sensitive topics and allowed us to solve logistical issues . However, according to the literature [ , ], FGs using videoconference software require shorter durations and fewer participants per group. In addition, promoting interactions between participants is more challenging than in face-to-face FGs, due to audio delays or interruptions produced by weak internet connections. Therefore, from the original FG guideline, we selected some dimensions to be collected in an individual interview where women were asked about personal experiences and sensitive topics. We carried out individual online semistructured interviews about (1) the participant’s profile; (2) use of cellphone, apps, and the internet; (3) personal experiences in the gynecological consultation; (4) information needs regarding HPV/CC; (5) risk perception and attitudes of HPV and CC; (6) perceived norms and self-efficacy to adhere to follow-up procedures; and (7) perceptions regarding an app as a tool to receive HPV testing–related information and support. The interviews also helped instruct women in the use of a virtual platform during the FGs, if necessary.
Second, we carried out 4 online FGs using the same virtual platform. Discussion in the FGs began with general questions on women’s knowledge, beliefs, and attitudes regarding HPV results and CC prevention. This information was used as a trigger to introduce questions about women’s preferences regarding the app and contextualize their answers. We then shared the draft app's mock-ups (). This allowed us to give the women understandable triggers to debate the concepts presented on each screen. We asked the women about each screen’s content and their preferences for app features. This paper presents the results we obtained from these FGs.
Two trained female researchers collected the information from the FGs in Spanish. One of these women has a background in social sciences and acted as a moderator (author VSA), while the other woman, who has a background in app design and user-experience research (author DS), acted mainly as an observer but added further questions when needed; neither of them lived in Ituzaingó, nor did they have any relation with the health care institutions or their authorities. This was also stated during the FGs. At the end of each FG and if needed, we provided women with accurate information regarding HPV/CC prevention and answered their questions to reduce confusion related to discussed topics.
We carried out the fieldwork during the COVID-19 pandemic (November and December 2020). In that period, social distancing and semilockdown measures were in force for nonessential activities, including most services for nonurgent health issues. Despite this unprecedented context, we recruited 29 women during the individual interviews, of whom 19 (66%) participated in the 4 FGs. We also carried out a pilot FG to test the guide in a virtual environment. Each FG lasted 1 hour 55 minutes on average. Both were digitally recorded to transcribe verbatim.
FG audios were transcribed to carry out thematic analysis of the debates , based on an iterative and flexible process following 6 steps:
- To ensure coding reliability, 2 researchers (authors VSA and LS) become independently familiar with the data through transcriptions and the video recording.
- We classified data using an initial codebook based on the theoretical constructs (eg, knowledge, beliefs, and attitudes), and in accordance with our research objectives, we identified the reactions to the app and to each draft mock-up screen (opinions).
- We analyzed each category to generate new themes (eg, “a salient aspect of the data in a patterned way, regardless of whether that theme captures the majority experience of the participants” [ ]).
- Both researchers met to review themes to identify consistencies and resolve the inconsistencies with the other members of the team.
- We grouped the emergent themes according to their conceptual similarities to define and name the subthemes.
- We sought examples that adequately graphed each theme. Women’s preferences, reactions and opinions regarding the app draft screens were coded into emergent categories (subthemes) that identified their preferences with regard to content, tool, feature, and design aspect.
For data processing, we used the RQDA package from R software (R Core Team) [, ] to organize, code, and summarize patterns. RQDA is a tool that assists the analysis of textual data, and it includes a number of standard computer-aided qualitative data analysis features, such as character-level coding, creation of documents or codes memos, and organization of codes into code categories.
To ensure coding reliability, a third author (SA) verified coding against a sample of transcripts and critically reviewed the data and themes to improve the trustworthiness of the study . A detailed description of all procedures used to guarantee the trustworthiness of data collection and analysis is included in .
Method details and FG results are presented following the Consolidated Criteria for Reporting Qualitative Research (COREQ).
The study’s protocol was approved by the Diagnóstico por Imagen Morón (DIM) private clinic’s ethics committee. Before the study began, women provided orally informed consent, which was audio-recorded for documentation. The anonymity of participants was guaranteed at each step of the study.
Characteristics of the Women
A total of 19 women participated in 4 FGs. Most of them had secondary-level education or less (12/19, 63%) and were employed (11/19, 58%). Most of them lived with a partner and had children, and near three quarters of them had public health insurance ().
|Age (years); mean 47.4 years, range 31-66 years|
|Secondary (incomplete and complete)||12 (63)|
|Tertiary incomplete||5 (26)|
|Tertiary complete||2 (11)|
|Economic activity status|
|Economically active (labor force)||14 (74)|
|Economically inactive (out of labor force)||5 (26)|
|In a relationship with children||9 (47)|
|Single with children||8 (42)|
|Single without children||2 (11)|
|Private/social security||5 (26)|
aHPV: human papillomavirus.
Knowledge, Beliefs, and Attitudes Regarding HPV and CC
Most of the participants were unclear on certain aspects related to HPV and CC. HPV transmission was the topic that generated the most questions and caused the most confusion. Although most of the women knew about the sexual transmission of HPV, some mentioned other possible routes of transmission, such as poor hygiene or sharing clothes. The women also asked questions, such as who is at risk of HPV, what type of organism HPV is, what its symptomatology is, what the prognosis is in the case of HPV-positive results, and follow-up or treatment required. They also expressed interest in vaccines and recommended screening tests according to age. The lack of information led 1 of the women to conclude, “We don't know anything” [FG3].
It would be great to have information because sometimes they say, “No, I won't do this to you because of such and such protocol,” and you’re just left thinking, “But how come they did it to my friend?”
[FG3, 30-49 years old]
Likewise, in the FGs, results identified recurrent beliefs in the different groups, such as that the virus affects more young women or women of childbearing age, that it is transmitted in the context of heterosexual relations, and the idea of dormancy of the virus associated with cancer being something that is awakened.
The concerns that the participants mentioned were related to infidelity, partner conflict in the face of an HPV-positive result, possible discomfort during sexual intercourse due to HPV, or the consequences on fertility. In at least 2 of the groups, the women had initially mistaken the positive HPV test result for a cancer diagnosis.
In all groups, receiving the HPV-positive result triggered negative emotions, such as distress, anger, anxiety, shame, and fear. Those who had a medical consultation where they received information reported that it was a satisfying experience and reduced their concerns. However, those who did not get an opportunity to speak with a doctor shared a lot of concern, which was only increased by the difficulties in obtaining an immediate appointment during the COVID-19 pandemic.
[After receiving the HPV+ result] . . . I spent entire nights crying, days with swollen eyes because I didn't know what I had. And I couldn't rely on a professional, there was nobody open for an appointment, it was terrible because it was just when the pandemic started. They didn't take appointments anywhere and only cared about COVID cases, but people also have other issues.
[FG2, 50 years and over]
Participants in the different FGs expressed their willingness to use an app to access information about HPV and CC, especially to clarify doubts and have access to quality information until they could consult a health professional. In all the groups, the participants indicated that the health authorities, such as the Ministry of Health or the Health Secretariat of the municipality, would be reliable sources that would give legitimacy to the content of the app. The presence of institutional logos would provide an endorsement and, therefore, trust. Most of the participants indicated that they would trust the app if a physician or health professional recommended its use.
Woman 1: The idea [of the app] is great. Yes, I would download it, but if someone recommends it to me...
Moderator: Who has to recommend it?
Woman 1: The doctors.
Woman 2: Well, if the doctor recommends it, even better.
Woman 3: Yes, if it’s the doctor, even better.
Woman 2: Yes, I agree with the ladies. Professionals that come from the Ministry of Health and are approved for everything.
[FG1, 30-49 years old]
Preferences on App Content, Features, and Design
All groups mentioned that the app should address the user's doubts, offer advice, and provide information in a way that is easy to understand: “It should be like a psychologist; it should listen but also give you advice, guide you” (FG1) and “It should explain things clearly” (FG2).
[How should the app be?]
Woman 1: . . . It should know how to emotionally support us and how to respond to our questions. It should know how to give the user peace of mind and the information they need.
Woman 2: It has to seem human . . .
[FG4, 50 years and over]
The Welcome Screen
This screen included the sentence “Hi, I'm an HPV-specific app. I'd like to help you” as an introduction to the app. Several women criticized that it says, “I’m an app,” and suggested that it should have a person's name, otherwise they would discard its use. Some positively valued the illustration that was included the draft, a health professional taking notes, which was interpreted as a receptive gesture: “Like they’re listening to what you tell them” (FG1).
Woman 1: I would put, instead of “I’m an app,” I would give it a name to generate a more personal bond more human, you know?
Woman 2: Yes, because the greeting “I’m an app” sounds like a robot, and you delete [an app] . . . so they have a human identity, that looks like, simulates being human.
[FG3, 30-49 years old]
The Onboarding Screen
Faced with the options presented on the screen (), several women expressed confusion:
Woman 1: I don’t understand . . . so you open the app, and it says it’s going to help you, and now it jumps to “What did the doctor say?”
Woman 2: . . . So, you open the application knowing that you have HPV?
Woman 1: . . . I think there could be another [screen] before asking, “Did you get an HPV test?”
[FG2, 50 years and over]
Some women were unaware of the different tests listed: “What would be the difference between a Pap smear and colposcopy?” (FG3). Regarding their results, several women had been told that “everything was fine, that I should come back in a year” (FG1), even though they registered an HPV-positive result. This fact influenced the women’s reaction as to which option they should choose, causing doubts as to whether the doctor's indication was the right one for their case.
Woman 1: I was told that I have to get a PAP [smear] and colpo[scopy] every year, as well as a mammogram, which doesn’t appear here [as an option on the screen].
Woman 2: [Reacting with doubts regarding the screen] . . . Sometimes you think you have to undergo such and such study, and you don’t actually have to undergo it, and you never know if that’s right or not.
[FG3, 30-49 years old]
The Main Menu Screen
The women's reaction to the Main Menu screen () was positive, with a high level of acceptability of the options: ”I would like to read everything; if I open [the app], in just a day I’d explore the whole application, from top to bottom“ (FG3).
Woman 1: It’s great.
Woman 2: I think it’s good.
Woman 3: I think it’s very good.
Woman 4: I would separate ”If you like, I can help you with . . .“ and you have all the information, ”Would you like more information?“ and then, absolutely, refer you with an appointment . . . make an appointment to have the study done, no matter what, and to consult a specialist, always.
[FG4, 50 years and over]
The Information Screen
When evaluating the Information screen (), the women agreed that all the contents displayed were particularly important and interesting to them. Moreover, these contents led to proposals from the women on topics that this module of the app should address.
[The app should provide information about] ”call or contact us if you have any symptoms,“ or give guidelines on at what age you should do it . . . ”If you are over 30 years old, you have to get a specialized test.“ In other words, more controls, to have all that at your fingertips. ”Babies must be vaccinated from this age to that age“ . . . That would help us a lot.
[FG2, 50 years and over]
The Myths and Facts Screen
This screen generated both positive and negative reactions. Among the positive comments, the women recognized that debunking inaccurate beliefs reduces concern: ”It’s important to debunk myths because they generate a lot of stress“ (FG4). Among those who rejected the Myths and Facts screen, it was observed that the contents were interpreted as statements about their behaviors, not as a myth to be refuted. In some cases, the contents generated discomfort: ”It's like they blame us“ (FG1).
[After reading the screen] . . . You don’t have to be unfaithful or suffer from . . . it isn’t cancer . . . nor is it because the person is an easy woman . . . nor did they die; in other words, they live with HPV and nothing else . . . I mean, I tested positive, but I wasn’t unfaithful or anything like that; I got it and I don’t know where. It could have been in a gynecological study that I had done . . .
[FG2, 50 years and over]
The Things to Make You Feel Better Screen
This screen proposed a list of activities so that the user could find emotional support. Among the options on the screen, women were asked to indicate which options they preferred (). Of the proposed alternatives, the favored ones were ”Listening to other women's stories“ and finding ”Women support groups that help each other.“ Some participants stated that they wanted to hear testimonies from other women to know ”how she coped with the HPV result“ and ”how it went“ (FG3). They also suggested that the app provide statistics about women with HPV ”who got cured because they did everything“ (FG3).
The other proposed activities, such as ”List of activities you like,“ ”Listen to messages or see pictures of loved ones,“ and ”Have music you like,“ were discarded because, on the one hand, “People already have [music or photos] on their cell phone” (FG1), while, on the other hand, they generated doubts about the personal information shared with the app.
Woman 1: [The “Things to Make You Feel Better” screen] . . . I don't get it. In the app, are you going to hear or see stories of other women who went through the same thing? That's good. But . . . “Listen to messages from your loved ones” what would there be there? Audios in there, or is that something you would have to add? Have music that you like to listen to? I kind of don't relate it to the issue . . .
Woman 2: I already know what makes me feel better; why remind me of it?
Woman 3: Would we put pictures on the app? I wouldn't let it, for example . . . [when] it asks for permissions to access [meaning not giving permission to access photos or files].
[FG4, 50 years and over]
The Step by Step - Helpful Information Screen
The women of all the FGs named the Reminders function as the most relevant: “I think it's great that it notifies you that you have to have a check-up” (FG4). Likewise, many participants proposed including a directory with care centers specialized in CC prevention. They also proposed a function that would allow scheduling appointments or “to be able to make an appointment directly there [in the app], you can enter your address, and they will give you an appointment at the nearest clinic” (FG1).
Several women showed interest in receiving notifications of the availability of results: “so that you can go and know that it’s ready” (FG2). Others proposed including a function that would allow them to store or record previously performed studies: “. . . maybe the doctor asks me and I don't remember (. . .) I have to go and rummage through all the papers to see when [the last study] was” (FG2).
. . . [in the app] you list the tests you should get done, you have the doctors' appointments, and you go . . . you have an agenda where you have all the tests you should get, so, well, you check off: “I’ve already had this done, ah, I need . . .” I don't know, “next time I go to the doctor's office, I’ll ask them if this test is suitable or not,” but you already have an agenda to follow and comply with.
[FG3, 30-49 years old]
One criticized aspect of the draft shown to the women was the sequence in which the screens were displayed.
Woman 1: I would like that before choosing an option on “What did the doctor say?,” it would say, “Do you know what HPV is?” first. Then if they don't know, send the user to an option where you give her all the information. If she already knows what it is, then follow with the “What did the doctor say?” options.
Woman 2: I want to find out what [HPV] is all about first, then I want to see “What method should I follow?” Or, if I already know what I should do, ”What is [that test] for?“
Woman 1: Also . . . if you’re already in treatment, ”What step are you in?,“ the ”step by step“ of the process, the appointments and the studies would be missing. If you’re already in treatment, ”How are you?“ Give other options there: ”How are you feeling?,“ ”Are you going to a center?,“ ”Are you talking to anyone?“ That would also be another bonus point, after the step by step.
[FG2, 50 years and over]
Regarding the different contents proposed in the app, the women proposed videos with explanations provided by professionals and testimonial videos with women relating their cases and evolution. They pointed out the need for a feature that would also allow sharing the information in the app with other women.
As for formats, women positively valued infographics and illustrations and, to a lesser extent, texts. Two groups stressed the importance of providing content using different formats to ensure accessibility: texts with audio for people with visual impairment or videos with text for those with hearing impairment.
Regarding the use of images, opinions were divided. On the one hand, there were some who argued that health contents through realistic images ”are shocking“ (FG1) and ”are very off-putting“ (FG4). On the other hand, women who were in favor of using real images pointed out that ”if they’re real, they help to raise awareness“ (FG2).
Woman 1: I would like there to be a video with a specialist who can clearly explain what this disease is and what steps you have to follow or what has to be done . . . so that a registered specialist can guide you. Not just anyone talking . . . and that they go straight to the point . . . In the general framework, they can guide you and tell you what you can do.
Woman 2: . . . but women's opinions too, there are some videos . . . of real cases, it would be good too, real cases . . .
[FG3, 30-49 years old]
summarizes the themes and subthemes obtained during analysis. Additionally, in , we present verbatim examples for each theme and subtheme.
|Lack of information||The questions and concerns the women expressed during FGsa that showed a lack of general knowledge of HPVb and CCc prevention|
|Partial or incorrect information about HPV transmission||The questions and statements the women expressed during FGs that showed incomplete or incorrect information about HPV transmission|
|Information needs: nature of HPV||The questions and concerns the women expressed during FGs regarding the nature of HPV (“What kind of disease is it?”)|
|Information needs: symptomatology||The questions and concerns the women expressed during FGs regarding possible HPV symptoms|
|Information needs: prognosis||The questions and concerns the women expressed during FGs regarding the forecasting of the probable course of HPV and the chances of recovery|
|Information needs: who is at risk for HPV?||The questions and concerns the women expressed during FGs regarding who is at risk for HPV (what kind of person or age/gender/sexual behavior profile)|
|Information needs: follow-up medical procedures||The questions and concerns the women expressed during FGs regarding the follow-up medical procedures required after an HPV-positive result|
|Only affects young people||Narratives showing women’s perceptions on HPV as a disease that only affects young people|
|Is only transmitted via heterosexual intercourse||Narratives showing women’s perceptions on HPV as a disease that is only transmitted in heterosexual intercourse|
|HPV and cancer as dormant diseases||Narratives showing women’s perceptions on the asymptomatic nature of HPV linked with the idea of cancer as a dormant disease|
|An HPV-positive result causes conflicts with partner over infidelity.||Emotional reactions related to the HPV-positive results (such as anger) that may cause conflict with partners due to suspicions of infidelity|
|An HPV-positive result causes fear of consequences in sexual intercourse.||Narratives around fear of having consequences in sexual intercourse due to HPV-positive results (such as feel pain or discomfort)|
|An HPV-positive result causes concerns on infertility.||Narratives around concerns that HPV causes infertility|
|An HPV-positive result causes distress.||Narratives around concerns due to distress caused by an HPV-positive result|
|App acceptability||Trust||Reactions to the app in terms of acceptability and the criteria to be considered trustworthy|
|Welcome screen||App preferences identity: age/gender||Preferences around the app’s character identity in terms of age and gender|
|Onboarding screen||Reactions: confusion||Women’s comments, concerns, and questions that showed the confusion produced by the Onboarding screen|
|Contents Menu screen||Reactions: positively evaluated content||Reaction expressed in terms of approving the displayed content|
|Information screen||Reactions: positively evaluated content||Reaction expressed in terms of approving the displayed content|
|Myths and Facts screen (Emotional Support module)|
|Accepts the Myths and Facts screen||Reaction expressed in terms of approving the displayed content|
|Rejects the Myths and Facts screen||Reaction expressed in terms of rejecting the displayed content (includes other reactions such as confusion or misunderstanding of the displayed content)|
|Things to Make You Feel Better screen (Emotional Support module)|
|Preferred activity: listening to other women||The main activities the women preferred from a list of displayed options|
|Preferred activity: sharing with other women||The main activities the women preferred from a list of displayed options|
|Dismissed activities||The activities dismissed as app features|
|Step by Step - Helpful Information screen (Practical Support module)|
|Reminder to make an appointment||App features proposed/accepted as practical support|
|Results availability reminder||App features proposed/accepted as practical support|
|Reminder of having an appointment||App features proposed/accepted as practical support|
|Directory||App features proposed/accepted as practical support|
|General app design|
|Communication style||Preferences on the app’s contents communication style (how it should be)|
|Contents organization: screen flow||Preferences and suggestions on the app’s screens sequence (order in which screens must be displayed in the app according to its content)|
|Formats preferences: videos||Preferences on the app’s content formats|
|Formats preferences: multiple formats for accessibility||Preferences on the app’s content formats|
|Formats preferences: images/photographs||Preferences on the app’s content formats|
aFG: focus group.
bHPV: human papillomavirus.
cCC: cervical cancer.
Our results showed that women positively valued the app as a tool to obtain information and counseling about HPV and CC. Similar findings were reported by studies that analyzed women’s preference for apps aimed at providing support to women diagnosed with cancer [, - ]. Two studies analyzed the acceptability of an app oriented toward educating people on HPV and CC prevention. A research team from Norway designed an app called FightHPV [ ]. The app is a digital game-based learning tool for mobile devices that aims to communicate concepts that help people understand HPV-related diseases, such as CC, and their prevention. Authors reported positive reactions from potential users toward the educational game (they enjoyed the game, and the game was challenging). Additionally, a study carried out in the United States reported the development of an interactive virtual patient educator for Hispanic women about CC and HPV. During the design process and in the pilot study, participants reported high levels of satisfaction with the interaction with the system [ ].
Our app was conceived to provide support to HPV-tested women after the delivery of the test results. Our study showed that women would accept and trust its contents as long as a physician recommended it. Greenhalgh et al  analyzed dimensions that influence the diffusion and adoption of health innovative interventions. They conducted a systematic review, and many of their conclusions were used to develop the Consolidated Framework Intervention Research (CFIR). Following Greenhalgh et al’s [ ] conclusions, the CFIR states that a key element to achieving the acceptability and adoption of health innovations is leader endorsement during its implementation. According to this finding, experts' opinions have a particular influence on the beliefs and actions of those who have to adopt the health innovation. In our case, health professionals can be perceived as experts who may exert influence through their authority and status, instilling credibility to the contents provided by the app (legitimacy).
Evidence has shown that it is important to offer users personalized contents . Initially, we chose an onboarding screen to provide customized content according to the clinical screening, diagnosis, and treatment protocol recommended by the National Ministry of Health and the National Cancer Institute [ ]. However, our study concluded that women find the onboarding options based on these recommendations confusing, as they cannot relate them to the explanation provided by the health professional. Adherence of health professionals to national screening-diagnosis-treatment recommendations is rather low [ ], so women are often given instructions on follow-up that do not align with national guidelines. This is the case, for example, of the woman who was told to repeat a Pap smear and colposcopy annually, an option not endorsed by the national guidelines. In addition, evidence shows that women lack general knowledge on HPV and CC prevention and have problems understanding what their health professionals tell them [ ]. Therefore, our study showed the importance of an initial screen that provides a menu to access information regarding HPV, and the purpose of screening tests before providing customized content.
Following our theoretical framework, the app initial draft included 3 separate modules: Information, Emotional Support, and Practical Support. However, the FG participants rejected this scheme and suggested reorganizing the screens and a new hierarchical organization of modules. They agreed that more knowledge helps them face fears and that the emotional support tools (eg, Things to Make You Feel Better) should complement the provided information, not be the central content of the app. This result enhances the importance of user perceptions of the app content and its organization as a key element in the design process in order to ensure high final user engagement .
Our study showed that women highly value having a medical appointment reminder feature (Practical Support module). Similarly, the study Application of Communication and Information Technologies to Self-Collection (ATICA study, for its initials in Spanish), conducted in Jujuy, Argentina, found that HPV-positive women highly accept receiving reminders through the Short Messaging Service (SMS) to increase their adherence to a Pap-based triage . This is an important result for the app design as reminders (eg, through SMS) have been found to improve medication adherence and other treatment compliance [ ].
Regarding the app style and tone, women asked for an empathic communication style even when clearly acknowledging that they were interacting with a device (mobile phone). Similar findings were found in a previous study that analyzed women’s preferences regarding SMS content design  to receive information about triage after an HPV-positive result. In that study, also carried out in Argentina, women requested the SMS content to emulate the overall friendly style of community health workers. Other authors found that empathy is positively valued among women when receiving information about being HPV-positive and follow-up [ ]. Additionally, our results found that women positively value the application as it can provide information through multiformat content. They agreed that subtitled videos, illustrations, or infographics with audio help them understand the content while ensuring accessibility. However, we did not find agreement on preference related to real pictures or only text content.
Our findings have some implications for the design of mHealth interventions targeted toward HPV-tested women. Health care providers may consider using electronic health (eHealth) technologies, such as smartphone apps, to provide patients with psychosocial support after HPV-positive result delivery. Furthermore, policy makers may consider funding and supporting evidence‐based interventions delivered through eHealth platforms. This is particularly important in the midst of the COVID-19 pandemic, as using mHealth strategies has been signaled as a key intervention that may help women in a context where we must minimize face-to-face encounters.
This study had some limitations. Due to the COVID-19 pandemic, we conducted online FGs, and we reduced the number of participants for each group. The small sample and the specific study setting may have limited the generalizability of our findings. However, it is considered sufficient for qualitative research, and clear themes emerged from the data. However, the pandemic created an optimal setting as it hinders physical interaction, thereby strengthening the argument for an mHealth approach. In addition, we achieved theoretical saturation to the main findings, such as content presence and screen organization. The study results were limited to the women's points of view and did not include health providers’ opinions regarding the app; however, we plan to interview physicians from the Ituzaingó health system as part of the app process design.
This formative research has shown that women accept an app that provides information and counseling as part of the health provider-woman encounter. A lack of knowledge or misinformation about HPV and CC was the core of their opinions and demands regarding the app design. Our findings highlight the need to involve end users in the early stages of the conceptualization and design process of mHealth innovations. The key elements of the app design must be carefully chosen in an endeavor to guarantee both comprehension of the contents and usefulness to the end user.
The authors express their gratitude to the Secretaría de Salud de Ituzaingó (Ituzaingó Secretariat of Health), their wonderful team health workers, and their coordinators, in addition to all the women who generously donated their time to participate in the study. This work is part of formative research of the main project “Designing a Counseling App to Reduce the Psycho-social Impact of HPV Testing: A UCD Approach (Phase 1)” led by Dr Silvina Arrossi at the Center of Studies of State and Society (CEDES), in association with the Ituzaingó Secretariat of Health and in collaboration with Dr Kasisomayajula “Vish” Viswanath from the Department of Social and Behavioral Sciences, Harvard T H Chan School of Public Health, Harvard University.
This work was supported by a Conquer Cancer International Innovation Grant. Any opinions, findings, and conclusions expressed in this material are those of the author(s) and do not necessarily reflect those of the American Society of Clinical Oncology or Conquer Cancer.
Conflicts of Interest
Thematic analysis: results and procedures.PDF File (Adobe PDF File), 287 KB
- Bray F, Ferlay J, Soerjomataram I, Siegel RL, Torre LA, Jemal A. Global cancer statistics 2018: GLOBOCAN estimates of incidence and mortality worldwide for 36 cancers in 185 countries. CA Cancer J Clin 2018 Nov;68(6):394-424 [FREE Full text] [CrossRef] [Medline]
- Murillo R, Almonte M, Pereira A, Ferrer E, Gamboa OA, Jerónimo J, et al. Cervical cancer screening programs in Latin America and the Caribbean. Vaccine 2008 Aug 19;26 Suppl 11:L37-L48. [CrossRef] [Medline]
- Arrossi S, Paolino M, Sankaranarayanan R. Challenges faced by cervical cancer prevention programs in developing countries: a situational analysis of program organization in Argentina. Rev Panam Salud Publica 2010 Oct;28(4):249-257 [FREE Full text] [CrossRef] [Medline]
- Lazcano-Ponce E, Lorincz AT, Cruz-Valdez A, Salmerón J, Uribe P, Velasco-Mondragón E, et al. Self-collection of vaginal specimens for human papillomavirus testing in cervical cancer prevention (MARCH): a community-based randomised controlled trial. Lancet 2011 Nov 26;378(9806):1868-1873 [FREE Full text] [CrossRef] [Medline]
- Arrossi S, Thouyaret L, Paul L. Prevención Del Cáncer Cervicouterino: Recomendaciones Para El Tamizaje, Segui Miento y Tratamiento de Mujeres En El Marco de Programas de Tamizaje Basados En El Test de VPH. Ciudad de Buenos Aires: Instituto Nacional del Cancer, Ministerio de Salud de la nación; Nov 11, 2020:2015 URL: https://extranet.who.int/ncdccs/Data/ARG_D1_ca%20cervico%20uterino.pdf
- Rask M, Swahnberg K, Lindell G, Oscarsson M. Women's experiences of abnormal Pap smear results: a qualitative study. Sex Reprod Healthc 2017 Jun;12:3-8. [CrossRef] [Medline]
- Arrossi S, Almonte M, Herrero R, Gago J, Sánchez Antelo V, Szwarc L, et al. Psycho-social impact of positive human papillomavirus testing in Jujuy, Argentina results from the Psycho-Estampa study. Prev Med Rep 2020 Jun;18:101070 [FREE Full text] [CrossRef] [Medline]
- Verhoeven V, Baay MF, Baay PE, Lardon F, Van Royen P, Vermorken JB. Everything you always wanted to know about HPV (but could not ask your doctor). Patient Educ Couns 2010 Oct;81(1):101-105. [CrossRef] [Medline]
- Marván ML, Ehrenzweig Y, Catillo-López RL. Fatalistic beliefs and cervical cancer screening among Mexican women. Health Care Women Int 2016 Nov 21;37(1):140-154. [CrossRef] [Medline]
- Barnack-Tavlaris JL, Serpico JR, Ahluwalia M, Ports KA. "I have human papillomavirus": an analysis of illness narratives from the Experience Project. Appl Nurs Res 2016 May;30:137-141 [FREE Full text] [CrossRef] [Medline]
- Lehmann U, Sanders D. Community Health Workers: What Do We Know About Them? The State of the Evidence on Programmes, Activities, Costs an Impact on Health Outcomes of Using Community Health Workers. Geneva: World Health Organization; 2007.
- Kannisto KA, Koivunen MH, Välimäki MA. Use of mobile phone text message reminders in health care services: a narrative literature review. J Med Internet Res 2014 Oct 17;16(10):e222 [FREE Full text] [CrossRef] [Medline]
- Arrossi S, Thouyaret L, Herrero R, Campanera A, Magdaleno A, Cuberli M, et al. Effect of self-collection of HPV DNA offered by community health workers at home visits on uptake of screening for cervical cancer (the EMA study): a population-based cluster-randomised trial. Lancet Global Health 2015 Feb;3(2):e85-e94 [FREE Full text] [CrossRef] [Medline]
- Binka C, Doku DT, Awusabo-Asare K. Experiences of cervical cancer patients in rural Ghana: an exploratory study. PLoS One 2017 Oct 11;12(10):e0185829 [FREE Full text] [CrossRef] [Medline]
- Karasz A, McKee MD, Roybal K. Women's experiences of abnormal cervical cytology: illness representations, care processes, and outcomes. Ann Fam Med 2003 Nov 01;1(4):196-202 [FREE Full text] [CrossRef] [Medline]
- Szwarc L, Sánchez Antelo V, Paolino M, Arrossi S. "I felt myself getting sick:" women's perceptions and understandings of a positive human papillomavirus test in Jujuy, Argentina. Salud Colect 2021 Aug 23;17:e3572 [FREE Full text] [CrossRef] [Medline]
- León-Maldonado L, Wentzell E, Brown B, Allen-Leigh B, Torres-Ibarra L, Salmerón J, et al. Perceptions and experiences of human papillomavirus (hpv) infection and testing among low-income Mexican women. PLoS One 2016 May 5;11(5):e0153367 [FREE Full text] [CrossRef] [Medline]
- Castro VM, Arellano GM. Social support networks and gender: experience of women with HPV, dysplasia and cervical cancer (Spanish). La ventana. Revista de estudios de género 2014 Jun;5(39):208-240 [FREE Full text]
- Monsalve-Páez S, Valderrama-Vega D, Castillo-Zamora MF, Guzmán-Sabogal YR, Amaya-Guío J. Experiencia de las pacientes frente a citología cérvico-vaginal reportada como ASCUS o LEI de bajo grado en dos instituciones de Bogotá (Colombia), 2014. Rev Colomb Obstet Ginecol 2015 Mar 30;66(1):14. [CrossRef]
- Szwarc L, Sánchez Antelo V, Paolino M, Arrossi S. "I'm neither here, which would be bad, nor there, which would be good": the information needs of HPV+ women. A qualitative study based on in-depth interviews and counselling sessions in Jujuy, Argentina. Sex Reprod Health Matters 2021 Dec 15;29(1):1991101 [FREE Full text] [CrossRef] [Medline]
- Cendejas BR, Smith-McCune KK, Khan MJ. Does treatment for cervical and vulvar dysplasia impact women's sexual health? Am J Obstet Gynecol 2015 Mar;212(3):291-297 [FREE Full text] [CrossRef] [Medline]
- Leite V, Santos BD, Pereira MG. Psychosocial impact of human papillomavirus on women's sexual dissatisfaction and quality of life. J Psychosom Obstet Gynaecol 2019 Sep;40(3):232-238. [CrossRef] [Medline]
- Wang K, Jeng C, Yang Y, Chen C, Cheng W, Chen T, et al. The psychological impact of illness among women experiencing human papillomavirus-related illness or screening interventions. J Psychosom Obstet Gynaecol 2010 Mar 02;31(1):16-23. [CrossRef] [Medline]
- Kahn JA, Slap GB, Bernstein DI, Tissot AM, Kollar LM, Hillard PA, et al. Personal meaning of human papillomavirus and Pap test results in adolescent and young adult women. Health Psychol 2007 Mar;26(2):192-200. [CrossRef] [Medline]
- Waller J, Marlow LAV, Wardle J. The association between knowledge of HPV and feelings of stigma, shame and anxiety. Sex Transm Infect 2007 Apr 10;83(2):155-159 [FREE Full text] [CrossRef] [Medline]
- D'Egidio V, Sestili C, Mancino M, Sciarra I, Cocchiara R, Backhaus I, RETURN TO BREAST Collaborative group. Counseling interventions delivered in women with breast cancer to improve health-related quality of life: a systematic review. Qual Life Res 2017 Oct 16;26(10):2573-2592. [CrossRef] [Medline]
- Lancaster T, Stead LF. Individual behavioural counselling for smoking cessation. Cochrane Database Syst Rev 2017 Mar 31;3:CD001292 [FREE Full text] [CrossRef] [Medline]
- Broutet N, O’Neal Eckert L, Ullrich A, Bloem P. Comprehensive Cervical Cancer Control: A Guide to Essential Practice, 2nd Ed. Geneva: World Health Organization; 2014.
- Wang Z, Lau JTF, Ip M, Ho SPY, Mo PKH, Latkin C, et al. A randomized controlled trial evaluating efficacy of promoting a home-based HIV self-testing with online counseling on increasing HIV testing among men who have sex with men. AIDS Behav 2018 Jan 22;22(1):190-201. [CrossRef] [Medline]
- Coates TJ, Richter L, Caceres C. Behavioural strategies to reduce HIV transmission: how to make them work better. Lancet 2008 Aug 23;372(9639):669-684 [FREE Full text] [CrossRef] [Medline]
- Kurth AE, Chhun N, Cleland CM, Crespo-Fierro M, Parés-Avila JA, Lizcano JA, et al. Linguistic and cultural adaptation of a computer-based counseling program (CARE+ Spanish) to support HIV treatment adherence and risk reduction for people living with HIV/AIDS: a randomized controlled trial. J Med Internet Res 2016 Jul 13;18(7):e195 [FREE Full text] [CrossRef] [Medline]
- Pan American Health Organization. Integrating HPV Testing in Cervical Cancer Screening Program: A Manual for Program Managers. Washington, DC: World Health Organization; 2016.
- Santarossa S, Kane D, Senn CY, Woodruff SJ. Exploring the role of in-person components for online health behavior change interventions: can a digital person-to-person component suffice? J Med Internet Res 2018 Apr 11;20(4):e144 [FREE Full text] [CrossRef] [Medline]
- Evans C, Nalubega S, McLuskey J, Darlington N, Croston M, Bath-Hextall F. The views and experiences of nurses and midwives in the provision and management of provider-initiated HIV testing and counseling: a systematic review of qualitative evidence. JBI Database Syst Rev Implement Rep 2016 Jan 15;13(12):130-286. [CrossRef] [Medline]
- Rodríguez Torres A, Jarillo Soto EC, Casas Patiño D. Medical consultation, time and duration. Medwave 2018 Sep 26;18(5):e7266-e7264. [CrossRef] [Medline]
- Castro-Vásquez MDC, Arellano-Gálvez MDC. Access to information by women with HPV, cervical dysplasia and cancer in situ. Salud Publica Mex 2010 Jun;52(3):207-212. [CrossRef] [Medline]
- Wiesner C, Acosta J, Díaz Del Castillo A, Tovar S. Social representations of human papillomavirus in Bogotá, Colombia. Med Anthropol 2012 Jan;31(1):77-92. [CrossRef] [Medline]
- McRae J, Martin C, O'Leary J, Sharp L, Irish Cervical Screening Research Consortium (CERVIVA). "If you can't treat HPV, why test for it?" Women's attitudes to the changing face of cervical cancer prevention: a focus group study. BMC Womens Health 2014 May 06;14:64 [FREE Full text] [CrossRef] [Medline]
- O'Connor M, Costello L, Murphy J, Prendiville W, Martin CM, O'Leary JJ, Irish Screening Research Consortium (CERVIVA). Influences on human papillomavirus (HPV)-related information needs among women having HPV tests for follow-up of abnormal cervical cytology. J Fam Plann Reprod Health Care 2015 Apr 23;41(2):134-141 [FREE Full text] [CrossRef] [Medline]
- Paolino M, Campanera A, Martiarena SN, Echenique AL, López N, Gago J, et al. Triage of women with human papillomavirus self-collection in Jujuy Province. Rev argent salud pública 2019;10(40):7-14 [FREE Full text]
- Fjell M, Langius-Eklöf A, Nilsson M, Wengström Y, Sundberg K. Reduced symptom burden with the support of an interactive app during neoadjuvant chemotherapy for breast cancer: a randomized controlled trial. Breast 2020 Jun;51:85-93 [FREE Full text] [CrossRef] [Medline]
- Greer JA, Jacobs J, Pensak N, MacDonald JJ, Fuh C, Perez GK, et al. Randomized trial of a tailored cognitive-behavioral therapy mobile application for anxiety in patients with incurable cancer. Oncologist 2019 Aug 25;24(8):1111-1120 [FREE Full text] [CrossRef] [Medline]
- Børøsund E, Ehlers SL, Varsi C, Clark MM, Andrykowski MA, Cvancarova M, et al. Results from a randomized controlled trial testing StressProffen; an application-based stress-management intervention for cancer survivors. Cancer Med 2020 Jun 03;9(11):3775-3785 [FREE Full text] [CrossRef] [Medline]
- Hantsoo L, Criniti S, Khan A, Moseley M, Kincler N, Faherty LJ, et al. A mobile application for monitoring and management of depressed mood in a vulnerable pregnant population. Psychiatr Serv 2018 Jan 01;69(1):104-107 [FREE Full text] [CrossRef] [Medline]
- Firth J, Torous J, Nicholas J, Carney R, Rosenbaum S, Sarris J. Can smartphone mental health interventions reduce symptoms of anxiety? A meta-analysis of randomized controlled trials. J Affect Disord 2017 Aug 15;218:15-22 [FREE Full text] [CrossRef] [Medline]
- Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry 2017 Oct;16(3):287-298 [FREE Full text] [CrossRef] [Medline]
- Jongerius C, Russo S, Mazzocco K, Pravettoni G. Research-tested mobile apps for breast cancer care: systematic review. JMIR Mhealth Uhealth 2019 Feb 11;7(2):e10930 [FREE Full text] [CrossRef] [Medline]
- Hall CS, Fottrell E, Wilkinson S, Byass P. Assessing the impact of mHealth interventions in low- and middle-income countries: what has been shown to work? Glob Health Action 2014 Oct 27;7:25606 [FREE Full text] [CrossRef] [Medline]
- Vo V, Auroy L, Sarradon-Eck A. Patients' perceptions of mHealth apps: meta-ethnographic review of qualitative studies. JMIR Mhealth Uhealth 2019 Jul 10;7(7):e13817 [FREE Full text] [CrossRef] [Medline]
- Shake MC, Crandall KJ, Mathews RP, Falls DG, Dispennette AK. Efficacy of Bingocize: a game-centered mobile application to improve physical and cognitive performance in older adults. Games Health J 2018 Aug;7(4):253-261. [CrossRef] [Medline]
- Rosen KD, Paniagua SM, Kazanis W, Jones S, Potter JS. Quality of life among women diagnosed with breast cancer: a randomized waitlist controlled trial of commercially available mobile app-delivered mindfulness training. Psychooncology 2018 Aug 01;27(8):2023-2030. [CrossRef] [Medline]
- Beratarrechea A, Lee AG, Willner JM, Jahangir E, Ciapponi A, Rubinstein A. The impact of mobile health interventions on chronic disease outcomes in developing countries: a systematic review. Telemed J E Health 2014 Jan;20(1):75-82 [FREE Full text] [CrossRef] [Medline]
- INDEC. Access and use of information and communication technologies (Spanish). EPH. Inf Técnicos Cienc y Tecnol 2020;4(1):1-16 Official Publication [FREE Full text]
- Aitken M, Clancy B, Nass D. The Growing Value of Digital Health: Evidence and Impact on Human Health and the Healthcare System (Institute Report).: IQVIA Institute for Human Data Science; 2017 Nov 07. URL: https://www.iqvia.com/insights/the-iqvia-institute/reports/the-growing-value-of-digital-health [accessed 2021-11-25]
- Skinner C, Tiro J, Champion V. The health belief model. In: GlanZ K, Rimer BK, Viswanath VK, editors. Health Behavior and Health Education. 5th ed. San Francisco: Jossey-Bass; 2015:75-93.
- Montaño D, Kasprzyk D. Theory of reasoned action, theory of planned behavior, the integrated behavioral model. In: Glanz K, Rimer BK, Viswanath VK, editors. Health Behavior and Health Education. 5th ed. San Francisco: Jossey-Bass; 2015:95.
- Moore de Peralta A, Holaday B, Hadoto IM. Cues to cervical cancer screening among U.S. Hispanic women. Hisp Health Care Int 2017 Mar 16;15(1):5-12. [CrossRef] [Medline]
- Shida J, Kuwana K, Takahashi K. Behavioral intention to prevent cervical cancer and related factors among female high school students in Japan. Jpn J Nurs Sci 2018 Oct 13;15(4):375-388. [CrossRef] [Medline]
- Sánchez AV, Kohler RE, Szwarc L, Paolino M, Viswanath K, Arrossi S. Knowledge and perceptions regarding triage among human papillomavirus-tested women: a qualitative study of perspectives of low-income women in Argentina. Womens Health (Lond) 2020 Dec 02;16:1745506520976011 [FREE Full text] [CrossRef] [Medline]
- Fleming K, Simmons VN, Christy SM, Sutton SK, Romo M, Luque JS, et al. Educating Hispanic women about cervical cancer prevention: feasibility of a Promotora-LED Charla intervention in a farmworker community. Ethn Dis 2018 Jul 12;28(3):169-176 [FREE Full text] [CrossRef] [Medline]
- Darville G, Burns J, Chavanduka T, Anderson-Lewis C. Utilizing theories and evaluation in digital gaming interventions to increase human papillomavirus vaccination among young males: qualitative study. JMIR Serious Games 2021 Jan 22;9(1):e21303 [FREE Full text] [CrossRef] [Medline]
- Moore de Peralta A, Holaday B, McDonell JR. Factors affecting Hispanic women's participation in screening for cervical cancer. J Immigr Minor Health 2015 Jun 28;17(3):684-695. [CrossRef] [Medline]
- Lyon AR, Koerner K. User-centered design for psychosocial intervention development and implementation. Clin Psychol (NY) 2016 Jun 17;23(2):180-200 [FREE Full text] [CrossRef] [Medline]
- Schnall R, Rojas M, Bakken S, Brown W, Carballo-Dieguez A, Carry M, et al. A user-centered model for designing consumer mobile health (mHealth) applications (apps). J Biomed Inform 2016 Apr;60:243-251 [FREE Full text] [CrossRef] [Medline]
- Garrett JJ. The elements of user experience: user-centered design for the web and beyond. Choice Rev Online 2011 Sep 01;49(01):49-0321-49-0321. [CrossRef]
- Paolino M, Arrossi S. Women's knowledge about cervical cancer, Pap smear and human papillomavirus and its relation to screening in Argentina. Women Health 2011 Jan 31;51(1):72-87 [FREE Full text] [CrossRef] [Medline]
- Bush NE, Smolenski DJ, Denneson LM, Williams HB, Thomas EK, Dobscha SK. A virtual hope box: randomized controlled trial of a smartphone app for emotional regulation and coping with distress. Psychiatr Serv 2017 Apr 01;68(4):330-336. [CrossRef] [Medline]
- Christoforou M, Sáez Fonseca JA, Tsakanikos E. Two novel cognitive behavioral therapy-based mobile apps for agoraphobia: randomized controlled trial. J Med Internet Res 2017 Nov 24;19(11):e398 [FREE Full text] [CrossRef] [Medline]
- Forgays DK, Hyman I, Schreiber J. Texting everywhere for everything: gender and age differences in cell phone etiquette and use. Comput Hum Behav 2014 Feb;31:314-321. [CrossRef]
- Davies L, LeClair KL, Bagley P, Blunt H, Hinton L, Ryan S, et al. Face-to-face compared with online collected accounts of health and illness experiences: a scoping review. Qual Health Res 2020 Nov 15;30(13):2092-2102. [CrossRef] [Medline]
- Flynn R, Albrecht L, Scott SD. Two approaches to focus group data collection for qualitative health research. Int J Qual Methods 2018 Jan 17;17(1):160940691775078. [CrossRef]
- Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol 2006 Jan;3(2):77-101. [CrossRef]
- Huang R. What Is RQDA and What Are Its Features?. 2016. URL: http://rqda.r-forge.r-project.org/ [accessed 2021-11-25]
- R Core Team. R: A Language and Environment for Statistical Computing. 2020. URL: https://www.r-project.org/ [accessed 2021-11-25]
- Lincoln YS, Guba EG. Naturalistic Inquiry. CA: Sage; 1985.
- Yanez B, Oswald LB, Baik SH, Buitrago D, Iacobelli F, Perez-Tamayo A, et al. Brief culturally informed smartphone interventions decrease breast cancer symptom burden among Latina breast cancer survivors. Psychooncology 2020 Jan 15;29(1):195-203 [FREE Full text] [CrossRef] [Medline]
- Visser A, Prins JB, Jansen L, Radema SA, Schlooz MS, van Dalen T, et al. Group medical consultations (GMCs) and tablet-based online support group sessions in the follow-up of breast cancer: a multicenter randomized controlled trial. Breast 2018 Aug;40:181-188. [CrossRef] [Medline]
- Buscemi J, Buitrago D, Iacobelli F, Penedo F, Maciel C, Guitleman J, et al. Feasibility of a smartphone-based pilot intervention for Hispanic breast cancer survivors: a brief report. Transl Behav Med 2019 Jul 16;9(4):638-645 [FREE Full text] [CrossRef] [Medline]
- Lubberding S, van Uden-Kraan CF, Te Velde EA, Cuijpers P, Leemans CR, Verdonck-de Leeuw IM. Improving access to supportive cancer care through an eHealth application: a qualitative needs assessment among cancer survivors. J Clin Nurs 2015 May;24(9-10):1367-1379. [CrossRef] [Medline]
- Ormel I, Onu C, Magalhaes M, Tang T, Hughes J, Law S. Using a mobile app-based video recommender system of patient narratives to prepare women for breast cancer surgery: development and usability study informed by qualitative data. JMIR Form Res 2021 Jun 02;5(6):e22970 [FREE Full text] [CrossRef] [Medline]
- Ruiz-López T, Sen S, Jakobsen E, Tropé A, Castle PE, Hansen BT, et al. FightHPV: design and evaluation of a mobile game to raise awareness about human papillomavirus and nudge people to take action against cervical cancer. JMIR Serious Games 2019 Apr 08;7(2):e8540 [FREE Full text] [CrossRef] [Medline]
- Mendu S, Boukhechba M, Gordon J, Datta D, Molina E, Arroyo G, et al. Design of a culturally-informed virtual human for educating Hispanic women about cervical cancer. Int Conf Pervasive Comput Technol Healthc 2018 May;2018:360-366 [FREE Full text] [CrossRef] [Medline]
- Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q 2004;82(4):581-629 [FREE Full text] [CrossRef] [Medline]
- Bartholomew K, Parcel G, Kok G, Gottlieb N, Fernández M. Planning Health Promotion Programs: An Intervention Mapping Approach, 3rd ed. San Francisco: John Wiley & Sons; Feb 8, 2011.
- Arrossi S, Viswanath KV, Paolino M, Luzcubir P, Martiarena N, Ugarte M, et al. Effectiveness of a multi-component mhealth intervention for triage after HPV self-collection: preliminary results of the ATICA cluster randomized trial. 2020 Jul 20 Presented at: 33rd International Papillomavirus Conference & Basic Science, Clinical and Public Health Workshops; July 20-24, 2020; Barcelona.
- Sanchez Antelo V, Kohler RE, Curotto M, Viswanath KV, Paolino M, Arrossi S. Developing SMS content to promote Papanicolaou triage among women who performed HPV self-collection test: qualitative study. JMIR Form Res 2020 Mar 06;4(3):e14652 [FREE Full text] [CrossRef] [Medline]
|CC: cervical cancer|
|CFIR: Consolidated Framework Intervention Research|
|eHealth: electronic health|
|FG: focus group|
|HBM: health belief model|
|HPV: human papillomavirus|
|IA: information architecture|
|IBM: integrative behavioral model|
|mHealth: mobile health|
|SMS: Short Messaging Service|
|STI: sexually transmitted infection|
|UCD: user-centered design|
Edited by G Eysenbach; submitted 03.08.21; peer-reviewed by S Santarossa; comments to author 09.09.21; revised version received 01.11.21; accepted 17.11.21; published 13.01.22Copyright
©Victoria Sanchez Antelo, Lucila Szwarc, Melisa Paolino, Diana Saimovici, Silvia Massaccesi, Kasisomayajula Viswanath, Silvina Arrossi. Originally published in JMIR Formative Research (https://formative.jmir.org), 13.01.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.