Published on in Vol 4, No 10 (2020): October

Preprints (earlier versions) of this paper are available at, first published .
Using ADAPT-ITT to Modify a Telephone-Based HIV Prevention Intervention for SMS Delivery: Formative Study

Using ADAPT-ITT to Modify a Telephone-Based HIV Prevention Intervention for SMS Delivery: Formative Study

Using ADAPT-ITT to Modify a Telephone-Based HIV Prevention Intervention for SMS Delivery: Formative Study

Original Paper

1Center for Research and Evaluation, Kaiser Permanente Georgia, Atlanta, GA, United States

2Department of Social & Behavioral Sciences, School of Global Public Health, New York University, New York, NY, United States

3Goizueta Business School & Hubert Department of Global Health, Emory University, Atlanta, GA, United States

*all authors contributed equally

Corresponding Author:

Michael Prietula, MPH, PhD

Goizueta Business School & Hubert Department of Global Health

Emory University

Goizueta Business School

1300 Clifton Road

Atlanta, GA, 30322

United States

Phone: 1 7709009034


Background: African American adolescent females are disproportionately affected by sexually transmitted infections (STIs) and HIV. Given the elevated risk of STIs and HIV in African American women, there is an urgent need to identify innovative strategies to enhance the adoption and maintenance of STI and HIV preventive behaviors. Texting is a promising technology for creating preventive maintenance interventions (PMIs) that extend the efficacy of the original intervention. However, little guidance in public health literature is available for developing this type of application.

Objective: This paper describes a formative pilot study that incorporates user experience methods to design and test PMI texts for Afiya, an original evidence-based intervention (EBI) specifically designed for African American adolescent females. This study aims to describe the adaptation process of health educator–led phone calling to text-based communication.

Methods: The formative process followed the assessment, decision, adaptation, production, topical experts-integration, training, testing (ADAPT-ITT) framework for adapting EBIs and using them in a new setting, for a new target population or a modified intervention strategy. This study presents the details of how the phases of the ADAPT-ITT framework were applied to the design of the adaptation. An advisory board was constituted from the target population, consisting of 6 African American women aged 18-24 years, participating in formative activities for 12 weeks, and involving components of the PMI design. As Afiya included a telephone-based PMI, developers of the original Afiya phone scripts crafted the initial design of the SMS-based texts and texting protocol. The advisory board participated in the 1-day Afiya workshop, followed by 4 weeks of texting PMI messages and a midcourse focus group, followed by 4 more weeks of texting PMI messages, ultimately ending with a final focus group. At the advisory board’s request, this phase included an optional, additional week of text-based PMI messages.

Results: The methods provided a rich source of data and insights into the fundamental issues involved when constructing SMS-based PMI for this target population and for this EBI. Prior contact and context are essential as the health educator was identified as a key persona in the process and the messages were situated in the original (workshop) context. Narrative adaptations for personas emerged from advisory board discussions. Suggestions on how to expand the PMI to current, specific social contexts indicated that the use of narrative analysis is warranted.

Conclusions: The use of existing EBIs incorporating telephone-based PMI scripts facilitated the initial design of the texts, with a subsequent narrative analysis of the advisory board data providing additional adjustments given the actual context. Additional examination of the advisory board feedback revealed that personas would offer insight into and opportunities for a persona-specific modification of texting narratives.

JMIR Form Res 2020;4(10):e22485



Young people in the United States have never known a world without HIV [1]. The National HIV and AIDS Strategy has consistently identified African Americans as a population at increased risk for HIV to which prevention efforts and resources should be directed (President Donald Trump closed the Office of National AIDS Policy in 2017) [2]. In recent Centers for Disease Control and Prevention (CDC) reports [3,4], in 2018, African Americans comprised approximately 12.3% of the US population but accounted for approximately 42% of the new HIV diagnoses and a disproportionate rate of HIV deaths at 28.4 per 100,000 population (vs 4.9 per 100,000 for Whites), leading all other racial and ethnic groups. African American females comprised approximately 13% of females in the United States but accounted for 58% of new HIV diagnoses among females, with 92% of infections attributed to heterosexual contact. The infection rate for African American females (21.3 per 100,000 population) was 13 times the rate for White females (1.7 per 100,000). These data underscore the HIV disparities disproportionately burdening African American women.

Disparities persist among adolescents as well. In 2018, the HIV diagnosis rate among adolescents in the United States was highest among African Americans (26.0 per 100,000), which was 19 times the rate for White adolescents (1.4 per 100,000) [5]. Young people aged 13 to 24 years accounted for 21% of new HIV infections, of which 52% were African American. The incidence among persons aged 13 years between 2014 and 2018 revealed that the rate among African Americans was still excessive, being 8 times that of Whites [6]. These disparities highlight a need for increased, effective efforts to address HIV prevention efforts among young African American women.

Challenges to HIV prevention include low testing rates, youth unsure of their HIV status, inadequate or delayed sex education, incorrect or no condom use, substance use, multiple partners, and high sexually transmitted disease rates. The 2017 Youth Risk Behavioral Surveillance Survey results from 144 high schools [7] estimated that African American adolescents, compared with White adolescents, were more likely (15.2% to 7.9%) to have been tested for HIV, more likely to have multiple partners (11.7% to 8.6%), and more likely to have had sex before the age of 13 years (7.5% to 2.1%). The required health education varied widely, especially within large, urban school districts where, across grades 6 through 12, the range was 0% to 100% for each grade (median: 6th grade, 59.9%; 7th grade, 47.6%; 8th grade, 27.0%; 9th grade, 75.9%; 10th grade, 44.4%; 11th grade, 39.1%; and 12th grade, 53.6%) [8]. Even when delivered in those districts, variances were found on coverage of all 20 topics in grades 6 through 8 (range 17.6% to 41.0%) and grades 9 through 12 (range 42.8% to 75.0%) [8].

A systematic review and meta-analysis of extant US school-based HIV and STI prevention programs found no persuasive evidence for the effectiveness of school-based programs [9]. However, a recent systematic review specifically examining the impacts on African American adolescents found that sexual health interventions are associated with increases in abstinence and condom use and improved sexual health knowledge, self-efficacy, and intentions [10]. It is essential that the response to HIV and AIDS effectively addresses African American youth.

Early prevention programs addressing behavioral risk factors are important for reducing the HIV disparity observed among African American adolescents relative to White adolescents. Although less is known about the burden and epidemiological details of sexually transmitted infections (STIs), especially HIV and AIDS, among youth and adolescents than about infants and adults [11], there is accumulating evidence that designing interventions for adolescents requires unique combinations and insight into gender, developmental level, race, culture, and social factors [12-14]. This is especially salient in the escalated concentration of HIV and AIDS in southern United States [3,15-17]. Understanding these factors in the context of adolescents is essential for designing and delivering effective prevention programs to ensure that they are developmentally appropriate [13,18]. In addition, there is one particularly important question that is salient to this paper: how can the effect of a successful intervention be maintained?

Program Maintenance Interventions

A review of national STI and HIV prevention programs targeting African American adolescents indicated that the frequency and duration of a program’s implementation was related to its efficacy [19]. The implementation fidelity of extended face-to-face programs is difficult to maintain and expensive, particularly in an era of uncertain funding and support for HIV and STI prevention programs [20-23]. A recent metareview of youth-focused interventions concluded that they effectively influenced condom use, sexual health knowledge, and safer sex norms but suggested that future work should focus on intervention adaptations and supplements that may extend their protective effects over time [24]. Thus, the problem becomes one of sustaining program effectiveness over time—program maintenance interventions. This echoes the call from a focused review of HIV prevention interventions targeting African American women where technology can serve as boosters sustaining the effects of the intervention [25].

In general, preventive maintenance intervention (PMI) strategies such as making phone calls to participants have been more effective in sustaining intervention effects over time compared with interventions without a maintenance component [26]. However, incorporating intervention components to enhance behavior maintenance such as face-to-face programs and phone calls, is difficult to sustain, labor intensive, and costly [23]. Consequently, sexual health researchers have called for the increased use of technology-based interventions to promote the maintenance of HIV and STI preventive behaviors [27,28]. One of the most promising technological platforms is the mobile (smart) phone delivering health-related services—texting.

The Social Role of Texting

Mobile health (mHealth) technology is gaining recognition in the field because it affords a wide array of user-facing functionality and services [29]. Evidence supporting the feasibility, acceptability, and efficacy of digital interventions is growing [30-32], particularly for adolescents [33-39]. SMS texting is seen as an mHealth technology with specific promise for adolescents [40], thus serving as an opportunistic technology for impacting sexual health behavior [41-45]. For younger adolescents (aged 13-17 years), texting is the preferred mode of communication with friends, surpassing social media apps, face-to-face interactions, and telephone calls [46], with 95% of adolescents (African Americans: 94%) having access to a smartphone and 89% of adolescents being on the web almost constantly or several times a day [47].

The critical point is that texting is a social medium. As opposed to theoretical stances that presume the socialness of technology is heavily determined by the characteristics of the channel’s ability to provide cues, we adopted a social information processing perspective. This suggests that individuals adapt available cues for a given channel (eg, language, textual display options) to successfully accommodate their management of social interactions [48,49] over time. Technological characteristics are less about limiting the amount of social information exchanged and more about determining the rate of that exchange [49]. Furthermore, the social information processing approach is consistent with co-construction theories of adolescent development and technology-mediated exchanges, wherein adolescents are cocreating the internet environment through processes of social interaction and construct the same developmental issues online as they do off [50]. It is about establishing a common conceptual framework shared between the health educator and the client.

Adolescents’ online and offline worlds are strongly connected as they use online communication for offline issues, and to connect with people in their offline lives [51]. Indeed, research on Twitter and Facebook has shown remarkable structural similarities between online social networks and offline (face-to-face) networks [52]. This could include direct mapping between the online and offline networks as well as the inclusion of online-only individuals, thus treating the modes of communication as essentially the same [52]. This explains the explosion of messaging among adolescents for relationship management. For adolescents, texting is as much a social choice as a technical choice. In fact, it is often the preferred choice [53], surpassing social media apps and phone calls, with adolescent females more likely to use texting as conduits for conversations with friends [54].

Consequently, we suggest that interventions beginning by establishing a strong social context (eg, initial meetings, workshops) would benefit from a texting-based PMI that can retain the social presence of that context by affording social presence cues to enhance the message [55]. The belief is that such hybrid intervention models can help sustain the impacts of EBI by sustaining the narrative engagement of participants. A mechanism we are developing to sustain narrative engagement is the tailoring of PMI messages via the specification of context-determined personas.

As with other intervention components, PMIs must be carefully designed and implemented, otherwise they may undermine the initial intervention [23]. Reviews of texting or mobile apps intended to increase various specific preventive or adherence behaviors in adolescents (eg, sexual health, smoking, oral health, sickle cell disease) reported that the overall efficacy findings were modest, but again only a minority reported a theoretical framework in their design [34]. The feasibility and accessibility of SMS as a behavioral maintenance strategy for African American adolescent populations with increased risk of HIV and STI acquisition requires continued adaptation of evidence-based interventions with text messaging–enhanced content to expand our knowledge of the potential of this approach [56].

Therefore, instead of starting with the technology, start with a theoretically grounded EBI, then discern how to adapt the EBI to technology to each other. The integrity of the EBI must be maintained whereas the capability of the technology must be exploited in the context of the target population. Although a variety of generic approaches (design guides or review recommendations) for integrating technology into behavioral change interventions have been proposed [57-62], a more focused approach was appropriate for this adaptation. We selected a design framework to guide how the intervention can besystematicallyadapted to a technological form and use.

In this paper, we present a formative pilot study that describes the design process applied to adapting an EBI to reduce the risk of HIV and STI among African American adolescent females. We selected an existing EBI for this target group that would likely benefit from a text-based program maintenance intervention to extend the EBI’s reach, sustainability, and effectiveness. We applied an adaptation-implementation framework that demonstrated efficacy for that purpose—the Assessment, Decision, Adaptation, Production, Topical experts—Integration, Training, Testing (ADAPT-ITT) framework [63].

ADAPT-ITT Framework and Implementation Science

Calls to advance implementation science argue for the development of adaptation strategies that would more comprehensively describe the needed fit betweeninterventions and their settings [64]. A recent review [65] traces the history of the most prominent models, including the ADAPT-ITT framework, noting the primary health context of their application and extracts steps that is common across frameworks. These frameworks reflect the CDC’s earlier general guidance describing the ADAPT process intended to assist health departments and community-based organizations in adapting an EBI to fit the cultural context, risk determinants, risk behaviors, and unique circumstances of the agency without competing with or contradicting the core elements and internal logic [66].

The purpose of this research is to use the ADAPT-ITT framework to modify existing EBIs to increase STI and HIV preventive behaviors among African American females. Adaptation focuses on translating health educator–facilitated phone calls to SMS-delivered messages. We selected the ADAPT-ITT framework because of our experience with the framework, its relevance to our target population, and its demonstrated effectiveness in guiding the design implementation of postworkshop PMIs to extend elements of the primary intervention over time [67]. The ADAPT-ITT framework is being widely used to design and implement HIV and STI prevention interventions and other prevention adaptations in diverse settings in different cultural contexts, both domestically and internationally [68-78].

This was a formative study using qualitative methods. ADAPT-ITT has 8 phases. Each phase brings contextual nuances and constraints that determine how the phases are engaged and the timing of corresponding tasks. The phases are as follows: (1) Assess the proposed new priority population’s HIV risk profile, (2) Decide on whether to adopt or adapt an EBI, (3) Administer novel methods to facilitate the adaptation process, (4) Plan on what aspects of the EBI need to be adapted and plan on how best to evaluate the adapted EBI, (5) identify Topic experts to assist in the adaptation process, (6) Integrate material from the topic experts to adapt the EBI, (7) Train staff to implement the adapted EBI, and (8) Test the adapted EBI. Our texting adaptation process describes how the ADAPT-ITT phases can be used to guide the adaptation of EBI components to texting.

The goal was to select an existing EBI for African American adolescent females who would benefit from text-based PMIs to extend the EBI’s reach, sustainability, and effectiveness. We applied the ADAPT-ITT framework to translate an original EBI (Afiya) that included a face-to-face workshop followed by health educator phone call PMIs to an adapted intervention that would include the same face-to-face workshop but followed-up by health educator texting PMIs. Table 1 summarizes the 8 steps and the lessons learned in the context of this adaptation pilot. The lessons learned identified as structure describe changes made to EBI delivery or logistics. The lessons learned identified as content describe changes to the information delivered in the intervention. The core element of the translation process is the formation of an advisory board (advisory board) selected from the target population.

Table 1. Application of the Assessment, Decision, Adaptation, Production, Topical experts—Integration, Training, Testing framework with a preventive maintenance intervention texting adaptation in Afiya.
PhaseMethodology decisionsResults or observations
1. Assessment
  • Formed advisory board
  • Conducted an initial meeting with advisory board
  • Conducted meetings with intervention experts for the target population
  • The target population (African American adolescent females) requires interventions addressing their specific situation
  • The intervention needs to address safer sex norms, sexual negotiation, and refusal skills, HIV and STIa preventive attitudes
  • The advisory board was selected for project, met, and provided input on the plan
  • Advisory board members were paid as consultants to develop or test the feasibility of texting PMIb
2. Decision
  • Selected HORIZONS and Afiya interventions
  • Decided to adapt Afiya phone-based PMIs to texting PMIs
  • Original developer of Afiya-led adaptation
  • mHealthc and texting literature reviewed
  • HORIZONS, an evidence-based intervention that successfully reduced STIs and increased condom use among young women, was selected as it appropriately addressed the target population
  • Afiya selected as it demonstrated a PMI based on HORIZONS to the same target population, but extend the efficacy of the HORIZONS intervention
  • Texting is most likely the simplest mHealth adaptation to adapt from Afiya and appropriate implementation technology choice for the target population
3. Administration
  • Decided not to modify Afiya core elements
  • Decided to focus on Afiya core element support by texts
  • Adaptation would involve scripts and texts responses based on Afiya documents and data
  • Retention of primary intervention form assured standard of care and served as a shared primary intervention control (therefore, theater testing was not conducted)
  • 5 core elements of Afiya were identified to be supported by PMIs
4. Production
  • Designed 8-week iterative formative pilot plan for adaptation
  • Designed questionnaires and focus group–led questions
  • Designed initial texts and support scripts
  • Selected company for formative pilot texting
  • Reviewed with Afiya and HORIZONS creators
  • Reviewed plan with advisory board
  • Assembled Afiya workshop materials
  • Iterative formative pilot designed for advisory board
  • Primary intervention led by Afiya and HORIZONS developers in formative pilot and support scripts and associated text messages were created
  • Important to have both advisory board and intervention developers review pilot design and timing
  • Important to have intervention developers review PMI scripts and texting form or content (Draft 1 completed)
  • Texting platforms vary in terms of capacity, functionality, and cost. Total program costs should be estimated
5. Topical experts
  • Obtained review advice regarding HIPAAd issues relevant to texting
  • Obtained review advice regarding pre- and postintervention CASIe instruments for future effectiveness pilot
  • Met with texting companies (with advice from ITf) for future effectiveness pilot
  • CASI content should be reviewed for duplication or replication as well as total time required (test run the instrument)
  • Texting is not encrypted, so both HIPAA (and local IRBg/state) requirements must be reviewed regarding texted data and data privacy issues
  • Role, functionality, and cost of texting companies were more clearly defined with this experience
  • Overall costs for the 8-week formative pilot were made
6. Integration
  • Integrated Draft 1 and topical expert comments for scripts, SMS texting content or form (Draft 2)
  • Conducted Afiya workshop with advisory board
  • Integrated topical expert comments of pre- and postworkshop CASI materials
  • Integrated Draft 2 and CASI components (Draft 3)
  • Final review by advisory board and Afiya and HORIZONS creators
  • Draft 2 completed
  • Draft 3 completed
  • Final formative pilot design completed
7. Training
  • Created training materials for the formative pilot
  • Formative pilot materials completed
8. Testing
  • Submitted to IRB for clearance of the formative pilot

  • Obtained IRB clearance to determine adaptation efficacy

Step 1: formative pilot

  • Conducted 8-week formative pilot with advisory board: primary Afiya intervention, 4-week texting, focus group 1 (adjustments), 4-week texting, focus group 2 (adjustments)
  • Iterative pilot design provided important feedback on texts (timing, wording, dose) as well as script and CASI modifications
  • Information gathered during the first advisory board focus group was applied to modifying the second 4-week texting session, information gathered during the second 4-week focus group was also useful (topic experts were consulted during these sessions as necessary)
  • 5 personas identified, exit interviews added
  • Results informed design of adaptation impact pilot

Step 2: feasibility pilot

  • Designed texting PMI RCTh feasibility pilot study
  • Study methods submitted to IRB for approval
  • Obtained IRB clearance for 3-arm feasibility pilot study
  • Preparing for PMI RCT feasibility pilot study to examine short-term intervention efficacy

aSTI: sexually transmitted infection.

bPMI: preventive maintenance intervention.

cmHealth: mobile health.

dHIPAA: Health Insurance Portability and Accountability Act.

eCASI: computer-assisted self-interview.

fIT: information technology.

gIRB: Institutional Review Board.

hRCT: randomized controlled trial.

Phase 1: Assessment

Who will be the primary audience for the EBI? Phase 1 included incorporating information from the published literature on the need for behavioral maintenance strategies that are sustainable, encouraging health behavior maintenance (as previously summarized). The epidemiological data for this target population highlighted the health disparities in the prevalence of HIV transmission through heterosexual contact among African American female adolescents and young women. Our target population was well defined, and the population attributes and risk profiles were already matched with EBI theory and design approaches to interventions. Therefore, we could immediately recruit an advisory board from that target population. The advisory board members consisted of 6 African American women aged 18-24 years to serve as additional assessment-informative roles throughout the adaptation process. The advisory board members were compensated to participate in the formative advisory activities for 12 weeks.

Phase 2: Decision

What EBI Will Be Used and Will It Be Adapted?

In phase 2, the critical decision on which EBI to select or to determine whether any EBI would be appropriate is made. This necessitates an examination of EBIs and of how likely the target population is to respond to the adapted components of the intervention. In this case, texting. This provides the theoretical and empirical foundation for the form and substance of the texting PMI.

Selection of the Primary EBI: Afiya

We examined several HIV and STI interventions explicitly designed and tested for either Blacks, Black females, Black adolescents, or Black adolescent females. Afiya was selected as the intervention to be adapted for the project for 3 reasons. First, Afiya [79] incorporates the HORIZONS intervention that has been evaluated and designated a tier I (best) evidence-based risk reduction intervention by the CDC [80]. HORIZONS, an in-person group-delivered session tailored for Black adolescent females, significantly reduced chlamydial infections and increased HIV and STI preventive behaviors, partner communication efficacy, condom use efficacy, and HIV and STI prevention knowledge. Importantly, the underlying theories of HORIZONS and Afiya are social cognitive theory [81] and the theory of gender and power (TGP) [82-84]. The TGP addresses partner influences and gender-based social correlates that influence behavioral risk factors, which have been extended to address the exposures, social or behavioral risk factors, and biological properties that increase women’s vulnerability to HIV acquisition [83,85].

Second, Afiya used HORIZONS plus bimonthly phone calls for 3 years to determine whether healthy behaviors could be maintained over time. The calls were brief, tailored one-on-one sessions with a health educator, delivered over a 36-month period, and the calls served as PMIs. In the Afiya trial [79], the workshop (tested in HORIZONS) was implemented as a single 4-hour group session delivered by trained African American female health educators. When answering a call, health educators followed an algorithm in their call scripts to guide them through scenarios involving intimate and sexual partnerships, referencing information from the workshop. Afiya (1 workshop+18 phone calls) was efficacious. Over the 36-month follow-up, compared with the control group, participants in the treatment group had significantly lower incidences of chlamydial (50% reduction) and gonococcal infections (60% reduction), a higher proportion of condom use (both within 90 days and 6 months before assessment), and fewer sexual episodes when high on drugs and/or alcohol [79]. These findings provide initial insights into (1) how to begin to adapt the telephone-based PMI to an SMS-based PMI and link them to core elements of the intervention theory and (2) how the target population would respond to a communication mode that differed from the initial telephone calls.

Third, the developers of both HORIZONS and Afiya were available for consultation and reviewed the project products to maintain the integrity of the adaptation and ensure that it remained faithful to the theoretical components of the original intervention.

Selection of Texting Adaptation

As discussed, simple mobile phone–based texting was selected as it is ubiquitous, tethered to individuals, and a widely accepted technological application, especially in the target population (teen or adolescent African American women). Using mobile phone technology for adolescent and young adult health purposes was promising as most members of this population possess this technology and exhibit distinct patterns of use, especially the enduring dominance of texting [40,86,87]. Thus, in terms of reach, texting affords a preimplemented, preadopted, and preferred technological platform for adolescents.

Phase 3: Administration

What components of the selected EBIs should be adapted? We decided that the adaptation should address the selected core elements of the EBI: (1) ethnic and gender pride role models, (2) sexual health decision making, (3) HIV and STI knowledge, (4) healthy and unhealthy relationships, and (5) negotiating safe sex. It is important to note that several of these activities involve direct, face-to-face, and small group interactions (discussion and simulations) to address situational-partner negotiation strategies and skills, and other activities involve physical skill development and practice (eg, condom application). As these are both essential and not substitutable by texting, it was determined that the adaptation would not be directed toward modification or replacement of the activities associated with the core elements of the workshop. Discussions with experienced health educators noted that each core element and its associated activities supported thematic narratives that recurred in the workshop. Consequently, the core elements of the EBI did not need to be adapted; rather, the narratives that surrounded each core element needed to be extended. Texting, as it turns out, is a powerful, yet efficient, mechanism to accomplish this. Toward that end, all messages would be set in the context of participants in interacting with messages prepared by Tina (one of the health educators).

The adaptation of Afiya involved modifying the telephone scripts and phone-based messages to an SMS text narrative form, aligning with the Afiya core elements. These messages were designed by the developers of Afiya and served as plausible first approximations to test the messages, the messaging concepts, and the messaging technology with members of the target population in the formative pilot (phase 8). Thus, the Afiya scripts were predefined narrative structures tailored to the texting form (examples shown in Table 2). As this is a text-based intervention, theater testing was not used; rather, equivalent methods (and supporting theory) designed to examine how humans interact with computers were employed. In general, this is referred to as user experience (UX) analysis and design [88,89].

Table 2. Mapping Afiya core elements to texting categories.
Afiya core elementsPrimary intervention activitiesAssociated text category or example
  • Ethnic and gender pride
  • Role models
  • Poems and affirmations
  • Media images
  • Role models
Poems and affirmations (motivational message): “It is where you are headed not where you are from that will determine where you end up (Marion Wright Edelman)”
  • Sexual health
  • Decision making
  • Goal setting
  • Values
  • Sexual health options (condoms, abstinence)
Sexual health choices (vote poll): Question: What is ur sexual health choice? AbstinenceCondomsNeitherNot sexually active Automated responses: Abstinence is the 100% way 2 protect against STDsa/HIV. Remember 2 talk with ur partner abt ur sexual health choiceRemember 2 use condoms each every time u have sex. Talk with ur partner abt ur sexual health choice before u have sexAbstinence is 100% STDa protection. Condoms protect u from STD if u use them each time. Consider 1 of these optionsIf u decide 2 have sex, condoms protect from STDs if used each every time. Talk with ur partner abt ur choice
  • HIV/STD knowledge
  • Facts about STDs
  • Testing
  • OPRaH
  • Condom do’s and don’ts
STD testing (cues to action): Question: When do u need an STD test? Partner has STDHad sex-no condomNew partnerAll of the above Automated responses for (A)-(D): Get tested when new partner, STD symptoms, sex no condom, ur partner has STD. Planned parenthood MTW 8-4:30pm; xxx-xxx-xxxx
  • Healthy and unhealthy relationships
  • Personal risk factors
  • Understanding risks
  • What turns you on?
  • Boundary setting
  • Peacefully breaking up
Boundary setting (cues to action): Question: Y is it important 2 know ur sexual health boundaries? 2 help stick 2 ur limits2 communicate them to ur BFA B Automated responses: One that’s a start! Stick 2 ur limits. Its okay 2 say what ur comfortable doing what u don’t want 2 doThat’s a start! Telling ur partner what ur boundaries r is important so he doesn’t make u uncomfortable or cross the lineExactly! U want 2 b comfortable happy in ur relationship. Communicating ur boundaries 2 ur bf is healthy
  • Negotiating safe sex
  • Healthy communication
  • Sexnarios: negotiation skills
  • Condom excuses and comebacks
Communication (cues to action): Question: What type of communicator are u in ur relationship? AggressivePassiveAssertive Automated responses: If u r aggressive, do 1-2 assertive things. Avoid yelling threatening. B direct honest. C how he responds.Passive If ur passive, do 1-2 assertive things next time. Avoid the silent treatment. B direct honest. C how he responds.Great! Continue 2 b assertive when u talk 2 ur partner, even when it gets hard. Be direct honest. C how he responds

aSTD: sexually transmitted disease.

bMTWF: Monday, Tuesday, Wednesday, and Friday.

Text messages fit into 1 of 3 categories: motivational messages, vote polls, and cues to action. Motivational messages are one-way messages delivered to participants to serve as inspiration using poetry from Black authors and other leaders. Vote polls are two-way messages initiated by Afiya’s texting platform. The vote polls pose a close-ended question, and participants respond with the letter corresponding to their answer. On the basis of their answers, the system has predesigned responses that will automatically reply to the participant. The automated replies provide information linked back to the Afiya content, serving as a reminder of key messages from Afiya. The cues to action are like vote polls and are two-way messages initiated by the Afiya texting platform. However, cues to action are specifically designed to have automated replies that cue or prompt the participant to engage in a specific action, such as sexually transmitted disease testing or initiating a conversation regarding STI prevention with a sex partner. Each message maps on to at least one of the Afiya core elements presented in the main intervention workshop.

Phase 4: Production

How do you adapt and document adaptations? We analyzed the results of the focus groups and texting and then reviewed them with the HORIZONS and Afiya creators. Initially, the responses to SMS texts were made by a health educator and guided using the modified Afiya phone scripts, and these were adjusted based on the analysis and the consultation with the HORIZONS and Afiya developers. We also initiated the design of computer-assisted self-interview (CASI) questions and instruments as well as focus group–led questions. Measures of fidelity and quality assurance included postsession interviews and participant evaluations. Initial designs of the SMS texting and automated two-way communication were created with help from the Afiya developer with respect to the core elements of the EBI.

In parallel, we began to design the implementation requirements for selecting a commercial texting platform that would best serve our formative texting pilot needs to capture data from a research study, including questionnaires, instruments, and focus group–led questions. At the time of the study, many commercial texting platforms were built for mass marketing. We needed a platform that would allow us to easily set up and automatically send messages based on their cohort or study condition as well as conditional texting responses given a texting question (probe). Additionally, we needed to be able to initially use the platform for recruitment and then transition people into the appropriate study cohort or condition once they consented and were enrolled into the study. Once selected, we would have to code the scripts or texts and conditions as required by the vendor to realize the texting PMI for Afiya.

During this phase, the group drafted an 8-week formative pilot plan to engage the advisory board in the adaptation process. However, given the nature of mHealth technology and uncertainty regarding the specifics of adapting the narratives, we engaged an alternative design method involving an individual texting and response analysis, followed by a group discussion. This resulted in iterations between the administration and production phases, reflecting a development approach often used in software projects to define and refine the UX by tightly integrating interactions and adjustments in design [90].

The overall sequence of the formative pilot is as follows: advisory board members initially participated in a 4-hour HORIZONS workshop (ie, the primary intervention) led by a health educator. Following the workshop, weekly automated SMS text messages were sent that highlighted key messages from the core elements of the workshop for 4 weeks. Advisory board members would activate the weekly text by responding to a weekly text prompt, such as:

Good morning! 2 get ur next HORIZONS convo with Tina, reply to this text with the word WEEK1

They would then receive a text that required a response related to a specific core element covered in the workshop, such as sexual health decision making:

Afiya talked abt sexual health choices: abstinence, condom use or neither. What choice is best for u right now?

Subsequent texts were selected using response scripts based on the original phone scripts used in the Afiya phone-based PMI. The timeline for the pilot study is shown in Figure 1. At the end of 4 weeks, the advisory board focus group met to provide feedback. The team reviewed the results and adjusted the scripts and texts. There were then 4 additional weeks of messages followed by the final advisory board focus group, allowing 2 cycles of iterated user response elicitation and refinement (this type of small-scale, iterated focused development is common in UX studies and is similar in theory to spiral development in software engineering but involves rapid testing and turnaround. The presumption is that users may have opinions of their needs and how they would react to a system but after actually engaging a small prototype system the requirements change, which will cause the system to be modified and reassessed in an evolving spiral that converges as the system is developed. This is most common when requirements are ill-defined, as is often found when implementing new types of interactions with technology). Finally, the decisions, designs, and information emerging from phases 1 to 4 were integrated into the first draft, Draft 1.

Figure 1. Timeline for formative pilot study. PMI: preventive maintenance intervention.
View this figure

Phase 5: Topic Experts

Who can assist with the adaptation? Although experts were consulted as needed throughout the process, phase 5 involved additional experts whose input was specifically necessary to help review the adapted intervention design (content and form). In this case, additional experts were solicited: (1) experts in designing CASI items and psychosocial instruments relevant to the purpose and population, (2) representatives from selected third-party texting companies to determine capabilities, constraints, and pricing, and (3) those who had specific Health Insurance Portability and Accountability Act knowledge regarding ethical-legal implications of the possible SMS texting content and data privacy or protection issues. We generated initial estimates of total program costs and had them reviewed by the team and administrators. Primary cost estimates included the texting company, a graduate research assistant (GRA), and participant incentives.

Phase 6: Integration

What is going to be included in the adapted EBI? Phase 6 involved the integration of the results from Draft 1 (phase 4) with the results of the topic experts’ review of the fidelity of the script or message designs relative to the original Afiya intervention core components (phase 5) to create Draft 2. Project members reviewed the pre- and post-Afiya workshop CASI measures (the workshop was offered when phase 4 CASI materials were completed and vetted) and revised the instruments to (1) reduce their length and (2) include assessment items appropriate for evaluating an SMS-based intervention. We finalized the modified Afiya scripts for a texting algorithm that would be used by the health educator in the postworkshop texting in phase 8. These were reviewed by Afiya developers and the advisory board. Our team produced Draft 3 after completing the workshop and after text communication with advisory board members in phase 6.

Phase 7: Training

Who needs to be trained? Once the decisions were made regarding the adapted text intervention (scripts, SMS texts, texting platform), intervention-specific training materials were developed for the formative pilot. Health educators were trained on how to implement the Afiya workshop; materials were already available, with minor modifications introducing SMS texting and approved by the Afiya developers. Health educators were trained on the SMS text scripting component and texting platform use and were part of the development process. One of the study principal investigators and a GRA were trained to develop and manage the texting platform and messages. Data analysts were trained on the texting platform’s data components such that texts and associated data could be acquired from the company.

Phase 8: Testing

Was the adaptation successful? The definition of success and the form of the testing depend on the context of the adaptation, but the general objectives remain. As our adaptation did not include delivery to a different target population, we modified the two-step testing processes of phase 8.

In Step 1, we assessed the adaptation efficacy by conducting an 8-week formative pilot study with the advisory board members, as shown in Figure 1. This important validation step addresses whether the intervention was effectively adapted and implemented correctly, involving close monitoring and specific types of data acquisition and feedback and testing all the operational components including health educator training and performance of the texting company. We decided against a pure formative pilot (ie, engaging a new set of participants) because of the extensive involvement of the advisory board and HORIZONS and Afiya developers, the retention of the same target population as Afiya, and the success of the iterative design process with the advisory board for the formative pilot. This approach was extremely helpful and informative in designing the final product of this stage, the randomized controlled trial (RCT) efficacy study.

Step 2 involves assessing the short-term intervention efficacy of the PMI by conducting an RCT feasibility study to test the efficacy of the PMI over an extended duration with the target population. Regarding Part 2, a 3-arm RCT efficacy study (standard of care, Afiya workshop only, and Afiya+texting) was designed. This has been approved by Emory’s Institutional Review Board and is being initiated.

As noted, the formative study involved the advisory board members (n=6) actively participating in adapting Afiya to a texting platform, and they were compensated for their time and effort. Focus groups with the advisory board were conducted midway through the pretest and after the last week, allowing 2 cycles of iterated user response elicitation and refinement. Examples of the feedback after week 4 are summarized in Textbox 1. For this focus group, we sought to distinctly examine 4 categories of texting issues: timing, wording, content, and form. The narrative analysis was very useful in extracting issues regarding texting characteristics, such as timing (eg, thank you messages came too early in the texting series), wording (eg, questions were judged as being clear and simple), content (eg, inspirational messages were appreciated), and form (eg, desired more individualized feedback). Getting the text wording correct for the target audience was also a continuous improvement process to facilitate culturally appropriate narrative engagement via text. Frequent use of commonly agreed-upon abbreviation dialects in texting results in these abbreviations being rapidly absorbed into the language and automatically (linguistically) recognized as words [91], reflecting how humans socially adapt to a technology (and its constraints). On the basis of the first focus group with the advisory board, the following modifications were made for the second 4-week session:

  1. We added a motivational or inspirational message each week in addition to the regular text, such as “It is where you are headed not where you are from that will determine where you end up” (Marion Wright Edelman).
  2. We added more complex response scripts to the prompts because participants felt some of the texts were too open ended and not specific to them.
  3. We provided individualized feedback and advice during a time for open questions about any topic.
  4. We gave advisory board members a specific window of time to chat with the health educatorliveinstead of always getting the automated message responses.

Results from the advisory board texting formative pilot (texting issues and examples of reactions; weeks 1-4).


  • Texting frequency should be increased; daily texts are acceptable
  • No preferences for weekday vs weekend texts
  • Texts should not come too early in the day; better to get texts starting mid-day and continue through early evening
  • Participants indicated that the Thank You message came too early in the text series and would have preferred a more in-depth conversation via text


  • Text wording was straight-forward and participants liked that the messages were not sugar coated
  • Questions were clear and simple


  • Texts about sexually transmitted diseases were favorite and made them think about their behaviors
  • When discussing relationships, participants emphasized that content should focus on communication in relationships and engaging in safe behaviors. They also wanted the discussion to expand to other facets of relationships (eg, quality of relationship, satisfaction with relationship)
  • For more complex issues like relationships and communication, the participants requested more feedback and information to help keep them on track
  • Participants indicated that any topic would be acceptable by text if they knew where their answers were going and who was reading or responding to the texts
  • Wanted a motivational or inspirational message or quote each week


  • Dissatisfied that there was not a person live on the other end of the texting
  • Disliked texting with a computer that could not be more interactive and have a conversation with a live person
  • Wanted more individualized feedback and advice to come with the texting program
Textbox 1. Results from the advisory board texting formative pilot (texting issues and examples of reactions; weeks 1-4).

All advisory board members participated during weeks 5 and 6; participation decreased during the second half of the pilot. Reasons for nonparticipation were as follows: (1) phone temporarily disconnected and (2) busy during the specific designated conversation window (the scheduled time to interact). Within the final focus group, comments were sought regarding their overall experience and thoughts for the PMI. Examples of the feedback after week 8 are summarized in Textbox 2. These fell into 4 primary categories: HIV and STI information, context-specific social network maintenance, social engagement, and other ecologically relevant information or content. Participants sought additional information on related programs and topics beyond those addressed in the workshop. They also reported that the social connection with the health educator was indeed maintained, facilitating engagement. An interesting consequence of the pilot was the value of the social network that emerged within the context of the pilot and the role that delivery platform could play in maintaining that social network.

Results from the advisory board formative pilot (weeks 5-8, final focus group).

HIV and sexually transmitted infection information:

  • Participants wanted to make sure that information about new programs they may be able to participate in would be sent to them
  • Participants requested that the texting program also be a forum to let participants know about group meetings and group events surrounding related topics, such as medical or health service options (clinics that provide free or reduced-price services), education events, and training activities

Context-specific social network maintenance:

  • They stated that they enjoyed the texting but loved the groups
  • They emphasized repeatedly a desire to continue meeting (in person) with the groups
  • They expressed a design to have a forum to stay in touch in case their phone numbers change
  • Participants noted that they liked having greater time to talk and the ability to have more detailed, back-and-forth conversations

Other ecologically relevant information:

  • Participants stated they wanted information on the following topics: relevant community events, parenting, housing (different locations, pricing, etc), job information (job fairs, career info, etc), and health insurance information

Social engagement:

  • Participants stated that they felt like they were texting with a friend and felt very comfortable texting with the health educator. Important characteristics for health educator: woman, relatable, trustworthy, the same person over time to develop a relationship with, knowledgeable person who can provide accurate information
Textbox 2. Results from the advisory board formative pilot (weeks 5-8, final focus group).

Postadaptation, we analyzed how advisory board members engaged during the adaptation process, focusing on the emergent themes of interactions, to define an initial set of personas. Personas are specific, but hypothetical, individuals possessing core sets of relevant characteristics (eg, situations, beliefs, goals) that differentially influence the interaction narratives. The persona analysis defined 5 personas and linked each persona to counseling scripts from the Afiya intervention that reflected the context of prevention needs based on the situational narrative, the condom use behavior, and the current status of any relationships. Persona results were reviewed and revised by Afiya health educators and the project team. Note that personas are usually stable (as a descriptive model for the target population), but individuals may move between personas. If certain characteristics change, persona classifications can be modified (eg, a Shannon may turn into a Lexie). The results are shown in Table 3.

Table 3. Results of the persona analysis for the Afiya texting adaptation.
NarrativeShannon has been in a long-term relationship with her boyfriend for almost a year. They stopped using condoms after the first couple of monthsTonya is single. She just got out of a relationship and needs some time to focus on herself and her schoolworkKia is dating someone, but also talking to a couple of other guys. She does not have a formal boyfriend but has a consistent sex partner. However, they are not in an exclusive, monogamous relationshipShauna is starting a new relationship with a guy. They’ve been seeing each other for a month. She is abstinent and is ready to let him know her sexual health choiceLexie has both a boyfriend and a casual sex partner
Condom useShannon has discontinued the use of condomsTonya is not having sex right now but wants to use condoms when she does get into a relationship againKia uses condoms with her sex partnersShauna does not need condoms at this time as she is not having sexLexie uses condoms with her casual partner but not with her boyfriend
Relationship statusShannon has had a boyfriend for 1 yearTonya has no boyfriendKia has no boyfriend but has multiple partnersShauna has a new partnerLexie has concurrent sex partners
Link to Afiya intervention scriptsScript D: no to condom useScript A: no boyfriend; me timeScript C: yes to condom useScript B: yes to abstainingScript E: inconsistent condom use

Finally, upon request from the advisory board members, we provided them with the opportunity to text in with any questions they may have. This was an opportunity for them to seek additional information that they may not have learned through the program thus far. The text lines were open for 7 days. advisory board members were not compensated for texting during the bonus week 9; it was an opportunity for them to get any additional information from a health educator before the program ended. Half of the advisory board members participated in the unpaid bonus week of texts. The chat line parameters were as follows:

  1. Chat lines open for 7 days.
  2. You will not get paid for these texts.
  3. You can ask about anything you have questions or concerns about.
  4. You will get a response from Tina within 24 hours.
  5. If you have an emergency, you should always call 911.

The motivation for this paper was provided by the significant disparities in STI and HIV health risks among African American youth. Ethnic minorities in the United States have STIs 30 times greater than that in White, middle-class populations [92]. To address this disparity, coupled with scarce funding and staffing resources, new forms of digital technology solutions are constantly being sought, proposed, and attempted to curb the STI and HIV risk behaviors of adolescents and young adults, who are at most risk [67]. However, few guidelines currently exist to inform designers how digital media can be used in ways that can impact the efficacy of an intervention.

This paper describes a conservative approach to contribute to this effort. Specifically, this paper describes the development of a systematic process to incorporate simple texting messages as an adjunct program maintenance intervention to an evidence-based sexual health intervention for African American adolescent women.

The systematic approach of the ADAPT-ITT framework was clear and effective in phases 1 through 7. The reason was the reliance on the well-proven and understood primary intervention (HORIZONS) and the prior efforts (and developers) experienced in adapting that intervention to a communication-based PMI (Afiya). However, in developing technological implementations, we found it necessary to engage a sample of the target population with the PMIs directly, rather than the theater-testing approach suggested in phase 1.

The type of small-scale, iterated development approach with the formative pilot is common in UX design and software engineering. The presumption is that users may have beliefs about their needs and how they would react to such a system, but after engaging a system, many of their beliefs and preferences (therefore the requirements) change. This is most common when implementing new (to users) types of interactions with technology. Consequently, the formative pilot was conducted in phase 8: Testing, as it required a full implementation of the PMI to gather efficacy and implementation data.

As shown in Figure 1, the formative pilot included 2 focus group sessions interspersed within the SMS texting intervention. This allowed intermediate analysis of the 4-week experience to be reviewed by the developers (and any relevant topic experts) and adjust the SMS texting narrative characteristics. Thus, the formative pilot testing in phase 8 looped back to elements of phases 4 to 7.

It is unlikely that technology will elevate an ineffective intervention to one that is effective—automating a weak process generally results in an automated weak process. There is also a risk that poorly designed and implemented technological components may lower the efficacy of a proven intervention. The selection of texting was seen as a key technology commonly adopted by this group as a mechanism for sociocultural connectivity, thus having the potential to increase the uptake of extant interventions by extending the narratives that began in the core EBI workshop activities.

Early and repeated inclusion of the target population, advisory board, was essential in the development. In particular, the generation of personas from the advisory board participants provided insight into important narrative variations for subsequent delivery design. Key considerations for end users should be sought early in the process of app (or other digital) behavioral intervention design to ensure both short- and long-term engagement [93-95]. In the paper by Pettifor et al [13], titled Adolescent Lives Matter, they argue that “adolescents should be involved throughout the process from design to implementation.” This is supported by a recent systematic review of mHealth apps for adolescent users and concluded that there is a fundamental difference between adult and adolescent preferences in apps, where apps for adolescents need features that support decision making [91]. In summary, a quote by Glasgow et al [96] echoes the spirit of this paper’s intent:

Controlling the epidemic will not only require bringing successful interventions to scale but also tailoring them to vulnerable and marginalized populations and understanding the social, cultural, and institutional contexts in which interventions are delivered.
[Page S26]

In summary, 4 general suggestions can be made regarding how to proceed when considering mHealth solutions.

Suggestion 1

Do not start with the technology. Start with the EBI-based workshop and then discern how to adapt both.

EBIs (and the underlying theoretical base) define core elements that have demonstrated effective results. Technology alone cannot increase efficacy to significance but has the potential to decrease efficacy to insignificance. This leads to the necessary inclusion of methods that address user-centered issues when designing the technological components.

Suggestion 2

Technological adaptations of EBIs need to explicitly address the user’s experience as developers design, evaluate, and implement the technical components of an intervention.

Participants of technology-based intervention components are indeed users interacting with a service. Much is known about how to design, evaluate, and implement user services in general and how to assess the UX with technology in particular. This leads to an important conclusion regarding how to view the UX with adapting an EBI using a texting PMI.

Suggestion 3

Texting is less of a technical choice and more of a social choice.

Texting is not about creating a technological intervention and then trying to get individuals to adopt and to disseminate it. Everyone who has a mobile phone has the application; most people know how to use that application; most people have adopted that application for use. There is another element to consider; people use it for the same reason: engaging in narratives with others. Thus, a critical communication pathway already exists but it is limited. Interventions that use mHealth and texting compete for the user’s attention and the user’s time. Regarding the EBI, attention is gained, for example, via the EBI workshop (as demonstrated for this population for this health problem).

However, the narratives occurring in the workshop must be maintained through the initial (and continuing) establishment of trust, which mediates between information quality and use [97]. All health educators know this. By understanding the cultural components of the target population’s preferences, choices of how the technology is used can engender that trust, thus sustaining critical narrative connections. Indeed, today’s young adults value technology as a way to enhance, not replace their interactions with their health providers [37]. This leads to our fourth suggestion.

Suggestion 4

Texting as a PMI used with an EBI workshop is less about reminding and more about re-engaging narratives from the core intervention.

Texting can be used to extend the information and skills covered in an initial workshop or session. The Afiya intervention did not cover new information via texting. All information was presented in the in-person initial workshop. Therefore, testing then served to boost and further highlight details covered in the initial intervention. For example, the initial Afiya workshop demonstrated communication and condom use skills. The follow-up texts used terminology from the original intervention to remind or cue participants to the content. Subsequent text messages would then ask the participant about her communication style or whether she talked with her partner about her sexual health choice. The use of SMS in behavioral research should consider having an initial in-person presentation of information and using SMS to serve as a reminder of the information, resources, and skills presented.


The challenge in future research will be to transition from administration on a small scale to a larger scale while maintaining the tailoring and personalization participants preferred in this study phase. Additional study challenges included intervention length. This study included 8 to 9 weeks of two-way texting between a health educator and participants. To allow SMS to serve as a true intervention booster and to increase the maintenance of study outcomes, the intervention length may need to be implemented over a longer period. We also discovered that there is one more critical persona: the health educator; that is, each participant develops a mental model of the individual with whom she would be texting. Therefore, one goal moving forward is to ensure that the health educator (for a workshop) conveys a consistent persona in future iterations of the study.

Finally, and admittedly, there is a lack of strong economic data to support the use of mHealth behavioral interventions [98,99], and this pilot study did not examine the economic implications. We will be engaging in economic evaluations in our PMI RCT feasibility pilot study (step 2 of phase 8, Table 1). We believe that the systematic design and development of mHealth solutions based on strong evidence-based foundations can begin to show economic value as critical adjuncts (PMIs) by extending the efficacy of interventions. This requires systematically determining how a technological form can be adapted to an evidence-based intervention. However, this is both ill-defined and underresearched, leaving distinct gaps in the design, implementation, and acceptance of mHealth apps [100,101]. The incorporation of mHealth technologies necessitates considerations of how the current theories and practices employed can accommodate these technologies [102] and argues for the inclusion of theories and practices from other disciplines [103,104], especially those disciplines associated with explicitly studying how humans use technology [105,106]. This paper offers an approach to address such gaps.


In conclusion, given that digital technology is seen as an important component of addressing the STI and HIV epidemic in African American adolescents [67,107] as well as for public health innovation in general [108], we demonstrated how to systematically adapt an existing HIV and STI EBI designed for telephone-based health educator communication with African American females to one that is based on SMS texting. The ADAPT-ITT approach was used to navigate the adapted intervention. As recommended, we involved the target user group, sexual health experts, behavior change experts, software developers (SMS companies in this case), and research experts [109], a considerable strength of the study methodology. It is important to note that if mHealth technologies are to be components of an intervention, it is inappropriate to assume (explicitly or implicitly) that technology is neutral. This paper represents an initial step toward engaging a more systematic process, ADAPT-ITT, that will provide guidance for EBIs to extend the duration (and retain the integrity) of their impact using the most common communication technology on earth—texting.


This research was funded in part by a grant from Emory University’s Global Health Institute and the Goizueta Business School’s Summer Research Fund at Emory University.

Conflicts of Interest

None declared.

  1. Koenig LJ, Hoyer D, Purcell DW, Zaza S, Mermin J. Young people and HIV: a call to action. Am J Public Health 2016 Mar;106(3):402-405. [CrossRef] [Medline]
  2. National HIV/AIDS Strategy For the United States: Updated to 2020 Federal Action Plan. Office of National AIDS Policy. 2015.   URL: [accessed 2020-09-10]
  3. Monitoring Selected National HIV Prevention and Care Objectives by Using HIV Surveillance Data: United States and 6 Dependent Areas. Centers for Disease Control and Prevention. 2018.   URL: https:/​/www.​​hiv/​pdf/​library/​reports/​surveillance/​cdc-hiv-surveillance-supplemental-report-vol-25-2.​pdf [accessed 2020-08-31]
  4. Estimated HIV Incidence and Prevalence in the United States 2014–2018. Centers for Disease Control and Prevention.   URL: https:/​/www.​​hiv/​pdf/​library/​reports/​surveillance/​cdc-hiv-surveillance-supplemental-report-vol-25-1.​pdf [accessed 2020-08-31]
  5. Diagnoses of HIV Infection Among Adolescents and Young Adults in the United States and 6 Dependent Areas. Centers for Disease Control and Prevention. 2018.   URL: [accessed 2020-08-31]
  6. Estimated HIV Incidence and Prevalence in the Unites States, 2014-2018. Centers for Disease Control and Prevention. 2018.   URL: [accessed 2020-08-31]
  7. Kann L, McManus T, Harris W, Shanklin S, Flint K, Queen B, et al. Youth risk behavior surveillance - United States, 2017. MMWR Surveill Summ 2018 Jun 15;67(8):1-114 [FREE Full text] [CrossRef] [Medline]
  8. School Health Profiles: Characteristics of Health Programs Among Secondary Schools. Centers for Disease Control and Prevention. 2018.   URL: [accessed 2020-08-31]
  9. Mirzazadeh A, Biggs MA, Viitanen A, Horvath H, Wang LY, Dunville R, et al. Do school-based programs prevent HIV and other sexually transmitted infections in adolescents? A systematic review and meta-analysis. Prev Sci 2018 May;19(4):490-506. [CrossRef] [Medline]
  10. Evans R, Widman L, Stokes MN, Javidi H, Hope EC, Brasileiro J. Association of sexual health interventions with sexual health outcomes in black adolescents: a systematic review and meta-analysis. JAMA Pediatr 2020 Apr 20:- epub ahead of print. [CrossRef] [Medline]
  11. Idele P, Gillespie A, Porth T, Suzuki C, Mahy M, Kasedde S, et al. Epidemiology of HIV and AIDS among adolescents: current status, inequities, and data gaps. J Acquir Immune Defic Syndr 2014 Jul 1;66(Suppl 2):S144-S153. [CrossRef] [Medline]
  12. Jenkins RA. Supplemental issue on does early intervention prevent health-risking sexual behaviors related to HIV/AIDS: commentary on effects. Prev Sci 2014 Feb;15(Suppl 1):S84-S86 [FREE Full text] [CrossRef] [Medline]
  13. Pettifor A, Stoner M, Pike C, Bekker L. Adolescent lives matter: preventing HIV in adolescents. Curr Opin HIV AIDS 2018 May;13(3):265-273 [FREE Full text] [CrossRef] [Medline]
  14. Salazar LF, Bradley EL, Younge SN, Daluga NA, Crosby RA, Lang DL, et al. Applying ecological perspectives to adolescent sexual health in the United States: rhetoric or reality? Health Educ Res 2010 Aug;25(4):552-562 [FREE Full text] [CrossRef] [Medline]
  15. Piper K, Enah C, Daniel M. Black southern rural adolescents' HIV stigma, denial, and misconceptions and implications for HIV prevention. J Psychosoc Nurs Ment Health Serv 2014 Jun;52(6):50-56. [CrossRef] [Medline]
  16. Murry VM, Berkel C, Chen Y, Brody GH, Gibbons FX, Gerrard M. Intervention induced changes on parenting practices, youth self-pride and sexual norms to reduce HIV-related behaviors among rural African American youths. J Youth Adolesc 2011 Sep;40(9):1147-1163 [FREE Full text] [CrossRef] [Medline]
  17. Buchbinder SP, Liu AY. CROI 2018: epidemic trends and advances in HIV prevention. Top Antivir Med 2018 May;26(1):1-16 [FREE Full text] [Medline]
  18. DiClemente R, Santelli J, Crosby R. Adolescent Health: Understanding and Preventing Risk Behaviors. San Francisco, CA: Jossey-Bass; 2009.
  19. Lee YM, Cintron A, Kocher S. Factors related to risky sexual behaviors and effective STI/HIV and pregnancy intervention programs for African American adolescents. Public Health Nurs 2014;31(5):414-427. [CrossRef] [Medline]
  20. Collins CB, Sapiano TN. Lessons learned from dissemination of evidence-based interventions for HIV prevention. Am J Prev Med 2016 Oct;51(4 Suppl 2):S140-S147 [FREE Full text] [CrossRef] [Medline]
  21. Thompson M. HIVMA Statement on House Labor -- HHS FY 2019 Funding bBill. HIV Medicine Association. 2018.   URL: https:/​/www.​​news_and_publications/​hivma_news_releases/​2018/​hivma-statement-on-house-labor-hhs-fy-2019-funding-bill [accessed 2020-09-10]
  22. Andrews M. The ‘Perfect Storm’: Redirecting Family Planning Funds Could Undercut STD Fight. Washington Post. 2018.   URL: [accessed 2020-09-10]
  23. Wang B, Stanton B, Deveaux L, Lunn S, Rolle G, Adderley R, et al. Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention. Implement Sci 2017 Feb 10;12(1):16 [FREE Full text] [CrossRef] [Medline]
  24. Widman L, Nesi J, Kamke K, Choukas-Bradley S, Stewart JL. Technology-based interventions to reduce sexually transmitted infections and unintended pregnancy among youth. J Adolesc Health 2018 Jun;62(6):651-660 [FREE Full text] [CrossRef] [Medline]
  25. Hendrick CE, Canfield C. HIV risk-reduction prevention interventions targeting African American adolescent women. Adolesc Res Rev 2017 Jun;2(2):131-149 [FREE Full text] [CrossRef] [Medline]
  26. Bradley E, DiClemente RJ, Sales J, Rose E, Davis T, Wingood L, et al. Make It Last: Using a Supplemental Treatment Trial Design to Maintain Effects of a Sexual Risk Reduction Intervention for African-American Adolescent Females. J Clin Trials 2014;05(02) [FREE Full text] [CrossRef]
  27. Bull SS, Levine DK, Black SR, Schmiege SJ, Santelli J. Social media-delivered sexual health intervention: a cluster randomized controlled trial. Am J Prev Med 2012 Nov;43(5):467-474 [FREE Full text] [CrossRef] [Medline]
  28. Phillips KA, Epstein DH, Mezghanni M, Vahabzadeh M, Reamer D, Agage D, et al. Smartphone delivery of mobile HIV risk reduction education. AIDS Res Treat 2013;2013:231956 [FREE Full text] [CrossRef] [Medline]
  29. Davis TL, DiClemente R, Prietula M. Taking mhealth forward: examining the core characteristics. JMIR Mhealth Uhealth 2016 Aug 10;4(3):e97 [FREE Full text] [CrossRef] [Medline]
  30. Payne HE, Lister C, West JH, Bernhardt JM. Behavioral functionality of mobile apps in health interventions: a systematic review of the literature. JMIR Mhealth Uhealth 2015 Feb 26;3(1):e20 [FREE Full text] [CrossRef] [Medline]
  31. Thakkar J, Kurup R, Laba T, Santo K, Thiagalingam A, Rodgers A, et al. Mobile telephone text messaging for medication adherence in chronic disease: a meta-analysis. JAMA Intern Med 2016 Mar;176(3):340-349. [CrossRef] [Medline]
  32. Zhao J, Freeman B, Li M. Can mobile phone apps influence people's health behavior change? An evidence review. J Med Internet Res 2016 Oct 31;18(11):e287 [FREE Full text] [CrossRef] [Medline]
  33. Badawy SM, Cronin RM, Hankins J, Crosby L, DeBaun M, Thompson AA, et al. Patient-centered ehealth interventions for children, adolescents, and adults with sickle cell disease: systematic review. J Med Internet Res 2018 Jul 19;20(7):e10940 [FREE Full text] [CrossRef] [Medline]
  34. Badawy SM, Kuhns LM. Texting and mobile phone app interventions for improving adherence to preventive behavior in adolescents: a systematic review. JMIR Mhealth Uhealth 2017 Apr 19;5(4):e50 [FREE Full text] [CrossRef] [Medline]
  35. Badawy SM, Barrera L, Sinno MG, Kaviany S, O'Dwyer LC, Kuhns LM. Text messaging and mobile phone apps as interventions to improve adherence in adolescents with chronic health conditions: a systematic review. JMIR Mhealth Uhealth 2017 May 15;5(5):e66 [FREE Full text] [CrossRef] [Medline]
  36. Majeed-Ariss R, Baildam E, Campbell M, Chieng A, Fallon D, Hall A, et al. Apps and adolescents: a systematic review of adolescents' use of mobile phone and tablet apps that support personal management of their chronic or long-term physical conditions. J Med Internet Res 2015 Dec 23;17(12):e287 [FREE Full text] [CrossRef] [Medline]
  37. Radovic A, Badawy SM. Technology use for adolescent health and wellness. Pediatrics 2020 May;145(Suppl 2):S186-S194. [CrossRef] [Medline]
  38. Ramsey WA, Heidelberg RE, Gilbert AM, Heneghan MB, Badawy SM, Alberts NM. eHealth and mHealth interventions in pediatric cancer: a systematic review of interventions across the cancer continuum. Psychooncology 2020 Jan;29(1):17-37. [CrossRef] [Medline]
  39. Chernick LS, Berrigan M, Gonzalez A, Konja A, Stockwell MS, Ehrhardt A, et al. Engaging adolescents with sexual health messaging: a qualitative analysis. J Adolesc Health 2019 Nov;65(5):660-666. [CrossRef] [Medline]
  40. Madden M, Lenhart A, Duggan M, Cortesi S, Gasser U. Teens and Technology. Pew Research Center. 2013.   URL: [accessed 2020-08-31]
  41. Perry RC, Kayekjian KC, Braun RA, Cantu M, Sheoran B, Chung PJ. Adolescents' perspectives on the use of a text messaging service for preventive sexual health promotion. J Adolesc Health 2012 Sep;51(3):220-225. [CrossRef] [Medline]
  42. Smith A. African Americans and Technology Use: A Demographic Portrait. Pew Research Center. 2014.   URL: [accessed 2020-08-31]
  43. Gilliam M, Chor J, Hill B. Digital media and sexually transmitted infections. Curr Opin Obstet Gynecol 2014 Oct;26(5):381-385. [CrossRef] [Medline]
  44. Rempel GR, Ballantyne RT, Magill-Evans J, Nicholas DB, Mackie AS. Texting teens in transition: the use of text messages in clinical intervention research. JMIR Mhealth Uhealth 2014 Nov 6;2(4):e45 [FREE Full text] [CrossRef] [Medline]
  45. Orr JA, King RJ. Mobile phone SMS messages can enhance healthy behaviour: a meta-analysis of randomised controlled trials. Health Psychol Rev 2015;9(4):397-416. [CrossRef] [Medline]
  46. Rideout V, Robb M. Social Media, Social Life: Teens Reveal Their Experiences. Common Sense Media.: Common Sense Media; 2018.   URL: [accessed 2020-09-10]
  47. Anderson M, Jiang J. Teens, Social Media Technology. Public Services Alliance. 2018.   URL: http:/​/publicservicesalliance.​org/​wp-content/​uploads/​2018/​06/​Teens-Social-Media-Technology-2018-PEW.​pdf [accessed 2020-08-31]
  48. Walther JB. Interpersonal effects in computer-mediated interaction. Commun Res 2016 Jun 30;19(1):52-90. [CrossRef]
  49. Walther JB. Computer-mediated communication. Commun Res 2016 Jun 29;23(1):3-43. [CrossRef]
  50. Subrahmanyam K, Smahel D, Greenfield P. Connecting developmental constructions to the internet: identity presentation and sexual exploration in online teen chat rooms. Dev Psychol 2006 May;42(3):395-406. [CrossRef] [Medline]
  51. Subrahmanyam K, Reich SM, Waechter N, Espinoza G. Online and offline social networks: use of social networking sites by emerging adults. J Appl Dev Psychol 2008 Nov;29(6):420-433. [CrossRef]
  52. Dunbar R, Arnaboldi V, Conti M, Passarella A. The structure of online social networks mirrors those in the offline world. Soc Netw 2015 Oct;43:39-47. [CrossRef]
  53. Ehrenreich SE, Beron KJ, Burnell K, Meter DJ, Underwood MK. How adolescents use text messaging through their high school years. J Res Adolesc 2020 Jun;30(2):521-540. [CrossRef] [Medline]
  54. Lenhart A, Smith A, Anderson M, Duggan M, Perrin A. Teens, Technology Friendships. Pew Research Center. 2015.   URL: [accessed 2020-08-31]
  55. Song JH, Hollenbeck CR. The value of social presence in mobile communications. Serv Ind J 2015 Jul 10;35(11-12):611-632. [CrossRef]
  56. Cornelius JB, Dmochowski J, Boyer C, St Lawrence J, Lightfoot M, Moore M. Text-messaging-enhanced HIV intervention for African American adolescents: a feasibility study. J Assoc Nurses AIDS Care 2013;24(3):256-267 [FREE Full text] [CrossRef] [Medline]
  57. Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med 2009 Aug;38(1):18-27 [FREE Full text] [CrossRef] [Medline]
  58. Oinas-Kukkonen H. A foundation for the study of behavior change support systems. Pers Ubiquit Comput 2012 Jul 19;17(6):1223-1235. [CrossRef]
  59. Fogg B. A Behavior Model for Persuasive Design. In: Proceedings of the 4th International Conference on Persuasive Technology. 2009 Presented at: Persuasive'09; April 26-29, 2009; Claremont , USA. [CrossRef]
  60. Mohr DC, Schueller SM, Montague E, Burns MN, Rashidi P. The behavioral intervention technology model: an integrated conceptual and technological framework for eHealth and mHealth interventions. J Med Internet Res 2014 Jun 5;16(6):e146 [FREE Full text] [CrossRef] [Medline]
  61. Kelders SM, Kok RN, Ossebaard HC, van Gemert-Pijnen JE. Persuasive system design does matter: a systematic review of adherence to web-based interventions. J Med Internet Res 2012 Nov 14;14(6):e152 [FREE Full text] [CrossRef] [Medline]
  62. Coomes CM, Lewis MA, Uhrig JD, Furberg RD, Harris JL, Bann CM. Beyond reminders: a conceptual framework for using short message service to promote prevention and improve healthcare quality and clinical outcomes for people living with HIV. AIDS Care 2012;24(3):348-357. [CrossRef] [Medline]
  63. Wingood GM, DiClemente RJ. The ADAPT-ITT model: a novel method of adapting evidence-based HIV Interventions. J Acquir Immune Defic Syndr 2008 Mar 1;47(Suppl 1):S40-S46. [CrossRef] [Medline]
  64. Chambers DA, Norton WE. The adaptome: advancing the science of intervention adaptation. Am J Prev Med 2016 Oct;51(4 Suppl 2):S124-S131 [FREE Full text] [CrossRef] [Medline]
  65. Escoffery C, Lebow-Skelley E, Udelson H, Böing EA, Wood R, Fernandez ME, et al. A scoping study of frameworks for adapting public health evidence-based interventions. Transl Behav Med 2019 Jan 1;9(1):1-10 [FREE Full text] [CrossRef] [Medline]
  66. McKleroy VS, Galbraith JS, Cummings B, Jones P, Harshbarger C, Collins C, ADAPT Team. Adapting evidence-based behavioral interventions for new settings and target populations. AIDS Educ Prev 2006 Aug;18(4 Suppl A):59-73. [CrossRef] [Medline]
  67. DiClemente RJ, Bradley E, Davis TL, Brown JL, Ukuku M, Sales JM, et al. Adoption and implementation of a computer-delivered HIV/STD risk-reduction intervention for African American adolescent females seeking services at county health departments: implementation optimization is urgently needed. J Acquir Immune Defic Syndr 2013 Jun 1;63 Suppl 1:S66-S71 [FREE Full text] [CrossRef] [Medline]
  68. Wingood GM, Simpson-Robinson L, Braxton ND, Raiford JL. Design of a faith-based HIV intervention: successful collaboration between a university and a church. Health Promot Pract 2011 Nov;12(6):823-831. [CrossRef] [Medline]
  69. Latham TP, Sales JM, Boyce LS, Renfro TL, Wingood GM, DiClemente RJ, et al. Application of ADAPT-ITT: adapting an evidence-based HIV prevention intervention for incarcerated African American adolescent females. Health Promot Pract 2010 May;11(3 Suppl):53S-60S. [CrossRef] [Medline]
  70. Sullivan PS, Stephenson R, Grazter B, Wingood G, Diclemente R, Allen S, et al. Adaptation of the African couples HIV testing and counseling model for men who have sex with men in the United States: an application of the ADAPT-ITT framework. Springerplus 2014;3:249 [FREE Full text] [CrossRef] [Medline]
  71. Khumsaen N, Stephenson R. Adaptation of the HIV/AIDS self-management education program for men who have sex with men in Thailand: an application of the ADAPT-ITT framework. AIDS Educ Prev 2017 Oct;29(5):401-417 [FREE Full text] [CrossRef] [Medline]
  72. Myers B, Carney T, Browne FA, Wechsberg WM. Development of a trauma-informed substance use and sexual risk reduction intervention for young South African women. Patient Prefer Adherence 2018;12:1997-2006 [FREE Full text] [CrossRef] [Medline]
  73. Davidson TM, Lopez CM, Saulson R, Borkman AL, Soltis K, Ruggiero KJ, et al. Development and preliminary evaluation of a behavioural HIV-prevention programme for teenage girls of Latino descent in the USA. Cult Health Sex 2014;16(5):533-546 [FREE Full text] [CrossRef] [Medline]
  74. Shrestha R, Altice F, Karki P, Copenhaver M. Developing an integrated, brief biobehavioral HIV prevention intervention for high-risk drug users in treatment: the process and outcome of formative research. Front Immunol 2017;8:561 [FREE Full text] [CrossRef] [Medline]
  75. Bradley EL, Sutton MY, Cooks E, Washington-Ball B, Gaul Z, Gaskins S, et al. Developing FAITHH: methods to develop a faith-based HIV stigma-reduction intervention in the rural south. Health Promot Pract 2018 Sep;19(5):730-740 [FREE Full text] [CrossRef] [Medline]
  76. Takishima-Lacasa JY, Kameoka VA. Adapting a sexually transmitted infection prevention intervention among female adolescents in Hawai'i. Health Promot Pract 2019 Jul;20(4):608-615. [CrossRef] [Medline]
  77. Cavanaugh CE, Campbell J, Braxton N, Harvey J, Wingood G. Adapting an evidence-based HIV-prevention intervention for women in domestic violence shelters. Psychol Violence 2016 Jul;6(3):469-477 [FREE Full text] [CrossRef] [Medline]
  78. Wingood GM, Reddy P, Lang DL, Saleh-Onoya D, Braxton N, Sifunda S, et al. Efficacy of SISTA South Africa on sexual behavior and relationship control among isiXhosa women in South Africa: results of a randomized-controlled trial. J Acquir Immune Defic Syndr 2013 Jun 1;63(Suppl 1):S59-S65 [FREE Full text] [CrossRef] [Medline]
  79. DiClemente RJ, Wingood GM, Sales JM, Brown JL, Rose ES, Davis TL, et al. Efficacy of a telephone-delivered sexually transmitted infection/human immunodeficiency virus prevention maintenance intervention for adolescents: a randomized clinical trial. JAMA Pediatr 2014 Oct;168(10):938-946 [FREE Full text] [CrossRef] [Medline]
  80. Compendium of Evidence-Based Interventions and Best Practices for HIV Prevention. Centers for Disease Control and Prevention.   URL: [accessed 2020-08-31]
  81. Bandura A. Social cognitive theory and exercise of control over HIV infection. In: DiClemente R, Peterson J, editors. Preventing AIDS: Theories and Methods of Behavioral Interventions. New York, USA: Plenum Press; 1994.
  82. Gibbons MC. Gender and Power: Society, The Person and Sexual Politics. Stanford, CA: Stanford University Press; 1987.
  83. Wingood GM, DiClemente RJ. Application of the theory of gender and power to examine HIV-related exposures, risk factors, and effective interventions for women. Health Educ Behav 2000 Oct;27(5):539-565. [CrossRef] [Medline]
  84. Wingood G, Camp C, Dunkle K, Cooper H, DiClemente R. The theory of gender and power: constructs, variables, and implications for developing HIV interventions for women. In: DiClemente R, Crosby R, Kegler M, editors. Emerging Theories in Health Promotion Practice and Research. San Francisco, CA: Wiley; 2009.
  85. Wingood GM, DiClemente RJ. Enhancing adoption of evidence-based HIV interventions: promotion of a suite of HIV prevention interventions for African American women. AIDS Educ Prev 2006 Aug;18(4 Suppl A):161-170. [CrossRef] [Medline]
  86. Lenhart A, Smith A, Anderson M. Teens, Technology and Romantic Relations. Pew Research Center. 2015.   URL: [accessed 2020-08-31]
  87. Smith A. Americans and Text Messaging. Pew Research Center. 2011.   URL: [accessed 2020-08-31]
  88. Kuniavsky M. Observing the User Experience: A Practitioner's Guide to User Research. Waltham, MA: Morgan Kaufmann; 2012.
  89. Tullis T, Albert B. Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics. Waltham, MA: Morgan Kaufmann; 2013.
  90. Hartson R, Pyla P. The UX Book: Process and Guidelines for Ensuring a Quality User Experience. Waltham, MA: Morgan Kaufmann; 2012.
  91. Jeminiwa RN, Hohmann NS, Fox BI. Developing a theoretical framework for evaluating the quality of mhealth apps for adolescent users: a systematic review. J Pediatr Pharmacol Ther 2019;24(4):254-269 [FREE Full text] [CrossRef] [Medline]
  92. Mabey D. Epidemiology of sexually transmitted infections: worldwide. Medicine 2014 Jun;42(6):287-290. [CrossRef]
  93. Badawy SM, Thompson AA, Kuhns LM. Medication adherence and technology-based interventions for adolescents with chronic health conditions: a few key considerations. JMIR Mhealth Uhealth 2017 Dec 22;5(12):e202 [FREE Full text] [CrossRef] [Medline]
  94. Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med 2017 Jun;7(2):254-267 [FREE Full text] [CrossRef] [Medline]
  95. Perski O, Blandford A, Ubhi HK, West R, Michie S. Smokers' and drinkers' choice of smartphone applications and expectations of engagement: a think aloud and interview study. BMC Med Inform Decis Mak 2017 Feb 28;17(1):25 [FREE Full text] [CrossRef] [Medline]
  96. Glasgow RE, Eckstein ET, Elzarrad MK. Implementation science perspectives and opportunities for HIV/AIDS research: integrating science, practice, and policy. J Acquir Immune Defic Syndr 2013 Jun 1;63(Suppl 1):S26-S31. [CrossRef] [Medline]
  97. Kelton K, Fleischmann KR, Wallace WA. Trust in digital information. J Am Soc Inf Sci 2008 Feb 1;59(3):363-374. [CrossRef]
  98. Badawy SM, Kuhns LM. Economic evaluation of text-messaging and smartphone-based interventions to improve medication adherence in adolescents with chronic health conditions: a systematic review. JMIR Mhealth Uhealth 2016 Oct 25;4(4):e121 [FREE Full text] [CrossRef] [Medline]
  99. Iribarren SJ, Cato K, Falzon L, Stone PW. What is the economic evidence for mHealth? A systematic review of economic evaluations of mHealth solutions. PLoS One 2017;12(2):e0170581 [FREE Full text] [CrossRef] [Medline]
  100. Yen P, Bakken S. Review of health information technology usability study methodologies. J Am Med Inform Assoc 2012;19(3):413-422 [FREE Full text] [CrossRef] [Medline]
  101. van Velsen L, Wentzel J, van Gemert-Pijnen JE. Designing ehealth that matters via a multidisciplinary requirements development approach. JMIR Res Protoc 2013 Jun 24;2(1):e21 [FREE Full text] [CrossRef] [Medline]
  102. Glasgow RE, Phillips SM, Sanchez MA. Implementation science approaches for integrating eHealth research into practice and policy. Int J Med Inform 2014 Jul;83(7):e1-11. [CrossRef] [Medline]
  103. Riley WT, Rivera DE, Atienza AA, Nilsen W, Allison SM, Mermelstein R. Health behavior models in the age of mobile interventions: are our theories up to the task? Transl Behav Med 2011 Mar;1(1):53-71 [FREE Full text] [CrossRef] [Medline]
  104. Kumar S, Nilsen WJ, Abernethy A, Atienza A, Patrick K, Pavel M, et al. Mobile health technology evaluation: the mHealth evidence workshop. Am J Prev Med 2013 Aug;45(2):228-236 [FREE Full text] [CrossRef] [Medline]
  105. Poole ES. HCI and mobile health interventions: how human-computer interaction can contribute to successful mobile health interventions. Transl Behav Med 2013 Dec;3(4):402-405 [FREE Full text] [CrossRef] [Medline]
  106. Buller DB, Berwick M, Shane J, Kane I, Lantz K, Buller MK. User-centered development of a smart phone mobile application delivering personalized real-time advice on sun protection. Transl Behav Med 2013 Sep;3(3):326-334 [FREE Full text] [CrossRef] [Medline]
  107. Brown CH, Mohr DC, Gallo CG, Mader C, Palinkas L, Wingood G, et al. A computational future for preventing HIV in minority communities: how advanced technology can improve implementation of effective programs. J Acquir Immune Defic Syndr 2013 Jun 1;63(Suppl 1):S72-S84 [FREE Full text] [CrossRef] [Medline]
  108. DiClemente R, Nowara A, Shelton R, Wingood G. Need for innovation in public health research. Am J Public Health 2019 Feb;109(S2):S117-S120. [CrossRef] [Medline]
  109. Bailey J, Mann S, Wayal S, Hunter R, Free C, Abraham C. Sexual health promotion for young people delivered via digital media: a scoping review. Public Health Res 2015;3(13). [CrossRef] [Medline]

ADAPT-ITT: assessment, decision, adaptation, production, topical experts-integration, training, testing
CASI: computer-assisted self-interview
CDC: Centers for Disease Control and Prevention
EBI: evidence-based intervention
GRA: graduate research assistant
mHealth: mobile health
PMI: preventive maintenance intervention
RCT: randomized controlled trial
STI: sexually transmitted infection
TGP: theory of gender power
UX: user experience

Edited by G Eysenbach; submitted 15.07.20; peer-reviewed by S Badawy; comments to author 06.08.20; revised version received 18.08.20; accepted 23.08.20; published 06.10.20


©Teaniese Davis, Ralph Joseph DiClemente, Michael Prietula. Originally published in JMIR Formative Research (, 06.10.2020.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.