This paper is in the following e-collection/theme issue:

Reviews on Usage or other Formative Evaluation Metrics (44) Quality Evaluation and Descriptive Analysis/Reviews of Multiple Existing Mobile Apps (374) Violence including Domestic Violence/Abuse (121) mHealth for Wellness, Behavior Change and Prevention (2871) Mobile Health (mhealth) (2939) Online Dating, Sexual Health Behavior (162) Formative Evaluation of Digital Health Interventions (2410)

Published on in Vol 6, No 2 (2022): February

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/28959, first published .
Mobile Phone Apps for Intimate Partner and Sexual Violence Prevention and Response: Systematic Search on App Stores

Mobile Phone Apps for Intimate Partner and Sexual Violence Prevention and Response: Systematic Search on App Stores

Mobile Phone Apps for Intimate Partner and Sexual Violence Prevention and Response: Systematic Search on App Stores

Authors of this article:

Jessica Draughon Moret1 Author Orcid Image ;   Angela Todd1 Author Orcid Image ;   Lauren Rose2 Author Orcid Image ;   Erin Pollitt3 Author Orcid Image ;   Jocelyn Anderson2 Author Orcid Image
Article Authors Cited by (11) Tweetations (9) Metrics

    Original Paper

    1Betty Irene Moore School of Nursing, University of California, Davis, Sacramento, CA, United States

    2College of Nursing, Pennsylvania State University, University Park, PA, United States

    3District of Columbia Forensic Nurse Examiners, Washington, DC, United States

    *these authors contributed equally

    Corresponding Author:

    Jessica Draughon Moret, RN, PhD

    Betty Irene Moore School of Nursing

    University of California, Davis

    2570 48th Street

    Suite 2600

    Sacramento, CA, 95817

    United States

    Phone: 1 916 734 0511

    Fax:1 916 452 2112

    Email: jdmoret@ucdavis.edu


    Background: Since the 2008 advent of the smartphone, more than 180 billion copies of apps have been downloaded from Apple App Store, with more than 2.6 million apps available for Android and 2.2 million apps available for iOS. Many violence prevention and response apps have been developed as part of this app proliferation.

    Objective: This study aims to evaluate the prevalence and quality of freely available mobile phone apps targeting intimate partner violence (IPV) and sexual violence (SV) prevention and response.

    Methods: We conducted a systematic search of violence prevention and response mobile phone apps freely available in Apple App Store (iOS; March 2016) and Google Play Store (Android; July 2016). Search terms included violence prevention, sexual assault, domestic violence, intimate partner violence, sexual violence, forensic nursing, wife abuse, and rape. Apps were included for review if they were freely available, were available in English, and had a primary purpose of prevention of or response to SV or IPV regardless of app target end users.

    Results: Using the Mobile Application Rating Scale (MARS), we evaluated a total of 132 unique apps. The majority of included apps had a primary purpose of sharing information or resources. Included apps were of low-to-moderate quality, with the overall subjective quality mean for the reviewed apps being 2.65 (95% CI 2.58-2.72). Quality scores for each of the 5 MARS categories ranged from 2.80 (engagement) to 4.75 (functionality). An incidental but important finding of our review was the difficulty in searching for apps and the plethora of nonrelated apps that appear when searching for keywords such as “rape” and “domestic violence” that may be harmful to people seeking help.

    Conclusions: Although there are a variety of mobile apps available designed to provide information or other services related to SV and IPV, they range greatly in quality. They are also challenging to find, given the current infrastructure of app store searches, keyword prioritization, and highlighting based on user rating. It is important for providers to be aware of these resources and be knowledgeable about how to review and recommend mobile phone apps to patients, when appropriate.

    JMIR Form Res 2022;6(2):e28959

    doi:10.2196/28959

    Keywords

    rape; intimate partner violence; gender-based violence; smartphone; mobile phone app 


    Both sexual violence (SV) and intimate partner violence (IPV) continue to be major public health problems in the United States and worldwide. Every 68 seconds, a US resident is sexually assaulted [1]. In the 2015 National Intimate Partner and Sexual Violence Survey, 1 in 3 (33%) people reported experiencing lifetime physical violence or SV [2]. When psychological abuse is considered, the numbers are closer to 1 in 2 (50%) people. Rates are often higher in lesbian, gay, bisexual, transgender, and queer (LGBTQ) populations, with 50% of transgender people, 61% of bisexual women, 44% of lesbian women, 37% of bisexual men, and 26% of gay men reporting an experience of IPV in their lifetime [3,4].

    Documented direct and indirect health outcomes linked to IPV and SV include physical, mental, and sexual health sequelae. In addition to physical injury, these types of violence are associated with chronic stress, chronic immune system activation, and inflammation [5]; accelerated cellular aging [6]; and cardiovascular disease risk [7]. Depression, acute stress disorder, and posttraumatic stress disorder are common comorbidities [8]. IPV and SV are also associated with substance use, alcohol use, and sexual risk taking, all of which are documented risk factors for HIV and other sexually transmitted infections. In addition, experience of SV and IPV is associated with diminished control over sexual and reproductive health decisions [9], unplanned pregnancies, preterm labor, low-birthweight babies, and maternal morbidity and mortality [10].

    Although rates of SV and IPV have remained relatively stable over the past decade, the ways that people access and gather information have changed. Social media and other mobile apps are most people’s preferred source of information [11]. Smartphones are ubiquitous among adolescents and young adults, with 98% of Generation Z owning a smartphone [12]—overlapping with those at highest risk for sexual assault ages 12-34 years [13]. As researchers and clinicians working on SV and IPV, we recognized this shift toward internet- and smartphone-available information was imminent in our field. For example, in 2012, early media reports of the UAskDC app garnered attention, showing that these spaces were being utilized and that information in apps could be vetted in partnership with reputable health and advocacy service providers [14-16].

    The UAskDC app effectively curated the many disparate resources from each higher education campus Title IX and student affairs office, and health, advocacy, and criminal justice services across the District of Columbia into 1 place. The app provides more accurate and trauma-informed information than a Google search for “rape” or “sexual assault” and “District of Columbia” would, and the platform allows for rapid updates. Resource sharing apps, such as UAskDC, are focused on secondary and tertiary prevention—connecting a survivor to resources for safety and health. These community-specific apps, while designed for potential survivors/patients, are also an invaluable resource for health care providers, friends, and family members who may be trying to direct a patient or loved one to appropriate resources. Because most health care providers are not experts in IPV or SV, receiving an average of only 1-5 hours of training in these topics during their prelicensure training [17], resources used by health systems (eg, handouts, apps, and websites) become heavily-relied-upon sources of information. Therefore, it is of utmost importance that the quality of these apps be known and maintained to achieve their goals.

    Although IPV and SV prevention and response apps are widely available, the literature focused on these apps remains limited. Of the studies including IPV- or SV-related apps, most examined apps that were directed at college-aged women offering resources for use during or after SV to support safety and decision making [18-21], while 2 were directed toward education in recognition and prevention of child sexual abuse and trafficking [22,23]. Overall, these studies found potential for IPV- or SV-related apps to educate users about prevention, recognition, harm reduction, safety measures, and resources for victims of IPV or SV [18-23].

    Perhaps the most documented IPV app in the literature is MyPlan [24]. MyPlan draws on elements of social cognitive and decision-making theories through self-monitoring, social support, and priority setting [25]. MyPlan further integrates safety-planning strategies and tools used by IPV advocates for decades [26,27]. This app allows survivors to evaluate their relationship and safety while designing a plan tailored to their individual needs and simultaneously receiving resources with embedded links. It allows survivors to return to their plan and review and update information over time to coincide with changes within their abusive relationship. In prospective clinical trials, MyPlan and its precursor, the computer-based decision aid Internet Resource for Information and Safety (IRIS), both found improvements in decisional conflict, use of relationship safety strategies, and ending unsafe relationships [28-30].

    Given the proliferation of apps and our prior experience developing and testing a mobile app for IPV and SV response, we are aware of the multiple challenges with app dissemination and maintenance [20]. Therefore, this paper aims to determine the prevalence and quality of freely available mobile smartphone apps that include a primary goal of addressing prevention and response. A secondary aim was to determine priority recommendations for health care providers interested in integrating mobile apps within patient care.


    Study Design

    We conducted a search of Apple App Store (March 2016) and Google Play Store (July 2016) using the following search terms: violence prevention, sexual assault, domestic violence, intimate partner violence, sexual violence, forensic nursing, wife abuse, and rape. Complete lists of results were downloaded to Microsoft Excel for review. SV and IPV apps were included in this analysis as they both commonly co-occur (approximately 18% of women and 8% of men report lifetime intimate partner sexual violence [31]) and are commonly addressed by services that are colocated or multipurpose (eg, a community’s IPV shelter also provides rape crisis accompaniment services to health care facilities).

    Titles were reviewed by a member of the study team to determine whether inclusion criteria were met. When the title was unclear, they continued to the next step, which was review of the app’s general information available in the publisher’s app store without downloading the app. For apps that clearly met the inclusion criteria or in which it was unclear from the information available in the app store Information section, we continued to the final step: full review via download of the app to a mobile phone or tablet.

    Inclusion criteria for our analysis were (1) available in English, (2) free version available, and (3) directed toward 1 of the following audiences: the general public at risk for SV or IPV, people who have experienced IPV or SV, or health or advocacy providers who work with people who experience violence.

    App Review

    Apps were reviewed for quality using the Mobile Application Rating Scale (MARS) [32]. Since its initial publication in 2015, MARS has been used to evaluate the quality of smartphone apps on a wide range of health-related topics. These include health promotion topics, such as fitness [33], nutrition and weight management [34-36], mental health [37], and mindfulness [38], as well as self-management of medical conditions, such as diabetes [39], sleep disorders [40], pain management [41], heart failure [42], and asthma [43].

    For this analysis, modifications to MARS were made to ensure fit for the SV and IPV content area. These included using “sexual or intimate partner violence” to fill in the content areas for the target health behavior in the Perceived Impact of Health Behavior Change section, including instructions for categorizing violence advocacy and service agencies when addressing the item on credibility, and adding features that we knew to be potentially common or relevant to the goals of violence-specific apps (eg, Global Positioning System [GPS], linking to service providers, emergency exit features). Our full data collection instrument is available in Multimedia Appendix 1.

    All data were entered into an internet-based survey form, which also collected date and time information as well as which research team member was entering the data. At the search onset, the team selected 4 apps to all independently review and discuss during a team meeting to create shared definitions and consistency within the team. Subsequently, each app was reviewed by 1 team member with consultation to the team, as needed. Apple platform apps were reviewed between April 2016 and September 2016, and Google platform apps were reviewed between October 2017 and February 2018.

    Data Analysis

    Descriptive analyses were completed to summarize the apps reviewed. Mean scores were calculated for each of the MARS categories (engagement, functionality, aesthetics, information, and subjective quality). Individual item frequencies and proportions were also calculated for nonscale items. Data were analyzed using SPSS Statistics version 25 (IBM Corp.) [44]. App classification data were recoded by consensus of 2 of the team members (authors JCA and LR) to better summarize results and due to the large number of “Other” responses in some categories (initial n=38, 28.8% for focus area; n=14, 10.6% for theoretical background/strategies) based on the initial use of MARS with minor modifications.


    Search Results

    In our initial searches, 978 unique apps were identified from Apple App Store and 1043 from Google Play Store. Of the app titles screened, 835 (85.4%) Apple apps and 894 (85.7%) Google apps were excluded (see Figure 1 for the search flow diagram), resulting in 143 (14.6%) Apple apps and 149 (14.3%) Google apps for store description abstract information review. Following this step, 65 (45.5%) Apple and 85 (57%) Google apps met the inclusion criteria and remained for full analysis. Of these 150, 18 (12%) apps appeared in both app stores, and duplicates were removed from the list, resulting in 132 (86%) apps in the final analysis.

    ‎
    Figure 1. Flow diagram of the app search and inclusion process. IPV: intimate partner violence; SV: sexual violence.
    View this figure

    Although it was not an aim of this project, an additional important finding came to light during the app store search process. Unlike typical search engines (eg, Google) or research databases (eg, PubMed), Boolean operators (“and,” “or”) do not work when searching in app stores. Searching in app stores is heavily reliant on developer tagging of titles and keywords, ratings and reviews from other users, and advertising/marketing monies spent to promote apps [45,46]. Because of how these search functions work, searching for the word “rape” in Apple App Store brings up hundreds of results for voice changer and rap music apps (presumably because of the similar spelling of “rape” and “rap”). Searching for sexual assault, synonymous but more formal terminology, in the same Apple App Store brings up only a fraction of the results and far more that are designed for SV providers, advocates, prevention, and response. These differences in search strategies and logic have important implications for providers who may be recommending use of apps to individuals they work with.

    Descriptives

    Table 1 summarizes the apps’ targeted age groups, features, focus areas, behavior change strategies, and organizational affiliations. Over three-quarters (101/132, 76.4%) of the apps focused on resource or information sharing, with at least 10% of apps focusing on each of the following: IPV (37/132, 28%), crisis intervention or mental health (29/132, 22.2%), sexual assault (18/132, 13.6%), relationship conflict/health (17/132, 12.9%), and peer support (15/132, 11.4%). Apps primarily targeted adults (87/132, 65.9%), young adults (36/132, 27.3%), or no specific age group (31/132, 23.5%). In addition, 1 in 3 (45/132, 34.1%) apps was affiliated with a nonprofit or nongovernment agency and 1 in 4 (36/132, 27.3%) with a government agency. Nearly 1 in 5 (26/132, 19.7%) apps had developers or content that did not allow their affiliation to be determined. The most common features or functions observed in the reviewed apps included requiring internet service to operate (21/132, 15.9%), location or GPS services (20/132, 15.2%), and emergency exit/panic features (17/132, 12.9%); however, these were still only present in 13-20 (10%-15%) apps. Additional functions, such as logins, passwords, and reminders, were each present in a minority of apps. Apps overwhelmingly used information and education as a behavior change (104/132, 78.8%), with safety monitoring/tracking (15/132, 11.4%) and goal setting/safety planning (14/132, 10.6%), each following with approximately 1-10 (0.7%-7.6%) apps using these strategies.

    Table 1. App overview information (N=132).
    CategoryApps, n (%)
    App focus areasa

    		Resource or information sharing100 (76.4)

    		IPVb37 (28.0)

    		Crisis intervention/mental health29 (22.2)

    		Sexual assault18 (13.6)

    		Relationship conflict/health17 (12.9)

    		Peer support15 (11.4)

    		General violence risk9 (6.8)

    		Behavior change6 (4.5)

    		Goal setting6 (4.5)

    		Physical health3 (2.3)

    		Safety planning24 (18.2)

    		Entertainment1 (0.8)

    		Education4 (3.2)

    		Legal2 (1.6)

    		Other2 (1.6)
    Target age groupsa

    		General31 (23.5)

    		Adults87 (65.9)

    		Young adults36 (27.3)

    		Teens13 (9.8)

    		Children (<12 years)2 (1.5)
    Affiliations

    		Nongovernment organization/nonprofit45 (34.1)

    		Government organization36 (27.3)

    		Unknown26 (19.7)

    		University/educational organization13 (9.8)

    		Commercial organization6 (4.5)

    		Health care organization2 (1.2)
    App features or functionsa

    		Web required21 (15.9)

    		Location services20 (15.2)

    		Panic/exit17 (12.9)

    		Social media sharing9 (6.8)

    		Login8 (6.1)

    		Password7 (5.3)

    		Reminders6 (4.5)

    		Integration with phone (eg, calendar or reminders)2 (1.5)

    		App community1 (0.8)
    App theoretical background/intervention strategiesa

    		Information/education104 (78.8)

    		Safety monitoring/tracking15 (11.4)

    		Goal setting/safety planning14 (10.6)

    		Other12 (9.1)

    		Location tracking10 (7.6)

    		Decision making8 (6.1)

    		Feedback3 (2.3)

    		Assessment2 (1.5)

    aCategories are not mutually exclusive.

    bIPV: intimate partner violence.

    App Quality

    MARS classifies app quality into 5 categories: engagement, functionality, aesthetics, information, and overall subjective quality. The scale also includes a sixth domain of questions related to the perceived potential impact of an app on behavior change. App mean quality scores in this study ranged from 2.80 (engagement) to 4.75 (functionality), and the app perceived potential impact mean score was 3.02 (95% CI 2.84-3.20). The overall subjective quality mean for the reviewed apps was 2.65 (95% CI 2.58-2.72). The individual item means ranged from 1.08 (evidence base) to 4.15 (quantity of information), both items being within the information domain. Tables 2 and 3 summarize category and individual item scores for the reviewed apps.

    Table 2. Mobile Application Rating Scale (MARS) app quality subscale ratings.
    MARS sectionMean (SD)95% CI
    Engagement

    		Overall2.08 (0.676)1.96-2.20

    		Entertainment1.94 (0.935)1.78-2.11

    		Interest2.14 (1.077)1.95-2.33

    		Customization1.56 (0.981)1.39-1.74

    		Interactivity1.54 (0.896)1.38-1.70

    		Target group3.26 (0.734)3.13-3.39
    Functionality

    		Overall3.73 (0.957)3.57-3.90

    		Performance3.45 (1.163)3.25-3.66

    		Ease of use3.95 (0.847)3.80-4.10

    		Navigation3.95 (0.932)3.79-4.12

    		Gestural design3.98 (0.704)3.85-4.10
    Aesthetics

    		Overall3.38 (0.757)3.25-3.52

    		Layout3.83 (0.853)3.68-3.98

    		Graphics3.32 (0.829)3.17-3.47

    		Visual appeal3.08 (0.771)2.94-3.22
    Information

    		Overall2.71 (0.731)2.58-2.84

    		Accuracy of description3.74 (1.023)3.56-3.92

    		Goals2.15 (1.628)1.86-2.44

    		Quality of information4.02 (1.402)3.76-4.27

    		Quantity of information4.15 (1.186)3.92-4.38

    		Visual information1.7 (1.453)1.44-1.96

    		Credibility2.94 (1.148)2.74-3.15

    		Evidence base1.08 (0.302)1.03-1.13
    Table 3. Mobile Application Rating Scale (MARS) app subjective quality ratings and perceived impact scores.
    Subjective quality and perceived impact itemsMean (SD)95% CI
    Subjective quality

    		Overall score2.65 (0.398)2.58-2.72

    		Would you recommend this app to people who might benefit from it?3.37 (1.147)3.16-3.57

    		How many times do you think you would use this app in the next 12 months if it was relevant to you?1.62 (0.778)1.48-1.76

    		What is your overall star rating of the app?3.06 (0.905)2.90-3.22
    Perceived impact

    		Overall score3.02 (1.005)2.84-3.20

    		Awareness: This app is likely to increase awareness of the importance of sexual assault and IPVa.2.97 (1.101)2.77-3.16

    		Knowledge: This app is likely to increase knowledge/understanding of sexual assault and IPV.2.96 (1.165)2.75-3.17

    		Attitudes: This app is likely to change attitudes toward improving sexual assault and IPV.3.34 (1.043)3.15-3.52

    		Intention to change: This app is likely to increase intentions/motivation to address sexual assault and IPV.3.11 (1.061)2.92-3.30

    		Help seeking: Use of this app is likely to encourage further help seeking for sexual assault and IPV (if it is required).2.73 (1.188)2.52-2.94

    		Behavior change: Use of this app is likely to increase/decrease sexual assault and IPV (of their sequelae).3.10 (1.032)2.91-3.28

    aIPV: intimate partner violence.


    Principal Findings

    Despite reviewing over 100 freely available, English language mobile apps targeted at SV and IPV prevention and response, the overall quality was average. There were few apps that we ourselves as experienced forensic examiners would use as clinicians or recommend to our patients after a physical or sexual assault. We recognize the limitations of a dated search in a rapidly evolving mobile app space. However, our primary findings related to (1) identifying relevant apps and (2) high-quality evidence-based apps remain salient.

    The focus of the apps was largely on education and information sharing. Although individuals are spending more time on mobile phones, if the focus is largely on education and information sharing, we fear that these apps will not be successful in meeting their desired goal. As with any health promotion and prevention content, mobile app content must be regularly reviewed, and updated for accuracy—and the mobile app platform adds additional technology hurdles to overcome regarding maintaining the infrastructure and content in ways that are accessible and engaging for users. Although not part of any of the MARS subscales, the tool does include collecting data on the number of times an app was rated and the current app rating. Of the 132 included apps, 104 (78.8%) had at least 1 rating listed (median user rating across rated apps was 4.20; however, the median number of user ratings across rated apps was 2, with a range of 1 to >21,000). These variations in how apps are marketed, downloaded, and shared among networks highlight 1 key area of their usefulness and 1 challenge in their dissemination in violence prevention and response work [20,47].

    Marketing and sharing are key variables in how app-sharing platforms disseminate content to users and are not necessarily a skill set that violence advocates and health care providers have been trained in or possess. Notably, we believe the most concerning finding of this search was incidental. We were disturbed during the search process at the juxtaposition of violence prevention and response apps with zombie-killing games (any search including the term “violence”), dating sims (“intimate”), and the aforementioned voice changer app (when searching “rape”). The potential for retraumatization of our patients if they search these app stores looking for appropriate resources is high.

    Recommendations for Health Care Providers

    Clinicians caring for patients after sexual or physical violence interested in sharing a mobile app–based resource with their patient population should treat any app similar to any other resource. The resource should be vetted by the health care team before adoption. As things in the mobile app industry change at an ever-increasing pace, any recommended app should routinely be reviewed to ensure it is still up to date and has not gone defunct. Several of the apps we identified in the initial search were not available by the time we returned to review them (see Figure 1).

    Clinicians interested in providing mobile app resources to their patients experiencing IPV or SV should consider preidentifying a few select mobile app resources and sharing them directly with interested patients via a QR code or direct link to prevent patients from searching the app stores on their own. This would reduce the potential for retraumatization related to inappropriate or unexpected results of a search of the major app stores. Alternatively, if the patient allows or prefers, providers could search for and download the app directly onto the patient’s phone or device on their behalf.

    Clinicians interested in developing and launching a mobile health app for their target population should consider using or adopting an existing tool versus creating a new one. The costs of developing and maintaining an app must be weighed against the other services that could be rendered with those funds. There are costs associated with creation and design, as well as costs to publish an app on each individual platform and maintenance costs to ensure the app remains relevant [48]. One piece of data that may have supported this in our analysis was the large number of apps that were initially found in our title searches but were not able to be relocated by the time we undertook our full analysis. There are multiple reasons that apps are removed from app stores. Primary reasons are related to apps not being compatible with current hardware or software requirements. As technology moves extraordinarily rapidly, maintaining apps requires diligent attention to these requirements to stay current. Our results were also consistent with a 2016 examination of the turnover of mental health apps, which found that in approximately a 6-month period, there was a 50% turnover (eg, apps were found on the initial search and not found on subsequent searches) in search results on the Android platform, whereas in iOS, approximately 90% of apps remained in the app store throughout the entire 9-month study period [49].

    Recommendations for Research

    Few of the apps included had any scholarship or evidence associated with their effectiveness. It is difficult to recommend an app for use in a clinical setting when there is no evidence related to whether it achieves its stated goals. Many of the apps were targeted at information sharing; something as simple as a test-retest knowledge assessment would provide at least basic data regarding whether the app is effective in increasing knowledge. There is also a precedent for evaluating mobile apps in their target population as well as with relevant service providers [20,21,29,50-54].

    As we discovered during our analysis, MARS may not be the best tool for evaluating violence prevention and response apps. Although we adapted the tool for our use, we would recommend further adjustments in the future. For example, several of the features noted anecdotally may be worth formally evaluating (eg, how and when GPS is integrated into the app, the presence of an “emergency exit” button). It would also be prudent to assess and understand the limits of data confidentiality, as GPS can be used by apps to assist people in help seeking but also by IPV perpetrators to track their victims. We also did not further adapt MARS for items such as whether the apps used a trauma-informed approach [55]. Factors that may make an app useful to a provider or patient who has experienced violence, such as whether it is designed with trauma-informed principles in mind (eg, is the information not only correct but also written using language that is nonjudgmental and easily understandable during a traumatic situation), are not currently captured in MARS and would be beneficial to include in future work on violence and trauma-related mobile apps.

    There is also the continued difficulty of many apps placing the onus of violence prevention on the potential victim. Many apps are dependent on a potential victim taking a precautionary behavior: downloading the app, setting up a network, and holding a button on an app down until they are “safe.” These types of interventions perpetuate victim blaming, both blaming by others and self-blaming. Blaming is a form of retraumatization, which is in direct conflict with providing trauma-informed care [55].

    Limitations

    Mobile apps and the mobile space are changing rapidly. The amount of time people spend on mobile apps increased by 35% in 2019 [12]. Unfortunately, health care research has historically moved at a much slower pace, and conducting a systematic search and analysis took an incredible investment of time. Based on our own data, by the time these data exist in the world, many of the included apps will likely no longer be accessible to the public, demonstrating the incredibly fast nature of how mobile apps come and go compared to how research is conducted. Conducting a search of a constantly changing medium required adjustment to traditional methods. We were unable to evenly divide up the apps for review due to device and platform availability at our respective institutions.

    Additional limitations of this review included both the limitations inherent to the MARS tool and specifically its usefulness as a tool for evaluating violence apps. Although MARS standardizes language (eg, “This app is likely to increase awareness of the importance of address [insert target health behavior]), this still requires a reviewer to make numerous subjective decisions and assumptions. MARS also does not contain violence-specific content. This presented challenges in completely evaluating the aspects of apps that violence victims, survivors, or providers may find most important.

    A final significant limitation is the often overlapping yet distinct needs of the people who interact with violence apps. Providers, friends, family, and survivors may all benefit from rapid collated access to local service information, but survivors may additionally want, need, or benefit from specific guided planning and resources. Providers or friends and family using an app to assist a patient or loved one may instead find the most benefit from tailored educational information and trauma-informed response information [19,56]. Although we broadly included all apps for these audiences in our search and analysis, we did not collect data to determine which apps appeared to specify which target audiences.

    Conclusion

    In assessing freely available smartphone apps related to SV and IPV prevention or response, we note first the incredible amount of information that one needs to sift through before even getting to relevant apps. Over 2000 titles were assessed, including first-person shooter games and voice changer apps. Once narrowed to the 132 relevant and included apps, we must highlight that despite the number of apps in this space, the lack of quality and evidence base leaves much work to be done. As with any other item in our toolbox as health care providers and advocates, apps are 1 tool and will likely be most useful when implemented in the correct settings and with the appropriate knowledge, training, and skill sets.

    Acknowledgments

    The authors thank Daniel J. Sheridan, Joe Crowley, and Kristen Bettega for contributions to design and data collection. JCA received funding support from the National Institutes of Alcohol Abuse and Alcoholism (K23AA027288) and the National Institute of Child Health and Human Development (T32HD087162). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.

    Authors' Contributions

    JDM was responsible for conceptualization, methodology, formal analysis, investigation, resources, data curation, writing (original draft), writing (review and editing), visualization, supervision, and project administration. AT performed writing (original draft) and writing (review and editing). LR conducted visualization, writing (original draft), and writing (review and editing). EP performed conceptualization, investigation, and writing (review and editing). JCA was responsible for conceptualization, methodology, investigation, formal analysis, writing (original draft), writing (review and editing), and supervision.

    Conflicts of Interest

    None declared.

    ‎
    Multimedia Appendix 1

    Adapted Mobile App Rating Scale (MARS).

    PDF File (Adobe PDF File), 166 KB
    1. Truman J, Morgan R. Criminal Victimization, 2015.: Bureau of Justice Statistics, U.S. Department of Justice; 2018.   URL: https://bjs.ojp.gov/content/pub/pdf/cv15.pdf [accessed 2021-03-10]
    2. Smith SG, Zhang X, Basile KC, Merrick MT, Wang J, Kresnow M, et al. The National Intimate Partner and Sexual Violence Survey (NISVS): 2015 Data Brief - Updated Release. Atlanta, GA: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention; 2018.   URL: https://www.cdc.gov/violenceprevention/pdf/2015data-brief508.pdf [accessed 2021-03-10]
    3. James SE, Herman JL, Rankin S, Keisling M, Mottet L, Anafi M. The Report of the 2015 U.S. Transgender Survey. Washington, DC: National Center for Transgender Equality; 2016.   URL: https://transequality.org/sites/default/files/docs/usts/USTS-Full-Report-Dec17.pdf [accessed 2021-02-15]
    4. Walters ML, Chen J, Breiding MJ. The National Intimate Partner and Sexual Violence Survey: 2010 Findings on Victimization by Sexual Orientation. Atlanta, GA: National Center for Injury Prevention and Control, Centers for Disease Control and Prevention; 2013.   URL: https://www.cdc.gov/ViolencePrevention/pdf/NISVS_SOfindings.pdf [accessed 2020-09-25]
    5. Yim IS, Kofman YB. The psychobiology of stress and intimate partner violence. Psychoneuroendocrinology 2019 Jul;105:9-24 [FREE Full text] [CrossRef] [Medline]
    6. Humphreys J, Epel ES, Cooper BA, Lin J, Blackburn EH, Lee KA. Telomere shortening in formerly abused and never abused women. Biol Res Nurs 2012 Apr;14(2):115-123 [FREE Full text] [CrossRef] [Medline]
    7. Chandan JS, Thomas T, Bradbury-Jones C, Taylor J, Bandyopadhyay S, Nirantharakumar K. Risk of cardiometabolic disease and all-cause mortality in female survivors of domestic abuse. J Am Heart Assoc 2020 Feb 18;9(4):e014580 [FREE Full text] [CrossRef] [Medline]
    8. World Health Organization. Global and Regional Estimates of Violence Against Women: Prevalence and Health Effects of Intimate Partner Violence and Non-partner Sexual Violence. Geneva, Switzerland: Word Health Organization; 2013.   URL: https://www.who.int/publications/i/item/9789241564625 [accessed 2020-09-01]
    9. Paterno MT, Draughon Moret JE, Paskausky A, Campbell JC. Exploring reproductive coercion in relationship contexts among young adult, primarily African American women at three women's health clinics. J Interpers Violence 2021 Feb;36(3-4):NP2248-2271NP. [CrossRef] [Medline]
    10. Silverman JG, Decker MR, Reed E, Raj A. Intimate partner violence victimization prior to and during pregnancy among women residing in 26 U.S. states: associations with maternal and neonatal health. Am J Obstet Gynecol 2006 Jul;195(1):140-148. [CrossRef] [Medline]
    11. Perrin A, Anderson M. Share of U.S. Adults Using Social Media, Including Facebook Is Mostly Unchanged since 2018.: Pew Research Center; 2019 Apr 10.   URL: https:/​/www.​pewresearch.org/​fact-tank/​2019/​04/​10/​share-of-u-s-adults-using-social-media-including-facebook-is-mostly-unchanged-since-2018/​ [accessed 2019-09-16]
    12. App Annie. State of Mobile 2020.: App Annie   URL: https://www.appannie.com/en/go/state-of-mobile-2020/ [accessed 2020-11-24]
    13. Greenfield LA. An Analysis of Data on Rape and Sexual Assault: Sex Offenses and Offenders. Washington DC: Bureau of Justice Statistics, US Department of Justice; 1997.   URL: https://bjs.ojp.gov/content/pub/pdf/SOO.PDF [accessed 2020-11-24]
    14. The Oswegonian. UASK App Proves To Be Useful Resource On College Campuses. 2016 Oct 6.   URL: https:/​/www.​oswegonian.com/​2016/​10/​06/​u-ask-app-proves-to-be-useful-resource-on-college-campuses/​?fbclid=IwAR0roarew2wLui9i17PKJWF59yUVHdLun189cuEoHR37VEDAjeuUKl4rs6Q [accessed 2020-11-30]
    15. Geffen S. This App is Changing the Way College Students Respond to Sexual Assault Internet.: MTV News; 2015.   URL: http:/​/www.​mtv.com/​news/​2058624/​ask-app-college-sexual-assault/​?fbclid=IwAR25lJLlODhbFAxBP-WhQPXFp7RSIVqN1V9A71LMoDXXs3wA8h5N05LkSUs [accessed 2021-09-27]
    16. Florian A. UASK Apps Aim to Help Students Reach Sexual Assault Resources on Campus.: USA Today; 2016 Sep 20.   URL: https:/​/www.​usatoday.com/​story/​college/​2016/​09/​20/​u-ask-apps-aim-to-help-students-reach-sexual-assault -resources-on-campus/​37422127/​?fbclid=IwAR3Zmqpsy9QYR-XnzboJnUK9WkTAXCP0w_BMDMAcYQSX- pbJmv52gAVagYs [accessed 2021-10-04]
    17. Sande MK, Broderick KB, Moreira ME, Bender B, Hopkins E, Buchanan JA. Sexual assault training in emergency medicine residencies: a survey of program directors. West J Emerg Med 2013 Sep 17;14(5):461-466 [FREE Full text] [CrossRef] [Medline]
    18. Akash SA, Al-Zihad M, Adhikary T, Razzaque MA, Sharmin A. HearMe: A smart mobile application for mitigating women harassment. 2016 Presented at: 2016 IEEE International WIE Conference on Electrical and Computer Engineering (WIECON-ECE) IEEE; December 2016; AISSMS, Pune, Maharashtra, India p. 87-90. [CrossRef]
    19. Bloom T, Gielen A, Glass N. Developing an app for college women in abusive same-sex relationships and their friends. J Homosex 2016 Jun;63(6):855-874. [CrossRef] [Medline]
    20. Anderson JC, Pollitt E, Crowley J, Holbrook D, Draughon Moret JE. A mixed-methods evaluation of college student and provider perspectives on a smartphone application for help-seeking after violence. J Am Coll Health 2021;69(6):668-674. [CrossRef] [Medline]
    21. Glass N, Clough A, Case J, Hanson G, Barnes-Hoyt J, Waterbury A, et al. A safety app to respond to dating violence for college women and their friends: the MyPlan study randomized controlled trial protocol. BMC Public Health 2015 Sep 08;15:871 [FREE Full text] [CrossRef] [Medline]
    22. Goldman S, Goyal D. Knowledge regarding child victims of commercial sexual exploitation and the feasibility of using a smartphone application: a pilot study. J Forensic Nurs 2019 Jun;15(2):103-109. [CrossRef] [Medline]
    23. Moon KJ, Park KM, Sung Y. Sexual abuse prevention mobile application (SAP_MobAPP) for primary school children in Korea. J Child Sex Abus 2017 Jul;26(5):573-589. [CrossRef] [Medline]
    24. Johns Hopkins University School Of Nursing. myPlan.   URL: https://www.myplanapp.org/ [accessed 2021-03-08]
    25. Alhusen J, Bloom T, Clough A, Glass N. Development of the MyPlan Safety Decision app with friends of college women in abusive dating relationships. J Technol Hum Serv 2015 Aug 12;33(3):263-282. [CrossRef]
    26. Davies J, Lyon E, Monti-Catania D. Safety Planning with Battered Women: Complex Lives/Difficult Choices. Thousand Oaks, CA: Sage; 1998.
    27. Campbell J, Glass N. Safety planning, danger, lethality assessment. In: Mitchell C, Anglin D, editors. Intimate Partner Violence: A Health Based Perspective. New York: Oxford University Press; 2009:319-334.
    28. Eden KB, Perrin NA, Hanson GC, Messing JT, Bloom TL, Campbell JC, et al. Use of online safety decision aid by abused women: effect on decisional conflict in a randomized controlled trial. Am J Prev Med 2015 Apr;48(4):372-383 [FREE Full text] [CrossRef] [Medline]
    29. Glass NE, Clough A, Messing JT, Bloom T, Brown ML, Eden KB, et al. Longitudinal IMPACT of the myPlan app on health and safety among college women experiencing partner violence. J Interpers Violence 2021 Feb 12:886260521991880. [CrossRef] [Medline]
    30. Glass NE, Perrin NA, Hanson GC, Bloom TL, Messing JT, Clough AS, et al. The longitudinal impact of an internet safety decision aid for abused women. Am J Prev Med 2017 May;52(5):606-615. [CrossRef] [Medline]
    31. Breiding MJ, Smith SG, Basile KC, Walters ML, Chen J, Merrick MT. Prevalence and characteristics of sexual violence, stalking, and intimate partner violence victimization: national intimate partner and sexual violence survey, United States, 2011. MMWR Surveill Summ 2014 Sep 05;63(8):1-18 [FREE Full text] [Medline]
    32. Stoyanov SR, Hides L, Kavanagh DJ, Zelenko O, Tjondronegoro D, Mani M. Mobile app rating scale: a new tool for assessing the quality of health mobile apps. JMIR Mhealth Uhealth 2015 Mar 11;3(1):e27 [FREE Full text] [CrossRef] [Medline]
    33. Martín Payo R, Harris J, Armes J. Prescribing fitness apps for people with cancer: a preliminary assessment of content and quality of commercially available apps. J Cancer Surviv 2019 Jun;13(3):397-405. [CrossRef] [Medline]
    34. Bardus M, van Beurden SB, Smith JR, Abraham C. A review and content analysis of engagement, functionality, aesthetics, information quality, and change techniques in the most popular commercial apps for weight management. Int J Behav Nutr Phys Act 2016 Mar 10;13(1):35 [FREE Full text] [CrossRef] [Medline]
    35. Brown J, Siddiqi A, Froome H, Arcand J. What's cooking? A content and quality analysis of food preparation mobile applications (p16-050-19). Curr Dev Nutr 2019 Jun 13;3(Suppl 1):nzz050.P16-050-19. [CrossRef]
    36. Patel R, Sulzberger L, Li G, Mair J, Morley H, Shing MN, et al. Smartphone apps for weight loss and smoking cessation: quality ranking of 120 apps. N Z Med J 2015 Sep 04;128(1421):73-76. [Medline]
    37. Salehi F, Kermani ZA, Khademian F, Aslani A. Critical appraisal of mental health applications. Stud Health Technol Inform 2019;261:303-308. [Medline]
    38. Mani M, Kavanagh DJ, Hides L, Stoyanov SR. Review and evaluation of mindfulness-based iPhone apps. JMIR Mhealth Uhealth 2015 Aug 19;3(3):e82 [FREE Full text] [CrossRef] [Medline]
    39. Chavez S, Fedele D, Guo Y, Bernier A, Smith M, Warnick J, et al. Mobile apps for the management of diabetes. Diabetes Care 2017 Oct;40(10):e145-e146 [FREE Full text] [CrossRef] [Medline]
    40. Choi YK, Demiris G, Lin SY, Iribarren SJ, Landis CA, Thompson HJ, et al. Smartphone applications to support sleep self-management: review and evaluation. J Clin Sleep Med 2018 Oct 15;14(10):1783-1790 [FREE Full text] [CrossRef] [Medline]
    41. Salazar A, de Sola H, Failde I, Moral-Munoz JA. Measuring the quality of mobile apps for the management of pain: systematic search and evaluation using the mobile app rating scale. JMIR Mhealth Uhealth 2018 Oct 25;6(10):e10718 [FREE Full text] [CrossRef] [Medline]
    42. Woods LS, Duff J, Roehrer E, Walker K, Cummings E. Patients' experiences of using a consumer mHealth app for self-management of heart failure: mixed-methods study. JMIR Hum Factors 2019 May 02;6(2):e13009 [FREE Full text] [CrossRef] [Medline]
    43. Ramsey RR, Caromody JK, Voorhees SE, Warning A, Cushing CC, Guilbert TW, et al. A systematic evaluation of asthma management apps examining behavior change techniques. J Allergy Clin Immunol Pract 2019;7(8):2583-2591 [FREE Full text] [CrossRef] [Medline]
    44. IBM Corp. IBM SPSS Statistics for Windows. Armonk, NY: IBM Corp; 2017.
    45. Müller RM, Kijl B, Martens JKJ. A comparison of inter-organizational business models of mobile app stores: there is more than open vs. closed. J Theor Appl Electron Commer Res 2011;6(2):13-14. [CrossRef]
    46. Valvi AC, West DC. Mobile applications (apps) in advertising: A grounded theory of effective uses and practices. In: Kubacki K, editor. Ideas in Marketing: Finding the New and Polishing the Old. Proceedings of the 2013 Academy of Marketing Science (AMS) Annual Conference. Cham: Springer International; 2015:349-352.
    47. Klibanoff E. App Links Sex Assault Survivors To Help, But Who Downloads It? . 2015.   URL: https:/​/www.​npr.org/​sections/​health-shots/​2015/​01/​24/​379410663/​what-do-i-do-for-sexual-assault-survivors-an-app-has-all-the-answers [accessed 2021-02-17]
    48. Van Velthoven MH, Smith J, Wells G, Brindley D. Digital health app development standards: a systematic review protocol. BMJ Open 2018 Aug 17;8(8):e022969 [FREE Full text] [CrossRef] [Medline]
    49. Larsen ME, Nicholas J, Christensen H. Quantifying app store dynamics: longitudinal tracking of mental health apps. JMIR Mhealth Uhealth 2016 Aug 09;4(3):e96 [FREE Full text] [CrossRef] [Medline]
    50. Decker MR, Wood SN, Kennedy SR, Hameeduddin Z, Tallam C, Akumu I, et al. Adapting the myPlan safety app to respond to intimate partner violence for women in low and middle income country settings: app tailoring and randomized controlled trial protocol. BMC Public Health 2020 May 29;20(1):808 [FREE Full text] [CrossRef] [Medline]
    51. Bagwell-Gray M, Loerzel E, Dana Sacco G, Messing J, Glass N, Sabri B, et al. From myPlan to ourCircle: adapting a web-based safety planning intervention for Native American women exposed to intimate partner violence. J Ethn Cult Divers Soc Work 2020 Jun 22;30(1-2):163-180. [CrossRef]
    52. Alvarez C, Debnam K, Clough A, Alexander K, Glass NE. Responding to intimate partner violence: healthcare providers' current practices and views on integrating a safety decision aid into primary care settings. Res Nurs Health 2018 Apr;41(2):145-155. [CrossRef] [Medline]
    53. Decker MR, Wood SN, Hameeduddin Z, Kennedy SR, Perrin N, Tallam C, et al. Safety decision-making and planning mobile app for intimate partner violence prevention and response: randomised controlled trial in Kenya. BMJ Glob Health 2020 Jul;5(7):e002091 [FREE Full text] [CrossRef] [Medline]
    54. Sabri B, Njie-Carr VPS, Messing JT, Glass N, Brockie T, Hanson G, et al. The weWomen and ourCircle randomized controlled trial protocol: a web-based intervention for immigrant, refugee and indigenous women with intimate partner violence experiences. Contemp Clin Trials 2019 Jan;76:79-84 [FREE Full text] [CrossRef] [Medline]
    55. Substance Abuse and Mental Health Services Administration. SAMHSA’s Concept of Trauma and Guidance for a Trauma-Informed Approach. HHS Publication No. (SMA) 14-4884. Rockville, MD: Substance Abuse and Mental Health Services Administration; 2014 Jul.   URL: https://ncsacw.samhsa.gov/userfiles/files/SAMHSA_Trauma.pdf [accessed 2020-06-24]
    56. Griffiths KM, Crisp DA, Barney L, Reid R. Seeking help for depression from family and friends: a qualitative analysis of perceived advantages and disadvantages. BMC Psychiatry 2011 Dec 15;11:196 [FREE Full text] [CrossRef] [Medline]

    ‎
    GPS: Global Positioning System
    IPV: intimate partner violence
    IRIS: Internet Resource for Information and Safety
    LGBTQ: lesbian, gay, bisexual, transgender, and queer
    MARS: Mobile Application Rating Scale
    SV: sexual violence

    Edited by G Eysenbach; submitted 29.03.21; peer-reviewed by L Schwab-Reese, M Testa; comments to author 17.05.21; revised version received 06.10.21; accepted 30.11.21; published 08.02.22

    Copyright

    ©Jessica Draughon Moret, Angela Todd, Lauren Rose, Erin Pollitt, Jocelyn Anderson. Originally published in JMIR Formative Research (https://formative.jmir.org), 08.02.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.