This paper is in the following e-collection/theme issue:

Early Results from COVID-19 Studies (309) Web-based and Mobile Health Interventions (3357) JMIR Theme Issue: COVID-19 Special Issue (2461) Digital Contact Tracing, Digital Proximity Tracing, Precision Public Health (148) Hygiene and Infection Prevention (325)

Published on in Vol 6, No 7 (2022): July

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/37891, first published .
Preferences in the Willingness to Download a COVID-19 Contact Tracing App in the Netherlands and Turkey: Experimental Study

Preferences in the Willingness to Download a COVID-19 Contact Tracing App in the Netherlands and Turkey: Experimental Study

Preferences in the Willingness to Download a COVID-19 Contact Tracing App in the Netherlands and Turkey: Experimental Study

Authors of this article:

Frans Folkvord1, 2 Author Orcid Image ;   Lutz Peschke3 Author Orcid Image ;   Yasemin Gümüş Ağca3 Author Orcid Image ;   Karlijn van Houten2 Author Orcid Image ;   Giacomo Stazi2 Author Orcid Image ;   Francisco Lupiáñez-Villanueva2, 4 Author Orcid Image
Article Authors Cited by (3) Tweetations (5) Metrics

    Original Paper

    1Tilburg School of Humanities and Digital Sciences, Tilburg University, Tilburg, Netherlands

    2PredictBy, PredictBy Research, Barcelona, Spain

    3Department of Communication and Design, Bilkent University, Ankara, Turkey

    4Department of Information and Communication Science, Universitat Oberta de Catalunya, Barcelona, Spain

    Corresponding Author:

    Frans Folkvord, PhD

    Tilburg School of Humanities and Digital Sciences

    Tilburg University

    Warrandelaan 2

    Tilburg, 5037 AB

    Netherlands

    Phone: 31 682240480

    Email: fransfolkvord@gmail.com


    Background: Despite the worldwide growth in using COVID-19 contact tracing apps (CTAs) and the potential benefits for citizens, governments, health care professionals, businesses, and other organizations, only a few studies have examined the factors affecting the levels of willingness to download a CTA.

    Objective: This study aimed to investigate individuals’ preferences in the willingness to download a health app.

    Methods: We conducted an experimental study in 2 countries, the Netherlands (N=62) and Turkey (N=83), using 4 different vignettes (ie, data protection, manufacturer, reward, and gaming models) with different attributes. Participants were randomly assigned to 1 of the conditions within the vignettes.

    Results: The results showed that data protection and gaming elements are factors that influence the willingness to download a COVID-19 CTA. More specifically, we see that data protection is an important factor explaining the willingness to download the app in Turkey, whereas including gaming elements significantly affects the willingness to download the app in the Netherlands.

    Conclusions: COVID-19 CTAs are highly promising to reduce the spread of the virus and make it easier to open up society faster, especially because they can be used quickly and share information rapidly. COVID-19 CTA developers must ensure that their apps satisfactorily and sufficiently address ethical considerations, even in times of crisis. Furthermore, integrating gaming elements in the CTA could enhance the willingness to download the CTA.

    JMIR Form Res 2022;6(7):e37891

    doi:10.2196/37891

    Keywords

    COVID-19 tracing app; willingness to download; discrete choice task; pandemic; mitigation strategies; COVID-19; health application; mobile health; gaming; tracing application; digital health; data protection 


    Background

    The COVID-19 pandemic affected human health tremendously, as well as social and economic life, increasing the urge to find effective measures to start reviving public life as soon as possible while minimizing the risk of infection and hospitalization of patients [1]. Current developments across the world show that one strategy might be through technology, accompanied by mobile apps [2,3]. Considering that COVID-19 has proven to be highly contagious, especially newer variants such as Delta and Omicron [4]—sometimes without the carrier experiencing symptoms and infecting several others before actually testing positive—it is important to trace contacts and identify individuals who had close contact with the carrier.

    Normally, this tracking is accomplished through a personal interview with the infected individual, establishing the people who have been in (close) contact with the carrier, and subsequently developing strategies to mitigate further spreading. However, it is difficult for people to accurately remember all the persons that they have been in close contact with, including those who cannot be identified because they are unknown to the carrier. Moreover, considering the rapidly increasing numbers of infected people in a majority of the countries worldwide at the moment, conducting the interviews manually would require a considerable workforce of trained individuals to hold the interviews effectively, which is a highly costly exercise and has shown to be ineffective in times of high infection rates [5].

    Research has shown that COVID-19 contact tracings apps (CTAs) could mitigate the current pandemic by informing people instantly when they have been in close contact with an infected individual [5-9]. CTAs have been implemented in nearly all countries for the identification of pandemic hot spots, supporting collaborative information processes between the public and health authorities about critical contacts with infectious citizens. One of the main goals is to initiate knowledge circulation between the 5 systems of the Quintuple Helix [10], which includes the decision processes of policy makers. According to Oldeweme et al [6], the willingness to download processes of CTAs are fostered by the reduction of uncertainties—perceived privacy and performance risks—through trust in governments and public participation but do not reduce social risks and health-related COVID-19 concerns. Although these new possibilities promise several benefits for mitigating the pandemic, the actual willingness to download and the long-term use of mobile health (mHealth) apps is rather low and lags behind their potential [11]. As a result, despite the promising effects of the CTAs to mitigate the pandemic, there is insufficient evidence supporting the willingness to download preferences for these apps, although willingness to download is the first, and therefore important, step. This lack of evidence urges us to take a step back to better understand which factors influence the willingness to download CTAs [12,13].

    A first step in this endeavor is to understand which factors affect people’s willingness to download CTAs. Considering the limited understanding of the general cognitive motivators that trigger people’s willingness to download health apps, especially in times of crisis, it is important to examine which attributes of health apps are preferred when downloading CTAs. An extensive systematic literature review [14] has shown that, in support of the Technology Acceptance Model, 8 key themes can be categorized for clinicians’ adoption of mHealth tools: usefulness, ease of use, design, compatibility, technical issues, content, personalization, and convenience. In addition, from a patient’s perspective [15], usefulness, ease of use, data-related factors, monetary factors, technical issues, and user experience were considered to be important factors for the adoption of an mHealth app.

    Furthermore, intrinsic motivation to use such a health app is considered a strong predictor of actual willingness to download and use [16]. In addition, Salomoni et al [17] point out that rethinking how the users receive and interact with a health app is important to better understand the role of diegetic interfaces, which should also be taken into account when developing a CTA. Without the proper comprehension of the cognitive motivators that explain the willingness to download and use mHealth apps, it would be very difficult to establish the effectiveness of mHealth apps and fully understand individuals’ use of such apps.

    Attributes Explaining Preferences in the Willingness to Download CTAs

    The rising use of mHealth apps threatens to change the way substantial amounts of health data will be managed, with a paradigm shift from mainframe systems located in the facilities of health care providers to apps on mobile phones and data stored in shared cloud services [18,19]. According to Klar and Lanzerath [20], besides the challenges of effectiveness, technological problems and the risks of privacy and equity have to be considered. Ryan [21] has, for example, evaluated South Korea’s digital tracing app through the lens of 4 human rights principles to determine if this response was ethically justifiable (ie, necessary, proportional, scientifically valid, and time-bounded) and concluded that the Korean digital CTA was scientifically valid and proportionate—meeting the necessity requirement—but it was too vaguely defined to meet the time-boundedness requirement. More specifically, the prerequisite of an ethical deployment of CTAs is voluntariness, starting with deciding to carry a smartphone, choosing to download and install a CTA, leaving the CTA operating in the background all the times, and finally, sharing contact logs when tested positive. Peschke et al [22] discussed the voluntariness of CTA deployment in different countries. Based on an analysis of more than 35 CTAs worldwide [23], 2 main categories of CTA deployment could be identified. First, for the participation of the public life, such as entering university campuses and shopping malls in Turkey, an individual Hayat Eve Sığar (Turkish for “life fits into home”) code has to be generated and presented to the gatekeepers. In these apps, the data of the users are collected in a central place and sometimes shared with other state institutions. If COVID-19 is detected within the passengers of the same vehicle or at the same location within the next 14 days, everyone at that place, family doctors, and the filiation team are informed [24]. Second, Google and Apple have developed a system called Exposure Notifications System to bring out anonymized identity information to the users’ environment via Bluetooth. The importance of data protection and privacy issues regarded by potential users of the CTAs have not been sufficiently understood yet.

    A recent study has shown that privacy perceptions are related to the use of mHealth apps, in which people with more concerns about the secondary use of their personal data were less likely to use certain mHealth apps [25]. In addition, the manufacturer of a health app can be considered a heuristic in the consumers’ willingness to download a CTA. There is reason to assume that this factor may be an important, as the industry has struggled with its public image over the past few decades. Companies need to negotiate a tension between, on the one hand, striving for optimal health care and, on the other hand, striving for profit [26]. In the eyes of the public, it is not always clear that the industry has the patients’ interests at heart [27]. Therefore, people would probably prefer if an mHealth app is manufactured by the government than by a company.

    By contrast, the Edelman Trust Barometer [28] reveals that business is the only institution that is understood to be competent and ethical by the public in 18 of the 27 countries evaluated. The public is more likely to trust in business as it acts as the guardian of information quality, embraces sustainable practices, and provides robust COVID-19 health and safety response [28]. However, the Netherlands noticed an increase of trust in both business and government [28]. The Edelman Trust Barometer did not capture data from Turkey, but the result of 2 studies conducted in 2020 show that the pandemic crisis revealed 2 different results. Bostan et al [29] conclude that the public trusts the authorities and the accuracy of the decisions taken by the state to combat the pandemic. However, Tanca et al [30] perceive the ambiguity and capriciousness of the public’s reactions as a result of the uncertainty of both the government and national economy. A special report about trust and coronavirus published by Edelman Trust Barometer [31] reveals that 85% of the respondent want to hear more from scientists and less from politicians.

    Lastly, it is worth emphasizing the importance of the design of the CTA when participants are downloading apps. Web-based gaming studies have shown that elements and features with clear goals at every step [32], immediate feedback [33-35], and balance between challenge and skill [36] grounded in the flow theory [37] are considered key elements of the willingness to download apps.

    Finally, since last year, the majority of the public has prioritized increasing their own media and information literacy as well as science literacy, but only 26% of the respondents have good information hygiene—considering news engagement, avoiding information echo chambers, verifying information, and not amplifying unvetted information [28].

    Hypotheses

    In this study, we conducted 4 small experimental studies based on vignettes in 2 different countries (the Netherlands and Turkey). In the vignette study, we manipulated the manufacturer (government vs company), data protection (data protection vs no information), reward (no reward vs voucher as a reward), and gaming (no gaming elements vs gaming elements) variables and assessed the likelihood of downloading a COVID-19 CTA to test the following hypothesis:

    1. Participants who are exposed to a COVID-19 CTA developed by a government will be more willing to download the app than participants who were exposed to a COVID-19 CTA that is developed by a company (Hypothesis [H]1).
    2. Participants who are exposed to a COVID-19 CTA whereby there was communication that the data is protected by law will be more willing to download the app than participants who are exposed to a COVID-19 CTA whereby no information was given about the data protection (H2).
    3. Participants who are exposed to a COVID-19 CTA and will receive a reward based on scientific evidence will be more willing to download the app than participants who are exposed to a COVID-19 CTA and will receive no rewards (H3).
    4. Participants who are exposed to a COVID-19 CTA that includes gaming elements will be more willing to download the app than participants who are exposed to a COVID-19 CTA without any gaming elements (H4).

    Design

    In this study, we conducted 4 small experimental studies through a web-based questionnaire using vignettes to simulate real-life situations. The use of a web-based questionnaire provided completion time data to support the internal validity checks and enabled an accurate record of the time taken to complete the surveys. There were 2 rounds of cognitive testing (N=12) undertaken in the Netherlands to check the participants’ comprehension of information when making choices. These pretests confirmed that a study based on the questionnaire was acceptable and understandable for participants, after some minor revisions in the explanation of the task.

    Procedure

    All survey participants were informed about the overall study goals and procedures. First, participants were asked to provide sociodemographic information, including their age group, gender, education, and employment status. Subsequently, an introduction to the vignette studies provided an explanation of what was expected from the participants. One example of the vignette is the following, whereby the last sentence is the part of the script that varied among the conditions.

    Imagine that an app is presented to you to mitigate the pandemic, by providing you detailed information about the people that you have been around with, how close, and for how long, that are infected by the COVID virus, or not. Based on the collected data, the app will provide tailored advice to improve your health. We will present you some pairs of options and will ask you to select the one that you would prefer to use the app or not. Importantly, the app is developed by the government.

    Subsequently, participants were asked to score the likelihood that they would download the app and whether they would download the app. The other vignettes entailed exactly the same text, except the last sentence was replaced by the specific condition the participant was randomly allocated to (government vs company, data protection vs no information, no reward vs voucher as a reward, or no gaming elements vs gaming elements).

    Ethics Approval

    Only those who agreed to participate in the study gained access to the web-based survey. The approval of the Ethical Committee of the Tilburg School of Humanities and Digital Sciences to conduct the experiment was obtained (REDC 2021.73). Through signing informed consent, participants were ensured that their data would remain confidential, and they were told that they could cease participation at any moment. All participants participated anonymously, and the collected data was stored in a dark archive at the Tilburg University.

    Participants

    For this study, we used data collected from 2 different countries (Turkey and the Netherlands). This study was part of a larger project, whereby multiple experiments were conducted. After the participants finished the discrete choice experiment, they also participated in a separate experiment that is reported in a separate paper. The data in the Netherlands (N=62) and Turkey (N=83) were collected through a web-based survey administered through Qualtrics (SAP America Inc). Participant characteristics are shown in Table 1.

    Table 1. Descriptive information about the participants per country.
    CharacteristicNetherlands (N=62)Turkey (N=83)
    Gender, women, n (%)31 (50)43 (52)
    Age (year), mean (SD)23.92 (7.45)21.87 (2.46)
    Educational level, n (%)

    		Primary education3 (5)0 (0)

    		High school diploma3 (5)10 (12)

    		Some years of university28 (45)61 (73)

    		University degree18 (29)10 (12)

    		Post-graduate degree10 (16)2 (2)
    Employment status, n (%)

    		Employed/self-employed11 (18)12 (14)

    		Unemployed7 (11)0 (0)

    		Student44 (71)71 (86)

    		Retired0 (0)0 (0)

    		Not working due to illness or disability0 (0)0 (0)

    		Another reason for not being in the labor force0 (0)0 (0)
    Health app use, n (%)

    		No use27 (44)30 (36)

    		1 time8 (13)18 (22)

    		2 times11 (18)18 (22)

    		3 times7 (11)6 (7)

    		4 times3 (5)4 (5)

    		5 times0 (0)3 (4)

    		>5 times6 (10)4 (5)
    Health consciousness, mean (SD)3.77 (0.68)3.93 (0.83)
    Health information orientation, mean (SD)2.99 (0.82)3.48 (0.92)
    eHealth literacy, mean (SD)2.85 (0.96)3.09 (1.00)

    Measures

    Dependent Variables

    Willingness to download the app was measured through the question “Please indicate on a scale of 1 to 10 how likely it is that you would download the app. Please place yourself at a point on this scale where ‘0’ indicates that you would ‘definitely not download the app,’ ‘10’ indicates that you would ‘definitely download the app,’ and the remaining numbers indicate something in between these 2 positions.” whereby participants could answer on a visual analog scale.

    Intention to download the app was measured through the question “Would you download the app?” whereby participants could answer yes or no.

    Intrapersonal Factors

    Health app use was measured by asking how often the participant used a health app, varying from 0 (never) to 6 (more than 5 times), and how much time the participant spent using a health app in the last week, varying from 0 (0 hours) to 6 (more than 1 hour).

    Health consciousness was measured using 5 statements that were rated on a 5-point scale (from 1 representing strongly disagree to 5 representing strongly agree) [38]. The reliability of the scale was high (α=.82).

    Health information orientation was measured using 8 statements rated on a 5-point scale (from 1 representing strongly disagree to 5 representing strongly agree) [38]. The reliability of the scale was high (α=.87)

    eHealth literacy was measured using 8 statements rated on a 5-point scale (from 1 representing strongly disagree to 5 representing strongly agree) [39]. The reliability of the scale was high (α=.95).

    Statistical Analyses

    Several analyses of covariance (ANCOVAs) were conducted to assess the participants’ likelihood to download the app—first, for all participants and subsequently, for each country. Next, we conducted logistic regression analyses to assess the participants’ probability to download the app.


    Developer Models

    The first ANCOVA tested if participants who were exposed to a COVID-19 CTA developed by a government were more willing to download the app than participants who were exposed to a COVID-19 CTA developed by a company, whereby age, gender, education, health consciousness, health information orientation, and eHealth literacy were included as covariates in the analysis. No effects were found for the developer (F7,137=1.307; P=.26). For age (F1,137=9.848; P=.002) and eHealth literacy (F1,137=7.047; P=.009), we found significant relationships. For the other factors, we found no significant differences.

    Next, the logistic regression analysis showed that there was no effect of the developer on whether the participants would download the app (P=.32). For age (P<.001) and education (P=.02), we found significant relations to whether the participants would download the app.

    A separate ANCOVA for the Netherlands showed that no effects were found for the developer (F7,54=1.638; P=.21). We found a significant relationship for age (P=.01). For the other factors, we found no significant differences. In addition, the logistic regression analysis showed that there was no effect of the developer on whether the participants would download the app (P=.46). For age (P=.01) and education (P=.008), we found significant relations to whether the participants would download the app.

    In Turkey, an ANCOVA showed that no effects were found for the developer as well (F7,75=0.094; P=.76). For the other factors, we found no significant differences. Furthermore, the logistic regression analysis showed that there was no effect of the developer on whether the participants would download the app (P=.49). For age (P=.02) and eHealth literacy (P=.01), we found significant relations to whether the participants would download the app.

    Data Protection Models

    The second ANCOVA tested if participants who were exposed to a COVID-19 CTA developed whereby data was protected by European legislation were more willing to download the app than participants who were exposed to a COVID-19 CTA whereby no information was given about the data protection, whereby age, gender, education, health consciousness, health information orientation, and eHealth literacy were included as covariates in the analysis. The results showed that participants who were exposed to a COVID-19 CTA developed whereby data was protected by law (mean 6.93, SD 2.44) were significantly more willing to download the app than participants who were exposed to a COVID-19 CTA whereby no information was given about the data protection (mean 6.93, SD 2.44; F7,137=19.125; P>.001). For the other factors, we found no significant differences. The logistic regression analysis showed that there was a significant effect of data protection on whether the participants would download the app (P<.001). The probability that a participant would download the app would be 3.886 times greater when the data was protected by EU legislation than when no information was provided about what would be done with the data. For the other factors, we found no significant relations.

    Separate analyses for the Netherlands showed that participants who were exposed to a COVID-19 CTA developed whereby data was protected by law were not more likely to download the app than participants who were exposed to a COVID-19 CTA whereby no information was given about the data protection (F7,54=1.130; P=.29). For the other factors, we found no significant differences. The logistic regression analysis showed that there was a significant effect of data protection on whether the participants would download the app (P=.03). The probability that a participant would download the app would be 3.327 times greater when the data was protected by law than when no information was provided about what would be done with the data. For the other factors, we found no significant relations.

    In Turkey, participants who were exposed to a COVID-19 CTA developed whereby data was protected by law were significantly more willing to download the app (mean 7.27, SD 2.52) than participants who were exposed to a COVID-19 CTA whereby no information was given about the data protection (mean 4.17, SD 3.09; F7,75=24.584; P>.001). For the other factors, we found no significant differences. The logistic regression analysis showed that there was a significant effect of data protection on whether the participants would download the app (P=.007). The probability that a participant would download the app would be 3.847 times greater when the data was protected by law than when no information was provided about what would be done with the data. For the other factors, we found no significant relations.

    Reward Models

    The next ANCOVA tested if participants who were exposed to a COVID-19 CTA and would receive a reward if they adopted the app were more willing to download the app than participants who were exposed to a COVID-19 CTA and would receive no rewards, whereby age, gender, education, health consciousness, health information orientation, and eHealth literacy were included as covariates in the analysis. The results showed that participants who were exposed to a COVID-19 CTA and would receive a reward if they adopted the app were not more willing to download the app than participants who were exposed to a COVID-19 CTA and would receive no rewards (F7,137=0.324; P=.57). For the other factors, we found no significant differences. In addition, the logistic regression analysis showed that there was no effect of reward on whether the participants would download the app (P=.93). For age (P=.002), health consciousness (P=.04), health information orientation (P<.001), and eHealth literacy (P=.003), we found significant relations to whether the participants would download the app.

    Separate analyses for the Netherlands showed that participants who were exposed to a COVID-19 CTA and would receive a reward if they adopted the app were not more willing to download the app than participants who were exposed to a COVID-19 CTA and would receive no rewards (F7,54=0.322; P=.57). For the other factors, we found no significant differences. The logistic regression analysis showed that there was no effect of reward on whether the participants would download the app (P=.24). For gender (P=.05), age (P=.003), health consciousness (P=.006), health information orientation (P=.004), and eHealth literacy (P=.003), we found significant relationships to whether the participants would download the app. In Turkey, we found similar results for the reward (P=.74) and no other significant relations.

    Gaming Models

    The next ANCOVA tested if participants who were exposed to a COVID-19 CTA that included gaming elements were more willing to download the app than participants who were exposed to a COVID-19 CTA without any gaming elements, whereby age, gender, education, health consciousness, health information orientation, and eHealth literacy were included as covariates in the analysis. The results showed that participants who were exposed to a COVID-19 CTA where gaming elements were included (mean 6.46, SD 2.28) were significantly more willing to download the app than participants who were exposed to a COVID-19 CTA without any gaming elements (mean 5.46, SD 2.73; F7,137=6.603; P=.01). We found a significant relationship for age (F1,137=6.008; P=.02). For the other factors, we found no significant differences. Next, the logistic regression analysis showed that there was no effect of gaming on whether the participants would download the app (P=.15). For education (P=.03) and health information orientation (P=.02), we found significant relations to whether the participants would download the app.

    Separate analyses for the Netherlands showed that participants who were exposed to a COVID-19 CTA where gaming elements were included (mean 6.51, SD 2.07) were significantly more willing to download the app than participants who were exposed to a COVID-19 CTA without any gaming elements (mean 4.87, SD 2.27; F7,54=26.755; P<.001). Furthermore, we found a significant relationship for age (F1,54=13.399; P<.001). For the other factors, we found no significant differences. Next, the logistic regression analysis showed that there was a significant effect of gaming on whether the participant would download the app (P=.006). Participants who were exposed to a COVID-19 CTA with gaming elements were 20.516 times more likely to download the app than participants who were exposed to a COVID-19 CTA without gaming elements. For age (P=.03), education (P=.02), health consciousness (P=.04), and eHealth literacy (P=.03), we found significant relations to whether the participants would download the app. In Turkey, we found no significant differences between the gaming conditions (F7,75=2.380; P=.57) and for the other factors. The logistic regression analysis showed that there was no effect of gaming on whether the participants would download the app (P=.62). No other factors were significantly related to whether the participants would download the app.


    Principal Findings

    The results showed that data protection and gaming elements are important factors that affect the willingness to download a COVID-19 CTA, thereby supporting H2 and H4. For the developer and reward, we found no significant differences between the participants, thus rejecting H1 and H3. Governments might not have a second chance to get an intervention right, especially because in times of crises, trust in politicians is an important factor to mitigate the crisis at stake. Governments, developers, and deployers must ensure that COVID-19 CTAs satisfactorily address the ethical questions that were set out [3]. According to the Organisation for Economic Cooperation and Development [40], citizens expect integrity, openness, and fairness in communication and knowledge transfer, where responsiveness and reliability are crucial factors. As a result, a positive perception of comprehension leads to an increase in acceptance and cooperative engagement.

    Comparison With Prior Work

    Despite the worldwide growth in using COVID-19 CTAs and the potential benefits for all the actors within the Quintuple Helix to mitigate the pandemic more effectively and make us able to open up society sooner, only a few studies have examined the factors affecting the levels of willingness to download the apps. In this study, we investigated individuals’ preferences in the willingness to download a health app. Digital contact tracing via smartphone apps was established as a new public health intervention in many countries in 2020. Most of these apps are now at a stage where they need to be evaluated as public health tools, especially because this could provide us with important lessons for future events such as the current pandemic [3,41].

    Limitations

    One of the limitations of the study is that we used a convenience sampling, whereby most of the participants were students from only 2 countries, thus reducing the generalizability of the outcomes. Considering that this study is part of a larger study where we will develop an actual CTA that will be tested among a larger and more representative study in 5 different countries (Spain, the Netherlands, Finland, Germany, and Turkey), the generalizability will improve. Finally, gamification elements might have been judged differently if they were actually displayed or could be tried out in the experiment, increasing its effectiveness, which unfortunately was not possible. In the next phase of the study, we will test gaming elements in more detail.

    Conclusions

    Simply rolling out a CTA without ethical considerations is not acceptable and does not support the knowledge circulation in the Quintuple Helix. Even in a crisis, a “try everything” approach is dangerous when it ignores the real costs, including serious and long-lasting harms to fundamental rights and freedoms and the opportunity costs of not devoting resources to something else. As this pilot study shows, reassuring people that data protection regulations are put in place is an essential element for increasing the levels of willingness to download CTAs.

    During the last few decades, mHealth initiatives have emerged at an accelerating pace; some have seen widespread willingness to download, whereas others have failed to provide sustained value [42]. These failings can be attributed to their design and implementation efforts that were initiated without a good understanding of the interdependencies between technology, societal and cultural values, and user experience in a health care setting, which has become highly apparent during the current pandemic and health care crisis. Many conceptual frameworks based on implementation science have been developed to evaluate and orient mHealth delivery. These frameworks highlight key factors that predict successful and sustainable mHealth technologies, although there is still limited understanding of the factors influencing the willingness to download these technologies. The urgency of the ongoing public health crisis stimulated the rapid development of CTAs and other mHealth innovations, and this generated a substantial number of related publications. Their coverage of the essential design and implementation characteristics for eHealth innovation remains under investigated and needs to be further researched in future studies [41].

    Conflicts of Interest

    None declared.

    1. Nicola M, Alsafi Z, Sohrabi C, Kerwan A, Al-Jabir A, Iosifidis C, et al. The socio-economic implications of the coronavirus pandemic (COVID-19): a review. Int J Surg 2020 Jun;78:185-193 [FREE Full text] [CrossRef] [Medline]
    2. Bassi A, Arfin S, John O, Jha V. An overview of mobile applications (apps) to support the coronavirus disease 2019 response in India. Indian J Med Res 2020 May;151(5):468-473 [FREE Full text] [CrossRef] [Medline]
    3. Morley J, Cowls J, Taddeo M, Floridi L. Ethical guidelines for COVID-19 tracing apps. Nature 2020 Jun 28;582(7810):29-31. [CrossRef] [Medline]
    4. Mahase E. COVID-19: hospital admission 50-70% less likely with omicron than delta, but transmission a major concern. BMJ 2021 Dec 24;375:n3151-n3170. [CrossRef] [Medline]
    5. Davalbhakta S, Advani S, Kumar S, Agarwal V, Bhoyar S, Fedirko E, et al. A systematic review of smartphone applications available for Corona Virus Disease 2019 (COVID19) and the assessment of their quality using the Mobile Application Rating Scale (MARS). J Med Syst 2020 Aug 10;44(9):164 [FREE Full text] [CrossRef] [Medline]
    6. Oldeweme A, Märtins J, Westmattelmann D, Schewe G. The role of transparency, trust, and social influence on uncertainty reduction in times of pandemics: empirical study on the adoption of COVID-19 tracing apps. J Med Internet Res 2021 Feb 08;23(2):e25893 [FREE Full text] [CrossRef] [Medline]
    7. Wu S, Neill R, De Foo C, Chua AQ, Jung A, Haldane V, et al. Aggressive containment, suppression, and mitigation of covid-19: lessons learnt from eight countries. BMJ 2021 Nov 28;375:e067508 [FREE Full text] [CrossRef] [Medline]
    8. Walensky RP, Del Rio C. From mitigation to containment of the COVID-19 pandemic: putting the SARS-CoV-2 genie back in the bottle. JAMA 2020 May 19;323(19):1889-1890. [CrossRef] [Medline]
    9. Terhorst Y, Philippi P, Sander LB, Schultchen D, Paganini S, Bardus M, et al. Validation of the Mobile Application Rating Scale (MARS). PLoS One 2020 Nov 2;15(11):e0241480 [FREE Full text] [CrossRef] [Medline]
    10. Carayannis EG, Campbell DFJ. Triple Helix, Quadruple Helix and Quintuple Helix and how do knowledge, innovation and the environment relate to each other? : a proposed framework for a trans-disciplinary analysis of sustainable development and social ecology. International Journal of Social Ecology and Sustainable Development 2010;1(1):41-69. [CrossRef]
    11. Walrave M, Waeterloos C, Ponnet K. Adoption of a contact tracing app for containing COVID-19: a health belief model approach. JMIR Public Health Surveill 2020 Sep 01;6(3):e20572 [FREE Full text] [CrossRef] [Medline]
    12. Anastasiadou D, Folkvord F, Lupiañez-Villanueva F. A systematic review of mHealth interventions for the support of eating disorders. Eur Eat Disord Rev 2018 Sep 21;26(5):394-416. [CrossRef] [Medline]
    13. Anastasiadou D, Folkvord F, Serrano-Troncoso E, Lupiañez-Villanueva F. Mobile health adoption in mental health: user experience of a mobile health app for patients with an eating disorder. JMIR mHealth uHealth 2019 May 31;7(6):e12920 [FREE Full text] [CrossRef] [Medline]
    14. Jacob C, Sanchez-Vazquez A, Ivory C. Social, organizational, and technological factors impacting clinicians’ adoption of mobile health tools: systematic literature review. JMIR mHealth uHealth 2020 Feb 20;8(2):e15935 [FREE Full text] [CrossRef] [Medline]
    15. Jacob C, Sezgin E, Sanchez-Vazquez A, Ivory C. Sociotechnical factors affecting patients' adoption of mobile health tools: systematic literature review and narrative synthesis. JMIR mHealth uHealth 2022 May 05;10(5):e36284 [FREE Full text] [CrossRef] [Medline]
    16. Ng JYY, Ntoumanis N, Thøgersen-Ntoumani C, Deci EL, Ryan RM, Duda JL, et al. Self-determination theory applied to health contexts: a meta-analysis. Perspect Psychol Sci 2012 Jul 29;7(4):325-340. [CrossRef] [Medline]
    17. Salomoni P, Prandi C, Roccetti M, Casanova L, Marchetti L, Marfia G. Diegetic user interfaces for virtual environments with HMDs: a user experience study with oculus rift. J Multimodal User Interfaces 2017 Jan 9;11(2):173-184. [CrossRef]
    18. He D, Naveed M, Gunter CA, Nahrstedt K. Security concerns in Android mHealth apps. AMIA Annu Symp Proc 2014;2014:645-654 [FREE Full text] [Medline]
    19. Kahnbach L, Lehr D, Brandenburger J, Mallwitz T, Jent S, Hannibal S, et al. Quality and adoption of COVID-19 tracing apps and recommendations for development: systematic interdisciplinary review of European apps. J Med Internet Res 2021 Jun 02;23(6):e27989 [FREE Full text] [CrossRef] [Medline]
    20. Klar R, Lanzerath D. The ethics of COVID-19 tracking apps – challenges and voluntariness. Research Ethics 2020 Aug 05;16(3-4):1-9. [CrossRef]
    21. Ryan M. In defence of digital contact-tracing: human rights, South Korea and COVID-19. International Journal of Pervasive Computing and Communications 2020 Aug 06;16(4):383-407. [CrossRef]
    22. Peschke L, Günes Peschke S, Ağca YG, Seyfafjehi S, Dündar I, Aydogdu Y. Reward mechanism in COVID-19 tracking apps and its impact on the voluntary participation of the public in sustainable innovation processes. Turkish Review of Communication Studies 2022(39):54-72. [CrossRef]
    23. Peschke L(, Çataloğlu B, Ceylan N, Dionio P, Dündar I, Folkvord F, et al. Review about good practices of Quadruple Helix collaboration processes and developments of COVID-19 tracking apps and platforms. PandeVITA. 2021.   URL: https://www.pandevita.eu/images/D3-1_GoodPractices-CTAs.pdf [accessed 2022-07-22]
    24. HES kodu nedir. Hayat Eve Sığar. 2020.   URL: https://hayatevesigar.saglik.gov.tr/hes.html [accessed 2021-12-31]
    25. Bol N, Helberger N, Weert JCM. Differences in mobile health app use: a source of new digital inequalities? The Information Society 2018 Apr 26;34(3):183-193. [CrossRef]
    26. Bauchner H, Fontanarosa PB. Restoring confidence in the pharmaceutical industry. JAMA 2013 Feb 13;309(6):607-609. [CrossRef] [Medline]
    27. Olsen AK, Whalen MD. Public perceptions of the pharmaceutical industry and drug safety: implications for the pharmacovigilance professional and the culture of safety. Drug Saf 2009;32(10):805-810. [CrossRef] [Medline]
    28. Edelman Trust Barometer 2021. Edelman. 2021.   URL: https://www.edelman.com/sites/g/files/aatuss191/files/2021-03/2021%20Edelman%20Trust%20Barometer.pdf [accessed 2022-02-20]
    29. Bostan S, Erdem R, Öztürk YE, Kılıç T, Yılmaz A. The effect of COVID-19 pandemic on the Turkish society. Electron J Gen Med 2020;17(6):em237. [CrossRef]
    30. Tanca D, Aydoğ E, Murphy A, Zinciroğlu Ö. The political and economic impact of the coronavirus pandemic in Turkey. Center for Economics and Foreign Policy Studies. 2020 Jan.   URL: https:/​/edam.​org.tr/​wp-content/​uploads/​2020/​11/​The-Political-and-Economic-Impact-of-the-Corona-Virus-in-Turkey.​pdf [accessed 2022-07-22]
    31. Special report: trust and the coronavirus. Edelman. 2020.   URL: https:/​/www.​edelman.com/​sites/​g/​files/​aatuss191/​files/​2020-03/​2020%20Edelman%20Trust%20Barometer%20Coronavirus%20Special%20Report_0.​pdf [accessed 2022-02-02]
    32. Csikszentmihalyi M. Flow: The Psychology of Optimal Experience. New York, NY: Harper & Row; 1990.
    33. Kiili K, de Freitas S, Arnab S, Lainema T. The design principles for flow experience in educational games. Procedia Comput Sci 2012;15:78-91. [CrossRef]
    34. Wang H, Sun CT. Game reward systems: gaming experiences and social meanings. 2011 Jan Presented at: DiGRA 2011 Conference: Think Design Play; September 14-17, 2011; Hilversum, The Netherlands   URL: http://www.digra.org/wp-content/uploads/digital-library/11310.20247.pdf
    35. Bracken CC, Jeffres LW, Neuendorf KA. Criticism or praise? the impact of verbal versus text-only computer feedback on social presence, intrinsic motivation, and recall. Cyberpsychol Behav 2004 Jun;7(3):349-357. [CrossRef] [Medline]
    36. Koster R. A Theory of Fun for Game Design. Scottsdale, AZ: Paraglyph Press; 2005.
    37. Lopez SJ, Snyder CR, editors. The Oxford Handbook of Positive Psychology. 2 ed. Oxford, United Kingdom: Oxford University Press; Jul 2009:88-102.
    38. Dutta-Bergman MJ. Health attitudes, health cognitions, and health behaviors among internet health information seekers: population-based survey. J Med Internet Res 2004 May 28;6(2):e15 [FREE Full text] [CrossRef] [Medline]
    39. Norman CD, Skinner HA. eHEALS: the eHealth Literacy Scale. J Med Internet Res 2006 Nov 14;8(4):e27 [FREE Full text] [CrossRef] [Medline]
    40. Organisation for Economic Cooperation and Development. Trust and Public Policy: How Better Governance Can Help Rebuild Public Trust. Paris, France: OECD Publishing; Mar 27, 2017.
    41. Osmanlliu E, Rafie E, Bédard S, Paquette J, Gore G, Pomey M. Considerations for the design and implementation of COVID-19 contact tracing apps: scoping review. JMIR mHealth uHealth 2021 Jun 09;9(6):e27102 [FREE Full text] [CrossRef] [Medline]
    42. Patrick K, Hekler EB, Estrin D, Mohr DC, Riper H, Crane D, et al. The pace of technologic change: implications for digital health behavior intervention research. Am J Prev Med 2016 Nov;51(5):816-824. [CrossRef] [Medline]

    ‎
    ANCOVA: analysis of covariance
    CTA: contact tracing app
    H: hypothesis
    mHealth: mobile health

    Edited by A Mavragani; submitted 10.03.22; peer-reviewed by M Roccetti, C Jacob; comments to author 08.05.22; revised version received 29.05.22; accepted 31.05.22; published 28.07.22

    Copyright

    ©Frans Folkvord, Lutz Peschke, Yasemin Gümüş Ağca, Karlijn van Houten, Giacomo Stazi, Francisco Lupiáñez-Villanueva. Originally published in JMIR Formative Research (https://formative.jmir.org), 28.07.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.