Original Paper
Abstract
Background: The successful conduct of health and medical research is largely dependent on participant recruitment. Effective, yet inexpensive methods of increasing response rates for all types of research are required. QR codes are now commonplace, and despite having been extensively used to recruit study participants, a search of the literature failed to reveal any randomized trial investigating the effect of adding a QR code on qualitative research response rates.
Objective: This study aimed to collect data on rates of response, consent, and decline among patients with cancer, and the average time taken to respond following randomization to receive either a QR code or no QR code on the patient consent form for a qualitative research study.
Methods: This was a pilot randomized controlled trial (RCT) embedded within a qualitative research study. In total, 40 eligible patients received a recruitment pack for the qualitative study, which included an information statement, a consent form, and an addressed, stamped envelope to return their consent form. Patients were randomized 1:1 to the control (standard recruitment pack only) or intervention group (standard recruitment pack including modified consent form with a QR code).
Results: In total, 27 out of 40 patients (age: mean 63.0, SD 14.8 years; 45% female) responded to the consent form. A lower proportion of the QR code group (60%) responded (odd ratio [OR] 0.57, 95% CI 0.14-2.37; P=.44), compared to 75% of the standard recruitment group. However, a higher proportion of the QR group (35%) consented (OR 1.84, 95% CI 0.41-8.29; P=.43), compared to the standard recruitment group (20%). A lower proportion of the QR group (25%) declined (OR 0.34, 95% CI 0.09-1.38; P=.13) relative to the standard recruitment group (55%). The mean response time of the QR code group was 16 days (rate ratio [RR] 0.79, 95% CI 0.47-1.35; P=.39) compared to 19 days for the standard recruitment group. None of the age-adjusted analyses were statistically significant.
Conclusions: This underpowered pilot study did not find any evidence that offering an option to respond through a QR code on a patient consent form for a qualitative study increased the overall patient response rate (combined rate of consent and decline). However, there was a nonsignificant trend, indicating that more patients who received the QR code consented compared to those who did not receive the QR code. This study provides useful preliminary data on the potential impact of QR codes on patient response rates to invitations to participate in qualitative research and can be used to inform fully powered RCTs.
Trial Registration: OSF Registries 10.17605/OSF.IO/PJ25X; https://doi.org/10.17605/OSF.IO/PJ25X
doi:10.2196/66681
Keywords
Introduction
The successful conduct of health and medical research depends on effective recruitment strategies. Low recruitment rates affect both quantitative and qualitative research designs [-], and there is a need to identify effective and affordable methods that are minimally burdensome. For example, a 2019 study reported the costs of 14 recruitment strategies among patients with chronic diseases and reported that 20% of the study budget was spent on recruitment []. Given the recent widespread adoption of QR codes [-], they offer potential as a valuable and cost-effective recruitment tool. A number of randomized controlled trials (RCTs) have investigated the use of QR codes to recruit participants for quantitative surveys []. However, the evidence of the effectiveness of QR codes in increasing survey recruitment is equivocal, with earlier studies [,], tending to find no impact of QR codes on response rates, and later studies tending to find a small but significant increases [,]. Authors of these studies note that earlier research should be interpreted with caution, given the widespread use and familiarity with QR codes, which is relatively recent [], and has increased rapidly following the COVID-19 epidemic []. A 2024 large RCT (N=5550) that evaluated the effect of including a QR code in a printed and mailed recruitment to a web-based survey found a small but significant increase in survey participation (+1.31%) []. It also found that including QR codes resulted in higher participation rates from some harder-to-reach groups, including younger people and single people [].
However, there is little research about the effect of QR codes on consent rates to other research forms, such as recruitment to research trials or qualitative research, which often require ongoing or more maintained or intense commitment than a one-off survey. A 2024 study randomized recruitment methods ([Twitter rebrand as] X, Facebook [Meta] or QR code displayed on a poster) to a clinical trial and found little to no engagement with the QR code relative to the other recruitment strategies; however, this may have been due to the format (ie, poster) rather than the technology [].
A literature search failed to identify any study that empirically tests the use of QR codes among people invited to participate in qualitative health research. Given the dearth of studies of this nature, the primary objective of this pilot RCT was to determine whether adding a QR code to a participant consent form for a qualitative research study increased the participant consent rate (ie, the proportion of patients who responded and consented to participate). Secondary objectives were to collect data regarding differences in (1) the proportion of patients who responded (either to consent or decline; this outcome was registered in the Open Science Framework as the proportion of patients who did not respond, but for ease of reporting and understanding, the inverse is reported instead [ie, the proportion who did respond])), (2) the proportion of patients who responded and declined to participate, and (3) the average time (in days) taken to respond measured from the date the recruitment packs were sent.
Methods
Study Design
This was a pilot RCT embedded within a qualitative study with patients with colorectal cancer []. The purpose of the qualitative study was to determine the views of patients with colorectal cancer about a Digital Health Intervention (“RecoverEsupport”) [] to enhance their recovery from surgery. The qualitative study required participants to review a newly developed web-based support program and to provide feedback in a recorded telephone-based interview (approximately 20 minutes) that would be scheduled at a time convenient to them. The interview asked them to provide feedback about the relevance and ease of understanding of the program, as well as the information they could recall and the likely impact of the program.
Participants
Participants were recruited from a Surgical Department at a public hospital in a noncapital metropolitan region of Australia. The Colorectal Cancer Liaison Nurse identified eligible patients from medical records. The eligibility criteria for this pilot RCT were consistent with the eligibility criteria for the qualitative study. Patients were invited to participate in the qualitative study through a recruitment pack containing a printed consent form and a prepaid return envelope (mailed on 1 November 2021). Reminder packs were sent to all nonresponders 3 weeks later (22 November 2021).
For the qualitative study in which the QR code study was embedded, the patient eligibility criteria were as follows: (1) a diagnosis of colorectal cancer, (2) being 18-90 years old, and (3) having undergone a bowel resection for colorectal cancer within the last 6 months (excluding stoma reversals and secondary bowel surgeries).
Allocation
An independent statistician randomly allocated the patients in a 1:1 ratio using a random number function in Microsoft Excel to the intervention or control group (
Figure 1).
Standard Recruitment (Control)
These patients received the standard consent form (without the QR code). The form included 2 tick boxes for patients to indicate their decision to either consent or decline to participate in the qualitative study.
QR Code Group (Intervention)
These patients received an identical consent form to the control group, except this version included a QR code and instructions for accessing the web-based consent form to provide their consent. Scanning the QR code directed the participant to a web-consent-form, identical to the standard consent form, hosted within a REDCap (Research Electronic Data Capture; Vanderbilt University) database. REDCap automatically recorded the date of completion once the patient responded the web-based consent form.
Outcomes
The primary outcome was the proportion of patients who consented to participate in the qualitative study (through any channel, QR code, or mail). Secondary outcomes included (1) the proportion of patients who responded (either to consent or decline), (2) the proportion of patients who responded and declined to participate in the qualitative study, and (3) the average time in days taken to respond (measured from 1 November 2021 until either the postmark date on the return envelope or the date the web-based consent form was completed).
Statistical Analysis
Descriptive statistics are presented as counts (%) for categorical variables or mean (SD) for continuous variables. An intention-to-treat approach was used. Unadjusted and age-adjusted logistic regression models were fitted to estimate the odds ratio (OR) and 95% CIs. The between-group difference for the time taken to respond was analyzed using negative binomial instead of Poisson regression modeling (due to overdispersion) and unadjusted and age-adjusted rate ratios (RRs) are presented. Assumptions for the logistic regression model and negative binomial regression model were checked and found to be reasonable.
Ethical Considerations
The pilot was approved by the Ethics Committees of the Hunter New England Local Health District (2019/ETH00869) and the University of Newcastle (H-2015-0364) and was prospectively registered [] and is reported in accordance with CONSORT (Consolidated Standards of Reporting Trials) guidelines []. Each invited patient received a patient information sheet inviting them to participate in the qualitative research, assuring them that their participation was entirely voluntary and that any information they provided would remain confidential. No incentive was offered for patients to participate. All project staff members were bound by confidentiality agreements. Collected data are stored in a deidentified format.
Results
Overview
Of the 63 patients assessed for eligibility, 23 were ineligible, most commonly because they did not have internet access (7/23 patients). The mean age was 58.60 (SD 17.38) years for the QR code, 67.40 (SD 10.35) years for the standard recruitment, totaling 63 (SD 14.8) years for both groups. In total, 45% (n=18) of the sample was female; 40% (n=8) for the QR code and 50% (n=10) for the standard recruitment groups were female. The outcomes are presented below and in 
Table 1 in sequential order (ie, overall response rate, consent rate, and decline rate).
| QRa code (Intervention) (n=20), (%) | Standard recruitment (Control) (n=20) (%) | Unadjusted effect estimate (95% CI) | P value | Adjusted for age effect estimate (95% CI) | P value | ||||||||
| Responded (overall response rate)a | 12 (60) | 15 (75) | 0.50 (0.13-1.93) | 0.3145 | 0.57 (0.14-2.37) | .44 | |||||||
| Responded and consented (primary outcome)a | 7 (35) | 4 (20) | 2.15 (0.52-9.00) | 0.2930 | 1.84 (0.41-8.29) | .43 | |||||||
| Responded and declined (secondary outcome)a | 5 (25) | 11 (55) | 0.27 (0.07-1.04) | 0.0577 | 0.34 (0.09-1.38) | .13 | |||||||
| Response time in days (Secondary outcome)b | 16.33 (11.12) | 19.27 (12.40) | 0.85 (0.50-1.43) | 0.5361 | 0.79 (0.47-1.35) | .39 | |||||||
bOdds ratio.
cRate ratio.
Overall Response Rate
A total of 27 patients responded to the consent form, either to consent or decline; 12/20 (60%) from the QR code group and 15/20 (75%) from the standard recruitment group. The unadjusted effect estimate was 0.50 (95% CI 0.13 to 1.93, P=.31), indicating that the odds of the intervention group responding were 50% lower compared to the control group. After adjusting for age, the OR was 0.57 (95% CI 0.14 to 2.37, P=.44). Although the results suggest a lower overall response rate in the QR code group relative to the standard recruitment group, neither analysis was significant.
Proportion of Patients Who Responded and Consented (Primary Outcome)
Overall, 11/40 (27.5%) patients consented to participate in the qualitative study. Seven out of 40 consenting patients were from the QR code group (representing 35% of this group), and 4 were from the standard recruitment group (representing 20% of this group). The unadjusted OR was 2.15 (95% CI 0.52-9.00, P=.29), indicating that the odds of patients in the intervention group consenting was 2.15 times the odds among control patients, although this was not statistically significant. After adjusting for age, the OR was 1.84 (95% CI 0.41-8.29). However, neither was significant.
Proportion of Patients Who Responded and Declined to Participate
A total of 16 out of the 40 patients declined to participate in the qualitative study; 5 declining patients were in the QR code group (representing 25% of this group), and 11 were in the standard recruitment group (representing 55% of this group). The unadjusted OR of the QR code group declining to participate was 0.27 (95% CI 0.07-1.04), which was borderline significant (P=.06). The age-adjusted OR was 0.34 (95% CI 0.06-1.87, P=.21) and was not statistically significant.
Average Time (in Days) Taken to Respond
The average response time was 16 days (SD 11) days for the QR code group and 19 (SD 12) days for the standard recruitment group. The unadjusted incident RR for the QR code group compared to the standard recruitment group was 0.85 (95% CI 0.5-1.43, P=.54), indicating that the response time of the QR code group was 15% lower than the response time for the standard recruitment group. After adjusting for age, the RR was 0.79 (95% CI 0.47-1.35), indicating the QR code group response time was 21% lower than the control group. However, neither was statistically significant.
Discussion
Principal Findings
Given the dearth of studies of this nature, the aim of this pilot RCT was to determine the effect on response rates when a QR code was added to a participant consent form for a qualitative research study. Specifically, this pilot investigated the participant response rate, consent rate (primary outcome), rate of decline, as well as the average time taken to respond. Out of 40 patients invited to participate in a qualitative research study were randomized to receive either a standard consent form (control) or a consent form that included a QR code (intervention). The overall response rate (ie, either to consent or decline) was lower in the intervention group relative to the control group, however, the intervention consent rate was higher, the decline rate was lower, and the average time to respond to the invitation to participate was shorter in the intervention group (16 vs 19 days). None of the adjusted estimates of between-group differences were statistically significant. However, our results suggest a trend of patients in the QR code group having higher odds of consenting and lower odds of declining (relative to the control group), but lower odds of responding at all (ie, either to consent or decline). These results should be investigated further in a fully powered RCT.
The overall pattern of results is interesting, despite being nonsignificant. It suggests that the addition of a QR code to a consent form for qualitative research resulted in higher consent rates and lower rates of decline. Both outcomes are desirable for researchers who often spend a large portion of their research budget on recruitment. The shorter response time in the intervention group also suggests that the use of a QR code in recruitment materials could confer benefits to researchers in terms of more timely information about likely recruitment outcomes.
This is the first pilot RCT to investigate the effect of adding a QR code to a consent form within the context of recruitment of patients with cancer to a qualitative study. It is important to consider the rapidly changing context in which QR code research has taken place when comparing these results to the existing literature. Over the past 5 years, responses to the COVID-19 pandemic have made QR code levels of awareness, familiarity, and skill in the community is now much higher. The more recent RCTs testing the addition of QR codes to surveys, showed small but significant increases, of approximately 1-2% in consent rates [,]. The magnitude of the changes observed in the current pilot are much greater (15% increase in consent rates), despite being nonsignificant due to under-powering. This may be due to the targeted nature of the study (ie, people who had previously had colorectal cancer surgery, compared with a general population statewide public health survey) [] and due to differences in the specific nature of what they were being asked to do (ie, review an intervention designed to support patients with colorectal cancer going through surgery and provide feedback in a 1:1 interview, vs complete a web-based public health survey).
The randomized design is a strength; however, a few limitations should be considered when interpreting the findings of this term. Despite the randomization, due to the small sample size, the groups were not evenly distributed in age, which was subsequently adjusted for. The low sample size is another limitation, although it is still within the recommended range for pilot studies []. Therefore, as a next step, a fully powered RCT is recommended. Furthermore, the study did not collect data about whether the participants actually used the QR to respond (only overall response rates) or the characteristics of those users who responded using this channel. This would be valuable information to collect and analyze in future studies to better understand the impact of QR codes on the diversity of recruited participants. Given the context in which this research occurred, it is unclear the extent to which these findings would generalize to the general population, younger people or both groups. Future RCTs should also allow for subgroup analysis to determine the specific effects of QR codes on recruiting different age groups.
Conclusion
Despite the nonsignificance of the findings in this underpowered pilot trial, this research question warrants further investigation. Given their ease of use and inexpensive application, using QR codes on consent forms may hold promise for improving recruitment to qualitative research studies. As recruitment often consumes a large proportion of research budgets, even a small percentage of change could have important benefits for researchers and research programs. QR codes may be a low-risk strategy to complement other attempts to maximize research response rates, although a fully powered RCT is required to confirm this. Further research using larger and more diverse samples is warranted. This pilot study provides important preliminary data on which such studies could be based.
Acknowledgments
The authors acknowledge the patients included in this research, the research assistants of the Health Behavior Research Collaborative (HBRC) and the University of Newcastle (UoN); and Hunter Medical Research Institute (HMRI) staff members who supported this research. The research was supported by NHMRC, UoN, and HMRI grants. The content is solely the responsibility of the authors.
This research was funded as part of a National Health and Medical Research Council Partnership Grant (NHMRC APP1169822). RW is supported by a Heart Foundation postdoctoral fellowship (ID: 102156) and a Cancer Institute NSW Early Career Fellowship (ECF1355).
Data Availability
The datasets generated during this study or analysis of the data are available from the corresponding author on reasonable request and pending ethical approval.
Conflicts of Interest
None declared.
Multimedia Appendix 1
CONSORT (Consolidated Standards of Reporting Trials) extension for pilot and feasibility studies checklist.
PDF File (Adobe PDF File), 91 KBReferences
- Kasenda B, von Elm E, You J, Blümle A, Tomonaga Y, Saccilotto R, et al. Prevalence, characteristics, and publication of discontinued randomized trials. JAMA. Mar 12, 2014;311(10):1045-1051. [FREE Full text] [CrossRef] [Medline]
- Bernardez-Pereira S, Lopes RD, Carrion MJM, Santucci EV, Soares RM, de Oliveira Abreu M, et al. Methodological Evaluation of clinical TriAls Study Group. Prevalence, characteristics, and predictors of early termination of cardiovascular clinical trials due to low recruitment: insights from the ClinicalTrials.gov registry. Am Heart J. Aug 2014;168(2):213-9.e1. [CrossRef] [Medline]
- Spratling R. Recruitment of medically fragile children and adolescents: lessons learned from qualitative research. J Pediatr Health Care. Jan 2013;27(1):62-65. [CrossRef] [Medline]
- Kakumanu S, Manns BJ, Tran S, Saunders-Smith T, Hemmelgarn BR, Tonelli M, et al. Cost analysis and efficacy of recruitment strategies used in a large pragmatic community-based clinical trial targeting low-income seniors: a comparative descriptive analysis. Trials. Oct 07, 2019;20(1):577. [FREE Full text] [CrossRef] [Medline]
- Biddle N, Gray M, Sollis K. The ANU centre for social research and methods. The use of QR codes to identify COVID-19 contacts and the role of data trust and data privacy. Nov 5, 2021. URL: https://tinyurl.com/438cey75 [accessed 2024-12-01]
- Cohney S, Cheong M. COVID Down Under: where did Australia?s pandemic apps go wrong? arXiv:2212.12178. Jun 23, 2023. [FREE Full text] [CrossRef]
- Grekousis G, Liu Y. Digital contact tracing, community uptake, and proximity awareness technology to fight COVID-19: a systematic review. Sustain Cities Soc. Aug 2021;71:102995. [FREE Full text] [CrossRef] [Medline]
- Brodie K, Madden LL, Rosen CA. Applications of quick response (QR) codes in medical education. J Grad Med Educ. 2020;12(2):138-140. [FREE Full text] [CrossRef] [Medline]
- Endres K, Heiden EO, Park K. Surv methods insights field SMIF. The Effect of quick response (QR) codes on response rates and respondent composition: results from a statewide experiment. Aug 05, 2024. URL: https://surveyinsights.org/?p=19389 [accessed 2024-12-01]
- Marlar J. Do Quick Response Codes Enhance or Hinder Surveys? Gallup; Aug 30, 2018. URL: https://news.gallup.com/opinion/methodology/241808/quick-response-codes-enhance-hinder-surveys.aspx [accessed 2024-12-02]
- Lugtig P, Luiten A. Do shorter stated survey length and inclusion of a QR code in an invitation letter lead to better response rates? Surv Methods Insights Field. Feb 12, 2021. URL: https://surveyinsights.org/?p=14216 [accessed 2021-02-12]
- Endres K, Heiden EO, Park K, Losch ME, Harland KK, Abbott A. Experimenting with QR codes and envelope size in push-to-web surveys. J Surv Stat Methodol. Apr 26, 2023;12(4):893-905. [FREE Full text] [CrossRef]
- Gostin I. Forbes Communications Council. How the pandemic saved the QR code from extinction. May 25, 2021. URL: https://tinyurl.com/mka68j87 [accessed 2024-12-02]
- Zucca A, Mansfield E, Sanson-Fisher R, Wyse R, Johnston SA, Fakes K, et al. Perceived provision of perioperative information and care by patients who have undergone surgery for colorectal cancer: a cross-sectional study. Int J Environ Res Public Health. Nov 18, 2022;19(22):15249. [FREE Full text] [CrossRef] [Medline]
- Wyse R, Smith S, Zucca A, Fakes K, Mansfield E, Johnston SA, et al. Effectiveness and cost-effectiveness of a digital health intervention to support patients with colorectal cancer prepare for and recover from surgery: study protocol of the RecoverEsupport randomised controlled trial. BMJ Open. Mar 06, 2023;13(3):e067150. [FREE Full text] [CrossRef] [Medline]
- Wyse R, Zucca A, Norton G, Johnston SA. The Effect on study consent rates of adding a QR code to patient consent forms: a randomised controlled Pilot Study. Sep 23, 2021. URL: https://doi.org/10.17605/OSF.IO/PJ25X [accessed 2021-09-23]
- Schulz KF, Altman DG, Moher D. CONSORT 2010 Statement: Updated guidelines for reporting parallel group randomised trials. J Clin Epidemiol. Aug 2010;63(8):834-840. [FREE Full text] [CrossRef] [Medline]
- Kunselman AR. A brief overview of pilot studies and their sample size justification. Fertil Steril. Jun 2024;121(6):899-901. [CrossRef] [Medline]
Abbreviations
| CONSORT: Consolidated Standards of Reporting Trials |
| OR: odds ratio |
| RCT: randomized controlled trial |
| REDCap: Research Electronic Data Capture |
| RR: rate ratio |
Edited by A Mavragani; submitted 19.09.24; peer-reviewed by F Temidayo, M Tandon; comments to author 08.11.24; revised version received 01.12.24; accepted 09.12.24; published 21.02.25.
Copyright©Rebecca Wyse, Erin Forbes, Grace Norton, Priscilla Viana Da Silva, Kristy Fakes, Sally Ann Johnston, Stephen R Smith, Alison Zucca. Originally published in JMIR Formative Research (https://formative.jmir.org), 21.02.2025.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.