Published on in Vol 5, No 12 (2021): December

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/30578, first published .
A Pragmatic Intervention Using Financial Incentives for Pregnancy Weight Management: Feasibility Randomized Controlled Trial

A Pragmatic Intervention Using Financial Incentives for Pregnancy Weight Management: Feasibility Randomized Controlled Trial

A Pragmatic Intervention Using Financial Incentives for Pregnancy Weight Management: Feasibility Randomized Controlled Trial

Original Paper

1Department of Preventive Medicine, College of Medicine, University of Tennessee Health Science Center, Memphis, TN, United States

2Department of Public Health Science, University of Virginia, Charlottesville, VA, United States

3Just For Women Obstetric Clinic, Memphis, TN, United States

Corresponding Author:

Rebecca Krukowski, PhD

Department of Public Health Science

University of Virginia

PO Box 800765

Charlottesville, VA, 22908-0765

United States

Phone: 1 434 924 1000

Email: bkrukowski@virginia.edu


Background: Excessive gestational weight gain (GWG) is common and can result in maternal and child health complications. Pragmatic behavioral interventions that can be incorporated into standard obstetric care are needed, and financial incentives are a promising approach.

Objective: The aim of this study is to evaluate the feasibility of recruitment, randomization, and retention, as well as treatment engagement and intervention satisfaction, in a behavioral program. The program provided small incentives for meeting behavioral goals of self-weighing and physical activity as well as larger outcome incentives for meeting GWG goals.

Methods: We recruited 40 adult women in their first trimester of pregnancy from February 2019 to September 2019 at an obstetric clinic. Participants were randomized to 3 intervention components using a 2×2×2 factorial design: daily incentives for self-weighing (lottery vs certain loss), incentives for adhering to the Institute of Medicine’s GWG guidelines based on BMI category (monthly vs overall), and incentives for reaching physical activity goals (yes vs no). Participants were asked to complete daily weigh-ins using the Withings Body wireless scale provided by the study, as well as wear a physical activity tracker (Fitbit Flex 2). Feasibility outcomes of recruitment, randomization, and retention, as well as treatment engagement and intervention satisfaction, were assessed. Weight assessments were conducted at baseline, 32-week gestation, and 36-week gestation.

Results: Participants were enrolled at, on average, 9.6 (SD 1.8) weeks’ gestation. Of the 39 participants who were oriented to their condition and received the intervention, 24 (62%) were Black or African American, 30 (77%) were not married, and 29 (74%) had an annual household income of less than US $50,000. Of the 39 participants, 35 (90%) completed the follow-up data collection visit. Participants were generally quite positive about the intervention components, with a particular emphasis on the helpfulness of, and the enjoyment of using, the e-scale in both the quantitative and qualitative feedback. Participants who received the loss incentive, on average, had 2.86 times as many days of self-weighing as those who received the lottery incentive. Participants had a relatively low level of activity, with no difference between those who received a physical activity incentive and those who did not.

Conclusions: A financial incentive–based pragmatic intervention was feasible and acceptable for pregnant women for promoting self-weighing, physical activity, and healthy GWG. Participants were successfully recruited early in their first trimester of pregnancy and retained for follow-up data collection in the third trimester. Participants demonstrated promising engagement in self-weighing, particularly with loss-based incentives, and reported finding the self-weighing especially helpful. This study supports further investigation of pragmatic, clinic-based financial incentive–based interventions for healthy GWG behaviors.

Trial Registration: ClinicalTrials.gov NCT03834194; https://clinicaltrials.gov/ct2/show/NCT03834194

JMIR Form Res 2021;5(12):e30578

doi:10.2196/30578

Keywords



Background

Excessive gestational weight gain (GWG) increases risk for high-cost obstetric conditions such as labor complications and gestational diabetes mellitus for mothers in the short term [1-4]. Excessive GWG also has long-term risks for maternal weight retention [5-7] and childhood obesity [7-9]. For these reasons, GWG is a serious public health concern, particularly because 38% of the women with normal weight, 62% of the women with overweight, and 56% of the women with obesity exceed the GWG guidelines of the Institute of Medicine (IOM) [10]. Pragmatic behavioral interventions that can be incorporated into standard obstetric care are needed.

Financial incentives have been used alone or in combination with other interventions to improve a variety of health outcomes [11-14], including in weight management [15-19]. In addition, incentives are an effective strategy to facilitate smoking cessation among pregnant women [20,21], and incentives may be more attractive for the circumscribed pregnancy period rather than, for example, weight maintenance, which has a much longer time horizon. Surprisingly, however, only 1 study has examined the effect of financial incentives on meeting GWG recommendations; this study found that providing incentives did not increase adherence to GWG outcomes [22]. However, experts have recommended using incentives to encourage health behaviors rather than outcomes [23].

Behaviors that negatively affect health often involve immediate benefits and delayed costs. For example, eating for two provides immediate gratification but may lead to excessive GWG [24]. In contrast, behaviors associated with successful weight management (such as daily self-weighing [25-29], weight goals [30], and exercise goals [25,30-33]) often involve immediate time costs with delayed and uncertain health benefits [24]. Thus, incentivizing more immediate GWG-related behaviors may be better than just incentivizing longer-term outcomes.

Types of Incentives

Incentives, however, can vary widely in their certainty, format, and frequency of distribution [15]. It is generally thought that incentives are more likely to be effective when they are framed as avoiding losses rather than making gains [34] and when rewards are provided immediately [35]. Others have also recommended using small but frequent incentives because these incentives are more visible than large but infrequent payouts [24,36]. A recent study found support for the loss aversion framework in increasing step goal achievement; a greater proportion of participants achieved the daily step goal when it was framed as a loss compared with when the incentive was framed as a gain or a lottery [37]. Another study found that participants who received a lottery-based incentive for reaching a weight loss goal had greater success than the control group [18]. Recent research has also found enhanced engagement and greater weight loss among individuals who received both behavior- and outcome-focused incentives compared with those who did not receive incentives [16,38]. Thus, it will be important to determine what types of incentives are most promising for encouraging GWG-related behaviors and outcomes.

Consistent with previous research and based on self-regulation theory principles [39], this study examines the impact of small incentives for meeting behavioral goals of self-weighing and physical activity as well as larger outcome incentives for meeting GWG goals. The aim of this pilot study is to evaluate the feasibility of recruitment, randomization, and retention, as well as treatment engagement and intervention satisfaction.


Study Design

This pilot study recruited participants from February 2019 to September 2019 from an obstetric clinic with 1 physician in Memphis, Tennessee. Participants were randomized to 3 intervention components using a 2×2×2 factorial design: (1) daily incentives for self-weighing on a wireless scale (lottery vs certain loss), (2) incentives for adhering to the IOM’s GWG guidelines based on BMI category (monthly vs overall), and (3) incentives for reaching physical activity goals (yes vs no). The intervention lasted approximately 6 months, depending on participants’ gestational age at baseline. Assessments were conducted at baseline, 32-week gestation, and 36-week gestation (if the participant had not yet delivered). Participants were asked to complete daily weigh-ins using the Withings Body wireless scale provided by the study, as well as wear a physical activity tracker (Fitbit Flex 2; Google LLC). Incentives (US $30 for each follow-up visit) were used to facilitate high retention at both follow-up data collection visits, which took place at the obstetric clinic. This study was registered with ClinicalTrials.gov (NCT03834194) and approved by the institutional review board of the University of Tennessee Health Science Center.

Sample

Potential participants were identified by the clinic’s nurses and obstetrician at their pregnancy confirmation visit or self-identified through recruitment materials posted at the obstetric clinic (including in the examination rooms and waiting room; Multimedia Appendix 1). They were encouraged to meet with the study team in the obstetric office if they wished to learn more about the study and potentially enroll in the study. Interested individuals were evaluated for the eligibility criteria, and electronic informed consent was obtained. The obstetric clinic has approximately 16 pregnancy confirmation visits per month.

To be eligible, individuals needed to be aged at least 18 years and no more than 13 weeks’, 0 days’ gestation upon recruitment (based on the date of their last menstrual period and then confirmed by their physician at their first prenatal visit) because GWG-focused interventions that begin in the first trimester are more effective [40]. Individuals also needed to verify that they were having a singleton pregnancy by ultrasonography because of the different GWG guidelines for women with multiple gestation [7], and participants were enrolled only if the physician believed that the intervention would be safe for them. Additional eligibility criteria included (1) having a BMI of ≥18.5 kg/m2 (because of the infrequency of women with underweight) and (2) having access to wireless internet or a Bluetooth-connected device to facilitate data collection for participants’ self-weighing behavior and physical activity.

Enrollment

A total of 40 participants provided informed consent and were enrolled on the web using the Way to Health web platform developed by the University of Pennsylvania, which integrated enrollment, randomization, surveys, automated delivery of study email messages, and transfer of data from the study’s wireless devices [41]. All participants received a Fitbit Flex 2 and a Withings Body scale at enrollment to track their physical activity and weight over time. Before randomization, research staff members oriented the participants to the devices (including providing handouts to review if questions arose later). The staff members then assisted participants with setting up Fitbit and Withings accounts, downloading the apps to their smartphones, pairing the devices with Bluetooth, and authorizing the transfer of data to the Way to Health platform. Participants were instructed to open the apps each day to transmit their data to the Way to Health platform.

Randomization

After enrollment, participants were randomized into 1 of 8 conditions (Table 1), that represented all combinations of the 3 different components. Participants received an intervention orientation message and handout that detailed the components to which they were randomized, the recommendation to weigh daily, and a GWG recommendation tailored to BMI category (with overall or monthly goals). They also received a handout that provided strategies for achieving healthy GWG (Multimedia Appendix 2).

Table 1. Randomized conditions (N=40).
ConditionSelf-weighingWeight goalPhysical activity goalParticipants, n (%)
1LotteryMonthlyNo5 (13)
2LotteryOverallYes5 (13)
3LotteryOverallNo5 (13)
4LotteryMonthlyYes5 (13)
5LossMonthlyNo5 (13)
6LossOverallYes5 (13)
7LossOverallNo5 (13)
8LossMonthlyYes5 (13)

Procedures

Self-weighing Lottery-Based Incentive

Participants randomized to a condition with the self-weighing lottery-based incentive (conditions 1, 2, 3, and 4) were asked to pick a lucky number from 0 to 99 at randomization. They were informed that there would be a daily lottery for which they would be eligible if they weighed themselves on the previous day on the scale provided by the study team. Then, for each day of their pregnancy, participants were informed of the study’s randomly generated winning lottery number. Participants who weighed themselves on the previous day and who had a 1- or 2-digit match between their lucky number and the number that was drawn were notified of their reward, consistent with previous research [42]. A 2-digit match (1 in 100 chance) yielded a US $15 incentive and a single-digit match (1 in 5 chance) yielded a US $2 incentive in the form of an Amazon gift card. Participants who did not weigh themselves the previous day were informed that they could have won incentives, consistent with loss aversion principles [43] (see Multimedia Appendix 3 for sample email messages). Participants also received automated email messages when they did not transmit data, reminding them to self-weigh and sync their devices. The daily winnings were accumulated for the week starting Monday and were disbursed the following Monday. The maximum payout for this component was US $112 in total.

Self-weighing Loss-Based Incentive

Participants randomized to a condition with the self-weighing loss-based component (conditions 5, 6, 7, and 8) had a weekly balance of US $3.50 at the beginning of each week in their account. Then, for each day that they did not weigh, US $0.50 was subtracted from this account. Participants who did not weigh themselves the previous day were informed that they had lost US $0.50, consistent with loss aversion principles [43] (see Multimedia Appendix 3 for sample email messages). The daily winnings were accumulated for the week starting Monday and were disbursed the following Monday. The maximum payout for this component was US $112 total.

Monthly GWG Goal Incentive

Participants randomized to a condition with the monthly GWG goal component (conditions 1, 4, 5, and 8) received US $14 per month if their monthly GWG was within the recommended monthly range for their BMI category (Table 2), which they had received in a handout at randomization. Participants received a monthly email regarding whether their GWG was within the recommended range or not and, thus, whether they received the monthly GWG incentive (see Multimedia Appendix 3 for sample email messages).

The monthly GWG goals were constructed based on the IOM’s recommended range of total GWG tailored to BMI category, the minimum recommended GWG in the first trimester for all BMI categories (1.1 lb), and the range of recommended weekly GWG in the second and third trimesters by BMI category [7]. Participants were eligible for the incentive starting from the first full month of pregnancy after the start of their participation. To receive the incentive, the participant needed to self-weigh on the study-provided scale on at least 1 day in the last week of the gestational month as well as have at least one weight in the previous month to calculate GWG within the month.

Table 2. Monthly weight gain goals by weight statusa.

Monthly weight gain goals (lb)

Normal weightOverweightObese
First trimester

Weeks 5-8<2.2<2.2<2.2

Weeks 9-12<2.2<2.2<2.2
Second trimester

Weeks 13-162.8-51.4-3.60.8-2.8

Weeks 17-202.8-51.4-3.60.8-2.8

Weeks 21-242.8-51.4-3.60.8-2.8
Third trimester

Weeks 25-282.8-51.4-3.60.8-2.8

Weeks 29-322.8-51.4-3.60.8-2.8

Weeks 33-362.8-51.4-3.60.8-2.8

aThere was no lower bound for the first trimester weight goal so as to not penalize pregnant women who have trouble gaining weight because of nausea.

Overall GWG Goal Incentive

Participants randomized to a condition with the overall GWG goal component (conditions 2, 3, 6, and 7) were provided the IOM’s overall GWG recommendation based on their BMI at randomization (Table 3). The overall GWG goals were constructed based on the IOM’s recommended range of total GWG and the mean of recommended weekly GWG in the second and third trimesters. These values were adjusted for 8 weeks (for data collection at 32 weeks) and 4 weeks (for data collection at 36 weeks) from a full-term pregnancy at 40 weeks. If the participant met the goal, she received the overall GWG incentive after the 36-week visit, unless she delivered before this visit (in which case she received the incentive based on her 32-week visit weight upon notification that she had given birth).

Table 3. Overall weight gain goals by weight status (adjusted goals based on data collection at 32 weeks’ and 36 weeks’ gestation).
Gestational weeksOverall weight gain goals (lb)

Normal weightOverweightObese
3217-2710.2-20.27-16
3621-3112.6-22.69-18
Weekly Physical Activity Goal Incentive

Participants randomized to an arm with the physical activity incentive component (conditions 2, 4, 6, and 8) were encouraged to achieve a goal of 150 minutes of physical activity per week based on the guideline from the American College of Obstetricians and Gynecologists [44]. Participants received US $3.50 if they met the activity goal each week. Fairly active minutes and very active minutes based on the Fitbit activity tracker programming counted toward the 150-minute goal [45]. Participants who did not meet the activity goal were notified that they would have received US $3.50 had they met their activity goal (see Multimedia Appendix 3 for sample email messages). The maximum payout for this component was US $105 (US $3.50 per week for a participant who joined the study at 6 weeks’ gestation).

Measures

Sociodemographic Characteristics

At baseline, participants reported their age, race, ethnicity (Hispanic or non-Hispanic), marital status, educational background, employment status, income, and the number of children in their household.

Participant Recruitment

Recruitment yields were calculated based on the number of participants who indicated interest in the study and the number of participants who were randomized.

Perceptions About the Effectiveness of the Incentive Conditions

The baseline assessments included participants’ perceptions about which of the incentive types would be more effective (daily self-weighing: lottery vs loss-based; weight gain goals: monthly vs overall).

Intervention Satisfaction

At the 32-week follow-up assessment, participants were asked about their satisfaction with the intervention. Specifically, they were asked to indicate how satisfied they were with each component of the intervention on a 5-point scale from 1 (not at all) to 5 (extremely), including an option to indicate not applicable if they had not received the component. They were asked to separately rate the helpfulness and enjoyment aspect of the emails, electronic scales, and Fitbit activity trackers. They were also asked to separately rate the usefulness and enjoyment aspect of the lottery incentive, loss incentive, the monthly weight gain goal, overall weight gain goal, and the weekly physical activity goal. In addition, they were asked to rate how likely it was that they would recommend using an electronic scale, a fitness tracker, setting a goal for GWG, and setting a goal for physical activity for managing GWG to a friend. Finally, at the end of the structured questionnaire, participants were asked to respond to 3 open-ended questions regarding the recommendations they would make for changes to the program, aspects of the program that were most helpful, and anything else that they wanted to share that they thought might help improve pregnancy weight management programs in the future.

Intervention Engagement

Participants’ daily self-weighing behavior (coded each day as present or absent) and weekly physical activity (measured in active minutes) were monitored electronically because they were measures of treatment engagement.

Retention

Program retention was observed from the number of participants who consented to participate and then completed the follow-up data collection visits at 32 weeks’ and 36 weeks’ gestation. Participants were alerted that they would be withdrawn from the study if they exhibited extreme physical activity or restricted weight gain as potential symptoms of an eating disorder. Although the physician was alerted several times to instances of weight loss, no participant was recommended to be withdrawn for this reason.

GWG Measurement Visits

The secondary outcomes included GWG from baseline to the final data collection point before delivery (32 weeks’ and 36 weeks’ gestation). At all measurement visits, participants’ weights were recorded in kilograms on a calibrated research-grade scale in duplicate, with the participants wearing light clothing and no shoes. In addition to the measured weight at baseline, participants also reported their preconception weight. Participants’ GWG goals were calculated based on self-reported preconception BMI. There is strong concordance between self-reported preconception weight and measured pregravid weight [46]. The weight at week 36 was the default outcome, except for participants who delivered earlier than 36 weeks, in which case their weight at week 32 was used. This approach is an attempt to have a final observation of GWG for all participants, regardless of whether they delivered earlier than 36 weeks.

Power Estimates

This is a feasibility study, the primary purpose of which is to gather data that would evaluate the feasibility of recruitment, randomization, and retention, as well as treatment engagement and intervention satisfaction [47]. An additional aim of this study is to pilot the intervention components, consistent with the preparatory stage of the multiphase optimization strategy framework [48]. The trial was not powered to detect a significant difference among the conditions on treatment engagement or GWG.

Statistical Analysis

We described characteristics of the sample using counts and percentages for categorical data and means and SDs for continuous data. We used generalized linear models with log link function and variance function proportional to the mean for analyzing the 2×2×2 factorial design for 2 outcomes: days of self-weighing and mean of each participant’s weekly physical activity minutes. The model included main effects for the 3 intervention components (self-weighing, weight goal, and physical activity goal) and all 2- and 3-factor interactions for constructing 8 conditions in the 2×2×2 factorial analysis. Because of the small sample size and our primary interest in the main effects, the analysis focused on reporting the main effects. The reference levels were loss incentive for self-weighing, overall GWG goal, and no physical activity goal. Participants’ GWG values according to the guidelines as an ordinal variable (below, within, and exceeded) were not included in this analysis because of the small sample size. We conducted 2-tailed t tests to test the null hypothesis of no difference in the incentive amounts received by component and overall. Minutes of physical activity were calculated based on days for which data were transmitted. All analyses were implemented using R (version 4.0.2; The R Foundation for Statistical Computing).


Recruitment and Retention

A total of 41 participants indicated interest in the study over the 6-month recruitment period and completed the informed consent procedure, but 1 (2%) participant refused to participate after completing the informed consent process. In all, 40 participants were randomized; however, 1 (3%) participant was immediately withdrawn because of a staff member’s error in assessing this participant’s age eligibility (she was aged <18 years). This participant was not oriented to her condition and did not receive any intervention. Of the 39 participants who were oriented to their condition and received the intervention, 35 (90%) completed the follow-up data collection visit at 32 weeks’ and 36 weeks’ gestation; 1 (3%) participant delivered before the 36-week visit, and her 32-week weight was used. Among the 4 participants who did not complete the follow-up data collection visit, 1 (25%) relocated, 1 (25%) miscarried, 1 (25%) delivered her baby before the 32-week visit, and we were unable to contact 1 (25%) participant.

As can be seen in Table 4, the participants predominantly identified as Black or African American (24/39, 62%) and non-Hispanic (36/39, 92%). Among the 39 participants, for 12 (34%), this was their first pregnancy. Of the 39 participants, 30 (77%) were not married, 27 (70%) had at least some college education, 29 (74%) were employed, and 29 (74%) had an annual household income of less than US $50,000. With regard to managing GWG, of the 39 participants, 32 (82%) believed that the lottery-based daily self-weighing incentive would work better to help them and 31 (80%) believed that the monthly GWG goals would work better to help them. The participants were successfully recruited in the first trimester (mean gestational weeks at enrollment 9.6, SD 1.8), and they participated in the program for between 24 and 30 weeks.

Table 4. Sample characteristics (N=39).

Values
Age at enrollment, mean (SD)29.1 (12.5)
Gestational weeks at enrollment, mean (SD)9.6 (1.8)
Number of children in household, mean (SD)1.1 (0.9)
Prepregnancy BMI categories, n (%)

Normal weight (BMI 18.5-24.9 kg/m2)17 (44)

Overweight (BMI 25-29.9 kg/m2)13 (33)

Obese (BMI ≥30 kg/m2)9 (23)
Hispanic ethnicity, n (%)3 (8)
Race, n (%)

White10 (26)

Black or African American24 (62)

Unknown or multiple races5 (13)
Marital status, n (%)

Married9 (23)

Never married18 (46)

A member of an unmarried couple12 (31)
Education attainment, n (%)

Some high school2 (5)

High school graduate or GEDa10 (26)

Some college or technical school20 (51)

College, 4 years or more (college graduate)7 (18)
Employment status, n (%)

Employed for wages29 (74)

Self-employed2 (5)

Out of work2 (5)

Does not work outside the home1 (3)

Student4 (10)

Missing1 (3)
Annual household income (US $) n (%)

≤24,99918 (46)

25,000-49,99911 (28)

50,000-74,9994 (10)

≥75,0005 (13)

Missing1 (3)
Which type of incentive do you think would work better for you to manage gestational weight gain?, n (%)

Daily self-weighing


Lottery32 (82)


Loss7 (18)

Weight gain goals


Monthly weight gain goal31 (80)


Overall weight gain goal8 (20)

aGED: General Educational Development.

Intervention Satisfaction

Participants were generally quite positive about the intervention components (Table 5), with a mean score for each component of ≥3.8. Consistently, the mean score for the helpfulness and enjoyment aspect of the electronic scale was slightly higher than that for the other components; this positive view of self-weighing and weight tracking throughout pregnancy was also noted by 80% (28/35) of the participants in qualitative feedback regarding the aspects of the program that were most helpful to them. A participant stated, “Most helpful was having to weigh every day, it kept me in tune with where I was and what I needed to do differently.” In addition, in the qualitative responses, several participants indicated that it would have been helpful to have the option to receive SMS text messages rather than emails. A few participants also reported technical challenges, particularly with the e-scale. A participant noted, “I believe this is a great program for those who were already active prior to pregnancy,” perhaps reflecting the relatively low-intensity behavioral intervention for physical activity. Finally, participants indicated that additional features that might be helpful for this program would be dietary tracking and group meetings for peer support.

Table 5. Summary of intervention satisfaction (N=35).

Values, mean (SD)
Helpfulness for managingGWGa (1=not at all helpful; 5=extremely helpful)

Emails4.4 (0.9)

Electronic scale4.5 (0.9)

Fitbit4.2 (1.0)
Usefulness for managingGWG(1=not at all useful; 5=extremely useful)

Lottery-based self-weighing incentive3.9 (1.1)

Loss-based self-weighing incentive3.9 (1.0)

Monthly weight gain goal4.1 (0.9)

Overall weight gain goal4.0 (0.9)

Weekly physical activity incentive3.8 (1.1)
How much did you enjoy the following? (1=not at all enjoyable; 5=extremely enjoyable) 

Using electronic scale4.6 (0.7)

Using Fitbit4.0 (1.2)

Frequency of receiving incentives4.2 (0.8)

Frequency of receiving emails4.1 (1.2)
How much did you enjoy receiving...incentives? (1=not at all enjoyable; 5=extremely enjoyable)

Lottery-based self-weighing incentive4.3 (1.1)

Loss-based self-weighing incentive4.3 (1.1)

Monthly weight gain goal4.3 (1.0)

Overall weight gain goal4.2 (1.1)

Weekly physical activity incentive4.1 (1.2)
Would you recommend...for managingGWGto a friend? (1=not at all likely; 5=extremely likely)

Using an electronic scale4.7 (0.7)

Using a fitness tracker4.5 (0.9)

Setting a goal for weight gain4.6 (0.6)

Setting a goal for physical activity4.6 (0.7)

aGWG: gestational weight gain.

Intervention Adherence

The mean number of days that participants self-weighed on the study scale was 44.5 (SD 57.5) days.

Participants who were randomized to receive the loss incentive had a mean of 68.0 (SD 71.4) days of self-weighing compared with 19.8 (SD 18.8) days among those participants who were randomized to the lottery incentive. There was a significant main effect such that the mean difference in log means (or the log of the ratio of the means) was –1.05. The ratio of the means was 1/exp(1.05) = 1/2.86 = 0.35 (Table 6). In other words, participants who received the loss incentive, on average, had 2.86 times as many days of self-weighing as those who received the lottery incentive, or inversely the mean frequency of self-weighing with the lottery incentive was 0.35 times the loss incentive. Consistent with this greater adherence to self-weighing among those who received the loss incentive, participants in the loss incentive condition earned, on average, US $59.58, in self-weighing incentives in comparison with US $25.66 earned by those in the lottery incentive condition, although the amount that they could have earned in each condition was the same (US $112).

Table 6. Factorial main effects for all outcomes (N=39).
2×2×2 intervention componentsDays of self-weighingMean of participants’ weekly PAa

Mean ratio (95% CI)Estimate (SE)bMean ratio (95% CI)Estimate (SE)
Self-weighing (reference=loss), lottery0.35 (0.15-0.80)–1.05c (0.40)5.38 (0.34-85.92)1.68 (1.36)
Gestational weight gain goal (reference=overall), monthly0.69 (0.30-1.58)–0.36 (0.40)0.24 (0.015-3.80)–1.43 (1.36)
PA goal (reference=no incentives), incentives1.26 (0.55-2.88)0.23 (0.40)0.79 (0.05-12.56)–0.24 (1.36)

aPA: physical activity.

bEstimates and SEs are on the logarithmic scale; the mean ratio is obtained by exponentiating the main effect estimate.

cP<.01.

Participants, on average, had a relatively low level of activity, with a mean number of active minutes of 8.7 (SD 18.5) per week. Participants who were randomized to receive the physical activity incentive had a mean of 5.4 active minutes per week compared with 12.0 active minutes per week among those participants who were not randomized to receive physical activity incentives. However, there was no significant main effect. Of the 39 participants, 2 (5%) achieved the physical activity goal, and they received the US $3.50 incentive in just 1 week each.

Among the 35 participants who completed the follow-up data collection, 7 (20%) had weight gain below the GWG guidelines, 13 (37%) were within the guidelines, and 15 (43%) exceeded the guidelines. A similar proportion of individuals exceeded the guidelines, regardless of whether they were randomized to receive GWG incentives monthly (8/35, 44%) or overall (7/35, 41%). Of the 19 participants who were randomized to the monthly GWG incentive component, 8 (42%) received at least one monthly US $14 incentive (with a range of 1-5 monthly incentives received).

Participants earned, on average, US $43.05 (range US $0 to US $211) in total. Not surprisingly, participants who were within the guidelines earned more on average (US $91.27) compared with those who were below the guidelines (US $16.50) and those who exceeded the guidelines (US $19.87).


Principal Findings

We demonstrated the feasibility of conducting a randomized controlled trial with a 2×2×2 factorial design at an obstetric clinic that provided financial incentives for self-weighing, physical activity, and GWG within the IOM guidelines. We successfully recruited participants early in their first trimester of pregnancy and retained 90% (35/39) of these participants for follow-up data collection in the third trimester. We were also successful in randomizing participants to this complex randomization scheme and providing the assigned intervention components. In addition, the intervention was well-received, with high satisfaction ratings from the participants for all the components and a particular focus on the helpfulness of self-weighing and weight tracking. The participants engaged in self-weighing approximately 7 days per month, in contrast to previous research indicating that regular self-weighing is uncommon among pregnant women without intervention [49]. However, there was low engagement in physical activity among these participants, regardless of whether they received an incentive for reaching the 150-minute physical activity goal.

On the basis of the projected clinic flow of 16 pregnancy confirmation appointments per month, we were successful in recruiting more than one-third of the patients per month, with more than 6 participants recruited to the study per month. Notably, all but 2 participants who indicated initial interest were eligible and interested in being randomized. In addition, retention was very good, with only 10% (4/39) of the participants not participating in follow-up data collection (including a participant who had a miscarriage and a participant who gave birth before the 32-week visit).

Contrary to previous literature that has reported that participants prefer incentive schemes other than lotteries [50-52], the participants in this study indicated that they believed that the lottery-based incentive for self-weighing would be more helpful for them in managing GWG than the loss-based incentive. Surprisingly, contrary to their stated preference, participants who were randomized to receive the loss-based incentive had significantly greater self-weighing engagement compared with those randomized to the lottery-based incentive. This finding is consistent with a recent study, which found that loss-based incentives were more effective in increasing step goal attainment than a lottery-based incentive [37].

Although regular physical activity is recommended for a healthy pregnancy [44], most women in general are physically inactive, particularly during pregnancy [53]. Consistent with these previous findings, we found that women in our sample had a very low level of physical activity overall. The physical activity incentives seemed to do little to increase physical activity. On the basis of a recent meta-analysis [54], more intensive intervention such as supervised exercise may be necessary for increasing physical activity during pregnancy.

This study is the first to offer both process incentives (for behaviors) and outcome incentives (for achieving monthly or overall GWG), within the context of gestational weight management. However, there were no clear trends in this study as to whether an incentive for achieving a monthly or an overall GWG goal was associated with gaining weight within the IOM guidelines. A similar proportion of participants in this sample (13/36, 37%) gained weight within the guidelines compared with the national prevalence (32.1%) [10]. Although this study was not powered to detect differences in GWG recommendation adherence, this finding is consistent with previous research indicating that incentives did not increase adherence to GWG recommendations [22]. Should the lack of impact of financial incentives on GWG outcomes be confirmed in future fully powered research, it may be that financial incentives are more powerful at encouraging behaviors associated with GWG than GWG outcomes themselves. In that case, it would then be essential to determine whether the costs to achieve certain behaviors in pregnancy (such as self-weighing) are beneficial independently. For example, it is possible that incentives for self-weighing may not lead to optimal GWG (as a categorical variable), but incentives for self-weighing may reduce the mean amount of GWG [55] and thus reduce the likelihood of negative maternal health outcomes.

This study includes several notable strengths and weaknesses. First, the recruited sample was quite diverse in race, income level, and BMI category and, thus, included many individuals who often are not included in research [56,57]. However, this study had a small sample to determine feasibility and recruited from only 1 obstetric clinic; thus, future fully powered research is necessary. In addition, the incentive strategies and amounts used in this study were only a few of the many possible approaches, and it is possible that there are more effective alternatives that should be tested. A further limitation is that the data reported here and the incentives provided are based on the data received by the research team and not necessarily all of the data sent by the participants. This is an important distinction because 5% (2/39) of the participants reported having technical problems in the program evaluation. It is also possible that the low levels of physical activity were due to undetected difficulties in transmitting physical activity data. In addition, although we did not report all the costs of the intervention, the unreported costs (including the costs of the scale and the Fitbit activity tracker) were the same for all participants.

This feasibility study provides valuable information for future research, including the expected rate of clinic-based recruitment per physician for a low-intensity intervention, the high rate of retention with convenient clinic-based data collection, and expected adherence and costs for a financial incentive–based intervention. In future research, given our few unresolved technical difficulties, it may be important to set up a telephone visit after a few days to ensure that participants are able to use the technology in their home environment and test using multiple modalities (SMS text messages, telephone, and email) for investigating potential technical problems. The findings from this study also indicate enthusiasm for self-weighing among pregnant women as a strategy for gestational weight management, which may be important in designing future studies. These results also may indicate that preferences for an intervention strategy may not translate into the more effective strategy, which has also been demonstrated in other research [58]. Our findings indicate that although the loss-based incentives may not be perceived as more effective at baseline, they are a promising strategy for increasing self-weighing behaviors. Finally, this feasibility study suggests that more intense intervention strategies (such as meal replacements, motivational interviewing or problem-solving sessions, calorie goals, and dietary self-monitoring with feedback from an interventionist) may be necessary for increasing moderate physical activity among pregnant women and adherence to the GWG guidelines [59,60]. For example, future research in this area could be a factorial experiment that examines the combination of outcome and behavioral incentives with more intense intervention strategies.

Conclusions

This pilot randomized controlled trial indicates that a financial incentive–based pragmatic intervention is feasible and acceptable for pregnant women for promoting self-weighing, physical activity, and healthy GWG. Participants were successfully recruited early in their first trimester of pregnancy and retained for follow-up data collection in the third trimester. Participants demonstrated promising engagement in self-weighing, particularly with loss-based incentives, and reported finding the self-weighing especially helpful. This study supports further investigation of pragmatic, clinic-based interventions for healthy GWG.

Acknowledgments

The research reported here was supported by the Jane Nuckolls Grant to Fight Hunger Fund.

Conflicts of Interest

None declared.

Multimedia Appendix 1

Recruitment brochure.

PDF File (Adobe PDF File), 4128 KB

Multimedia Appendix 2

Study handout: strategies for achieving healthy gestational weight gain.

PDF File (Adobe PDF File), 40 KB

Multimedia Appendix 3

Example email messages for each intervention condition.

DOCX File , 14 KB

Multimedia Appendix 4

CONSORT-eHEALTH checklist (V 1.6.1).

PDF File (Adobe PDF File), 1224 KB

  1. Macdonald-Wallis C, Tilling K, Fraser A, Nelson SM, Lawlor DA. Gestational weight gain as a risk factor for hypertensive disorders of pregnancy. Am J Obstet Gynecol 2013 Oct;209(4):327.e1-327.17 [FREE Full text] [CrossRef] [Medline]
  2. Brunner S, Stecher L, Ziebarth S, Nehring I, Rifas-Shiman SL, Sommer C, et al. Excessive gestational weight gain prior to glucose screening and the risk of gestational diabetes: a meta-analysis. Diabetologia 2015 Oct;58(10):2229-2237. [CrossRef] [Medline]
  3. Thorsdottir I, Torfadottir JE, Birgisdottir BE, Geirsson RT. Weight gain in women of normal weight before pregnancy: complications in pregnancy or delivery and birth outcome. Obstet Gynecol 2002 May;99(5 Pt 1):799-806. [CrossRef] [Medline]
  4. Stotland NE, Cheng YW, Hopkins LM, Caughey AB. Gestational weight gain and adverse neonatal outcome among term infants. Obstet Gynecol 2006 Sep;108(3 Pt 1):635-643. [CrossRef] [Medline]
  5. Phelan S. Pregnancy: a "teachable moment" for weight control and obesity prevention. Am J Obstet Gynecol 2010 Feb;202(2):135.e1-135.e8 [FREE Full text] [CrossRef] [Medline]
  6. Mamun A, Kinarivala M, O'Callaghan MJ, Williams GM, Najman JM, Callaway LK. Associations of excess weight gain during pregnancy with long-term maternal overweight and obesity: evidence from 21 y postpartum follow-up. Am J Clin Nutr 2010 May;91(5):1336-1341. [CrossRef] [Medline]
  7. Weight Gain During Pregnancy: Reexamining the Guidelines. Washington: National Academies Press; 2009.
  8. Hu Z, Tylavsky FA, Han JC, Kocak M, Fowke JH, Davis RL, et al. Maternal metabolic factors during pregnancy predict early childhood growth trajectories and obesity risk: the CANDLE Study. Int J Obes (Lond) 2019 Oct;43(10):1914-1922 [FREE Full text] [CrossRef] [Medline]
  9. Liao X, Yu Y, Marc I, Dubois L, Abdelouahab N, Bouchard L, et al. Prenatal determinants of childhood obesity: a review of risk factors. Can J Physiol Pharmacol 2019 Mar;97(3):147-154. [CrossRef] [Medline]
  10. Deputy NP, Sharma AJ, Kim SY. Gestational Weight Gain - United States, 2012 and 2013. MMWR Morb Mortal Wkly Rep 2015 Nov 06;64(43):1215-1220 [FREE Full text] [CrossRef] [Medline]
  11. Higgins ST, Budney AJ, Bickel WK, Foerg FE, Donham R, Badger GJ. Incentives improve outcome in outpatient behavioral treatment of cocaine dependence. Arch Gen Psychiatry 1994 Jul;51(7):568-576. [CrossRef] [Medline]
  12. Pope L, Harvey-Berino J. Burn and earn: a randomized controlled trial incentivizing exercise during fall semester for college first-year students. Prev Med 2013 Mar;56(3-4):197-201. [CrossRef] [Medline]
  13. Mitchell MS, Goodman JM, Alter DA, John LK, Oh PI, Pakosh MT, et al. Financial incentives for exercise adherence in adults: systematic review and meta-analysis. Am J Prev Med 2013 Nov;45(5):658-667. [CrossRef] [Medline]
  14. Strohacker K, Galarraga O, Williams DM. The impact of incentives on exercise behavior: a systematic review of randomized controlled trials. Ann Behav Med 2014 Aug;48(1):92-99 [FREE Full text] [CrossRef] [Medline]
  15. Jeffery RW. Financial incentives and weight control. Prev Med 2012 Nov;55 Suppl:S61-S67 [FREE Full text] [CrossRef] [Medline]
  16. West DS, Krukowski RA, Finkelstein EA, Stansbury ML, Ogden DE, Monroe CM, et al. Adding financial incentives to online group-based behavioral weight control: an RCT. Am J Prev Med 2020 Aug;59(2):237-246 [FREE Full text] [CrossRef] [Medline]
  17. Kullgren JT, Troxel AB, Loewenstein G, Asch DA, Norton LA, Wesby L, et al. Individual- versus group-based financial incentives for weight loss: a randomized, controlled trial. Ann Intern Med 2013 Apr 02;158(7):505-514 [FREE Full text] [CrossRef] [Medline]
  18. Volpp KG, John LK, Troxel AB, Norton L, Fassbender J, Loewenstein G. Financial incentive-based approaches for weight loss: a randomized trial. JAMA 2008 Dec 10;300(22):2631-2637 [FREE Full text] [CrossRef] [Medline]
  19. Finkelstein EA, Linnan LA, Tate DF, Birken BE. A pilot study testing the effect of different levels of financial incentives on weight loss among overweight employees. J Occup Environ Med 2007 Sep;49(9):981-989. [CrossRef] [Medline]
  20. Wilson SM, Newins AR, Medenblik AM, Kimbrel NA, Dedert EA, Hicks TA, et al. Contingency management versus psychotherapy for prenatal smoking cessation: a meta-analysis of randomized controlled trials. Womens Health Issues 2018;28(6):514-523 [FREE Full text] [CrossRef] [Medline]
  21. Higgins ST, Washio Y, Heil SH, Solomon LJ, Gaalema DE, Higgins TM, et al. Financial incentives for smoking cessation among pregnant and newly postpartum women. Prev Med 2012 Nov;55 Suppl:S33-S40 [FREE Full text] [CrossRef] [Medline]
  22. Phillips JK, Skelly JM, Roberts LM, Bernstein IM, Higgins ST. Combined financial incentives and behavioral weight management to enhance adherence with gestational weight gain guidelines: a randomized controlled trial. Am J Obstet Gynecol MFM 2019 Mar;1(1):42-49. [CrossRef] [Medline]
  23. Paul-Ebhohimhen V, Avenell A. Systematic review of the use of financial incentives in treatments for obesity and overweight. Obes Rev 2008 Jul;9(4):355-367. [CrossRef] [Medline]
  24. Volpp KG, Asch DA, Galvin R, Loewenstein G. Redesigning employee health incentives--lessons from behavioral economics. N Engl J Med 2011 Aug 04;365(5):388-390 [FREE Full text] [CrossRef] [Medline]
  25. Phelan S, Jankovitz K, Hagobian T, Abrams B. Reducing excessive gestational weight gain: lessons from the weight control literature and avenues for future research. Womens Health (Lond) 2011 Nov;7(6):641-661 [FREE Full text] [CrossRef] [Medline]
  26. Zheng Y, Klem ML, Sereika SM, Danford CA, Ewing LJ, Burke LE. Self-weighing in weight management: a systematic literature review. Obesity (Silver Spring) 2015 Feb;23(2):256-265 [FREE Full text] [CrossRef] [Medline]
  27. Lombard C, Harrison C, Kozica S, Zoungas S, Ranasinha S, Teede H. Preventing weight gain in women in rural communities: a cluster randomised controlled trial. PLoS Med 2016 Jan;13(1):e1001941 [FREE Full text] [CrossRef] [Medline]
  28. Vanwormer JJ, French SA, Pereira MA, Welsh EM. The impact of regular self-weighing on weight management: a systematic literature review. Int J Behav Nutr Phys Act 2008 Nov 04;5:54 [FREE Full text] [CrossRef] [Medline]
  29. Linde JA, Jeffery RW, French SA, Pronk NP, Boyle RG. Self-weighing in weight gain prevention and weight loss trials. Ann Behav Med 2005 Dec;30(3):210-216. [CrossRef] [Medline]
  30. Shin DW, Yun JM, Shin J, Kwon H, Min HY, Joh H, et al. Enhancing physical activity and reducing obesity through smartcare and financial incentives: a pilot randomized trial. Obesity (Silver Spring) 2017 Feb;25(2):302-310. [CrossRef] [Medline]
  31. Ries A, Blackman L, Page R, Gizlice Z, Benedict S, Barnes K, et al. Goal setting for health behavior change: evidence from an obesity intervention for rural low-income women. Rural Remote Health 2014;14:2682 [FREE Full text] [Medline]
  32. Jeffery R, Wing RR, Sherwood NE, Tate DF. Physical activity and weight loss: does prescribing higher physical activity goals improve outcome? Am J Clin Nutr 2003 Oct;78(4):684-689. [CrossRef] [Medline]
  33. Brown MJ, Sinclair M, Liddle D, Hill AJ, Madden E, Stockdale J. A systematic review investigating healthy lifestyle interventions incorporating goal setting strategies for preventing excess gestational weight gain. PLoS One 2012;7(7):e39503 [FREE Full text] [CrossRef] [Medline]
  34. Volpp KG, Pauly MV, Loewenstein G, Bangsberg D. P4P4P: an agenda for research on pay-for-performance for patients. Health Aff (Millwood) 2009;28(1):206-214 [FREE Full text] [CrossRef] [Medline]
  35. O'Donoghue T, Rabin M. The economics of immediate gratification. J Behav Decis Making 2000 Apr;13(2):233-250. [CrossRef]
  36. Loewenstein G, Asch DA, Volpp KG. Behavioral economics holds potential to deliver better results for patients, insurers, and employers. Health Aff (Millwood) 2013 Jul;32(7):1244-1250. [CrossRef] [Medline]
  37. Patel MS, Asch DA, Rosin R, Small DS, Bellamy SL, Heuer J, et al. Framing financial incentives to increase physical activity among overweight and obese adults: a randomized, controlled trial. Ann Intern Med 2016 Mar 15;164(6):385-394 [FREE Full text] [CrossRef] [Medline]
  38. Leahey TM, Subak LL, Fava J, Schembri M, Thomas G, Xu X, et al. Benefits of adding small financial incentives or optional group meetings to a web-based statewide obesity initiative. Obesity (Silver Spring) 2015 Jan;23(1):70-76 [FREE Full text] [CrossRef] [Medline]
  39. Kanfer FH, Goldstein AP. Helping People Change: A Textbook of Methods. Oxford, United Kingdom: Pergamon Press; 1986.
  40. Gardner B, Wardle J, Poston L, Croker H. Changing diet and physical activity to reduce gestational weight gain: a meta-analysis. Obes Rev 2011 Jul;12(7):e602-e620. [CrossRef] [Medline]
  41. Asch DA, Volpp KG. On the way to health. LDI Issue Brief 2012;17(9):1-4. [Medline]
  42. Sen AP, Sewell TB, Riley EB, Stearman B, Bellamy SL, Hu MF, et al. Financial incentives for home-based health monitoring: a randomized controlled trial. J Gen Intern Med 2014 May 13;29(5):770-777 [FREE Full text] [CrossRef] [Medline]
  43. Thaler RH, Tversky A, Kahneman D, Schwartz A. The effect of myopia and loss aversion on risk taking: an experimental test. Quarterly J Econ 1997 May 01;112(2):647-661. [CrossRef]
  44. Committee on Obstetric Practice. Committee Opinion No. 650 Physical Activity and Exercise During Pregnancy and the Postpartum Period. Obstet Gynecol 2015 Dec;126(6):e135-e142. [CrossRef]
  45. Cadmus-Bertram L, Marcus BH, Patterson RE, Parker BA, Morey BL. Use of the Fitbit to measure adherence to a physical activity intervention among overweight or obese, postmenopausal women: self-monitoring trajectory during 16 weeks. JMIR Mhealth Uhealth 2015 Nov 19;3(4):e96 [FREE Full text] [CrossRef] [Medline]
  46. Oken E, Taveras EM, Kleinman KP, Rich-Edwards JW, Gillman MW. Gestational weight gain and child adiposity at age 3 years. Am J Obstet Gynecol 2007 Apr;196(4):322.e1-322.e8 [FREE Full text] [CrossRef] [Medline]
  47. Leon AC, Davis LL, Kraemer HC. The role and interpretation of pilot studies in clinical research. J Psychiatr Res 2011 May;45(5):626-629 [FREE Full text] [CrossRef] [Medline]
  48. Collins L. Optimization of Behavioral, Biobehavioral, and Biomedical Interventions: The Multiphase Optimization Strategy (MOST). Cham: Springer; 2018.
  49. Harrison CL, Teede HJ, Lombard CB. How effective is self-weighing in the setting of a lifestyle intervention to reduce gestational weight gain and postpartum weight retention? Aust N Z J Obstet Gynaecol 2014 Aug;54(4):382-385. [CrossRef] [Medline]
  50. Finkelstein EA, Tham K, Haaland BA, Sahasranaman A. Applying economic incentives to increase effectiveness of an outpatient weight loss program (TRIO) - A randomized controlled trial. Soc Sci Med 2017 Jul;185:63-70. [CrossRef] [Medline]
  51. Giles EL, Becker F, Ternent L, Sniehotta FF, McColl E, Adams J. Acceptability of financial incentives for health behaviours: a discrete choice experiment. PLoS One 2016;11(6):e0157403 [FREE Full text] [CrossRef] [Medline]
  52. McGill B, O'Hara BJ, Grunseit AC, Bauman A, Osborne D, Lawler L, et al. Acceptability of financial incentives for maintenance of weight loss in mid-older adults: a mixed methods study. BMC Public Health 2018 Feb 13;18(1):244 [FREE Full text] [CrossRef] [Medline]
  53. Pereira MA, Rifas-Shiman SL, Kleinman KP, Rich-Edwards JW, Peterson KE, Gillman MW. Predictors of change in physical activity during and after pregnancy: project viva. Am J Prev Med 2007 Apr;32(4):312-319 [FREE Full text] [CrossRef] [Medline]
  54. Choi J, Fukuoka Y, Lee JH. The effects of physical activity and physical activity plus diet interventions on body weight in overweight or obese women who are pregnant or in postpartum: a systematic review and meta-analysis of randomized controlled trials. Prev Med 2013 Jun;56(6):351-364 [FREE Full text] [CrossRef] [Medline]
  55. Krukowski RA, West D, DiCarlo M, Shankar K, Cleves MA, Tedford E, et al. A behavioral intervention to reduce excessive gestational weight gain. Matern Child Health J 2017 Mar;21(3):485-491. [CrossRef] [Medline]
  56. Chen MS, Lara PN, Dang JH, Paterniti DA, Kelly K. Twenty years post-NIH Revitalization Act: enhancing minority participation in clinical trials (EMPaCT): laying the groundwork for improving minority clinical trial accrual: renewing the case for enhancing minority participation in cancer clinical trials. Cancer 2014 Apr 01;120 Suppl 7:1091-1096 [FREE Full text] [CrossRef] [Medline]
  57. Haughton CF, Silfee VJ, Wang ML, Lopez-Cepero AC, Estabrook DP, Frisard C, et al. Racial/ethnic representation in lifestyle weight loss intervention studies in the United States: a systematic review. Prev Med Rep 2018 Mar;9:131-137 [FREE Full text] [CrossRef] [Medline]
  58. Renjilian DA, Perri MG, Nezu AM, McKelvey WF, Shermer RL, Anton SD. Individual versus group therapy for obesity: effects of matching participants to their treatment preferences. J Consult Clin Psychol 2001 Aug;69(4):717-721. [Medline]
  59. Hill B, Skouteris H, Fuller-Tyszkiewicz M. Interventions designed to limit gestational weight gain: a systematic review of theory and meta-analysis of intervention components. Obes Rev 2013 Jun;14(6):435-450. [CrossRef] [Medline]
  60. Phelan S, Wing RR, Brannen A, McHugh A, Hagobian TA, Schaffner A, et al. Randomized controlled clinical trial of behavioral lifestyle intervention with partial meal replacement to reduce excessive gestational weight gain. Am J Clin Nutr 2018 Feb 01;107(2):183-194 [FREE Full text] [CrossRef] [Medline]


GWG: gestational weight gain
IOM: Institute of Medicine


Edited by G Eysenbach; submitted 26.05.21; peer-reviewed by N Meloncelli, S Hertling, HL Tam; comments to author 02.07.21; revised version received 29.07.21; accepted 17.11.21; published 24.12.21

Copyright

©Rebecca Krukowski, Brandi Johnson, Hyeonju Kim, Saunak Sen, Riad Homsi. Originally published in JMIR Formative Research (https://formative.jmir.org), 24.12.2021.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.