This paper is in the following e-collection/theme issue:

Formative Evaluation of Digital Health Interventions (2491) Design and Formative Evaluation of Mobile Apps (706) Methods and Feasibility Studies (384) mHealth for Data Collection and Research (981) mHealth for Wellness, Behavior Change and Prevention (2922) Instruments and Questionnaires for Nutrition and Food Intake (169)

Published on in Vol 6, No 6 (2022): June

Preprints (earlier versions) of this paper are available at https://preprints.jmir.org/preprint/38283, first published .
Assessing the Initial Validity of the PortionSize App to Estimate Dietary Intake Among Adults: Pilot and Feasibility App Validation Study

Assessing the Initial Validity of the PortionSize App to Estimate Dietary Intake Among Adults: Pilot and Feasibility App Validation Study

Assessing the Initial Validity of the PortionSize App to Estimate Dietary Intake Among Adults: Pilot and Feasibility App Validation Study

Authors of this article:

Sanjoy Saha1 Author Orcid Image ;   Chloe Panizza Lozano1 Author Orcid Image ;   Stephanie Broyles1 Author Orcid Image ;   Corby K Martin1 Author Orcid Image ;   John W Apolzan1 Author Orcid Image
Article Authors Cited by (5) Tweetations (5) Metrics

    Original Paper

    Pennington Biomedical Research Center, Louisiana State University System, Baton Rouge, LA, United States

    Corresponding Author:

    John W Apolzan, PhD

    Pennington Biomedical Research Center

    Louisiana State University System

    6400 Perkins Road

    Baton Rouge, LA, 70808

    United States

    Phone: 1 2257632827

    Email: john.apolzan@pbrc.edu


    Background: Accurately assessing dietary intake can promote improved nutrition. The PortionSize app (Pennington Biomedical Research Center) was designed to quantify and provide real-time feedback on the intake of energy, food groups, saturated fat, and added sugar.

    Objective: This study aimed to assess the preliminary feasibility and validity of estimating food intake via the PortionSize app among adults.

    Methods: A total of 15 adults (aged 18-65 years) were recruited and trained to quantify the food intake from a simulated meal by using PortionSize. Trained personnel prepared 15 simulated meals and covertly weighed (weigh back) the amount of food provided to participants as well as food waste. Equivalence tests (±25% bounds) were performed to compare PortionSize to the weigh back method.

    Results: Participants were aged a mean of 28 (SD 12) years, and 11 were female. The mean energy intake estimated with PortionSize was 742.9 (SD 328.2) kcal, and that estimated via weigh back was 659.3 (SD 190.7) kcal (energy intake difference: mean 83.5, SD 287.5 kcal). The methods were not equivalent in estimating energy intake (P=.18), and PortionSize overestimated energy intake by 83.5 kcal (12.7%) at the meal level. Estimates of portion sizes (gram weight; P=.01), total sugar (P=.049), fruit servings (P=.01), and dairy servings (P=.047) from PortionSize were equivalent to those estimated via weigh back. PortionSize was not equivalent to weigh back with regard to estimates for carbohydrate (P=.10), fat (P=.32), vegetable (P=.37), grain (P=.31), and protein servings (P=.87).

    Conclusions: Due to power limitations, the equivalence tests had large equivalence bounds. Though preliminary, the results of this small pilot study warrant the further adaptation, development, and validation of PortionSize as a means to estimate energy intake and provide users with real-time and actionable dietary feedback.

    JMIR Form Res 2022;6(6):e38283

    doi:10.2196/38283

    Keywords

    dietary assessment; eating; food intake; energy intake; portion size; mHealth; digital health; eHealth; nutrition; food groups 


    Accurately quantifying food intake is important to managing body weight; improving health and nutrition; and reducing the risk of chronic diseases, such as malnutrition, diabetes, and obesity [1-4]. Valid food intake assessment methods are needed to determine whether individual dietary patterns and nutrient intake meet the recommended levels [1-6]. Moreover, sufficiently accurate methods are needed that can provide people with information in real time about what foods they select and eat to facilitate the modification of dietary behaviors when they occur [1,7-10].

    Traditional dietary intake assessment methods, including 24-hour dietary recall, food frequency questionnaires, and food records, have been widely used in nutritional research. These conventional methods have some advantages, as well as limitations. Recall-based methods rely on participants’ memory to recall what foods were consumed, how they were prepared, and how much of each food they consumed (ie, participants must estimate portion size). These traditional methods of dietary assessment are also time consuming [1,10,11]. Advancements in technology allow for unique perspectives when estimating energy and nutrient intake [10]. Web and food photography or food image–based methods may reduce user burden and provide more accurate estimates of food intake [10,12]. Although some of these methods may be accurate [13-15], they also have limitations. For example, food photography–based methods, such as the remote food photography method (RFPM), require trained human raters to analyze food images and quantify food intake. Consequently, such methods do not provide immediate feedback about food intake to the users, are not scalable, and have little to no cost advantage over more traditional methods [3,13,16].

    PortionSize (Pennington Biomedical Research Center [PBRC]) is a newly developed smartphone app and method for estimating food intake that also relies on images of foods. Rather than human raters estimating portion size based on food images, the app integrates templates and other techniques that allow users to estimate portion sizes in real time [7]. Consequently, the users receive immediate feedback about their food selections prior to eating, which theoretically allows users to modify their food selections to better adhere to certain energy intake levels, food group recommendations, or macronutrient levels. The users also receive information about their food intake after they eat. The information provided to the users includes energy intake; fruit, vegetable, grain, protein, and dairy servings; and amounts of saturated fat and added sugar. The users also receive feedback about the extent to which their intake throughout the day is meeting specific energy intake and food group goals (eg, United States Department of Agriculture [USDA] MyPlate–recommended food groups: fruits, vegetables, grains, protein, and dairy). The results of the users estimating portion size and the ability of the users to receive food intake information immediately are expected reductions in validity and accuracy, particularly when compared to those of the RFPM [3,7,13]. To our knowledge, PortionSize is one of the first apps to provide users with food intake adherence data about their food selections before meals are consumed, after meals, and cumulatively throughout the day. We expect that the PortionSize app will help users overcome the limitations inherent with the RFPM.

    The portion sizes of food have increased in the United States, and at fast-food chains, portions have increased by 2 to 5 times the original serving size [17]. Without visual aids however, it is very difficult for people [18], including trained registered dietitians [19], to accurately estimate portion sizes. Nevertheless, most dietary intake assessment methods focus on energy and nutrient intake and are not able to capture information on whether consumers are meeting the USDA MyPlate–recommended daily servings [20]. Therefore, there remains a significant need for methods that are sufficiently accurate to provide researchers with good outcome data and guide health promotion efforts while remaining scalable and affordable. PortionSize relies on emerging technology (eg, augmented reality) to improve accuracy and minimize the amount of missing data. PortionSize integrates ecological momentary assessment methods [21] to drive data completeness and quality (Figure 1). Validation studies of food intake assessment methods play an important role in identifying key areas to improve the accuracy of food intake estimation [18]. To collect preliminary data, assess initial validity, and identify areas of improvement for the PortionSize app, we conducted this pilot study. The aim of this pilot and feasibility study was to collect preliminary validity data on food intake that are estimated with the PortionSize app and compare them with data on weighed food. The secondary aim was to explore participants’ perceived satisfaction with the PortionSize app.

    ‎
    Figure 1. The PortionSize app allows users to take before-meal photos and after-meal photos.
    View this figure

    Ethics Approval

    This study was conducted in accordance with the Declaration of Helsinki [22], and all procedures involving human subjects were approved by the institutional review board (IRB) at the PBRC (IRB Federal Wide Assurance number: 00006218). The trial was registered at ClinicalTrails.gov (trial number: NCT04494971) prior to recruiting participants in this study. Written informed consent was obtained from all subjects.

    Recruitment and Participants

    In this pilot study, 15 adult participants were enrolled, following the recommendation made by Hertzog [23] that 10 to 15 participants are sufficient for a pilot study. Advertisements on the PBRC Current Research Trials web page and the PBRC Facebook pages were used to recruit participants. We also distributed flyers at Louisiana State University. Participants who were interested in this study emailed the study team and then completed a phone screen. Preliminary eligible participants were scheduled for an in-person screening visit. Those who qualified and remained interested enrolled in the study. The eligibility criteria were adults aged 18 to 65 years and a BMI within the range of 18.5 to 45 kg/m2. Participants who reported an eating disorder or serious mental illness, pregnant women, and breastfeeding mothers were excluded from this study. The aim of this pilot and feasibility study was to assess the PortionSize app’s performance when participants ate typical meals; hence, these exclusion criteria eliminated participants whose eating patterns or meal sizes may have been atypical. Each participant was given a subject ID number to ensure confidentiality, and collected data were stored in the password-protected PBRC server. The app is Health Insurance Portability and Accountability Act compliant. Participants were compensated for their successful completion of the study.

    Procedures

    Participants completed a demographic questionnaire, and trained research staff conducted anthropometric measurements (height and weight) of the participants. Afterward, participants were trained to use the PortionSize app to measure food intake. During training, participants practiced assessing food intake by using food models. The entire session took about 1.5 hours.

    Measures

    Demographics and Anthropometrics

    Participants’ age, race, ethnicity, sex, marital status, education level, height, and weight were collected during their visit to the center. BMI was calculated from participants’ objectively measured height and weight.

    Directly Weighed Food Intake to Prepare Simulated Test Meals

    Trained research staff prepared simulated test meals via direct observation. Such simulated meals served as the criterion measures of portion size, energy content, and food group quantity for comparisons with the food intake assessments by participants using the PortionSize app. Participants’ energy requirements were calculated by using sex-specific formulas [24]. Energy requirements were multiplied by 1.3, and the food selection for the simulated test meal included 30% of this value, which represents a typical lunch. The meals consisted of at least 3 food items and 1 calorie-containing beverage. Menus of meals were selected from a list of commonly consumed foods from a previous study [25]. Further, 3 participants were provided with the same simulated meal food menu (Table S1 in Multimedia Appendix 1); however, the meals differed in terms of portion size. Plate waste was determined at the individual food item level. This measure ranged from 0% and 100% and was right-skewed; as such, the mean plate waste was around 5% of the foods provided, which was similar to the actual plate waste from our free-living data (around 3%) [25]. Simulated food provision and plate waste were covertly weighed, and food intake was calculated by difference.

    Food Intake Estimation Using the PortionSize App

    Participants were instructed to use the PortionSize app to estimate food provision and waste. After the assessment, participants immediately obtained estimated feedback on their food intake, including energy intake, servings of different food groups (fruits, vegetables, grains, dairy, and protein), and amounts of selected nutrients (saturated fat and added sugar). The PortionSize app currently contains a database of around 1150 food items that are linked with the food codes in the Food and Nutrition Dataset for Dietary Studies (FNDDS) database [26]. Participants identified food items (from the served simulated meals) and associated food codes by selecting food items within the PortionSize app. A summary of details about the PortionSize app are included in the supplementary materials (Multimedia Appendix 1).

    User Satisfaction Survey and the Computer System Usability Questionnaire

    After completing the food intake assessments, participants completed 2 surveys. We adapted a 10-item user satisfaction survey that was administered in prior studies to quantify satisfaction, ease of use, and the adequacy of training for PortionSize [27,28]. The items were generated to obtain user satisfaction data and feedback about the app that could be used to identify areas where the app requires improvement. We did not rely on a formal framework when developing the survey. All items were rated on a scale ranging from 1 to 6, with 1 indicating “extremely dissatisfied,” “very difficult,” “not at all,” or “not appropriate” and 6 indicating “extremely satisfied,” “extremely easy,” “very much,” or “very appropriate.”

    Participants also completed the Computer System Usability Questionnaire (CSUQ; a 7-point rating scale)—a standardized, reliable, and valid questionnaire that was originally designed to evaluate computer programs [27,29]. It has been used to quantify the usability of mobile phone apps [30,31]. A rating of 7 represented “strongly disagree,” and a rating of 1 indicated “strongly agree.” The CSUQ provides an overall satisfaction score and scores for system usefulness, information quality, and interface quality [29].

    Data Analysis

    All statistical analyses were performed by using IBM SPSS software (version 28.0.1; IBM Corporation) and SAS/STAT software (version 9.4; SAS Institute Inc). The primary analysis was assessing the equivalence between the PortionSize app and the weigh back method by using equivalence tests, specifically the two one-sided t test method [32]. The primary outcome variable was the measured energy (kcal) calculated via the weigh back method at the meal level. The equivalence bounds were set at ±25%. These bounds are large, but they reflected the appropriate statistical power for a pilot study and were used in a similar pilot study [15]. A Bland-Altman analysis [33] was performed to test for differences in error variance over levels of the variable being measured (eg, food intake). We also calculated error from PortionSize in relation to the criterion measure (weigh back) by using 2-tailed dependent samples t tests to compare portion sizes and the intake of energy, food group servings (fruits, vegetables, grains, dairy, and protein), macronutrients (carbohydrates, fat, and protein), selected nutrients (saturated fat, cholesterol, dietary fiber, total sugar, and added sugar), and selected micronutrients (sodium, calcium, iron, potassium, and vitamin D). These results are presented in the supplementary materials (Multimedia Appendix 1). The inclusion of selected nutrients for analysis was determined based upon the nutrition facts panels. We estimated the mean percent difference (ie, [(PortionSize − weigh back)/weigh back] × 100) at the group level to avoid having a 0 value as a denominator for each nutrient. The significance level was set at .05. User satisfaction and CSUQ survey results were presented primarily as frequencies and percentages.


    Participants’ Characteristics

    A total of 21 participants completed the phone screening, and 15 participants were enrolled and completed the study. Of the 15 participants, 11 (73%) were female (Table 1). The mean age of the participants was 28 (SD 12) years, and the BMI (kg/m2) range was 18.8 to 41.8 kg/m2.

    Table 1. Background characteristics of participants (N=15).
    VariablesValue
    Sex, n (%)

    		Male4 (27)

    		Female11 (73)
    Race and ethnicity, n (%)

    		Black or African American1 (7)

    		White14 (93)
    Education, n (%)

    		High school diploma or General Educational Development1 (7)

    		Some college7 (47)

    		Bachelor’s degree5 (33)

    		Postgraduate degree2 (13)
    Employment, n (%)

    		Unemployed2 (13)

    		Full-time employment4 (27)

    		Part-time employment7 (47)

    		Retired1 (7)

    		Other: student1 (7)
    Age (years), mean (SD; range)28.0 (12.2; 20-57)
    Height (cm), mean (SD; range)168.1 (10.4; 147.3-182.9)
    Weight (kg), mean (SD; range)68.3 (19.8; 50.4-113.4)
    BMI (kg/m2), mean (SD; range)24.1 (6.6; 18.8-41.8)

    Estimation of Energy Intake

    Table 2 indicates that the mean energy intake estimated with the PortionSize app (742.9, SD 328.2 kcal) was not equivalent (P=.18) to the mean estimated from the weighed meals (659.3, SD 190.7 kcal). The mean energy intake difference between the two methods was 83.5 (95% CI –480.0 to 647.0) kcal, and the mean percent error for the estimation of energy intake was 12.7% (Table 2 and Table S2 in Multimedia Appendix 1). PortionSize underestimated energy intake at lower levels of intake, but overestimation occurred and increased with higher levels of intake (Figure 2), as indicated by a significant regression equation (R2=0.300; adjusted R2=0.246; P=.03).

    Table 2. Comparison of portion size, energy, and nutrient intake estimates between PortionSize and the weigh back method (meals: N=15).
     PortionSize appWeigh back Difference Equivalence at ±25%, P valueMean percent errora

    		MeanSDMeanSDMeanSD

    Energy (kcal) 742.9328.2 659.3190.7 83.5287.5 .1812.7 
    Portion size (g) 674.3222.8 716.9207.2 −42.7303.9 .03b−6
    Total fruits (servingsc) 0.20.3 0.30.4 −0.10.4 .01b−33.3 
    Total vegetables (servingsc) 0.60.3 0.60.4 0.00.2 .370
    Total grains (servingsd) 1.71.7 1.21.1 0.50.8 .3141.7
    Total dairy (servingsc) 0.4 0.6 0.50.6 −0.10.7 .047b−20
    Total protein (servingsd) 3.1 3.6 2.82.9 0.32.0 .8710.7
    Saturated fat (g) 10.86.8 10.44.1 0.46.1 .113.8
    Added sugar (teaspoons) 8.87.3 8.55.1 0.24.8 .142.4
    Protein (g) 35.327.9 32.719.8 2.617.4 .258
    Total fat (g) 32.522.4 27.110.8 5.418.7 .3219.9 
    Carbohydrates (g) 78.949.6 72.028.4 6.933.8 .109.6 
    Dietary fiber (g) 4.63.2 4.11.3 0.53.6 .3912.2 
    Total sugar (g) 45.627.6 46.515.7 −1.023.7 .049b−2.2 
    Cholesterol (mg) 110.394.0 103.373.0 7.161.9 .526.9 
    Sodium (mg) 1200.8562.0 940.5376.7 260.3449.5 .6827.7 
    Calcium (mg) 214.3185.4 254.7176.5 −40.4171.7 .09−15.9 
    Iron (mg) 4.33.1 3.32.3 1.01.4 .7230.3 
    Potassium (mg) 888.5576.6 831.9431.8 56.6361.1 .049b6.8 
    Vitamin D (µg) 0.81.9 1.52.0 −0.62.1 .62−40

    aMean percent error = ([PortionSize – weigh back]/weigh back) × 100.

    bSignificant equivalence (level of significance at P<.05).

    cServings were cup equivalents.

    dServings were ounce equivalents.

    ‎
    Figure 2. Bland-Altman analysis for comparing energy intake (kcal) between PortionSize and the WB method (15 meals). LCL: lower confidence limit; UCL: upper confidence limit; WB: weigh back.
    View this figure

    Estimation of Portion Size

    The mean gram weight of meals estimated with the PortionSize app was 674.3 (SD 222.8) g, and the mean estimated from the weighed meals was 716.9 (SD 207.2) g. The mean difference in the estimated gram weights of food items between the two methods was −42.7 (95% CI −638.3 to 552.9) g/meal, and both means were significantly equivalent (P=.03; Table 2 and Table S2 in Multimedia Appendix 1). The mean percent error for the estimation of gram weight was −6%. The Bland-Altman limit of agreement plot for the gram weights of food items (Figure 3) indicates a slightly positive trend (not significant) for the difference in estimated gram weights (PortionSize – weigh back) with regard to the means of both methods ([PortionSize + weigh back]/2). The results show nonsignificant bias (R2=.005; adjusted R2=−0.071; P=.80).

    ‎
    Figure 3. Bland-Altman analysis for comparing consumed food in grams (portion size) between PortionSize and the WB method (15 meals). LCL: lower confidence limit; UCL: upper confidence limit; WB: weigh back.
    View this figure

    Estimation of Food Group Servings

    The mean PortionSize-estimated total fruit servings was 0.2 (SD 0.3; Table 2). The mean weigh back method–estimated servings of fruits was 0.3 (SD 0.4), and the means were equivalent (P=.01). PortionSize-estimated total dairy servings (mean 0.4, SD 0.6 servings) were equivalent to the weigh back–estimated servings (mean 0.5, SD 0.6 servings; P=.047). Among the five food groups, the estimations of total vegetable servings had the lowest mean percent error (0%), with those for grain servings having the highest (41.7%). The results of dependent t tests for comparing the intake of energy, nutrient, and food group servings between the two methods—the PortionSize app and weigh back—are presented in Table S2 in Multimedia Appendix 1. Bland-Altman analyses of food groups are presented in Figures S4-S8 in Multimedia Appendix 1.

    Estimation of Macronutrients and Specific Nutrients

    The estimates for the mean intake of protein (P=.25), fat (P=.32), and carbohydrates (P=.10) were not equivalent between PortionSize and the weigh back method (Table 2). The mean differences in protein, fat, and carbohydrate intake estimates between PortionSize and the weigh back method were 2.6 (SD 17.4) g, 5.4 (SD 18.7) g, and 6.9 (SD 33.8) g, respectively. We found significant equivalence in estimations of total sugar (P=.049) and potassium (P=.049) intake between PortionSize and the weigh back method. Among the macronutrient estimations, total fat estimations had the highest mean percent error (19.9%).

    User Satisfaction and CSUQ Survey

    Table 3 shows that of the 15 participants, 12 (80%) were satisfied or extremely satisfied with the PortionSize app, and 11 (73%) were similarly satisfied with the easiness of the PortionSize app for recording portion sizes. Moreover, 13 (87%) participants marked “very much” for how much the iPhone training helped them to prepare for using the PortionSize app.

    The CSUQ survey indicated that 11 (73%) participants strongly agreed that they could become productive quickly by using the app, and the information provided for the app was easy to understand (Table S3 in Multimedia Appendix 1). The mean score from the CSUQ was 35.3 (SD 13.5).

    Table 3. Participants’ satisfaction with the PortionSize app (N=15).
    QuestionsScore, n (%)

    		1a23456b
    1. How satisfied are you with the PortionSize app for recording portion sizes?N/AcN/AN/A3 (20)8 (53)4 (27)
    2. How satisfied are you with the Portion Summary tab of the PortionSize app?N/AN/A2 (13)1 (7)6 (40)6 (40)
    3. How satisfied are you with the Take Photo tab of the PortionSize app?N/AN/AN/A4 (27)6 (40)5 (33)
    4. How satisfied are you with the Forgot Meal tab of the PortionSize app?N/A1 (7)N/AN/A4 (27)10 (67)
    5. How satisfied are you with the Settings tab of the PortionSize app?N/AN/AN/A1 (7)4 (27)10 (67)
    6. How easy was it to use the PortionSize app for recording portion sizes?N/AN/AN/A4 (27)7 (47)4 (27)
    7. How easy was it to capture images and record portion sizes?N/AN/A1 (7)7 (47)4 (27)3 (20)
    8. How easy was it to use the Forgot Meal tab to describe portions?N/AN/A2 (13)1 (7)4 (27)8 (53)
    9. How much did the iPhone training help prepare you for using the PortionSize app?N/AN/AN/AN/A2 (13)13 (87)
    10. How appropriate were the PortionSize templates superimposed on your food items?N/AN/AN/A1 (7)8 (53)6 (40)

    aScores of 1 indicated “extremely dissatisfied,” “very difficult,” “not at all,” and “not appropriate” for questions 1 to 5, questions 6 to 8, question 9, and question 10, respectively.

    bScores of 6 indicated “extremely satisfied,” “extremely easy,” “very much,” and “very appropriate” for questions 1 to 5, questions 6 to 8, question 9, and question 10, respectively.

    cN/A: not applicable.


    Principal Findings

    In this small pilot and feasibility study, we collected preliminary validation data for the PortionSize app. The results indicate that the estimations of energy intake and the intake of energy-contributing nutrients (carbohydrates, protein, and fat) from the PortionSize app were not equivalent to those estimated via weigh back. The mean percent error of the energy intakes estimated by the PortionSize app and from weighed food was 12.7% and fell within the ranges of 8% to 30% for 24-hour dietary recall and 1.3% to 47% for diet histories, food records, and food frequency questionnaires [1]. PortionSize’s error for estimating gram weight intake was smaller (−6%). There are mixed results that suggest that app-based assessment methods either underestimate or overestimate energy intake when compared with the doubly labeled water method and traditional methods, such as dietary records [1,9]. Traditional methods, such as self-reported 24-hour dietary recall, have significantly underreported energy intake when compared with 7-day food weigh records [34]. A systematic review and meta-analysis study found that image-based dietary assessments underestimated energy intake by 20% (range 0%-37%) when compared with the doubly labeled water method; however, the study showed no significant difference in energy intakes estimated via traditional methods (such as 24-hour dietary recall) and the RFPM [35]. We observed in this pilot study that the CI for the mean difference in energy intake estimations between the two methods—the PortionSize app and weigh back—crossed 0 (Table S2 in Multimedia Appendix 1).

    The results of this pilot study indicate that the estimated portion sizes (g) of food from the PortionSize app was equivalent to the portion sizes that were estimated via weigh back, and the mean percent error between the two methods was −6%. Inaccurate portion size estimates necessarily result in inaccurate food intake estimates, and approximately 50% of the error in self-reported food intake is due to inaccurate portion size estimates, with missing data likely accounting for the majority of the remaining error [36]. Furthermore, consumers’ difficulties with estimating portion sizes are a barrier to correctly measuring energy intake [37]. The PortionSize app integrates visual templates that enable users or consumers to accurately quantify portion sizes in real time [7]. However, users need to be discreet when selecting the right FNDDS food codes within the PortionSize app to match with the food items in order to correctly estimate their food intake.

    Equivalent estimations of total fruit and total dairy servings were found between PortionSize and the weigh back method. We cross-checked the outlier values for the vegetable, grain, and protein group servings. A participant experienced app glitches when using the PortionSize app and thus could not correctly record plate waste for the grain group servings (outlier value is reported in Figure S6 in Multimedia Appendix 1). In addition, 1 participant mistakenly reported percent plate waste when using the PortionSize app and thus generated an outlier value for the protein group servings (Figure S8 in Multimedia Appendix 1). The estimations of total vegetable servings were not equivalent; however, the mean percent error was 0%. This reflects that there is no fundamental issue with the PortionSize app; however, app improvements are needed for the correct estimation of food intake.

    The USDA provides recommendations in terms of food groups, such as fruits, vegetables, grains, protein, and dairy [20]. To our knowledge, PortionSize app is the first food intake assessment tool that provides immediate feedback on energy intake and food group servings. Such feedback can help users track whether they are meeting the recommended daily intake of energy, fruits, vegetables, grains, dairy, and protein. Additionally, obtaining real-time feedback on food selection will provide an opportunity for users to modify their food intake and thus improve their food intake behavior [3,38,39]. Unspecific or delayed feedback is not as effective as real-time feedback at inducing behavior change, since behavior change is promoted by receiving immediate and specific feedback based on objective data that are temporally associated with a target behavior [38]. Food intake and dietary patterns outline an individual’s nutrition status because food intake encompasses energy intake; nutrient intake (macronutrients and micronutrients, including vitamins and minerals); and the consumption of different food groups, such as fruits and vegetables [1,17,40].

    A survey-based study that focused on the perceived burdens of and preferences for traditional methods, the RFPM, and PortionSize indicated that 67.3% of participants preferred to use the RFPM, 51.9% preferred the PortionSize app, 48% preferred food records, and 32.9% preferred 24-hour dietary recall. Nevertheless, a significantly higher percentage of older adults (aged ≥65 years) preferred using food records and 24-dietary recall when compared to other participants (aged <65 years) [7]. Older adults often perceive barriers and difficulties in using mobile health apps [41], and this could be one of the reasons that older adults typically prefer traditional methods. Participants in the survey-based study perceived the RFPM to less burdensome compared to the PortionSize app [7]; however, the RFPM needs trained human raters to analyze food images and assess food intake [16]. On the other hand, the PortionSize app has more embedded features for measuring food intake, including those for capturing images of food selection and plate waste, identifying foods, and estimating portion size, and these may challenge users or consumers when using the PortionSize app. Low health and nutrition literacy could be potential barriers to accurately estimating portion size [40]. The PortionSize app provides real-time feedback on food intake and food group servings; therefore, we expect that the advantages of using PortionSize app will promote users’ willingness to use the PortionSize app and accept the challenges. We also expect that future validation studies will support this hypothesis.

    Limitations

    The purpose of this pilot and feasibility study was to examine the initial validity of the PortionSize app and inform power for future validation studies of the PortionSize app. This study has several limitations that need to be acknowledged. First, it had a small but appropriate sample size for a pilot study. Second, most of the participants were female (11/15, 73%) and highly educated (college or above: 14/15, 93%). Third, there was limited representation from different racial or ethnic groups. Fourth, while all BMI categories were targeted, the effects across different BMI categories could not be examined due to the small sample size. Fifth, each participant estimated a single meal with limited food items; however, they did not estimate food intake over a long duration (ie, days or weeks). Sixth, the PortionSize app was also designed to estimate and provide feedback on alcohol consumption; however, we did not analyze alcohol consumption in this study. Lastly, the PortionSize app was recently developed, and the team continues to debug the app and improve its functionality. This likely impacted user satisfaction. Future studies with a large sample are needed to examine differences in food intake estimations from the PortionSize app between men and women, among BMI categories, and among different ethnic groups.

    Conclusions

    The findings from this pilot study suggest that the PortionSize app has promise for estimating food intake in real time. With some improvements, it is hoped that the PortionSize app will become sufficiently accurate, so that it can be used by participants to modify their food intake in real time (ie, when they are selecting foods) and how much of each food they eat during a meal or snack.

    Acknowledgments

    The authors would like to thank the participants for their time and effort in this study. We are grateful to Randy Ullrich for his assistance in app development.

    This work was supported by the National Institute of Diabetes and Digestive and Kidney Diseases (R01, grant DK124558; P30, grant DK072476; T32, grant DK064584) and the Louisiana Clinical and Translational Science Center (U54, grant GM104940).

    Authors' Contributions

    SS, CPL, CKM, and JWA formulated the research questions. SB, CKM, and JWA designed this study. CKM and JWA carried out this study. SS, CPL, and SB analyzed the data. SS, CPL, SB, CKM, and JWA interpreted the findings. SS, CPL, SB, CKM, and JWA wrote this paper.

    Conflicts of Interest

    The intellectual property related to the PortionSize app is owned by the Louisiana State University System and Pennington Biomedical Research Center. Authors CKM and JWA are the inventors of the technology and are employed by the Louisiana State University System and Pennington Biomedical Research Center.

    ‎
    Multimedia Appendix 1

    Supplementary material.

    DOCX File , 374 KB
    1. Burrows TL, Ho YY, Rollo ME, Collins CE. Validity of dietary assessment methods when compared to the method of doubly labeled water: A systematic review in adults. Front Endocrinol (Lausanne) 2019 Dec 17;10:850 [FREE Full text] [CrossRef] [Medline]
    2. Ambrosini GL, Hurworth M, Giglia R, Trapp G, Strauss P. Feasibility of a commercial smartphone application for dietary assessment in epidemiological research and comparison with 24-h dietary recalls. Nutr J 2018 Jan 09;17(1):5 [FREE Full text] [CrossRef] [Medline]
    3. Martin CK, Correa JB, Han H, Allen HR, Rood JC, Champagne CM, et al. Validity of the Remote Food Photography Method (RFPM) for estimating energy and nutrient intake in near real-time. Obesity (Silver Spring) 2012 Apr;20(4):891-899 [FREE Full text] [CrossRef] [Medline]
    4. McClung HL, Ptomey LT, Shook RP, Aggarwal A, Gorczyca AM, Sazonov ES, et al. Dietary intake and physical activity assessment: Current tools, techniques, and technologies for use in adult populations. Am J Prev Med 2018 Oct;55(4):e93-e104 [FREE Full text] [CrossRef] [Medline]
    5. Schembre SM, Liao Y, O'Connor SG, Hingle MD, Shen SE, Hamoy KG, et al. Mobile ecological momentary diet assessment methods for behavioral research: Systematic review. JMIR Mhealth Uhealth 2018 Nov 20;6(11):e11170 [FREE Full text] [CrossRef] [Medline]
    6. Teixeira V, Voci SM, Mendes-Netto RS, da Silva DG. The relative validity of a food record using the smartphone application MyFitnessPal. Nutr Diet 2018 Apr;75(2):219-225. [CrossRef] [Medline]
    7. Höchsmann C, Fearnbach N, Dorling JL, Fazzino TL, Myers CA, Apolzan JW, et al. Preference, expected burden, and willingness to use digital and traditional methods to assess food and alcohol intake. Nutrients 2021 Sep 24;13(10):3340 [FREE Full text] [CrossRef] [Medline]
    8. Kouvari M, Mamalaki E, Bathrellou E, Poulimeneas D, Yannakoulia M, Panagiotakos DB. The validity of technology-based dietary assessment methods in childhood and adolescence: a systematic review. Crit Rev Food Sci Nutr 2021;61(7):1065-1080. [CrossRef] [Medline]
    9. Shinozaki N, Murakami K. Evaluation of the ability of diet-tracking mobile applications to estimate energy and nutrient intake in Japan. Nutrients 2020 Oct 29;12(11):3327 [FREE Full text] [CrossRef] [Medline]
    10. Zhao X, Xu X, Li X, He X, Yang Y, Zhu S. Emerging trends of technology-based dietary assessment: a perspective study. Eur J Clin Nutr 2021 Apr;75(4):582-587. [CrossRef] [Medline]
    11. Shim JS, Oh K, Kim HC. Dietary assessment methods in epidemiologic studies. Epidemiol Health 2014 Jul 22;36:e2014009 [FREE Full text] [CrossRef] [Medline]
    12. Naska A, Lagiou A, Lagiou P. Dietary assessment methods in epidemiological research: current state of the art and future prospects. F1000Res 2017 Jun 16;6:926 [FREE Full text] [CrossRef] [Medline]
    13. Martin CK, Nicklas T, Gunturk B, Correa JB, Allen HR, Champagne C. Measuring food intake with digital photography. J Hum Nutr Diet 2014 Jan;27 Suppl 1(0 1):72-81 [FREE Full text] [CrossRef] [Medline]
    14. McConahy KL, Smiciklas-Wright H, Birch LL, Mitchell DC, Picciano MF. Food portions are positively related to energy intake and body weight in early childhood. J Pediatr 2002 Mar;140(3):340-347. [CrossRef] [Medline]
    15. Olafsdottir AS, Hörnell A, Hedelin M, Waling M, Gunnarsdottir I, Olsson C. Development and validation of a photographic method to use for dietary assessment in school settings. PLoS One 2016 Oct 06;11(10):e0163970. [CrossRef] [Medline]
    16. Martin CK, Han H, Coulon SM, Allen HR, Champagne CM, Anton SD. A novel method to remotely measure food intake of free-living individuals in real time: the remote food photography method. Br J Nutr 2009 Feb;101(3):446-456 [FREE Full text] [CrossRef] [Medline]
    17. Young LR, Nestle M. Expanding portion sizes in the US marketplace: implications for nutrition counseling. J Am Diet Assoc 2003 Feb;103(2):231-234. [CrossRef] [Medline]
    18. Almiron-Roig E, Solis-Trapala I, Dodd J, Jebb SA. Estimating food portions. Influence of unit number, meal type and energy density. Appetite 2013 Dec;71:95-103 [FREE Full text] [CrossRef] [Medline]
    19. Champagne CM, Bray GA, Kurtz AA, Monteiro JBR, Tucker E, Volaufova J, et al. Energy intake and energy expenditure: a controlled study comparing dietitians and non-dietitians. J Am Diet Assoc 2002 Oct;102(10):1428-1432. [CrossRef] [Medline]
    20. What is MyPlate? MyPlate U.S. Department of Agriculture.   URL: https://www.myplate.gov/eat-healthy/what-is-myplate [accessed 2022-01-12]
    21. Shiffman S, Stone AA, Hufford MR. Ecological momentary assessment. Annu Rev Clin Psychol 2008;4:1-32. [CrossRef] [Medline]
    22. World Medical Association. World Medical Association Declaration of Helsinki. Ethical principles for medical research involving human subjects. Bull World Health Organ 2001;79(4):373-374 [FREE Full text] [Medline]
    23. Hertzog MA. Considerations in determining sample size for pilot studies. Res Nurs Health 2008 Apr;31(2):180-191. [CrossRef] [Medline]
    24. Plucker A, Thomas DM, Broskey N, Martin CK, Schoeller D, Shook R, et al. Adult energy requirements predicted from doubly labeled water. Int J Obes (Lond) 2018 Aug;42(8):1515-1523. [CrossRef] [Medline]
    25. Roe BE, Apolzan JW, Qi D, Allen HR, Martin CK. Plate waste of adults in the United States measured in free-living conditions. PLoS One 2018 Feb 14;13(2):e0191813. [CrossRef] [Medline]
    26. Food and nutrient database for dietary studies (2017-2018). U.S. Department of Agriculture.   URL: https:/​/www.​ars.usda.gov/​northeast-area/​beltsville-md-bhnrc/​beltsville-human-nutrition-research-center/​food-surveys-research-group/​docs/​fndds-download-databases/​ [accessed 2022-01-13]
    27. Lewis JR. IBM computer usability satisfaction questionnaires: Psychometric evaluation and instructions for use. Int J Hum Comput Interact 1995;7(1):57-78. [CrossRef]
    28. Lewis JR. Usability: Lessons learned … and yet to be learned. Int J Hum Comput Interact 2014 Jul 10;30(9):663-684. [CrossRef]
    29. Lewis JR. Psychometric evaluation of the PSSUQ using data from five years of usability studies. Int J Hum Comput Interact 2002;14(3-4):463-488. [CrossRef]
    30. Al Ayubi SU, Parmanto B, Branch R, Ding D. A persuasive and social mHealth application for physical activity: A usability and feasibility study. JMIR Mhealth Uhealth 2014 May 22;2(2):e25 [FREE Full text] [CrossRef] [Medline]
    31. English LL, Dunsmuir D, Kumbakumba E, Ansermino JM, Larson CP, Lester R, et al. The PAediatric Risk Assessment (PARA) mobile app to reduce postdischarge child mortality: Design, usability, and feasibility for health care workers in Uganda. JMIR Mhealth Uhealth 2016 Feb 15;4(1):e16 [FREE Full text] [CrossRef] [Medline]
    32. Walker E, Nowacki AS. Understanding equivalence and noninferiority testing. J Gen Intern Med 2011 Feb;26(2):192-196 [FREE Full text] [CrossRef] [Medline]
    33. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986 Feb 08;1(8476):307-310. [Medline]
    34. Jayawardena R. Comparison dietary assessment methods in Sri Lankan adults: use of 24-hour dietary recall and 7-day weighed intake. BMC Nutr 2016 Mar 21;2(18):1-4 [FREE Full text] [CrossRef]
    35. Ho DKN, Tseng SH, Wu MC, Shih CK, Atika AP, Chen YC, et al. Validity of image-based dietary assessment methods: A systematic review and meta-analysis. Clin Nutr 2020 Oct;39(10):2945-2959. [CrossRef] [Medline]
    36. Beasley J, Riley WT, Jean-Mary J. Accuracy of a PDA-based dietary assessment program. Nutrition 2005 Jun;21(6):672-677. [CrossRef] [Medline]
    37. Livingstone MBE, Pourshahidi LK. Portion size and obesity. Adv Nutr 2014 Nov 14;5(6):829-834 [FREE Full text] [CrossRef] [Medline]
    38. Schultz W. Behavioral theories and the neurophysiology of reward. Annu Rev Psychol 2006;57:87-115. [CrossRef] [Medline]
    39. de Roos B. Personalised nutrition: ready for practice? Proc Nutr Soc 2013 Feb;72(1):48-52. [CrossRef] [Medline]
    40. Chaudhry BM, Schaefbauer C, Jelen B, Siek KA, Connelly K. Evaluation of a food portion size estimation interface for a varying literacy population. 2016 May Presented at: CHI'16: CHI Conference on Human Factors in Computing Systems; May 7-12, 2016; San Jose, California p. 5645-5657. [CrossRef]
    41. Askari M, Klaver NS, van Gestel TJ, van de Klundert J. Intention to use medical apps among older adults in the Netherlands: Cross-sectional study. J Med Internet Res 2020 Sep 04;22(9):e18080 [FREE Full text] [CrossRef] [Medline]

    ‎
    CSUQ: Computer System Usability Questionnaire
    FNDDS: Food and Nutrition Dataset for Dietary Studies
    IRB: institutional review board
    PBRC: Pennington Biomedical Research Center
    RFPM: remote food photography method
    USDA: United States Department of Agriculture

    Edited by A Mavragani; submitted 28.03.22; peer-reviewed by M Allman-Farinelli, C Jacob; comments to author 08.05.22; revised version received 24.05.22; accepted 26.05.22; published 15.06.22

    Copyright

    ©Sanjoy Saha, Chloe Panizza Lozano, Stephanie Broyles, Corby K Martin, John W Apolzan. Originally published in JMIR Formative Research (https://formative.jmir.org), 15.06.2022.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Formative Research, is properly cited. The complete bibliographic information, a link to the original publication on https://formative.jmir.org, as well as this copyright and license information must be included.