Conventional energy and macronutrient variables distort the accuracy of children's dietary reports: illustrative data from a validation study of effect of order prompts

Fourth-Grade Children's Reporting Accuracy for Amounts Eaten at School-Provided Meals: Insight from a Reporting-Error-Sensitive Analytic Approach Applied to Validation Study Data

BACKGROUND

Validation studies that have directly assessed reporting accuracy for amounts eaten have provided results in various ways.

OBJECTIVE

To analyze amount categories of a reporting-error-sensitive approach for insight concerning reporting accuracy for amounts eaten.

DESIGN

For a cross-sectional validation study, children were observed eating school-provided breakfast and lunch, and randomized to one of eight 24-hour recall conditions (two retention intervals [short and long] crossed with four prompts [forward, meal name, open, and reverse]).

PARTICIPANTS/SETTING

Data collected during 3 school years (2011-2012 to 2013-2014) on 455 children from 10 schools (four districts) in a southern US state.

MAIN OUTCOME MEASURES

Items were classified as matches (observed and reported), omissions (observed but unreported), or intrusions (unobserved but reported). Within amount categories (matches [corresponding, overreported, and underreported], intrusions [overreported], and omissions [underreported]), item amounts were converted to kilocalories.

STATISTICAL ANALYSES PERFORMED

A multilevel model was fit with food-level explanatory variables (amount category and meal) and child-level explanatory variables (retention interval, prompt, sex, and race/ethnicity). To investigate inaccuracy differences, t tests on three contrasts were performed.

RESULTS

Inaccuracy differed by amount category (P<0.001; in order from largest to smallest: omission, intrusion, underreported match, and overreported match), meal (P=0.01; larger for breakfast), retention interval (P=0.003; larger for long), sex (P=0.004; larger for boys), race/ethnicity (P=0.045; largest for non-Hispanic whites), and amount category×meal interaction (P=0.046). Overreported amounts were larger for intrusions than overreported matches (P<0.0001). Underreported amounts were larger for omissions than underreported matches (P<0.0001). Overall underreported amounts (from omissions and underreported matches) exceeded overall overreported amounts (from intrusions and overreported matches) (P<0.003).

CONCLUSIONS

Amount categories provide a standard way to analyze validation study data on reporting accuracy for amounts eaten, and compare results across studies. Multilevel analytic models reflecting the data structure are recommended for inference. To enhance reporting accuracy for amounts eaten, focus on increasing reports of correct items, thereby yielding more matches with fewer intrusions and omissions.

Children's school-breakfast reports and school-lunch reports (in 24-h dietary recalls): conventional and reporting-error-sensitive measures show inconsistent accuracy results for retention interval and breakfast location

Validation-study data were analysed to investigate retention interval (RI) and prompt effects on the accuracy of fourth-grade children's reports of school-breakfast and school-lunch (in 24-h recalls), and the accuracy of school-breakfast reports by breakfast location (classroom; cafeteria). Randomly selected fourth-grade children at ten schools in four districts were observed eating school-provided breakfast and lunch, and were interviewed under one of eight conditions created by crossing two RIs ('short'--prior-24-hour recall obtained in the afternoon and 'long'--previous-day recall obtained in the morning) with four prompts ('forward'--distant to recent, 'meal name'--breakfast, etc., 'open'--no instructions, and 'reverse'--recent to distant). Each condition had sixty children (half were girls). Of 480 children, 355 and 409 reported meals satisfying criteria for reports of school-breakfast and school-lunch, respectively. For breakfast and lunch separately, a conventional measure--report rate--and reporting-error-sensitive measures--correspondence rate and inflation ratio--were calculated for energy per meal-reporting child. Correspondence rate and inflation ratio--but not report rate--showed better accuracy for school-breakfast and school-lunch reports with the short RI than with the long RI; this pattern was not found for some prompts for each sex. Correspondence rate and inflation ratio showed better school-breakfast report accuracy for the classroom than for cafeteria location for each prompt, but report rate showed the opposite. For each RI, correspondence rate and inflation ratio showed better accuracy for lunch than for breakfast, but report rate showed the opposite. When choosing RI and prompts for recalls, researchers and practitioners should select a short RI to maximise accuracy. Recommendations for prompt selections are less clear. As report rates distort validation-study accuracy conclusions, reporting-error-sensitive measures are recommended.

Effectiveness of Prompts on Fourth-Grade Children's Dietary Recall Accuracy Depends on Retention Interval and Varies by Gender

BACKGROUND

Dietary recall accuracy is related to retention interval (RI) (i.e., time between to-be-reported meals and the interview), and possibly to prompts. To the best of our knowledge, no study has evaluated their combined effect.

OBJECTIVE

The combined influence of RI and prompts on children's recall accuracy was investigated in this study. Two RIs [short (prior-24-h recall obtained in afternoon) and long (previous-day recall obtained in morning)] were crossed with 4 prompts [forward (distant-to-recent), meal-name (breakfast, lunch, etc.), open (no instructions), and reverse (recent-to-distant)], creating 8 conditions.

METHODS

Fourth-grade children (n = 480; 50% girls) were randomly selected from consenting children at 10 schools in 4 districts in a southern state during 3 school years (2011-2012, 2012-2013, and 2013-2014). Each child was observed eating school-provided breakfast and lunch, and interviewed one time under 1 of the 8 conditions. Condition assignment was constrained so that each had 60 children (30 girls). Accuracy measures were food-item omission and intrusion rates, and energy correspondence rate and inflation ratio. For each measure, linear models determined effects of RI, prompt, gender, and interactions (2-way, 3-way); race/ethnicity, school year, and district were control variables.

RESULTS

RI (P values < 0.015) and prompt (P values < 0.005) were significant for all 4 accuracy measures. RI × prompt (P values < 0.001) was significant for 3 accuracy measures (not intrusion rate). Prompt × gender (P = 0.005) was significant for omission rate. RI × prompt × gender was significant for intrusion rate and inflation ratio (P values < 0.001). For the short vs. long RI across prompts and genders, accuracy was better by 33-50% for each accuracy measure.

CONCLUSIONS

To obtain the most accurate recalls possible from children, studies should be designed to use a short rather than long RI. Prompts affect children's recall accuracy, although the effectiveness of different prompts depends on RI and varies by gender: at a short RI, the choice of prompts has little systematic effect on accuracy, whereas at a long RI, reverse prompts may elicit the most accurate recalls.

The Automated Self-Administered 24-Hour Dietary Recall for Children, 2012 Version, for Youth Aged 9 to 11 Years: A Validation Study

BACKGROUND

Valid methods of diet assessment are important for nutrition research and practice, but can be difficult with children.

OBJECTIVE

To validate the 2012 version of the Automated Self-Administered 24-Hour Dietary Recall for Children (ASA24-Kids-2012), a self-administered web-based 24-hour dietary recall (24hDR) instrument, among children aged 9 to 11 years, in two sites.

DESIGN

Quasiexperimental.

PARTICIPANTS/SETTING

In one site, trained staff members observed and recorded foods and drinks consumed by children (n=38) during school lunch. The next day, the observed children completed both ASA24-Kids-2012 and an interviewer-administered 24hDR in a randomized order. Procedures in a second site (n=31) were similar, except observations occurred during dinner in a community location.

STATISTICAL ANALYSES

Foods were classified as matches (reported and consumed), intrusions (reported, but not consumed), or omissions (not reported, but consumed) for each participant. Rates of matches, intrusions, and omissions were calculated. Rates were compared between each recall method using repeated measures analysis of covariance. For matched foods, the authors determined correlation coefficients between observed and reported serving sizes.

RESULTS

Match, intrusion, and omission rates between ASA24-Kids-2012 and observed intakes in Site 1 were 37%, 27%, and 35%, respectively. Comparable rates for interviewer-administered 24hDRs were 57%, 20%, and 23%, respectively. In Site 2, match, intrusion, and omission rates between ASA24-Kids-2012 and observed intakes were 53%, 12%, and 36%, respectively, vs 76% matches, 9% intrusions, and 15% omissions for interviewer-administered 24hDRs. The relationship strength between reported and observed serving sizes for matched foods was 0.18 in Site 1 and 0.09 in Site 2 for ASA24-Kids-2012, and 0.46 in Site 1 and 0.11 in Site 2 for interviewer-administered 24hDRs.

CONCLUSIONS

ASA24-Kids-2012 was less accurate than interviewer-administered 24hDRs when compared with observed intakes, but both performed poorly. Additional research should assess the age at which children can complete recalls without the help of a parent or guardian, as well as elucidate under which circumstances recalls can reasonably be used among children.

A validation study concerning the effects of interview content, retention interval, and grade on children's recall accuracy for dietary intake and/or physical activity

BACKGROUND

Practitioners and researchers are interested in assessing children's dietary intake and physical activity together to maximize resources and minimize subject burden.

OBJECTIVE

Our aim was to investigate differences in dietary and/or physical activity recall accuracy by content (diet only; physical activity only; diet and physical activity), retention interval (same-day recalls in the afternoon; previous-day recalls in the morning), and grade (third; fifth).

DESIGN

Children (n=144; 66% African American, 13% white, 12% Hispanic, 9% other; 50% girls) from four schools were randomly selected for interviews about one of three contents. Each content group was equally divided by retention interval, each equally divided by grade, each equally divided by sex. Information concerning diet and physical activity at school was validated with school-provided breakfast and lunch observations, and accelerometry, respectively. Dietary accuracy measures were food-item omission and intrusion rates, and kilocalorie correspondence rate and inflation ratio. Physical activity accuracy measures were absolute and arithmetic differences for moderate to vigorous physical activity minutes.

STATISTICAL ANALYSES PERFORMED

For each accuracy measure, linear models determined effects of content, retention interval, grade, and their two-way and three-way interactions; ethnicity and sex were control variables.

RESULTS

Content was significant within four interactions: intrusion rate (content×retention-interval×grade; P=0.0004), correspondence rate (content×grade; P=0.0004), inflation ratio (content×grade; P=0.0104), and arithmetic difference (content×retention-interval×grade; P=0.0070). Retention interval was significant for correspondence rate (P=0.0004), inflation ratio (P=0.0014), and three interactions: omission rate (retention-interval×grade; P=0.0095), intrusion rate, and arithmetic difference (both already mentioned). Grade was significant for absolute difference (P=0.0233) and five interactions mentioned. Content effects depended on other factors. Grade effects were mixed. Dietary accuracy was better with same-day than previous-day retention interval.

CONCLUSIONS

Results do not support integrating dietary intake and physical activity in children's recalls, but do support using shorter rather than longer retention intervals to yield more accurate dietary recalls. Additional validation studies need to clarify age effects and identify evidence-based practices to improve children's accuracy for recalling dietary intake and/or physical activity.

Adaptation and validation of an FFQ for 6-10-year-old children

OBJECTIVE

To adapt and test the relative validity of an instrument measuring the usual food intake of 6-10-year-old children.

DESIGN

An FFQ encompassing the preceding 6 months was adapted and compared with the average of three 24 h dietary recalls.

SETTING

Private and public schools in Porto Alegre, capital city of Rio Grande do Sul, the southernmost state in Brazil, with 1·5 million inhabitants.

SUBJECTS

Children aged 6-10 years attending grades 1-4 in private and public schools in Porto Alegre.

RESULTS

Ninety-one children were studied. The FFQ overestimated all nutrients. Correlations with the values obtained by 24 h dietary recalls were mostly above 0·50. The deattenuated correlations increased for all nutrients. The κ coefficients for the adjusted nutrients varied from 0·12 (weak) to 0·34 (reasonable). Graphically, the FFQ was shown to underestimate some of the parameters and to overestimate others, with a wide CI for all nutrients.

CONCLUSIONS

The FFQ does not have the required relative validity to classify the intake levels of schoolchildren, and further investigation is required to understand the sources of error.

Validation of a group-administered pictorial dietary recall with 9- to 11-year-old children

OBJECTIVE

Determine validity of Day in the Life Questionnaire-Colorado (DILQ-CO) as a dietary assessment tool for classroom-administered use.

METHODS

Agreement between DILQ-CO responses and weighed plate waste measured in 125 fourth-grade students in 2 low-income schools. Validity assessed by comparing reported school lunch items and portion size estimations on DILQ-CO to plate waste. Agreement calculated using Spearman correlations, κ statistic, percent agreement, exclusions, intrusions, and mismatches.

RESULTS

Substantial-to-almost-perfect agreements for students' reports of food eaten in all but the dessert category (κ coefficients: 0.65-0.97; 81%-99% matches). Significant correlations (P ≤ .05) were found between students' reports of how much was eaten and plate waste measurements for 6 of 10 items; agreement ranged from 47%-82%.

CONCLUSIONS AND IMPLICATIONS

Classroom-administered DILQ-CO provided a valid measure of reported school lunch items, with amounts reported eaten of lower but still acceptable agreement. This tool shows promise as a group-administered dietary recall with children.

Shortening the retention interval of 24-hour dietary recalls increases fourth-grade children's accuracy for reporting energy and macronutrient intake at school meals

BACKGROUND

Accurate information about children's intake is crucial for national nutrition policy and for research and clinical activities. To analyze accuracy for reporting energy and nutrients, most validation studies utilize the "conventional approach," which was not designed to capture errors of reported foods and amounts. The "reporting-error-sensitive approach" captures errors of reported foods and amounts.

OBJECTIVE

To extend results to energy and macronutrients for a validation study concerning retention interval (elapsed time between to-be-reported meals and the interview) and accuracy for reporting school-meal intake, the conventional and reporting-error-sensitive approaches were compared. DESIGN AND PARTICIPANTS/SETTING: Fourth-grade children (n=374) were observed eating two school meals, and interviewed to obtain a 24-hour recall using one of six interview conditions from crossing two target periods (prior 24 hours and previous day) with three interview times (morning, afternoon, and evening). Data were collected in one district during three school years (2004-2005, 2005-2006, and 2006-2007).

MAIN OUTCOME MEASURES

Report rates (reported/observed), correspondence rates (correctly reported/observed), and inflation ratios (intruded/observed) were calculated for energy and macronutrients.

STATISTICAL ANALYSES PERFORMED

For each outcome measure, mixed-model analysis of variance was conducted with target period, interview time, their interaction, and sex in the model; results were adjusted for school year and interviewer.

RESULTS

With the conventional approach, report rates for energy and macronutrients did not differ by target period, interview time, their interaction, or sex. With the reporting-error-sensitive approach, correspondence rates for energy and macronutrients differed by target period (four P values <0.0001) and the target period by interview-time interaction (four P values <0.0001); inflation ratios for energy and macronutrients differed by target period (four P values <0.0001), and inflation ratios for energy and carbohydrate differed by the target period by interview-time interaction (both P values <0.005).

CONCLUSIONS

Shortening the retention interval of dietary recalls increases accuracy for reporting energy and macronutrients. For validation studies, it is best to obtain reference information from a method that provides details about foods and amounts consumed and to use an analytic approach that captures errors of reported foods and amounts.

Fourth-grade children's dietary recall accuracy for energy intake at school meals differs by social desirability and body mass index percentile in a study concerning retention interval

Data from a study concerning retention interval and school-meal observation on children's dietary recalls were used to investigate relationships of social desirability score (SDS) and body mass index percentile (BMI%) to recall accuracy for energy for observed (n = 327) children, and to reported energy for observed and unobserved (n = 152) children. Report rates (reported/observed) correlated negatively with SDS and BMI%. Correspondence rates (correctly reported/observed) correlated negatively with SDS. Inflation ratios (overreported/observed) correlated negatively with BMI%. The relationship between reported energy and each of SDS and BMI% did not depend on observation status. Studies utilizing children's dietary recalls should assess SDS and BMI%.

Accuracy of children's school-breakfast reports and school-lunch reports (in 24-h dietary recalls) differs by retention interval

BACKGROUND/OBJECTIVES

Validation-study data were analyzed to investigate the effect of retention interval (time between the to-be-reported meal and interview) on accuracy of children's school-breakfast reports and school-lunch reports in 24-h recalls, and to compare accuracy of children's school-breakfast reports for two breakfast locations (classroom; cafeteria).

SUBJECTS/METHODS

Each of 374 fourth-grade children was interviewed to obtain a 24-h recall using one of six conditions from crossing two target periods (prior 24 h; previous day) with three interview times (morning; afternoon; evening). Each condition had 62 or 64 children (half boys). A recall's target period included one school breakfast and one school lunch, for which the child had been observed. Food-item variables (observed number; reported number; omission rate; intrusion rate) and energy variables (observed; reported; report rate; correspondence rate; inflation ratio) were calculated for each child for school breakfast and school lunch separately.

RESULTS

Accuracy for school-breakfast reports and school-lunch reports was inversely related to retention interval. Specifically, as indicated by smaller omission rates, smaller intrusion rates, larger correspondence rates and smaller inflation ratios, accuracy for school-breakfast reports was best for prior-24-h recalls in the morning, and accuracy for school-lunch reports was best for prior-24-h recalls in the afternoon. For neither school meal was a significant sex effect found for any variable. For school-breakfast reports, there was no significant school-breakfast location effect for any variable.

CONCLUSIONS

By shortening the retention interval, accuracy can be improved for school-breakfast reports and school-lunch reports in children's 24-h recalls.

Fourth-grade children's dietary recall accuracy is influenced by retention interval (target period and interview time)

BACKGROUND

For a 24-hour dietary recall, two possible target periods are the prior 24 hours (24 hours immediately preceding the interview time) and previous day (midnight to midnight of the day before the interview), and three possible interview times are morning, afternoon, and evening. Target period and interview time determine the retention interval (elapsed time between to-be-reported meals and the interview), which, along with intervening meals, can influence reporting accuracy.

OBJECTIVE

The effects of target period and interview time on children's accuracy for reporting school meals during 24-hour dietary recalls were investigated. DESIGN AND SUBJECTS/SETTING: During the 2004-2005, 2005-2006, and 2006-2007 school years in Columbia, SC, each of 374 randomly selected fourth-grade children (96% African American) was observed eating two consecutive school meals (breakfast and lunch) and interviewed to obtain a 24-hour dietary recall using one of six conditions defined by crossing two target periods with three interview times. Each condition had 62 or 64 children (half boys).

MAIN OUTCOME MEASURES

Accuracy for reporting school meals was quantified by calculating rates for omissions (food items observed eaten but unreported) and intrusions (food items reported eaten but unobserved); a measure of total inaccuracy combined errors for reporting food items and amounts.

STATISTICAL ANALYSES PERFORMED

For each accuracy measure, analysis of variance was conducted with target period, interview time, their interaction, sex, interviewer, and school year in the model.

RESULTS

There was a target-period effect and a target-period by interview-time interaction on omission rates, intrusion rates, and total inaccuracy (six P values <0.004). For prior-24-hour recalls compared to previous-day recalls, and for prior-24-hour recalls in the afternoon and evening compared to previous-day recalls in the afternoon and evening, omission rates were better by one third, intrusion rates were better by one half, and total inaccuracy was better by one third.

CONCLUSIONS

To enhance children's dietary recall accuracy, target periods and interview times that minimize the retention interval should be chosen.

Cognitive processes in children's dietary recalls: insight from methodological studies

BACKGROUND/OBJECTIVES

This article summarizes 12 dietary-reporting methodological studies with children (six validation studies, one non-validation study, five secondary analyses studies of data from one or more of the six validation studies), identifies research gaps and provides recommendations for (a) improving children's recall accuracy and (b) details to specify in publications of studies that utilize children's dietary recalls.

SUBJECTS/METHODS

Randomly selected children (aged 9-10 years) were observed eating school breakfast and school lunch, and interviewed to obtain dietary recalls.

RESULTS

Children's recall accuracy improved slightly between the first and third recalls, but an individual child's accuracy was inconsistent from one interview to the next. Although accuracy was poor overall, it was better for boys with reverse-order (evening-to-morning) prompts and for girls with forward-order (morning-to-evening) prompts. Children recalled breakfast intake less accurately than lunch intake. Children's accuracy did not depend on whether recalls were obtained in person or by telephone, but was better for recalls obtained with an open format than a meal format. Retention interval was crucial as children's accuracy was better for prior-24-h recalls (about the 24 h immediately preceding the interview) than for previous-day recalls (about midnight to midnight of the day before the interview). Observations of school meals did not affect children's recalls. Children's recall accuracy was related to their age/sex body mass index percentile. Conventional report rates (which disregard accuracy for items and amounts) overestimated accuracy for energy and macronutrients, and masked complexities of recall error.

CONCLUSIONS

Research concerning errors in children's dietary recalls provides insight for improving children's recall accuracy.

Children's Dietary Recalls from Three Validation Studies: Types of Intrusion Vary with Retention Interval

Using previously collected data of fourth-grade children observed eating school meals and then interviewed, we categorized intrusions (food items reported but not observed eaten) as stretches (on the child's tray) or confabulations (not on the child's tray). We investigated intrusions, confabulations, and stretches, and the role of liking, at different retention intervals (morning interviews about the previous day's intake; evening interviews about that day's intake) and under different reporting-order prompts (forward; reverse). As retention interval between consumption and report increased, the likelihood 1) increased that reported items were intrusions, that reported items were confabulations, and that intrusions were confabulations; and 2) was constant that reported items were stretches. Results concerning reporting-order prompts were inconclusive. Liking ratings were higher for matches (reports of items observed eaten) than stretches, for confabulations than stretches, and for matches than omissions (unreported items observed eaten), but did not vary by retention interval or reporting-order prompts.

Origins of intrusions in children's dietary recalls: data from a validation study concerning retention interval and information from school food-service production records

OBJECTIVE

To use data from a published validation study concerning retention interval and school food-service production records to examine intrusions (uneaten items reported eaten) in the school-meal parts of 24 h recalls.

DESIGN

For that study, children were observed eating two school meals (breakfast, lunch) and interviewed under one of six conditions from two target periods (previous day (PDTP), prior 24 h (24TP)) crossed with three interview times (morning, afternoon (AIT), evening). For the present article, a catalogue was constructed of foods available for that study's school meals. The study's intrusions were classified as stretches (on children's meal trays but uneaten), internal confabulations (in children's school food-service environments for that meal but not on children's trays) or external confabulations (not in children's school food-service environments for that meal). Occurrence, types and amounts of intrusions were investigated.

SETTING/SUBJECTS

Six schools; sixty fourth-grade children (ten per condition).

RESULTS

For breakfast, for the 24TP v. PDTP, reported items were less likely to be intrusions, internal confabulations and external confabulations; and intrusions were more likely to be stretches. For lunch, for the 24TP-AIT condition v. the other five conditions, reported items were less likely to be intrusions and external confabulations. Mean amounts reported eaten were smaller for stretches than for internal confabulations or external confabulations at breakfast, and for stretches than for internal confabulations at lunch.

CONCLUSIONS

Accuracy was better for the 24TP (with fewer intrusions of which proportionally more were stretches which had smaller amounts reported eaten) than for the PDTP. Studies with 24 h recalls should minimize retention interval to improve accuracy.

Insight into the origins of intrusions (reports of uneaten food items) in children's dietary recalls, based on data from a validation study of reporting accuracy over multiple recalls and school foodservice production records

BACKGROUND

Intrusions in dietary recalls may originate in confusion of episodic memories manifested as temporal dating errors.

OBJECTIVE

Data from a validation study (concerning reporting accuracy over multiple recalls) and school foodservice production records were used to investigate origins of intrusions in school meals in children's 24-hour recalls. DESIGN/SUBJECTS/SETTING: During the 1999-2000 school year, 104 fourth-grade children were observed eating school meals on 1 to 3 nonconsecutive days separated by >or=25 days, and interviewed about the previous day's intake in the morning on the day after each observation day.

STATISTICAL ANALYSES PERFORMED

For breakfast and lunch separately, logistic regression was used to investigate the effect of time (ie, days) before the interview day on the probability that intrusions referred to items available in the school foodservice environment. Exploratory analyses were conducted for breakfast options observed and/or reported eaten.

RESULTS

For interviews in which reported meals met criteria to be considered school meals and that contained intrusions, of 634 and 699 items reported eaten at breakfast and lunch, respectively, 394 and 331 were intrusions. Availability in the school foodservice environment of items referred to by intrusions in reports of lunch, but not breakfast, decreased as days increased before the interview day (P=0.031 and P=0.285, respectively). Concerning breakfast, children observed eating a cold option (ie, ready-to-eat cereal, milk, juice, crackers [graham or animal]) almost always reported a cold option, whereas children observed eating a hot option (ie, non-ready-to-eat cereal entrée [eg, sausage biscuit], milk, and fruit or juice) reported a cold option in approximately 50% of interviews.

CONCLUSIONS

In children's 24-hour recalls, confusion of episodic memories contributes to intrusions in school lunch, and generic dietary information (eg, cold option items available daily) or confusion of episodic memories may contribute to intrusions in school breakfast. Understanding the origins of intrusions may help in developing interview methods to decrease the occurrence of intrusions.