scholarly journals Uses and limitations of statistical accounting for random error correlations, in the validation of dietary questionnaire assessments

2002 ◽  
Vol 5 (6a) ◽  
pp. 969-976 ◽  
Author(s):  
Rudolf Kaaks ◽  
Pietro Ferrari ◽  
Antonio Ciampi ◽  
Martyn Plummer ◽  
Elio Riboli
Keyword(s):  
Random Error ◽  
Statistical Models ◽  
Validation Studies ◽  
Dietary Assessment ◽  
Nutritional Epidemiology ◽  
Random Errors ◽  
Doubly Labelled Water ◽  
Dietary Assessment Methods ◽  
Simultaneous Comparisons ◽  
Replicate Measurements

AbstractObjective:To examine statistical models that account for correlation between random errors of different dietary assessment methods, in dietary validation studies.Setting:In nutritional epidemiology, sub-studies on the accuracy of the dietary questionnaire measurements are used to correct for biases in relative risk estimates induced by dietary assessment errors. Generally, such validation studies are based on the comparison of questionnaire measurements (Q) with food consumption records or 24-hour diet recalls (R). In recent years, the statistical analysis of such studies has been formalised more in terms of statistical models. This made the need of crucial model assumptions more explicit. One key assumption is that random errors must be uncorrelated between measurements Q and R, as well as between replicate measurements R1 and R2 within the same individual. These assumptions may not hold in practice, however. Therefore, more complex statistical models have been proposed to validate measurements Q by simultaneous comparisons with measurements R plus a biomarker M, accounting for correlations between the random errors of Q and R.Conclusions:The more complex models accounting for random error correlations may work only for validation studies that include markers of diet based on physiological knowledge about the quantitative recovery, e.g. in urine, of specific elements such as nitrogen or potassium, or stable isotopes administered to the study subjects (e.g. the doubly labelled water method for assessment of energy expenditure). This type of marker, however, eliminates the problem of correlation of random errors between Q and R by simply taking the place of R, thus rendering complex statistical models unnecessary.

scholarly journals Evaluating the quality of dietary intake validation studies

2009 ◽  
Vol 102 (S1) ◽  
pp. S3-S9 ◽  
Author(s):  
Lluis Serra-Majem ◽  
Lene Frost Andersen ◽  
Patricia Henríque-Sánchez ◽  
Jorge Doreste-Alonso ◽  
Almudena Sánchez-Villegas ◽  
...  
Keyword(s):  
Dietary Intake ◽  
Validation Studies ◽  
Scoring System ◽  
Dietary Assessment ◽  
Quality Score ◽  
Assessment Methods ◽  
Nutritional Epidemiology ◽  
Supplement Use ◽  
Dietary Assessment Methods

Within the EURopean micronutrient RECommendations Aligned Network of Excellence (EURRECA), a scoring system was developed to assess the quality of dietary intake validation studies. The scoring system included three steps. The first step was to give each study a quality score, which included five components: sample size, statistics used, data collection procedure, consideration of seasonality and supplement use. Scores ranged from 0 to 7, and validation studies classified as very good ( ≥ 5), good (5–3·5), acceptable/reasonable (3·5–2·5) and poor ( < 2·5). The second and third steps included an adjustment/weighting of the correlation coefficient according to the quality score and moreover a rating of the adjusted/weighted correlation. The scoring system was tested in 124 validation studies that included at least one vitamin. Only 5·6 % of the 124 studies were judged to be of very good quality according to the quality score, 41·9 % of good quality and 16·9 % had a poor rating. When adjusting for the study quality scores, crude and adjusted mean correlations of vitamins A, C, D and E intakes were similar, but the percentage of correlation values classified as poor or very good was higher after adjustment. These results show the importance of considering the quality of studies validating dietary assessment methods and the correlations obtained for the micronutrient of interest when interpreting effects observed in epidemiological studies using dietary assessment methods. Without a doubt, this subject constitutes a key topic for research in nutritional epidemiology.

scholarly journals Measuring energy, macro and micronutrient intake in UK children and adolescents: a comparison of validated dietary assessment tools

BMC Nutrition ◽  
2019 ◽  
Vol 5 (1) ◽  
Author(s):  
Linda A. Bush ◽  
Jayne Hutchinson ◽  
Jozef Hooson ◽  
Marisol Warthon-Medina ◽  
Neil Hancock ◽  
...  
Keyword(s):  
Systematic Review ◽  
Children And Adolescents ◽  
Validation Studies ◽  
Dietary Assessment ◽  
Assessment Tools ◽  
Food Diary ◽  
Doubly Labelled Water ◽  
Validation Data ◽  
Review Of Reviews ◽  
The Uk

Abstract Background Measuring dietary intake in children and adolescents can be challenging due to misreporting, difficulties in establishing portion size and reliance on recording dietary data via proxy reporters. The aim of this review was to present results from a recent systematic review of reviews reporting and comparing validated dietary assessment tools used in younger populations in the UK. Methods Validation data for dietary assessment tools used in younger populations (≤18 years) were extracted and summarised using results from a systematic review of reviews of validated dietary assessment tools. Mean differences and Bland-Altman limits of agreement (LOA) between the test and reference tool were extracted or calculated and compared for energy, macronutrients and micronutrients. Results Seventeen studies which reported validation of 14 dietary assessment tools (DATs) were identified with relevant nutrition information. The most commonly validated nutrients were energy, carbohydrate, protein, fat, calcium, iron, folate and vitamin C. There were no validated DATs reporting assessment of zinc, iodine or selenium intake. The most frequently used reference method was the weighed food diary, followed by doubly labelled water and 24 h recall. Summary plots were created to facilitate comparison between tools. On average, the test tools reported higher mean intakes than the reference methods with some studies consistently reporting wide LOA. Out of the 14 DATs, absolute values for LOA and mean difference were obtained for 11 DATs for EI. From the 24 validation results assessing EI, 16 (67%) reported higher mean intakes than the reference. Of the seven (29%) validation studies using doubly labelled water (DLW) as the reference, results for the test DATs were not substantially better or worse than those using other reference measures. Further information on the studies from this review is available on the www.nutritools.org website. Conclusions Validated dietary assessment tools for use with children and adolescents in the UK have been identified and compared. Whilst tools are generally validated for macronutrient intakes, micronutrients are poorly evaluated. Validation studies that include estimates of zinc, selenium, dietary fibre, sugars and sodium are needed.

scholarly journals Validity of Absolute Intake and Nutrient Density of Protein, Potassium, and Sodium Assessed by Various Dietary Assessment Methods: An Exploratory Study

Nutrients ◽  
2019 ◽  
Vol 12 (1) ◽  
pp. 109
Author(s):  
Laura Trijsburg ◽  
Anouk Geelen ◽  
Paul J.M. Hulshof ◽  
Pieter van’t Veer ◽  
Hendriek C. Boshuizen ◽  
...  
Keyword(s):  
Total Energy ◽  
Measurement Errors ◽  
Sodium Intake ◽  
Dietary Assessment ◽  
Dietary Exposure ◽  
Assessment Methods ◽  
Doubly Labelled Water ◽  
Web Based ◽  
Dietary Assessment Methods ◽  
Nutrient Density

It is suggested that nutrient densities are less affected by measurement errors than absolute intake estimates of dietary exposure. We compared the validity of absolute intakes and densities of protein (kJ from protein/total energy (kJ)), potassium, and sodium (potassium or sodium (in mg)/total energy (kJ)) assessed by different dietary assessment methods. For 69 Dutch subjects, two duplicate portions (DPs), five to fifteen 24-h dietary recalls (24 hRs, telephone-based and web-based) and two food frequency questionnaires (FFQs) were collected and compared to duplicate urinary biomarkers and one or two doubly labelled water measurements. Multivariate measurement error models were used to estimate validity coefficients (VCs) and attenuation factors (AFs). This research showed that group bias diminished for protein and sodium densities assessed by all methods as compared to the respective absolute intakes, but not for those of potassium. However, the VCs and AFs for the nutrient densities did not improve compared to absolute intakes for all four methods; except for the AF of sodium density (0.71) or the FFQ which was better than that of the absolute sodium intake (0.51). Thus, using nutrient densities rather than absolute intakes does not necessarily improve the performance of the DP, FFQ, or 24 hR.

scholarly journals Comparison of dietary assessment methods in nutritional epidemiology: weighed records v. 24 h recalls, food-frequency questionnaires and estimated-diet records

1994 ◽  
Vol 72 (4) ◽  
pp. 619-643 ◽  
Author(s):  
S. A. Bingham ◽  
C. Gill ◽  
A. Welch ◽  
K. Day ◽  
A. Cassidy ◽  
...  
Keyword(s):  
Dietary Assessment ◽  
Assessment Methods ◽  
Portion Size ◽  
Nutritional Epidemiology ◽  
Food Diary ◽  
Individual Values ◽  
Food Frequency ◽  
Dietary Assessment Methods ◽  
Diet Records ◽  
Habitual Diet

Women (n 160) aged 50 to 65 years were asked to weigh their food for 4 d on four occasions over the period of 1 year, using the PETRA (Portable Electronic Tape Recorded Automatic) scales. Throughout the year, they were asked to complete seven other dietary assessment methods: a simple 24 h recall, a structured 24 h recall with portion size assessments using photographs, two food-frequency questionnaires, a 7 d estimated record or open-ended food diary, a structured food-frequency (menu) record, and a structured food-frequency (menu) record with portion sizes assessed using photographs. Comparisons between the average of the 16 d weighed records and the first presentation of each method indicated that food-frequency questionnaires were not appreciably better at placing individuals in the distribution of habitual diet than 24 h recalls, due partly to inaccuracies in the estimation of frequency of food consumption. With a 7 d estimated record or open-ended food diary, however, individual values of nutrients were most closely associated with those obtained from 16 d weighed records, and there were no significant differences in average food or nutrient intakes.

Experimental Design and Statistical Methods for Improved Hit Detection in High-Throughput Screening

2010 ◽  
Vol 15 (8) ◽  
pp. 990-1000 ◽  
Author(s):  
Nathalie Malo ◽  
James A. Hanley ◽  
Graeme Carlile ◽  
Jing Liu ◽  
Jerry Pelletier ◽  
...  
Keyword(s):  
Experimental Design ◽  
High Throughput ◽  
Random Error ◽  
Statistical Models ◽  
False Positive ◽  
High Throughput Screening ◽  
Operating Characteristic ◽  
Simulated Data ◽  
True Positive ◽  
Replicate Measurements

Identification of active compounds in high-throughput screening (HTS) contexts can be substantially improved by applying classical experimental design and statistical inference principles to all phases of HTS studies. The authors present both experimental and simulated data to illustrate how true-positive rates can be maximized without increasing false-positive rates by the following analytical process. First, the use of robust data preprocessing methods reduces unwanted variation by removing row, column, and plate biases. Second, replicate measurements allow estimation of the magnitude of the remaining random error and the use of formal statistical models to benchmark putative hits relative to what is expected by chance. Receiver Operating Characteristic (ROC) analyses revealed superior power for data preprocessed by a trimmed-mean polish method combined with the RVM t-test, particularly for small- to moderate-sized biological hits.

scholarly journals BMI was found to be a consistent determinant related to misreporting of energy, protein and potassium intake using self-report and duplicate portion methods

2016 ◽  
Vol 20 (4) ◽  
pp. 598-607 ◽  
Author(s):  
Laura Trijsburg ◽  
Anouk Geelen ◽  
Peter CH Hollman ◽  
Paul JM Hulshof ◽  
Edith JM Feskens ◽  
...  
Keyword(s):  
Regression Analysis ◽  
Linear Regression ◽  
Dietary Intake ◽  
Dietary Assessment ◽  
Linear Regression Analysis ◽  
Assessment Methods ◽  
Self Report ◽  
Doubly Labelled Water ◽  
Dietary Assessment Methods ◽  
Duplicate Portion

AbstractObjectiveAs misreporting, mostly under-reporting, of dietary intake is a generally known problem in nutritional research, we aimed to analyse the association between selected determinants and the extent of misreporting by the duplicate portion method (DP), 24 h recall (24hR) and FFQ by linear regression analysis using the biomarker values as unbiased estimates.DesignFor each individual, two DP, two 24hR, two FFQ and two 24 h urinary biomarkers were collected within 1·5 years. Also, for sixty-nine individuals one or two doubly labelled water measurements were obtained. The associations of basic determinants (BMI, gender, age and level of education) with misreporting of energy, protein and K intake of the DP, 24hR and FFQ were evaluated using linear regression analysis. Additionally, associations between other determinants, such as physical activity and smoking habits, and misreporting were investigated.SettingThe Netherlands.SubjectsOne hundred and ninety-seven individuals aged 20–70 years.ResultsHigher BMI was associated with under-reporting of dietary intake assessed by the different dietary assessment methods for energy, protein and K, except for K by DP. Men tended to under-report protein by the DP, FFQ and 24hR, and persons of older age under-reported K but only by the 24hR and FFQ. When adjusted for the basic determinants, the other determinants did not show a consistent association with misreporting of energy or nutrients and by the different dietary assessment methods.ConclusionsAs BMI was the only consistent determinant of misreporting, we conclude that BMI should always be taken into account when assessing and correcting dietary intake.

scholarly journals Dietary assessment methods for intakes of iron, calcium, selenium, zinc and iodine

2009 ◽  
Vol 102 (S1) ◽  
pp. S38-S55 ◽  
Author(s):  
Lluis Serra-Majem ◽  
Karina Pfrimer ◽  
Jorge Doreste-Alonso ◽  
Lourdes Ribas-Barba ◽  
Almudena Sánchez-Villegas ◽  
...  
Keyword(s):  
Dietary Intake ◽  
Validation Studies ◽  
Quality Index ◽  
Dietary Assessment ◽  
Correlation Coefficients ◽  
Reference Method ◽  
Assessment Methods ◽  
Inclusion Criteria ◽  
Dietary Assessment Methods ◽  
Dietary Records

The EURopean micronutrient RECommendations Aligned (EURRECA) Network of Excellence is working towards developing aligned micronutrient recommendations across Europe. The purpose of the present study was to conduct a review of methods used in validation studies carried out in adults assessing dietary intake of EURRECA priority minerals. A search strategy and inclusion criteria were defined and a scoring system was developed to rate the quality of each validation study that produced a quality index with possible scores obtained ranging from 0·5 to 7. A MEDLINE and EMBASE literature review was conducted. Articles/validation studies meeting the inclusion criteria included: 79/88 for Fe; 95/104 for Ca; 13/15 for Se; 29/30 for Zn; 7/9 for iodine. The most frequently used method to ascertain dietary intake was the Food Frequency Questionnaire (FFQ), whereas dietary records (DR) and 24 h recalls were the most used reference methods. The correlation coefficients (CC) between study mineral intakes estimated by FFQ and the reference method were weighted according to the study's quality index and obtained acceptable to good ratings, ranging from 0·36 to 0·60 when the reference method was DR and from 0·41 to 0·58 when the reference was 24 h recalls. A minority of studies (n9) used biomarkers for validation and among these, five included iodine obtaining a CC of 0·47. The FFQ was seen as a valid method for assessing mineral intake, particularly for Ca and, to a lower extent, for iodine and Zn. Se and Fe showed only acceptable correlations. The present review provides new insights regarding the characteristics that assessment methods for dietary mineral intakes should fulfil.

scholarly journals Misreporting of energy and micronutrient intake estimated by food records and 24 hour recalls, control and adjustment methods in practice

2009 ◽  
Vol 101 (S2) ◽  
pp. S73-S85 ◽  
Author(s):  
Kamila Poslusna ◽  
Jiri Ruprich ◽  
Jeanne H. M. de Vries ◽  
Marie Jakubikova ◽  
Pieter van't Veer
Keyword(s):  
Energy Intake ◽  
Nutrient Intake ◽  
Literature Search ◽  
Dietary Assessment ◽  
Systematic Literature Search ◽  
Good Tool ◽  
Doubly Labelled Water ◽  
Food Records ◽  
Dietary Assessment Methods ◽  
Micronutrient Intake

In order to assess nutritional adequacy, valid estimates of nutrient intake are required. One of the main errors in dietary assessment is misreporting. The objective was to review the extent, nature and determinants of misreporting in dietary assessment, how this affects reported intakes of micronutrients and how this is identified and measured, and to identify the best ways of dealing with misreporting when interpreting results. A systematic literature search was conducted for studies of misreporting of dietary intake in adults by 24 hour recalls or by estimated or weighed food records, published up to March 2008. Thirty-seven relevant studies were identified. Possible causes of misreporting were identified. Methods most used to identify misreporting were the Goldberg cut-off (46 % studies) and the doubly labelled water technique (24 % studies). The magnitude of misreporting of energy intake was similar in all three dietary assessment methods. The percentage of under-reporters was about 30 % and energy intake was underestimated by approximately 15 %. Seven papers presented usable data for micronutrient intake. Absolute intakes of Fe, Ca and vitamin C (the three micronutrients addressed in all papers) were on average 30 % lower in low-energy reporters (LER) than that in non-LER and, although results were not consistent, there was a tendency for micronutrient density to be higher in LER. Excluding underreporters or using energy adjustment methods for micronutrient intakes is discussed. Residual method of energy adjustment seems to be a good tool for practice to decrease an influence of misreporting when interpreting results of studies based on food records and 24 hour recalls.

scholarly journals Dietary assessment methods for micronutrient intake in infants, children and adolescents: a systematic review

2009 ◽  
Vol 102 (S1) ◽  
pp. S87-S117 ◽  
Author(s):  
Adriana Ortiz-Andrellucchi ◽  
Patricia Henríquez-Sánchez ◽  
Almudena Sánchez-Villegas ◽  
Luis Peña-Quintana ◽  
Michelle Mendez ◽  
...  
Keyword(s):  
Dietary Intake ◽  
Children And Adolescents ◽  
Validation Studies ◽  
Dietary Assessment ◽  
Correlation Coefficients ◽  
Reference Method ◽  
Serum Levels ◽  
Short Term ◽  
Dietary Assessment Methods

A systematic literature search identified studies validating the methodology used for measuring the usual dietary intake in infants, children and adolescents. The quality of each validation study selected was assessed using a European micronutrient Recommendations Aligned-developed scoring system. The validation studies were categorised according to whether the study used a reference method that reflected short-term intake ( < 7 d), long-term intake ( ≥ 7 d) or used biomarkers. A correlation coefficient for each nutrient was calculated from the mean of the correlation coefficients from each study weighted by the quality of the study. Thirty-two articles were included in the present review: validation studies from infants (1–23 months); child preschool (2–5 years); children (6–12 years); adolescents (13–18 years). Validation of FFQ studies in infants and preschool children using a reference method that reflected short-term intake showed good correlations for niacin, thiamin, vitamins B6, D, C, E, riboflavin, Ca, K, Mg, Fe and Zn (with correlations ranging from 0·55 for vitamin E to 0·69 for niacin).Regarding the reference method reflecting short-term intake in children and adolescents, good correlations were seen only for vitamin C (r 0·61) and Ca (r 0·51). Using serum levels of micronutrient demonstrated that the 3 d weighed dietary records was superior to the FFQ as a tool to validate micronutrient intakes. Including supplement users generally improved the correlations between micronutrient intakes estimated by any of the dietary intake methods and respective biochemical indices.

scholarly journals Bias in dietary-report instruments and its implications for nutritional epidemiology

2002 ◽  
Vol 5 (6a) ◽  
pp. 915-923 ◽  
Author(s):  
Victor Kipnis ◽  
Douglas Midthune ◽  
Laurence Freedman ◽  
Sheila Bingham ◽  
Nicholas E Day ◽  
...  
Keyword(s):  
Measurement Error ◽  
Validation Studies ◽  
Protein Intake ◽  
Dietary Assessment ◽  
Nitrogen Excretion ◽  
Nutritional Epidemiology ◽  
Assessment Instruments ◽  
Systematic Bias ◽  
Nutritional Studies ◽  
The Impact

AbstractObjective:To evaluate measurement error structure in dietary assessment instruments and to investigate its implications for nutritional studies, using urinary nitrogen excretion as a reference biomarker for protein intake.Design:The dietary assessment methods included different food-frequency questionnaires (FFQs) and such conventional dietary-report reference instruments as a series of 24-hour recalls, 4-day weighed food records or 7-day diaries.Setting:Six original pilot validation studies within the European Prospective Investigation of Cancer (EPIC), and two validation studies conducted by the British Medical Research Council (MRC) within the Norfolk cohort that later joined as a collaborative component cohort of EPIC.Subjects:A sample of approximately 100 to 200 women and men, aged 35–74 years, from each of eight validation studies.Results:In assessing protein intake, all conventional dietary-report reference methods violated the critical requirements for a valid reference instrument for evaluating, and adjusting for, dietary measurement error in an FFQ. They displayed systematic bias that depended partly on true intake and partly was person-specific, correlated with person-specific bias in the FFQ. Using the dietary-report methods as reference instruments produced substantial overestimation (up to 230%) of the FFQ correlation with true usual intake and serious underestimation (up to 240%) of the degree of attenuation of FFQ-based log relative risks.Conclusion:The impact of measurement error in dietary assessment instruments on the design, analysis and interpretation of nutritional studies may be much greater than has been previously estimated, at least regarding protein intake.

Sign in / Sign up

Export Citation Format

Share Document