Published on 15.02.12 in Vol 14, No 1 (2012): Jan-Feb
Active-Q: Validation of the Web-Based Physical Activity Questionnaire Using Doubly Labeled Water
Background: Increased use of the Internet provides new opportunities for collecting data in large studies. The aim of our new Web-based questionnaire, Active-Q, is to assess total physical activity and inactivity in adults. Active-Q assesses habitual activity during the past year via questions in four different domains: (1) daily occupation, (2) transportation to and from daily occupation, (3) leisure time activities, and (4) sporting activities.
Objective: The objective of our study is to validate Active-Q’s energy expenditure estimates using the doubly labeled water (DLW) method, and to assess the reproducibility of Active-Q by comparing the results of the questionnaire completed by the same group on two occasions.
Methods: The validity and reproducibility of Active-Q were assessed in a group of 37 individuals, aged 20 to 65 years. Active-Q was distributed via email to the participants. The total energy expenditure of the participants was assessed using DLW for 11 consecutive days.
Results: The median time to complete Active-Q was 6.1 minutes. The majority of participants (27/37, 73%) reported that the questionnaire was “easy” or “very easy” to answer. On average, Active-Q overestimated the total daily energy expenditure by 440 kJ compared with the DLW. The Spearman correlation between the two methods was r = 0.52 (P < .001). The intraclass correlation coefficient for total energy expenditure between the results of Active-Q completed on two occasions was 0.83 (95% CI 0.73-0.93).
Conclusions: Active-Q is a valid and reproducible method of assessing total energy expenditure. It is also a user-friendly method and suitable for Web-based data collection in large epidemiological studies.
J Med Internet Res 2012;14(1):e29
Increased use of the Internet over the past decade provides new opportunities to use Web-based questionnaires in epidemiological studies. Compared to traditional paper-based questionnaires, Web-based alternatives may simplify data collection and improve the quality of data [- ]. The need to design and validate questionnaires specifically for use on the Web has, therefore, increased in recent years. Many Web-based questionnaires used today are directly transferred from printed questionnaires rather than being originally developed for the medium in which they are used. Thus, few take advantage of the potential interactive features offered by the Web. For example, the burden on the respondent can be decreased by using follow-up questions, and errors can be minimized by implementing automatic controls for missing, inconsistent, or anomalous answers [ ].
At present, there are few physical activity questionnaires available specifically developed for the Web. To the best of our knowledge, only one Web-based questionnaire (that assessed lifetime physical activity) has been validated and showed acceptable results . Therefore, we developed a series of interactive questionnaires that assess total physical activity and inactivity in different age groups. The Active-Q questionnaire assesses physical activity and inactivity during the past year in subjects over 18 years.
The primary aim of this study was to test the validity of Active-Q against the doubly labeled water (DLW) method, the criterion standard for measuring energy expenditure . Furthermore, the reproducibility of Active-Q was assessed by comparing the results obtained from the questionnaire on two separate occasions.
Study participants of both sexes, aged 20 to 65 years, were recruited in April of 2009 through public advertisements (including advertisements on the campuses of three universities) around Stockholm, Sweden. Participants were required to have an email address and access to the Internet. Exclusion criteria were any form of weight alteration diet, pregnancy, or having given birth during the ten months prior to the start of the study. Participants were provided with written and verbal information about the study. All participants gave their written informed consent prior to entering the study.
In total, 40 individuals were recruited. Data from three participants were excluded from the analysis because of illness during data collection, incomplete data from the first Active-Q questionnaire (ie, < 1 hour of leisure time activities per day reported), and unreliable DLW data, respectively. After exclusions, data from 37 participants remained for analysis.
illustrates the design of the study procedure. Participants filled out the Active-Q questionnaire on two occasions, separated by two weeks, and their energy expenditure was measured for 11 consecutive days using the DLW method [ ]. On day 1, a baseline urine sample was collected before the participants drank a dose of DLW. Daily urine samples were collected for the next 10 consecutive days. Participants received the first Active-Q questionnaire (Active-Q-I ) 7 days after the start of the study; they received the second questionnaire (Active-Q-II) two weeks later. Questionnaires were distributed via email. Individual usernames and passwords served as unique identifiers in the Web-questionnaire program. Email reminders were sent to participants who had not responded to the questionnaire within two days of it being sent out. After responding to Active-Q-I, participants were asked to evaluate its user-friendliness and self-report their weight, height, level of education, and tobacco use.
The study was approved by the Research Ethics Committee at the Karolinska Institutet, Stockholm, Sweden.
Active-Q is a Web-based questionnaire designed to assess physical activity and inactivity in adults older than 18 years. Respondents are asked to report their habitual activity during the past year. Active-Q covers four different domains: (1) daily occupation, (2) transportation to and from daily occupation, (3) leisure time activities, and (4) regular sporting activities (see). The leisure time domain includes activities such as housework, watching television, and using the computer. Within each domain, activities with similar intensity levels are grouped together as appropriate. Inactivity is assessed by questions about sedentary behavior during daily occupation, and by questions regarding time spent watching television and using a computer during leisure time. The initial questions within the means of transportation to and from daily occupation, leisure time activities, and sporting activities domains are screening questions that list all the activities included in the domain. The participant selects those activities within this list that he or she practices. Follow-up questions about frequency and duration pertain only to those activities selected in the screening question. With the exception of one question (the total number of hours spent in daily occupation), all questions have predefined answers regarding frequency and duration. Respondents report the frequency and duration of leisure time activities they perform at least once per week and sport activities they perform on a regular basis, thus limiting the number of questions for each respondent. shows screenshots of an initial screening question in Active-Q and shows a screenshot of a follow-up question for a selected activity regarding frequency and duration.
In total, Active-Q includes 35 questions with all activities linked to a corresponding Metabolic Equivalent Task (MET) value [, ]. lists the activities included in Active-Q and their corresponding MET values.
Energy expenditure (EE) was estimated based on the assumption that 1 MET equals 1 kcal ∙ kg-1 ∙ h-1 . To calculate the energy expenditure based on the results from Active-Q, MET values assigned to each activity were multiplied by the participants’ weight (kg), the average daily duration of the activity (h/d), and a conversion factor of 4.184, to transform the values from kcal to kJ:
EEactivity (kJ/day) = METactivity ∙ Weight (kg) ∙ Durationactivity (h/d) ∙ 4.184
Total energy expenditure was expressed in terms of the crude total energy expenditure and the total energy expenditure per 24 hours. The crude total energy expenditure was obtained by summing the contributions of energy from each activity in Active-Q. The total energy expenditure over a 24-hour period was calculated by adding eight hours of sleep to the crude results from Active-Q. If the resulting time differed from 24 hours, time was added or subtracted to obtain the adjusted total energy expenditure per 24 hours. A MET value of 2.0 was assumed for the time added and subtracted [, ].
Doubly Labeled Water
Doubly labeled water was used as the criterion measure of total energy expenditure  for 11 consecutive days. The logistics of the study prevented the preparation of individually tailored DLW doses. Instead, two standard doses were prepared adopting a strategy similar to that of Trabulsi et al [ ]. A bulk dose of DLW was made by adding 44 g of2H2O (99.98% sterility tested, CK Gas Products Ltd, Hampshire, UK) to 1 L 10% normalized H218O (SerCon Ltd, Cheshire, UK). Participants gave a baseline urine sample before drinking either 108 g (participants < 75 kg) or 141 g (participants ≥ 75 kg) of the bulk dose depending on their self-reported weight at the beginning of the study. In addition, participants collected 5 ml daily urine samples (excluding the first morning void) on each of the following 10 days. Participants recorded the date and time of each sample collection and kept the samples refrigerated until they were returned to the research team. The research team sent the samples to MRC Human Nutrition Research in Cambridge, UK, for analysis.
The principles for the slightly modified analyses of the isotopic enrichment in the samples have been described in detail in previous studies [, ]. Briefly, for2H analysis, 0.4 ml samples of undistilled urine were equilibrated with hydrogen gas using platinum catalyst rods to promote the rapid exchange between2H and1H. The 3.5-ml sample vials were first flush-filled with hydrogen, producing approximately 3 ml of gas at 1 bar atmosphere, and then equilibrated at 22.0 +0.1°C for 6 hours. Cryogenically dried hydrogen gas from the headspaces of each sample was analyzed using isotope ratio mass spectrometry (Sira10, VG Isogas, Winsford, Cheshire, UK).
Measurements of the18O/16O ratios were made using an AP2003 continuous-flow isotope ratio mass spectrometer (Analytical Precision Ltd, Northwich, Cheshire, UK). Urine samples of 0.5 ml were placed in 10 ml Vacutainers (Labco Ltd, High Wycombe, UK), flush-filled with 5% CO2 in nitrogen and then equilibrated on blood tube rotators overnight at room temperature before analysis. In all cases, analytical standards prepared in-house and traceable to the international standards, Vienna Standard Mean Ocean Water (VSMOW) and Standard Light Arctic Precipitation (SLAP), were included in each batch of samples analyzed.
Total energy expenditure was calculated as described by Schoeller et al  from the slopes and intercepts of the isotope disappearance curves using urine samples collected on days 1-3 and 8-10, respectively. The value of the respiratory quotient was assumed to be 0.85.
Descriptive statistics were used to present the characteristics of the participants. Results are reported as mean values and standard deviations (SD), with the exception of time to respond to the questionnaire, which is presented as the median response time, and results of user-friendliness, which is presented in absolute numbers. For categorical variables or variables with a skewed distribution, Fisher’s exact test was performed to assess potential differences between men and women, and participants < 30 and ≥ 30 years of age. For those continuous variables typically normally distributed (eg, height, weight, and BMI), t tests were used to assess potential differences. The level of significance was set at P < .05.
The degree of association between the total energy expenditure obtained from Active-Q-I, both crude and adjusted to reflect a 24-hour day, and the DLW method, was assessed using Spearman correlation coefficients. Because Spearman correlation coefficients do not detect systematic differences between the methods, we used the Bland-Altman technique  to determine the absolute agreement. The difference in energy expenditure assessed from Active-Q-I (adjusted to reflect a 24-hour period) and DLW was plotted on the y-axis, and the mean values of the two assessments on the x-axis. The limits of agreement, equal to ±2 SD of the mean difference, provide a measure of the variation. The reproducibility of Active-Q was assessed using intraclass correlation coefficients [ ]. The ANOVA estimator of intraclass correlation coefficients was computed. All analyses were performed using STATA 11.1 (STATA Corporation, College Station, TX).
displays the baseline characteristics of the participants included in analysis. Subjects were predominantly female (> 80%) and under the age of 40 (> 70%). The self-reported height and weight resulted in a mean body mass index (BMI) of 23.0 (±3.8) kg/m2. Men were taller (P < .001) and weighed more (P < .001) than women. Subjects ≥ 30 years of age, weighed more (P = .024) and had a higher BMI (P = .007) compared with participants < 30 years of age. No other statistically significant differences were found between sex or age groups.
The median time required to fill out the Active-Q questionnaire on the first occasion was 6 minutes and 6 seconds. On average, the activities reported corresponded to 11 hours and 24 minutes of a typical day (excluding time spent sleeping). In the evaluation of the user-friendliness of the questionnaire, the majority of respondents (27/37, 73%) graded the questionnaire as “easy” or “very easy” to answer. Respondents were also asked to give the questionnaire an overall grade on a scale from 1 (worst) to 5 (best). The majority of respondents (21/37, 57%) graded the questionnaire a 4. An equal number of participants (7/37, 19%), graded the questionnaire a 3 or a 5. The remainder of participants (2/37, 5%) gave the questionnaire a 2. No respondents gave the questionnaire a 1, the worst possible grade. The mean overall grade for Active-Q-I was 3.9 ±0.8. Participants ≥ 30 years graded the questionnaire higher than younger participants (P = .006). No other statistically significant age-related or sex-related differences were seen in the results.
The mean total daily energy expenditure measured with DLW was 11,229 kJ (SD 2256), while the mean energy expenditure from Active-Q-I and Active-Q-II, adjusted to reflect a 24-hour period, was 11,667 kJ (SD 3212) and 11,529 kJ (SD 2758), respectively. The mean crude energy expenditure assessed with Active-Q-I was 7008 kJ (SD 3854). The crude energy expenditure for each domain of Active-Q-I was 2971 kJ (SD 1736) for daily occupation, 434 kJ (SD 388) for transportation, 2243 kJ (SD 1550) for leisure time activities, and 1360 kJ (SD 3044) for regular sporting activities. The mean crude energy expenditure from Active-Q-II was 6439 kJ (SD 2614). The crude energy expenditure for each domain of Active-Q-II was 3005 kJ (SD 1537) for daily occupation, 365 kJ (SD 296) for transportation, 2254 kJ (SD 1880) for leisure time activities, and 815 kJ (SD 761) for regular sporting activities.
The Spearman correlation coefficient between the crude total daily energy expenditure assessed with Active-Q-I and DLW was r = 0.42 (P = .01). After adjusting Active-Q-I for a 24-hour day, the Spearman correlation coefficient increased to r = 0.52 (P < .001).
shows a Bland-Altman plot illustrating the differences in the total energy expenditure during 24 hours assessed with Active-Q-I and DLW. No clear trend (proportional error) can be seen in the plot. Most data points fall within the limits of agreement (±2 SD), although it should be noted that the limits of agreement were wide. The mean difference between the methods of assessment was 440 kJ, with Active-Q overestimating the total daily energy expenditure compared with DLW. According to the Bland-Altman plot, there were two outliers for which Active-Q noticeably overestimated total energy expenditure. One of the outliers reported extreme amounts of sporting activities in Active-Q, while the other had a BMI above 35 kg/m2.
The intraclass correlation coefficient for the crude total energy expenditure assessed from the questionnaire on two occasions was 0.66 (95% CI 0.47-0.84). After adjustments to a 24-hour day, the value increased to 0.83 (95% CI 0.73-0.93).
The results of this study demonstrate that Active-Q is a user-friendly questionnaire that provides valid and reproducible estimates of total energy expenditure when compared with objective DLW measurements, the criterion standard .
The validity and reproducibility of many paper-based physical activity questionnaires in use today are low , although some show reasonable validity [ - ]. The number of questionnaires validated against DLW is limited and, according to two reviews, few studies have shown Spearman correlations above 0.50 [ , ]. However, Besson et al [ ] recently reported a correlation of 0.67. Nevertheless, all questionnaires previously validated against DLW have, to the best of our knowledge, been paper-based and not adapted for the Web, making comparisons with Active-Q difficult.
Important factors in making a questionnaire user-friendly are the length and the level of details in a questionnaire, plus the way in which questions are structured and the order in which they are presented . It is also important to adapt the questionnaire to the medium in which it is to be used for data collection. Web-based questionnaires offer many advantages compared with traditional paper-based questionnaires. The Web allows the use of skip and follow-up patterns, thereby increasing the user-friendliness by creating interactivity, which may reduce dropout [ , ]. Technical features, such as checking the plausibility of answers, decrease the measurement error [ ]. Computerized administration also means reduced costs for data collection and analysis, and facilitates the administration of large studies [ , ]. Active-Q is interactive and takes advantage of follow-up questions with predefined answers, which minimizes the time required to answer the questions and decreases the risk of mistyping. Further, checks for missing answers are implemented in Active-Q, and respondents are prevented from proceeding to the next question in the questionnaire before answering the previous questions.
Today, more than 90% of the population in Sweden between 16 and 74 years of age have access to the Internet at home . Therefore, we do not believe that concerns raised previously regarding high non-response rates and the introduction of selection bias will be a problem when collecting Web-based data in Sweden [ ]. However, it is difficult to draw any conclusions regarding non-response rates and selection bias from this study, as a pre-requisite for participation was access to the Internet and an email address. A previous study comparing response rates to Web- and paper-based dietary questionnaires in Sweden reported that the response rate for paper questionnaires was approximately 15% higher than for Web questionnaires [ ]. However, this study was performed in 2002 and access to, and the use of, the Internet have increased considerably in Sweden during the past decade [ ].
Among Swedish individuals between 16 and 44 years of age, over 97% reported to be frequent users of the Internet compared to 90% for individuals between 45 and 54 years, and 70% for individuals between 55 and 74 years . Although younger individuals are more frequent users of the Internet, the vast majority of the older individuals also use the Internet regularly. Therefore, we believe that a Web-based questionnaire is suitable for a wide age range. However, a larger validation study would clarify how applicable a Web-based questionnaire would be across different age groups.
Ideally, in validation studies, the reference method should reflect the same period of time as the new method being validated. However, habitual physical activity was assessed over a one-year period with Active-Q, while that measured with the DLW method reflects physical activity over 11 days. Repeated reference measures of DLW over a longer period of time would have been preferable, but this was neither practical nor possible in our study setting. Another drawback of this study is that we were only able to validate measures of total energy expenditure. Because the DLW method does not discriminate between different levels of intensity in activity, we were not able to validate Active-Q in this respect. Since different aspects of activity may affect health-related outcomes differently, the ability of Active-Q to accurately assess this needs to be validated in future studies using, for example, accelerometers.
When estimating the total daily energy expenditure with Active-Q, we assumed that all participants slept for eight hours . The true variation in the duration of sleep among individuals may reduce the accuracy of results, leading to an underestimation of validity of Active-Q. In future studies, a question about the average duration of sleep will be added to Active-Q. On average, the participants’ reported total activity time in Active-Q-I was in line with other studies on the Swedish population [ ]. However, even after adjusting for sleep, most participants underestimated the time spent in daily activities in Active-Q, whereas a small proportion overestimated it. Therefore, results were adjusted by adding or subtracting under- or over-reported time to obtain a total of 24 hours in order to make the data comparable to the average total daily energy expenditure obtained from DLW measurements. Missing and overestimated time was adjusted by using a MET value of 2.0. Missing time was assumed to reflect a combination of common activities, such as self-care and preparing and eating meals, and overestimated time to reflect an average MET value of activities included in Active-Q.
The use of published MET values  to represent the energy cost for a specific activity constitutes a limitation in most physical activity questionnaires. The MET value for a specific activity assumes the same energy expenditure per kilogram of body weight for all individuals, regardless of variations in both mechanical and metabolic efficiency [ , ], thereby leading to the risk of potential misclassification in assessments of energy expenditure. However, the measure of physical activity used in many epidemiological studies is that of MET hours, avoiding the issue of weight being a factor affecting the final outcome in terms of energy expenditure, which is obtained by multiplying MET hours with participants’ weight. Hence, the exact energy expenditure of participants is less important than ranking individuals correctly.
While the point estimate of the intraclass correlation for the adjusted total energy expenditure assessed with Active-Q is high, the point estimate for the assessed crude total energy expenditure is lower, and the confidence intervals around both estimates are rather wide. The wide confidence intervals, and the rather low point estimate obtained for the crude total energy expenditure, might be explained by our small sample size and sampling variability. To obtain more certain measures of reproducibility, we need to conduct a larger study to assess reproducibility of both assessments of total energy expenditure, as well as energy expenditure within each individual domain of Active-Q.
Our study population was recruited from the Stockholm area, including the campuses of three universities, and the participants were young and predominantly female. This may limit the generalizability of our results. The overall level of education among the participants was high, with more than 80% having an education longer than 12 years, compared with 36% in the general Swedish population aged 16-64 years . Higher education has been associated with more accurate recall of physical activity [ ]; therefore, our results may be biased in this direction. In addition, bias due to self-selection of participants may be present because recruitment was voluntary through public advertisements. Health-conscious individuals may be more prone to participate in a study on physical activity.
To the best of our knowledge, Active-Q is one of the first validated physical activity questionnaires specifically designed for Web-based use. Despite the limitations mentioned previously, we believe Active-Q to be a good assessment method in studies collecting Web-based data. Active-Q is currently in use in three large ongoing cohort studies in Sweden, aimed at recruiting hundreds of thousands of people .
An increasing number of studies are relying on the collection of data via the Web, and there is a need for valid Web-based methods of assessing physical activity. We have demonstrated that Active-Q is a valid method for estimating total energy expenditure. Furthermore, Active-Q is also a reproducible and user-friendly method. We conclude that Active-Q is a suitable method for collecting Web-based data on physical activity and inactivity in large epidemiological studies.
This work was supported by grants from the Swedish Cancer Foundation as well as grants to LifeGene from AFA Insurance, Torsten and Ragnar Söderbergs Foundation, Karolinska Institutet, Stockholm's County Council, and the Swedish Research Council.
The authors thank MRC Human Nutrition Research for their cooperation and performing the DLW analyses, in particular Marilena Leventi for her help in analyzing samples and Dr. Les Bluck for his help with the analysis and interpretation of the results.
SEB, YTL, SEC, EM, and KB contributed significantly to the concept and design of the study, and SEB, SEC, EM, AW, and KB participated in the data acquisition. AW conducted doubly labeled water analyses while SEB conducted data analyses (in collaboration with AS who provided significant statistical expertise). SEB, YTL, AW, AS, and KB contributed to the interpretation of results. SEB together with YTL and KB prepared the manuscript, which was subsequently reviewed by SEC, EM, AW, and AS. All authors have approved the final manuscript.
Multimedia Appendix 1
The Active-Q Physical Activity Questionnniare.PDF File (Adobe PDF File), 300KB
- Ekman A, Litton JE. New times, new needs; e-epidemiology. Eur J Epidemiol 2007;22(5):285-292. [CrossRef] [Medline]
- Ekman A, Dickman PW, Klint A, Weiderpass E, Litton JE. Feasibility of using web-based questionnaires in large population-based epidemiological studies. Eur J Epidemiol 2006;21(2):103-111. [CrossRef] [Medline]
- Bälter KA, Bälter O, Fondell E, Lagerros YT. Web-based and mailed questionnaires: a comparison of response rates and compliance. Epidemiology 2005 Jul;16(4):577-579. [Medline]
- Touvier M, Méjean C, Kesse-Guyot E, Pollet C, Malon A, Castetbon K, et al. Comparison between web-based and paper versions of a self-administered anthropometric questionnaire. Eur J Epidemiol 2010 May;25(5):287-296. [CrossRef] [Medline]
- De Vera MA, Ratzlaff C, Doerfling P, Kopec J. Reliability and validity of an internet-based questionnaire measuring lifetime physical activity. Am J Epidemiol 2010 Nov 15;172(10):1190-1198 [FREE Full text] [CrossRef] [Medline]
- Ainslie P, Reilly T, Westerterp K. Estimating human energy expenditure: a review of techniques with particular reference to doubly labelled water. Sports Med 2003;33(9):683-698. [Medline]
- Davidsson L. Assessment of body composition and total energy expenditure in humans using stable isotope techniques. IAEA Human Health Series. Vienna: International Atomic Energy Agency; 2009. URL: http://www-pub.iaea.org/MTCD/publications/PDF/Pub1370_web.pdf [accessed 2011-10-25] [WebCite Cache]
- Ainsworth BE, Haskell WL, Leon AS, Jacobs DR, Montoye HJ, Sallis JF, et al. Compendium of physical activities: classification of energy costs of human physical activities. Med Sci Sports Exerc 1993 Jan;25(1):71-80. [Medline]
- Ainsworth BE, Haskell WL, Whitt MC, Irwin ML, Swartz AM, Strath SJ, et al. Compendium of physical activities: an update of activity codes and MET intensities. Med Sci Sports Exerc 2000 Sep;32(9 Suppl):S498-S504. [Medline]
- Norman A, Bellocco R, Bergström A, Wolk A. Validity and reproducibility of self-reported total physical activity--differences by relative weight. Int J Obes Relat Metab Disord 2001 May;25(5):682-688 [FREE Full text] [CrossRef] [Medline]
- Trabulsi J, Troiano RP, Subar AF, Sharbaugh C, Kipnis V, Schatzkin A, et al. Precision of the doubly labeled water method in a large-scale application: evaluation of a streamlined-dosing protocol in the Observing Protein and Energy Nutrition (OPEN) study. Eur J Clin Nutr 2003 Nov;57(11):1370-1377. [CrossRef] [Medline]
- Assah FK, Ekelund U, Brage S, Wright A, Mbanya JC, Wareham NJ. Accuracy and validity of a combined heart rate and motion sensor for the measurement of free-living physical activity energy expenditure in adults in Cameroon. Int J Epidemiol 2011 Feb;40(1):112-120 [FREE Full text] [CrossRef] [Medline]
- Bluck LJC. Doubly labelled water for the measurement of total energy expenditure in man - progress and applications in the last decade. Nutrition Bulletin 2008;33:80-90. [CrossRef]
- Schoeller DA, Ravussin E, Schutz Y, Acheson KJ, Baertschi P, Jéquier E. Energy expenditure by doubly labeled water: validation in humans and proposed calculation. Am J Physiol 1986 May;250(5 Pt 2):R823-R830. [Medline]
- Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986 Feb 8;1(8476):307-310. [Medline]
- Lee J, Koh D, Ong CN. Statistical evaluation of agreement between two methods for measuring a quantitative variable. Comput Biol Med 1989;19(1):61-70. [Medline]
- Westerterp KR. Assessment of physical activity: a critical appraisal. Eur J Appl Physiol 2009 Apr;105(6):823-828. [CrossRef] [Medline]
- Conway JM, Irwin ML, Ainsworth BE. Estimating energy expenditure from the Minnesota Leisure Time Physical Activity and Tecumseh Occupational Activity questionnaires - a doubly labeled water validation. J Clin Epidemiol 2002 Apr;55(4):392-399. [Medline]
- Craig CL, Marshall AL, Sjöström M, Bauman AE, Booth ML, Ainsworth BE, et al. International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc 2003 Aug;35(8):1381-1395. [CrossRef] [Medline]
- Besson H, Brage S, Jakes RW, Ekelund U, Wareham NJ. Estimating physical activity energy expenditure, sedentary time, and physical activity intensity by self-report in adults. Am J Clin Nutr 2010 Jan;91(1):106-114 [FREE Full text] [CrossRef] [Medline]
- Staten LK, Taren DL, Howell WH, Tobar M, Poehlman ET, Hill A, et al. Validation of the Arizona Activity Frequency Questionnaire using doubly labeled water. Med Sci Sports Exerc 2001 Nov;33(11):1959-1967. [Medline]
- Pettee Gabriel K, McClain JJ, Schmid KK, Storti KL, Ainsworth BE. Reliability and convergent validity of the past-week Modifiable Activity Questionnaire. Public Health Nutr 2010 Sep 15:1-8. [CrossRef] [Medline]
- Neilson HK, Robson PJ, Friedenreich CM, Csizmadi I. Estimating activity energy expenditure: how valid are physical activity questionnaires? Am J Clin Nutr 2008 Feb;87(2):279-291 [FREE Full text] [Medline]
- van Poppel MN, Chinapaw MJ, Mokkink LB, van Mechelen W, Terwee CB. Physical activity questionnaires for adults: a systematic review of measurement properties. Sports Med 2010 Jul 1;40(7):565-600. [CrossRef] [Medline]
- Jacobs DR, Ainsworth BE, Hartman TJ, Leon AS. A simultaneous evaluation of 10 commonly used physical activity questionnaires. Med Sci Sports Exerc 1993 Jan;25(1):81-91. [Medline]
- Russell CW, Boggs DA, Palmer JR, Rosenberg L. Use of a web-based questionnaire in the Black Women's Health Study. Am J Epidemiol 2010 Dec 1;172(11):1286-1291 [FREE Full text] [CrossRef] [Medline]
- van Gelder MM, Bretveld RW, Roeleveld N. Web-based questionnaires: the future in epidemiology? Am J Epidemiol 2010 Dec 1;172(11):1292-1298 [FREE Full text] [CrossRef] [Medline]
- Arrhenius C, Ewerdahl D. Statistics Sweden. 2011. Use of computers and the Internet by private persons in 2010 URL: http://www.scb.se/statistik/_publikationer/LE0108_2010A01_BR_IT01BR1101.pdf [accessed 2011-10-18] [WebCite Cache]
- Rydenstam K. Statistics Sweden. 2003. Living conditions, report no. 99. Time for everyday life: Women's and men's time use 1990/91 and 2000/01 URL: http://www.scb.se/statistik/LE/LE0103/2003M00/LE99SA0301.pdf [accessed 2011-10-18] [WebCite Cache]
- Lagerros YT, Bellocco R, Adami HO, Nyrén O. Measures of physical activity and their correlates: the Swedish National March Cohort. Eur J Epidemiol 2009;24(4):161-169. [CrossRef] [Medline]
- Sundh L. Statistics Sweden. 2010. Yearbook of Educational Statistics 2011 URL: http://www.scb.se/statistik/_publikationer/UF0524_2010A01_BR_00_UF0110TAB.pdf [accessed 2011-09-26] [WebCite Cache]
- Falkner KL, McCann SE, Trevisan M. Participant characteristics and quality of recall of physical activity in the distant past. Am J Epidemiol 2001 Nov 1;154(9):865-872 [FREE Full text] [Medline]
- Almqvist C, Adami HO, Franks PW, Groop L, Ingelsson E, Kere J, et al. LifeGene--a large prospective population-based study of global relevance. Eur J Epidemiol 2011 Jan;26(1):67-77. [CrossRef] [Medline]
|BMI: body mass index|
|DLW: doubly labeled water|
|EE: energy expenditure|
|MET: metabolic equivalent task|
|SLAP: standard light arctic precipitation|
|VSMOW: Vienna standard mean ocean water|
Edited by G Eysenbach; submitted 26.10.11; peer-reviewed by P Bergman, S Blair, M De Vera; comments to author 27.11.11; revised version received 20.12.11; accepted 02.01.12; published 15.02.12
©Stephanie Erika Bonn, Ylva Trolle Lagerros, Sara Elisabeth Christensen, Elisabeth Möller, Antony Wright, Arvid Sjölander, Katarina Bälter. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 15.02.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.