Estimation of Physical Activity Levels Using Cell Phone Questionnaires: A Comparison With Accelerometry for Evaluation of Between-Subject and Within-Subject Variations
Background: Physical activity promotes health and longevity. Further elaboration of the role of physical activity for human health in epidemiological studies on large samples requires accurate methods that are easy to use, cheap, and possible to repeat. The use of telecommunication technologies such as cell phones is highly interesting in this respect. In an earlier report, we showed that physical activity level (PAL) assessed using a cell phone procedure agreed well with corresponding estimates obtained using the doubly labeled water method. However, our earlier study indicated high within-subject variation in relation to between-subject variations in PAL using cell phones, but we could not assess if this was a true variation of PAL or an artifact of the cell phone technique.
Objective: Our objective was to compare within- and between-subject variations in PAL by means of cell phones with corresponding estimates using an accelerometer. In addition, we compared the agreement of daily PAL values obtained using the cell phone questionnaire with corresponding data obtained using an accelerometer.
Methods: PAL was measured both with the cell phone questionnaire and with a triaxial accelerometer daily during a 2-week study period in 21 healthy Swedish women (20 to 45 years of age and BMI from 17.7 kg/m2 to 33.6 kg/m2). The results were evaluated by fitting linear mixed effect models and descriptive statistics and graphs.
Results: With the accelerometer, 57% (95% confidence interval [CI] 40%-66%) of the variation was within subjects, while with the cell phone, within-subject variation was 76% (95% CI 59%-83%). The day-to-day variations in PAL observed using the cell phone questions agreed well with the corresponding accelerometer results.
Conclusions: Both the cell phone questionnaire and the accelerometer showed high within-subject variations. Furthermore, day-to-day variations in PAL within subjects assessed using the cell phone agreed well with corresponding accelerometer values. Consequently, our cell phone questionnaire is a promising tool for assessing levels of physical activity. The tool may be useful for large-scale prospective studies.
J Med Internet Res 2011;13(3):e70)
Large epidemiological studies on physical activity and health require accurate methods that are easy to use, cheap, and possible to repeat. Recently, the potential of using cell phones, either through short message service (SMS) or Web-like applications, in behavior change intervention studies have been explored (for example, [- ]). However, cell phones also open new possibilities for data collection in large-scaled prospective studies [ , ].
When assessing physical activity, one important aspect is the total amount of energy expended due to physical activity. This variable can be obtained as total energy expenditure divided by basal metabolic rate, that is, the so-called physical activity level (PAL) . We have recently developed a Java-based cell phone questionnaire to assess PAL that places little demand on either the study center or the participants [ ]. Once every day for 2 weeks subjects are asked two questions via their cell phones about their daily physical activity. In an earlier study, the mean PAL during 2 weeks using this cell phone questionnaire agreed well with corresponding estimates based on the doubly labeled water method and indirect calorimetry (mean difference = 0.014, 1 standard deviation [SD] = 0.15) [ ]. However, our earlier study showed a low variation in PAL between subjects (20% of the total variation) [ ], indicating that the rest (80%) was caused by variations within subjects. Since the doubly labeled water method does not provide daily PAL values, we could not evaluate whether these variations were true or not. If they are not true, a low between-subject variation in our cell phone questionnaire may indicate that these estimates are not able to distinguish PAL between individuals very well. Thus, the aim of this study was to compare within- and between-subject variations in PAL by means of cell phones with corresponding estimates using an accelerometer. In addition, we compared the agreement of daily PAL values obtained using the cell phone questionnaire with corresponding data obtained using an accelerometer.
In all, 22 healthy nonsmoking Swedish women were recruited during August 2007 through May 2008 as previously described . The women were 35.1 (range 20-45, SD 8.3) years of age, and their BMI was 23.7 kg/m2 (range 17.7 kg/m2 to 33.6 kg/m2, SD 3.8 kg/m2). PAL was measured daily during a 14-day study period using the cell phone questions as well as a tri-axial accelerometer, the RT3 (Stayhealthy Inc, Monrovia, CA, USA). The first day of the study period was excluded since the women did not wear the accelerometer until the afternoon that day; thus, results are reported for 13 days. One woman accidently broke her accelerometer; thus, results are reported for only 21 women. The study was approved by the central ethics board in Stockholm, Sweden.
Our JAVA-based questionnaire for assessing PAL using cell phones has previously been described in detail . Briefly, at 9 pm, each woman was asked two questions about her physical activity during the same day ( ). For each woman and for each day, the answers to the two short questions were converted to PAL by adding the PAL points obtained for work/day time activities [ ] and the PAL points obtained for leisure/evening activities [ ] ( ).
Each woman was instructed to wear the accelerometer during all her waking hours except when in water. She recorded in a notebook when she took off the device and the activities performed without it (eg, showering or sleeping). Recorded movements were converted to total energy expenditure according to the manufacturer. All women wore the RT3 all 14 days and the recordings obtained during these days covered 97% ± 2% of time awake. For activities reported in the notebook, energy expenditure was estimated based on published energy costs of specific activities . PAL was obtained as total energy expenditure divided by resting metabolic rate (calculated using in-built equations provided by the RT3 manufacturer) for each 24-hour period during days 1 to 13 (starting at 9 pm the first study day).
Intraclass correlation coefficients (ICC) were calculated as the between-subject variation divided by the total variation.The coefficients were estimated by means ofa linear mixed effect model with the two components of variance and a fixed effect for days 1 to 13. The ICC was used to compare the between-subject variation in relation to total variation for PAL values at days 1 to 13. The ICC was calculated from models fitted separately for the cell phone data and the accelerometer data. To test the robustness against the influence of single gross outliers, we repeated the ICC calculations for both methods when we had replaced the 10 as well as 20 most deviating daily PAL values out of 273 values with the mean PAL for these women. Furthermore, the agreement of daily PAL values obtained using the cell phone questionnaire and corresponding accelerometer data was evaluated using descriptive statistics. All statistical analyses were carried out using the SAS software proc mixed, version 9.2 (SAS Institute, Inc, Cary, NC, USA).
For PAL obtained using the cell phone, the variance between and within subjects was estimated to be 0.009 and 0.029, respectively. Thus, 24% of the total variation was between subjects, and 76%, within subjects. The corresponding estimates for the accelerometer were 0.017 and 0.023, showing that 43% of the variation was between subjects and 57%, within subjects. The 95% CI for the within-subject variation was 59% to 83 % for the cell phone while it was 40% to 66% for the accelerometer. The variance components for PAL obtained using the cell phone and the accelerometer remained similar when we replaced the 10 and 20 most deviating values with the mean PAL of these women.
compares daily PAL values obtained with cell phones and accelerometers from day 1 to day 13 for 6 randomly selected subjects. Daily PAL values obtained with the accelerometer were generally on a lower level than the corresponding cell phone estimates, but the day-to-day changes in PAL observed using the cell phone questions followed the corresponding changes in the accelerometer PAL. Similar agreement between daily PAL values obtained using the two methods was observed for the other 15 women (data not shown).
Both the cell phone questionnaire and the accelerometer showed high within-subject variations, indicating that there is considerable true day-to-day variation in PAL. First, this makes it more likely that the relative low between-subject variations we reported in our earlier paper are not artifacts of the cell phone technique. Second, this is an interesting finding since few reports have described the specific sources of variance in daily physical activity using objective measures in adults [- ].
PAL obtained using the accelerometer was generally on a lower level than the cell phone value. The RT3 as well as several other accelerometers have shown a tendency to underestimate energy expenditure during free-living conditions compared with the doubly labeled water method [- ] also in the women in this study (Löf et al, unpublished data). Since the changes in daily PAL values obtained using the RT3 accelerometer agreed well with the corresponding cell phone estimates, we hypothesize that the underestimation in PAL results from an underestimation of energy expenditure from movements. Future studies should explore why the RT3 underestimates energy expenditure and how the monitor may be refined in order to improve its predictions.
With the accelerometer, 43% of the variation in PAL was between subjects, while between-subject variation was 24% with the cell phone. For comparison, Matthews et al  reported that differences between subjects accounted for 55% to 60% of the variation in accelerometer counts in 92 healthy adults, but their study covered a wider age range (18 to 79 years of age) than our study. For a paper questionnaire, the between-subject variation in overall physical activity was 20% to 30% in 580 healthy adults [ ]. As discussed by Matthews et al, the variance structure between self-reported and objective measures may differ due to different inherent errors [ ]. A limitation of accelerometers is that they are not sensitive to activities involving upper body movements such as weight-lifting or carrying. Weight-lifting was not common, but we have no information about carrying. If carrying was evenly distributed among our women, the variance components would be unchanged, but if carrying was unevenly distributed, the true between-subject variation using the accelerometer may be even higher. Thus, the results likely indicate that the cell phones underestimate the between-subject variation. One plausible explanation is the answer options. The highest category for the second question only mentions sports and cycling, while home chores like gardening are not included. Such activities could be added to refine the capability of the cell phone questionnaire to assess between-subject variation in PAL.
The major limitation of this study is the small sample size. First, it makes our analysis sensitive to single gross outliers since these may largely increase the within-subject variations. However, we found no evidence for any important effect of such outliers in our analysis since the variance components were stable when we replaced the 10 or 20 most deviating PAL values (out of totally 273) with the average PAL for those women. Second, the small sample size limits our ability to make firm conclusions about the between-subject variations. We cannot exclude that the low between-subject variation obtained by both methods to some extent is due to the fact that our participants were a relatively small group of women. Other limitations are that we estimated energy expenditure for activities when the women were not wearing the RT3, but this amount of time was small, and that this study was conducted in healthy, moderately active women. The results should be repeated in other populations including men as well as elderly and obese subjects.
In conclusion, (1) Both the cell phone questionnaire and the accelerometer showed high within-subject variations in PAL and (2) changes in daily cell phone PAL values agreed well with corresponding accelerometer values. This study adds further evidence to our earlier findings  that the cell phone questionnaire is a promising tool for assessing PAL in epidemiological studies.
The authors would like to thank all the women who participated in the study and Novatelligence for Medipal, with special thanks to Johan Cederlund. This study was supported by the following grants awarded to Marie Löf: the Swedish Research Council, FORMAS, the Magnus Bergvall Foundation, the Thuring Foundation, and the Swedish Society of Medicine.
Conflicts of Interest
ML was responsible for the recruitment of subjects and data collection for the accelerometer. CB collected data using cell phones and conducted the data analyses (in collaboration with SS who was responsible for the statistical analyses). CB together with ML prepared the manuscript, which was subsequently reviewed by JEL, YTL, and SS. All authors contributed to the interpretation of the results, and all authors have approved the final manuscript.
- Hurling R, Catt M, Boni MD, Fairley BW, Hurst T, Murray P, et al. Using internet and mobile phone technology to deliver an automated physical activity program: randomized controlled trial. J Med Internet Res 2007;9(2):e7 [FREE Full text] [CrossRef] [Medline]
- Patrick K, Raab F, Adams MA, Dillon L, Zabinski M, Rock CL, et al. A text message-based intervention for weight loss: randomized controlled trial. J Med Internet Res 2009;11(1):e1 [FREE Full text] [CrossRef] [Medline]
- Fjeldsoe BS, Marshall AL, Miller YD. Behavior change interventions delivered by mobile telephone short-message service. Am J Prev Med 2009 Feb;36(2):165-173. [CrossRef] [Medline]
- Woolford SJ, Clark SJ, Strecher VJ, Resnicow K. Tailored mobile phone text messages as an adjunct to obesity treatment for adolescents. J Telemed Telecare 2010;16(8):458-461. [CrossRef] [Medline]
- Ekman A, Litton JE. New times, new needs; e-epidemiology. Eur J Epidemiol 2007;22(5):285-292. [CrossRef] [Medline]
- Aanensen DM, Huntley DM, Feil EJ, al-Own F, Spratt BG. EpiCollect: linking smartphones to web applications for epidemiology, ecology and community data collection. PLoS One 2009;4(9):e6968 [FREE Full text] [CrossRef] [Medline]
- FAO/WHO/UNU Expert Consultation. Human Energy Requirements: Report of a Joint FAO/WHO/UNU Expert Consultation. Rome, Italy: Food & Agriculture Organization of the United Nations; 2004.
- Bexelius C, Löf M, Sandin S, Trolle Lagerros Y, Forsum E, Litton JE. Measures of physical activity using cell phones: validation using criterion methods. J Med Internet Res 2010;12(1):e2 [FREE Full text] [CrossRef] [Medline]
- Black AE, Coward WA, Cole TJ, Prentice AM. Human energy expenditure in affluent societies: an analysis of 574 doubly-labelled water measurements. Eur J Clin Nutr 1996 Feb;50(2):72-92. [Medline]
- Ainsworth BE, Haskell WL, Whitt MC, Irwin ML, Swartz AM, Strath SJ, et al. Compendium of physical activities: an update of activity codes and MET intensities. Med Sci Sports Exerc 2000 Sep;32(9 Suppl):S498-S504. [Medline]
- Gretebeck RJ, Montoye HJ. Variability of some objective measures of physical activity. Med Sci Sports Exerc 1992 Oct;24(10):1167-1172. [Medline]
- Matthews CE, Ainsworth BE, Thompson RW, Bassett DR. Sources of variance in daily physical activity levels as measured by an accelerometer. Med Sci Sports Exerc 2002 Aug;34(8):1376-1381. [Medline]
- Levin S, Jacobs DR, Ainsworth BE, Richardson MT, Leon AS. Intra-individual variation and estimates of usual physical activity. Ann Epidemiol 1999 Nov;9(8):481-488. [Medline]
- Plasqui G, Westerterp KR. Physical activity assessment with accelerometers: an evaluation against doubly labeled water. Obesity (Silver Spring) 2007 Oct;15(10):2371-2379 [FREE Full text] [CrossRef] [Medline]
- Maddison R, Jiang Y, Hoorn SV, Mhurchu CN, Lawes CM, Rodgers A, et al. Estimating energy expenditure with the RT3 triaxial accelerometer. Res Q Exerc Sport 2009 Jun;80(2):249-256. [Medline]
- Matthews CE, Hebert JR, Freedson PS, Stanek EJ, Merriam PA, Ebbeling CB, et al. Sources of variance in daily physical activity levels in the seasonal variation of blood cholesterol study. Am J Epidemiol 2001 May 15;153(10):987-995 [FREE Full text] [Medline]
|CI: confidence interval|
|ICC: Intraclass correlation coefficient|
|PAL: physical activity level|
|SMS: Short Message Service|
Edited by G Eysenbach; submitted 17.11.10; peer-reviewed by E Hekler; comments to author 19.02.11; revised version received 19.05.11; accepted 19.05.11; published 25.09.11
©Christin Bexelius, Sven Sandin, Ylva Trolle Lagerros, Jan-Eric Litton, Marie Löf. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 25.09.2011.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.