Published on 14.03.12 in Vol 14, No 2 (2012): Mar-Apr
Results from an Online Computer-Tailored Weight Management Intervention for Overweight Adults: Randomized Controlled Trial
Background: Prevention of weight gain has been suggested as an important strategy in the prevention of obesity and people who are overweight are a specifically important group to target. Currently there is a lack of weight gain prevention interventions that can reach large numbers of people. Therefore, we developed an Internet-delivered, computer-tailored weight management intervention for overweight adults. The focus of the intervention was on making small (100 kcal per day), but sustained changes in dietary intake (DI) or physical activity (PA) behaviors in order to maintain current weight or achieve modest weight loss. Self-regulation theory was used as the basis of the intervention.
Objective: This study aims to evaluate the efficacy of the computer-tailored intervention in weight-related anthropometric measures (Body Mass Index, skin folds and waist circumference) and energy balance-related behaviors (physical activity; intake of fat, snacks and sweetened drinks) in a randomized controlled trial.
Methods: The tailored intervention (TI) was compared to a generic information website (GI). Participants were 539 overweight adults (mean age 47.8 years, mean Body Mass Index (BMI) 28.04, 30.9% male, 10.7% low educated) who where recruited among the general population and among employees from large companies by means of advertisements and flyers. Anthropometric measurements were measured by trained research assistants at baseline and 6-months post-intervention. DI and PA behaviors were assessed at baseline, 1-month and 6-month post-intervention, using self-reported questionnaires.
Results: Repeated measurement analyses showed that BMI remained stable over time and that there were no statistically significant differences between the study groups (BMI: TI=28.09, GI=27.61, P=.09). Similar results were found for waist circumference and skin fold thickness. Amount of physical activity increased and intake of fat, snacks and sweetened drinks decreased during the course of the study, but there were no differences between the study groups (eg, fat intake: TI=15.4, GI=15.9, P=.74). The first module of the tailored intervention was visited by almost all participants, but only 15% completed all four modules of the tailored intervention, while 46% completed the three modules of the general information intervention. The tailored intervention was considered more personally relevant (TI=3.20, GI=2.83, P=.001), containing more new information (TI=3.11, GI=2.73, P=.003) and having longer texts (TI=3.20, GI=3.07, P=.01), while there were no group differences on other process measures such as attractiveness and comprehensibility of the information (eg, attractive design: TI=3.22, GI=3.16, P=.58).
Conclusions: The online, computer-tailored weight management intervention resulted in changes in the desired direction, such as stabilization of weight and improvements in dietary intake, but the intervention was not more effective in preventing weight gain or modifying dietary and physical activity behaviors than generic information. A possible reason for the absence of intervention effects is sub-optimal use of the intervention and the self-regulation components. Further research is therefore needed to gain more insight into how the intervention and exposure to its contents can be improved.
Trial Registration: NTR1862; http://apps.who.int/trialsearch/trial.aspx?trialid=NTR1862
J Med Internet Res 2012;14(2):e44
Obesity (Body Mass Index: BMI > 30 kg/m2) is a major public health concern, because of its high prevalence and association with several negative health outcomes [- ], a lower quality of life [ , ], and increased health care costs [ ]. Given the poor long-term results of weight loss attempts among obese people [ ], prevention of weight gain has been postulated as an important strategy for fighting the obesity epidemic [ ]. Prevention of weight gain is particularly important among people who are overweight (BMI 25-30 kg/m2), since they are most at risk of becoming obese. Weight gain prevention (WGP) or modest weight loss does not require drastic dieting but can be achieved by making small, sustained changes in dietary intake or physical activity. In the Netherlands, the average annual weight gain was about 0.5 kg [ ]. The global average 1 kg of annual weight gain that is seen in many populations is caused by excess energy intake of about 7000 kcal a year. In reverse, it is hypothesized that 1 kg of annual weight gain can be prevented in about 90% of the population by a daily decrease in dietary intake (DI) or increase in physical activity (PA) of about 100 kcal [ ]. Currently, there are only a few effective interventions that focus on the prevention of obesity in overweight adults [ ] that take the small changes approach and that can reach large numbers of people. Therefore, we developed a computer-tailored intervention aimed at preventing weight gain among overweight adults [ ] and evaluated it for effects.
Behavior Change and Online Interventions
Evidence of the effectiveness of current obesity prevention interventions indicates that such interventions can be successful, but that findings are mixed. In the Pound of Prevention Study, a monthly newsletter (including practical guides for behavior change, recipes and locations for walking) and other activities such as weight control sessions were found to have favorable (but statistically non-significant) effects on behavior and weight . Using 10 modules of usual care and email counseling [ ] or individual and environmental intervention strategies [ ], 2 Dutch worksite interventions were successful in changing behavior and/or preventing weight gain. In a review by Lemmens et al [ ], 4 of 11 studies reported a positive effect on weight, of which 3 were aimed at modifying DI and PA; more intensive and sustained interventions, including monitoring of behavior, were more effective [ ]. Kremers et al [ ], in their meta-analysis on prevention of overweight and obesity, reported a small, but statistically significant average effect size (d=0.06) of weight management interventions, with studies aiming at weight management being more successful than studies aiming at behavior change for other reasons (eg, decrease risk for coronary event). However, most of these studies were not aimed at overweight adults [ ].
One key factor in successful WGP is that changes in DI and PA need to be maintained for a long time, which requires self-regulation skills. Self-regulation [, ] motivates and enables people to achieve self-set goals. The first step in self-regulation consists of setting a goal, in this case WGP. Second, one has to choose the means to achieve this goal. In the case of WGP this means deciding to make small changes in DI and/or PA. Third, a person needs to make a detailed plan for how to make the desired change and how to avoid difficulties that may occur when making the desired change. The step of planning is followed by actual goal pursuit, monitoring, and evaluation of progress toward goal achievement. Providing a platform for goal setting, planning, monitoring, and providing feedback on targeted behavior has been identified as pre-requisite for interventions that aim for change in dietary intake and physical activity [ ]. Another prerequisite for WGP interventions is that large numbers of people need to be reached, with relative low costs per person, since about 35% of the adults in the Netherlands are overweight [ ].
To be able to meet the criteria of an individualized approach and large reach, we chose to develop an online, computer-tailored intervention. Several reviews have shown that (online) computer-tailored interventions may have a positive effect on energy balance-related behaviors [- ] compared with general information or no information. One review included 76 studies on eating a healthy diet and/or undertaking physical activity and found a statistically significant overall small effect size (g=0.17) for computer-tailored interventions [ ]. Kroeze et al concluded in a review that there is consistent evidence that tailored interventions have a positive effect on dietary intake, especially on fat reduction, and probably on physical activity [ ]. Of the 10 studies that were included in the review of Neville [ ] and that were aimed at reduction of dietary fat intake, 5 found a positive effect of ‘second generation’ (delivered through interactive technology or desktop applications such as websites, email and CD-rom) tailored interventions. A review on physical activity showed that 10 of 16 studies found statistically significant positive effects on physical activity and weight reduction measures [ ]. These reviews show that positive effects on weight, dietary and physical activity behaviors can be achieved with computer-tailored interventions, but there is currently no evidence for the efficacy of a tailored intervention on prevention of weight gain among overweight adults.
Aims of the Study
The aim of this study was to establish the efficacy of an online, computer-tailored weight management intervention (GRIPP) on anthropometric outcome measures at 6-months post-intervention and on energy balance-related behaviors (intake of sugar-sweetened drinks, snacks and fat, and physical activity) at 1- and 6-months post-intervention compared to a generic information control group. The hypotheses were that anthropometric outcomes (BMI, waist circumference, and skin fold thickness) will be more favorable at 6-months post-intervention for the intervention group, because the average annual weight gain will occur in the control group and not in the intervention group, and that the intervention group will have lowered intake of sugar-sweetened drinks, snacks and high fat products, and engage in more PA at 1- and 6-months post-intervention, as compared with the control group.
In addition, we performed a process evaluation in order to contribute to a better understanding of the (non) effects of the intervention and to identification of areas for improvement for the intervention . Therefore, measures of use and appreciation were included in the process evaluation.
A 2-group randomized controlled trial was conducted in which the computer-tailored intervention (TI, n = 270) was compared with a generic information intervention (GI, n = 270) control group. Body height, weight, waist circumference, and skin fold thickness were measured at baseline and 6-month post-intervention and measurements of energy balance- related behavior were taken at baseline, 1-month post-intervention and 6-month post-intervention. After baseline assessment, participants were allocated to one of the two study groups (1:1) by means of sex-stratified computer block randomization (block size: 10). The study received a declaration of no objection from the Erasmus MC Medical Ethics Committee.
The participants were adults (18-65 years) who were overweight (self-reported BMI 25-30 m2). Exclusion criteria were not having a sufficient command of the Dutch language, not having Internet access, being pregnant, following a diet prescribed by a physician or dietician, and having a history of depression or eating disorders.
A power calculation showed that 200 participants in each study group would be sufficient to detect 0.4 difference in BMI points between the intervention and control group (caused by weight gain of 0.3 kg in the control group and weight maintenance or slight weight reduction in the intervention group) with a power of 0.80 and a significance level of P<.05. To account for dropout between the measurements, 600 participants needed to be recruited for the study.
Participants were recruited between March and October 2009 from the general population in the Rotterdam (the second largest city in the Netherlands, with approximately 600,000 inhabitants) region through advertisements in local newspapers, flyers that were delivered door-to-door, in waiting rooms of GP’s, and among the employees of 4 large companies, with the aim to reach a diverse population with respect to socioeconomic status. The recruitment materials contained information about the goal, process and incentives for the study. More detailed information was available on the study website. People who were interested in participating in the study were asked to fill out an online subscription form available on the study website that was used to assess whether they were eligible for participation in the study. Participants were included in the study if their BMI (calculated as weight/height2), based on self-reported height and weight, was between 24 and 31 (this range was broader than the objective inclusion criteria of a BMI of 25-30, in order to prevent exclusion based on biased self-reported measures). If people did not meet the inclusion criteria, they could not subscribe for the study.
After subscription, participants received a confirmation letter and information leaflet about the study. In addition, they received an email in which they were asked to fill out the baseline questionnaire online. Weight, height, waist circumference and skin folds were measured at the hospital site. Participants signed the consent form when they had their anthropometric measurements taken. When participants did not come to have their anthropometrics measured, the consent form was sent to their home address with a return-envelope. Participants preferably completed both measurements (anthropometrics and questionnaire) but were also randomized when they had completed only one measurement.
All randomized participants received a login name and a password by email, which gave them access to the allocated intervention program. Participants were asked to visit the websites at least three or four times during a 2-month period. They received email reminders to (re-) visit the intervention every 2 weeks. At 1 month and 6 months after the intervention period, participants were asked by email to fill out the online questionnaire again. Furthermore, after 6 months they were again invited to the hospital site for measurement of weight, waist circumference and skin fold thickness. Participants who did not respond to the email invitations for the anthropometric measurements or to complete the questionnaire received a phone call to motivate them to complete the questionnaire or to have their anthropometric measures taken. Gift vouchers were handed out as compensation for travel expenses and invested time. Participants who filled out the questionnaire 1-month post-intervention received a gift voucher of € 10. Participants who filled out the questionnaire and had their anthropometrics measured at 6-months post-intervention, received (another) gift voucher of € 10. Furthermore, because dropout at 1-month post-intervention was higher than the expected 10%, 10 extra gift vouchers of € 20 were raffled among the participants who completed all measures at 6-months post-intervention.
The body measurements were performed by trained research assistants following a measurement protocol. Body height was measured twice using a Seca mobile height rod with an accuracy of 0.1 cm. The mean of both measures was used for height. A calibrated electronic digital floor scale (Seca 888 clas III) was used to measure body weight, with an accuracy of 0.2 kg. The measures of height and weight were used to calculate BMI (weight [kg] / (height [m])2). Waist circumference was measured twice with a flexible band (Seca 201) with a precision of 0.1 cm. When the difference between two measurements was larger than 1.0 cm, the waist circumference was measured twice again. Mean waist circumference was calculated based on the last two measurements. Skin fold thickness was measured at 4 sites (biceps, triceps, subscapular and supra-iliac) with the Harpenden Skinfold Caliper to assess body fat percentage [, ]. Each site was measured 3 times and the mean was calculated for each site. A variable for total skin fold thickness in centimeters was composed by summing the means for the 4 sites in 1 measure. The same measures, except for height, were taken at baseline and 6-months post intervention.
Energy Balance-Related Behaviors
In this study, we examined the effects of the interventions on 1) fat intake, 2) snack intake, 3) intake of sweetened drinks (mean number of sweet and sweetened drinks per day), and 4) physical activity. Fat intake, expressed as ‘fat score’, was assessed using a food frequency questionnaire assessing the frequency and quantity of a variety of high density foods eaten in the past week. It was based on a validated questionnaire  and allows for calculating fat intake and intake from specific food groups. The questionnaire consisted of 74 questions and was organized according to meal pattern. Participants recorded their frequency of consumption and portion size for a selection of food items eaten during meals or between meals. Fat points were based on frequency and amount of intake of high fat products, with higher scores indicating higher fat intake. There were 23 products, in the following categories: dairy products (5), butter (1), gravy (1), sandwich fillings (3), meat and cheese for main dinner (2) and snacks (sweet, salty, hot and cold; 11 in total). There were a maximum number of points (2 to 5) for each product. In total, a maximum of 83 fat points could be obtained.
Furthermore, people were asked to answer questions about the mean number and amount of sweet and salty, and hot and cold snacks per week from 11 categories (eg, fried products, candy bars, etc). High energy snack intake was calculated as the mean number of high energy snacks per day by multiplying the frequency per week with the amount per frequency, divided by 7 (days a week). To assess intake of sweetened drinks, questions on frequency and amount for fruit juices, soft drinks and sweetened tea and coffee were asked. Intake of sweetened drinks was calculated in a similar way as intake of snacks.
Physical activity was assessed using a questionnaire based on ‘The Short Questionnaire to Assess Health - Enhancing Physical Activity’ (SQUASH), developed to assess habitual activity level . In this 16-item questionnaire, participants were asked to indicate on how many days of the week they participated in specified activities, and how much time they engaged in the activity per occasion. For active transport, respondents were asked how often they cycled and walked for home to work transportation, and the duration. Similar questions were asked for walking and cycling during leisure time. Furthermore, participants were asked how many different sports they did on a weekly basis (with a maximum of 4). For each different sport, they were asked to choose the type of sport (eg, swimming, yoga, running) from a list, and to choose the weekly frequency, and the average duration per activity. For each category, the average number of minutes per week was calculated by multiplying the frequency with the duration. Then, this number was divided by 7 to calculate the mean number of minutes per day. Next, the number of minutes engaged in physical activity per day was calculated as the sum of all activities (active transportation, leisure time activities, and sports). The same questionnaires were used at baseline, 1-month and 6-month post-intervention to assess energy balance related behaviors.
Sex (male/female), date of birth, and educational level were assessed in the baseline questionnaire. To determine age we asked for date of birth. Education was assessed by asking the participants to indicate their highest completed education (8 answering options). A 3-category variable was subsequently made, indicating a low (completed no education, primary school, secondary school or lowest level of high school or lower vocational training), medium (intermediate or high level high school) or high (completed higher vocational training, college or university) level of education.
An objective measure of exposure to the intervention was obtained from the login data from the intervention registration, which keeps information from participants’ use of the (tailored) information. One scale was made for use/exposure, indicating the number of modules actually used (0-4 for TI, 0-3 for GI). Self-reported measures of use and appreciation were included in the 1-month post-intervention questionnaire. If not stated otherwise, answer categories ranged from ‘totally disagree’ (1) to ‘totally agree’ (5).
Amount of information read was assessed by the question, “To what extent did you read the information in the program?” Answering categories ranged from ‘none of it’ (0) to ‘all of it’ (5). Perceived length of the text was assessed by the question, “What do you think of the lengths of the text in the program?” Answering categories ranged from ‘much too short’ (1) to ‘much too long’ (5). Perceived personalization was assessed with the statement, “The information in the program was relevant for me personally”. Novelty of the information was assessed by, “The information in the program was new for me”. Usefulness of the information was assessed with, “The information in the program was useful”. Attractiveness was assessed by the question, “The design of the program is attractive”. Usefulness of the intervention was assessed with the question, “the program is a good instrument to control my weight”. Furthermore, participants were asked whether they would recommend the intervention to others using the response options, ‘no’ (1), ‘maybe’, (2), or ‘yes’ (3). Participants were also asked to give an overall grade to the intervention on a scale from 1 to 10 (1 being very low, 10 being very high). These questions were included in the questionnaire for the intervention and the control group and are only reported for those who have actually used the interventions.
The objective of the computer-tailored intervention was to prevent weight gain in adults who are overweight by inducing small changes (100 kcal/day) in energy balance-related behaviors (DI and PA). It aimed at making a change in (one or more) behaviors that add most to the energy balance and that are associated with weight gain (frequency and duration of various physical activities and intake of fat (from several categories such as dairy, meat, cheese, sauce, snacks and sweetened drinks) . The intervention was carefully developed based on theory and evidence using the Intervention Mapping approach [ ]. The intervention goals, methods, and strategies were based on self-regulation theory [ ], and other theories such as the Theory of Planned Behavior [ ], Precaution Adoption Process Model [ ] and implementation intentions [ ]. The strategies were combined into a computer-tailored Internet-delivered intervention. Detailed information about the intervention development and content is described elsewhere [ ].
The intervention consisted of 4 modules, each to be visited 1 week after the previous one and followed the steps of self-regulation. Completion of the entire program took about 90 minutes in total. The first module aimed at commitment to prevent weight gain by considering pros and cons of WGP, identifying and setting a goal for one relevant change in DI or PA and making a plan for change. Participants were made aware of current levels of DI and PA and possibilities for change by providing them with individualized feedback on their behavior. Then, people could make a choice for what to change (guided goal setting) and make a plan for where, when, and how to make that change (implementation plan). The second and third modules were focused around evaluation of progress toward behavior change, and provided feedback on past week performance. If necessary, it supported adaptation of action and coping plans (when attempts to change behavior were unsuccessful). The fourth module was aimed at promoting sustained self-regulation of body weight without use of the program. A tool to monitor and evaluate (changes in) body weight was provided, as well as a short guideline with sequences of actions for long term WGP, reflecting on the self-regulatory skills that had been practiced in the previous three modules, and provision of positive reinforcement to maintain behavior. At the end, the participants signed a personalized contract, which included their personal behavior goals, actions plans, weight status, etc. The tailored modules were embedded in a website that also contained recipes, a peer-to-peer forum and links to useful websites, and was accessible through the Internet.
The generic information for the control group was embedded in a website with similar content, and similar reminders were sent to the participants. The main components of this website were 3 modules with general information on weight gain prevention, which had a similar layout as the TI. The first module aimed at increasing the motivation for WGP. The second module aimed at choosing a behavior change by providing information about possible changes. The third module provided general information about a healthy diet and safe physical activity.
Descriptive statistics were used to characterize both study groups at baseline. Logistic regression analyses were conducted to evaluate whether participant characteristics (BMI, sex, education, and age) and allocated intervention group were related to dropout (dropout, no = 0, yes = 1) during the study. Repeated measures analyses were performed, using a general linear mixed model with a random intercept, to study changes during the study period (‘time’) and differences in changes between the intervention groups (‘group’, GI = 0 vs TI = 1) for the main outcome measures. These measures were objectively measured BMI, skin fold thickness and waist circumference, and self-reported PA and DI (intake of fat, snacks and sweetened drinks) (‘group*time’ interaction). This procedure allows for inclusion of cases with missing data, without replacement of missing values, and therefore includes all randomized participants. The ‘Type III Wald test’ was used to test overall statistical significance of the effects. The significance level (P) was set at .05 and tests were two-sided. All analyses were performed using SPSS 17.
In total, 630 people completed the online registration, and 539 enrolled in the study by completing the baseline questionnaire and/or anthropometric measures (). The mean age of the participants was 47.8 years (SD 9.4), 31% were male and 11% had a low level of education. The mean BMI was 28.04 (SD 1.94). No baseline differences in socio-demographic characteristics, behavior and anthropometrics were observed between the intervention groups at baseline (P<.05, t-tests) ( ).
Loss to Follow-up
At baseline, 480 participants had their anthropometrics measured and 313 people at 6-month post-intervention (dropout 34.8%). Younger people were more likely to dropout between the two moments of anthropometric measures (OR age = 0.97, 95% CI 0.95-0.99). A total of 375 participants filled out the 1-month post-intervention (dropout 31%) and 361 people the 6-month post-intervention questionnaire (dropout 33%). Dropout between baseline and 1-month post-intervention questionnaires was more likely among men (OR sex = 0.56, 95% CI 0.35-0.89). Dropout between baseline and 6-month post-intervention was more likely among younger participants (OR age=0.97, 95% CI 0.95-0.99). No other differences were observed among those who completed the study and those who were lost after the first or second measurement.
Repeated measures analyses showed that BMI did not change significantly over time (P=.09) (and ) and that there was no difference between the two groups (interaction effect group*time P=.09). Skin fold thickness increased significantly over time (P<.001) but there were no differences in change over time between the TI and GI group (interaction effect group*time P=.95). There was a statistically significant decrease in waist circumference over time (P<.001), but the change in time was not different between the study groups (interaction effect group*time P=.12).
The time spent on physical activity decreased significantly in the total population (P=.002), but the change was not significantly different among the TI and GI (interaction effect group*time P=.44) (and ). Mean fat intake decreased statistically significantly between baseline measurement and post-intervention measurements (P<.001), but the decrease was similar in the two conditions (interaction effect group*time P=.74). Intake of sweetened drinks and snacks showed a similar pattern: intake decreased over time (sweetened drinks P<.001, snacks P<.001), but changes were not different between the intervention groups (interaction effect group*time: sweetened drinks P=.55, and snack intake P=.78).
Some of the behavioral outcomes measures (physical activity and intake of sweetened drinks and snacks) had a very skewed distribution. Log-transformation of these outcomes did not improve the fitted model and was not of influence on the time and intervention effects.
The login data showed that more than 80% (n = 272) of the respondents used the first module of their allocated intervention (). About 15% (n = 41) completed four modules of the TI intervention and 46% (n = 124) completed the three modules of the GI intervention.
T-tests () showed that participants in the TI group reported to have read statistically significantly less of the presented information (TI 4.07 vs GI 4.5, P<.001) and were slightly less positive about the lengths of the texts (TI 3.20 vs GI 3.07, P = .01), compared to the TI group. The information in the TI group was experienced as more ‘new’ (TI 3.11 vs GI 2.73, P=.003) and individualized (TI 3.20 vs GI 2.83, P=.001), compared with the GI. No differences were found for the usefulness (TI 3.48 vs GI 3.44) and attractiveness (TI 3.22 vs GI 3.16) of the information, the usefulness of the program as a tool for WGP (TI 2.90 vs GI 2.75), recommending it to others (TI 2.14 vs GI 2.14), and the overall grade (TI 6.6 vs GI 6.6).
In the present study we evaluated the effects of a carefully developed multi-session computer-tailored weight management intervention for overweight adults that was based on self-regulation theory and contained a number of self-regulation strategies. The results of the study showed that weight remained stable over time and that waist circumference and dietary behaviors slightly improved over six months, but that these improvements were not different from those in the generic information control group. Thus, even though some of the effects of the intervention were in the desired direction, in the present study we could not demonstrate that the elaborate intervention was more effective in inducing weight gain prevention than more basic generic information about weight management.
Interpretation of the Results: Theory and Previous Evidence
Our intervention was solidly based on theory and evidence relevant for inducing weight maintenance and long-term changes in dietary intake and physical activity, and used the promising method of computer tailoring as an educational technique. It therefore had, in theory, good prospects for effects. The technique of computer tailoring has successfully been applied in interventions aimed at dietary intake, physical activity and weight loss [, , ] but no meta-analytic results are known for prevention of weight gain.
Our tailored intervention had a number of characteristics that have been indentified as having a positive influence on intervention efficacy [, ], such as including 4 modules (‘contact moments’), and at least six behavior change strategies. Thus, the intervention had, in theory, good prospects to be effective.
Furthermore, based on the limited evidence with respect to effectiveness of interventions aimed at the prevention of weight gain , the results of our study fit in the pattern of mixed effects that have been found. One study found positive effects of an online weight management intervention [ ], but this intervention aimed at a restriction of calorie intake to 1200-1500 calories/day, while our study aimed at a reduction of 100 kcal/day. It may be argued that a change of 100 kcal/day is too small to prevent weight gain or induce modest weight loss, but there is compelling evidence that this approach can in fact result in weight maintenance and modest weight loss, including for people who are overweight [ - ]. Our results are, furthermore, comparable to a number of other studies where the intervention group showed small or no effects on weight, compared to their control group [ , , ].
The results of our study compare unfavorably to the results from 2 previous intervention studies conducted in the Netherlands [, ]. These studies found effects on waist circumference and skin fold thickness [ ] or waist circumference and weight [ ], but had employees of companies as their target population and were more extensive in that it included email counseling [ ] and changes in the environment [ ]. Despite the planned theory and evidence-based development, the number of contacts, and the dynamic tailoring, our tailored intervention did not appear to be more effective than general information. Possible explanations may be the integration of self-regulation theory in an online intervention, methodological issues, and limited exposure to the intervention.
We used self-regulation theory as the main theoretical basis for the intervention. This theory is particularly suitable for management of chronic diseases, and behaviors and outcomes that need life long regulation, which is also the case for weight management. Self-regulation theory has been applied successfully in interventions aimed at weight-loss among young adults, asthma management, and diabetes [- ]. Many successful interventions that were based on self-regulation have been intensive counselor-led interventions, in which participants are guided through all the important steps of self-regulation (monitoring, goal setting, action planning, evaluation, and adaptation). However, in the present study we had to apply the self-regulation principles and strategies in a computerized program that had to guide the participants through all the steps of self-regulation. Although feasible, incorporating principles from self-regulation theory and self-regulation strategies in an online self-management intervention may not translate into the same results as when implemented in a face-to-face counseling session. That is, there are fewer possibilities for instructions for use, a smaller variety of options, and use of the intervention components may be less optimal, both in quality and frequency of use. There is indeed evidence that, for example, implementation intentions have been of better quality when developed in the presence of a researcher who reviewed the plans, compared to plans that were developed without a counselor present [ ]. Goals and plans that lack quality have previously been reported from unguided interventions [ , ].
Exposure to the Intervention
Even though multiple visits are associated with higher efficacy of (computer-tailored) interventions , it has also been well documented that attrition is high in online interventions with multiple sessions [ - ]. To improve the likelihood that participants would revisit the intervention, we incorporated some of the elements that had been indicated as potentially associated with more revisits in previous research [ ] in the intervention. In follow-up visits participants could monitor progress, could access new elements of the intervention, could review recipes and tips on the website that were refreshed every 2 weeks and participants received email reminders to visit the website every 2 weeks. Nevertheless, logon rates decreased over time. As a consequence, large numbers of participants in the intervention group were not exposed to parts of the intervention in which important self-regulation strategies, such as monitoring, feedback, and coping planning were incorporated. Therefore, the ‘dynamic’ tailoring (eg, feedback on progress), which is one element of computer tailoring that can increase effect size [ , ], was not delivered to large numbers of participants. Similar (low) use of self-regulation components has been observed before among a study sample of overweight adults [ ].
Possible reasons for dropout were the number and length of the tailored modules, and perhaps the ineffectiveness of the reminders. In order to increase use and effectiveness, we should improve these aspects, for example, by using other media such as short message service (SMS) as reminders . Direct contact, in order to motivate people and to teach the steps of self-regulation and problem solving skills [ ], may be useful to increase involvement. Furthermore, although the tailored intervention was appreciated a little bit more than the general information intervention, the overall appreciation was just sufficient. Improving the intervention on these aspects may have a positive influence on use and effect.
Kremers et al  found in their review that interventions aimed at weight management have small effect sizes (mean effect size of 0.06). This means that studies need to be powered to detect such small effect sizes. Our study was sufficiently powered to detect a difference of 0.4 BMI points, based on the assumption that weight would remain stable or be slightly reduced in the intervention group, and that weight would show the usual annual increase of 0.6 kg among the control group. However, weight did not increase in the control group in the actual study, but remained stable. Even though initially our sample size was sufficient for detecting the anticipated effect, retention of participants in the study was much lower than we had anticipated, thus reducing the actual power of the study. However, the size of the effect appears to be very small, indicating that lack of power was not the most important reason for not detecting an effect. Rather, the effect in the control group, whether it was caused by participation in the study, completion of the questionnaire, or the exposure to generic information, was larger than expected. The high dropout from the study is not unusual [ ], but is a serious concern, and at this moment we do not know the reasons for this high dropout.
It is possible that we could have detected an effect had we compared the intervention with a no-intervention control group. There is evidence that the effect size of a computer-tailored intervention depends on the comparison condition: comparing a tailored intervention to a generic message (r = 0.058) results in smaller effect sizes than comparing it to a no-treatment group (r = 0.11) . However, comparing the intervention to a no information control group can only provide insight into the effects of the intervention per se and cannot provide insight in the effectiveness of a specific technique, such as tailoring or self-regulation. In the present study we were interested in examining the effects in comparison to a control group that received ‘usual care’ in the form of generic information about weight management that can also be found on the website of the Dutch Nutrition Bureau. The technique of computer-tailoring and the incorporation of self-regulation strategies as incorporated and implemented in the present study appeared no more effective than the already available information on Dutch websites.
Another methodological issue that is worth discussing is the effect of offering respondents the option to choose their own behavioral change. Our second hypothesis concerned differences in dietary and physical activity behaviors. Changes in dietary and PA behaviors may precede or mediate changes in anthropometric outcome measures and are therefore relevant to study. Even though there was a time effect for some of these behaviors, there were no differences between the intervention and control group.
Lack of effects on the behavioral outcome measures was somewhat expected since participants could choose from 10 changes in DI and PA (eg, increase active transport with 20 minutes per day), and even more options within these subgroups (eg, cycling or walking), based on their current dietary and PA behavior. This results in small groups of people who chose for the same change to make, which makes it difficult to detect differences between the study groups in the dietary and PA sub-behaviors. Limited power for detection of differences in relevant underlying behaviors is one of the consequences of dynamic and personally adapted interventions.
Strengths and Limitations
Strengths of the study are its randomized controlled design and the use of objective measures of BMI, waist circumference and skin fold thickness. Limitations are the self-reported measures for physical activity and dietary intake, which may have resulted in less reliable outcomes. The baseline level of PA was high among all participants in the study, which may be due to over-reporting. If the participants also over-reported their PA level in the tailored intervention, this may have resulted in less room for improvement, limiting the potential intervention effect. Another limitation is that participants in the intervention and control condition were not exposed to an equal number of program sessions. However, we do not expect that this had a large effect on the study outcomes, since the tailored intervention (with more elaborate content) was not more effective than the generic information. Furthermore, we had a 6-month assessment as the longest follow-up. We cannot rule out that differences between the study groups would become more apparent after a longer follow-up period. Although dropout was high, it was similar in both conditions and mainly related to age, as in other studies [- ]. However, due to the high dropout the results cannot be generalized to other populations than those who remained participating in the study.
The carefully developed online, computer-tailored weight management intervention for adults who are overweight resulted in stable weight, and changes in dietary intake in the desired direction, but the tailored intervention was not more effective than generic information. A possible reason for the absence of intervention effects is sub-optimal use of the intervention, and the self-regulation components. Further research is therefore needed to gain more insight into how the intervention and exposure to its contents can be improved.
This work was support by a grant from ‘The Netherlands Organisation for Health Research and Development’ (ZonMW) [6130.0025].
AO had the original idea of for the study. LVG developed the intervention and conducted the evaluation study. AO and PVE supervised the intervention development and evaluation study. BB and TV provided feedback during intervention development, evaluation and writing the manuscript. GB supported the statistic analyses. LVG wrote the manuscript, supervised by AO and PVE. All authors have provided feedback on the manuscript.
Multimedia Appendix 1
CONSORT-EHEALTH checklist V1.6 .PDF File (Adobe PDF File), 1MB
- Formiguera X, Cantón A. Obesity: epidemiology and clinical aspects. Best Pract Res Clin Gastroenterol 2004 Dec;18(6):1125-1146. [CrossRef] [Medline]
- Stunkard AJ, Faith MS, Allison KC. Depression and obesity. Biol Psychiatry 2003 Aug 1;54(3):330-337. [Medline]
- Roberts RE, Deleger S, Strawbridge WJ, Kaplan GA. Prospective association between obesity and depression: evidence from the Alameda County Study. Int J Obes Relat Metab Disord 2003 Apr;27(4):514-521. [CrossRef] [Medline]
- Han TS, Tijhuis MA, Lean ME, Seidell JC. Quality of life in relation to overweight and body fat distribution. Am J Public Health 1998 Dec;88(12):1814-1820. [Medline]
- Burns CM, Tijhuis MA, Seidell JC. The relationship between quality of life and perceived body weight and dieting history in Dutch men and women. Int J Obes Relat Metab Disord 2001 Sep;25(9):1386-1392 [FREE Full text] [CrossRef] [Medline]
- Polder JJ, Takkern J, Meerding WJ, Kommer GJ, Stokx LJ. Kosten van Ziekten in Nederland - De zorgeuro ontrafeld Cost of illness in the Netherlands. Bilthoven: RIVM; 2002. URL: http://www.rivm.nl/bibliotheek/rapporten/270751005.pdf [accessed 2011-05-09] [WebCite Cache]
- Jeffery RW, Drewnowski A, Epstein LH, Stunkard AJ, Wilson GT, Wing RR, et al. Long-term maintenance of weight loss: current status. Health Psychology 2000 Jan;19(1 Suppl):5-16. [Medline]
- WHO. The challenge of obesity in the WHO European Region and the strategies for response. Copenhagen: WHO; 2007. URL: http://www.euro.who.int/__data/assets/pdf_file/0010/74746/E90711.pdf [accessed 2011-05-09] [WebCite Cache]
- Visscher TL, Kromhout D, Seidell JC. Long-term and recent time trends in the prevalence of obesity among Dutch men and women. Int J Obes Relat Metab Disord 2002 Sep;26(9):1218-1224 [FREE Full text] [CrossRef] [Medline]
- Hill JO, Wyatt HR, Reed GW, Peters JC. Obesity and the environment: where do we go from here? Science 2003 Feb 7;299(5608):853-855. [CrossRef] [Medline]
- Lombard CB, Deeks AA, Teede HJ. A systematic review of interventions aimed at the prevention of weight gain in adults. Public Health Nutr 2009 Nov;12(11):2236-2246. [CrossRef] [Medline]
- van Genugten L, van Empelen P, Flink I, Oenema A. Systematic development of a self-regulation weight-management intervention for overweight adults. BMC Public Health 2010;10:649 [FREE Full text] [CrossRef] [Medline]
- Jeffery RW, French SA. Preventing weight gain in adults: the pound of prevention study. Am J Public Health 1999 May;89(5):747-751. [Medline]
- van Wier MF, Ariëns GA, Dekkers JC, Hendriksen IJ, Smid T, van Mechelen W. Phone and e-mail counselling are effective for weight management in an overweight working population: a randomized controlled trial. BMC Public Health 2009;9:6 [FREE Full text] [CrossRef] [Medline]
- Kwak L, Kremers SP, Candel MJ, Visscher TL, Brug J, van Baak MA. Changes in skinfold thickness and waist circumference after 12 and 24 months resulting from the NHF-NRG In Balance-project. Int J Behav Nutr Phys Act 2010;7:26 [FREE Full text] [CrossRef] [Medline]
- Lemmens VE, Oenema A, Klepp KI, Henriksen HB, Brug J. A systematic review of the evidence regarding efficacy of obesity prevention interventions among adults. Obes Rev 2008 Sep;9(5):446-455. [CrossRef] [Medline]
- Kremers S, Reubsaet A, Martens M, Gerards S, Jonkers R, Candel M, et al. Systematic prevention of overweight and obesity in adults: a qualitative and quantitative literature analysis. Obes Rev 2010 May;11(5):371-379. [CrossRef] [Medline]
- Austin JT, Vancouver JB. Goal Constructs in Psychology: Structure, Process, and Content. Psychological Bulletin 1996;120(3):338-375. [CrossRef]
- Maes S, Karoly P. Self-regulation assessment and intervention in physical health and illness: a review. Applied Psychology 2005;54:267-299. [CrossRef]
- Anderson-Bill ES, Winett RA, Wojcik JR. Social cognitive determinants of nutrition and physical activity among web-health users enrolling in an online intervention: the influence of social support, self-efficacy, outcome expectations, and self-regulation. J Med Internet Res 2011;13(1):e28 [FREE Full text] [CrossRef] [Medline]
- Bakel AM, Zantinge EM. Nationaal Kompas Volksgezondheid; Accessed 4 August. 2010. Hoeveel mensen hebben overgewicht of ondergewicht? (How many people are underweight or overweight?) URL: http://www.nationaalkompas.nl/gezondheidsdeterminanten/persoonsgebonden/lichaamsgewicht/hoeveel-mensen-hebben-overgewicht-of-ondergewicht/ [accessed 2011-05-09] [WebCite Cache]
- Krebs P, Prochaska JO, Rossi JS. A meta-analysis of computer-tailored interventions for health behavior change. Prev Med 2010;51(3-4):214-221. [CrossRef] [Medline]
- Kroeze W, Werkman A, Brug J. A systematic review of randomized trials on the effectiveness of computer-tailored education on physical activity and dietary behaviors. Ann Behav Med 2006 Jun;31(3):205-223. [CrossRef] [Medline]
- Neville LM, O'Hara B, Milat A. Computer-tailored physical activity behavior change interventions targeting adults: a systematic review. Int J Behav Nutr Phys Act 2009;6:30 [FREE Full text] [CrossRef] [Medline]
- Neville LM, O'Hara B, Milat AJ. Computer-tailored dietary behaviour change interventions: a systematic review. Health Educ Res 2009 Aug;24(4):699-720 [FREE Full text] [CrossRef] [Medline]
- Parcel GS, Kok G, Gottlieb NH. Planning health promotion programs: an intervention mapping approach. San Francisco: Jossey-Bass; 2006.
- Durnin JV, Womersley J. Body fat assessed from total body density and its estimation from skinfold thickness: measurements on 481 men and women aged from 16 to 72 years. Br J Nutr 1974 Jul;32(1):77-97. [Medline]
- van Assema P, Brug J, Ronda G, Steenhuis I. The relative validity of a short Dutch questionnaire as a means to categorize adults and adolescents to total and saturated fat intake. J Hum Nutr Diet 2001 Oct;14(5):377-390. [Medline]
- Wendel-Vos GC, Schuit AJ, Saris WH, Kromhout D. Reproducibility and relative validity of the short questionnaire to assess health-enhancing physical activity. J Clin Epidemiol 2003 Dec;56(12):1163-1169. [Medline]
- Swinburn BA, Caterson I, Seidell JC, James WP. Diet, nutrition and the prevention of excess weight gain and obesity. Public Health Nutr 2004 Feb;7(1A):123-146. [Medline]
- Ajzen I. The theory of planned behavior. Organizational Behavior and Human Decision Processes 1991;50:179-211. [CrossRef]
- Weinstein ND, Sandman PM. A model of the precaution adoption process: evidence from home radon testing. Health Psychol 1992;11(3):170-180. [Medline]
- Gollwitzer PM, Bargh JA. The volitional benefits of planning. In: The Psychology of Action: Linking Cognition and Motivation to Behavior. New York: The Guilford Press; 1996:287.
- Enwald HP, Huotari ML. Preventing the obesity epidemic by second generation tailored health communication: an interdisciplinary review. J Med Internet Res 2010;12(2):e24 [FREE Full text] [CrossRef] [Medline]
- Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 2007 Jul;133(4):673-693. [CrossRef] [Medline]
- Hunter CM, Peterson AL, Alvarez LM, Poston WC, Brundige AR, Haddock CK, et al. Weight management using the internet a randomized controlled trial. Am J Prev Med 2008 Feb;34(2):119-126. [CrossRef] [Medline]
- Hall KD, Sacks G, Chandramohan D, Chow CC, Wang YC, Gortmaker SL, et al. Quantification of the effect of energy imbalance on bodyweight. Lancet 2011 Aug 27;378(9793):826-837. [CrossRef] [Medline]
- Hill JO. Can a small-changes approach help address the obesity epidemic? A report of the Joint Task Force of the American Society for Nutrition, Institute of Food Technologists, and International Food Information Council. Am J Clin Nutr 2009 Feb;89(2):477-484 [FREE Full text] [CrossRef] [Medline]
- Rodearmel SJ, Wyatt HR, Stroebele N, Smith SM, Ogden LG, Hill JO. Small changes in dietary sugar and physical activity as an approach to preventing excessive weight gain: the America on the Move family study. Pediatrics 2007 Oct;120(4):e869-e879 [FREE Full text] [CrossRef] [Medline]
- Booth AO, Nowson CA, Matters H. Evaluation of an interactive, Internet-based weight loss program: a pilot study. Health Educ Res 2008 Jun;23(3):371-381 [FREE Full text] [CrossRef] [Medline]
- Levine MD, Klem ML, Kalarchian MA, Wing RR, Weissfeld L, Qin L, et al. Weight gain prevention among women. Obesity (Silver Spring) 2007 May;15(5):1267-1277 [FREE Full text] [CrossRef] [Medline]
- Gokee-LaRose J, Gorin A, Wing R. Behavioral self-regulation for weight loss in young adults: a randomized controlled trial. International Journal of Behavioral Nutrition and Physical Activity 2009;6(1):10. [CrossRef]
- Shegog R, Bartholomew LK, Parcel GS, Sockrider MM, Mâsse L, Abramson SL. Impact of a computer-assisted education program on factors related to asthma self-management behavior. J Am Med Inform Assoc 2001;8(1):49-61 [FREE Full text] [Medline]
- Thoolen BJ, de Ridder D, Bensing J, Gorter K, Rutten G. Beyond good intentions: The role of proactive coping in achieving sustained behavioural change in the context of diabetes management. Psychol Health 2009 Mar;24(3):237-254. [CrossRef] [Medline]
- Luszczynska A. An implementation intentions intervention, the use of a planning strategy, and physical activity after myocardial infarction. Soc Sci Med 2006 Feb;62(4):900-908. [CrossRef] [Medline]
- de Vet E, Gebhardt WA, Sinnige J, Van Puffelen A, Van Lettow B, de Wit JBF. Implementation intentions for buying, carrying, discussing and using condoms: the role of the quality of plans. Health Education Research. 2011 Mar 16.
- de Vet E, Oenema A, Brug J. More or better: Do the number and specificity of implementation intentions matter in increasing physical activity? Psychology of Sport and Exercise 2011;12(4):471-477. [CrossRef]
- Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med 2007 Oct;33(4):336-345. [CrossRef] [Medline]
- Brouwer W, Oenema A, Raat H, Crutzen R, de Nooijer J, de Vries NK, et al. Characteristics of visitors and revisitors to an Internet-delivered computer-tailored lifestyle intervention implemented for use by the general public. Health Educ Res 2010 Aug;25(4):585-595 [FREE Full text] [CrossRef] [Medline]
- Robroek SJ, Brouwer W, Lindeboom D, Oenema A, Burdorf A. Demographic, behavioral, and psychosocial correlates of using the website component of a worksite physical activity and healthy nutrition promotion program: a longitudinal study. J Med Internet Res 2010;12(3):e44 [FREE Full text] [CrossRef] [Medline]
- Verheijden MW, Jans MP, Hildebrandt VH, Hopman-Rock M. Rates and determinants of repeated participation in a web-based behavior change program for healthy body weight and healthy lifestyle. J Med Internet Res 2007;9(1):e1 [FREE Full text] [CrossRef] [Medline]
- Brouwer W, Oenema A, Crutzen R, de Nooijer J, de Vries NK, Brug J. An exploration of factors related to dissemination of and exposure to internet-delivered behavior change interventions aimed at adults: a Delphi study approach. J Med Internet Res 2008;10(2):e10 [FREE Full text] [CrossRef] [Medline]
- Michie S, Abraham C, Whittington C, McAteer J, Gupta S. Effective techniques in healthy eating and physical activity interventions: a meta-regression. Health Psychol 2009 Nov;28(6):690-701. [CrossRef] [Medline]
- Binks M, van Mierlo T. Utilization patterns and user characteristics of an ad libitum Internet weight loss program. J Med Internet Res 2010;12(1):e9 [FREE Full text] [CrossRef] [Medline]
- Webb TL, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010;12(1):e4 [FREE Full text] [CrossRef] [Medline]
- Groeneveld IF, Proper KI, van der Beek AJ, Hildebrandt VH, van Mechelen W. Factors associated with non-participation and drop-out in a lifestyle intervention for workers with an elevated risk of cardiovascular disease. Int J Behav Nutr Phys Act 2009;6:80 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
|BMI: Body Mass Index|
|DI: Dietary intake|
|GI: Generic information intervention|
|PA: Physical activity|
|SFT: Skin fold thickness|
|SMS: Short message service|
|TI: Tailored intervention|
|WC: Waist circumference|
Edited by G Eysenbach; submitted 03.08.11; peer-reviewed by C Vandelanotte; comments to author 19.10.11; revised version received 28.11.11; accepted 16.01.12; published 14.03.12
©Lenneke van Genugten, Pepijn van Empelen, Brigitte Boon, Gerard Borsboom, Tommy Visscher, Anke Oenema. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.03.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.