Published on 14.12.10 in Vol 12, No 4 (2010): Oct-Dec
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/1640, first published Sep 01, 2010.
Dropout, Nonusage Attrition, and Pretreatment Predictors of Nonusage Attrition in a Commercial Web-Based Weight Loss Program
Background: An understanding of the factors that predict retention and website use are critical to the development of effective Web-based weight loss interventions. However, poor retention (dropout attrition) and website utilization (nonusage attrition) are major inhibitors to the effectiveness of Web-based programs.
Objective: The study aimed to (1) describe the prevalence of dropout and nonusage attrition and (2) examine pretreatment predictors of nonusage attrition in a cohort of commercial Web-based weight loss program participants.
Methods: Participants enrolled in the online program, The Biggest Loser Club, Australia, from August 15, 2007, to May 31, 2008. Only those who subscribed for 12 or 52 weeks were included in this study. All data were collected by the program proprietors, SP Health Co Pty Ltd (Sydney, Australia), and provided in “deidentified” form. Data collected included responses to a pretreatment survey (sociodemographic and behavioral characteristics), subscription history (date of enrollment and subscription end), and website use (log-ins, food and exercise diary entries, weigh-ins, and forum posts). Participants were classified as a member of the program at 12 or 52 weeks if they held an active subscription plan at that point in time. Participants were classified as nonusers at 12 or 52 weeks if they had stopped using all of the website features and had not returned. Predictors of nonusage attrition were explored using Cox proportional hazards regression analysis.
Results: Of the 9599 eligible participants, 6943 (72%) subscribed to the program for 12 weeks, and 2656 (28%) subscribed for 52 weeks. Of all participants, 31% (2975/9599) were classified as overweight, 61% (5866/9599) were classified as obese, 86% (8279/9599) were female, and participants’ mean (SD) age was 35.7 (9.5) years. The 12 week and 52 week subscribers’ retention rates were 97% and 77% respectively. Of 12 week subscribers, 35% were classified as program “users” after 12 weeks, and 30% of 52 week subscribers were classified as “users” after 52 weeks. Significant predictors of nonusage attrition among 12 week subscribers included age (hazard ratio for 45 to 55 years of age = 0.83, 95% confidence interval [CI] 0.73 - 0.93, P = .001; hazard ratio for 55 to 65 years of age = 0.80, 95% CI 0.66 - 0.99, P = .04), exercise level (hazard ratio = 0.76, 95% CI 0.72 - 0.81, P < .001), emotional eating (hazard ratio = 1.11, 95% CI 1.04 - 1.18, P = .001), eating breakfast (hazard ratio = 0.88, 95% CI 0.82 - 0.95, P = .001), and skipping meals (hazard ratio = 1.12, 95% CI 1.04 -1.19, P = .001). For 52 week subscribers, eating breakfast (hazard ratio = 0.88, 95% CI 0.79 - 0.99, P = .04) and not drinking tea or coffee with sugar (hazard ratio = 1.23, 95% CI 1.11 - 1.37, P < .001) were the pretreatment characteristics that significantly decreased risk of nonusage attrition.
Conclusions: The findings demonstrate a high prevalence of nonusage attrition among a cohort of commercial Web-based weight loss program participants. Several sociodemographic and behavioral factors were shown to independently predict nonusage attrition.
J Med Internet Res 2010;12(4):e69
Public health interventions delivered via the Internet are becoming increasingly popular, and evidence to support their ability to achieve health-related behavior change and positive health outcomes is growing . However, there is a need for Internet-delivered health and lifestyle interventions to minimize attrition and boost utilization rates in order to improve effectiveness [ - ]. A recent systematic review of Web-based weight loss interventions found that these interventions have the potential to achieve significant weight loss; however, they can also suffer from high dropout and poor utilization [ ].
Retention rates published to date for Web-based weight loss programs range from 20% to 100%, with the majority less than 80% . There may be an association between increased numbers of tasks prescribed or degree of participation required in Web-based interventions with lower retention rates. For example, studies comparing participants in Web-based weight loss interventions with control groups almost universally report higher retention among the control groups [ - ]. Furthermore, in some studies, where Web-based weight loss interventions are compared with Web-based interventions with a greater number of features, higher retentions rates are often found in the Web-based interventions with fewer features [ - ].
The majority of Web-based weight loss interventions report low website usage and experience a steady drop in usage over time . Many participants also do not achieve the level of use prescribed by the program [ , - ]. It appears, however, that the addition of evidence-based components to Web-based interventions such as behavioral therapy, human counseling, or motivational interviewing may result in greater website use compared with Web-based interventions that provide basic education or information only [ - , ]. For example, studies have demonstrated significantly higher numbers of log-ins [ - , ] as well as more self-monitoring occasions and higher attendance in online meetings [ ] with the addition of these evidence-based components. Recent systematic reviews of Web-based weight loss interventions have also acknowledged the inverse relationship between website use and weight loss [ , ]. Therefore, the ability of Web-based interventions to maximize utilization and retain participants is a crucial component of efforts to enhance effectiveness.
As participants can potentially fail to drop out of Web-based interventions but stop using the website, Eysenbach  has suggested that exploration of attrition rates should include dropout attrition rates (ie, participants who do not complete the study/program) and nonusage attrition rates (ie, participants who stop using the website). Such knowledge is required to improve our understanding of how participants use Web-based programs. Eysenbach [ ] has also highlighted the importance of exploring predictors of attrition in Web-based programs. Previous research has investigated pretreatment predictors of dropout attrition from weight loss interventions and demonstrated key sociodemographic characteristics (education level [ ], employment status [ , ], age [ , ], gender [ ]) and behavioral factors (number of previous weight loss attempts [ , , ], dietary intake [ ], emotional status [ , ], binge eating [ ], and weight loss expectations [ ]) that were predictive of dropout attrition. However, no consistent patterns of pretreatment predictors of nonusage attrition from Web-based weight loss interventions have been identified to date. Potential predictors include gender [ , ], age [ , , ], motivation [ ], body mass index [ ], physical activity [ ], and fruit and vegetable consumption [ ].
To date, studies investigating Web-based weight loss programs have predominantly been randomized controlled trials (RCTs). However, RCTs could potentially overestimate or underestimate participant attrition and website use due to the inherent characteristics of volunteers and study rigor (eg, motivated participants, additional assessment sessions, subject retention strategies, greater accountability, and contact with study staff). Therefore, RCTs may not represent attrition or website usage in the “real world.” Studies that follow real-world participants of Web-based weight loss programs are, therefore, needed to ascertain true dropout and nonusage attrition rates in order to enhance program effectiveness.
Therefore, the first aim of this study was to describe in a large cohort of real-world users of a commercial Web-based weight loss program, the prevalence of dropout and nonusage attrition. The second aim was to determine which pretreatment sociodemographic and behavioral characteristics predict nonusage attrition.
Participants and Design
Participants were adults 18 to 75 years of age who enrolled in a commercial Web-based weight loss program from August 15, 2007, through May 31, 2008, and paid a subscription to access the program. A self-reported body mass index (BMI) of greater than or equal to 22 kg/m2 was required to enroll in the program. Only participants who subscribed for 12 or 52 weeks were included in this study, as they are the most predominant subscription lengths. Participants who did not pay for their initial subscription (eg, free promotional program trials) were excluded. Data related to free or nonconsecutive memberships (≥ 7 days apart) were also not included in the analysis. Membership status and website use were tracked for the duration of the subscription.
The Commercial Web-Based Weight Loss Program
SP Health Co Pty Ltd (Sydney, Australia) developed the Web-based weight loss platform that is commercially available as The Biggest Loser Club. In summary, the online program incorporates key evidence-based weight management strategies and aligns with key elements of social cognitive theory  including self-management, social support, self-efficacy, outcome expectations and expectancies, and perceived barriers/facilitators. The key features of the program include goal setting (goal weight, daily calorie goal, and weekly exercise goals), self-monitoring of weight via weekly weigh-ins, as well as food and exercise using an online diary, educational material provided by weekly email, and an online discussion forum. Participants who enroll in the program purchase a specific subscription plan. The subscription plans are of 4, 12, 16, or 52 week’s duration and are either paid for prospectively at enrollment or by monthly installments. In 2007–2008 the cost of the program ranged from A$16.50 to A$79.95 per month. The cost per month to the participant was lower if they subscribed for longer and/or paid up front. Participants were predominantly recruited via marketing of the program through a reality television program, The Biggest Loser, Australia.
The proprietors of program, SP Health Co, store all data entered by participants accessing the program website. Data stored include responses to an enrollment survey, subscription plans held, and use of a number of the website features (log-ins, online food and activity diary entries, weigh-ins, and posts to the discussion forum). SP Health Co extracted stored data in “deidentifiable” form for up to 52 weeks from enrollment for all participants who met the inclusion criteria. Ethics approval for the study was obtained from the University of Newcastle Human Research Ethics Committee.
Participants’ pretreatment characteristics were captured from the enrollment survey. Participants’ self-reported height and weight were used to calculate BMI (weight in kilograms divided by height in meters squared), which was categorized as healthy, overweight, or obese using the World Health Organization’s BMI classification . Reported postcodes were assigned an Index of Relative of Socioeconomic Advantage and Disadvantage (IRSAD) decile (ranked from 1 = disadvantaged to 10 = advantaged) as an indicator of socioeconomic status [ ]. The remoteness of the area in which participants lived was classified according to the Accessibility/Remoteness Index of Australia (ARIA) of their postcode [ ]. Participants’ reasons for wanting to achieve weight loss were grouped as health-related reasons (eg, doctor recommended or health scare) and reasons not related to health (eg, to look good or to enhance one’s love life), and participants were categorized as having 1 or more health-related reasons or no health-related reasons for wanting to lose weight. Participants also selected their reasons for eating (to ease emotional upset, for the joy of it, to reduce stress, and out of boredom), whether they had eating habits associated with weight gain (frying foods, using butter in cooking, drinking full sugar soft drinks, skipping meals, drinking tea or coffee with sugar, not eating breakfast, not using low fat products, keeping snack foods in the house, and not drinking 6 or more glasses of water a day) and the number of days they exercised per week. Age and gender were also captured from the enrollment survey.
Website use was assessed by summing available usage data. Participants were classified as having used the website on any given day if they logged in, made an entry in the diary, posted to the forum, and/or weighed in. The total number of days per 4 week period each participant “used” the website was calculated and categorized as 0 days, 1 to 3 days, 4 to 7 days, 8 to 15 days and 16 or more days. All website use variables were calculated from enrollment to 12 and 52 weeks for the 12- and 52 week subscribers respectively.
The date a participant enrolled in program and the date membership ceased were used to calculate the number of days each participant was a member of the program (ie, duration of membership). The date membership ceased was the end date of the participant’s subscription plan unless there were special circumstances that prevented the participant from completing the subscription (eg, pregnancy or financial constraints). Participants were classified as members of the program at 12 or 52 weeks if they held an active subscription plan at that point in time (≥ 78 days for 12 week subscriptions and ≥ 359 days for 52 week subscriptions). Otherwise they were classified as a dropout.
Nonusage attrition was only considered for participants who completed their subscription (ie, they did not drop out). Participants were classified as a nonuser at 12 or 52 weeks if they stopped using the website features (ie, no log-ins, food/activity diary entries, weigh-ins, or posts to the discussion forum). The week a participant was classified as a nonuser was the week he or she ceased using the website and did not return.
Data analysis was undertaken using Stata 11 IC (StataCorp LP, College Station, USA). Participant pretreatment characteristics were described as means (SD) for continuous variables and percentage for categorical variables. Subscription length (12 and 52 weeks) group differences were tested using independent t tests for continuous variables and chi-square tests for categorical variables. Participants’ pretreatment characteristics were investigated as predictors of nonusage attrition for 12- and 52 week subscribers using Cox proportional hazards regression analyses. The time variable was the duration of usage (in weeks), and nonusage was considered a failure. Univariate analyses were conducted on all pretreatment predictor variables of interest and those with P < .2 were included in a stepwise regression analysis to find the most parsimonious model. The proportional hazards assumption was tested for each model using the Schoenfeld residuals. The significance level was set at alpha = .05.
Pretreatment Characteristics and Website Use
Of the 11,341 participants who enrolled in the commercial Web-based weight loss program between August 15, 2007, and May 31, 2008, 9599 were eligible for inclusion in the study, and 1742 were excluded (). In all, 72% (6943/9599) of eligible participants subscribed to the program for 12 weeks, and 2656 subscribed for 52 weeks.
The characteristics of the eligible participants are outlined in. In summary, 31% (2975/9599) of participants were overweight, 61% (5866/9599) were obese, and 86% (8279/9599) were female. The mean (SD) age of participants was 35.7 (9.5) years, 85% (8022/9455) of participants were of moderate-to-high socioeconomic status (ie, scored between 5 and 10 on IRSAD), and 75% (7125/9456) were from major cities in Australia. The majority of the group reported some healthy eating habits such as eating breakfast (7052/9599 or 74%) and using low fat products (6269/9599 or 65%), but many (5098/9599 or 53%) also reported poor eating habits such as skipping meals. Most participants reported inadequate levels of physical activity at enrollment, with 51% (4875/9569) exercising less than 2 days per week.
|Descriptor||Total||12 Weeks||52 Weeks||P Value|
|n = 9599||n = 6943||n = 2656|
|Mean (SD)||35.7 (9.5)||35.3 (9.4)||36.7 (9.6)||< .001|
|18 to 25 years, %||12.8||13.5||10.8||< .001|
|25 to 35 years, %||37.4||38.6||34.5|
|35 to 45 years, %||33.2||32.3||35.6|
|45 to 55 years, %||13.2||12.6||14.7|
|55 to 65 years, %||3.1||2.8||4.0|
|65 to 75 years, %||0.4||0.4||0.4|
|Mean (SD)||32.9 (6.7)||31.8 (6.1)||35.8 (7.1)||< .001|
|Healthy weight, %||7.9||9.7||3.1||< .001|
|Socioeconomic status (IRSAD decile)a|
|1-2, %||5.8||4.9||8.0||< .001|
|Major city, %||75.4||76.4||72.7||.001|
|Days of planned exercisec|
|0-1 days, %||51.0||50.6||51.8||< .001|
|2 or more days, %||49.0||49.4||48.2|
|Fry foods, %||37.9||36.4||42.4||< .001|
|Use butter in cooking, %||36.1||35.4||38.2||.01|
|Drink full sugar soft drinks, %||29.4||28.2||32.6||< .001|
|Skip meals, %||53.1||51.3||58.0||< .001|
|Drink tea or coffee with sugar, %||43.7||44.4||41.9||.03|
|Eat breakfast, %||73.5||74.7||70.3||< .001|
|Use low fat products, %||65.3||66.3||62.7||.001|
|Keep snack foods in the house, %||59.8||58.9||62.1||.004|
|Drink 6+ glasses of water a day, %||40.7||41.2||39.4||.10|
|Reason for eating|
|To ease emotional upset, %||56.0||55.0||58.7||.001|
|For the joy of it, %||55.9||53.4||56.9||.002|
|To reduce stress, %||44.6||44.0||46.1||.07|
|Out of boredom, %||78.6||78.9||77.9||.26|
|One or more health-related reasons for weight loss, %||54.7||53.2||58.9||< .001|
a Total n = 9455; at 12 weeks n = 6841; and at 52 weeks, n = 2614
b Total n = 9456; at 12 weeks, n = 6842; and at 52 weeks, n = 2614
c Total n = 9569; at 12 weeks, n = 6923; and at 52 weeks, n = 2646
Statistically significant differences in pretreatment characteristics of 12- and 52 week subscribers were evident, with the mean (SD) age of participants who subscribed for 52 weeks being significantly greater (35.8 [7.1] years of age vs 31.8 [6.1] years of age), having a higher mean (SD) BMI (36.7 [9.6] vs 35.3 [9.4]), being of lower socioeconomic status (82% vs 86% with an ISRAD of 5 to 10), and a lower proportion residing in major cities of Australia (73% vs 76%) when compared with 12 week subscribers. A significantly higher proportion of 52 week subscribers reported poor eating habits (eg, frying foods or drinking full sugar soft drinks), exercising less than 2 days per week, eating for emotional reasons or for the joy of it, and having health-related reasons for wanting to lose weight.
describe overall website use. For both 12- and 52 week subscribers, the highest proportion of participants used the website on 16 days or more during weeks 1 to 4 of the program. During weeks 5 to 8 and weeks 9 to 12, the highest proportion of 12 week subscribers did not use the website. However, of the participants who did use the website, most used it 1 to 3 days during each 4 week period. For 52 week subscribers, the highest proportion of participants used the program on 1 to 3 days from weeks 5 to 8. After this time (ie, weeks 9 to 52) the highest proportion of participants never used the website, and the second highest proportion used the website 1 to 3 days in each 4 week period.
and present dropout attrition curves for 12- and 52 week subscribers respectively. Of the 6943 participants who subscribed to the program for 12 weeks, the retention rate was 97% at 12 weeks, with 238 participants (3%) dropping out over the 12 week period ( ). For the 2656 participants who subscribed to the program for 52 weeks, the retention rate was 77% with 605 dropping out over the 52 week period ( ).
and also present nonusage attrition curves for those who subscribed and completed a 12- or 52 week subscription, respectively. Of the 6705 participants who subscribed to and completed 12 weeks of the program, 35% (2317) of participants were classified as ”users” of the program at 12 weeks. The lowest proportion of participants stopped using the program during weeks 1 and 2. The proportion of participants who stopped using the program remained steady from week 3 to week 10 (6% to 7% stopped using per week) but increased during week 11 to 8%. Of the 6705 12 week subscribers, 50% (n = 3398) had become nonusers of the program by week 9 ( ).
Of the 2051 participants who completed their 52 week subscription, 622 participants (30%) were “users” of the program at 52 weeks. The proportion of participants who stopped using the program remained steady from week 1 to week 44 (1% to 2% stopped using per week) but increased rapidly thereafter. By week 46, greater than 50% of the 52 week subscribers were nonusers of the program ().
Predictors of Nonusage Attrition: 12 week Subscribers
describes unadjusted predictors of nonusage attrition among 12 week subscribers from univariate analyses. In the multiple regression analysis ( ), skipping meals (hazard ratio = 1.12, 95% confidence interval (CI) 1.04 - 1.19, P = .001) and eating to ease emotional upset (hazard ratio = 1.11, 95% CI 1.04 -1.18, P = .001) were the 2 pretreatment characteristics found to significantly increase a participants risk of being a nonuser. Participants who exercised more than 1 day per week were at a significantly decreased risk of being a nonuser (hazard ratio = 0.76, 95% CI 0.72 - 0.81, P < .001). Participants who ate breakfast (hazard ratio = 0.88, 95% CI 0.82 - 0.95, P = .001) were also at decreased risk of nonusage, as well as participants aged 45 to 65 years (hazard ratio for 45 to 55 years of age = 0.83, 95% CI 0.73 - 0.93, P = .001; hazard ratio for 55 to 65 years of age = 0.80, 95% CI 0.66 - 0.99, P = .04).
|Risk Factor||Unadjusted (n = 6705)||Adjusted (n = 6686)d|
|Female||0.85 (0.78 - 0.92)||< .001|
|18 to 25||1.00 (reference)||1.00 (reference)|
|25 to 35||0.92 (0.84 -1.01)||.09||0.93 (0.85 - 1.02)||.12|
|35 to 45||0.92 (0.84 -1.01)||.09||0.93 (0.85 - 1.03)||.15|
|45 to 55||0.81 (0.72 - 0.91)||< .001||0.83 (0.73 - 0.93)||.001|
|55 to 65||0.77 (0.63 - 0.95)||.01||0.80 (0.66 - 0.99)||.04|
|65 to 75||0.54 (0.29 - 1.01)||.05||0.63 (0.34 - 1.17)||.14|
|Socioeconomic status (IRSAD decile)a|
|3-4||1.04 (0.88 - 1.23)||.67|
|5-6||0.97 (0.83 - 1.13)||.69|
|7-8||1.01 (0.87 - 1.17)||.93|
|9-10||1.03 (0.89 - 1.19)||.72|
|Major cities of Australia||1.00 (reference)|
|Regional Australia||0.97 (0.90 - 1.04)||.35|
|Rural/remote Australia||1.17 (0.91 - 1.49)||.21|
|Healthy weight||1.00 (reference)|
|Overweight||1.02 (0.92 - 1.14)||.66|
|Obese||1.11 (1.00 - 1.24)||.04|
|0 to 1 days||1.00 (reference)||1.00 (reference)|
|2 or more days||0.74 (0.69 - 0.78)||< .001||0.76 (0.72 - 0.81)||< .001|
|Reason for eating|
|To ease emotional upset||1.07 (1.01 - 1.14)||.01||1.11 (1.04 - 1.18)||.001|
|For the joy of it||0.99 (0.93 - 1.05)||.63|
|To reduce stress||1.10 (1.03 - 1.16)||.002|
|Out of boredom||0.98 (0.91 - 1.05)||.59|
|Fry foods||1.07 (0.99 - 1.13)||.07|
|Use butter in cooking||1.06 (0.99 - 1.13)||.07|
|Drink full sugar soft drinks||1.16 (1.09 - 1.24)||< .001|
|Skip meals||1.23 (1.16 - 1.31)||< .001||1.12 (1.04 - 1.19)||.001|
|Drink tea or coffee with sugar||0.99 (0.94 - 1.05)||.84|
|Eat breakfast||0.77 (0.72 - 0.82)||< .001||0.88 (0.82 - 0.95)||.001|
|Use low fat products||0.85 (0.79 - 0.90)||< .001|
|Keep snack foods in the house||1.03 (0.97 - 1.09)||.33|
|Drink 6 or more glasses of water a day||0.92 (0.86 - 0.97)||.004|
|1 or more health-related reasons for weight loss||0.97 (0.92 - 1.03)||.37|
a n = 6610
b n = 6611
c n = 6686 (all unadjusted)
d Stratified by gender
Predictors of Nonusage Attrition: 52 week Subscribers
describes unadjusted potential predictors of nonusage attrition for 52 week subscribers using univariate analyses. In the multiple regression analysis ( ), eating breakfast (hazard ratio = 0.88, 95% CI 0.79 - 0.99, P = .04) was shown to be associated with reduced risk of nonusage attrition. Drinking tea or coffee with sugar was associated with increased risk of nonusage attrition among 52 week subscribers (hazard ratio = 1.23, 95% CI 1.11- 1.37, P < .001).
|Risk Factors||Unadjusted (n = 2051)||Adjusted (n = 2043)d|
|Female||0.90 (0.78 - 1.04)|
|18 to 25||1.00 (reference)|
|25 to 35||0.96 (0.79 - 1.16)||.66|
|35 to 45||0.93 (0.77 - 1.16)||.45|
|45 to 55||0.79 (0.63 - 0.97)||.03|
|55 to 65||0.68 (0.49 - 0.91)||.01|
|65 to 75||0.20 (0.02 - 1.44)||.11|
|Socioeconomic status (IRSAD decile)a|
|3-4||0.92 (0.71 - 1.18)||.49|
|5-6||0.82 (0.66 - 1.03)||.08|
|7-8||0.89 (0.72 - 1.10)||.29|
|9-10||0.82 (0.66 - 1.01)||.06|
|Major cities of Australia||1.00 (reference)|
|Regional Australia||1.03 (0.91 - 1.16)||.66|
|Rural/remote Australia||1.05 (0.64 - 1.71)||.89|
|Healthy weight||1.00 (reference)|
|Overweight||1.02 (0.74 - 1.42)||.89|
|Obese||1.04 (0.76 - 1.41)||.83|
|0 to 1 day||1.00 (reference)|
|2 or more days||0.70 (0.63 - 0.78)||< .001|
|Reason for eating|
|To ease emotional upset||0.98 (0.88 - 1.08)||.64|
|For the joy of it||0.96 (0.87 - 1.07)||.46|
|To reduce stress||0.93 (0.84 - 1.03)||.17|
|Out of boredom||0.97 (0.86 - 1.10)||.62|
|Fry foods||1.12 (1.00 - 1.24)||.04|
|Use butter in cooking||1.16 (1.04 - 1.29)||.007|
|Drink full sugar soft drinks||1.12 (1.01 - 1.26)||.04|
|Skip meals||1.22 (1.10 - 1.36)||< .001|
|Drink tea or coffee with sugar||1.25 (1.13 - 1.39)||< .001||1.23 (1.11 - 1.37)||< .001|
|Eat breakfast||0.82 (0.73 - 0.92)||.001||0.88 (0.79 - 0.99)||.04|
|Use low fat products||0.84 (0.75 - 0.93)||.001|
|Keep snack foods in the house||1.09 (0.98 - 1.21)||.13|
|Drink 6 or more glasses of water a day||0.93 (0.83 - 1.03)||.15|
|1 or more health-related reasons for weight loss||0.90 (0.81 - 1.01)||.06|
a n = 2019
b n = 2019
c n = 2043 (all unadjusted)
d Stratified by exercise level
This study is one of only a small number of studies [, - ] to follow a group of real-world participants of a Web-based weight loss program and is the first to comprehensively evaluate the prevalence and predictors of nonusage attrition in a large cohort. The study demonstrates a high prevalence of nonusage attrition and highlights the need for evidence-based strategies to reduce attrition rates. Notably, we found that a participant’s age, as well as his or her eating and physical activity habits at enrollment can predict nonusage attrition.
The findings from this study are consistent with other studies that have demonstrated that individuals in the mid-to-older age group (45 to 65 years) are at decreased risk of nonusage [, , ]. People in this age group have lower levels of Internet access [ ], spend less time using the Internet and are less likely to use user-generated sites than younger age groups [ , ]. However, their access and use of the Internet is increasing rapidly [ , ]. Therefore, this suggests that Web-based interventions may be well suited to the mid-to-older age groups.
The study findings suggest that people with poor eating or physical activity habits prior to enrolling in a commercial Web-based weight loss program are most likely to stop using the program. This includes participants who exercised less than 2 days per week, skipped meals, did not eat breakfast, drank tea or coffee with added sugar, or identified eating to ease emotional upset. This suggests that these at-risk individuals may require alternate or additional support to remain an active participant of Web-based programs, particularly in the short-term. Alternatively, it may be that the Web-based program in its current form did not engage this group of participants. A research priority is, therefore, to determine whether different or extra website features can improve website usage in this group of at-risk individuals.
This study highlights the importance of investigating nonusage attrition to accurately describe attrition rates. The retention rates for the commercial Web-based weight loss program of 97% after 12 weeks and 77% after 52 weeks were high in comparison with observational [, , , ] and experimental [ ] Web-based weight loss intervention studies, as well as all types of behavioral weight loss interventions [ ]. However, as participants purchase a specific subscription plan and can only unsubscribe if they have special circumstances that prevent them from completing their subscription, the retention rates do not capture those participants who did not wish to continue using the program. The nonusage attrition at 12 weeks of 65% and at 52 weeks of 70% is higher than the dropout attrition rates and demonstrates that a number of participants do not continue to use the commercial Web-based weight loss program for the duration of their subscription. Use of the commercial website was consistent with other public health interventions delivered via the Internet, whereby use drops after the preliminary weeks of the intervention [ ]. For both 12- and 52 week subscribers the nonusage attrition was steady throughout the majority of the intervention, but nonusage attrition increased slightly towards the final weeks of the intervention. This opposes a previous hypothesis that suggests that by the final phase of the intervention a stable user group should exist, resulting in less nonusage [ ]. The pattern of nonusage attrition in this study is most likely an interplay of several factors that potentially impact nonusage attrition either positively (eg, cost of program, program features, and usability) or negatively (eg, no prompts or personal contact, self-directed nature) [ ].
To our knowledge, only 2 other studies have investigated nonusage attrition rates in a Web-based interventions aiming to achieve weight loss [, ]. The first, an observational study, described nonusage attrition rates for a physical activity focused Web-based program (MiLife) and found that 79% of participants were still using the website after 12 weeks [ ]. The second study compared nonusage attrition rates among RCT and real-world participants of a Web-based intervention (Active-Online) to promote physical activity over an 18-month period. Greater than 50% of trial participants became nonusers after approximately 11 months and 1 month for the real-world participants [ ]. This commercial Web-based weight loss program’s nonusage attrition rates were superior to the real-world participants of Active-Online but higher than MiLife [ , ]. However, both Active-Online and MiLife incorporated strategies that have been previously proposed as factors that influence nonusage attrition [ ]. One intervention was worksite based [ ], which may have enhanced the networking and/or peer pressure and peer support, and, therefore, reversed the usual decline in nonusage [ ]. A number of “push-factors” [ ], including reminder emails and short message service (SMS) were utilized [ , ]; therefore, participants may have felt obligated to continue using the Web-based programs [ ]. The use of accelerometers by participants in one of the studies to monitor physical activity levels [ ] may have improved the usability of the program and, therefore, increased usage rates [ ]. In comparison, the commercial Web-based weight loss program is primarily a self-directed intervention. This may have negatively impacted usage rates, as it made it easier for participants to stop using the program [ ]. However, the participants paid a commercial rate to access the program, which has been previously suggested to positively impact usage rates [ ]. As the cost of the program varied and was dependant on the length of subscription and whether a participant paid up front or in installments, the impact on nonusage may have varied. Therefore, the nonusage attrition rates reported in this study appear acceptable compared with previous studies, taking into consideration the existence of factors that may have impacted nonusage attrition.
Potential limitations of this study include that only pretreatment characteristics were considered as potential predictors of nonusage attrition. It is possible that other factors such as satisfaction with the program, initial and ongoing weight loss, and external factors also influenced program use. However, the aim of this study was to determine whether it is possible to predict who will use the program at enrollment. Furthermore, although a large number of pretreatment characteristics were explored as potential predictors of nonusage attrition, the study could have been improved by including a larger range of pretreatment characteristics (eg, motivation and stage of change), as well as through the use of validated measures to more comprehensively assess eating and physical activity behaviors. In addition, the study did not track the use of all features of the commercial Web-based weight loss program (eg, weekly tutorials and menu plans), as these data were not available at the time of the study. This may have overestimated nonusage attrition rates. Furthermore, the methodology assumes that nonusage is a negative behavior. It has been suggested, however, that participants may consider Web-based interventions differently from other treatment options . Participants who stop using the website may have achieved a positive outcome and, therefore, reduced the frequency with which they engage with the Web-based program [ ]. Further research investigating participants’ reasons for dropout and nonusage attrition and the impact of dropout and nonusage attrition on long-term weight loss is therefore required.
Adherence has been acknowledged as one of the main determinants of effectiveness ; therefore, strategies are required to improve nonusage attrition rates among Web-based weight loss program participants. Previous research [ ], including research with this cohort [ ], has demonstrated a significant correlation between the use of different website features (eg, log-ins, use of discussion forums, online diary entries, and self-monitoring of weight) and weight change. Therefore, there is potential to improve weight loss achieved by participants of Web-based weight loss programs by establishing effective methods to improve nonusage attrition, so that the majority of participants continue to use the website features in the long-term. As the mean weight change achieved by participants of this Web-based weight loss program after 12 and 52 weeks has been found to be clinically important and statistically significant [ , ], if strategies were successful in improving engagement, the public health impact could be substantial.
The findings from this study also highlight key pretreatment sociodemographic and behavioral predictors of nonusage attrition. The findings are similar to other weight loss [, - ] and Web-based intervention studies [ ], whereby individuals most in need of treatment are less likely to complete and/or engage with the intervention. A number of previous Web-based intervention studies have investigated Web and non-Web-based strategies to improve website engagement including periodic prompts, incentives, self-monitoring, management of participant expectations, improving intervention usability, provision of feedback, as well as contact with service providers [ ]. Given the self-directed nature of this intervention, the findings suggest clear evidence-based guidelines outlining the website use required to achieve significant outcomes may also improve nonusage attrition rates. One or a combination of these strategies could be provided to the participants who enroll in the program with the pretreatment characteristics predictive of attrition. However, we do not know the most appropriate strategy or combination of strategies required to improve the use of Web-based programs or whether the strategies required are consistent across population groups. In the future, such knowledge may be used as part of the enrollment process to ensure individuals enroll who are best suited to this approach and that they are provided with access to program features within the Web-based program that meets their needs. Therefore, a research priority is the development and evaluation of strategies to improve nonusage attrition rates in Web-based programs, including their impact on different population groups.
Previous research has identified optimization of participant retention and website use as key challenges for all Web-based interventions [- ]. This study demonstrated the high prevalence nonusage attrition characteristic of Web-based interventions and, therefore, highlights the need for evidence-based strategies to improve website use. Researchers should investigate the use of new or additional intervention strategies among participants with the pretreatment demographic and behavioral characteristics that were found to independently predict nonusage attrition in this study.
We acknowledge the work of Ben Noblet in retrieving the data, Anna Crook and Penelope Jones for assistance with interpreting the data set, and Patrick McElduff for assistance with design and implementation of the statistical analyses. MJ Neve is funded by an Australian Postgraduate Award scholarship and a scholarship top-up from SP Health Co Pty Ltd. CE Collins is supported by an Australian National Health and Medical Research Council Career Development Award research fellowship
Conflicts of Interest
MJ Neve receives a postgraduate scholarship top-up from SP Health Co. CE Collins is a consultant dietitian to SP Health Co. PJ Morgan and CE Collins hold an Australian Research Council (ARC) Linkage project grant that is evaluating a weight loss program with SP Health Co.
- Wantland DJ, Portillo CJ, Holzemer WL, Slaughter R, McGhee EM. The effectiveness of Web-based vs. non-Web-based interventions: a meta-analysis of behavioral change outcomes. J Med Internet Res 2004 Nov 10;6(4):e40 [FREE Full text] [CrossRef] [Medline]
- Bennett GG, Glasgow RE. The delivery of public health interventions via the Internet: actualizing their potential. Annu Rev Public Health 2009 Apr 29;30:273-292. [CrossRef] [Medline]
- Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med 2009 Aug;38(1):18-27. [CrossRef] [Medline]
- Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
- Neve M, Morgan PJ, Jones PR, Collins CE. Effectiveness of web-based interventions in achieving weight loss and weight loss maintenance in overweight and obese adults: a systematic review with meta-analysis. Obes Rev 2010 Apr;11(4):306-321. [CrossRef] [Medline]
- Carr LJ, Bartee RT, Dorozynski C, Broomfield JF, Smith ML, Smith DT. Internet-delivered behavior change program increases physical activity and improves cardiometabolic disease risk factors in sedentary adults: results of a randomized controlled trial. Prev Med 2008 May;46(5):431-438. [CrossRef] [Medline]
- Cussler EC, Teixeira PJ, Going SB, Houtkooper LB, Metcalfe LL, Blew RM, et al. Maintenance of weight loss in overweight middle-aged women through the Internet. Obesity (Silver Spring) 2008 May;16(5):1052-1060 [FREE Full text] [CrossRef] [Medline]
- Harvey-Berino J, Pintauro SJ, Gold EC. The feasibility of using Internet support for the maintenance of weight loss. Behav Modif 2002 Jan;26(1):103-116. [Medline]
- Hunter CM, Peterson AL, Alvarez LM, Poston WC, Brundige AR, Haddock CK, et al. Weight management using the internet a randomized controlled trial. Am J Prev Med 2008 Feb;34(2):119-126. [CrossRef] [Medline]
- Morgan PJ, Lubans DR, Collins CE, Warren JM, Callister R. The SHED-IT randomized controlled trial: evaluation of an Internet-based weight-loss program for men. Obesity (Silver Spring) 2009 Nov;17(11):2025-2032 [FREE Full text] [CrossRef] [Medline]
- Webber KH, Tate DF, Michael Bowling J. A randomized comparison of two motivationally enhanced Internet behavioral weight loss programs. Behav Res Ther 2008 Sep;46(9):1090-1095. [CrossRef] [Medline]
- Womble LG, Wadden TA, McGuckin BG, Sargent SL, Rothman RA, Krauthamer-Ewing ES. A randomized controlled trial of a commercial internet weight loss program. Obes Res 2004 Jun;12(6):1011-1018. [CrossRef] [Medline]
- Glasgow RE, Nelson CC, Kearney KA, Reid R, Ritzwoller DP, Strecher VJ, et al. Reach, engagement, and retention in an Internet-based weight loss program in a multi-site randomized controlled trial. J Med Internet Res 2007;9(2):e11 [FREE Full text] [CrossRef] [Medline]
- Gold BC, Burke S, Pintauro S, Buzzell P, Harvey-Berino J. Weight loss on the web: A pilot study comparing a structured behavioral intervention to a commercial program. Obesity (Silver Spring) 2007 Jan;15(1):155-164 [FREE Full text] [CrossRef] [Medline]
- Tate DF, Jackvony EH, Wing RR. A randomized trial comparing human e-mail counseling, computer-automated tailored counseling, and no counseling in an Internet weight loss program. Arch Intern Med 2006;166(15):1620-1625 [FREE Full text] [CrossRef] [Medline]
- Tate DF, Jackvony EH, Wing RR. Effects of Internet behavioral counseling on weight loss in adults at risk for type 2 diabetes: a randomized trial. JAMA 2003 Apr 9;289(14):1833-1836 [FREE Full text] [CrossRef] [Medline]
- Glasgow RE. eHealth evaluation and dissemination research. Am J Prev Med 2007 May;32(5 Suppl):S119-S126. [CrossRef] [Medline]
- Vandelanotte C, Spathonis KM, Eakin EG, Owen N. Website-delivered physical activity interventions a review of the literature. Am J Prev Med 2007 Jul;33(1):54-64. [CrossRef] [Medline]
- Norman GJ, Zabinski MF, Adams MA, Rosenberg DE, Yaroch AL, Atienza AA. A review of eHealth interventions for physical activity and dietary behavior change. Am J Prev Med 2007 Oct;33(4):336-345. [CrossRef] [Medline]
- Tate DF, Wing RR, Winett RA. Using Internet technology to deliver a behavioral weight loss program. JAMA 2001 Mar 7;285(9):1172-1177 [FREE Full text] [Medline]
- Elfhag K, Rössner S. Who succeeds in maintaining weight loss? A conceptual review of factors associated with weight loss maintenance and weight regain. Obes Rev 2005 Feb;6(1):67-85. [CrossRef] [Medline]
- Inelmen EM, Toffanello ED, Enzi G, Gasparini G, Miotto F, Sergi G, et al. Predictors of drop-out in overweight and obese outpatients. Int J Obes (Lond) 2005 Jan;29(1):122-128. [CrossRef] [Medline]
- Dalle Grave R, Calugi S, Molinari E, Petroni ML, Bondi M, Compare A, QUOVADIS Study Group. Weight loss expectations in obese patients and treatment attrition: an observational multicenter study. Obes Res 2005 Nov;13(11):1961-1969. [CrossRef] [Medline]
- Honas JJ, Early JL, Frederickson DD, O'Brien MS. Predictors of attrition in a large clinic-based weight-loss program. Obes Res 2003 Jul;11(7):888-894. [CrossRef] [Medline]
- Fabricatore AN, Wadden TA, Moore RH, Butryn ML, Heymsfield SB, Nguyen AM. Predictors of attrition and weight loss success: Results from a randomized controlled trial. Behav Res Ther 2009 Aug;47(8):685-691. [CrossRef] [Medline]
- Teixeira PJ, Going SB, Houtkooper LB, Cussler EC, Metcalfe LL, Blew RM, et al. Pretreatment predictors of attrition and successful weight management in women. Int J Obes Relat Metab Disord 2004 Sep;28(9):1124-1133. [CrossRef] [Medline]
- Yass-Reed EM, Barry NJ, Dacey CM. Examination of pretreatment predictors of attrition in a VLCD and behavior therapy weight-loss program. Addict Behav 1993;18(4):431-435. [Medline]
- Grossi E, Dalle Grave R, Mannucci E, Molinari E, Compare A, Cuzzolaro M, et al. Complexity of attrition in the treatment of obesity: clues from a structured telephone interview. Int J Obes (Lond) 2006 Jul;30(7):1132-1137. [CrossRef] [Medline]
- Wanner M, Martin-Diener E, Bauer G, Braun-Fahrländer C, Martin BW. Comparison of trial participants and open access users of a web-based physical activity intervention regarding adherence, attrition, and repeated participation. J Med Internet Res 2010;12(1):e3 [FREE Full text] [CrossRef] [Medline]
- Verheijden MW, Jans MP, Hildebrandt VH, Hopman-Rock M. Rates and determinants of repeated participation in a web-based behavior change program for healthy body weight and healthy lifestyle. J Med Internet Res 2007;9(1):e1 [FREE Full text] [CrossRef] [Medline]
- Bandura A. Social foundations of thought and action: a social cognitive theory. Englewood Cliffs, N.J.: Prentice-Hall; 1986.
- World Health Organisation. Obesity: Preventing and managing the global epidemic. Report of a WHO consultation. Geneva: WHO; 2000. URL: http://whqlibdoc.who.int/trs/who_trs_894.pdf [accessed 2010-11-17] [WebCite Cache]
- Australian Bureau of Statistics. Information paper: An introduction to socio-economic indexes for areas (SEIFA). Canberra: ABS; 2006. URL: http://www.ausstats.abs.gov.au/ausstats/subscriber.nsf/0/D729075E079F9FDECA2574170011B088/$File/20390_2006.pdf [accessed 2010-11-17] [WebCite Cache]
- Australian Bureau of Statistics. Australian standard geographic classification (ASGC). Canberra: ABS; 2008.
- Binks M, van Mierlo T. Utilization patterns and user characteristics of an ad libitum Internet weight loss program. J Med Internet Res 2010;12(1):e9 [FREE Full text] [CrossRef] [Medline]
- Carter-Edwards L, Bastian LA, Schultz M, Amamoo MA, Østbye T. An internet-based weight loss intervention initiated by a newspaper. Prev Chronic Dis 2009 Jul;6(3):A101 [FREE Full text] [Medline]
- Jonasson J, Linné Y, Neovius M, Rössner S. An Internet-based weight loss programme -- a feasibility study with preliminary results from 4209 completers. Scand J Public Health 2009 Jan;37(1):75-82. [CrossRef] [Medline]
- McCoy MR, Couch D, Duncan ND, Lynch GS. Evaluating an internet weight loss program for diabetes prevention. Health Promot Int 2005 Sep;20(3):221-228 [FREE Full text] [CrossRef] [Medline]
- Moore TJ, Alsabeeh N, Apovian CM, Murphy MC, Coffman GA, Cullum-Dugan D, et al. Weight, blood pressure, and dietary benefits after 12 months of a Web-based Nutrition Education Program (DASH for health): longitudinal observational study. J Med Internet Res 2008;10(4):e52 [FREE Full text] [CrossRef] [Medline]
- Petersen R, Sill S, Lu C, Young J, Edington DW. Effectiveness of employee internet-based weight management program. J Occup Environ Med 2008 Feb;50(2):163-171. [CrossRef] [Medline]
- Wing RR, Pinto AM, Crane MM, Kumar R, Weinberg BM, Gorin AA. A statewide intervention reduces BMI in adults: Shape Up Rhode Island results. Obesity (Silver Spring) 2009 May;17(5):991-995 [FREE Full text] [CrossRef] [Medline]
- Ware LJ, Hurling R, Bataveljic O, Fairley BW, Hurst TL, Murray P, et al. Rates and determinants of uptake and use of an internet physical activity and weight management program in office and manufacturing work sites in England: cohort study. J Med Internet Res 2008;10(4):e56 [FREE Full text] [CrossRef] [Medline]
- Australian Bureau of Statistics. Patterns of Internet access in Australia 2006. Canberra: ABS; 2010. URL: http://www.ausstats.abs.gov.au/ausstats/free.nsf/0/1B7DD59C9E8F52ECCA2573A1007EE8DA/$File/8146055001_2006.pdf [accessed 2010-11-17] [WebCite Cache]
- Australian Communications and Media Authority. Australia in the digital economy. Report 2: Online participation. Canberra: ACMA; 2009. URL: http://www.acma.gov.au/webwr/aba/about/recruitment/online_participation_aust_in_digital_economy.pdf [accessed 2010-11-17] [WebCite Cache]
- Wadden TA, Crerand CE, Brock J. Behavioral treatment of obesity. Psychiatr Clin North Am 2005 Mar;28(1):151-70, ix. [CrossRef] [Medline]
- World Health Organization. The world health report 2002: reducing risk - promoting healthy life. Geneva: WHO; 2002. URL: http://www.who.int/whr/2002/en/whr02_en.pdf [accessed 2010-11-17] [WebCite Cache]
- Neve M, Morgan P, McElduff P, Collins C. Is website use associated with weight loss in a commercial web-based weight loss program? Obesity Research & Clinical Practice 2010;4(S1):S2. [CrossRef]
- Collins C, Neve M, Morgan P, McElduff P. Weight loss outcomes for over 10, 000 participants in a 12 week commercial web-based program. Obesity Reviews 2010;11(11):811. [CrossRef]
- Neve M, Collins C, McElduff P, Morgan P. Weight change among participants who subscribed to a commercial web-based weight loss program for 1-year. Obes Res Clin Pract 2010;4(S1):S2. [CrossRef]
|BMI: body mass index|
|ISRAD: Index of Relative of Socioeconomic Advantage and Disadvantage|
|RCT: randomized controlled trial|
|SMS: short message service|
Edited by G Eysenbach; submitted 01.09.10; peer-reviewed by J Harvey-Berino, M Wanner, J Van 't Riet; comments to author 20.09.10; revised version received 07.10.10; accepted 16.11.10; published 14.12.10
©Melinda J Neve, Clare E Collins, Philip J Morgan. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 14.12.2010
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.