JMIR Publications

Select Journals for Content Updates

When finished, please click submit.

This paper is in the following e-collection/theme issue:

    Original Paper

    Preventing Smoking Relapse via Web-Based Computer-Tailored Feedback: A Randomized Controlled Trial

    1Department of Health Promotion, School for Public Health and Primary Care (Caphri), Maastricht University, Maastricht, Netherlands

    2Department of Psychology, Open University of the Netherlands, Heerlen, Netherlands

    3Department of Methodology and Statistics, School for Public Health and Primary Care (Caphri), Maastricht University, Maastricht, Netherlands

    4Department of Developmental Psychology, University of Amsterdam, Amsterdam, Netherlands

    Corresponding Author:

    Iman Elfeddali

    Department of Health Promotion

    School for Public Health and Primary Care (Caphri)

    Maastricht University

    PO Box 616

    Maastricht, 6200 MD

    Netherlands

    Phone: 31 433882436

    Fax:31 43 36 71 032

    Email:


    ABSTRACT

    Background: Web-based computer-tailored approaches have the potential to be successful in supporting smoking cessation. However, the potential effects of such approaches for relapse prevention and the value of incorporating action planning strategies to effectively prevent smoking relapse have not been fully explored. The Stay Quit for You (SQ4U) study compared two Web-based computer-tailored smoking relapse prevention programs with different types of planning strategies versus a control group.

    Objectives: To assess the efficacy of two Web-based computer-tailored programs in preventing smoking relapse compared with a control group. The action planning (AP) program provided tailored feedback at baseline and invited respondents to do 6 preparatory and coping planning assignments (the first 3 assignments prior to quit date and the final 3 assignments after quit date). The action planning plus (AP+) program was an extended version of the AP program that also provided tailored feedback at 11 time points after the quit attempt. Respondents in the control group only filled out questionnaires. The study also assessed possible dose–response relationships between abstinence and adherence to the programs.

    Methods: The study was a randomized controlled trial with three conditions: the control group, the AP program, and the AP+ program. Respondents were daily smokers (N = 2031), aged 18 to 65 years, who were motivated and willing to quit smoking within 1 month. The primary outcome was self-reported continued abstinence 12 months after baseline. Logistic regression analyses were conducted using three samples: (1) all respondents as randomly assigned, (2) a modified sample that excluded respondents who did not make a quit attempt in conformance with the program protocol, and (3) a minimum dose sample that also excluded respondents who did not adhere to at least one of the intervention elements. Observed case analyses and conservative analyses were conducted.

    Results: In the observed case analysis of the randomized sample, abstinence rates were 22% (45/202) in the control group versus 33% (63/190) in the AP program and 31% (53/174) in the AP+ program. The AP program (odds ratio 1.95, P = .005) and the AP+ program (odds ratio 1.61, P = .049) were significantly more effective than the control condition. Abstinence rates and effects differed per sample. Finally, the results suggest a dose–response relationship between abstinence and the number of program elements completed by the respondents.

    Conclusion: Despite the differences in results caused by the variation in our analysis approaches, we can conclude that Web-based computer-tailored programs combined with planning strategy assignments and feedback after the quit attempt can be effective in preventing relapse 12 months after baseline. However, adherence to the intervention seems critical for effectiveness. Finally, our results also suggest that more research is needed to assess the optimum intervention dose.

    Trial Registration: Dutch Trial Register: NTR1892; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=1892 (Archived by WebCite at http://www.webcitation.org/693S6uuPM)

    J Med Internet Res 2012;14(4):e109)

    doi:10.2196/jmir.2057

    KEYWORDS



    Introduction

    Smoking relapse rates can be extremely high (up to 90% in the first 3 months), and only 3%-5% of quitters maintain their quit attempt for 6 months or longer [1]. The role of risk factors for relapse (eg, low self-efficacy, the expectation of negative outcomes from quitting, negative affect, stress, and physical dependence) is quite well documented (see for examples [2-6]). However, a Cochrane review concluded that current smoking relapse prevention programs are not effective [7]. This ineffectiveness, combined with the alarming relapse rates, underlines the need for new, effective smoking relapse prevention strategies and programs. One potential explanation for these programs’ lack of effectiveness is that quitters are not fully prepared for their cessation attempt and lack sufficient coping strategies to maintain their attempts successfully [8-10].

    Adding action planning components to programs may be a promising strategy for improving smoking relapse prevention programs [8-12]. Planning strategies are already incorporated into many face-to-face and telephone smoking cessation counseling sessions (eg, smoking cessation courses provided by the Dutch Foundation for a Smoke-free Future in the Netherlands) [13]. Furthermore, the role of action planning strategies is acknowledged by integrative social cognitive models, such as the Integrated Change (I-Change) Model [14,15]. The I-Change Model distinguishes between two essential planning components: (1) preparatory plans as actions designed to prepare for the behavior change, and (2) coping plans as actions designed to maintain the new behavior by coping with challenging or difficult situations. Yet, as far as we know, these planning strategies have received little emphasis in Web-based prevention programs.

    The Internet has proven to be a promising delivery mode for health-promoting and lifestyle-changing interventions (for instance, [12,16-18]). Since 91% of Dutch households have access to the Internet, it could potentially be used to reach large numbers of people [19]. Additionally, interactive, personalized Internet-based delivery modes, such as computer tailoring, have already demonstrated their potential to support smoking cessation [12,20-23]. These highly personalized approaches are assessment based and adapt their messages to the needs of the respondent [24,25]. Compared with nontailored messages, tailored messages are evaluated more positively, attract more attention, and are more likely to be read [12,16,24,26]. Computer-tailored health programs have shown to be promising tools for promoting healthy behavior in general [27-32] and smoking cessation specifically [12,20-23], with multiple tailoring moments being more effective than a single tailoring moment [32-34]. Few computer-tailored programs have explicitly targeted smoking relapse (see Borland et al [35] for an example). In line with earlier studies [31,33,34], Borland’s study also indicated the surplus value of multiple tailoring moments and suggested a dose-response relationship between the number of feedback letters and smoking abstinence. Moreover, no studies have assessed the effects of using planning strategies in combination with multiple tailored feedback time points after the quit attempt.

    In sum, the main goal of the Stay Quit for You (SQ4U) study was to assess the efficacy of two relapse prevention programs: (1) an action planning (AP) program that provided tailored feedback based on the baseline questionnaire and 6 preparatory and coping planning assignments, and (2) an action planning plus (AP+) program that extended the AP program by providing tailored feedback at 11 time points after the quit date. The efficacy of the programs was compared with that of a control group (with no intervention). Moreover, we aimed to assess possible dose–response relationships between abstinence and adherence to the number of program elements. First, we expected both programs to be more effective than the control condition in fostering continued abstinence 12 months after the start of the study (hypothesis 1). We expected the AP+ program to be the most effective. Moreover, we expected to find a dose–response relationship between continued abstinence and intervention dose (hypothesis 2). Finally, we will provide an overview of the respondents’ program evaluations.


    Methods

    Ethics approval was obtained from the Medical Ethics Committee of Maastricht Academic Hospital and Maastricht University (MEC 08-3-003; NL21414.068.08). The study is registered with the Dutch Trial Register (NTR1892).

    Respondents and Recruitment

    We recruited smokers by placing ads in local newspapers, distributing 10,000 flyers in the city of Maastricht, and placing online ads on the websites of national health funds, a national news page, and the Dutch Foundation for a Smoke-free Future. The ads referred the respondents to our research website for more information. All data were gathered via the Web and there was no face-to-face contact between respondents and the study team. A software program randomly assigned a total of 2681 respondents to one of the three conditions using a simple randomization type (see design below). The enrollment and inclusion of respondents is presented in Figure 1. Respondents were eligible for participation when they met the baseline inclusion criteria (aged 18–65 years, smoked daily, willing to set a quit date within 1 month, and motivated to quit smoking) and agreed with the informed consent. The final sample consisted of 2031 respondents, of whom 566 (27.98%) responded to the 12-month follow-up measurement.

    Figure 1. Enrollment and inclusion of respondents. NA = not applicable. a All respondents as randomly assigned, b modified sample excluding respondents who indicated after their quit date as well as at follow-up that they did not make a quit attempt during the study and respondents who quit too close to follow-up (see Analyses section in the Methods), c minimum dose sample additionally excluding respondents who did not adhere to at least one intervention element.
    View this figure

    Design and Procedure

    The SQ4U study was a randomized controlled study with a control condition and two experimental conditions. Respondents registered via the research website and made their own login account (each time they were invited for participation they received this account in the invitation mail). After registration, respondents were randomly assigned to one of the three programs outlined in the Introduction. Respondents in the intervention groups were invited by email or text message (optional) to perform intervention tasks (eg, filling out a planning assignment). The same procedure was used to invite all respondents for the 12-month follow-up measurement. Reminder emails were sent when respondents did not respond to the follow-up measurement, which asked them to report on their smoking behavior using self-assessed questionnaires. Respondents who reported that they were abstinent were asked to take biochemical validation tests (see below). Respondents who completed all parts of their assigned SQ4U variant (including those in the control group) were eligible to win 1 of 20 prizes of €250. A more detailed description of the development, design, study course, biochemical validation, and intervention elements can be found elsewhere [36].

    Biochemical Validation

    We used cotinine assessments to validate reports of abstinence in a subsample (n = 70) of the respondents. This verified the nonsmoking status self-reported by respondents at the 12-month follow-up measurement. Only 1 (1%) respondent showed positive cotinine results and admitted to having smoked. Another respondent admitted to smoking when invited for biochemical validation. The smoking status for these 2 (3%) respondents was changed to relapse.

    Intervention Materials

    Baseline Computer-Tailored Feedback Before the Quit Attempt (AP and AP+ programs)

    Feedback focused on respondents’ perceptions of smoking and quitting and was based on previously tested effective computer tailoring programs that used the I-Change Model [12,20]. The feedback was intended to increase the respondents’ motivation to quit smoking and to prepare them for the period after the quit attempt. It targeted the pros and cons of not smoking and relapses, provided tips to enhance or increase self-efficacy, offered suggestions for dealing with social influences, explained the importance of preparatory planning, and gave ideas for preparing for the quit attempt and dealing with stress.

    Planning Strategy Assignments Before and After the Quit Attempt (AP and AP+ programs)

    Since planning assignments have proven to be promising strategies to foster cessation and prevent relapse, the SQ4U programs incorporated assignments designed to motivate respondents to use these strategies to make a quit attempt (first 3 assignments, prior to quit date) and to prevent relapse (final 3 assignments, after quit date). Two assignments focused on making and carrying out preparatory plans; 2 more assignments addressed coping planning. Finally, 1 assignment focused on a specific coping plan (making an emergency plan for coping in case of a lapse) and 1 assignment required making a specific preparatory plan (planning a reward for abstaining from smoking for some time).

    Tailored Feedback After the Quit Attempt (AP+ program only)

    Studies that use ecological momentary assessments to gain in-depth, day-to-day information on the process of quitting have noted that low self-efficacy and negative affect preceded lapsing [37-40]. Therefore, we targeted self-efficacy, recovery self-efficacy, and negative affect in the feedback moments after the quit attempt. We also included feedback about the level of planning. Each measurement after the quit attempt targeted two of the four concepts mentioned. Tailored feedback about each of the four concepts was provided daily during the first 3 days (after the quit date), once a week during the rest of the first month, and once every 2 weeks until the third month. The feedback not only addressed the respondents’ present state but was also ipsative, referring to earlier states (reporting changes in a positive or negative direction). Finally, all feedback targeted self-reported smoking behavior for the last three measurements and reported the progress of maintenance or decline over those three measurements.

    Baseline Questionnaire

    The following basic information was collected about each respondent:

    • Demographic variables assessed age, gender, and educational level (1 = low [no education or only primary or primary-level vocational education], 2 = medium [secondary or secondary-level vocational education], and 3 = high [higher education]).
    • Perceived stress was assessed by 5 items based on the Perceived Stress Scale [41] and was rated on a 5-point scale (1 = never, 5 = very often). The mean scale score was included in the analyses (Cronbach alpha = .75).
    • Level of depression was measured by 10 items (eg, “I feel anxious”) using the Center for Epidemiologic Studies Depression scale [42]. The answers were given on a 4-point scale (1 = never, 4 = all the time). The mean scale score was included in the analyses (alpha = .83).
    • Level of dependence was assessed by 5 items (eg, the time when tobacco is smoked after awakening) based on an abbreviated Fagerström test [43,44]. The sum score was used in the analyses (0 = not dependent, 9 = very dependent).

    The following questions about intention and motivational factors were based on questions used in previous studies [9,12,20,45-47]:

    o Attitudes were measured on a 4-point scale (1 = no, 2 = yes, a bit, 3 = yes, 4 = yes, a lot/very) with four subscales measuring the following: (1) pros of not smoking, expressed by 9 statements representing positive expected outcomes (eg, “not smoking will save me money”) (alpha = .73), (2) cons of not smoking, expressed by 9 statements representing negative expected outcomes (eg, “not smoking will cause me more stress”) (alpha = .71), (3) pros of relapse, expressed by 4 statements representing positive expected outcomes (eg, “relapse will make me feel relieved”) (alpha = .82), and (4) cons of relapse, expressed by 6 statements representing negative expected outcomes (eg, “relapse will make me feel weak”) (alpha = .85).

    o Social support was measured by 5 items that asked about the support received from significant others (partner, children, other family members, friends, or colleagues) on a 4-point scale (1 = no, 2 = yes, some, 3 = yes, moderate, and 4 = yes, a lot). A “not applicable” response was coded as missing. We created an index and used these scores in the analyses.

    o Modeling was assessed by 5 items that measured the smoking status of the partner (yes, no, not applicable) and residential children, parents, colleagues, and friends (all, the majority, half, a minority, none, not applicable). The items were coded into three category scales (–1 = not smoking, 0 = not applicable, 1 = smoking). The items were summed and formed an index that we used in the analyses; smoking status of the partner was included separately in the analyses.

    o Self-efficacy was assessed by 13 items that asked whether respondents thought they would be able to refrain from smoking in various smoking-related high-risk situations such as parties (alpha = .88). Recovery self-efficacy was assessed by 7 items that asked whether respondents thought they would be able to resume a smoking cessation program after a lapse (eg, after a week of abstinence) (alpha = .92). Answers were given on a 5-point scale (1 = totally disagree, 5 = totally agree) and the mean score was used in the analyses.

    o Preparatory planning was assessed by 12 items (based on previous studies [8,9,12,46]) asking respondents to indicate whether they had plans to perform preparatory behaviors, such as removing all smoking materials, on a 5-point scale (1 = totally disagree, 5 = totally agree) (alpha = .72). The mean scale scores were used in the analyses.

    Follow-up Measurements

    Continued abstinence at 12 months after baseline was the primary outcome. In line with the definitions provided by Hughes et al [48], we defined continued abstinence as not smoking at all after the quit attempt. We measured it by asking whether the respondent had smoked since the quit date. Continued abstinence was coded as 0 = relapse and nonsmoking as 1 = abstinence.

    Analyses

    The most common approach to analyzing the effects of interventions is to include all respondents randomly assigned to the programs. The advantage to this approach is that it reflects the situation as it is likely to occur in practice (where low adherence levels and not following program protocols will also be common). This strategy also maintains the balance between randomly assigned groups and preserves sample sizes [49,50]. On the other hand, including all randomly assigned respondents is a very conservative approach that may be susceptible to type II errors [49,50] and may say little about the efficacy of a treatment, since respondents who did not receive the treatment or did not follow the protocol are still included [49,51]. A modified approach (which has been used more frequently in the last decades [52]) seems to be more suitable for gaining insight into the effects of programs among those who actually followed them. However, excluding respondents after randomization may threaten the randomization balance and neglect the fact that nonadherence (and even making or not making a quit attempt) may also be a result of the treatment [50]. Therefore, both approaches have their advantages and disadvantages. To provide a complete overview of our results, we analyzed three samples and report on the above-mentioned modified approach. This resulted in three different analytic approaches with three different samples:

    • Sample 1 is the sample as randomized, including all respondents. Since this study focused on relapse prevention and therefore on continued abstinence, we also report on smaller samples:
    • Sample 2, referred to as the modified sample, excluded respondents who indicated after their quit date as well as at follow-up that they did not make a quit attempt, and those who reported that they had quit less than 320 days before the follow-up measurement (this is after about 2 weeks after the first month in which they were supposed to make an attempt). We excluded the latter group because one of the inclusion criteria was that respondents needed to set a quit date within 1 month after inclusion. Including respondents who explicitly stated that they made their quit attempt much later or even too close to the follow-up measurement would result in differences between respondents in the time frame from the quit attempt to the follow-up measurement.
    • Sample 3, referred to as the minimum dose sample, excluded respondents who did not adhere to at least one element of the program they were assigned to (ie, did not complete the prequit and postquit assignments) in addition to meeting the exclusion criteria in the modified sample.

    For all three samples, we conducted an observed case analysis (only including respondents with follow-up data) and a conservative analysis in which we assumed that participants missing at follow-up had relapsed to smoking. We used a logistic regression analysis to compare the efficacy of the control condition and the SQ4U programs to foster continued smoking abstinence after 12 months. Differences in baseline factors (demographics, smoking-related factors, perceived stress, depression, intention strength, social influence, attitude, self-efficacy, recovery self-efficacy, and preparatory planning) were assessed using chi-square tests for categorical variables and analysis of variance for continuous variables. Attrition was analyzed by logistic regression and included baseline factors. To preserve power, we included only baseline factors on which the three conditions significantly differed at baseline as well as the factors that significantly predicted dropout at follow-up as covariates in the effect analyses. Listwise deletion with regard to missing values was used. Finally, chi-square tests were used to assess the existence of dose-response relationships within the SQ4U programs using the observed cases in sample 2 (the modified sample) to conform to the methods used by Borland et al [35].


    Results

    Sample Characteristics and Attrition Check

    Table 1 presents the demographic and smoking-related characteristics at baseline and shows no significant differences between these variables in the three conditions. The mean age of the respondents was 41 (SD 11.80) years, and 1265 of the 2031 (62.28%) respondents were female. On average, respondents smoked 20 (SD 8.73) cigarettes per day, and 1887 (92.91%) had made previous attempts to quit. Furthermore, we found no significant (P > .05) differences between the three conditions on the baseline measurements of perceived stress, depression, intention strength, social influence, attitude, self-efficacy and recovery self-efficacy, and preparatory planning. (Table 1 shows only demographics and smoking-related factors.)

    In the control condition, 434 of 636 (68.2%) were lost to follow-up versus 508 of 698 (72.8%) in the AP program and 523 of 697 (75.0%) in the AP+ program (Figure 1). Attrition analysis proved that dropout was more likely among respondents in the AP (odds ratio [OR] 1.26, P = .06) and AP+ (OR 1.44, P = .004) programs and respondents who were younger (OR 0.98, P < .001, 95% confidence interval [CI] 0.97–0.99), were male (OR 1.32, P = .02, 95% CI 1.05–1.66), had a lower education level (OR 2.00, P = .001, 95% CI 1.33–3.00), perceived fewer advantages to relapse (OR 0.80, P = .02, 95% CI 0.67–0.97), and had low levels of self-efficacy (OR 0.78, P = .001, 95% CI 0.67–0.91).

    Table 1. Means and baseline differences between the three programs in demographic and smoking-related variables.
    View this table

    Abstinence Rates 12 Months After Baseline

    Table 2 presents the abstinence rates for samples 1, 2, and 3 when using observed cases alone, as well as when conducting conservative analyses and considering dropouts as relapsers. When using the observed case analysis strategy on sample 1, abstinence rates in the control group, the AP program, and the AP+ program were 22%, 33%, and 31%, respectively (see Table 2). In the sample where those who did not make a quit attempt conforming to the study protocol were excluded (sample 2), we found abstinence rates of 34%, 44%, and 37%, respectively. Finally, abstinence rates among only those who adhered to at least one of the intervention elements from the program they were assigned to (sample 3) showed abstinence rates of 34%, 46%, and 39%, respectively.

    Table 2. 12-month abstinence rates per program for the three samples using observed and conservative analyses.
    View this table

    Main Effects of the AP and AP+ Programs With Correction for Covariates

    Table 3 presents the main effects of the AP and AP+ programs compared with the control condition, while controlling for covariates (factors that predicted dropout according to the attrition analysis). The table shows these findings for observed case analyses as well as conservative analyses for sample 1 (including all respondents as randomly assigned), sample 2 (modified sample), and sample 3 (minimum dose sample). The AP program was significantly more effective in fostering abstinence than was the control condition in sample 1 (OR 1.95, P = .005), sample 2 (OR 1.71, P = .04), and sample 3 (OR 1.84, P = .02) when including observed cases only. The AP+ program was, however, only significant in sample 1 (OR 1.61, P =.049). In the conservative analyses, both programs were significantly more effective than the control condition only in sample 3 (AP: OR 1.72, P = .01; AP+: OR 1.76, P = .01). Finally, having high levels of self-efficacy was the only consistent predictor of continued abstinence in all these analyses.

    Table 3. Regression 12-month continued abstinence on the APa and AP+b program in sample 1 (observed cases, n = 559; conservative analysis, n = 1974), sample 2 (observed cases, n = 412; conservative analysis, n = 1757), and sample 3 (observed cases, n = 383; conservative analysis, n = 1297).
    View this table

    Abstinence Rates per Program Stratified to Intervention Dose

    Table 4 shows the 12-month continued abstinence rates per intervention dose for the modified sample (sample 2). As posed in hypothesis 2, the results revealed significant relationships between abstinence and the number of planning assignments using linear by linear association chi-square tests (AP: χ21 = 7.4, P < .007; AP+: χ21 = 14.7, P < .001) and feedback moments (AP+: χ21 = 24.5, P < .001) and confirmed higher abstinence rates when more planning assignments or questionnaires after the quit attempt were completed. On average, respondents in the program groups adhered to 4 out of 6 planning assignments and 6 out of 11 feedback questionnaires.

    Table 4. 12-month continued abstinence rates stratified by the number of planning assignments and feedback moments in the modified sample (sample 2).
    View this table

    Program Evaluation of the AP and AP+ Programs

    Table 5 presents the program evaluation that was conducted 6 months after baseline. Respondents from the AP and AP+ programs gave the baseline-tailored feedback a positive evaluation. However, significantly more respondents in the AP+ program remembered the content of the baseline-tailored feedback and perceived the feedback as relevant and helpful for making the quit attempt. The planning assignments were perceived as useful by 87 of 164 (53%) respondents. Moreover, 724 (44%) of the respondents rated them as helpful for making a quit attempt and 51 (31%) agreed they were helpful in maintaining a quit attempt. Respondents from the AP and AP+ programs did not differ significantly on the evaluation of the planning assignments. The feedback after the quit attempt (short feedback moments) was rated as useful by 66 of 104 (63%) respondents, as helpful for making a quit attempt by 49 (47%), and as helpful for maintaining the quit attempt by 50 (48%).

    Table 5. Program evaluation (conducted 6 months after baseline) by respondents from the APa and the AP+b programs.
    View this table

    Discussion

    The main goal of this study was to evaluate the efficacy of two Web-based smoking relapse prevention programs (AP and AP+) in the SQ4U study with regard to 12-month continued smoking abstinence. Furthermore, we aimed to assess dose-response associations. Despite the potential of the Internet, a recurrent problem in Internet trials is low adherence to the programs [53]. These low levels of adherence may lead to underestimations of intervention effects. This impression is strengthened by the fact that most studies of Internet interventions have shown dose-response relationships (see, for instance, [35,54-58]). Hence, an alternative strategy in which nonadherent respondents are excluded may be needed. Recently, a systematic review has discussed an increase in the literature of randomized controlled trials that report on a modified strategy [52]. To provide a complete overview of our results, we employed both approaches and reported on three samples: (1) the sample as randomly assigned, including all respondents, (2) a sample excluding those who did not make a quit attempt (modified sample), and (3) a sample additionally excluding those who did not adhere to at least one of the intervention elements (minimum dose sample). Observed case analyses (only including respondents with follow-up data) and conservative analyses (including all cases and coding respondents who were missing at follow-up as smoking relapsers) were conducted on all samples.

    The results of all three observed case analyses (samples 1, 2, and 3) revealed significant effects in favor of the AP program. We can conclude that most of the analyses support our first hypothesis that planning strategies can be effective in preventing relapse among smokers who are motivated to quit smoking. The AP+ program, on the other hand, only proved to be significantly more effective than the control condition in the randomized sample (sample 1). The approach for sample 2 seems to have created a bias against the AP+ program by excluding respondents who did not make a quit attempt during the study, which resulted in more exclusions of relapsers (since nonquitters cannot be considered to be continued abstinent at follow-up) in the control condition than in the AP+ program (which consisted of elements designed to foster making a quit attempt). This approach may therefore have been too conservative. Furthermore, additional power analyses showed that 2623 respondents would have been needed to find significant differences in abstinence rate between the control group (45/134, 34%) and the AP+ program group (53/142, 37%). Therefore, the lack of significance in sample 2 may be due to power issues. Another possible explanation for lack of significant effect for the AP+ program in sample 2 and sample 3 may be that the program was too intensive and therefore resulted in an overload for the respondents that negatively influenced its efficacy. A comparable result was found in an earlier study conducted among vocational students, which tested the efficacy of a standard in-school program, a computer-tailored program, and a combined program [59]. This study found that the combined strategy did not have a surplus value. The authors suggested that combining strategies may lead to an overload of information, which may produce more negative effects. Although this may also account for our findings, program evaluation data do not support this suggestion because the AP+ and AP programs both received a positive evaluation. A final explanation may be that the planning assignments and the feedback provided after the quit attempt may not have been an ideal combination to foster abstinence after all.

    When conducting conservative analyses, we found the AP and AP+ programs to be significantly more effective than the control condition in the minimum dose sample (sample 3). However, given the large dropout rate, this conservative approach (coding missing participants as relapsers) may be too conservative. Additional descriptive analyses indicated that about 60% of the respondents who dropped out at follow-up were nonsmokers at their last visit, indicating that interpreting all missing cases as treatment failures may be too conservative, a finding also supported by others [60]. Finally, conservative analyses in the minimum dose sample (sample 3) may have biased the results in favor of the experimental conditions by excluding nonadherers (whose follow-up data are generally missing). Excluding these nonadherers results in fewer imputations of relapsers in the experimental conditions than in the control condition, as these respondents are already excluded because they did not adhere to the programs.

    The abstinence rate of 22% in the control group is another notable finding, since self-quitters generally reach abstinence rates of only 3%-5% [1]. A possible explanation for this high abstinence rate may be that respondents in our control condition, who were highly motivated to quit smoking, sought additional help themselves when they did not receive the help they expected from our program. Since not all respondents reported on their use of additional help, we were not able to test this assumption with the available data. Moreover, the high motivation of these respondents may have played a role in their high abstinence rates.

    Finally, the dose-response relationship between abstinence and the number of program elements suggests that a dose-response association may exist. This is because abstinence rates increased by up to 53% (33/62) in the AP program and 51% (36/70) in the AP+ program when doing 5 to 6 planning assignments, and up to 61% (20/33) in the AP+ program when filling out 10-11 feedback questionnaires (on which feedback was provided). These findings suggest, in line with hypothesis 2, that the efficacy of the programs depends on adherence to the program, also found in previous studies [35,61]. Our findings regarding dose-response relationships may, however, be attributed to the fact that respondents who relapsed after a few sessions discontinued the program, resulting in the finding that those who continued with the program were more successful. Caution is, therefore, needed when interpreting dose-response relationships: these relationships can be subject to selection biases, since the respondents are not randomly assigned to different doses [62]. Additional research that tests the assumption of a dose-response relationship in this context is needed in the form of an experimental design in which respondents are randomly assigned to groups with different doses.

    The SQ4U study was subject to limitations. The first limitation is that the planning assignments and feedback moments were provided at fixed times, while the varying levels of adherence found in our study suggest that programs should perhaps provide support when the respondent needs it most (ie, by real-time support in difficult situations). Research is needed to explore the potential additional efficacy of such an approach. Second, the cut-off point for the minimum dose sample (sample 3) is not based on empirical findings and needs to be explored in additional studies. Third, because of medical ethics guidelines, we could not prevent respondents from using additional help to quit smoking. The use of additional help, however, may interfere with the effects of the programs and may be beneficial or counterproductive. Further research is needed to explore which additional aids may have positive or negative effects. Fourth, our study had a high rate of loss to follow-up (1465/2031, 72.1%), an issue that is very common in comparable studies [12,21,63,64]. Attrition may have been caused by factors such as spam filters or invalid email accounts or because people who have quit smoking do not want to be reminded of their past smoking behavior [65]. The latter is partly supported by our data, which showed that about 60% of the respondents who dropped out of the experimental programs were nonsmokers at their last visit. Finally, the conservative analyses (in which missing answers at follow-up were regarded as relapse) may be too conservative, as our data showed that about 60% of the respondents who dropped out of the experimental programs were nonsmokers at their last visit. Furthermore, attrition analyses indicated that dropout was more likely in the experimental programs. Consequently, the conservative analyses can be subject to biases strengthening the relation between the experimental programs and relapse, while the actual relation is one between the programs and dropout. Therefore, caution is needed with interpreting these results.

    Aside from these limitations, our SQ4U study is the first to test the efficacy of incorporating planning assignments in a Web-based computer-tailored relapse prevention program and of combining planning assignments with multiple tailored feedback moments after the quit date. The study reflected on the findings from different samples, and the results pointed out the importance of using planning strategies and tailored feedback moments after the quit date for smokers who are motivated to quit. Previous studies indicated that a lack of preparatory planning is associated with smoking relapse [8,9]. Our current study further illuminates the role of planning by showing that managing behavior using action planning strategies in relapse prevention programs fosters abstinence. Additional research is needed to determine the optimum dose for reaching best effects and which planning strategies are most effective for which groups. Since some of the respondents in the experimental programs did not adhere to even one intervention element, insight into the predictors of adherence and into strategies to facilitate adherence are also needed.

    Acknowledgments

    This study was funded by the Dutch Organization for Health Research and Innovation (grant number 6130-0030). We would like to thank Claire Jeukens and Verina Servranck for their contribution to the development and piloting of the SQ4U program materials. We would also like to thank Stivoro for their help in recruiting respondents, as well as the respondents for their participation in the study.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    CONSORT eHealth V1.6.1 checklist [66].

    PDF File (Adobe PDF File), 558KB

    References

    1. Hughes JR, Keely J, Naud S. Shape of the relapse curve and long-term abstinence among untreated smokers. Addiction 2004 Jan;99(1):29-38. [Medline]
    2. Dijkstra A, Borland R. Residual outcome expectations and relapse in ex-smokers. Health Psychol 2003 Jul;22(4):340-346. [Medline]
    3. Kenford SL, Smith SS, Wetter DW, Jorenby DE, Fiore MC, Baker TB. Predicting relapse back to smoking: contrasting affective and physical models of dependence. J Consult Clin Psychol 2002 Feb;70(1):216-227. [Medline]
    4. Killen JD, Fortmann SP, Kraemer HC, Varady AN, Davis L, Newman B. Interactive effects of depression symptoms, nicotine dependence, and weight change on late smoking relapse. J Consult Clin Psychol 1996 Oct;64(5):1060-1067. [Medline]
    5. Marlatt GA, Gordon JA. Relapse Prevention: Maintenance Strategies in the Treatment of Addictive Behaviors. New York, NY: Guilford Press; 1985.
    6. Shiffman S, Waters AJ. Negative affect and smoking lapses: a prospective analysis. J Consult Clin Psychol 2004 Apr;72(2):192-201. [CrossRef] [Medline]
    7. Hajek P, Stead LF, West R, Jarvis M, Lancaster T. Relapse prevention interventions for smoking cessation. Cochrane Database Syst Rev 2009(1):CD003999. [CrossRef] [Medline]
    8. Elfeddali I, Bolman C, Candel MJ, Wiers RW, De Vries H. The role of self-efficacy, recovery self-efficacy, and preparatory planning in predicting short-term smoking relapse. Br J Health Psychol 2012 Feb;17(1):185-201. [CrossRef] [Medline]
    9. Hoving EF, Mudde AN, de Vries H. Predictors of smoking relapse in a sample of Dutch adult smokers; the roles of gender and action plans. Addict Behav 2006 Jul;31(7):1177-1189. [CrossRef] [Medline]
    10. O'Connell KA, Hosein VL, Schwartz JE, Leibowitz RQ. How does coping help people resist lapses during smoking cessation? Health Psychol 2007 Jan;26(1):77-84. [CrossRef] [Medline]
    11. van Osch L, Lechner L, Reubsaet A, Wigger S, de Vries H. Relapse prevention in a national smoking cessation contest: effects of coping planning. Br J Health Psychol 2008 Sep;13(Pt 3):525-535. [CrossRef] [Medline]
    12. Te Poel F, Bolman C, Reubsaet A, de Vries H. Efficacy of a single computer-tailored e-mail for smoking cessation: results after 6 months. Health Educ Res 2009 Dec;24(6):930-940 [FREE Full text] [CrossRef] [Medline]
    13. van der Plas A, Hilberink S, Hermans M, Breteler M. Evaluatie van de Millennium Campagne 'Dat kan ik ook!' en regionale cursussen stoppen met roken: Resultaten en predictoren van succes [Evaluation of the Millenium Campaign and Regional Smoking Cessation Programs: Results and Predictors of Success]. Nijmegen: Nijmegen Institute for Scientifist-Practitioners in Addiction; 2001.
    14. de Vries H, Kremers SP, Smeets T, Brug J, Eijmael K. The effectiveness of tailored feedback and action plans in an intervention addressing multiple health behaviors. Am J Health Promot 2008;22(6):417-425. [CrossRef] [Medline]
    15. de Vries H, Mudde A, Leijs I, Charlton A, Vartiainen E, Buijs G, et al. The European Smoking Prevention Framework Approach (EFSA): an example of integral prevention. Health Educ Res 2003 Oct;18(5):611-626 [FREE Full text] [Medline]
    16. Brug J, Campbell M, van Assema P. The application and impact of computer-generated personalized nutrition education: a review of the literature. Patient Educ Couns 1999 Feb;36(2):145-156. [Medline]
    17. Vandelanotte C, Spathonis KM, Eakin EG, Owen N. Website-delivered physical activity interventions a review of the literature. Am J Prev Med 2007 Jul;33(1):54-64. [CrossRef] [Medline]
    18. Walters ST, Wright JA, Shegog R. A review of computer and Internet-based interventions for smoking behavior. Addict Behav 2006 Feb;31(2):264-277. [CrossRef] [Medline]
    19. Anonymous. Statline: vrije tijd en cultuur; internet toegang huishoudens 2005-2010 [Statline: spare time and culture; internet access households 2005-2010] [database online]. The Hague/Heerlen: Centraal Bureau voor de Statistiek; 2011.
    20. Dijkstra A, De Vries H, Roijackers J. Long-term effectiveness of computer-generated tailored feedback in smoking cessation. Health Educ Res 1998 Jun;13(2):207-214 [FREE Full text] [Medline]
    21. Etter JF. Comparing the efficacy of two Internet-based, computer-tailored smoking cessation programs: a randomized trial. J Med Internet Res 2005;7(1):e2 [FREE Full text] [CrossRef] [Medline]
    22. Shahab L, McEwen A. Online support for smoking cessation: a systematic review of the literature. Addiction 2009 Nov;104(11):1792-1804. [CrossRef] [Medline]
    23. Strecher VJ, Shiffman S, West R. Randomized controlled trial of a web-based computer-tailored smoking cessation program as a supplement to nicotine patch therapy. Addiction 2005 May;100(5):682-688. [CrossRef] [Medline]
    24. Dijkstra A, De Vries H. The development of computer-generated tailored interventions. Patient Educ Couns 1999 Feb;36(2):193-203. [Medline]
    25. Kreuter MW, Strecher VJ, Glassman B. One size does not fit all: the case for tailoring print materials. Ann Behav Med 1999;21(4):276-283. [Medline]
    26. Brug J, Oenema A, Campbell M. Past, present, and future of computer-tailored nutrition education. Am J Clin Nutr 2003 Apr;77(4 Suppl):1028S-1034S [FREE Full text] [Medline]
    27. Bandura A. Health promotion from the perspective of social cognitive theory. Psychol Health 1998;13(4):623-649. [CrossRef]
    28. Kreuter MW, Wray RJ. Tailored and targeted health communication: strategies for enhancing information relevance. Am J Health Behav 2003;27 Suppl 3:S227-S232. [Medline]
    29. Kreuter MW, Caburnay CA, Chen JJ, Donlin MJ. Effectiveness of individually tailored calendars in promoting childhood immunization in urban public health centers. Am J Public Health 2004 Jan;94(1):122-127. [Medline]
    30. Kroeze W, Werkman A, Brug J. A systematic review of randomized trials on the effectiveness of computer-tailored education on physical activity and dietary behaviors. Ann Behav Med 2006 Jun;31(3):205-223. [CrossRef] [Medline]
    31. Noar SM, Benac CN, Harris MS. Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions. Psychol Bull 2007 Jul;133(4):673-693. [CrossRef] [Medline]
    32. Smeets T, Brug J, de Vries H. Effects of tailoring health messages on physical activity. Health Educ Res 2008 Jun;23(3):402-413 [FREE Full text] [CrossRef] [Medline]
    33. Dijkstra A, De Vries H, Roijackers J, van Breukelen G. Tailoring information to enhance quitting in smokers with low motivation to quit: three basic efficacy questions. Health Psychol 1998 Nov;17(6):513-519. [Medline]
    34. Brug J, Glanz K, Van Assema P, Kok G, van Breukelen GJ. The impact of computer-tailored feedback and iterative feedback on fat, fruit, and vegetable intake. Health Educ Behav 1998 Aug;25(4):517-531. [Medline]
    35. Borland R, Balmford J, Hunt D. The effectiveness of personally tailored computer-generated advice letters for smoking cessation. Addiction 2004 Mar;99(3):369-377. [CrossRef] [Medline]
    36. Elfeddali I, Bolman C, de Vries H. SQ4U - a computer tailored smoking relapse prevention program incorporating planning strategy assignments and multiple feedback time points after the quit-attempt: development and design protocol. Contemp Clin Trials 2012 Jan;33(1):151-158. [CrossRef] [Medline]
    37. Gwaltney CJ, Shiffman S, Balabanis MH, Paty JA. Dynamic self-efficacy and outcome expectancies: prediction of smoking lapse and relapse. J Abnorm Psychol 2005 Nov;114(4):661-675. [CrossRef] [Medline]
    38. Shiffman S, Balabanis MH, Gwaltney CJ, Paty JA, Gnys M, Kassel JD, et al. Prediction of lapse from associations between smoking and situational antecedents assessed by ecological momentary assessment. Drug Alcohol Depend 2007 Dec 1;91(2-3):159-168. [CrossRef] [Medline]
    39. Ferguson SF, Shiffman S, Gwaltney CJ. Does reducing withdrawal severity mediate nicotine patch efficacy? A randomized controlled trial. J Consult Clin Psychol 2004;74:1153-1161. [CrossRef]
    40. Shiffman S, Paty JA, Gnys M, Kassel JA, Hickcox M. First lapses to smoking: within-subjects analysis of real-time reports. J Consult Clin Psychol 1996 Apr;64(2):366-379. [Medline]
    41. Cohen S, Williamson G. Perceived stress in a probability sample of the United States. In: Spacapan S, Oskamp S. editors. The Social Psychology of Health. Beverly Hills, CA: Sage Publications; 1988:31-67.
    42. Cole JC, Rabin AS, Smith TL, Kaufman AS. Development and validation of a Rasch-derived CES-D short form. Psychol Assess 2004 Dec;16(4):360-372. [CrossRef] [Medline]
    43. Fagerstrom KO, Heatherton TF, Kozlowski LT. Nicotine addiction and its assessment. Ear Nose Throat J 1990 Nov;69(11):763-765. [Medline]
    44. Heatherton TF, Kozlowski LT, Frecker RC, Fagerström KO. The Fagerström Test for Nicotine Dependence: a revision of the Fagerström Tolerance Questionnaire. Br J Addict 1991 Sep;86(9):1119-1127. [Medline]
    45. Dijkstra A, de Vries H. Self-efficacy expectation with regard to different tasks in smoking cessation. Psychol Health 2000;15(4):501-511. [CrossRef]
    46. Hilberink SR, Jacobs JE, Schlösser M, Grol RP, de Vries H. Characteristics of patients with COPD in three motivational stages related to smoking cessation. Patient Educ Couns 2006 Jun;61(3):449-457. [CrossRef] [Medline]
    47. Mudde A, Willemsen M, Kremers S, de Vries H. Meetinstrumenten voor onderzoek naar roken en stoppen met roken [Measurements for Studies About Smoking and Smoking Cessation]. Den Haag: Stivoro; 2006.
    48. Hughes JR, Keely JP, Niaura RS, Ossip-Klein DJ, Richmond RL, Swan GE. Measures of abstinence in clinical trials: issues and recommendations. Nicotine Tob Res 2003 Feb;5(1):13-25. [Medline]
    49. Heritier SR, Gebski VJ, Keech AC. Inclusion of patients in clinical trial analysis: the intention-to-treat principle. Med J Aust 2003 Oct 20;179(8):438-440 [FREE Full text] [Medline]
    50. Wertz R. Intention to treat: once randomized, always analyzed. Clin Aphasiol 1995;23:57-64.
    51. Hollis S, Campbell F. What is meant by intention to treat analysis? Survey of published randomised controlled trials. BMJ 1999 Sep 11;319(7211):670-674. [Medline]
    52. Abraha I, Montedori A. Modified intention to treat reporting in randomised controlled trials: systematic review. BMJ 2010;340:c2697 [FREE Full text] [Medline]
    53. Wangberg SC, Bergmo TS, Johnsen JA. Adherence in Internet-based interventions. Patient Prefer Adherence 2008;2:57-65 [FREE Full text] [Medline]
    54. An LC, Perry CL, Lein EB, Klatt C, Farley DM, Bliss RL, et al. Strategies for increasing adherence to an online smoking cessation intervention for college students. Nicotine Tob Res 2006 Dec;8 Suppl 1:S7-12. [Medline]
    55. Cobb NK, Graham AL, Bock BC, Papandonatos G, Abrams DB. Initial evaluation of a real-world Internet smoking cessation system. Nicotine Tob Res 2005 Apr;7(2):207-216. [CrossRef] [Medline]
    56. Japuntich SJ, Zehner ME, Smith SS, Jorenby DE, Valdez JA, Fiore MC, et al. Smoking cessation via the internet: a randomized clinical trial of an internet intervention as adjuvant treatment in a smoking cessation intervention. Nicotine Tob Res 2006 Dec;8 Suppl 1:S59-S67. [Medline]
    57. Eysenbach G. Issues in evaluating health websites in an Internet-based randomized controlled trial. J Med Internet Res 2002 Dec;4(3):E17 [FREE Full text] [CrossRef] [Medline]
    58. Steele RM, Mummery WK, Dwyer T. Examination of program exposure across intervention delivery modes: face-to-face versus internet. Int J Behav Nutr Phys Act 2007;4:7 [FREE Full text] [CrossRef] [Medline]
    59. Ausems M, Mesters I, van Breukelen G, De Vries H. Effects of in-school and tailored out-of-school smoking prevention among Dutch vocational school students. Health Educ Res 2004 Feb;19(1):51-63 [FREE Full text] [CrossRef] [Medline]
    60. Lachin JM. Worst-rank score analysis with informatively missing observations in clinical trials. Control Clin Trials 1999 Oct;20(5):408-422. [Medline]
    61. Fiore MC, Jaen CR, Baker TB, Bailey WC, Benowitz NL, Curry SJ, et al. US Department of Health and Human Services, Public Health Service. 2008 May. Clinical Practice Guideline: Treating Tobacco Use and Dependence: 2008 Update   URL: http://www.ahrq.gov/clinic/tobacco/treating_tobacco_use08.pdf [accessed 2012-07-22] [WebCite Cache]
    62. McGowan HM, Nix RL, Murphy SA, Bierman KL, Conduct Problems Prevention Research Group. Investigating the impact of selection bias in dose-response analyses of preventive interventions. Prev Sci 2010 Sep;11(3):239-251. [CrossRef] [Medline]
    63. Eysenbach G. The law of attrition. J Med Internet Res 2005;7(1):e11 [FREE Full text] [CrossRef] [Medline]
    64. Tate DF, Zabinski MF. Computer and Internet applications for psychological treatment: update for clinicians. J Clin Psychol 2004 Feb;60(2):209-220. [CrossRef] [Medline]
    65. Strecher V. Internet methods for delivering behavioral and health-related interventions (eHealth). Annu Rev Clin Psychol 2007;3:53-76. [CrossRef] [Medline]
    66. Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    AP: Action planning (program)
    AP+: Action planning plus (program)
    CI: confidence interval
    I-Change Model: Integrated Change Model
    OR: odds ratio
    SQ4U: Stay Quit for You


    Edited by G Eysenbach; submitted 19.01.12; peer-reviewed by R Borland, J McClure, N Zhang, L Vervoort; comments to author 05.02.12; revised version received 29.04.12; accepted 24.05.12; published 20.08.12

    ©Iman Elfeddali, Catherine Bolman, Math J.J.M. Candel, Reinout W. Wiers, Hein de Vries. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 20.08.2012.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.