Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 23.06.17 in Vol 19, No 6 (2017): June

Preprints (earlier versions) of this paper are available at, first published Jan 13, 2017.

This paper is in the following e-collection/theme issue:


    A Review of the Theoretical Basis, Effects, and Cost Effectiveness of Online Smoking Cessation Interventions in the Netherlands: A Mixed-Methods Approach

    1Department of Health Services Research, Maastricht University, Maastricht, Netherlands

    2Department of Health Promotion, Maastricht University, Maastricht, Netherlands

    Corresponding Author:

    Kei Long Cheung

    Department of Health Services Research

    Maastricht University

    Duboisdomein 30



    Phone: 31 43 38 82294

    Fax:31 43 38 84162



    Background: Tobacco smoking is a worldwide public health problem. In 2015, 26.3% of the Dutch population aged 18 years and older smoked, 74.4% of them daily. More and more people have access to the Internet worldwide; approximately 94% of the Dutch population have online access. Internet-based smoking cessation interventions (online cessation interventions) provide an opportunity to tackle the scourge of tobacco.

    Objective: The goal of this paper was to provide an overview of online cessation interventions in the Netherlands, while exploring their effectivity, cost effectiveness, and theoretical basis.

    Methods: A mixed-methods approach was used to identify Dutch online cessation interventions, using (1) a scientific literature search, (2) a grey literature search, and (3) expert input. For the scientific literature, the Cochrane review was used and updated by two independent researchers (n=651 identified studies), screening titles, abstracts, and then full-text studies between 2013 and 2016 (CENTRAL, MEDLINE, and EMBASE). For the grey literature, the researchers conducted a Google search (n=100 websites), screening for titles and first pages. Including expert input, this resulted in six interventions identified in the scientific literature and 39 interventions via the grey literature. Extracted data included effectiveness, cost effectiveness, theoretical factors, and behavior change techniques used.

    Results: Overall, many interventions (45 identified) were offered. Of the 45 that we identified, only six that were included in trials provided data on effectiveness. Four of these were shown to be effective and cost effective. In the scientific literature, 83% (5/6) of these interventions included changing attitudes, providing social support, increasing self-efficacy, motivating smokers to make concrete action plans to prepare their attempts to quit and to cope with challenges, supporting identity change and advising on changing routines, coping, and medication use. In all, 50% (3/6) of the interventions included a reward for abstinence. Interventions identified in the grey literature were less consistent, with inclusion of each theoretical factor ranging from 31% to 67% and of each behavior change technique ranging from 28% to 54%.

    Conclusions: Although the Internet may provide the opportunity to offer various smoking cessation programs, the user is left bewildered as far as efficacy is concerned, as most of these data are not available nor offered to the smokers. Clear regulations about the effectiveness of these interventions need to be devised to avoid disappointment and failed quitting attempts. Thus, there is a need for policy regulations to regulate the proliferation of these interventions and to foster their quality in the Netherlands.

    J Med Internet Res 2017;19(6):e230




    Tobacco Smoking

    Tobacco smoking is a worldwide public health problem, with more than 5 million deaths being attributable to direct smoking [1]. Nonsmokers are also impacted by tobacco smoke as a result of second-hand smoke (passive smoking); an estimated 600,000 deaths are caused by smoking behavior, which affects various related diseases such as lung cancer, heart diseases, and chronic obstructive pulmonary disease. In the Netherlands, smoking is a public health problem. In 2015, 26.3% of the Dutch population aged 18 years and older smoked, 74.4% of them daily [2]. Of all smokers, 15.6% were considered heavy smokers, meaning that these individuals smoke an average of 20 or more cigarettes per day [2]. Estimates showed that in 2013, 19,000 deaths were attributable to smoking-related diseases in the Netherlands [3].

    Online Smoking Cessation Interventions

    In an attempt to tackle the scourge of tobacco smoking, many smoking cessation interventions have been developed and proven effective, especially the more intensive interventions such as one-to-one behavioral therapy [4]. Each intervention has strengths and limitations. The more intensive interventions are often expensive, inconvenient to the recipient (eg, waiting list and the need to take time off work), and reach only a small proportion of smokers [5]. The Internet provides opportunities to address the smoking problem, as the Internet has grown to be an extremely important medium and is embedded in daily life in the Dutch population (and many other parts of the world). The opportunities provided by the Internet to enhance smoking cessation have led to the development of Internet-based interventions. Internet-based smoking cessation interventions (hereafter: online cessation interventions) are relatively new innovations and, due to the low costs per smoker, the accessibility (eg, home, work, and public access points), and 24-hour a day availability, have the potential to reach a large proportion of smokers [5]. Internet access is increasing worldwide. In 2016, approximately 94.4% of the Dutch population had access [6] (98.9% of those aged 25 to 45 years, 98.3% aged 45 to 65 years, and 77.6% aged 65 years or older [7]). The level of access for the younger population, aged between 12 and 25 years, was 99.1% in 2015 [7]. Moreover, individuals having access to the Internet in the Netherlands range from 87.0% for the lower educated to 99.5% for the higher educated [7]. However, reach may be a too narrow construct to reflect Internet usage, as activities in use differ [8]. Educational level might, for instance, play a role in online behavior because many individuals may not be sufficiently literate to understand the high literacy level of most written information on the Internet [9]. Yet, a recent study in the Netherlands indicated that usage of eHealth interventions, as recommended, did not differ among education levels. The study also found that eHealth interventions are more often used as recommended to people with a greater need for health care information [10]. As well as Internet access, online cessation interventions allow other opportunities, such as being interactive and tailoring messages to individuals, which has been shown to be effective in changing health behaviors such as enhancing smoking cessation [11]. In addition, due to the low costs per person, online cessation interventions can be cost effective [12]. Therefore, it is relevant to explore the online cessation interventions that are available in the Netherlands and investigate the extent to which these are effective and cost effective.

    Cost effectiveness is explored in economic evaluation studies that determine the costs and effects associated with an intervention and compare these with the costs and effects of other interventions or current practice [13]. A typical economic evaluation consists of five steps: (1) identification of relevant costs and effects, (2) measurement of costs and effects, (3) valuation of measured costs and effects, (4) calculation of cost-effectiveness ratio, and (5) sensitivity analysis [14].

    Evaluating Content: Theoretical Basis

    Because many online cessation interventions may not have been tested in a randomized controlled trial (RCT), scholars have become interested in evaluating relevant characteristics of behavioral interventions, such as online cessation interventions. The literature shows that the theoretical basis of an intervention and behavior change techniques (BCTs) are characteristics that may influence the impact of behavior [15-17]. Three theories—the social cognitive theory [18], the transtheoretical model [19], and the theory of planned behavior [20]—were particularly important in developing the intervention; their usage in intervention development was associated with increases in effect size [21]. Various sociocognitive theories, including the three mentioned, are integrated in the Integrated Change (I-Change) Model [22-25]. This explains adoption of health behavior in (at least) three phases (ie, awareness, motivation, and action phase), each of which has phase-specific determinants, such as attitudes, social support, and self-efficacy for understanding motivation, and action planning and coping plans to understand the final step from intentions to behavior. Another way to evaluate the content of an intervention is by assessing whether or not the online cessation interventions use specific BCTs that are associated with higher success rates in smoking cessation [26-28]. Five BCTs that are applicable to online interventions and mobile-based interventions have been found to be associated with higher cessation rates [26].These are (1) strengthening exsmoker identity (eg, clear boundaries offered), (2) providing rewards contingent on stopping successfully (eg, use praise or advise on rewarding oneself for moving toward the goal of becoming an exsmoker), (3) advising on changing routines (eg, advising on avoiding cues that will trigger strong urges to smoke), (4) advising and assisting with ways of coping with urges to smoke (eg, develop effective ways of distracting attention from smoking cues in the environment and from urges to smoke), and (5) advising on use of stop-smoking medications (eg, explain the medication available, its benefits, and promote use). The theoretical underpinnings (theoretical factors and BCTs) of interventions, especially those that are not tested in RCTs, may thus provide insights into the content of online cessation interventions (ie, specifying interventions based on relevant theories and BCTs used).


    Web-based interventions are usually developed for a specific platform, made accessible via computers, tablets, or mobile phones. Not all may be optimized for all platforms. A distinction is made between online interventions (accessed via computer), referred to as eHealth, and mobile-based interventions (apps), referred to as mHealth [29]. Online cessation interventions in this study are defined as online interventions—developed to be accessed via a computer—aimed at enhancing smoking cessation among individual smokers. To explore a broader range of online cessation interventions, combinations of an online intervention and a counselor were deemed relevant. This led to the study goal: to provide an overview of online cessation interventions in the Netherlands and explore their effectivity, cost effectiveness, and theoretical basis.


    This study used a mixed-methods approach, including (1) a scientific literature search, (2) a grey literature search, and (3) expert input. The methods and the analysis are detailed subsequently.

    Scientific Literature Search

    In the search for online cessation interventions, we used a systematic review of Cochrane [5] regarding the effectiveness of Internet-based interventions, to screen for the Dutch interventions. Because this review was last updated in April 2013, we conducted an additional systematic literature search to explore recent online cessation interventions in the Netherlands up to July 2016. The selection process is depicted in a flowchart (see Figure 1).

    The Cochrane review included randomized or quasi-RCTs with smokers that participated in online cessation interventions [5]. All types of online cessation intervention were included; there was no exclusion with respect to method or duration. Also, combinations of interventions were included (when the Internet component was subject to evaluation), if the Internet intervention was an adjunct to behavioral therapy or pharmacotherapy. Trials were excluded if they used Internet solely for recruitment or as a reminder of offline appointments (eg, face-to-face therapy or pharmacotherapy). Moreover, text messaging interventions and mobile-based interventions were not covered. Also, trials with fewer than four weeks of follow-up were excluded.

    Similar to the Cochrane review [5], the search strategy for the update of literature was based on the specialized register of the Cochrane Tobacco Addiction Group, including the terms “Internet” or “www” or “web” or “net” or “online” in the title, abstract, or as keywords since 2013. Databases of Cochrane Central Register of Controlled trials (CENTRAL), MEDLINE, and EMBASE were searched via OVID. For full search strategies, see the Tobacco Addiction Group Module [30]. The search led to a total of 651 papers (CENTRAL=96, MEDLINE=163, and EMBASE=392), which two researchers (KLC and BW) screened independently for title and abstract. Inclusion criteria were (1) English or Dutch language, (2) smoking cessation intervention, (3) eHealth (ie, Internet or computer), and (4) original research (excluding study protocols and conference abstracts). Interventions directed at indirect populations (eg, clinicians and nurses) were excluded, as well as lifestyle, telephone, and prevention interventions. The two researchers resolved disagreements through discussion, resulting in 79 potentially relevant papers. The full-text papers were screened by KLC and BW, resulting in exclusion of 10 additional papers. For the relevant Dutch online cessation interventions, the researchers searched through the full-text papers and the Cochrane review [5]. Excluding all non-Dutch intervention studies, the Cochrane review yielded three relevant papers, whereas the updated search (ie, between 2013 and July 2016) yielded six papers. The updated literature search had six papers on Dutch online cessation interventions, from which one was a cost-effectiveness study aiding a study included in the Cochrane review, and four papers were studies on the same intervention (with the same lead author). Due to expert input (described in “Expert Input” section), one intervention was added to the list. Hence, this search led to a final list of six unique online cessation interventions in the Netherlands that were reported in the scientific literature.

    Figure 1. Flowchart of the selection process in the scientific literature.
    View this figure

    Grey Literature Search

    Most online cessation interventions in the Netherlands were not described in peer-reviewed journals. Hence, a Google search was conducted to capture interventions in the grey literature. In line with a previous Dutch study on identifying online tobacco control methods [31], we conducted a Google search to identify actual interventions rather than a search strategy aiming for identifying documents. This is now elaborated in the text. The free-text terms stoppen met roken (“smoking cessation”) and online roken (“online smoking”) were used, with the intention to capture a broad range of online cessation interventions. For each of the text terms, the first five pages (50 hits) of Google were explored, yielding 100 results (September 25, 2016). These were then screened by two researchers together (KLC and BW) looking at the title (of the page) and content of the site (for potential online cessation interventions), leading to 47 results. Lifestyle interventions, websites targeting indirect groups (eg, clinicians), or telephone-only interventions were excluded. These websites were then screened independently (KLC and BW) for content, including online cessation interventions in the Dutch language. For each website where there was disagreement, consensus was reached via discussion. Here we included a broad range of interventions, including informative static websites and websites promoting any intervention in online form (eg, online counseling). Websites that solely referred to other websites were excluded, as were standalone apps. Six interventions were added due to expert input (described in “Expert Input” section). This led to a final list of 39 online cessation interventions in the Netherlands that were reported in the grey literature.

    Expert Input

    To check and complement the previously mentioned searches, Dutch experts in smoking cessation (eg, smoking cessation research and/or online smoking cessation interventions) were recruited using a convenience sampling strategy, in which researchers created a list of potential participants based on personal networks. Twenty experts were approached via email, outlining the goal of the study and asked whether they were able to provide input. Five (25% response rate) provided input for the questionnaire. We asked experts to list the online cessation interventions they knew, adding to the list from the literature search. They provided a list of 21 interventions in total, with seven unique interventions added to the final list (compiled from the literature and grey literature search). One online cessation intervention was added to the scientific literature search, and six to the grey literature search.

    Data Extraction and Analysis

    For each included online cessation intervention, two independent reviewers (KLC and BW) systematically extracted data using a predefined extraction form that included general characteristics, four theoretical components (ie, attitudes, social support, self-efficacy, and action planning and coping plans), and five BCTs (ie, strengthening exsmoker identity, providing rewards contingent on stopping successfully, advising on changing routines, advising and assisting with ways of coping with urges to smoke, and advising on use of stop-smoking medications) for the content analysis. Two separate extraction forms were developed (one for scientific literature and one for grey literature), based on literature (theoretical underpinnings) and discussions in the research team. The two reviewers piloted and discussed the extraction form for two interventions, which led to minor adjustments to the data extraction forms.

    The extracted data for the interventions identified in the scientific literature included four categories: general study and intervention information; effectiveness, cost effectiveness, and outcome information; theoretical factors; and BCTs. General study and intervention information included intervention name, brief description, and target population. Effectiveness, cost effectiveness, and outcome information included effectiveness (yes, no, and not reported [NR]), effect (in relative risk [RR]), number and percentage abstinent in the intervention condition and in the control condition, control group, outcome measure (for smoking cessation), and cost effectiveness (yes, no, NR). Theoretical factors included were based on the I-Change Model and assessed the presence or absence of the core factors for motivation and behavioral change (yes, no): attitude (discussing advantages and disadvantages of smoking), social influence (addressing social influence or social support), self-efficacy (enhancing one’s capability to become an exsmoker), and action/coping planning (supporting creation or advising on action or coping plans). Literature concerning BCT revealed a large range of potential BCTs that could be selected for reviewing the efficacy of interventions, amounting to 40 different BCTs [21]. Therefore, five BCTs that were especially applicable and relevant to online interventions and mobile-based interventions were included [26]. Consequently, the BCTs included the five BCTs discussed (yes, no): supporting identity change, rewarding abstinence, advising on changing routines, advising on coping, and advising on medication use.

    The extracted data for the interventions identified in the grey literature included general intervention information, theoretical factors, and BCTs. General intervention information included intervention name, provider, and target population. The same theoretical factors and BCTs were extracted as for the scientific literature. Websites with only a page of static information about smoking cessation were grouped in the results.

    Data were independently extracted by the two researchers and the first author then checked and compared the extracted data. Any disagreements between the researchers were resolved through discussion until consensus was reached [5,26]. Extracted data are presented in tables. Whenever an intervention was shown to be cost effective, this is elaborated in the results section. Information was extracted from the literature and, when available, the researchers checked the online cessation intervention. Suggested interventions by experts are indicated in the tables.


    The mixed-methods yielded 45 unique online cessation interventions (scientific literature: n=6; grey literature: n=39).

    Scientific Literature

    The literature revealed six interventions in the Netherlands, which typically targeted adult smokers, who were motivated to quit smoking (thus willing to set a quitting date) (see Table 1). These interventions typically involved tailoring health messages based on the I-Change Model. The exception was the Web-based Attentional Bias Modification (ABM) self-help intervention [32], which aimed to reduce attentional bias and generalize to influence an approach bias for cigarettes and success in quitting. The effectiveness, cost effectiveness, and outcome information of these interventions are detailed in Table 2.

    Table 1. General study and intervention details of smoking cessation interventions in the scientific literature (n=6).
    View this table
    Table 2. Effectiveness, cost effectiveness, and outcome information of smoking cessation interventions in the scientific literature (n=6)
    View this table

    The effectiveness was shown in four interventions. For Smoke Alert (2.0) [37], the study did not investigate the effectiveness of smoking cessation, but rather investigated and found effects on prevention. Yet, a previous version did show effects on smoking cessation with 17.2% quitters in the control group and 26.8% in the online computer-tailored condition (P<.03) [42,43]. Results indicate no overall effectiveness evidence for the ABM intervention except only for heavy smokers. The effective interventions incorporated health messages tailored to responses in an initial questionnaire, which was based on the I-Change Model. Long-term effects were shown in Stay Quit For You (SQ4U) [34,35], Personal Advice in Stopping smoking (PAS) [22,36], and Support to Quit (STQ) [38-41], using a 12-month follow-up with either continued or prolonged abstinence outcome measure. For these interventions with long-term follow-ups, we conducted a meta-analysis in which the Mantel-Haenszel fixed-effect model was used to pool the effectiveness of these interventions. This resulted in a pooled RR of 1.39 (95% CI 1.18-1.65). For two interventions (PAS and STQ), studies also found support for its cost effectiveness from a societal perspective. Using prolonged abstinence as the outcome measure, the cost-effectiveness study for PAS showed that the mere multiple computer-tailored program had the highest probability of being cost effective as in this group €5100 had to be paid for each additional abstinent participant (compared to usual care) [22]. Using prolonged abstinence, the study for STQ indicated that with a willingness to pay €1500, the video-based intervention was likely to be the most cost-effective treatment. For each additional abstinent participant, €1500 had to be paid within the video-based intervention [38]. Given the fact that, in the Netherlands, cost effectiveness is concluded when the additional costs (for an additional quality-adjusted life year [QALY]) are between €20,000 and €80,000, the conclusion is that these interventions were highly cost effective [44]. Normally, this threshold is dependent on the severity of the disease. In prevention, a threshold of €20,000 is often considered [45].

    The interventions were also evaluated and analyzed with regard to the theoretical factors and BCTs used (see Table 3). For the theoretical factors, all interventions (with one exception) addressed attitudes, social influence, self-efficacy, and action or coping planning (83%, 5/6). The exception was the ABM intervention [32], which had a different theoretical basis, namely retraining implicit associations (automatic attentional processes). Attentional bias is the tendency of certain cues in a person’s environment to attract and/or hold the individual’s attention preferentially, such as cigarettes. This attentional bias could be retrained toward or away from the substance-related cues [32]. The SQ4U [34,35] and STQ [38-41] interventions included all BCTs, whereas half of the interventions included all BCTs, except rewarding abstinence (50%, 3/6).

    Table 3. Theoretical factors and behavior change techniques (BCTs) of smoking cessation interventions in the scientific literature (n=6).
    View this table

    Grey Literature

    The grey literature revealed 39 interventions in the Netherlands, which typically were targeted at smokers (see Table 4). The online cessation interventions were grouped as websites providing only static information (n=23) and websites incorporating an interactive component (n=17). Seven unique interventions were added due to expert input (see Tables 3 and 4). Some experts indicated that it was difficult to evaluate the effectiveness of the online cessation interventions, with the exception of a few reported in scientific literature. The grey literature yielded a variety of online cessation interventions with different providers, but only minimal research has been conducted to test their effects, resulting in little scientific support for their evidence. One intervention was identified in both the grey literature and in the scientific literature (Smoke Alert [37], which—as outlined previously—was effective in preventing the initiation of smoking among adolescents [37]). An intervention (Online zelfhulp tabak [46]) identified in the grey literature search and via expert input was reported to be effective; it was to be tested in a RCT. After contacting the provider of the intervention, it was revealed that the claim on effectiveness was based on a trial of a similar intervention on alcohol [47]. It was stated that ‘’due to the generalizability of the self-help module, the self-help tobacco module was recognized as well.” Hence, the quality of the interventions identified in the grey literature search seems to lack scientific basis because the number of effectiveness studies is limited.

    Table 4. General intervention information of grey literature (translation in brackets).
    View this table

    The interventions were extracted on theoretical factors and BCTs (see Multimedia Appendixes 1 and 2) with the exception of those that were not accessible to the researchers. This was especially the case for interactive interventions, with tailored messages or combined with feedback from a counselor. For those that could be evaluated, the results show that at least 67% (26/39) addressed attitude, mentioning the advantages and disadvantages of smoking cessation. Many interventions also addressed social influence and action or coping planning (at least 44%, 17/39 and 51%, 20/39, respectively), by advising on social support, planning to continue to abstain from smoking, or dealing with difficult situations. At least 31% (12/39) of the interventions addressed the self-efficacy of smokers by persuasion or via modeling, enhancing beliefs that the smoker is able to become an exsmoker. Regarding BCTs, most online cessation interventions provided information and advice on the importance of changing routines (at least 49%, 19/39) and medication usage (at least 54%, 21/39). A moderate number of interventions supported identity change (at least 28 %, 11/39), provided tips or provided rewards for abstinence (at least 38%, 15/39), and advised on coping strategies (at least 44%, 17/39).


    This study provides an overview of online cessation interventions in the Netherlands, up to 2016. They are broadly categorized in two lists: interventions reported in the scientific literature and those identified in the grey literature. Expert input overlapped with the lists and added a few unique interventions.

    Summary of Evidence

    The first goal of this study was to assess the effectiveness of online interventions concerning smoking cessation as defined by the most strictly reported outcome measure. Our search revealed that six online cessation interventions in the Netherlands were investigated for their effectiveness in trials. With one exception, these were all interactive individually tailored interventions based on sociocognitive models (ie, the I-Change Model). Smokers filled in questionnaires dealing with demographics, smoking behavior, and sociocognitive constructs. The answers were used to yield tailored motivational messages. The exception was the ABM intervention, which focused on reducing attentional bias and inducing more distant generalization effects regarding approach bias and success in quitting [32]. The effects indicated that smokers using an online cessation intervention are 1.15 to 2.84 times more likely to become a former smoker compared to the control condition. This range and the meta-analysis (with a pooled RR 1.39, 95% CI 1.18-1.65) seem in line with the Cochrane review with a pooled RR (Mantel-Haenszel fixed-effect) of 1.41 for computer-tailored online smoking cessation interventions (95% CI 1.11-1.78) [5]. These reported effects of online smoking cessation interventions may perhaps be underestimated because conservative analyses were used, including penalized imputation which categorizes missing data as smoking. A recent study showed that penalized imputation biases the reported effects of online smoking cessation interventions, favoring the condition with the lowest proportion of missing data [48]. Interestingly, many more interventions were identified using grey literature; yet, none of them were evaluated in terms of their effectiveness.

    A second goal was to identify the cost effectiveness of online cessation interventions in the Netherlands. Of the six interventions identified, two were tested and shown to be cost effective, meaning that the costs for an additional quitter (or QALY) did not surpass a conservative threshold of €20,000. PAS was cost effective, with costs of €5100 for each additional quitter [22], and STQ with its tailored video-based intervention was cost effective with costs of €1500 per additional quitter [38]. When the additional costs for an additional QALY is between €20,000 and €80,000, an intervention is considered to be cost effective in the Netherlands. Normally, this threshold is dependent on the severity of the disease. In prevention, often a threshold of €20,000 is considered [45]. There is, however, no cut-off point with regard to smoking abstinence rates as outcome, which suggests future research should identify an acceptable cut-off point for the willingness to pay per abstinent participant [49]. Extracting data on theoretical components and BCTs revealed that these I-Change Model-based interventions all addressed attitudes, social influence, self-efficacy, and action or coping planning. It also revealed that these interventions support identity change, and advise on changing routines and on coping. Because not all interventions were available to the public or researchers, there is some uncertainty about the percentage interventions rewarding abstinence and advising on medication. Other interventions that have potential to be implemented are SQ4U (scoring high on all BCTs and shown to be effective) [34] and Quit Smoking 2.0 (shown to be effective and recommended based on quality, practicability, and effectiveness on [33]. However, data concerning their cost effectiveness are lacking, and for Quit Smoking 2.0 the follow-up is 6 months only [33]. Hence, because a follow-up of 12 months indicates long-term effects, SQ4U [34,35] and especially PAS [22,36] and STQ [38-41] appear to be promising interventions for implementation in the Netherlands. The effective interventions (ie, Quit Smoking 2.0, SQ4U, PAS, and STQ), are no longer publicly available because they were part of a research study. Yet, if organizations are interested, they can be obtained via Vision2Health (a health consultancy initiative offering evidence-based health promotion interventions). For instance, Quit Smoking 2.0 has been offered by several regional health authorities on request. The youth intervention Smoke Alert is still online because it is offered by Trimbos and has received approximately 13,000 unique visitors. Interestingly, it was shown that such online interventions did not differ in usage as recommended by individuals with different educational levels [10]. This indicates the potential to be effectively implemented for smokers with different levels of education [50].

    A third goal was to assess the theoretical underpinnings of the interventions. The majority of the interventions that were also evaluated for their effectiveness and cost effectiveness used most, if not all, of the theoretical factors and the five BCTs. The interventions identified from the grey literature also used some of these factors and techniques. Some appeared to have included several, from which one might conclude that they are more likely to be successful. They could be candidates for testing in RCTs. But the theoretical factors and BCTs have to be applied according to parameters, which impact on the degree of effectiveness [51].

    In conclusion, it would be beneficial to many smokers, and even cost effective from a societal perspective, if effective and cost-effective interventions were to become available to the public after completion of a RCT study. For public health impact, it is important that these evidence-based interventions are not only available online, with no marketing (passive availability), but that they be promoted proactively, involving marketing to various stakeholders within health care (eg, general practitioners, dental practices, and other primary health care providers) and public health organizations (eg, regional health education authorities). Moreover, it is important for universities and research institutes to consider implementation of the intervention and to create a business model [52]. Researchers need to include this step, enhancing availability and usage of the developed intervention. Furthermore, more funding is needed to implement interventions that are proven to be effective and cost effective, in order to enhance usage and availability of those already online, such as PAS [22,36] and STQ [38-41]. In addition, future research may also look at the cost effectiveness to bridge the gap between research and practice because cost-effectiveness studies provide a financial argument for investment in effective interventions, such as SQ4U [34,35]. Many interventions were identified in the grey literature, more than in the scientific literature. Some may be promising if they address theoretical factors and BCTs, but they lack scientific support for effectiveness. This may be an argument for introducing a quality mark to reflect the extent of the scientific evidence. Providers could then submit their intervention for evaluation. Such a mark is important for health care stakeholders and smokers to identify quality online cessation interventions.


    This study has several limitations. One is the lack of an evaluation tool to investigate the quality or effectiveness of nontested reports identified in the grey literature. To evaluate the content, we assessed whether the interventions implemented relevant theoretical components and BCTs, identified as being associated with smoking cessation [21,26-28]. However, BCTs have limitations because they simplify reality [51]. They are generic and their application varies. Current practice often does not recognize that these BCTs have parameters for effectiveness and that methods can interact with one another. Context factors may also impact the effectiveness of BCTs [51]. Hence, the evaluation of whether interventions include BCTs may result in overly simplistic or even incorrect conclusions about the quality of the identified interventions. As well as the evaluation of the content via BCTs, the delivery, such as engagement and ease-of-use features, is important [26]. Delivery evaluation was not included in this study. Similarly, previously mentioned criticism of BCTs also applies with regard to the inclusion of theoretical factors in the interventions. This study is cautious in its recommendations based on the inclusion of theoretical factors and BCTs. Another limitation of the study may be the limited generalizability of results to other countries. Findings reflect the online cessation interventions in the Netherlands; other countries may have implemented and tested different interventions. It would, therefore, be interesting to conduct similar studies in other countries and compare potential differences. Moreover, no risk of bias assessment (eg, a quality checklist) was conducted, which may have over- or underemphasized the strength of the evidence of some studies when calculating the pooled effect. Yet, our estimates were in line with others reported in, for example, the Cochrane review on online cessation interventions [5]. Nevertheless, study results should be interpreted with some caution.

    The usage of mobile phones in everyday life is becoming increasingly important, indicating that online cessation interventions (developed to be accessed via a computer) may also need to function on a mobile platform. In the most recent Cochrane review on mobile-based smoking cessation interventions, only five studies were included [53]. None of them was developed for the Dutch population; results were heterogeneous with three of five interventions crossing the line of no effects. Hence, more research is required to explore opportunities for mobile-based interventions by investigating effectiveness and cost effectiveness. The lack of Dutch mobile phone-based interventions—tested for effectiveness—indicates the need to transfer the effective online cessation interventions to the mobile phone. Whereas mHealth interventions may have great potential, a recent Dutch study found that eHealth was more effective in realizing physical activity [54]. This does not imply that mHealth cannot be effective, but rather that we need to identify how to use the two modalities optimally. The potential of mHealth, as well as issues such as effectiveness, cost effectiveness, and usability [55,56], should be topics for future research, as well as exploring ways of improving computer tailoring of health messages (via different algorithms) [57].


    This study provides an overview of Dutch online cessation interventions, while assessing their effectivity, cost effectivity, and theoretical basis. This mixed-methods study may also serve as a vantage point for future overviews in other countries. Although the Internet may well provide the possibility of offering various smoking cessation interventions, the user in the Netherlands is left bewildered about its efficacy because most of the data are not available or are not offered to the smokers. If the Internet wants to live up to its promise, clear regulations governing effectiveness of interventions have to be devised to avoid disappointment and failed quit attempts. Policy regulations may be needed to regulate the proliferation of interventions and foster quality. As nonadoption of cost-effective eHealth interventions is both detrimental at the micro level (smokers not profiting from effective interventions) as well as the macro level (unnecessary high costs of smoking due to nonimplementation of effective methods), reasons for nonadoption, as well as strategies enhancing such an adoption, are a prerequisite to ensure a significant public health impact of effective eHealth and mHealth interventions.


    The study was funded by Miro. The funding agency had no role in study design; in the collection, analysis, and interpretation of data; in the writing of the report; and in the decision to submit the article for publication.

    Authors' Contributions

    KLC planned and managed the work, analyzed and interpreted results, and produced the first draft of the manuscript with support from BW and HV. KLC and BW screened titles, abstracts, and full text for the online cessation interventions in the Netherlands. Different versions of the manuscript have been reviewed and conceptualized by all authors. All authors have read and approved the final manuscript.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Theoretical factors of grey literature.

    PDF File (Adobe PDF File), 27KB

    Multimedia Appendix 2

    BCTs of grey literature.

    PDF File (Adobe PDF File), 27KB


    1. Glasgow RE, Vogt TM, Boles SM. Evaluating the public health impact of health promotion interventions: the RE-AIM framework. Am J Public Health 1999 Sep;89(9):1322-1327. [Medline]
    2. Aspect Consortium. European Commission, Directorate General for Health and Consumer Protection. 2004. Tobacco or health in the European Union: past, present and future   URL: [accessed 2017-06-05] [WebCite Cache]
    3. Volksgezondheidenzorg. Roken. 2013. Sterfte en verloren levensjaren door roken   URL: [accessed 2017-06-06] [WebCite Cache]
    4. Lancaster T, Stead LF. Individual behavioural counselling for smoking cessation. Cochrane Database Syst Rev 2005 Apr 18(2):CD001292. [CrossRef] [Medline]
    5. Civljak M, Stead L, Hartmann-Boyce J, Sheikh A, Car J. Internet-based interventions for smoking cessation. Cochrane Database Syst Rev 2013 Jul 10(7):CD007078. [CrossRef] [Medline]
    6. Eysenbach G. The law of attrition. J Med Internet Res 2005 Mar 31;7(1):e11 [FREE Full text] [CrossRef] [Medline]
    7. Centraal Bureau voor de Statistiek. 2016. Statline: Internet; toegang, gebruik en faciliteiten   URL: http:/​/statline.​​Statweb/​publication/​?DM=SLNL&PA=83429NED&D1=0&D2=0,3-6,20-22&D3=0&D4=a&HDR=T&STB=G1,G2,G3&VW=T [accessed 2017-08-01]
    8. van Deursen AJ, Van Dijk JA. The digital divide shifts to differences in usage. New Med Soc 2014;16(3):507-526.
    9. Zarcadoolas C, Blanco M, Boyer J, Pleasant A. Unweaving the Web: an exploratory study of low-literate adults' navigation skills on the World Wide Web. J Health Commun 2002;7(4):309-324. [CrossRef] [Medline]
    10. Reinwand D, Schulz D, Crutzen R, Kremers S, de Vries H. Who follows eHealth interventions as recommended? A study of participants' personal characteristics from the experimental arm of a randomized controlled trial. J Med Internet Res 2015 May 11;17(5):e115 [FREE Full text] [CrossRef] [Medline]
    11. de Vries H, Brug J. Computer-tailored interventions motivating people to adopt health promoting behaviours: introduction to a new approach. Patient Educ Couns 1999 Feb;36(2):99-105. [Medline]
    12. Swartz LH, Noell JW, Schroeder SW, Ary DV. A randomised control study of a fully automated internet based smoking cessation programme. Tob Control 2006 Feb;15(1):7-12 [FREE Full text] [CrossRef] [Medline]
    13. Drummond MF, Sculpher MJ, Claxton K, Stoddart GL, Torrance GW. Methods for the Economic Evaluation of Health Care Programmes. Oxford: Oxford University Press; 2005.
    14. Evers S, Wolfs C, Ponds R, Fasotti L, Wekking E. Economische evaluatie van neuropsychologische behandeling. In: Neuropsychologische Behandeling. Amsterdam: Uitgeverij Boom; 2010:115-140.
    15. Bootzin R. Behavior modification and therapy: An introduction. In: Behavior modification and therapy: an introduction. Cambridge, Mass: Winthrop Publishers; 1975.
    16. Kanfer F, Goldstein A. Helping People Change: A Textbook of Methods. New York: Pergamon Press; 1975.
    17. Ritterband LM, Thorndike FP, Cox DJ, Kovatchev BP, Gonder-Frederick LA. A behavior change model for internet interventions. Ann Behav Med 2009 Aug;38(1):18-27 [FREE Full text] [CrossRef] [Medline]
    18. Bandura A. Human agency in social cognitive theory. Am Psychol 1989 Sep;44(9):1175-1184. [Medline]
    19. Prochaska J, DiClemente C. The Transtheoretical Approach: Crossing Traditional Boundaries of Therapy. Malabar, FL: Krieger Pub; 1994.
    20. Ajzen I. The theory of planned behavior. Organ Behav Human Dec 1991;50(2):179-211.
    21. Webb T, Joseph J, Yardley L, Michie S. Using the internet to promote health behavior change: a systematic review and meta-analysis of the impact of theoretical basis, use of behavior change techniques, and mode of delivery on efficacy. J Med Internet Res 2010 Feb 17;12(1):e4 [FREE Full text] [CrossRef] [Medline]
    22. Smit E, Evers SM, de Vries H, Hoving C. Cost-effectiveness and cost-utility of Internet-based computer tailoring for smoking cessation. J Med Internet Res 2013 Mar 14;15(3):e57 [FREE Full text] [CrossRef] [Medline]
    23. de Vries H, Eggers SM, Bolman C. The role of action planning and plan enactment for smoking cessation. BMC Public Health 2013 Apr 26;13:393 [FREE Full text] [CrossRef] [Medline]
    24. de Vries H, Eggers SM, Jinabhai C, Meyer-Weitz A, Sathiparsad R, Taylor M. Adolescents' beliefs about forced sex in KwaZulu-Natal, South Africa. Arch Sex Behav 2014 Aug;43(6):1087-1095 [FREE Full text] [CrossRef] [Medline]
    25. de Vries H, Mudde A, Leijs I, Charlton A, Vartiainen E, Buijs G, et al. The European Smoking Prevention Framework Approach (EFSA): an example of integral prevention. Health Educ Res 2003 Oct;18(5):611-626. [Medline]
    26. Ubhi H, Michie S, Kotz D, van Schayck OC, Selladurai A, West R. Characterising smoking cessation smartphone applications in terms of behaviour change techniques, engagement and ease-of-use features. Transl Behav Med 2016 Sep;6(3):410-417 [FREE Full text] [CrossRef] [Medline]
    27. Michie S, Hyder N, Walia A, West R. Development of a taxonomy of behaviour change techniques used in individual behavioural support for smoking cessation. Addict Behav 2011 Apr;36(4):315-319. [CrossRef] [Medline]
    28. West R, Evans A, Michie S. Behavior change techniques used in group-based behavioral support by the English stop-smoking services and preliminary assessment of association with short-term quit outcomes. Nicotine Tob Res 2011 Dec;13(12):1316-1320. [CrossRef] [Medline]
    29. Borrelli B, Ritterband LM. Special issue on eHealth and mHealth: challenges and future directions for assessment, treatment, and dissemination. Health Psychol 2015 Dec;34S:1205-1208. [CrossRef] [Medline]
    30. Cochrane Tobacco Addiction Group.   URL: [accessed 2017-06-20] [WebCite Cache]
    31. de Gee EA, Blankers M, Duivis H, Spijkerman M, Fischer E, Leone S. Trimbos Institute. 2014. Programmeringsstudie Technologisch Ondersteunde Innovatieve Tabaksontmoediging   URL: [accessed 2017-06-06] [WebCite Cache]
    32. Elfeddali I, de Vries H, Bolman C, Pronk T, Wiers RW. A randomized controlled trial of Web-based Attentional Bias Modification to help smokers quit. Health Psychol 2016 Dec;35(8):870-880. [CrossRef] [Medline]
    33. Te Poel F, Bolman C, Reubsaet A, de Vries H. Efficacy of a single computer-tailored e-mail for smoking cessation: results after 6 months. Health Educ Res 2009 Dec;24(6):930-940. [CrossRef] [Medline]
    34. Elfeddali I, Bolman C, Candel MJ, Wiers R, de Vries H. Preventing smoking relapse via Web-based computer-tailored feedback: a randomized controlled trial. J Med Internet Res 2012 Aug 20;14(4):e109 [FREE Full text] [CrossRef] [Medline]
    35. Elfeddali I, Bolman C, de Vries H. SQ4U-a computer tailored smoking relapse prevention program incorporating planning strategy assignments and multiple feedback time points after the quit-attempt: development and design protocol. Contemp Clin Trials 2012 Jan;33(1):151-158. [CrossRef] [Medline]
    36. Smit E, Candel MJ, Hoving C, de Vries H. Results of the PAS study: a randomized controlled trial evaluating the effectiveness of a Web-based multiple tailored smoking cessation program combined with tailored counseling by practice nurses. Health Commun 2016 Sep;31(9):1165-1173. [CrossRef] [Medline]
    37. de Jong S, Candel M, Segaar D, Cremers H, de Vries H. Efficacy of a Web-based computer-tailored smoking prevention intervention for Dutch adolescents: randomized controlled trial. J Med Internet Res 2014 Mar 21;16(3):e82 [FREE Full text] [CrossRef] [Medline]
    38. Stanczyk N, Smit E, Schulz D, de Vries H, Bolman C, Muris JW, et al. An economic evaluation of a video- and text-based computer-tailored intervention for smoking cessation: a cost-effectiveness and cost-utility analysis of a randomized controlled trial. PLoS One 2014;9(10):e110117 [FREE Full text] [CrossRef] [Medline]
    39. Stanczyk N, Bolman C, van Adrichem M, Candel M, Muris J, de Vries H. Comparison of text and video computer-tailored interventions for smoking cessation: randomized controlled trial. J Med Internet Res 2014 Mar 03;16(3):e69 [FREE Full text] [CrossRef] [Medline]
    40. Stanczyk N, Bolman C, Smit E, Candel MJ, Muris JW, de Vries H. How to encourage smokers to participate in web-based computer-tailored smoking cessation programs: a comparison of different recruitment strategies. Health Educ Res 2014 Feb;29(1):23-40. [CrossRef] [Medline]
    41. Stanczyk NE, Crutzen R, Bolman C, Muris J, de Vries H. Influence of delivery strategy on message-processing mechanisms and future adherence to a Dutch computer-tailored smoking cessation intervention. J Med Internet Res 2013 Feb 06;15(2):e28 [FREE Full text] [CrossRef] [Medline]
    42. Dijk F, de Vries H. Internet-based smoking-cessation aids for young people: practical experience and current evidence. In: Res Pract Health. 2008 Presented at: FCHE Workshop; Sep 18-19, 2008; Berlin p. 35-46.
    43. de Jong S, Segaar D, de Vries H. Effectiviteit en bereik van e-health interventie Smoke Alert. 2012. Onderzoeksrapport   URL: http:/​/www.​​wp-content/​uploads/​2012/​docs/​rapporten/​jongeren/​Onderzoeksrapport_SmokeAlert2%200.​pdf [accessed 2017-06-06] [WebCite Cache]
    44. Nielsen J, Landauer T. A mathematical model of the finding of usability problems. In: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems. 1993 Presented at: CHI '93 Conference on Human Factors in Computing Systems; Apr 24-29, 1993; Amsterdam.
    45. van den Berg M, van Baal P, de Wit G, Schuit A. literatuursignalering en modellering. RIVM rapport 27009. 2008. Kosteneffectiviteit van preventie   URL: [accessed 2017-06-06] [WebCite Cache]
    46. Online Zelfhulp Tabak.   URL: [accessed 2017-06-20] [WebCite Cache]
    47. Blankers M, Koeter MW, Schippers G. Internet therapy versus internet self-help versus no treatment for problematic alcohol use: a randomized controlled trial. J Consult Clin Psychol 2011 Jun;79(3):330-341. [CrossRef] [Medline]
    48. Blankers M, Smit E, van der Pol P, de Vries H, Hoving C, van Laar M. The missing=smoking assumption: a fallacy in Internet-based smoking cessation trials? Nicotine Tob Res 2016 Jan;18(1):25-33. [CrossRef] [Medline]
    49. Feenstra T, Hamberg-van Reenen HH, Hoogenveen R, Rutten-van Mölken MP. Cost-effectiveness of face-to-face smoking cessation interventions: a dynamic modeling study. Value Health 2005;8(3):178-190 [FREE Full text] [CrossRef] [Medline]
    50. Elder JP, Ayala GX, Harris S. Theories and intervention approaches to health-behavior change in primary care. Am J Prev Med 1999 Nov;17(4):275-284. [Medline]
    51. Peters G, de Bruin M, Crutzen R. Everything should be as simple as possible, but no simpler: towards a protocol for accumulating evidence regarding the active content of health behaviour change interventions. Health Psychol Rev 2015;9(1):1-14 [FREE Full text] [CrossRef] [Medline]
    52. van Gemert-Pijnen JE, Nijland N, van Limburg M, Ossebaard HC, Kelders SM, Eysenbach G, et al. A holistic framework to improve the uptake and impact of eHealth technologies. J Med Internet Res 2011 Dec 05;13(4):e111 [FREE Full text] [CrossRef] [Medline]
    53. Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y. Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev 2016 Apr 10;4:CD006611. [CrossRef] [Medline]
    54. Quiñonez SG, Walthouwer MJ, Schulz D, de Vries H. mHealth or eHealth? Efficacy, use, and appreciation of a Web-based computer-tailored physical activity intervention for Dutch adults: a randomized controlled trial. J Med Internet Res 2016 Nov 09;18(11):e278 [FREE Full text] [CrossRef] [Medline]
    55. Ubhi HK, Michie S, Kotz D, Wong WC, West R. A mobile app to aid smoking cessation: preliminary evaluation of SmokeFree28. J Med Internet Res 2015 Jan 16;17(1):e17 [FREE Full text] [CrossRef] [Medline]
    56. Hassandra M, Lintunen T, Kettunen T, Vanhala M, Toivonen H, Kinnunen K, et al. Effectiveness of a mobile phone app for adults that uses physical activity as a tool to manage cigarette craving after smoking cessation: a study protocol for a randomized controlled trial. JMIR Res Protoc 2015 Oct 22;4(4):e125 [FREE Full text] [CrossRef] [Medline]
    57. Sadasivam R, Borglund E, Adams R, Marlin B, Houston T. Impact of a collective intelligence tailored messaging system on smoking cessation: the Perspect randomized experiment. J Med Internet Res 2016 Nov 08;18(11):e285 [FREE Full text] [CrossRef] [Medline]


    ABM: Attentional Bias Modification
    BCT: behavior change technique
    PAS: Personal Advice in Stopping smoking
    QALY: quality-adjusted life year
    RCT: randomized controlled trial
    RR: relative risk
    SQ4U: Stay Quit for You
    STQ: Support to Quit
    VWS: Volksgezondheid, Welzijn en Sport

    Edited by G Eysenbach; submitted 13.01.17; peer-reviewed by O Perski, T McFadyen, J Apolinário-Hagen; comments to author 01.03.17; revised version received 10.04.17; accepted 11.04.17; published 23.06.17

    ©Kei Long Cheung, Ben Wijnen, Hein de Vries. Originally published in the Journal of Medical Internet Research (, 23.06.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.