Published on 01.11.17 in Vol 19, No 11 (2017): November
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/7928, first published Jun 16, 2017.
Engagement Within a Mobile Phone–Based Smoking Cessation Intervention for Adolescents and its Association With Participant Characteristics and Outcomes
Background: Although mobile phone–delivered smoking cessation programs are a promising way to promote smoking cessation among adolescents, little is known about how adolescents might actually use them.
Objective: The aim of this study was to determine adolescents’ trajectories of engagement with a mobile phone–delivered smoking cessation program over time and the associations these trajectories have with baseline characteristics and treatment outcomes.
Methods: We performed secondary data analysis on a dataset from a study that compared a mobile phone–delivered integrated smoking cessation and alcohol intervention with a smoking cessation only intervention for adolescents recruited in vocational and upper secondary school classes (N=1418). Throughout the 3-month intervention, participants in both intervention groups received one text message prompt per week that either assessed smoking-related target behaviors or encouraged participation in a quiz or a message contest. Sequence analyses were performed to identify engagement trajectories. Analyses were conducted to identify predictors of engagement trajectory and associations between engagement trajectories and treatment outcomes.
Results: Three engagement trajectories emerged: (1) stable engagement (646/1418, 45.56%), (2) decreasing engagement (501/1418, 35.33%), and (3) stable nonengagement (271/1418, 19.11%). Adolescents who were younger, had no immigrant background, perceived more benefits of quitting smoking, and reported binge drinking preceding the baseline assessment were more likely to exhibit stable engagement. Due to different reach of more engaged and less engaged participants at follow-up, three statistical models (complete-cases, last-observation-carried-forward, and multiple imputation) for the associations of engagement trajectory and smoking outcome were tested. For 7-point smoking abstinence, no association was revealed to be statistically significant over all three models. However, decreasing engagement with the program was associated over all three models, with greater reductions in daily tobacco use than nonengagement.
Conclusions: The majority of tobacco-smoking adolescents engaged extensively with a mobile phone–based smoking cessation program. However, not only stable engagement but also decreasing engagement with a program might be an indicator of behavioral change. Measures to avoid nonengagement among adolescents appear especially necessary for older smokers with an immigrant background who do not drink excessively. In addition, future studies should not only examine the use of specific program components but also users’ engagement trajectories to better understand the mechanisms behind behavioral change.
J Med Internet Res 2017;19(11):e356
Tobacco smoking is one of the main contributors to the global burden of disease . A survey of 15- and 16-year-old adolescents covering 36 European countries revealed that 21% considered themselves current smokers [ ]. As tobacco use often starts in adolescence, intervening before the development of a substance use disorder gains importance [ ].
Mobile phone–based programs for smoking cessation are promising tools for delivering treatment to large numbers of adolescents . Such programs have already been proven more effective than minimal or no intervention in adult smokers [ - ]. Whereas only trends toward the effectiveness of such programs in adolescents have been documented to date [ ], studies highlight their acceptance by adolescent smokers with mixed intentions to quit smoking and by adolescent smokers of different genders, educational levels, and immigrant backgrounds [ , ].
Mobile phone–based smoking cessation programs are delivered via apps  or texting [ , ], with the greatest difference being the level of engagement demanded by the two approaches. The first demands that users proactively engage with the program, whereas the latter requires users to actively disengage from the program [ ]. Engagement, for instance, has been conceptualized in previous studies both as the usage or the subjective experience with the program [ ]. For texting-based programs, there is some evidence that the predominant engagers are female [ ] and older and that they exhibit lower rates of daily cigarette consumption [ ], but none of these studies were conducted on adolescents.
User engagement with different smoking cessation programs has been linked to positive behavioral changes. With Web-based interventions, for instance, higher numbers of visits and page views were associated with abstinence [- ]. Recent studies on texting-based interventions point in the same direction. In a study by Balmford and Borland [ ], the efficacy of a texting-based smoking cessation program was associated with completion of the program. Participants who elected to stop the program were less likely to be abstinent at follow-up. In another study by Heminger et al [ ], rather than overall engagement, postquit engagement and the use of specific program features such as pledges were specifically predictive of 6-month abstinence. Even more accurately, a study by Christofferson et al [ ] identified five different classes of user engagement, which in turn were associated with different levels of interventional success. These investigators extracted two classes of engagement (high engagement and increasing engagement) and three classes of disengagement (rapidly-decreasing engagement, delayed decreasing engagement, and low engagement), demonstrating that participants within the more engaged classes were significantly more likely to be abstinent at weeks 3, 4, and 5 than participants within less engaged classes.
However, there are also studies that question the association between high engagement and positive behavior changes [, , ]. For instance, Balmford and Borland [ ] found that users with the lowest texting intensity had a greater chance of being abstinent at the 1-month follow-up. The researchers concluded that users tend to be selective as to what they need, which is not to be confused with a lack of motivation. Furthermore, they questioned whether it would be of more help if greater engagement could be achieved among less responsive users. In another pilot study [ ] that investigated the use of an app-based smoking cessation program, the total number of actively-viewed quit tips and medication tips was predictive of nonabstinence at 12-week follow-up.
Three methodological issues make the contribution of a user’s level of engagement to long-term abstinence somewhat uncertain. First, only one study has reported long-term outcome associations with engagement . Second, setting a quit date and having a quit attempt is an integral component of most smoking cessation programs [ , , , , ]. Such interventions are typically divided into prequit and postquit phases. There is a lack of studies investigating engagement with a mobile phone–based intervention that was matched to stages of change and did not require subjects to set a quit date. This is of special interest, as most adult and adolescent smokers do not report any serious intention to quit within the next month [ , ]. Third, on the other hand, smokers who enroll in such cessation programs already tend to report an intention to quit smoking [ , , ], which can lead to a self-selection of more engaged and thus, more successful subjects. To our knowledge, no studies have investigated engagement with a mobile phone–based cessation program in proactively-recruited smokers at different stages of change.
Thus, this study aimed to examine trajectories of program engagement associated with long-term outcomes within a randomized controlled trial (RCT) assessing a fully-automated mobile phone–based program for young smokers that was based on the health action process approach (HAPA) stages of change model . In this study, we conceptualized engagement as the usage of the program. We expected to find trajectories of higher and lower program engagement, similar to the study of Christofferson et al [ ]. Compared with their study [ ], we did not expect a concrete amount of trajectories, as we applied a different analysis method, and our sample was not only constituted by participants intending to quit smoking. Factors that predict engagement and completion of the 3-month program were analyzed to sort out for whom such programs still need to be improved. We hypothesized that being female [ ], older age, and smoking at lower daily rates [ ] would predict engagement. In addition, this study investigated adolescents’ engagement with different features of a mobile phone–based intervention, as identifying more and less influential components of such interventions has recently been raised as a means to help refine other health behavior change programs [ ].
Participants and Procedures
Data for this study were extracted from a two-arm, parallel-group, cluster RCT that used school class as the randomization unit, as detailed elsewhere [, ]. Students in vocational or upper secondary schools in Switzerland were invited to participate in a technology-based program called MobileCoach Tobacco (MCT) if they (1) either smoked on a daily or occasional basis (at least 4 cigarettes in the preceding month and at least one cigarette during the preceding week) and (2) owned a mobile phone . Participating students were reimbursed 10 Swiss francs for participating in the baseline and follow-up assessments and with 0.5 Swiss francs for each of the 11 text message (short service message, SMS) assessments that they answered within the MCT program.
In the original trial, the efficacy of an integrated smoking cessation and alcohol intervention (MCT+) was tested against a smoking cessation only intervention (MCT) for smoking cessation in adolescents. A total of 1471 students from 360 Swiss vocational school classes participated in this study. They were randomly assigned to either the combined program (MCT+, n=730) or to the smoking cessation only program (MCT, n=741). The original study  found no significant difference between the programs in terms of reducing the number of cigarettes used per day (MCT+ vs MCT: −2.7 vs −2.8) or in increasing the 7-day point prevalence of smoking abstinence at follow-up (MCT+ vs MCT: 14.9% vs 14.0%).
The intervention was designed with, and triggered by, the open-source behavioral intervention platform MobileCoach version 1.1 . The original study protocol was approved by the ethics committee of the Faculty of Philosophy at the University of Zurich, Switzerland (date of approval: June 24, 2014). The study was registered at Current Controlled Trials ISRCTN (ISRCTN02427446, assigned September 8, 2014) and executed in full compliance with the Declaration of Helsinki.
Description of MobileCoach Tobacco
The MCT+ program combined (1) tailored Web-based feedback on individual drinking behaviors delivered directly after completion of the baseline assessment, (2) tailored mobile phone text messages to promote drinking within low-risk limits over a 3-month period, (3) tailored mobile phone text messages to support smoking cessation for 3 months, and (4) the option of receiving twice daily strategies for smoking cessation centered around a self-defined quit date. Only components (3) and (4) of the integrated intervention were delivered to participants in the MCT group. The theoretical backgrounds of these intervention components are described elsewhere .
The Web-based feedback, intended only for participants in the combined program, was provided immediately after completion of the baseline assessment. It included individually-tailored information (1) about calorie intake based on personal drinking data and (2) age and gender-specific norms on the number of drinks consumed per week, as well as on the individual’s frequency of binge drinking.
The alcohol-related text messages provided information on (1) strategies for drinking within low-risk limits and (2) the association between smoking and alcohol consumption. These text messages were sent only to those subjects within the MCT+ condition who reported binge drinking previous to their baseline assessment, where binge-drinking is equivalent to the consumption of 5 or more drinks on a single occasion for men and 4 or more drinks for women. These text messages were sent on Saturdays at 7 PM on even weeks, whereas on odd weeks they were sent at each particular individual’s typical drinking day and time.
The tobacco-related text messages provided information relevant to each subject’s individual HAPA stage of change . On the basis of the HAPA stage [ ], subjects can be divided into “preintenders” (individuals with no intention to quit smoking) and “intenders” or “actors” (individuals who seriously intend to quit smoking or have already quit). For preintenders, the text messages addressed the benefits of quitting, risks of smoking, and methods for improving self-efficacy. For intenders, the text messages initiated planning processes, whereas for actors they emphasized self-regulatory skills.
During the 3-month MobileCoach Tobacco program, participants in both intervention groups received one text message prompt per week that either assessed smoking-related target behaviors or encouraged the subject’s participation in a quiz or message contest. These prompts were easily answered by typing a single letter, number, or sentence using the mobile phone’s reply function. Every 4 weeks, smoking-related target behaviors, including the person’s HAPA stage of change, were assessed through the question “Have you recently smoked cigarettes?,” with the following response options: (1) “Yes, and I do not intend to quit” (preintender), (2) “Yes, but I am considering quitting” (preintender), (3) “Yes, but I seriously intend to quit” (intender), or (4) “No, I have already quit smoking” (actor). Furthermore, among preintenders, the number of cigarettes smoked per day or week (depending on smoking status: daily or occasionally) was assessed every 4 weeks. For intenders and actors, the use of strategies to cope with craving, which were individually chosen within the baseline assessment, was assessed: for example, “Did you apply the following strategy recently? When I am at a party, I distract myself from smoking by dancing. Yes (Y) No (N).”
Quizzes were included thrice during the MCT, with the questions targeting (1) smoking norms (percentage of smokers within the same age- and gender-specific reference group), (2) the health consequences of smoking cessation (days until positive health consequences after smoking cessation), and (3) expenditures on cigarettes (money spent on cigarettes per year).
A contest that required participants to create a text message to motivate other participants to quit smoking (for nonintenders) or to provide concrete ways to help others quit smoking (for intenders and actors) was conducted twice during the intervention period. The best text message from each of the two categories, rated weekly by a tobacco cessation expert, was sent anonymously to participants in the respective categories after 48 hours.
Finally, additional text messages were offered to subjects who reported having the intention to quit smoking. Intenders and actors were informed biweekly about the option of receiving additional information around a chosen quit date. After entering a scheduled quit date, the program provided up to 2 daily text messages on quit-day preparation and relapse prevention (weeks −1 to +1: 2 daily text messages; weeks +2 and +3: one daily text message).
Participants took part in a Web-based health survey during a regular class session, by which data on potential predictors of engagement and outcome variables were collected. The sociodemographic characteristics that were assessed were gender, age, educational attainment, and immigrant background. The following common Swiss levels of educational attainment were assessed: (1) none, (2) secondary school, (3) extended secondary school, and (4) technical or high school. We assessed the country of birth of both parents of the students to identify any potential immigrant background. On the basis of this information, participants were assigned to one of the following categories: (1) neither parent born outside Switzerland, (2) one parent born outside Switzerland, or (3) both parents born outside Switzerland. For further analysis, we grouped subjects with either a one- or two-sided immigrant background into a single category for comparison against nonimmigrants.
The health-related variables that were assessed were perceived stress, physical activity, body weight, typical number of drinks consumed per week, and whether any binge drinking had occurred in the month before the baseline assessment. Perceived stress was measured using the following single item: “In the last month, how severely have you felt stressed?” Participants were asked to indicate their response on a 6-point Likert scale that ranged from not at all to very. Self-reported moderate to vigorous physical activity was measured by a question derived from the Health Behaviour in School Aged Children study : “Outside school, how many hours a week do you exercise or participate in sports that make you sweat or out of breath?” The typical number of drinks consumed weekly was assessed via a 7-day drinking calendar similar to the Daily Drinking Questionnaire [ ], for which participants were asked to think about a typical week in the preceding month and record the number of standard drinks they typically consumed each day during that week. Examples of standard drinks containing 12 g to 14 g of ethanol were provided for beer, wine, spirits, alcopops, and cocktails, along with conversion values (eg, three 0.5 L cans of beer=6 standard drinks). Binge drinking was assessed by asking participants to report the number of standard drinks they consumed on their heaviest drinking occasion over the preceding 30 days.
Tobacco smoking status was assessed using the question, “Are you currently smoking cigarettes?” with the following response options: (1) “Yes—I smoke cigarettes daily,” (2) “Yes—I smoke cigarettes occasionally, but not daily,” and (3) “No.” In occasional smokers, we assessed the number of days they typically smoked per month, the total number of cigarettes smoked within the previous 7 days, and the number of cigarettes smoked on a typical smoking day. In daily smokers, we only assessed the mean number of cigarettes smoked per day. For occasional smokers, the average number of cigarettes smoked per day was computed by multiplying the typical number of smoking days per month with the number of cigarettes smoked on a typical smoking day and dividing this product by 30.
Additionally, we assessed the following smoking-related variables: HAPA stage of change and the number of previous quit attempts. Each subject’s HAPA stage of change was assessed using the following question: “Have you recently smoked cigarettes?” with the following response options (1) “Yes, and I do not intend to quit” (preintenders), (2) “Yes, but I am considering quitting” (preintenders), and (3) “Yes, but I seriously intend to quit” (intenders). Subjects were asked about their previous attempts to quit smoking with the question—“Have you ever made a serious attempt to quit smoking?”—for which they were provided the response options “No,” “Yes—once,” and “Yes—more than once.”
Engagement with the program was assessed in terms of the number of program participants who unsubscribed from the program (program attrition), the number of responses to the weekly text message prompts, the percentage of retrieved versus sent media objects within the program, and the number of smokers who entered a quit date and activated the additional quit day preparation program.
Smoking behavior at 6-month follow-up was assessed as the (1) 7-day point prevalence of smoking abstinence and (2) the mean number of cigarettes smoked per day. To assess the 7-day point prevalence of smoking abstinence, subjects were asked to indicate whether they had taken a puff of a cigarette within the 7 days previous to follow-up. The mean number of cigarettes smoked per day was assessed and computed in the same way as at the baseline assessment.
As a first step, we analyzed whether persons who actively unsubscribed from the intervention differed from those who remained in the intervention, applying Pearson chi-square analysis to examine differences in categorical variables and unpaired student t tests for continuous variables. Given that the combined intervention was more extensive, we also examined whether program attrition differed as a function of study condition. Participants who had either unsubscribed or did not receive the text messages, as seen from program log files, were excluded from further analysis. We then explored the use of different program features for the total sample and by treatment arm.
Subsequently, we examined engagement trajectories by analyzing answers to weekly prompts, which were identical for both study groups. To this end, we performed sequence analysis using the TraMineR library (version 1.8-8) in R . For each participant, answers to prompts (as described previously) were ordered into a sequence of states (ie, engagement trajectories). Similarities between participants’ state sequences were computed using the optimal matching (OM) distance algorithm. OM is defined as the minimal effort, in terms of insertions, deletions, and substitutions, of transforming one sequence into another. Homogeneous engagement trajectory groups (clusters) were then constructed from the distance matrix using agglomerative nesting hierarchical clustering and Ward’s linkage method. The number of clusters chosen was based on the highest relative loss of inertia (see function HCPC in FactoMineR package [ ]) and upon the quality of the clusters according to the average silhouette width (ASW) [ ]. The ASW ranges from −1 to +1 and can be interpreted as the degree of coherence among assignments to clusters: a high degree of coherence (close to 1) indicates large between-group distances and strong within-group homogeneity.
Upon detecting different engagement trajectories, we examined for baseline differences between the clusters. Subsequently, we conducted multinomial logistic regression analysis to identify predictors of clusters characterized by lower engagement trajectories, compared with those with higher engagement trajectories. Initially, separate univariate multinomial logistic regression analyses were performed (subsequently referred to as univariate analyses) to evaluate potential predictors of engagement trajectories. After these univariate analyses, multivariate prediction models were developed. As suggested by Hosmer et al , variable selection consisted of the following steps: (1) significant predictors (P<.05) identified during univariate analyses were entered into the preliminary multivariate model; (2) variables that were nonsignificant at P>.05 were removed, one at a time, starting with those with the highest P values (backward selection); and (3) to account for suppressor effects, the resulting model was verified by adding the aforementioned excluded variables, separately, to the regression model. Only variables that were significant at P<.05 were retained in the final multinomial regression model (forward selection).
Finally, we compared smoking outcomes between participants grouped by their engagement trajectory. As participants were nested in school classes, we conducted a generalized linear mixed model for the 7-day point prevalence of abstinence. For changes in consumed cigarettes per day, we conducted a linear mixed model. Engagement trajectory was included as an independent variable (fixed effect) and school class as a single random effect (random intercept). These analyses were conducted using the lme4 library (version 3.2.1) in R  on the following three statistical models because of the disparate reach of more engaged than less engaged participants at follow-up: (1) a complete case analysis (CCA) dataset, (2) a last-observation-carried-forward (LOCF) dataset, and (3) an intention-to-treat (ITT) dataset. Details of outcome analysis and missing data imputation procedures are provided in Haug et al [ ]. R version 3.3.3 (The R Foundation for Statistical Computing) was used to perform all sequence analyses and outcome analyses, whereas the Statistical Package for the Social Sciences (SPSS) version 22 (IBM Corp) was used for all other analyses. All statistical tests were two-tailed, with P<.05 set as the criterion for statistical significance.
depicts the progression of participants through the trial. Of the original 1471 study participants, 1418 (96.39%) completed the program. Those who failed to complete their intervention had either signed off (31/1471, 2.11%) or discontinued the intervention because of technical problems (22/1471, 1.49%). No significant baseline differences were observed between those who did and did not complete the intervention. Program attrition also did not differ between the two treatment arms, with 13 of the 741 (1.8%) participants in the MCT choosing to unsubscribe compared with 18 of the 730 (2.5%) assigned to the MCT+ (χ22=0.9, P=.34). Of the 1418 participants analyzed for this study, 863 (60.86%) were female. The reported mean age was 18.6 (standard deviation [SD] 3.1). More than half (740/1418, 52.18%) reported either a one-sided or two-sided immigrant background, and almost all (1180/1418, 83.21%) had reached at least the lowest educational degree (ie, secondary school). Two-thirds of the sample (1083/1418, 76.37%) took part on the follow-up assessment; 538 of the 712 (75.6%) participants were assigned to the MCT and 545 of the 706 (77.2%) were assigned to the MCT+.
Use of Different Program Features
summarizes different program use characteristics across the total sample and by intervention group. Participants answered a mean of 6.6 (SD 3.5) out of 11 text message prompts. Each participant received between 3 and 5 text messages containing media objects (videos and pictures) that had to be downloaded. On average, participants downloaded 20.5% (SD 31.5) of the received media content. Participants in the MCT+ downloaded media content significantly more often than their MCT counterparts (23.6% vs 17.9%, P<.001). Roughly half of the subjects answered all or almost all of their text message prompts. The fewest answers were recorded for the contest prompt at week 8 (24.9%) and for the HAPA stage query at week 10 (42.9%).
Our inspection of answer behavior over the 3-month intervention revealed different types of engagement trajectory. Some participants exhibited a stable answer pattern (either usually answered or almost never answered text messages). Other participants displayed irregular trajectories. The highest relative loss of inertia measure suggested the following three-cluster solution: cluster 1=stable engagement (SE), cluster 2=decreasing engagement (DE), and cluster 3=stable nonengagement (SNE). On the basis of the ASW, the quality of the three clusters ranged from poor (cluster 2=−0.02) to good (cluster 1=0.55) and excellent (cluster 3=0.70). The low ASW for cluster 2 was because the engagement trajectories included within the cluster differed to a great extent. Some subjects answered text messages only in the beginning, whereas others answered depending on the topic. There were also some participants who only started to answer text messages at the end of the program (). As the common element within all these trajectories included in cluster 2 is their instability, the three-cluster solution was considered adequate for the purposes of this study.
|Program components||All (N=1418)||MCT (n=712)||MCT+ (n=706)||P value|
|Questions answered, mean (SDa)b,c||6.6 (3.5)||6.5 (3.6)||6.8 (3.5)||.22|
|Percentage of media objects viewed or of media objects sent, mean (SD)b,c||20.8 (31.5)||17.9 (32.6)||23.6 (30.0)||<.001|
|Answer to quizzesd,e, n (%)|
|Quiz costs (week 1)||975 (68.76)||481 (67.6)||494 (70.0)||.33|
|Quiz health (week 5)||898 (63.32)||438 (61.5)||460 (65.2)||.16|
|Quiz norms (week 9)||863 (60.86)||429 (60.3)||434 (61.5)||.64|
|Answer to HAPAfstage of changed,e, n (%)|
|Stage 1 (week 2)||1206 (85.04)||598 (83.9)||608 (86.1)||.26|
|Stage 2 (week 6)||975 (68.76)||485 (68.7)||490 (68.8)||.96|
|Stage 3 (week 10)||609 (42.94)||295 (41.4)||314 (44.5)||.25|
|Answer to smoking-related questionsd,e, n (%)|
|CPDg or CPWh or coping strategy (week 3)||992 (69.95)||490 (68.8)||502 (71.1)||.35|
|CPD or CPW or coping strategy (week 7)||876 (61.77)||444 (62.4)||432 (61.2)||.65|
|CPD or CPW or coping strategy (week 11)||749 (52.82)||361 (50.7)||388 (55.0)||.11|
|Answer to contest, n (%)d,e|
|Motivational or quit contest (week 4)||626 (44.14)||303 (42.6)||323 (45.8)||.23|
|Motivational or quit contest (week 8)||353 (24.89)||175 (24.6)||178 (25.2)||.78|
|Setting of a quit dated,e||156/475 (32.8)||79/239 (33.1)||77/236 (32.6)||.92|
aSD: standard deviation.
cDegrees of freedom=1416.
eDegrees of freedom=1.
fHAPA: health action process approach.
gCPD: cigarettes smoked per day.
hCPW: cigarettes smoked per week.
and describe the three clusters in different ways. The first figure displays the response or nonresponse of individuals to each of the 11 prompts within the different clusters. highlights the prototype engagement trajectory within each of the three clusters. The typical participant within cluster 1 (SE) answered to almost all text messages, except for the second request to send their own message to motivate other participants to quit smoking or remain cigarette free. The typical participant within cluster 3 (SNE) did not respond to any of the prompts. Meanwhile, the typical participant within cluster 2 (DE) did not reply to the two message contests and exhibited a steadily decreasing response rate. This last pattern is associated with the repetition of questions, such as queries relating to the person’s HAPA stage of change and cigarettes per day or per week.
Predictors of Engagement Trajectory
summarizes the baseline characteristics of participants by engagement trajectory. There were significant differences between the three clusters with regard to age (P=.006), immigrant background (P<.001), educational attainment (P=.04), binge drinking (P<.001), HAPA stage of change (P<.05), and self-perceived benefits of quitting (P<.001).
shows which of the aforementioned variables were predictive of engagement trajectory within the multivariate model. Being older (Odds ratio [OR]=1.05, P=.04) and having an immigrant background (OR=0.76, P=.02) predicted a decreasing engagement with the program compared with a stable engagement. Furthermore, participants who perceived more benefits of quitting were more likely to display stable than decreasing engagement with the program (OR=0.52, P=.007). Compared with stable engagement, nonengagement was predicted by immigrant background (OR=0.47, P<.001) and binge-drinking behavior (OR=1.54, P=.005). Being a stable nonengager was more likely than being a stable engager, when participants reported an immigrant background and no binge drinking within the month previous to baseline.
Engagement Trajectories and Smoking Behavior
Treatment outcome by type of engagement trajectory and comparisons of outcomes between engagement trajectories are summarized in. Reach at follow-up differed importantly between stable engagers (84.3%, 545/646), decreasing engagers (74.5%, 373/501), and nonengagers (59.0%, 160/271). Due to this, three statistical models were tested. Only the reduction in cigarettes per day among decreasing engagers differed significantly from stable nonengagers under the CCA, LOCF, and ITT assumptions (CCA: beta=.65, P=.02; LOCF: beta=.43, P=.01; and ITT: beta=.54, P=.03). Decreasing engagers smoked significantly fewer cigarettes per day at the end of the intervention than nonengagers.
With respect to the 7-day point prevalence of abstinence at 6-month follow-up, no comparison revealed a significant difference under all three assumptions. On ITT analysis, the odds of being abstinent at follow-up was higher among nonengagers than engagers (OR=1.32, P=.02). But this finding must be interpreted with caution, as bias in the multiple imputation of missing data seems probable because of the different amount of available information at follow-up. Caution is also warranted, as under the missing-as-smoker assumption, the odds for being abstinent turn in the opposite direction.
|Demographic characteristics||All (N=1418)||Stable engagement (n=646)||Decreasing engagement (n=501)||Stable nonengagement (n=271)||P value|
|Intervention groupa,c, n (%)|
|MCTg||712 (50.21)||319 (49.4)||248 (49.5)||145 (53.5)||.48|
|MCT+h||706 (49.78)||327 (50.6)||253 (50.5)||126 (46.5)|
|Female sexa,c, n (%)||863 (60.86)||398 (61.6)||293 (58.5)||172 (63.5)||.35|
|Immigrant backgrounda,c, n (%)||740 (52.18)||293 (45.4)||268 (53.5)||179 (66.1)||<.001|
|Age in years, mean (standard deviation [SDf])b,c||18.6 (3.1)||18.4 (2.8)||18.8 (3.4)||18.9 (2.9)||.006|
|Educational levela,e, n (%)|
|Secondary school||1180 (83.21)||555 (85.9)||401 (80.0)||224 (82.7)||.04|
|Vocational school||189 (13.32)||67 (10.4)||86 (17.2)||36 (13.3)|
|Technical or high school or university||30 (2.11)||13 (2.0)||10 (2.0)||7 (2.6)|
|Unknown||19 (1.33)||11 (1.7)||4 (0.8)||4 (1.5)|
|Hours of moderate to vigorous extracurricular physical activity per week, mean (SD)b,c||3.5 (3.6)||3.4 (3.4)||3.7 (3.8)||3.2 (3.6)||.08|
|Number of alcoholic drinks consumed per week, mean (SD)b,c||9.9 (12.1)||10.2 (12.1)||10.3 (11.8)||8.4 (12.5)||.09|
|Binge drinkinga,c, n (%)|
|No||465 (32.79)||191 (29.6)||158 (31.6)||116 (42.8)||<.001|
|Yes||952 (67.13)||455 (70.4)||342 (68.4)||155 (57.2)|
|Tobacco smoking statusb, n (%)|
|Daily smoker||1075 (75.81)||476 (73.7)||390 (77.8)||209 (77.1)||.22|
|Occasional smoker||343 (24.18)||170 (26.3)||111 (22.2)||62 (22.9)|
|Number of cigarettes smoked per day, mean (SD)b,c||10.1 (7.3)||9.9 (7.3)||10.5 (7.4)||10.0 (7.1)||.32|
|Stage of changea,d, n (%)|
|No intention to quit||396 (27.92)||200 (31.0)||124 (24.8)||72 (26.8)||.03|
|Considering quitting||825 (58.18)||372 (57.6)||291 (58.2%)||162 (60.2)|
|Serious intention to quit||194 (13.68)||74 (11.5)||85 (17.0)||35 (13.0)|
|Benefits of quitting smoking, mean (SD)b,c||1.38 (0.3)||1.41 (0.3)||1.36 (0.3)||1.37 (0.3)||<.001|
|Previous quit attemptsa,d, n (%)|
|None||507 (35.75)||247 (38.2)||173 (34.6)||87 (32.5)||.10|
|One||608 (42.87)||276 (42.7)||205 (41.0)||127 (47.4)|
|Two or more||299 (21.08)||123 (19.0)||122 (24.4)||54 (20.1)|
cDegrees of freedom=2.
dDegrees of freedom=4.
eDegrees of freedom=6.
fSD: standard deviation.
gMCT: smoking cessation only program.
hMCT+: integrated smoking cessation and alcohol intervention.
|Predictors of engagement trajectory||Beta (SEa)||P value||ORb (95% CI)|
|Stable engagement (refc) versus decreasing engagement|
|Age in years||.05 (.02)||.04||1.05 (1.003-1.09)|
|Immigration background (ref yes)||−.28 (.12)||.02||0.76 (0.59-0.96)|
|Binge drinking (ref yes)||.01 (.13)||.98||1.00 (0.78-1.30)|
|Benefits of quitting smoking||−.66 (.24)||.007||0.52 (0.32-0.84)|
|Stable engagement (ref) versus stable nonengagement|
|Age in years||.05 (.03)||.05||1.05 (0.99-1.10)|
|Immigration background (ref yes)||−.76 (.15)||<.001||0.47 (0.35-0.63)|
|Binge drinking (ref yes)||.43 (.15)||.005||1.54 (1.14-2.08)|
|Benefits of quitting smoking||−.37 (.29)||.21||0.70 (0.39-1.24)|
aSE: standard error.
bOR: odds ratio.
|Mean (SD)||Difference in cigarettes per daya||n (%)||7-day point prevalence of smoking abstinenceb|
|CCAc (P value)||LOCFd (P value)||ITTe (P value)||CCA (P value)||MASf (P value)||ITT (P value)|
|SEg (refh)||2.36 (5.5)||.25 (.34)||−.19 (.24)||.07 (.77)||73 (13.4)||1.18 (.16)||0.96 (.76)||1.32 (.02)|
|SNEi||2.43 (5.6)||29 (18.1)|
|SE (ref)||2.36 (5.5)||.52 (.01)||.14 (.32)||.40 (.04)||73 (13.4)||1.05 (.58)||0.97 (.77)||1.11 (.21)|
|DEj||3.44 (7.1)||54 (14.5)|
|SNE (ref)||2.43 (5.6)||.65 (.02)||.43 (.01)||.54 (.03)||29 (18.1)||0.91 (.46)||0.99 (.97)||0.87 (.25)|
|DE||3.44 (7.1)||54 (14.5)|
|SE (ref)||2.36 (5.5)||.25 (.046)||.00 (.99)||.17 (.18)||73 (13.4)||1.06 (.31)||0.98 (.74)||1.09 (.08)|
|SNE and DE||2.94 (6.4)||83 (15.6)|
cCCA: complete-case dataset.
eITT: intention-to-treat dataset.
gSE: stable engagement.
href.: reference category.
iSNE: stable nonengagement.
jDE: decreasing engagement.
Using a proactively-recruited sample of smoking adolescents with mixed intentions to quit smoking, this study examined (1) the use of different components of a mobile phone–based smoking cessation program, (2) different prototypes of engagement trajectory, (3) the association between engagement trajectories and adolescent characteristics, and (4) the association between engagement trajectories and treatment outcomes.
The main findings are as follows: (1) the components of the mobile phone–based smoking cessation program were used over the 3-month intervention in a regular way, with quizzes being the component with the highest participation rate and repeated smoking-related assessments the least-used component, (2) three distinct engagement trajectories emerged: two characterized by higher levels of engagement, stable and decreasing engagement, and one by a lower level of engagement: stable nonengagement, (3) adolescents who were younger, had no immigrant background, perceived more benefits of quitting smoking, and reported binge drinking preceding their baseline assessment were more likely to exhibit a stable engagement trajectory throughout the intervention, and (4) subjects who displayed a decreasing engagement pattern generally reduced their daily tobacco use more than subjects whose level of engagement was low.
This is the first study to examine engagement with a mobile phone–based smoking cessation intervention among adolescents. As expected, trajectories of higher and lower engagement were identified. We found similar results among adolescents as for adults [, , ]. We also identified a cluster of people who fully committed to the program, as in the study by Balmford and Borland [ ]. Similarly, this study replicates three of the five engagement clusters detected by Christofferson et al [ ]. Whereas our cluster-solution was less fine-grained, the clusters were significantly different with respect to baseline characteristics, contrary to those reported by Christoffersons et al [ ]. Distinct groups are essential if interventions have to be adapted to different types of engager.
Furthermore, this study was the first to examine factors that predict stable engagement with a mobile phone–based smoking cessation program among adolescents. Other than expected from previous studies on mobile phone–based programs for adult smokers [, ], engagement was not related to gender. This could be explained by the gender-specific tailoring which was undertaken for MobileCoach Tobacco (eg, the feedback on gender-specific drinking norms). Interestingly, in adolescents, being younger was associated with higher levels of engagement versus being older among adults [ ]. This result suggests a quadratic relationship between age and engagement. Younger and older people might become more engaged for a variety of reasons that include the program being more novel to them, having more free time, or being more likely to commit to tasks in general. Contrary to our assumptions based on studies in adults, lower rates of daily cigarette consumption were not associated with higher engagement.
This study revealed three further factors, besides age, to be predictive of engagement among adolescents: the individual’s immigrant background, their personal outcome expectancies with respect to quitting smoking (ie, the benefits of quitting), and whether or not they previously engaged in binge drinking. An association between immigrant background and use of the program also was identified in a study by Businelle et al  that investigated the feasibility and effectiveness of an app-based smoking cessation intervention among socioeconomically disadvantaged adults. Especially non-white participants used the two information-delivering features of the app, which were tips and information about medication for quitting. Future studies should investigate whether tailoring mobile phone–based interventions to a person’s immigrant background impacts the intervention’s effectiveness. In particular, it has to be examined whether immigrants show less engagement with mobile phone–based programs because of poorer lexical-grammatical skills [ ] or because of different interests and socialization than nonimmigrants.
Compared with previous research, the current findings underline the relevance of hazardous alcohol use in predicting engagement with a smoking cessation program. Recent studies on tobacco interventions [- ] have already highlighted the underestimated role of combined alcohol and tobacco use among adolescents and its association with intervention effectiveness. Not only might mobile phone–based smoking cessation programs be more effective in adolescents who smoke and binge drink [ , - ], they also could be more attractive to those adolescents. As such, measures are needed to make smoking cessation programs more attractive for adolescents who smoke but do not drink excessively.
Contrary to previous work on adult smokers [, , ], we were not able to certainly discern whether more engaged subjects were more likely to be cigarette abstinent after the intervention. This was because of the different reach at follow-up of more engaged compared with less engaged participants. The only stable finding over all statistical assumptions was that a decreasing engagement trajectory was associated with a greater reduction in daily tobacco use than a stable nonengagement trajectory. This result suggests that not only stable engagement but also decreasing engagement might be an indicator of behavior change. As illustrated by other studies [ , ], disengaging from an intervention might not necessarily mean disengaging from behavioral change. Instead, it could indicate a shift from extrinsic to intrinsic motivation [ ]. These results support the claim by Yardley et al [ ] to examine ways of improving “effective engagement” in subjects rather than simply more engagement, with “effective engagement” defined as sufficient engagement with the treatment to achieve intended outcomes.
One major challenge of future research, however, will be to sort out which kind of intervention is apt for nonengagers. One starting point will be to adapt smoking cessation programs for adolescents to address immigrant backgrounds and drinking behaviors to prevent stable nonengagement and thereby, potentially enhance treatment effectiveness. Considering that most stable nonengagers were more highly motivated to quit smoking at baseline than most stable engagers, one question to answer will be whether actions must be undertaken to increase active participation or not.
The findings of this study must be interpreted in view of its limitations. First, only answers to weekly prompts were included for engagement analysis. Other components of the program—such as downloading media content, setting a quit date, and extracurricular texting behaviors—were not included in our analyses; these components could all be analyzed to determine their own predictive values, similar to [, ]. However, our rationale for selecting answers to prompts that were identical for all participants was to render our intergroup comparisons more interpretable. Second, that answers to weekly prompts were rewarded with 0.50 Swiss francs to cover the expenses of the adolescents might have influenced the adolescents’ likelihood of responding. Third, as already emphasized by Heminger et al [ ], quantity and quality of answers to prompts could qualitatively differ (eg, a smoker who replies to all smoking-related prompts and indicates greater daily use of cigarettes). Rather than just analyzing registered events, future qualitative work should investigate whether the content of answers is associated with treatment outcomes. In addition, qualitative research should further investigate the different forms of motivation underlying engagement trajectories among smokers. As stated elsewhere [ ], some highly engaged participants might have seen the program as integral to maintaining abstinence, whereas other nonabstinent smokers may have remained highly engaged to prepare for future smoking cessation attempts or merely to receive the offered remuneration. Finally, this study relied on self-report data of smoking behavior, which bears the risk that the results may have been influenced by social desirability.
In summary, in our study, adolescents who smoked engaged to a large extent with a mobile phone–based smoking cessation program, irrespective of their initial intention to quit smoking. Decreasing engagement was in turn clearly associated with better long-term treatment outcomes. Further efforts should be undertaken to increase program engagement among older smokers, with an immigrant background, who do not drink excessively. In addition, future studies should not only examine the use of specific program components but also users’ engagement trajectories to better understand the mechanisms behind behavioral change.
Conflicts of Interest
- Feigin VL, Roth GA, Naghavi M, Parmar P, Krishnamurthi R, Chugh S, Global Burden of Diseases, Injuries and Risk Factors Study 2013 and Stroke Experts Writing Group. Global burden of stroke and risk factors in 188 countries, during 1990-2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet Neurol 2016 Aug;15(9):913-924. [CrossRef] [Medline]
- Espad. 2016. ESPAD report 2015. Results from the European school survey project on alcohol and other drugs URL: http://www.espad.org/sites/espad.org/files/ESPAD_report_2015.pdf [accessed 2017-10-02] [WebCite Cache]
- Marsch LA, Borodovsky JT. Technology-based interventions for preventing and treating substance use among youth. Child Adolesc Psychiatr Clin N Am 2016 Oct;25(4):755-768. [CrossRef] [Medline]
- Scott-Sheldon LA, Terry DL, Carey KB, Garey L, Carey MP. Efficacy of expectancy challenge interventions to reduce college student drinking: a meta-analytic review. Psychol Addict Behav 2012 Sep;26(3):393-405 [FREE Full text] [CrossRef] [Medline]
- Head KJ, Noar SM, Iannarino NT, Grant Harrington N. Efficacy of text messaging-based interventions for health promotion: a meta-analysis. Soc Sci Med 2013 Nov;97:41-48. [CrossRef] [Medline]
- Mason M, Ola B, Zaharakis N, Zhang J. Text messaging interventions for adolescent and young adult substance use: a meta-analysis. Prev Sci 2015 Feb;16(2):181-188. [CrossRef] [Medline]
- Spohr SA, Nandy R, Gandhiraj D, Vemulapalli A, Anne S, Walters ST. Efficacy of SMS text message interventions for smoking cessation: a meta-analysis. J Subst Abuse Treat 2015 Sep;56:1-10. [CrossRef] [Medline]
- Whittaker R, McRobbie H, Bullen C, Rodgers A, Gu Y. Mobile phone-based interventions for smoking cessation. Cochrane Database Syst Rev 2016 Apr 10;4:CD006611. [CrossRef] [Medline]
- Haug S, Paz Castro R, Kowatsch T, Filler A, Schaub MP. Efficacy of a technology-based, integrated smoking cessation and alcohol intervention for smoking cessation in adolescents: results of a cluster-randomised controlled trial. J Subst Abuse Treat 2017 Nov;82:55-66. [CrossRef]
- Haug S, Schaub MP, Venzin V, Meyer C, John U. Efficacy of a text message-based smoking cessation intervention for young people: a cluster randomized controlled trial. J Med Internet Res 2013 Aug 16;15(8):e171 [FREE Full text] [CrossRef] [Medline]
- Businelle MS, Ma P, Kendzor DE, Frank SG, Vidrine DJ, Wetter DW. An ecological momentary intervention for smoking cessation: evaluation of feasibility and effectiveness. J Med Internet Res 2016 Dec 12;18(12):e321 [FREE Full text] [CrossRef] [Medline]
- Borland R, Balmford J, Benda P. Population-level effects of automated smoking cessation help programs: a randomized controlled trial. Addiction 2013 Mar;108(3):618-628. [CrossRef] [Medline]
- Suffoletto B. Text message behavioral interventions: from here to where? Curr Opin Psychol 2016 Feb 1;9:16-21. [CrossRef] [Medline]
- Perski O, Blandford A, West R, Michie S. Conceptualising engagement with digital behaviour change interventions: a systematic review using principles from critical interpretive synthesis. Transl Behav Med 2017 Jun;7(2):254-267. [CrossRef] [Medline]
- Heminger CL, Boal AL, Zumer M, Abroms LC. Text2Quit: an analysis of participant engagement in the mobile smoking cessation program. Am J Drug Alcohol Abuse 2016 Jul;42(4):450-458. [CrossRef] [Medline]
- Christofferson DE, Hertzberg JS, Beckham JC, Dennis PA, Hamlett-Berry K. Engagement and abstinence among users of a smoking cessation text message program for veterans. Addict Behav 2016 Nov;62:47-53. [CrossRef] [Medline]
- Strecher VJ, McClure J, Alexander G, Chakraborty B, Nair V, Konkel J, et al. The role of engagement in a tailored web-based smoking cessation program: randomized controlled trial. J Med Internet Res 2008 Nov 4;10(5):e36 [FREE Full text] [CrossRef] [Medline]
- Schwarzer R, Satow L. Online intervention engagement predicts smoking cessation. Prev Med 2012 Sep;55(3):233-236. [CrossRef] [Medline]
- Richardson A, Graham AL, Cobb N, Xiao H, Mushro A, Abrams D, et al. Engagement promotes abstinence in a web-based cessation intervention: cohort study. J Med Internet Res 2013 Jan 28;15(1):e14 [FREE Full text] [CrossRef] [Medline]
- Balmford J, Borland R. How do smokers use a smoking cessation text messaging intervention? Nicotine Tob Res 2014 Dec;16(12):1586-1592. [CrossRef] [Medline]
- Saul JE, Amato MS, Cha S, Graham AL. Engagement and attrition in Internet smoking cessation interventions: insights from a cross-sectional survey of “one-hit-wonders”. Internet Interv 2016 Sep;5:23-29. [CrossRef]
- Gmel G, Kuendig H, Notari L, Gmel C. [Addiction monitoring Switzerland: Use of alcohol, tobacco and illegal drugs in Switzerland, data 2015]. Lausanne: Sucht Schweiz; 2016. URL: http://www.suchtmonitoring.ch/docs/library/gmel_thezckxvvkq4.pdf [accessed 2017-10-02] [WebCite Cache]
- Schwarzer R. Modeling health behavior change: how to predict and modify the adoption and maintenance of health behaviors. Appl Psychol 2008 Jan;57(1):1-29. [CrossRef]
- Ybarra ML, Prescott TL, Holtrop JS. Steps in tailoring a text messaging-based smoking cessation program for young adults. J Health Commun 2014 Dec;19(12):1393-1407. [CrossRef] [Medline]
- Haug S, Castro RP, Filler A, Kowatsch T, Fleisch E, Schaub MP. Efficacy of an Internet and SMS-based integrated smoking cessation and alcohol intervention for smoking cessation in young people: study protocol of a two-arm cluster randomised controlled trial. BMC Public Health 2014 Nov 5;14:1140 [FREE Full text] [CrossRef] [Medline]
- Filler A, Kowatsch T, Haug S, Wahle F, Staake T, Fleisch E. MobileCoach: a novel open source platform for the design of evidence-based, scalable and low-cost behavioral health interventions: overview and preliminary evaluation in the public health contexts. 2015 Presented at: Wireless Telecommunications Symposium (WTS), 2015; April 15-17, 2015; New York URL: http://cocoa.ethz.ch/downloads/2015/06/2120_WTS-2015-MobileCoach-final_2.pdf [CrossRef]
- Euro.who.int. Copenhagen: WHO Regional Office for Europe; 2016. Health behaviour in school-aged children (HBSC) study: International Report from the 2013/2014 survey Internet URL: http://www.euro.who.int/__data/assets/pdf_file/0003/303438/HSBC-No.7-Growing-up-unequal-Full-Report.pdf?ua=1 [accessed 2017-10-02]
- Collins RL, Parks GA, Marlatt GA. Social determinants of alcohol consumption: the effects of social interaction and model status on the self-administration of alcohol. J Consult Clin Psychol 1985 Apr;53(2):189-200. [Medline]
- Gabadinho A, Ritschard G, Müller NS, Studer M. Analyzing and visualizing state sequences in R with TraMineR. J Stat Soft 2011;40(4):1-37. [CrossRef]
- Lê S, Josse J, Husson F. FactoMineR: an package for multivariate analysis. J Stat Soft 2008;25(1):1-18. [CrossRef]
- Studer M. WeightedCluster library manual: a practical guide to creating typologies of trajectories in the social sciences with R. LIVES Work Pap 2013;2013(24):1-32. [CrossRef]
- Hosmer DW, Lemeshow S, Sturdivant RX. Applied Logistic Regression. New York: John Wiley & Sons; 2013.
- Bates D, Mächler M, Bolker B, Walker S. Fitting linear mixed-effects models using lme4. J Stat Soft 2015;67(1):1-48 [FREE Full text] [CrossRef]
- Melzer J, Rißling JK, Petermann F. [Influence of nonverbal intelligence and migration background on language abilities]. Gesundheitswesen 2015 Oct;77(10):793-798. [Medline]
- Ames SC, Werch CE, Ames GE, Lange LJ, Schroeder DR, Hanson AC, et al. Integrated smoking cessation and binge drinking intervention for young adults: a pilot investigation. Ann Behav Med 2010 Dec;40(3):343-349 [FREE Full text] [CrossRef] [Medline]
- Ames SC, Pokorny SB, Schroeder DR, Tan W, Werch CE. Integrated smoking cessation and binge drinking intervention for young adults: a pilot efficacy trial. Addict Behav 2014 May;39(5):848-853. [CrossRef] [Medline]
- Paz Castro R, Haug S, Kowatsch T, Filler A, Schaub MP. Moderators of outcome in a technology-based intervention to prevent and reduce problem drinking among adolescents. Addict Behav 2017 Sep;72:64-71. [CrossRef] [Medline]
- Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [Medline]
- Yardley L, Spring BJ, Riper H, Morrison LG, Crane DH, Curtis K, et al. Understanding and promoting effective engagement with digital behavior change interventions. Am J Prev Med 2016 Nov;51(5):833-842. [CrossRef] [Medline]
- Whitton AE, Proudfoot J, Clarke J, Birch MR, Parker G, Manicavasagar V, et al. Breaking open the black box: isolating the most potent features of a web and mobile phone-based intervention for depression, anxiety, and stress. JMIR Ment Health 2015 Mar 4;2(1):e3 [FREE Full text] [CrossRef] [Medline]
|ASW: average silhouette width|
|CCA: complete case analysis|
|CPD: cigarettes smoked per day|
|CPW: cigarettes smoked per week|
|DE: decreasing engagement|
|HAPA: health action process approach|
|OM: optimal matching|
|OR: odds ratio|
|RCT: randomized controlled trial|
|SD: standard deviation|
|SE: stable engagement|
|SE: standard error|
|SNE: stable nonengagement|
Edited by G Eysenbach; submitted 16.06.17; peer-reviewed by R Schwarzer, S Hermsen; comments to author 02.08.17; revised version received 07.09.17; accepted 07.09.17; published 01.11.17
©Raquel Paz Castro, Severin Haug, Andreas Filler, Tobias Kowatsch, Michael P Schaub. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 01.11.2017.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.