Advertisement: Preregister now for the Medicine 2.0 Congress
Multilevel Growth Curve Analyses of Treatment Effects of a Web-Based Intervention for Stress Reduction: Randomized Controlled Trial
Filip Drozd1,2, MPhil; Sabine Raeder2, PhD; Pål Kraft1,2, PhD; Cato Alexander Bjørkli2, PhD
1Research and Development, Changetech AS, Oslo, Norway
2Department of Psychology, University of Oslo, Oslo, Norway
Research and Development
Phone: 47 97516188
Fax: 47 22604427
Background: Stress is commonly experienced by many people and it is a contributing factor to many mental and physical health conditions, However, few efforts have been made to develop and test the effects of interventions for stress.
Objective: The aim of this study was to examine the effects of a Web-based stress-reduction intervention on stress, investigate mindfulness and procrastination as potential mediators of any treatment effects, and test whether the intervention is equally effective for females as males, all ages, and all levels of education.
Methods: We employed a randomized controlled trial in this study. Participants were recruited online via Facebook and randomly assigned to either the stress intervention or a control condition. The Web-based stress intervention was fully automated and consisted of 13 sessions over 1 month. The controls were informed that they would get access to the intervention after the final data collection. Data were collected at baseline and at 1, 2, and 6 months after intervention onset by means of online questionnaires. Outcomes were stress, mindfulness, and procrastination, which were all measured at every measurement occasion.
Results: A total of 259 participants were included and were allocated to either the stress intervention (n=126) or the control condition (n=133). Participants in the intervention and control group were comparable at baseline; however, results revealed that participants in the stress intervention followed a statistically different (ie, cubic) developmental trajectory in stress levels over time compared to the controls. A growth curve analysis showed that participants in the stress intervention (unstandardized beta coefficient [B]=–3.45, P=.008) recovered more quickly compared to the control group (B=–0.81, P=.34) from baseline to 1 month. Although participants in the stress intervention did show increases in stress levels during the study period (B=2.23, P=.008), long-term stress levels did decrease again toward study end at 6 months (B=–0.28, P=.009). Stress levels in the control group, however, remained largely unchanged after 1 month (B=0.29, P=.61) and toward 6 months (B=–0.03, P=.67). Mediation analyses showed nonlinear (ie, cubic) specific indirect effects of mindfulness and a linear specific indirect effect of procrastination on stress. In simple terms, the intervention increased mindfulness and decreased procrastination, which was related to lower stress levels. Finally, the effect of the stress intervention was independent of participants’ gender, age, or education.
Conclusions: The results from this randomized controlled trial suggest that a Web-based intervention can reduce levels of stress in a normal population and that both mindfulness and procrastination may be important components included in future eHealth interventions for stress.
Trial Registration: International Standard Randomized Controlled Trial Number (ISRCTN): 25619675; http://controlled-trials.com/ISRCTN25619675 (Archived by Webcite at http://www.webcitation.org/6FxB1gOKY)
(J Med Internet Res 2013;15(4):e84)
stress, multilevel modeling, randomized controlled trial, mindfulness, procrastination, multiple mediation, multiple moderation, Web
Symptoms of stress, such as fatigue, mood changes, and muscle pain, are very common in the general population. More than 90% of the Norwegian population reported having several such symptoms during the past 30 days . According to an international survey, approximately 75% of the general population in developed countries report feeling stressed on a daily basis . Furthermore, the most recent Stress in America survey conducted by the American Psychological Association  shows that more than half of the American population report that they recognize when they are feeling stressed; however, less than 1 in 3 report successfully managing their stress levels.
For most people, stress may be perceived as such a minor problem that it does not require any treatment seeking or professional assistance . However, major savings in health care costs can be achieved by reducing stress levels or eliminating some of the subjective health complaints. Although the psychobiological mechanisms remain elusive, stress is a risk factor for a wide range of mental and physical health problems, such as cardiovascular disease , diabetes , and depression . In fact, of all the health conditions predicted by the World Health Organization as having the greatest disease burden by 2030 , many have a common contributing underlying factor of stress as either causing or exacerbating disease. Moreover, as many as 40% to 50% of work-related illnesses are related to stress [9,10]. Consequently, it is important to reduce stress in the general population, but this requires scalable interventions with a potentially high reach.
Systematic reviews demonstrate that face-to-face stress-reduction interventions are effective for reducing stress and various health problems [11-14], but their scalability is limited. On the other hand, eHealth interventions have the scalability potential to reach the general population; however, only a small number of studies have focused on stress reduction. Research has mostly focused on posttraumatic stress  or stress as a component in interventions primarily aimed at other health problems, such as diabetes  or alcohol use .
Web-Based Stress-Reduction Interventions
Most eHealth interventions for stress in the general population have been evaluated in workplace settings and have shown varying results. The earliest studies have documented intervention effects for anxiety and depression , stress responses and job satisfaction , and beneficial psychophysiological effects on stress . More recent studies have failed to find any effects on stress [21,22], and a few studies that compared Web-based versus therapist-supported stress management interventions demonstrated only short-term and small effects on stress [23,24].
Studies outside of the workplace setting have shown more unequivocal results. Two studies reported improved outcomes for Web-based family or parental stress interventions [25,26], whereas 2 other studies found reduced health distress among participants with various chronic diseases [27,28]. Another study that recruited participants through the Internet and newspaper articles also observed greater improvements in the treatment group .
A few studies have also evaluated the impact of stress management as an add-on component to existing eHealth interventions. These studies, however, showed varying results just like Web-based stress-reduction interventions in workplace settings. Christensen et al  did not find any additional contribution of stress reduction for depression, whereas Richards et al  found only short-term effects of adding stress management for panic disorder. Prochaska and colleagues  demonstrated that the add-on of a tailored component to a brief health risk intervention increased the number of participants that were effectively managing their stress.
Mechanisms of Change
One reason why findings on Web-based interventions for stress are inconsistent, may be the “black box” phenomenon, or lack of understanding as to how and why some interventions work or do not work. Therefore, it is important to investigate the role of potential mediators and moderators of treatment effects. In this study, the Web-based stress-reduction intervention made use of 2 central intervention components—mindfulness and procrastination—both of which are associated with stress.
Mindfulness involves being in the present moment and accepting thoughts and feelings as they occur in a nonjudgmental way . A meta-analysis has shown that mindfulness can have a broad range of health benefits  and that mindfulness-based stress-reduction interventions are generally effective . It appears that mindfulness mediates the effect of interventions on stress  and it is associated with higher levels of self-regulation  which can facilitate deliberate actions to regulate behavior  and lessen avoidant coping [38,39]. The latter is a form of procrastination that is characterized by a voluntary extension of the temporal sequencing between an intended course of action and goal-directed behavior, despite one’s expectation of being worse off than before the delay . Numerous studies have shown the negative effects of procrastination, including its relationship to stress . According to the procrastination-health model, procrastination creates unnecessary stress and delays the onset of health promoting behaviors . It is a strategy that brings immediate, albeit temporary, relief from unpleasant or distressing events , but ultimately the event remains unresolved.
Temporal dimensions are clearly important to mindfulness, procrastination, and stress, although few theories explicitly specify changes that occur over time or time as a cause of changes in any of these constructs. For example, the key characteristic of mindfulness is a temporal orientation at the present moment that requires a temporal and attentional shift to a state of awareness. However, the temporal course of changes in mindfulness has not yet been fully explored. Studies on procrastination, on the other hand, have indicated that procrastinators experience less stress early on, but more stress closer to a deadline as compared to nonprocrastinators . More recent studies have investigated temporal changes in procrastination using growth curve approaches, and most suggest that procrastination is characterized by a hyperbolic or quadratic function . It is also reasonable to assume that the development of stress changes over time. Daily hassles or acute experiences of stress (ie, meeting a deadline, car trouble, or negative affect) that typically affect a person within hours on the same day of occurrence, are highly transient and rarely affect a person the next day as major stressful life events . Thus, modeling time as an independent variable is important and allows one to represent change or the dynamic relationships between variables, although it remains elusive as to what kind of developmental trajectories one can expect over the course of time in intervention settings.
Moderating Effects on Stress
In addition to identifying mechanisms of change over time, one may expect variations in intervention efficacy among participants (eg, not all participants improve). Thus, it is interesting to identify participants who benefit the most or participants for who the intervention shows contraindications. For example, the effects of the Web-based intervention on stress responses and job satisfaction, as mentioned previously, were shown particularly effective among males and younger employees . In terms of stress, demographic differences between participants, such as gender, age, and education, can be expected to have varying intervention effects. The reason is that there are demographic differences in stress and how people manage their stress. In general, women report higher levels of stress compared with men . This can be due to women’s multiple roles  or the fact that the roles (eg, caregiving) typically assigned to women are stressful . When it comes to age, people use more problem-focused coping strategies and less avoidance coping strategies as they grow older [50,51]. People also develop the ability to self-regulate emotions when dealing with stress as their age increases . This may explain why researchers have found that adults in their 20s report more perceived stress than those in their 50s . But with education, the picture is less clear. A recent large survey demonstrated that work-related stress is associated with higher education , whereas previous studies have shown that lower education is a risk factor for stress [55,56].
Aims of the Study
This study aimed to test whether treatment was predictive of participants’ initial status and different trajectory changes in stress across time. First, it was hypothesized that participants in the Web-based stress-reduction intervention would exhibit lower stress scores at the end of the treatment compared to the beginning, as measured by log server registrations. Second, it was hypothesized that the intervention would reduce levels of stress as measured by online survey data over a period of 6 months as compared to a control group. The control group was expected to remain at approximately the same stress level throughout the study period. Third, the effect of the intervention was expected to be, at least, partially mediated by mindfulness and procrastination over time. Finally, the effect of the intervention was examined with respect to moderating effects of gender, age, and education on the treatment effect on stress over the study period.
The study was a randomized controlled trial consisting of 2 groups to test the effectiveness of a Web-based stress management intervention. Participants were randomized either to the fully automated Web-based Less Stress (LS) intervention or a waitlist control group to test for the natural course of participants’ levels of stress. No unexpected events occurred after the commencement of the intervention (eg, bug fixes, downtimes, email delivery service failures, content changes). Participants in the control group received the intervention after the final data collection. The trial received its ethical approval by the Norwegian Social Science Data Services (reference number: 26816).
Participants and Recruitment
The study was a Web-based trial without any face-to-face components as part of the recruitment procedure, intervention, or follow-up. Participants were recruited online through a master’s student’s social network on Facebook. In total, 320 first-degree contacts were invited to participate and forward the invitation to their network (ie, viral recruitment).
Potential participants clicked on a link posted on Facebook and were redirected to an external website containing study information and a consent form. Participants had to confirm that they had read the study information and submit the informed consent before they could proceed to the Web-based baseline questionnaire. Eligible participants were implicitly required to (1) read and understand Norwegian, (2) explicitly state that they were 18 years or older, and (3) fill in their email address.
A total of 326 participants were assessed for eligibility. Sixty-five (19.9%) participants did not provide a (valid) email address, and 2 (0.6%) participants reported being younger than 18 years. These 67 (20.6%) potential participants were excluded before randomization. The final sample size that was randomized consisted of 259 participants.
Every participant had an equal probability of being assigned to either the LS or control group. The allocation ratio was set to 1:1 and a series of zeros and ones were generated for each participant using a random integer generator . Because recruitment was carried out through a private and social online network and participants were potentially identifiable through their email addresses, another research member on the team conducted the randomization procedure. This was done to avoid experimenter biases interfering with the randomization. As an extra precaution, email addresses were concealed during randomization.
The LS intervention is a fully automated and Web-based intervention developed for people who feel stressed or experience a lot of negative emotions (for screenshots, see Figure 1). Its objective is to have users learn about stress, build awareness of sources of stress, and prevent or manage prolonged or high levels of stress. LS uses an eclectic approach and includes evidence-based information and exercises that have been documented to be directly or indirectly effective for stress management, such as mindfulness  and metacognitive exercises . The LS intervention consists of 13 sessions over a period of 4 weeks. Every Monday, Wednesday, and Friday, users receive an email with a unique hyperlink. By clicking on the hyperlink, users are directed to a sequence of Web pages that are unique for that particular session. Every session is designed to take approximately 10 minutes to complete. It is a prerequisite that the user completes a session successfully before proceeding to the next session. In this way, the user proceeds through a predetermined therapeutic chronology of sessions with restricted degrees of freedom (ie, tunneled design). For a demonstration, see .
Each session contains 2 components. The first component is psychoeducational and addresses some stress-related topics (see Table 1). The second section provides users with techniques, exercises, and homework designed to address the particular topic presented in the psychoeducational section. Psychoeducational information is presented by a young male agent, whereas tasks and exercises are presented by a young female, both accompanied by text designed in such a way “as if they were talking”. The role of the personal computer agent equals that of a domain expert that guides the user. In this way, knowledge and information are represented in a form that is presumably similar to that of a human therapist or expert. Text is presented in short sentences and with a limited amount of text per Web page (approximately 80 words). Techniques and exercises often include audio files (eg, guided instructions for mindfulness exercises) and are often given in the form of home assignments (eg, keep postponing worries to a scheduled time of the day). See Table 1 for a more thorough overview of the contents in LS.
Data Collection and Measures
Data were collected at baseline (ie, preintervention), and at 1, 2, and 6 months postintervention by means of Web-based surveys. Participants were given 2 weeks to register their responses at each measurement occasion. A reminder email was sent to all nonresponders after 1 week. Log server registrations were also used to collect data on participants in the LS intervention and extracted at the final data collection at 6 months.
Stress was assessed by the stress subscale of the Depression Anxiety and Stress Scale (DASS-S)  at every measurement occasion. The DASS-S is a 7-item measure that assesses the severity of the core symptoms of tension (ie, stress) in the past 7 days developed for use with population samples (eg, “I found it difficult to relax”). In the current study, the Cronbach alpha coefficients were .87, .89, .90, and .89 for baseline, 1, 2, and 6 months, respectively. The DASS-S was the primary outcome for the main analyses.
Stress was also assessed in the LS intervention by means of log server registrations as part of the regular intervention. This scale (constructed by the intervention designers by compiling items from several stress measures) consisted of 20 items, such as “I often feel I have too much to do” and “I often set too high personal goals” measured on a 5-point Likert scale (1 = strongly disagree, 5 = strongly agree). The Cronbach alphas were .92 and .93 in sessions 1 and 13, respectively.
The Mindful Attention Awareness Scale (MAAS)  assesses the frequency of being aware of what is occurring in the present moment at each repeated measurement. The MAAS is a 15-item scale that was reduced to 10 items for this study. One item was dropped (“...do jobs or tasks automatically, without being aware...”) because it was very similar in Norwegian language to another item that was retained (“...running on automatic, without much awareness...”). Four other items were dropped because the intervention was not developed to tap into these (ie, breaking things, forgetting a person’s name, mindless snacking, and excessive goal focus). The Cronbach alphas in this study were .90, .91, .93, and .92 for each measurement occasion from baseline throughout 6 months, respectively.
Procrastination was measured by the procrastination subscale of the Melbourne Decision Making Questionnaire (MDMQ-P)  at each measurement occasion. The MDMQ-P is a 5-item measure of the tendency to avoid decision making (eg, “When I have to make a decision, I wait a long time before starting to think about it”). Its Cronbach alphas were .92, .92, .93, and .94 for baseline, 1, 2, and 6 months, respectively, in this study.
An alpha level of .05 was chosen for all tests and all tests were 2-tailed. To check for baseline differences between groups, t tests were used for scales and chi-square (χ2) tests for categorical data. All χ2 tests that were based on a 2 × 2 contingency table applied the Yates’ continuity correction.
Normality was assessed by means of skewness, kurtosis, and inspection of histograms, with plotted normality curves as visual aids, separately for each treatment group. Skewness was ≤1.43 for the LS group and ≤1.04 for the control group. Kurtosis was ≤4.04 and ≤1.77 for the LS and control group, respectively. This indicates moderate skewness and kurtosis; thus, it was decided not to perform any transformations on data in interest of interpretability.
There were no concerns about violation of homogeneity of variance or variance-covariance matrices with Fmax ratios ≤1.25. Two participants had excessive z scores of ±3.29 (P<.001, 2-tailed test) on stress at 1 month in the imputed datasets 1 through 5; however, both participants were retained in the dataset as the influence of outliers on mean scores was less than 1.11% after trimming the means by 5%. There were no multivariate outliers as tested by the Mahalanobis distance (D) separately for the LS (D6≤19.83) and control group (D4≤13.72) with P<.001.
There were 113 (43.6%) participants that participated on all measurement occasions; hence, many participants had missing data. Thus, a 2-group multiple imputation (MI) procedure was applied to construct 5 complete datasets for the main analyses (ie, data were imputed separately for the LS and control group) . Auxiliary demographic variables, such as gender, age, education, and intervention adherence, were included in the imputation model to avoid suppressed correlations. Intervention adherence was included in the imputation model for the LS group only. Otherwise, the imputation model was identical for both groups.
Data were longitudinally nested within 2 hierarchical levels, in which time was nested within participants and defined as level 1, whereas participants were defined as level 2. Level 1 variables included the repeated measures of stress, mindfulness, and procrastination, and were measured at baseline and 1, 2, and 6 months. Level 2 variables included demographics and treatment assignment, and were only measured at baseline. All continuous predictors and covariates were centered on the grand mean before modeling.
A series of multilevel models with maximum likelihood estimation were run to analyze the main treatment effect, multiple mediation, and moderation analyses. The overall fit of the models was evaluated by the Akaike information criterion (AIC) and –2 log likelihood (–2LL) on a smaller-is-better basis. Moreover, comparison of nested models was also evaluated formally by a test of differences in –2LL over the difference in degrees of freedom by using an ordinary χ2 distribution. A significant difference indicates that the model with the lowest –2LL value fits data better. Analyses were run in SPSS version 20; however, SPSS does not provide pooled model fit indexes in mixed models. Therefore, the median model fit indexes of the 5 imputed datasets are reported. Finally, a pseudo-multivariate coefficient of determination (R2) was calculated to account for the variation between participants in the final main, mediation, and moderation models. Analyses were also conducted separately with available case analysis. Both procedures produced similar results; thus, only data for the imputed sets are reported.
[view this table]
|Table 1. Overview of program sessions in the Less Stress intervention.|
[view this figure]
|Figure 1. Screenshots from the Less Stress intervention.|
The flow of participants is depicted in Figure 2. A total of 259 people were eligible for participation and randomized to either the LS intervention or control group. A total of 34 (27.0%) participants in the intervention group discontinued study participation or intervention. Most did not give any reasons for discontinuation, but a few people mentioned reasons such as mail delivery failure (n=2), lack of time (n=2), pregnancy (n=1), too extensive to participate (n=1), and too much to do at work (n=1). Only 3 people provided reasons as to why they discontinued the LS intervention, ie, lack of time (n=2) and too extensive (n=1). Cumulative losses (ie, loss to follow-up on at least 1 previous follow-up) are shown in curly brackets in Figure 2. Note that participants who discontinued the LS intervention were approached for data collection, although 26 (76.5%) of the 34 intervention dropouts were also lost to follow-up.
There were no significant differences between participants in the LS and control group at baseline (Table 2). However, there were more women (76.0% vs 24.0% males, P<.01) and participants with ≤1-3 years of college or university education (59.1% vs 40.9% ≥4-5 years of college or university education, P<.01) in the total sample. Most were not acquainted with the recruiter (80.3% vs 19.7% acquainted, P<.01) indicating that viral recruitment through Facebook was successful in reaching participants beyond the researcher’s first-degree contacts.
[view this figure]
|Figure 2. Flowchart of participants.|
[view this table]
|Table 2. Baseline sample characteristics by group, Less Stress (LS) intervention and control.|
Attrition and Missing Data
The number of respondents to the follow-up surveys in the total sample were 152 (58.7%), 140 (54.1%), and 133 (51.4%) for 1, 2, and 6 months, respectively. The number of respondents within the LS group was 62 (49.2%), 58 (46.0%), and 53 (42.1%) across the 3 follow-up measurements, and 90 (67.7%), 82 (61.7%), and 80 (60.2%) in the control group. Between-group differences in dropout rates at 1-month (χ21=8.4, P=.004), 2-month (χ21=5.7, P=.017), and 6-month (χ21=7.8, P=.005) follow-up, were significant. Hence, selective attrition is a potential problem regarding the interpretation of levels of stress over the study period. Further, it turned out that the proportion of missing data in the total sample ranged from 0% to 3.5% at baseline and from 42.9% to 52.1% at follow-up (ie, missing data due to item or wave nonresponse). Despite this, Little’s overall test of randomness indicated that the distribution of missing data was not predictable for the LS group (χ2145=172.2, P=.06) and that data for the control group also could be classified as missing completely at random (χ2154=158.3, P=.39).
Due to these potential problems, the effects of selective attrition on means, variances, and relationships among variables used in subsequent longitudinal analyses of treatment effects were assessed, following the procedure described by Goodman and Blum . Because there was little attrition in the study from 1 to 6 months, selective attrition was assessed on the basis of study dropout from baseline to 1 month. The results showed no mean differences between study dropouts and stayers at baseline (-0.59 ≤ t ≤0.63, all P values ≥.53). There were also no significant differences in variances using the normal approximation to chi-square  in the total sample to those who stayed (-1.91 < z <0.36, all P values >.06). In other words, selective attrition did not affect the means or variances. However, testing the relationship among variables with multiple regression analyses on stress in the total sample and stayers separately found gender to be a significant predictor of stress at baseline for the total sample (unstandardized beta coefficient [B]=1.40, P=.01), but not among stayers (B=0.63, P=.44). An independent samples t test revealed that males (mean 5.4, SD 3.7) had lower stress scores than females at baseline (mean 7.7, SD 4.8; t130=–3.96, P<.001). Despite that substantial study dropout led to selective attrition, only the relationship between gender and stress was affected. Thus, we can be confident that, other than gender, participant attrition will not affect the results in this study.
Intervention Use, Acceptance, and Effect
A total of 126 subjects were registered for the LS intervention, of which 92 (73.0%) engaged with LS (ie, initiated use) and 47 (38.5%) completed all 13 sessions. On average, participants completed 6.82 (SD 5.70) sessions and spent 1 hour and 6 minutes (SD 46) on LS. Time spent on LS was below estimated time needed for optimal adherence per session (13 sessions × 10 minutes per session=2 hours and 10 minutes) as tested by a 1-sample t test (t91=–13.27, P<.001).
Of the 49 (38.9%) participants that reported data on intervention acceptance at 1 month, LS seemed well received among most. Of these, 41 (83.7%) reported that they believed LS to be “useful to me” whereas 8 (16.3%) participants either disagreed or were indifferent with LS being “useful to me.” Thirty-five (71.4%) participants would recommend LS to others, 10 (20.4%) would neither recommend LS to others or not, whereas 4 (8.2%) users reported that they would not recommend LS to others. Moreover, 46 (89.7%) participants agreed that LS was “easy to use.”
The first hypothesis was that participants in the LS intervention would have lower stress scores at session 13 compared to session 1, as measured by log server registrations. A paired-samples t test showed that participants in the LS group had significantly reduced their stress level from session 1 (mean 65.74, SD 13.71) to session 13 (mean 51.91, SD 13.12; t46=7.54, P<.001) as measured by the test of stress levels in the intervention. This equals a large effect size (Cohen’s d=1.10).
Main Effects Analysis
Tables 3 and 4 present the uncentered correlations among study variables from level 1 (ie, repeated measures) and level 2 (ie, participants), respectively. Separate correlation tables for level 1 and level 2 variables were included to avoid aggregation or disaggregation of data. As can be seen in Table 3, all measures of stress, mindfulness, and procrastination correlated significantly at each measurement occasions (all P values ≤.002). Stress correlated negatively with mindfulness and positively with procrastination, and mindfulness correlated negatively with procrastination, as expected.
The main hypothesis concerned the comparison of trajectories in stress levels in the LS group and the control group. It was expected that participants in the LS group would reduce levels of stress over a period of 6 months compared to the control group, which would remain at approximately the same stress level throughout. The main effects from the multilevel regression analysis of stress levels are presented in Tables 5 and 6. Model 1 with the repeated measures only indicates that average levels of stress vary significantly across participants and over time. The intraclass correlation coefficient (ICC) was 0.34. This means that 34% of the variation in stress levels is attributable to interindividual differences. In other words, stress varies (naturally) over time for most participants; however, substantial proportions of the variation in stress levels can be attributed to differences between participants over time.
[view this table]
|Table 3. Correlations among level 1 variables.|
[view this table]
|Table 4. Correlations among level 2 variables.|
[view this table]
|Table 5. Results of functions of time on stress levels over six months.|
A series of multilevel models with a linear, quadratic, and cubic growth parameter were estimated separately to distinguish the natural or normative development of stress over measurement occasions from the treatment effect (ie, models 2-4 in Table 5). The negative estimate of linear growth in model 2 does indicate that, on average, participants experienced reductions in stress levels over time. A test of differences in model fit between model 2 and model 1 yielded a significant result (Δχ23=20.3, P<.001). A quadratic function of time was added in model 3 to capture any acceleration or deceleration in the rate of change that might occur over the repeated measurements. Results show that participants’ reductions in stress levels tended to accelerate slightly over time. Model 3 showed an improvement in model fit from model 2 at the 10% level (Δχ21=3.5, P=.06). The variation within groups over time decreased, the AIC value decreased, and the explained variance increased slightly (ie, R2) for model 3. Thus, it was decided to retain the quadratic function in further analyses. By including a cubic term in model 4, the rate of change in stress levels decelerated again and provided significant improvements in model fit (Δχ21=7.85, P=.005). Consequently, treatment effects had to be modeled with a linear, quadratic, and cubic growth parameter.
Model 5 with treatment as level 2 predictor shows that, after controlling for the natural development of stress over time, participants in the LS group had significantly lower stress levels as compared to the control group (see Table 6). A formal test of differences comparing models 5 and 4, demonstrated that model 5 fits data better than model 4 (Δχ21=9.4, P=.002). However, a test of differences in slopes or developmental trajectories between groups was first examined in model 6 that included cross-level interactions between treatment and normative growth over time. The results show that there was a significant interaction effect between treatment and the linear, quadratic, and cubic growth parameters which suggests that, on average, participants experienced reductions in their stress levels, but that participants in the LS group experienced a different developmental trajectory over and above the natural variation in stress over time (model 6 vs model 5: Δχ23=8.0, P=.046).
[view this table]
|Table 6. Results of treatment effects on stress levels over six months.|
To demonstrate the effect of treatment on initial status and the rate of change over time, Singer and Willett  proposed creating prototypical plots. Prototypical plots can be obtained by substituting the values of the treatment variable and time (ie, linear, quadratic, and cubic) variables in the final estimated model (ie, model 6): Yit=7.40 + (–0.81)(Time) + (0.29)(Time2) + (–0.03)(Time3) + (–0.40)(Treatment) + (–3.45)(Time × Treatment) + (2.23)(Time2 × Treatment) + (–0.28)(Time3 × Treatment), where Yit is the repeated measure of stress for person i at time t. The trajectories in Figure 3 demonstrate that the LS group experienced a more immediate and rapid reduction in stress levels as compared to the control group. Although stress levels increased from 1 to 2 months, stress levels returned to the 1-month level by 6 months. In comparison, the control group followed a more modest, steady, and nonsignificant linear decline in stress levels (ie, normative development).
Finally, 3 types of covariance structures relevant and common in studies with repeated measurements were tested. The purpose was to examine how errors were distributed and whether the properties imposed on the covariance structure fit well to the data. The unstructured covariance structure fit the data best as determined by having the lowest information criterion (AIC = 5663.27; compound symmetry AIC = 5678.61 and first-order autoregressive AIC = 5735.48). The assumption of the unstructured error covariance is that all parameters are estimated and allowed to vary freely. In other words, it is the least restrictive covariance structure. Estimates remained largely unchanged with an unstructured covariance structure and are thus not reported.
[view this figure]
|Figure 3. Fitted developmental trajectories for the control and LS group, respectively.|
Multiple Mediation Analysis
The third hypothesis was that changes in stress levels over time attributed to the LS intervention could be accounted for by changes in mindfulness and procrastination over time. The model-building approach suggested by Bliese and Ployhart  was used and a product-of-coefficients strategy was employed to test for multiple mediation effects of treatment on stress via mindfulness and procrastination [67-69]. In other words, the unstandardized beta coefficients for each mediator were multiplied to represent the different indirect effects. Furthermore, the Monte Carlo Method for Assessing Mediation (MCMAM), as described by MacKinnon et al , was applied to generate 95% confidence intervals for indirect effects with 20,000 bootstraps . The MCMAM performs reasonably well and can be implemented on the pooled estimates of multiply imputed datasets.
The total effect of treatment on stress was demonstrated previously in model 6 in Table 6 and found to be significant. So, the first step in the mediation analysis was to estimate an unconditional model (ie, model 7a) to test for variation between participants in mindfulness as a mediator over time (see Table 7). The ICC was 0.44, which indicated that average levels of mindfulness vary significantly across participants and over time; hence, a multilevel mediation analysis would be adequate. The next step was to determine the effect of treatment on mindfulness and the fixed functions for time, controlling for procrastination (ie, the second mediator), in a sequence of steps similar to models 2-5 in Tables 5 and 6, although only the final model is reported. Model 7b in Table 7 shows that there was a significant interaction effect between treatment and the linear, quadratic, and cubic growth parameters. This suggests that, on average, participants in the LS group experienced a different developmental trajectory over and above the natural variation in mindfulness over time, after controlling for procrastination.
The effect of treatment on procrastination was tested similarly. The ICC in the unconditional model 8a was 0.51 and suggested that average levels of procrastination vary significantly across participants and over time. Then the effect of treatment on procrastination and the fixed functions for time, controlling for mindfulness was determined. The final model providing the best-fit indexes suggested that treatment had a quadratic effect on procrastination. On average, participants in the LS group did experience a significant decrease in procrastination, although levels of procrastination seemed to increase slightly over time.
Finally, model 9 examined whether the direct effect of treatment on stress was reduced. The results show that mindfulness and procrastination as a set do mediate the effect of treatment on stress levels (see Figure 4). A comparison of the final 2-mediator model (ie, model 9) indicates that this model fit data better than model 6 of the treatment effect (Δχ22=279.1, P<.001). However, in contrast to model 6 of the treatment effect, an examination of the distribution of errors showed that the best fitting covariance structure was that of compound symmetry (AIC = 5399.26; unstructured AIC = 5403.44 and first-order autoregressive AIC = 5434.60). The assumption of compound symmetry suggests that variances and covariances across the repeated measures were equal.
In simplified terms, the directions of the paths in Table 7 can be interpreted such that the LS intervention leads to greater mindfulness and, in turn, leads to lower stress over time. It also appears that the LS intervention leads to less procrastination, which appears to lead to slightly higher stress over time. An examination of the specific indirect effects in Table 8 indicates that all the specific indirect effects of mindfulness are significant; however, it appears that only the linear specific indirect effect of procrastination is significant. The 95% confidence interval for the quadratic specific indirect effect of procrastination ranged from 0.00 to 0.04 and does not seem to contribute to the indirect effect.
Multiple Moderation Analysis
The final hypothesis was concerned with examining any moderating effects of gender, age, and education on the treatment effect of the LS intervention on stress scores over time. A reference model of the normative growth and treatment effect was modeled previously (see model 6 in Table 6). Consequently, the first step in the multiple moderation analysis was to model the main effects of gender, age, and education conditional on the normative growth and treatment effects (see model 9 in Table 9). The results show that gender and age had a significant contribution above and beyond normative development and treatment effect on stress. Female participants had higher stress levels than males, whereas stress levels decreased slightly with age. There were, however, no main effects of education. A comparison of model 9 with the addition of the moderators to model 6 of the treatment effects (see Table 6), demonstrated that model 9 performed better (Δχ23=17.7, P<.001).
The next step was to model the interaction effects between treatment and gender, age, and education, respectively (see model 10 in Table 9). All 3 interaction terms were added simultaneously to adjust for multiple statistical tests and to estimate conditional interaction effects. Results show no interaction effects between treatment and the moderators and no overall improvement in model fit over model 9 (Δχ23=6.4, P=.09). Finally, a model with interactions between linear growth and all other variables were included to determine whether development was consistent across levels of the other variables (ie, determine time-specific interaction effects; see model 11). Three-way interactions were also included between linear development and other 2-way interactions to test for parallel slopes. Again, there was a significant effect of gender and age on stress over and above the treatment effect, and education also had a significant main effect on stress this time (ie, higher education was related to lower stress). However, although model 11 had improved model fit indexes compared to model 10 (Δχ26=24.7, P<.001), none of the interactions contributed substantially to the model.
In conclusion, model 9 appears to be the most parsimonious model in which the unstructured covariance structure fit the data best (AIC = 5609.71; compound symmetry AIC = 5678.61 and first-order autoregressive AIC = 5735.48). Estimates remained largely unchanged with an unstructured covariance structure and are not reported.
[view this figure]
|Figure 4. The estimated dynamic multiple mediation model with unstandardized beta coefficients.|
[view this table]
|Table 7. The effects of treatment and mindfulness and procrastination on stress levels over time.|
[view this table]
|Table 8. Specific indirect effects of mindfulness and procrastination on the effect of treatment on stress over time.|
[view this table]
|Table 9. Results of multilevel analysis: multiple moderation.|
Despite the fact that stress is experienced by many people and that stress is a contributing factor to many mental and physical health conditions, few efforts are made to develop and test the effects of interventions for stress. Findings from this study suggest that Web-based interventions can potentially reduce levels of stress. First of all, analysis of log server registrations found large reductions of the LS intervention on levels of stress among intervention completers. Second, treatment was a significant predictor of linear, quadratic, and cubic changes in stress, but not associated with initial status (see model 6 in Table 6). For the linear slope of stress, participants in the LS group showed a faster recovery from stress, although they also had a faster rate of change in stress (ie, increase, quadratic growth) when compared to the control group. Lastly, the LS group had a slower rate of cubic change in stress levels (ie, decrease) than the control group. In other words, despite variations in stress levels, long-term (ie, 6 months) stress levels returned to the level of the immediate short-term effect at 1 month in the LS group. This implies that participants learned ways of managing their stress levels during the course of the intervention that they carried on with them and used to lower their stress levels over time.
There are a limited number of Web-based stress interventions although there is great variability in terms of intervention content and the methods used to evaluate these [18-32]. However, to the extent that there are similarities between some of the studies, it seems that interventions outside of workplace settings (eg, general or family setting) have shown more unequivocally positive findings. It also appears that the single-target interventions are more likely to have an effect on stress  than multitarget interventions (eg, dietary behaviors and stress) [23,24]. In some studies, it is not unreasonable to assume that, for example, a small sample may have affected the results  or that a high attrition rate was not sufficiently addressed . In contrast to studies which have shown no or only short-term effects, this study has a reasonably high number of participants and data points, addressed attrition and missing data, and examined a single-target intervention in a general setting whose only aim is to reduce levels of stress.
Treatment accounted for approximately 5% of the variation in stress levels across time within participants (ie, 5% of the overall variability in stress is explained by the LS intervention). However, relatively modest treatment effects need not be a problem for eHealth interventions. The distribution of many psychological treatments is concentrated on a large effect for relatively few patients. However, eHealth technologies have the potential to shift this balance. Online consumer behavior suggests that by creating a longer tail in the distribution of eHealth interventions (ie, reaching more users), the market has the potential to substantially increase the collective effect of eHealth technologies . As such, even small and modest changes can be meaningful at the population level. It should, however, be noted that eHealth technologies have yet to reach a large number of users, in particular, the computer illiterate, those with lower incomes, and those without access to the Internet. Even in Norway where the access and use of the Internet is very high in the population, there are digital divides . For example, almost everyone with incomes above NOK 600,000 have Internet access at home, whereas 18% of those with incomes below NOK 200,000 are without Internet access.
This study has not only documented the effect of a Web-based intervention for stress reduction, but also identified its mechanisms of change. As expected and in-line with previous research , it turned out that mindfulness mediated the effect of the LS intervention. This is the first study that has examined the relationship between temporal changes in mindfulness and outcomes in an intervention setting. Overall, the results show that mindfulness can be successfully enhanced in Web-based interventions, but that momentary variations in mindfulness can be expected. The LS intervention also led to less procrastination that, in turn, reduced levels of stress as expected based on previous research . More specifically, the results indicate that the LS intervention successfully managed to interrupt the U-shaped (ie, quadratic) pattern of procrastination that can be expected to occur naturally over time . This means the LS intervention led to reduced procrastination that was maintained over time and participants did not, on average, experience the expected increases in procrastination.
Since there often are differences in stress by gender, age, and education, an important finding in this study is that the LS intervention seems to work equally well regardless of these demographic characteristics. In general, female participants reported higher levels of stress and participants that were older reported somewhat lower stress levels, but no demographic characteristics moderated the effect of the LS intervention. This does not mean that there are no psychological moderators of the effects of the LS intervention, for instance, but it may be that the LS intervention can provide a cost-efficient one-size-fits-all approach in terms of demographic characteristics. However, these findings (or lack thereof) should be interpreted with some caution, at least in regards to the result of the analyses of gender.
This study has several limitations. First, the sample in this study was based on viral recruitment on a social networking site (ie, Facebook). Earlier reviews have shown that Internet-based recruitment procedures have faced challenges in recruiting diverse samples . This may be a part of the reason 3 out of 4 participants in this study were women, albeit 80% of those recruited were not acquainted with the female recruiter. This may indicate other explanations of why more women were recruited, such as that more women generally participate in research or that more women are attracted to Web-based self-help interventions . In fact, a recent study did show success in recruiting a diverse sample using Facebook for a randomized controlled trial , which further supports the argument for alternative explanations for the gender bias in the recruitment procedure rather than viral online recruitment per se.
There were no reports of negative side effects of using Facebook for participant recruitment in this study; however, the use of social networking sites is an area in need of research and guidelines. Although most were not acquainted with the recruiter, they were acquainted with the person who told them about the study. Thus, a recommendation or study invitation from a friend would have more impact than from a researcher. This also raises ethical issues concerning confidentiality and security in research with peer-to-peer recruitment, but also because websites, such as Facebook, frequently change or update their privacy policies, many of which have been highly controversial. Therefore, it is of utmost importance to carefully consider the recruitment and communication strategies employed via social media, especially for sensitive topics (eg, sexually transmitted diseases), and ensure that participants are redirected to an external website so that the amount of information exchanged on Facebook or similar sites is minimized as in this study or the study by Fenner and colleagues  by using advertisements.
The second limitation has to do with selective attrition and missing data. In the LS group, more participants dropped out during follow-up than in the control group. However, the only substantial explanation for study attrition was that more males dropped out most likely because they, in general, had lower stress scores than females. The moderation analyses further confirmed this assumption that inadvertently may have had implications for the power to detect potential interaction effects which is considerably reduced with categorical variables whose categories differ in sample size . However, other than gender, there were no indications that selective attrition or missing data affected the means, variances, or the relationships among variables between those who remained in the study and those who dropped out. Hence, we can be confident about the validity of the results in this study.
The third limitation of this study concerns the mediation analysis. It is becoming more common to investigate complex models in intervention research by using multilevel mediation models, testing for multiple mediators or testing for nonlinear mediation effects [79,80]. In many cases, researchers will assume that there is more than 1 mediator that can potentially affect the outcome of an intervention. Most often, researchers examine mediation with only 1 mediator at a time. Consequently, the effects of multiple mediators cannot be simply examined or compared against each other if researchers examine mediators singly. However, several complications arise when testing for multiple mediators in multilevel models and, unfortunately, there is currently a lack of established procedures or methods for testing indirect effects in multilevel models with multiple mediators where the constituent paths are nonlinear. So, although we may have used the best available methods to date, such as bootstrapping, it is obvious that there is a need to develop a set of recommendations or procedures in this area.
Conclusion and Future Research
The results from this randomized controlled trial suggest that a Web-based intervention can reduce levels of stress over time and that both mindfulness and procrastination could be important components for inclusion in future eHealth interventions for stress. Future research should make sure to examine the effects of the LS or similar interventions for stress reduction among more male participants and investigate the role of psychological moderators of treatment effects.
This research was funded by the Norwegian Research Council (Project No 187979). The authors would like to thank Silje Henriksen for her role as participating investigator during recruitment.
Conflicts of Interest
FD was employed by Changetech AS, which developed the Less Stress intervention, at the time of investigation. PK has a financial interest in the intervention as a shareholder in Changetech AS.
Multimedia Appendix 1
Less Stress intervention screenshots.[PDF File (Adobe PDF File), 962KB]
Multimedia Appendix 2
CONSORT EHEALTH checklist V1.6.2 .[PDF File (Adobe PDF File), 990KB]
- Ihlebaek C, Eriksen HR, Ursin H. Prevalence of subjective health complaints (SHC) in Norway. Scand J Public Health 2002;30(1):20-29. [Medline]
- Ipsos Public Affairs. The Associated Press International Affairs Poll. Washington, DC: Ipsos Public Affairs; 2006. URL: http://surveys.ap.org/data/Ipsos/international/2006-11%20AP%20Globus%20topline_112606.pdf [accessed 2013-02-06] [WebCite Cache]
- American Psychological Association. Stress in America: Our Health at Risk. 2012 Jan 11. URL: http://www.apa.org/news/press/releases/stress/2011/final-2011.pdf [accessed 2013-02-06] [WebCite Cache]
- Oliver MI, Pearson N, Coe N, Gunnell D. Help-seeking behaviour in men and women with common mental health problems: cross-sectional study. Br J Psychiatry 2005 Apr;186:297-301 [FREE Full text] [CrossRef] [Medline]
- Kivimäki M, Virtanen M, Elovainio M, Kouvonen A, Väänänen A, Vahtera J. Work stress in the etiology of coronary heart disease--a meta-analysis. Scand J Work Environ Health 2006 Dec;32(6):431-442 [FREE Full text] [Medline]
- Golden SH. A review of the evidence for a neuroendocrine link between stress, depression and diabetes mellitus. Curr Diabetes Rev 2007 Nov;3(4):252-259. [Medline]
- Burke HM, Davis MC, Otte C, Mohr DC. Depression and cortisol responses to psychological stress: a meta-analysis. Psychoneuroendocrinology 2005 Oct;30(9):846-856. [CrossRef] [Medline]
- Mathers CD, Loncar D. Projections of global mortality and burden of disease from 2002 to 2030. PLoS Med 2006 Nov;3(11):e442 [FREE Full text] [CrossRef] [Medline]
- Health and Safety Executive. 2012. Stress-related and psychological disorders in Great Britain (GB) URL: http://www.hse.gov.uk/statistics/causdis/stress/index.htm [accessed 2013-02-06] [WebCite Cache]
- National Institute of Occupational Health. Faktabok om arbeidsmiljø og helse 2011: Status og utviklingstrekk Facts about working environment and health 2011: Status and trends. Oslo, Norway: National Institute of Occupational Health; 2011.
- Bohlmeijer E, Prenger R, Taal E, Cuijpers P. The effects of mindfulness-based stress reduction therapy on mental health of adults with a chronic medical disease: a meta-analysis. J Psychosom Res 2010 Jun;68(6):539-544. [CrossRef] [Medline]
- Chiesa A, Serretti A. Mindfulness-based stress reduction for stress management in healthy people: a review and meta-analysis. J Altern Complement Med 2009 May;15(5):593-600. [CrossRef] [Medline]
- Rainforth MV, Schneider RH, Nidich SI, Gaylord-King C, Salerno JW, Anderson JW. Stress reduction programs in patients with elevated blood pressure: a systematic review and meta-analysis. Curr Hypertens Rep 2007 Dec;9(6):520-528 [FREE Full text] [Medline]
- Richardson KM, Rothstein HR. Effects of occupational stress management intervention programs: a meta-analysis. J Occup Health Psychol 2008 Jan;13(1):69-93. [CrossRef] [Medline]
- Amstadter AB, Broman-Fulks J, Zinzow H, Ruggiero KJ, Cercone J. Internet-based interventions for traumatic stress-related mental health problems: a review and suggestion for future research. Clin Psychol Rev 2009 Jul;29(5):410-420 [FREE Full text] [CrossRef] [Medline]
- van Bastelaar KM, Pouwer F, Cuijpers P, Riper H, Snoek FJ. Web-based depression treatment for type 1 and type 2 diabetic patients: a randomized, controlled trial. Diabetes Care 2011 Feb;34(2):320-325 [FREE Full text] [CrossRef] [Medline]
- Matano RA, Futa KT, Wanat SF, Mussman LM, Leung CW. The Employee Stress and Alcohol Project: the development of a computer-based alcohol abuse prevention program for employees. J Behav Health Serv Res 2000 May;27(2):152-165. [Medline]
- Dolezal-Wood S, Belar CD, Snibbe J. A comparison of computer-assisted psychotherapy cognitive-behavioral therapy in groups. J Clin Psychol Med S 1998;5(1):103-115. [CrossRef]
- Shimazu A, Kawakami N, Irimajiri H, Sakamoto M, Amano S. Effects of web-based psychoeducation on self-efficacy, problem solving behavior, stress responses and job satisfaction among workers: a controlled clinical trial. J Occup Health 2005 Sep;47(5):405-413 [FREE Full text] [Medline]
- Hasson D, Anderberg UM, Theorell T, Arnetz BB. Psychophysiological effects of a web-based stress management system: a prospective, randomized controlled intervention study of IT and media workers [ISRCTN54254861]. BMC Public Health 2005;5:78 [FREE Full text] [CrossRef] [Medline]
- Cook RR, Billings DW, Hersch RK, Back AS, Hendrickson A. A field test of a web-based workplace health promotion program to improve dietary practices, reduce stress, and increase physical activity: Randomized controlled trial. J Med Internet Res 2007;9(2):e17. [CrossRef]
- Abbott JA, Klein B, Hamilton C, Rosenthal A. The impact of online resilience training for sales managers on wellbeing and work performance. EJAP 2009;5(1):89-95. [CrossRef]
- Eisen K, Allen G, Bollash M, Pescatello L. Stress management in the workplace: A comparison of a computer-based and an in-person stress-management intervention. Comput Hum Behav 2008 Mar;24(2):486-496. [CrossRef]
- van Straten A, Cuijpers P, Smits N. Effectiveness of a web-based self-help intervention for symptoms of depression, anxiety, and stress: randomized controlled trial. J Med Internet Res 2008;10(1):e7 [FREE Full text] [CrossRef] [Medline]
- Hänggi Y. Kann web-basierte Stressprävention erfolgreichsein? Zeitschrift für Klinische Psychologie und Psychotherapie 2006 Jul 2006;35(3):169-177. [CrossRef]
- Wade SL, Carey J, Wolfe CR. An online family intervention to reduce parental distress following pediatric brain injury. J Consult Clin Psychol 2006 Jun;74(3):445-454. [CrossRef] [Medline]
- Lorig KR, Ritter PL, Laurent DD, Plant K. Internet-based chronic disease self-management: a randomized trial. Med Care 2006 Nov;44(11):964-971. [CrossRef] [Medline]
- Lorig KR, Ritter PL, Laurent DD, Plant K. The internet-based arthritis self-management program: a one-year randomized trial for patients with arthritis or fibromyalgia. Arthritis Rheum 2008 Jul 15;59(7):1009-1017 [FREE Full text] [CrossRef] [Medline]
- Zetterqvist K, Maanmies J, Ström L, Andersson G. Randomized controlled trial of internet-based stress management. Cogn Behav Ther 2003;32(3):151-160. [CrossRef] [Medline]
- Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med 2006 Dec;36(12):1737-1746. [CrossRef] [Medline]
- Richards JC, Klein B, Austin DW. Internet cognitive behavioural therapy for panic disorder: Does the inclusion of stress management information improve end-state functioning? Clin Psychol 2006 Mar;10(1):2-15. [CrossRef]
- Prochaska JO, Butterworth S, Redding CA, Burden V, Perrin N, Leo M, et al. Initial efficacy of MI, TTM tailoring and HRI's with multiple behaviors for employee health promotion. Prev Med 2008 Mar;46(3):226-231 [FREE Full text] [CrossRef] [Medline]
- Baer RA. Mindfulness training as a clinical intervention: A conceptual and empirical review. Clin Psychol-Sci Pr 2003;10(2):125-143. [CrossRef]
- Grossman P, Niemann L, Schmidt S, Walach H. Mindfulness-based stress reduction and health benefits: A meta-analysis. J Psychosom Res 2004:35-43. [CrossRef]
- Dobkin PL, Zhao Q. Increased mindfulness--the active component of the mindfulness-based stress reduction program? Complement Ther Clin Pract 2011 Feb;17(1):22-27. [CrossRef] [Medline]
- Brown KW, Ryan RM. The benefits of being present: mindfulness and its role in psychological well-being. J Pers Soc Psychol 2003 Apr;84(4):822-848. [Medline]
- Evans DR, Baer RA, Segerstrom SC. The effects of mindfulness and self-consciousness on persistence. Pers Indiv Differ 2009 Sep 2009;47(4):379-382. [CrossRef]
- Weinstein N, Brown KW, Ryan RM. A multi-method examination of the effects of mindfulness on stress attribution, coping, and emotional well-being. J Res Pers 2009 Jun 2009;43(3):374-385. [CrossRef]
- Palmer A, Rodger S. Mindfulness, stress, coping among university students. Canadian Journal of Counselling and Psychotherapy/Revue canadienne de counseling et de psychothérapie 2009;43(3):198-212.
- Steel P. The nature of procrastination: a meta-analytic and theoretical review of quintessential self-regulatory failure. Psychol Bull 2007 Jan;133(1):65-94. [CrossRef] [Medline]
- Stead R, Shanahan MJ, Neufeld R. 'I'll go to therapy, eventually': Procrastination, stress and mental health. Pers Indiv Differ 2010 Aug;49(3):175-180. [CrossRef]
- Sirois FM. “I’ll look after my health, later”: A replication and extension of the procrastination–health model with community-dwelling adults. Pers Indiv Differ 2007 Jul 2007;43(1):15-26. [CrossRef]
- Fernie BA, Spada MM. Metacognitions about procrastination: A preliminary investigation. Behav Cogn Psychoth 2008 Feb;36(3):359-364. [CrossRef]
- Tice DM, Baumeister RF. Longitudinal study of procrastination, performance, stress, and health: The costs and benefits of dawdling. Psychol Sci 1997;8(6):454-458.
- Moon SM, Illingworth AJ. Exploring the dynamic nature of procrastination: A latent growth curve analysis of academic procrastination. Pers Indiv Differ 2005 Jan;38(2):297-309. [CrossRef]
- Affleck G, Tennen H, Urrows S, Higgins P. Person and contextual features of daily stress reactivity: individual differences in relations of undesirable daily events with mood disturbance and chronic pain intensity. J Pers Soc Psychol 1994 Feb;66(2):329-340. [Medline]
- Matud MP. Gender differences in stress and coping styles. Pers Indiv Differ 2004 Nov 2004;37(7):1401-1415. [CrossRef]
- Terrill AL, Garofalo JP, Soliday E, Craft R. Multiple roles and stress burden in women: A conceptual model of heart disease risk. J Appl Biobehav Res 2012 Mar;17(1):4-22. [CrossRef]
- Fredman L, Cauley JA, Hochberg M, Ensrud KE, Doros G, Study of Osteoporotic Fractures. Mortality associated with caregiving, general stress, and caregiving-related stress in elderly women: results of caregiver-study of osteoporotic fractures. J Am Geriatr Soc 2010 May;58(5):937-943 [FREE Full text] [CrossRef] [Medline]
- Amirkhan J, Auyeung B. Coping with stress across the lifespan: Absolute vs. relative changes in strategy. J Appl Dev Psychol 2007 Jul 2007;28(4):298-317. [CrossRef]
- Steel P, Ferrari J. Sex, education and procrastination: an epidemiological study of procrastinators' characteristics from a global sample. Eur J Pers 2012 Apr 2012;27(1):51-58. [CrossRef]
- Compas BE. An agenda for coping research and theory: basic and applied developmental issues. Int J Behav Dev 1998 Jun 1998;22(2):231-237. [CrossRef]
- Stone AA, Schwartz JE, Broderick JE, Deaton A. A snapshot of the age distribution of psychological well-being in the United States. Proc Natl Acad Sci U S A 2010 Jun 1;107(22):9985-9990 [FREE Full text] [CrossRef] [Medline]
- Bergene AC, Mamelund SE, Steen AH. Norsk arbeidsliv 2012 - Svekket motstand i gode tider Norwegian worklife 2012 - Impaired resistance in good times. Oslo, Norway: Work Research Institute; 2012.
- Gallo LC, Matthews KA. Understanding the association between socioeconomic status and physical health: do negative emotions play a role? Psychol Bull 2003 Jan;129(1):10-51. [Medline]
- Galanakis M, Stalikas A, Kallia H, Karagianni C, Karela C. Gender differences in experiencing occupational stress: The role of age, education and marital status. Stress Health 2009;25:397-404. [CrossRef]
- Random integer generator. URL: http://www.random.org/integers/ [accessed 2013-04-05] [WebCite Cache]
- Wells A. Detached mindfulness in cognitive therapy: a metacognitive analysis and ten techniques. J Rat-Emo Cognitive-Behav Ther 2006 Mar 2006;23(4):337-355. [CrossRef]
- Demonstration of Less Stress intervention. 2013. URL: http://bit.ly/less_stress [WebCite Cache]
- Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther 1995 Mar;33(3):335-343. [Medline]
- Mann L, Burnett P, Radford M, Ford S. The Melbourne decision making questionnaire: an instrument for measuring patterns for coping with decisional conflict. J. Behav. Decis. Making 1997 Mar 1997;10(1):1-19. [CrossRef]
- Graham JW. Missing data analysis: making it work in the real world. Annu Rev Psychol 2009 Jan;60:549-576. [CrossRef] [Medline]
- Goodman JS. Assessing the non-random sampling effects of subject attrition in longitudinal research. J Manage 1996 Aug 1996;22(4):627-652. [CrossRef]
- Hays WL. Statistics. New York: Holt, Rinehart and Winston; 1988.
- Singer JD, Willett JB. Applied longitudinal data analysis: modeling change and event occurrence. Oxford: Oxford University Press; 2003.
- Bliese PD, Ployhart RE. Growth modeling using random coefficient models: Model building, testing, and illustrations. Organ Res Methods 2002 Oct;5(4):362-387. [CrossRef]
- MacKinnon DP, Lockwood CM, Hoffman JM, West SG, Sheets V. A comparison of methods to test mediation and other intervening variable effects. Psychol Methods 2002 Mar;7(1):83-104 [FREE Full text] [Medline]
- Preacher KJ, Hayes AF. SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behav Res Methods Instrum Comput 2004 Nov;36(4):717-731. [Medline]
- Preacher KJ, Hayes AF. Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behav Res Methods 2008 Aug;40(3):879-891. [Medline]
- Mackinnon DP, Lockwood CM, Williams J. Confidence limits for the indirect effect: distribution of the product and resampling methods. Multivariate Behav Res 2004 Jan 1;39(1):99 [FREE Full text] [CrossRef] [Medline]
- Selig JP, Preacher KJ. Monte Carlo method for assessing mediation: An interactive tool for creating confidence intervals for indirect effects. 2008. URL: http://www.quantpsy.org/medmc/medmc.htm [accessed 2013-02-07] [WebCite Cache]
- Brynjolfsson E, Hu YJ, Simester D. Goodbye pareto principle, hello long tail: The effect of search costs on the concentration of product sales. Manage Sci 2011 Jun;57(8):1373-1386. [CrossRef]
- Statistics Norway. 2012 Oct 12. ICT usage in households, 2nd quarter URL: http://ssb.no/en/teknologi-og-innovasjon/statistikker/ikthus [accessed 2013-03-10] [WebCite Cache]
- Mathy RM, Kerr DL, Haydin BM. Methodological rigor and ethical considerations in internet-mediated research. Psychother Theor Res Pract Train 2003;40(1):77-85. [CrossRef]
- Stopponi MA, Alexander GL, McClure JB, Carroll NM, Divine GW, Calvi JH, et al. Recruitment to a randomized web-based nutritional intervention trial: characteristics of participants compared to non-participants. J Med Internet Res 2009;11(3):e38 [FREE Full text] [CrossRef] [Medline]
- Bull SS, Levine D, Schmiege S, Santelli J. Recruitment and retention of youth for research using social media: Experiences from the Just/Us study. Vulnerable Children and Youth Studies 2012 Dec 2012:1-11. [CrossRef]
- Fenner Y, Garland SM, Moore EE, Jayasinghe Y, Fletcher A, Tabrizi SN, et al. Web-based recruiting for health research using a social networking site: an exploratory study. J Med Internet Res 2012 Feb;14(1):e20 [FREE Full text] [CrossRef] [Medline]
- Aguinis H. Statistical power with moderated mutliple regression in management research. J Manage 1995 Dec;21(6):1141-1158. [CrossRef]
- Krull JL, MacKinnon DP. Multilevel mediation modeling in group-based intervention studies. Eval Rev 1999 Aug;23(4):418-444. [Medline]
- Hayes AF, Preacher KJ. Quantifying and testing indirect effects in simple mediation models when the constituent paths are nonlinear. Multivar Behav Res 2010 Jul;45(4):627-660. [CrossRef]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
|–2LL: –2 log likelihood|
|AIC: Akaike information criterion|
|DASS-S: Depression Anxiety Stress Scale–stress subscale|
|ICC: intraclass correlation coefficient|
|LS: Less Stress|
|MAAS: Mindfulness Attention Awareness Scale|
|MCMAM: Monte Carlo Method for Assessing Mediation|
|MDMQ-P: Melbourne Decision Making Questionnaire–procrastination subscale|
|MI: multiple imputation|
|Edited by G Eysenbach; submitted 07.02.13; peer-reviewed by J Abbott, L Kilpatrick; comments to author 02.03.13; revised version received 10.03.13; accepted 26.03.13; published 22.04.13|
Please cite as:
Drozd F, Raeder S, Kraft P, Bjørkli CA
Multilevel Growth Curve Analyses of Treatment Effects of a Web-Based Intervention for Stress Reduction: Randomized Controlled Trial
J Med Internet Res 2013;15(4):e84
BibTeX, compatible with BibDesk, LaTeX
RIS, compatible with RefMan, Procite, Endnote, RefWorks
Refer, compatible with Endnote
Add this article to your Mendeley library
Add this article to your CiteULike library
Add this article to your Connotea library
Copyright©Filip Drozd, Sabine Raeder, Pål Kraft, Cato Alexander Bjørkli. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 22.04.2013.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.