Published on 02.09.14 in Vol 16, No 9 (2014): September
Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/3507, first published May 01, 2014.
Prevention of Generalized Anxiety Disorder Using a Web Intervention, iChill: Randomized Controlled Trial
Background: Generalized Anxiety Disorder (GAD) is a high prevalence, chronic disorder. Web-based interventions are acceptable, engaging, and can be delivered at scale. Few randomized controlled trials evaluate the effectiveness of prevention programs for anxiety, or the factors that improve effectiveness and engagement.
Objective: The intent of the study was to evaluate the effectiveness of a Web-based program in preventing GAD symptoms in young adults, and to determine the role of telephone and email reminders.
Methods: A 5-arm randomized controlled trial with 558 Internet users in the community, recruited via the Australian Electoral Roll, was conducted with 6- and 12-month follow-up.
Five interventions were offered over a 10-week period. Group 1 (Active website) received a combined intervention of psycho-education, Internet-delivered Cognitive Behavioral Therapy (ICBT) for anxiety, physical activity promotion, and relaxation. Group 2 (Active website with telephone) received the identical Web program plus weekly telephone reminder calls. Group 3 (Active website with email) received the identical Web program plus weekly email reminders. Group 4 (Control) received a placebo website. Group 5 (Control with telephone) received the placebo website plus telephone calls.
Main outcome measures were severity of anxiety symptoms as measured by the GAD 7-item scale (GAD-7) (at post-test, 6, and 12 months). Secondary measures were GAD caseness, measured by the Mini International Neuropsychiatric Interview (MINI) at 6 months, Centre for Epidemiologic Studies-Depression scale (CES-D), Anxiety Sensitivity Index (ASI), Penn State Worry Questionnaire (PSWQ), and Days out of Role.
Results: GAD-7 symptoms reduced over post-test, 6-month, and 12-month follow-up. There were no significant differences between Group 4 (Control) and Groups 1 (Active website), 2 (Active website with telephone), 3 (Active website with email), or 5 (Control with telephone) at any follow-up. A total of 16 cases of GAD were identified at 6 months, comprising 6.7% (11/165) from the Active groups (1, 2, 3) and 4.5% (5/110) from the Control groups (4, 5), a difference that was not significant. CES-D, ASI, and PSWQ scores were significantly lower for the active website with email reminders at post-test, relative to the control website condition.
Conclusions: Indicated prevention of GAD was not effective in reducing anxiety levels, measured by GAD-7. There were significant secondary effects for anxiety sensitivity, worry, and depression. Challenges for indicated prevention trials are discussed.
Trial Registration: International Standard Randomized Controlled Trial Number (ISRCTN): 76298775; http://www.controlled-trials.com/ISRCTN76298775 (Archived by WebCite at http://www.webcitation.org/6S9aB5MAq).
J Med Internet Res 2014;16(9):e199
- anxiety disorders;
- early intervention;
- online systems;
- cognitive behavioral therapy
Approximately 5% of the general population experiences General Anxiety Disorder (GAD) at least once in their lifetime , with population surveys indicating a lifetime prevalence rate of between 4.3-5.9% and a 12-month prevalence rate of between 1.2-1.9% [ , ]. The cost of GAD to the community is high as a result of its chronic course [ ]. GAD frequently presents early in the lifespan and affects the individual throughout adulthood, with an estimated lag time to treatment of between 9 and 23 years [ ]. If the prevalence of GAD is to be lowered, prevention, particularly focusing on the early adult and adolescence years when the illness emerges [ ], will reduce the prevalence of mental disorder by up to 23% [ - ].
There is some evidence that GAD can be prevented. However, the conduct of research trials has not been optimal either because the researchers have been unable to exclude those with a diagnosis at the onset of the intervention or because the trials are too small or too short to investigate the number of incident cases following the intervention . We reviewed the research literature, but found that only four trials excluded a diagnosis of GAD in adults at baseline. Two of the studies found preventative effects, but both trials had limitations [ , ]. Van’t Veer Tazelaar and colleagues [ ] reported that depression and anxiety caseness could be halved in elderly people who were provided with a stepped care intervention of problem solving and cognitive behavioral therapy (CBT) bibliotherapy. However, the investigators did not report data separately for GAD, so the effect of the intervention on GAD compared to depression diagnosis could not be determined. Pitceathly and colleagues [ ] reported a protective effect of a brief coping intervention on GAD in cancer patients. The effect was not detectable in the full sample, but was evident for those identified at the start of the trial with high risk of anxiety or depression. No preventative effects were found in the other two studies [ , ]. In the first, a stepped care intervention in elderly people living in residential care did not result in reduced incidence of combined anxiety or depression. In the second, carers of patients with Alzheimer’s disease did not show lower levels of anxiety or depression as a result of an intervention involving a Family Meetings intervention. In effect, no genuine prevention trials have been conducted with younger adults and none with adults without a cancer diagnosis.
A key challenge to delivering prevention interventions is the low level of engagement by those at risk; if symptoms are not disabling, motivation may be low and seeking help from doctors seen as inappropriate. Web-based interventions provide a potentially very useful delivery medium because they are accessible, acceptable, globally disseminable, and have been found to be effective in delivering CBT in clinical settings for both depression and anxiety [- ]. Engagement may be enhanced by “push” factors (ie, factors that encourage involvement or engagement, such as reminders or coaching) [ ]. However, inconsistent findings are reported [ - ]. Because prevention programs are delivered to large numbers at a population level, the costs associated with different push factors are critical to the feasibility of prevention efforts. Hence, there is a need to know the extent to which email reminders and telephone communication with the research team will improve adherence and effectiveness. The present study aimed to evaluate the effectiveness of a Web-based multimedia CBT intervention in individuals aged 18 to 30 years with symptoms of anxiety, who did not meet diagnostic criteria at baseline. The intervention was a website that provided psychoeducation, CBT, physical activity promotion, and relaxation training, with the majority of the sessions focusing on CBT. Each component of the intervention was found to be effective in GAD treatment [ - ]. Our rationale to include all four components was based on the view that combining a range of evidence-based interventions provides potential for maximal impact, as well as the opportunity for participants’ preferences (for example, see [ ]). We know very little about engagement in prevention (compared to treatment) programs, and offering a range of interventions, all of which have evidence-based support from treatment settings, would potentially optimize effectiveness and uptake. We focused on young adults, as GAD develops during adolescence and early adulthood and any improvement would be likely to provide benefits over years. The intervention’s “e-couch” website is open following registration and the CBT “worry” program can be experienced.
Five interventions were offered over a 10-week period. Group 1 (Active website) received the combined intervention as described above. Group 2 (Active website with telephone) received the same Web program plus weekly telephone reminder calls. Group 3 (Active website with email) received the Web program plus automated weekly email reminders. Group 4 (Control) received a placebo website, matched in length to the active website. Group 5 (Control with telephone) received the placebo website plus telephone reminder calls. This design allowed us to compare the effectiveness of the active interventions to the control condition (1, 2, 3 vs 4) and also to determine the independent effect of phone contact in the control conditions (5 vs 4). Email reminders are less expensive than person-made telephone reminders, an important consideration for a prevention trial. To our knowledge, no similar prevention trials have been conducted with each of these inclusions: the use of an online intervention for GAD, targeting of young adults in the community, and excluding existing GAD diagnosis.
A randomized controlled trial with 5 arms, called the “iChill” trial, with post-test, 6- and 12-month follow-up, was conducted. The study was approved by the ANU Human Ethics Committee (Protocol 2008/548).
Setting, Participants, and Eligibility Criteria
The study protocol  describes trial details. A screening questionnaire was emailed to 120,000 randomly chosen Australians aged 18-30 years registered on the Australian Electoral Roll. Individuals meeting inclusion criteria were invited to a Web portal where they provided consent and undertook screening and baseline surveys. They were then interviewed via telephone to determine current GAD diagnosis using the MINI International Neuropsychiatric Interview (MINI) [ ] and randomized to the trial. Inclusion criteria were willingness to consent, an active email and phone number, English language proficiency, Internet access, and a score above 5 on the GAD-7 [ ]. In order to specify the target population for whom the intervention might be effective, participants were excluded if they were currently undergoing CBT or seeing a psychologist or a psychiatrist, had a current or previous diagnosis of bipolar disorder, schizophrenia, or psychosis, were at risk of self-harm or suicide based on the MINI depression module, or had a current diagnosis of panic disorder, social phobia, or post-traumatic stress disorder (PTSD) on the MINI. Participants were not excluded if taking antidepressants or benzodiazepines. A total of 40 (7.2%, 40/558) were taking antidepressants and 8 (1.4%, 8/558) were taking benzodiazepines at baseline; 510 were not taking either antidepressants or benzodiazepines.
The algorithm for randomization consisted of a stratified block design with eight strata (2 x 2 x 2) corresponding to gender, past GAD diagnosis, and severity of GAD symptoms with a block size of 10. “Past GAD diagnosis” was obtained from the MINI—a proportion of participants (24.2%, 135/558) met lifetime criteria for GAD on the MINI but did not meet MINI criteria for current GAD. To minimize imbalance between such participants, stratification was conducted on the basis of meeting lifetime GAD criteria (along with gender and current GAD symptoms). Allocation was administered via software architecture, and participants were informed of condition allocation after baseline interview.
The Active website intervention was a 10-week structured version of the Anxiety and Worry modules of the “e-couch” program (ecouch.anu.edu.au), which consisted of an integrated program of psychoeducation (weeks 1-2), CBT (weeks 3-7), relaxation (weeks 8-9), and physical activity promotion (week 10). The psychoeducation section (Modules 1 and 2) provides information on worry, stress, fear, and anxiety; a description of anxious thinking; differentiation of GAD from other anxiety disorders; risk factors for GAD; comorbidity; and consequences of anxiety and available treatments. This section is based on interventions for mental health literacy that have succeeded in reducing symptoms of depression and anxiety, and improving mental health attitudes . The CBT toolkits (Modules 3-7) addressed typical anxious thoughts and included sections on dealing with the purpose and meaning of worry, the act of worrying, and the content of worry. The information is derived from materials that have been found to reduce anxious cognitions in at-risk people [ , ]. Progressive muscle relaxation (PMR) (Module 8) instructs participants on how to progressively tense and relax different muscle groups to induce relaxation and help to identify tension early. PMR has been trialed in a previous website program for depression in adults [ ] and adolescents [ ]. The mindfulness meditation module (Module 9) helps participants become aware of their breathing and body, acknowledging thoughts and external distractions but remaining focused on the present. The final module, physical activity (Module 10), tailors advice about physical activity based on the stages of change theory [ ]. The control website was an adapted version of the HealthWatch control condition developed for the Australian National University WellBeing study [ ]. This website provided information about general health (nutrition, heart health, etc), and invited responses to questions about anxiety. Scripted telephone reminder calls in the Active plus telephone condition were made on a weekly basis to check on participants’ progress and to remind them to complete the module and/ or to keep completing the program. The phone reminders were intended to serve purely as reminders, had no therapeutic input, and were made by casual phone interviewers. Telephone calls were scripted and were based on the email scripts. Any technical issues were referred to the Trial Manager. Phone calls generally lasted between 30 seconds to 2 minutes. Phone calls were made regardless of whether the participant completed the program or not. Participants in the Active plus email and Control plus email conditions were sent a weekly reminder email. These were similar in content to the phone calls. There was no therapeutic input.
The primary outcome was the Generalized Anxiety Disorder 7-item scale (GAD-7) . Secondary outcomes were GAD caseness based on MINI; worry, measured by the Penn State Worry Questionnaire (PSWQ) [ ]; anxiety sensitivity, as measured by the Anxiety Sensitivity Index (ASI) [ ]; depression symptoms, measured by the Centre for Epidemiologic Studies-Depression Scale (CES-D) [ ]; and disability measured by Days out of Role from the US National Comorbidity Study [ ]. GAD caseness was measured at 6 months. GAD caseness at 36 months will be determined by proxy using GAD-7 cut-off scores. Other measures not analyzed in this paper focused on comorbidities, such as harmful/hazardous alcohol use as measured by the Alcohol Use Disorders Identification Test (AUDIT) [ ], or duplicate measures of depression caseness estimated by the Patient Health Questionnaire 9-item (PHQ-9) [ ], and other behaviors such as help seeking and perceived need for treatment. Outcomes were assessed at baseline, 6, and 12 months, with the exception of MINI caseness, which was assessed at 6 months.
We aimed, conservatively, to find an effect of 0.3 between each Active website group and the Control, based on effect sizes of 0.6 found for previous treatment and indicated prevention trials (0.6) [, ]. This assumes a pre-post correlation of .7 between scores. With 600 participants, we would have 80% power to detect effects, allowing for 15% attrition.
Primary analyses were undertaken on an intent-to-treat basis (ITT). Mixed model repeated measures (MMRM)  were used to include all available data, including that from participants who subsequently withdrew from the trial. This approaches yields unbiased estimates of intervention effects under the assumption that data are missing at random (MAR). Unlike conventional approaches to analysis, MAR allows observations to be missing conditional on observed variables appearing in the analytic model [ ]. Non-linear mixed models were used to analyze caseness.
A total of 558 people were randomized to a trial condition of whom 360 (64.5%) completed post-test, 303 (54.3%) completed 6-month follow-up, and 264 (47.3%) completed the 12-month follow-up.shows the flow of participants. Sample characteristics are presented in . Although mean GAD-7 scores were above the cut-point of 5 at screening for all participants (mean 8.3, SD 3.3), anxiety symptoms had decreased by the time the baseline was completed (mean 6.7, SD 3.8).
There were no differences on any of the baseline measures with the exception of “preference for active condition” and “employment status”. Across all conditions, the most preferred program was the Active website with email reminders (37.8%, 211/558), followed by the Control (31.4%, 175/558), with few participants stating a preference for telephone reminders (5.6%, 31/558 and 11.6%, 65/558, for Active and Control conditions, respectively). Lower preference for the Active website was found among those in the Control and Active with email conditions. Higher rates of full-time work were found among those receiving the Active website with telephone reminders and lower rates among those receiving the Control website with telephone reminders.
Adherence to the intervention differed significantly according to condition. Participants in the reminder conditions completed the majority of the 10 modules (Active/email: 5.5 modules, Active/telephone: 7.3, Control/telephone: 8.3) while those who did not receive reminders completed a little over one-third (3.7 modules for both active and control; F4, 477.5=38.1, P<.001).
GAD-7 symptoms reduced at post-test and 6-month follow-up, but returned to baseline levels by 12 months. There were no significant differences between Group 4 (Control) and Groups 1 (Active website), 2 (Active website with telephone), 3 (Active website with email), or 5 (Control with telephone) at any follow-up. Outcomes were unchanged after adjusting for employment status and preferences for condition. Likewise, accounting for adherence by adjusting for module completion (ie, testing the efficacy of the intervention) did not change these outcomes.shows estimated marginal means of GAD-7 scores from the mixed model shown in .
Data on secondary outcomes analyses are displayed for continuous variables in. Based on the MINI assessment at 6 months, 16 cases of GAD were identified, comprising 6.7% from the Active groups (1, 2, and 3) and 4.5% from the Control groups (4, 5). There was no significant difference in the number of cases across these collapsed groups.
The mixed effect model repeated measure (MMRM) analyses for secondary outcomes were as follows. As for the primary outcome, there were no significant overall interactions between condition and time for CES-D, PSWQ, or Days out of Role. However, there was a significant interaction between condition and time for the ASI. Furthermore, there were significant effects of specific conditions at specific time points. CES-D, ASI, and PSWQ scores were significantly lower for the active website with email reminders at post-test, relative to the control website condition (t389.2= −2.5, P=.015; t368.7=−3.4, P<.001; t371.9=−2.4, P=.017 respectively). The decrease in ASI scores for the active/email condition remained significant at 6 months (t343.1=−2.3, P=.021). In addition, Days out of Role due to anxiety was significantly decreased at 12 months (but not at post-test or 6 months) for the active/email condition (t398.3=−2.4, P=.016). There was also reduced worry in the active website with phone reminders at post-test and 6 months, relative to the control condition (t368.6=−2.0, P=.047; t340.2= −2.1, P=.035 respectively).
|Active website (n=111)||Active website with email (n=113)||Active website with phone (n=110)||Control website (n=111)||Control website with phone (n=113)||Fa or χ2||P|
|mean (SD) or n (%)|
|Age||25.7 (3.2)||25.4 (3.3)||25.5 (3.1)||26.0 (3.0)||25.6 (3.5)||0.623||.646|
|GAD-7d score||6.8 (3.9)||6.2 (3.9)||6.8 (3.6)||6.9 (3.8)||6.6 (3.7)||0.604||.660|
|CES-De score||16.7 (10.1)||17.7 (10.9)||16.7 (9.8)||18.8 (10.6)||17.3 (8.8)||0.802||.524|
|Anxiety sensitivity||19.3 (11.0)||19.9 (11.5)||17.5 (10.6)||18.7 (9.9)||18.8 (9.9)||0.753||.556|
|PSWQf||40.5 (12.2)||37.9 (12.5)||39.5 (11.6)||40.3 (12.0)||39.2 (10.8)||0.835||.503|
|AUDITg score||7.2 (5.1)||7.2 (5.7)||6.7 (4.8)||6.9 (4.7)||7.0 (5.3)||0.189||.944|
|DORh due to anxiety||0.6 (1.5)||0.9 (2.3)||0.6 (1.6)||0.6 (1.4)||0.6 (1.2)||0.859||.488|
|Self-rated healthi||2.4 (0.9)||2.5 (0.8)||2.4 (0.8)||2.5 (0.9)||2.5 (0.7)||0.879||.476|
|Childhood adversityj||1.5 (1.4)||1.9 (1.5)||1.8 (1.6)||1.7 (1.5)||1.7 (1.5)||0.919||.452|
|Traumatic eventsk||1.4 (1.5)||1.6 (1.6)||1.5 (1.5)||1.4 (1.5)||1.6 (1.6)||0.498||.737|
|Positive beliefs Internet therapyl||5.6 (1.2)||5.4 (1.3)||5.4 (1.3)||5.5 (1.3)||5.8 (1.3)||2.064||.084|
|Female gender||92 (82.9%)||90 (79.6%)||88 (80.0%)||89 (80.2%)||91 (80.5%)||0.474b||.976|
|Completed university degree||37 (33.3%)||32 (28.6%)||28 (25.9%)||36 (32.4%)||30 (26.8%)||2.352b||.671|
|Prefer active conditionm||67 (60.4%)||51 (45.1%)||70 (63.6%)||60 (54.1%)||70 (61.9%)||10.501b||.033c|
|Full-time employment||69 (62.2%)||68 (61.3%)||81 (75.7%)||65 (59.1%)||58 (51.8%)|
|Part-time employment||30 (27.0%)||27 (24.3%)||16 (15.0%)||34 (30.9%)||36 (32.1%)|
|Not in labor force||12 (10.8%)||16 (14.4%)||10 (9.3%)||11 (10.0%)||18 (16.1%)|
aF tests are from one-way analysis of variance (ANOVA) for continuous variables
bχ2 tests for categorical variables
dGAD: Generalized Anxiety Disorder
eCES-D: Center for Epidemiologic Studies Depression Scale
fPSWQ: Penn State Worry Questionnaire
gAUDIT: Alcohol Use Disorders Identification Test
hDOR: Days out of Role
iSelf-rated health assessed on a 5-point scale from 1 (excellent) to 5 (poor)
jChildhood adversity based on aggregate of 6 items assessing paternal/maternal mental health problems and substance use problems, high familial conflict, and parental separation/divorce
kTraumatic life events based on count from list of 14 traumatic events
lPositive beliefs in Internet therapy based on 2 items regarding confidence in learning skills about anxiety and better understanding anxiety using the Internet
mPreference for active condition based on a single item asking which intervention would be preferred
|Parameter||Estimate||Standard error||df||t / F||P|
|Active website with email reminders||−0.716||0.506||553.0||−1.4||.158|
|Active website with phone reminders||−0.173||0.510||553.0||−0.3||.734|
|Control website with phone reminders||−0.335||0.506||553.0||−0.7||.508|
|Condition × time interaction||0.8||.622|
|Active vs control at baseline||0.000||0.000|
|Active vs control at post-test||0.331||0.698||390.6||0.5||.636|
|Active vs control at 6 months||0.179||0.723||374.2||0.2||.805|
|Active vs control at 12 months||−0.274||0.853||313.9||−0.3||.748|
|Active email vs control at baseline||0.000||0.000|
|Active email vs control at post-test||−0.517||0.718||393.9||−0.7||.472|
|Active email vs control at 6 months||0.370||0.730||372.3||0.5||.612|
|Active email vs control at 12 months||−0.157||0.896||319.4||−0.2||.861|
|Active phone vs control at baseline||0.000||0.000|
|Active phone vs control at post-test||−0.689||0.682||384.5||−1.0||.314|
|Active phone vs control at 6 months||0.736||0.709||369.4||1.0||.300|
|Active phone vs control at 12 months||−1.082||0.851||315.4||−1.3||.205|
|Control phone vs control at baseline||0.000||0.000|
|Control phone vs control at post-test||−0.137||0.655||379.2||−0.2||.835|
|Control phone vs control at 6 months||0.394||0.683||364.4||0.6||.565|
|Control phone vs control at 12 months||−0.150||0.808||310.2||−0.2||.853|
|Active||Active / phone||Active / email||Control||Control / phone|
|mean (SD)/n||mean (SD)/n||mean (SD)/n||mean (SD)/n||mean (SD)/n||Fa||df||P|
|Baseline||6.8 (3.9)||6.8 (3.6)||6.2 (3.9)||7.0 (3.8)||6.6 (3.7)|
|Post-test||6.1 (4.7)||4.7 (3.6)||4.6 (2.9)||6.1 (4.1)||5.3 (4.2)|
|6-month||4.3 (3.0)||5.0 (4.0)||4.3 (3.7)||4.6 (3.6)||4.7 (3.1)|
|12-month||5.1 (4.6)||4.0 (3.4)||5.1 (4.1)||5.9 (4.5)||5.1 (3.6)|
|Baseline||40.5 (12.2)||39.5 (11.6)||37.9 (12.5)||40.3 (12.0)||39.2 (10.8)|
|Post-test||39.0 (13.2)||37.4 (10.6)||33.8 (11.5)||41.0 (12.3)||38.4 (12.8)|
|6-month||33.9 (13.2)||38.2 (11.3)||35.9 (11.5)||38.9 (13.4)||37.9 (13.5)|
|12-month||34.1 (14.0)||33.2 (11.2)||34.4 (13.1)||38.3 (13.9)||37.2 (12.1)|
|Baseline||19.3 (11.0)||17.5 (10.6)||19.9 (11.5)||18.7 (9.9)||18.8 (9.9)|
|Post-test||18.9 (11.8)||14.6 (10.6)||17.1 (11.1)||18.5 (12.2)||16.7 (11.0)|
|6-month||16.0 (12.3)||15.0 (11.5)||15.4 (9.5)||17.4 (10.2)||15.1 (9.8)|
|12-month||19.5 (12.4)||14.7 (10.0)||19.4 (11.6)||20.3 (11.1)||21.1 (10.6)|
|Baseline||16.7 (10.1)||16.7 (9.8)||17.7 (10.9)||18.8 (10.6)||17.3 (8.8)|
|Post-test||14.0 (10.8)||12.4 (8.6)||10.9 (8.4)||17.5 (11.3)||13.8 (9.6)|
|6-month||10.7 (7.7)||12.6 (10.5)||11.8 (8.9)||14.4 (11.3)||13.4 (8.1)|
|12-month||12.0 (9.2)||9.7 (5.9)||12.3 (11.3)||15.3 (9.3)||12.6 (8.7)|
|Baseline||0.6 (1.5)||0.6 (1.6)||0.9 (2.3)||0.6 (1.4)||0.6 (1.2)|
|Post-test||0.5 (1.3)||0.2 (0.5)||0.4 (0.9)||0.5 (1.4)||0.2 (0.8)|
|6-month||0.3 (1.4)||0.4 (1.1)||0.1 (0.6)||0.5 (1.8)||0.5 (2.5)|
|12-month||0.3 (0.8)||0.2 (0.6)||0.1 (0.5)||0.7 (1.8)||0.4 (1.9)|
astatistics are omnibus F tests from mixed models repeated measures for each outcome, based on time × condition interaction terms
cGAD: Generalized Anxiety Disorder
dPSWQ: Penn State Worry Questionnaire
eASI: Anxiety Sensitivity Index
fCES-D: Center for Epidemiologic Studies Depression scale
gDOR: days out of role due to anxiety
We found no evidence that a range of brief active interventions were associated with improved anxiety outcomes at post-test or at 6 or 12 months as measured by GAD-7 and by caseness at 6 months as measured by the MINI. We found that there were effects on secondary outcomes, most strongly found for anxiety sensitivity, where there was a significant interaction between condition and time for the ASI. In addition, ASI scores were significantly lower for the active website with email reminders at post-test, and at 6 months. There were also small effects at various follow-up intervals for the other measures mostly associated with the active website with email reminders. For instance, CES-D and PSWQ scores were significantly lower for the active website with email reminders at post-test, relative to the control website condition. In addition, Days out of Role due to anxiety was significantly decreased at 12 months for the active/email condition.
At best, these findings suggest that an active website with email may have small effects on a number of secondary outcomes. It is also possible that the GAD-7 may be a poorer measure of anxiety change than the ASI, and that genuine prevention effects operate, but were not discoverable because of our choice of outcome measure. The GAD-7 may be sensitive to a range of anxiety disorders  and may not have been the most robust outcome measure.
In addition, a number of limitations to the present study need to be considered. There was differential dropout in a number of conditions relative to the control. Nevertheless, the completer analyses (not reported in the paper but undertaken) produced comparable effects to the main ITT analysis. The condition with the strongest secondary outcome effects was also the condition that was associated with the highest preference rating, suggesting that preference for it might have influenced the findings. In addition, the intervention itself may not have been optimal. We argued that combining a range of evidence-based interventions would provide maximal impact as well as provide opportunity for participants to make choices within the program content. It might be suggested that this diluted the effects of the individual components. However, we disagree, given that (1) the combined intervention is highly efficacious (effect sizes greater than 1.0) for patients with a diagnosis of GAD , (2) the multimedia intervention in the current paper was associated with effects on a range of secondary measures, and (3) evidence from earlier online trials indicates that much shorter interventions (eg, over 5 sessions rather than 8) are associated with positive outcomes, and that very short interventions can be effective [ ]. Consequently, we doubt that the intervention website itself was the reason for the lack of effect on the primary outcome measure. Another criticism is that choosing a multi-modal treatment results in the findings not being clear-cut, as any component might be the effective one. However, we would argue that prevention trials, in direct comparison to treatment trials, are in their infancy. Trials that demonstrate the effectiveness of multi-component interventions represent the first stage of a prevention research program, where, once an effect can be demonstrated, further research would normally then investigate the effect of the subcomponents.
The number of individuals in the current prevention study developing a diagnosis over the 12-month period following the intervention was unexpectedly low. However, elsewhere, comparable rates of 8.6% for the intervention and 4.44% in usual care groups have been reported . These low rates may be due to regression to the mean and to the low threshold of anxiety for recruitment to the trial. The 6-month interval to determine caseness is relatively short with respect to prevention trials in the sense that a longer interval permits more opportunity to develop a disorder and thus to judge the effectiveness of the interventions. The choice of the 6-month interval for the MINI was made in order to maximize follow-up numbers (ie, to determine caseness) as dropouts were expected to increase over the 12-month follow-up period. We reasoned that we could determine proxy measures of caseness at 12 months via the GAD-7. A planned 3-year follow-up using GAD-7 as the primary outcome has commenced and we will report anxiety and depression outcomes at this time. Attrition was higher than expected at about 35% at post-test, although similar rates of dropout have been reported for face-to-face CBT [ ].
Consistent with previous eHealth trials, data completion was higher in the control condition and was lowest for the active website condition with automated emails—a finding consistent with earlier trials [, ]). The lower attrition in the control groups has been attributed to participant burden. Whether online or face-to-face, psychological interventions can be hard work, even threatening, and are often associated with dropout [ ]. We also had substantial loss to recruitment between an expression of interest to the trial, and enrollment following invitation to undertake baseline measures. The reasons for failure to take up enrollment are not clear, but the trial was configured to allow enrollment within a week of consent. Delays in telephone and email contact often stretched the recruitment process, although there were strict time limits on each of the processes involved. The multi-modal nature of recruitment made identification of the reasons for non-response very complex, as the screener was conducted by post, the MINI assessment by telephone call, and the baseline invitation by email to an online survey.
A related issue is the role of contact in promoting adherence. In the present trial, adherence to the website was increased by contact via email or telephone. However, increased contact does not always result in improved adherence. A study we undertook with crisis call centers showed that adherence was much lower in participants who were provided with a website and telephone support compared to individuals without such support . More research is required to examine for whom and under what circumstances telephone contact can increase adherence, and the factors that lead to increased dropout. We have reviewed factors that predict adherence for online programs [ ]. We also acknowledge that the effects of the intervention in an adolescent rather than a young adult sample might have been more evident, since GAD or worry might emerge in this period. Levels of attrition need to be considered, since these were high. In addition, the sample excluded concurrent other diagnoses such as social phobia and PTSD, reducing generalizability. The trial raises the important question of how best to keep symptomatic people engaged in interventions. One possibility is to change orientation toward healthy living and offer prevention for GAD by stealth. An alternative approach is to constrain participants from dropping out through structure (eg, curriculum activities in schools or induction programs in workforces). These possibilities are currently being pursued in other research projects.
Despite a number of limitations, the present trial represents a methodologically rigorous, well-executed prevention trial, which for the first time examines the effectiveness of the prevention of GAD in symptomatic 18-30 year olds in the community using online technologies. Diagnosis was established using a telephone interview at baseline and 6 months, and GAD diagnosis was an exclusion factor at commencement, ensuring that it was a genuine prevention trial. A post-hoc power analysis found that we had approximately 95% power to find a between-groups effect of d=0.3 between the Active website alone and Control website alone, indicating that the trial was sufficiently powered. Preference for trial condition was measured and assessed for its effect, and the study aimed to determine push and pull factors that might influence uptake and efficaciousness. In this trial, we were not able to demonstrate the preventative effects of the website on anxiety symptoms as measured by the GAD-7. There were indications that prevention was operating in one of the five conditions (email plus active website) on a number of the secondary measures. The 3-year follow-up will provide a stronger test of whether secondary outcomes such as anxiety sensitivity are modifiable in response to a website with email reminders and to determine whether anxiety symptoms and caseness are averted with a longer lapse of time.
The trial was funded by NHMRC Project Grant 525419. Helen Christensen is supported by NHMRC Fellowship 1056964. Philip Batterham is supported by NHMRC Fellowship 1035262. Kathleen Griffiths is supported by NHMRC Fellowship 1059620. Both Philip Batterham and Andrew Mackinnon had full access to the data in the study and had input into the final analyses. Philip Batterham takes full responsibility for the integrity of the data and the accuracy of the data analysis.
Conflicts of Interest
Griffiths is the Director of Australian National University e-hub self-help services, which delivers the public access version of e-couch GAD and co-authored the GAD stream of e-couch; Bennett is the development manager of e-hub services. Neither derives a personal financial benefit from e-couch.
Multimedia Appendix 1
CONSORT-EHEALTH checklist V1.6.2 .PDF File (Adobe PDF File), 994KB
- Kessler RC, McGonagle KA, Zhao S, Nelson CB, Hughes M, Eshleman S, et al. Lifetime and 12-month prevalence of DSM-III-R psychiatric disorders in the United States. Results from the National Comorbidity Survey. Arch Gen Psychiatry 1994 Jan;51(1):8-19. [Medline]
- Judd LL, Kessler RC, Paulus MP, Zeller PV, Wittchen HU, Kunovac JL. Comorbidity as a fundamental feature of generalized anxiety disorders: results from the National Comorbidity Study (NCS). Acta Psychiatr Scand Suppl 1998;393:6-11. [Medline]
- Tyrer P, Baldwin D. Generalised anxiety disorder. Lancet 2006 Dec 16;368(9553):2156-2166. [CrossRef] [Medline]
- Greenberg PE, Sisitsky T, Kessler RC, Finkelstein SN, Berndt ER, Davidson JR, et al. The economic burden of anxiety disorders in the 1990s. J Clin Psychiatry 1999 Jul;60(7):427-435. [Medline]
- Feldner MT, Zvolensky MJ. Prevention of anxiety psychopathology: a critical review of the empirical literature. Clinical Psychology: Science and Practice 2004;11(4):405-424. [CrossRef]
- Patel V, Flisher AJ, Hetrick S, McGorry P. Mental health of young people: a global public-health challenge. Lancet 2007 Apr 14;369(9569):1302-1313. [CrossRef] [Medline]
- Henderson M, Glozier N, Holland Elliott K. Long term sickness absence. BMJ 2005 Apr 9;330(7495):802-803 [FREE Full text] [CrossRef] [Medline]
- Kessler RC, Greenberg PE, Mickelson KD, Meneades LM, Wang PS. The effects of chronic medical conditions on work loss and work cutback. J Occup Environ Med 2001 Mar;43(3):218-225. [Medline]
- Andrews G, Issakidis C, Sanderson K, Corry J, Lapsley H. Utilising survey data to inform public policy: comparison of the cost-effectiveness of treatment of ten mental disorders. Br J Psychiatry 2004 Jun;184:526-533 [FREE Full text] [Medline]
- Institute of Medicine (US) Committee on Prevention of Mental Disorders. In: Mrazek PJ, Haggerty RJ, editors. Reducing risks for mental disorders: Frontiers for preventive intervention research. Washington, DC: National Academy Press; 1994.
- van't Veer-Tazelaar PJ, van Marwijk HW, van Oppen P, van Hout HP, van der Horst HE, Cuijpers P, et al. Stepped-care prevention of anxiety and depression in late life: a randomized controlled trial. Arch Gen Psychiatry 2009 Mar;66(3):297-304. [CrossRef] [Medline]
- van't Veer-Tazelaar PJ, van Marwijk HW, van Oppen P, van der Horst HE, Smit F, Cuijpers P, et al. Prevention of late-life anxiety and depression has sustained effects over 24 months: a pragmatic randomized trial. Am J Geriatr Psychiatry 2011 Mar;19(3):230-239. [Medline]
- Pitceathly C, Maguire P, Fletcher I, Parle M, Tomenson B, Creed F. Can a brief psychological intervention prevent anxiety or depressive disorders in cancer patients? A randomised controlled trial. Ann Oncol 2009 May;20(5):928-934 [FREE Full text] [CrossRef] [Medline]
- Dozeman E, van Marwijk HW, van Schaik DJ, Smit F, Stek ML, van der Horst HE, et al. Contradictory effects for prevention of depression and anxiety in residents in homes for the elderly: a pragmatic randomized controlled trial. Int Psychogeriatr 2012 Aug;24(8):1242-1251. [CrossRef] [Medline]
- Joling KJ, van Marwijk HW, Smit F, van der Horst HE, Scheltens P, van de Ven PM, et al. Does a family meetings intervention prevent depression and anxiety in family caregivers of dementia patients? A randomized trial. PLoS One 2012;7(1):e30936 [FREE Full text] [CrossRef] [Medline]
- Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
- Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression: systematic review. J Med Internet Res 2009;11(2):e13 [FREE Full text] [CrossRef] [Medline]
- Griffiths KM, Farrer L, Christensen H. The efficacy of internet interventions for depression and anxiety disorders: a review of randomised controlled trials. Med J Aust 2010 Jun 7;192(11 Suppl):S4-11. [Medline]
- Chiu TM, Eysenbach G. Stages of use: consideration, initiation, utilization, and outcomes of an internet-mediated intervention. BMC Med Inform Decis Mak 2010;10:73 [FREE Full text] [CrossRef] [Medline]
- Mohr DC, Duffecy J, Ho J, Kwasny M, Cai X, Burns MN, et al. A randomized controlled trial evaluating a manualized TeleCoaching protocol for improving adherence to a web-based intervention for the treatment of depression. PLoS One 2013;8(8):e70086 [FREE Full text] [CrossRef] [Medline]
- Schneider F, de Vries H, Candel M, van de Kar A, van Osch L. Periodic email prompts to re-use an internet-delivered computer-tailored lifestyle program: influence of prompt content and timing. J Med Internet Res 2013;15(1):e23 [FREE Full text] [CrossRef] [Medline]
- Woodall WG, Buller DB, Saba L, Zimmerman D, Waters E, Hines JM, et al. Effect of emailed messages on return use of a nutrition education website and subsequent changes in dietary behavior. J Med Internet Res 2007;9(3):e27 [FREE Full text] [CrossRef] [Medline]
- Farrer L, Christensen H, Griffiths KM, Mackinnon A. Internet-based CBT for depression with and without telephone tracking in a national helpline: randomised controlled trial. PLoS One 2011;6(11):e28099 [FREE Full text] [CrossRef] [Medline]
- Linden M, Zubraegel D, Baer T, Franke U, Schlattmann P. Efficacy of cognitive behaviour therapy in generalized anxiety disorders. Results of a controlled clinical trial (Berlin CBT-GAD Study). Psychother Psychosom 2005;74(1):36-42. [CrossRef] [Medline]
- Jayakody K, Gunadasa S, Hosker C. Exercise for anxiety disorders: systematic review. Br J Sports Med 2014 Feb;48(3):187-196. [CrossRef] [Medline]
- Herring MP, Jacob ML, Suveg C, Dishman RK, O'Connor PJ. Feasibility of exercise training for the short-term treatment of generalized anxiety disorder: a randomized controlled trial. Psychother Psychosom 2012;81(1):21-28. [CrossRef] [Medline]
- Borkovec TD, Costello E. Efficacy of applied relaxation and cognitive-behavioral therapy in the treatment of generalized anxiety disorder. J Consult Clin Psychol 1993 Aug;61(4):611-619. [Medline]
- McHugh RK, Whitton SW, Peckham AD, Welge JA, Otto MW. Patient preference for psychological vs pharmacologic treatment of psychiatric disorders: a meta-analytic review. J Clin Psychiatry 2013 Jun;74(6):595-602. [CrossRef] [Medline]
- Christensen H, Griffiths KM, Mackinnon AJ, Kalia K, Batterham PJ, Kenardy J, et al. Protocol for a randomised controlled trial investigating the effectiveness of an online e health application for the prevention of Generalised Anxiety Disorder. BMC Psychiatry 2010;10:25 [FREE Full text] [CrossRef] [Medline]
- Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, et al. The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10. J Clin Psychiatry 1998;59 Suppl 20:22-33;quiz 34. [Medline]
- Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
- McIntosh A, Cohen A, Turnbull N, Esmonde L, Dennis P, Eatock J. Clinical guidelines and evidence review for panic disorder and generalised anxiety disorder. Sheffield: University of Sheffield/London: National Collaborating Centre for Primary Care; 2004.
- Kenardy J, McCafferty K, Rosa V. Internet-delivered indicated prevention for anxiety disorders: a randomized controlled trial. Behav Cognit Psychother 2003;31(3):279-289. [CrossRef]
- Kenardy J, McCafferty K, Rosa V. Internet-delivered indicated prevention for anxiety disorders: six-month follow-up. Clinical Psychologist 2006;10(1):39-42. [CrossRef]
- Christensen H, Griffiths KM, Jorm AF. Delivering interventions for depression by using the internet: randomised controlled trial. BMJ 2004 Jan 31;328(7434):265 [FREE Full text] [CrossRef] [Medline]
- Calear AL, Christensen H, Mackinnon A, Griffiths KM, O'Kearney R. The YouthMood Project: a cluster randomized controlled trial of an online cognitive behavioral program with adolescents. J Consult Clin Psychol 2009 Dec;77(6):1021-1032. [CrossRef] [Medline]
- Prochaska JO, DiClemente CC. Stages and processes of self-change of smoking: toward an integrative model of change. J Consult Clin Psychol 1983 Jun;51(3):390-395. [Medline]
- Griffiths KM, Crisp D, Christensen H, Mackinnon AJ, Bennett K. The ANU WellBeing study: a protocol for a quasi-factorial randomised controlled trial of the effectiveness of an Internet support group and an automated Internet intervention for depression. BMC Psychiatry 2010;10:20 [FREE Full text] [CrossRef] [Medline]
- Fresco DM, Mennin DS, Heimberg RG, Turk CL. Using the Penn State Worry Questionnaire to identify individuals with generalized anxiety disorder: a receiver operating characteristic analysis. J Behav Ther Exp Psychiatry 2003;34(3-4):283-291. [CrossRef] [Medline]
- Peterson R, Reiss R. Anxiety Sensitivity Index Manual (2nd ed.). Worthington, OH: IDS Publishing Corporation; 1992.
- Radloff LS. The CES-D Scale: A Self-Report Depression Scale for Research in the General Population. Applied Psychological Measurement 1977 Jun 01;1(3):385-401. [CrossRef]
- Kessler RC, Berglund P, Demler O, Jin R, Koretz D, Merikangas KR, National Comorbidity Survey Replication. The epidemiology of major depressive disorder: results from the National Comorbidity Survey Replication (NCS-R). JAMA 2003 Jun 18;289(23):3095-3105. [CrossRef] [Medline]
- Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO collaborative project on early detection of persons with harmful alcohol consumption--II. Addiction 1993 Jun;88(6):791-804. [Medline]
- Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med 2001 Sep;16(9):606-613 [FREE Full text] [Medline]
- Verbeke G, Molenberghs G. Linear mixed models for longitudinal data. New York: Springer; 2000.
- Rubin DB. Multiple imputation for nonresponse in surveys. New York: Wiley; 1987.
- Kroenke K, Spitzer RL, Williams JB, Monahan PO, Löwe B. Anxiety disorders in primary care: prevalence, impairment, comorbidity, and detection. Ann Intern Med 2007 Mar 6;146(5):317-325. [Medline]
- Christensen H, Mackinnon A, Batterham P, O'Dea B, Guastella AJ, Griffiths KM, et al. The effectiveness of an online e-health application compared to attention placebo or sertraline in the treatment of generalised anxiety disorder. J Med Internet Res 2014:In Press (forthcoming).
- Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med 2006 Dec;36(12):1737-1746. [CrossRef] [Medline]
- Cuijpers P, Donker T, van Straten A, Li J, Andersson G. Is guided self-help as effective as face-to-face psychotherapy for depression and anxiety disorders? A systematic review and meta-analysis of comparative outcome studies. Psychol Med 2010 Dec;40(12):1943-1957. [CrossRef] [Medline]
- Donker T, Bennett K, Bennett A, Mackinnon A, van Straten A, Cuijpers P, et al. Internet-delivered interpersonal psychotherapy versus internet-delivered cognitive behavioral therapy for adults with depressive symptoms: randomized controlled noninferiority trial. J Med Internet Res 2013;15(5):e82 [FREE Full text] [CrossRef] [Medline]
- Bados A, Balaguer G, Saldaña C. The efficacy of cognitive-behavioral therapy and the problem of drop-out. J Clin Psychol 2007 Jun;63(6):585-592. [CrossRef] [Medline]
- Christensen H, Farrer L, Batterham PJ, Mackinnon A, Griffiths KM, Donker T. The effect of a web-based depression intervention on suicide ideation: secondary outcome from a randomised controlled trial in a helpline. BMJ Open 2013;3(6):e002886 [FREE Full text] [CrossRef] [Medline]
- Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009;11(2):e13 [FREE Full text] [CrossRef] [Medline]
- Eysenbach G, CONSORT-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
|ASI: Anxiety Sensitivity Index|
|AUDIT: Alcohol Use Disorders Identification Test|
|CBT: Cognitive Behavioral Therapy|
|CES-D: Centre for Epidemiologic Studies-Depression|
|GAD: generalized anxiety disorder|
|MAR: missing at random|
|MINI: Mini International Neuropsychiatric Interview|
|PHQ-9: Patient Health Questionnaire 9-item|
|PMR: progressive muscle relaxation|
|PSWQ: Penn State Worry Questionnaire|
Edited by G Eysenbach; submitted 01.05.14; peer-reviewed by C Reynolds III, A Parks, N Titov, C Donovan; comments to author 27.05.14; revised version received 30.06.14; accepted 04.08.14; published 02.09.14
©Helen Christensen, Philip Batterham, Andrew Mackinnon, Kathleen M Griffiths, Kanupriya Kalia Hehir, Justin Kenardy, John Gosling, Kylie Bennett. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 02.09.2014.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.