Published on in Vol 14, No 3 (2012): May-Jun

Beyond Efficacy: The Depth and Diversity of Current Internet Interventions

Beyond Efficacy: The Depth and Diversity of Current Internet Interventions

Beyond Efficacy: The Depth and Diversity of Current Internet Interventions


1Black Dog Institute, University of New South Wales, Sydney, NSW, Australia

2Centre for Mental Health Research, The Australian National University, Canberra, Australia

3Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden

4Department of Psychiatry and Neurobehavioral Sciences, University of Virginia Health System, Charlottesville, VA, United States

Corresponding Author:

Helen Christensen, PhD

Black Dog Institute

University of New South Wales

Hospital Road


Sydney, NSW, 2031


Phone: 61 2 9382 9288

Fax:61 2 9382 8208


This issue of the Journal of Medical Internet Research (JMIR) brings together nine papers selected from presentations at the 5th International Conference of the International Society for Research on Internet Interventions (ISRII) held in Sydney, Australia in 2011. The papers highlight the depth and diversity of our field and reflect some of the current major research themes, including issues of stigma, new modes of intervention delivery, tailoring, the role of support, mechanisms of change, target audience considerations, new theoretical approaches, and further grounding in models and frameworks. The field is pushing beyond efficacy trials to better understand when, how, and why Internet interventions work. As was true of many of the presentations at ISRII, this set of papers makes a substantive contribution to our field’s understanding of how to reduce mental and behavioral health problems (for example, depression, anxiety, smoking), improve mental health literacy and knowledge, and encourage help-seeking. In the remaining paragraphs, we summarize several key points on how each paper contributes to the broader research picture in these areas, suggesting future paths of research.

Stigmatizing attitudes and beliefs towards mental health disorders is a significant problem in the community, with mental health stigma associated with poor help-seeking behavior and treatment adherence. A number of effective programs have been developed to address mental health stigma in the community. These have included programs aimed at challenging stereotypes and increasing knowledge through education and/or personal contact with a person with a mental health problem [1, 2]. The paper by Gulliver et al. [3] presents the efficacy of two brief online interventions to promote help-seeking behavior in elite athletes, with the study suggesting that an online mental health literacy intervention can reduce depression and anxiety stigma. Online interventions such as this one have the potential to reach a broad audience and may be a cost-effective way of reducing stigma in the community. The paper by Farrer and colleagues [4] further supports the effectiveness of online interventions in reducing depression stigma, finding significantly lower levels of stigma amongst participants completing an online cognitive behavior therapy (CBT) program for depression.

Kauer et al. [5] continued the field’s investigation of using technology to treat depression, but examined the use of mobile phone self-monitoring in a group of adolescents with mild depressive symptoms. The authors found that self-monitoring increased emotional self-awareness which in turn mediated decreases in depressive symptoms. Monitoring symptoms and activities by means of mobile phone technology is likely to become even more common in research given increased use of smart phones in daily life. Smart phones are also extending the reach of these interventions to patient groups with historically limited Internet access.

Tailored Internet interventions are also being more readily developed and studied. Rather than offering the same intervention to all users, harnessing the full capabilities of the technology allows these interventions to be tailored to specific user characteristics (for example, symptom level, age). Silfvernagel et al. [6] report data from a controlled trial in which individually tailored, guided cognitive-behavior therapy was tested for persons with panic symptoms. Findings suggest that tailoring the Internet intervention to this patient population was feasible and efficacious, adding to the previous promising findings with large effect sizes [7, 8].

The role of support in Internet interventions has been discussed over the years, with considerable debate about whether support is necessary to achieve optimal outcomes, and, if so, at what cost [7, 9-14]. Support can be provided via multiple formats (for example, personalized emails, texts, phone calls) and can occur at various points in the intervention. Three papers in this special edition address the issue of support by exploring whether clinician delivered, clinician guided, guided or self-guided interventions are equally effective, as well as for whom and when (see [4, 6, 15]). The trial by Farrer et al. was conducted in a national helpline setting and compared outcomes among participants who received: 1) web-based CBT for depression; 2) web-based CBT plus telephone tracking; 3) weekly telephone tracking only; or 3) neither web CBT nor telephone tracking. In this study, telephone support during the actual treatment did not affect outcome, indicating that the temporal aspects of support and contact need to be further investigated [4]. In the Silfvernagel et al. paper [6] mentioned above, the tailored intervention for panic used online therapist guidance to support users. Overall, the role of support and better definitions of precisely what support entails, warrants further evaluation.

Anderson and colleagues [15] examined a therapist guided Internet intervention in which adolescents and children with anxiety disorders, as well as their parents, were included. Borrowing a concept from traditional face-to-face psychotherapy, the authors investigated the role of working alliance, a term to describe the collaboration between a patient and a therapist. In line with previous studies on adult patients [16, 17], high ratings of working alliance were found, even equivalent to what was observed in clinic-based treatment. Alliance also predicted adherence and outcome for the adolescents but not for the younger children. The findings from this study highlight the importance of investigating differences and similarities between traditional and Internet interventions, as well as the importance of examining mechanisms of change within Internet interventions.

The use of Internet interventions as a means of addressing problematic behaviors, including substance use, is now well established. A review by Riper and colleagues [18] found that even a single session achieves effects of a similar magnitude to that found for in-person brief alcohol interventions [19] with multi-session interventions producing significantly larger effects. However, much of the research in this field has utilized university samples that can be expected to have higher levels of computer literacy than the general community [20], leaving the effectiveness of Internet interventions in larger populations open to question. The paper by Muñoz et al. addresses this issue, at least in the context of the cessation of smoking [21]. Having demonstrated the efficacy of the combined Spanish / English language San Francisco Stop Smoking Internet site, the resource was opened to the general public (aged 18 or over). With participants from more than 150 counties, the observed quit rate at 12 months (45%) was higher than the baseline trial and incurred minimal costs. High rates of substance use frequently co-occur with other mental health problems [22]. Although, there have been interventions developed specifically addressing those with comorbid alcohol and depression [23], the paper by Farrer et al. [4] shows significant short-term reductions in hazardous alcohol use as a secondary effect of an intervention for depression.

An alternative approach to smoking cessation is through the use of online social networks. Popular components of Web-Assisted Tobacco Interventions (WATIs) are social support networks or discussion boards [24]. The paper by van Mierlo and colleagues [24] provides an analysis of the categories of users who post to discussion boards on WATIs. Similar typographies of users were found from a publicly funded resource (Smokers Helpline Online) and from a social enterprise site ( Of particular interest was the finding that a sub-group (termed “superusers”) who represented less than 1% of registrants accounted for 35-45% of all posts. An earlier review noted the paucity of evidence for the effectiveness of Internet Support Groups [25]. The findings by the van Mierlo team highlight a particular group for specific research attention in the future, given their likely impact on the tone and outcomes of discussion boards.

Another theme within Internet intervention research is consideration of the target audience; in this special issue, some papers evaluate treatment interventions targeted at symptomatic individuals (see [5, 6, 15]) and others examine the value of public health interventions (see [21, 26]), including in the novel area of online social networks (see [24]). Within Internet-delivered interventions, the major approach remains cognitive behavioral therapy (see [5, 6, 15]), but research is also being conducted with different theoretical approaches, including positive psychology (see [26]). The field is also examining its grounding within various theoretical frameworks, and the paper written by Hilgart and colleagues proposes using a proven methodology (instructional design models) to guide the planning, development, and implementation of Internet interventions [27].

In conclusion, this theme issue demonstrates the breadth of research being conducted within the International Society for Research on Internet Interventions. It shows how rapidly the field is moving forward, pushing beyond initial feasibility and efficacy trials to more nuanced questions, such as the testing of different levels of support, various technologies, potential mechanisms of change, and implementation on a public health scale. The field is well grounded in theoretical models of behavior change, but is calling for more theory-based intervention planning, design, and development. The rich array of research questions and investigations in this special edition shows the field is advancing to not only raising questions for specific populations or specific intervention types, but instead raising research questions for the field as a whole. The papers clearly suggest new lines of research for the future and show the promise of this emerging field.

Conflicts of Interest

None declared.

  1. Pinto-Foltz MD, Logsdon MC. Reducing stigma related to mental disorders: initiatives, interventions, and recommendations for nursing. Arch Psychiatr Nurs 2009 Feb;23(1):32-40. [CrossRef] [Medline]
  2. Schachter HM, Girardi A, Ly M, Lacroix D, Lumb AB, van Berkom J, et al. Effects of school-based interventions on mental health stigmatization: a systematic review. Child Adolesc Psychiatry Ment Health 2008;2(1):18 [FREE Full text] [CrossRef] [Medline]
  3. Gulliver A, Griffiths KM, Christensen H, Mackinnon A, Calear AL, Parsons A, et al. Internet-Based Interventions to Promote Mental Health Help-Seeking in Elite Athletes: An Exploratory Randomized Controlled Trial. J Med Internet Res 2012;14(3):e69 [FREE Full text] [CrossRef]
  4. Farrer L, Christensen H, Griffiths KM, Mackinnon A. Web-Based Cognitive Behavior Therapy for Depression With and Without Telephone Tracking in a National Helpline: Secondary Outcomes From a Randomized Controlled Trial. J Med Internet Res 2012;14(3):e68 [FREE Full text] [CrossRef]
  5. Kauer SD, Reid SC, Crooke AHD, Khor A, Hearps SJC, Jorm AF, et al. Self-monitoring Using Mobile Phones in the Early Stages of Adolescent Depression: Randomized Controlled Trial. J Med Internet Res 2012;14(3):e67 [FREE Full text] [CrossRef]
  6. Silfvernagel K, Carlbring P, Kabo J, Edström S, Eriksson J, Månson L, et al. Individually Tailored Internet-Based Treatment for Young Adults and Adults With Panic Attacks: Randomized Controlled Trial. J Med Internet Res 2012;14(3):e65 [FREE Full text] [CrossRef]
  7. Carlbring P, Maurin L, Törngren C, Linna E, Eriksson T, Sparthan E, et al. Individually-tailored, Internet-based treatment for anxiety disorders: A randomized controlled trial. Behav Res Ther 2011 Jan;49(1):18-24. [CrossRef] [Medline]
  8. Johansson R, Sjöberg E, Sjögren M, Johnsson E, Carlbring P, Andersson T, et al. Tailored vs. Standardized Internet-Based Cognitive Behavior Therapy for Depression and Comorbid Symptoms: A Randomized Controlled Trial. PLoS One 2012;7(5):e36905 [FREE Full text] [CrossRef] [Medline]
  9. Andersson G, Lundström P, Ström L. Internet-based treatment of headache: does telephone contact add anything? Headache 2003 Apr;43(4):353-361. [Medline]
  10. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
  11. Buhrman M, Fältenhag S, Ström L, Andersson G. Controlled trial of Internet-based treatment with telephone support for chronic back pain. Pain 2004 Oct;111(3):368-377. [CrossRef] [Medline]
  12. Christensen H, Griffiths KM, Mackinnon AJ, Brittliffe K. Online randomized controlled trial of brief and full cognitive behaviour therapy for depression. Psychol Med 2006 Dec;36(12):1737-1746. [CrossRef] [Medline]
  13. Kenardy J, McCafferty K, Rosa V. Internet-delivered indicated prevention for anxiety disorders: a randomized controlled trial. Behavioural and Cognitive Psychotherapy 2003;31(3):279-283.
  14. Muñoz RF. Using evidence-based internet interventions to reduce health disparities worldwide. J Med Internet Res 2010;12(5):e60 [FREE Full text] [CrossRef] [Medline]
  15. Anderson REE, Spence SH, Donovan CL, March S, Prosser S, Kenardy J. Working Alliance in Online Cognitive Behavior Therapy for Anxiety Disorders in Youth: Comparison With Clinic Delivery and its Role in Predicting Outcome. J Med Internet Res 2012;14(3):e88 [FREE Full text] [CrossRef]
  16. Klein B, Mitchell J, Gilson K, Shandley K, Austin D, Kiropoulos L, et al. A therapist-assisted Internet-based CBT intervention for posttraumatic stress disorder: preliminary results. Cogn Behav Ther 2009 Jun;38(2):121-131. [CrossRef] [Medline]
  17. Knaevelsrud C, Maercker A. Internet-based treatment for PTSD reduces distress and facilitates the development of a strong therapeutic alliance: a randomized controlled clinical trial. BMC Psychiatry 2007;7:13 [FREE Full text] [CrossRef] [Medline]
  18. Riper H, Spek V, Boon B, Conijn B, Kramer J, Martin-Abello K, et al. Effectiveness of E-self-help interventions for curbing adult problem drinking: a meta-analysis. J Med Internet Res 2011;13(2):e42 [FREE Full text] [CrossRef] [Medline]
  19. Moyer A, Finney JW, Swearingen CE, Vergun P. Brief interventions for alcohol problems: a meta-analytic review of controlled investigations in treatment-seeking and non-treatment-seeking populations. Addiction 2002 Mar;97(3):279-292. [Medline]
  20. White A, Kavanagh D, Stallman H, Klein B, Kay-Lambkin F, Proudfoot J, et al. Online alcohol interventions: a systematic review. J Med Internet Res 2010;12(5):e62 [FREE Full text] [CrossRef] [Medline]
  21. Muñoz RF, Aguilera A, Schueller SM, Leykin Y, Pérez-Stable EJ. From Online Randomized Controlled Trials to Participant Preference Studies: Morphing the San Francisco Stop Smoking Site into a Worldwide Smoking Cessation Resource. J Med Internet Res 2012;14(3):e64 [FREE Full text] [CrossRef]
  22. Kessler RC, Crum RM, Warner LA, Nelson CB, Schulenberg J, Anthony JC. Lifetime co-occurrence of DSM-III-R alcohol abuse and dependence with other psychiatric disorders in the National Comorbidity Survey. Arch Gen Psychiatry 1997 Apr;54(4):313-321. [Medline]
  23. Kay-Lambkin FJ, Baker AL, Lewin TJ, Carr VJ. Computer-based psychological treatment for comorbid depression and problematic alcohol and/or cannabis use: a randomized controlled trial of clinical efficacy. Addiction 2009 Mar;104(3):378-388. [CrossRef] [Medline]
  24. van Mierlo T, Voci S, Lee S, Fournier R, Selby P. Superusers in Social Networks for Smoking Cessation: Analysis of Demographic Characteristics and Posting Behavior From the Canadian Cancer Society's Smokers' Helpline Online and J Med Internet Res 2012;14(3):e66 [FREE Full text] [CrossRef]
  25. Griffiths KM, Calear AL, Banfield M. Systematic review on Internet Support Groups (ISGs) and depression (1): Do ISGs reduce depressive symptoms? J Med Internet Res 2009;11(3):e40 [FREE Full text] [CrossRef] [Medline]
  26. Schueller SM, Parks AC. Disseminating Self-Help: Positive Psychology Exercises in an Online Trial. J Med Internet Res 2012;14(3):e63 [FREE Full text] [CrossRef]
  27. Hilgart MM, Ritterband LM, Thorndike FP, Kinzie MB. Using Instructional Design Process to Improve Design and Development of Internet Interventions. J Med Internet Res 2012;14(3):e89 [FREE Full text] [CrossRef]

Edited by G Eysenbach; This is a non–peer-reviewed article. submitted 04.06.12; accepted 11.06.12; published 29.06.12


©Helen Christensen, Alison L Calear, Gerhard Andersson, Frances P Thorndike, Robert J Tait. Originally published in the Journal of Medical Internet Research (, 29.06.2012.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.