Published on in Vol 20, No 2 (2018): February

Effectiveness of a Web-Based Self-Help Program for Suicidal Thinking in an Australian Community Sample: Randomized Controlled Trial

Effectiveness of a Web-Based Self-Help Program for Suicidal Thinking in an Australian Community Sample: Randomized Controlled Trial

Effectiveness of a Web-Based Self-Help Program for Suicidal Thinking in an Australian Community Sample: Randomized Controlled Trial

Original Paper

1Centre for Mental Health Research, Australian National University, Canberra, Australia

2Black Dog Institute, Department of Medicine, University of New South Wales, Randwick, Australia

3EMGO Institute for Health Care Research, VU University Amsterdam, Amsterdam, Netherlands

4Department of Clinical Neuro and Developmental Psychology, VU University Amsterdam, Amsterdam, Netherlands

Corresponding Author:

Helen Christensen, PhD

Black Dog Institute

Department of Medicine

University of New South Wales

Hospital Road



Phone: 61 293 823 717


Background: Treatment for suicidality can be delivered online, but evidence for its effectiveness is needed.

Objective: The goal of our study was to examine the effectiveness of an online self-help intervention for suicidal thinking compared to an attention-matched control program.

Methods: A 2-arm randomized controlled trial was conducted with assessment at postintervention, 6, and, 12 months. Through media and community advertizing, 418 suicidal adults were recruited to an online portal and were delivered the intervention program (Living with Deadly Thoughts) or a control program (Living Well). The primary outcome was severity of suicidal thinking, assessed using the Columbia Suicide Severity Rating Scale.

Results: Intention-to-treat analyses showed significant reductions in the severity of suicidal thinking at postintervention, 6, and 12 months. However, no overall group differences were found.

Conclusions: Living with Deadly Thoughts was of no greater effectiveness than the control group. Further investigation into the conditions under which this program may be beneficial is now needed. Limitations of this trial include it being underpowered given the effect size ultimately observed, a high attrition rate, and the inability of determining suicide deaths or of verifying self-reported suicide attempts.

Trial Registration: Australian New Zealand Clinical Trials Registry ACTRN12613000410752; Trial/Registration/TrialReview.aspx?id=364016 (Archived by WebCite at; Universal Trial Number U1111-1141-6595

J Med Internet Res 2018;20(2):e15



Suicidal thinking is common and often precedes suicidal plans and attempts [1,2]. Effective treatments exist for suicidal thinking [3,4], but many individuals do not seek help due to factors such as low suicide literacy (ie, having little knowledge about suicidality), lack of perceived need, preference to manage the problem alone, stigma, shame, beliefs about receiving professional help, fear of hospitalization, structural factors (eg, time and finances), and having previously experienced negative encounters with health care professionals [5-9]. Providing anonymous self-help online may address these barriers to help-seeking. The internet provides an avenue to reach people with suicidal thinking and offers the potential to prevent escalation to suicidal behavior or suicide itself. While there is good evidence that Web-based programs are effective for a variety of mental health problems [10,11], suicidality is often an exclusion criteria in these trials and interventions [12].

A Dutch trial of a self-guided online intervention for suicidal thinking reported significant reductions in suicidal thoughts relative to the waitlist control condition that included access to a website with psychoeducational material about suicide [13,14]. These results require replication and extension. In the Dutch trial, respondents with a high depression and/or suicidality score were excluded, participants could not maintain anonymity as they had to provide their own and their general practitioner contact details, and follow-up was limited to 3 months. This trial evaluated an English language version of the Dutch self-help intervention, used a more broadly recruited community-based sample, did not exclude those with severe depressive symptoms, permitted anonymity, followed up over 12 months, and compared the intervention to an attention-matched control program to ensure an equal amount of material was presented to each group. It was hypothesized that, compared to controls, participants randomized to the active intervention would experience reduced severity of suicidal thinking at postintervention and 6- and 12-month follow-up. Improvements on secondary outcomes (suicidal ideation, suicidal behavior, reasons for living, perceived burdensomeness, thwarted belongingness, acquired capability, depression, hopelessness, anxiety, panic, rumination, alcohol use, insomnia, physical health, mental health, and physical functioning) were also expected. We sought to identify any potential moderating effects of sex, age, depression severity, history of attempted suicide, chronicity of suicide risk, and the effect of adherence on outcomes.

Trial Design

The study was a 2-arm randomized controlled trial delivered entirely online consisting of a treatment condition, Living with Deadly Thoughts (LwDT), and an attention-matched control condition, Living Well. There were 4 measurement occasions: baseline, postintervention (6 weeks after baseline) and 6- and 12-month follow-up. Full details on the study methodology can be found in the trial protocol [15]. The trial is reported in accordance with the CONSORT-EHEALTH checklist (see Multimedia Appendix 1).


Participants were recruited between November 2013 and December 2015 through online media forums including websites, social networking websites, and advertizing on search engines. A link to a welcome screen included an invitation to provide consent and complete the online screening procedure.

Eligibility criteria were as follows: aged 18 to 65 years, valid email address, access to a reliable internet connection, located in Australia, fluent in English, no history of a diagnosed psychotic disorder, currently experiencing suicidal thoughts, and no suicide attempts in the past month. These were assessed using single, self-report questions. Unlike the original trial [13], no restrictions were placed on the severity of suicidal thinking or depression.

Respondents who did not meet inclusion criteria were redirected to a “thank you” page listing referral information. Respondents who were excluded based on a recent suicide attempt were also provided with the opportunity to submit their phone number to receive a phone call from the Suicide Call Back Service (SCBS), a 24/7, Australia-wide, not-for-profit service that provides telephone counseling ( Participants were informed that the study was not intended to replace treatment as usual and were encouraged to seek or continue other treatment.


Active Condition: Living With Deadly Thoughts

LwDT is an adapted but closely aligned translation of the Dutch Web-based program Leven onder Controle (literally “Living under Control”). The content is drawn from principles of cognitive behavior therapy [16] and dialectical behavior therapy [17], and the program’s goal is to reduce the severity of suicidal thinking.

The program consists of 6 online modules. Participants are instructed to complete 1 module per week and to spend 30 minutes per day using the program. Each module contains 4 components: (1) theory, (2) a weekly assignment, (3) 2 to 3 exercises, and (4) optional exercises to help consolidate relevant information and skills. The modules become available in a fixed sequence, 4 days after the start of the previous module, regardless of completion, and remain available throughout the intervention period. Access to referral information via a “get help now” link is available on every Web page. A safety procedure included monitoring and intervention (if required) by the SCBS (see Safety Procedures).

Attention Control Condition: Living Well

The attention control condition was matched to the active program in length, style, and availability. It involved a 6-week modular online learning course containing lifestyle information on (1) nutrition, (2) a healthy home environment, (3) a healthy weight, (4) a healthy heart, (5) healthy skin, and (6) a healthy mouth. Participants in the control condition received the safety protocol procedure, including monitoring and intervention (if required) by the SCBS (see Safety Procedures).

Primary Outcome Measure: Severity of Suicidal Thinking

The primary outcome was severity of suicidal thinking, assessed using the Intensity of Suicidal Ideation subscale of the Columbia Suicide Severity Rating Scale (C-SSRS) [18]. This subscale comprises 5 items, each rated for frequency, duration, controllability, deterrents, and reasons for ideation.

Secondary Outcome Measures

Secondary outcome measures included presence of ideation and behavior, measured by the Suicidal Ideation and Suicidal Behavior subscales of the C-SSRS, respectively; reasons for living, using the Brief Reasons for Living Scale [19]; perceived burdensomeness and thwarted belongingness, assessed by the Interpersonal Needs Questionnaire [20]; acquired capability, measured by Acquired Capability for Suicide Scale [20]; depression, measured by Centre for Epidemiological Studies Depression Scale [21]; hopelessness, assessed by the Burns Hopelessness Scale (D Burns, personal communication); anxiety, measured by the 7-item Generalized Anxiety Disorder scale [22]; panic, using the Panic Syndrome subscale of the Brief Patient Health Questionnaire [23]; rumination, assessed by the Ruminative Response Scale [24]; alcohol consumption, using the Alcohol Use Disorders Identification Test–Consumption [25]; and insomnia, assessed by the Insomnia Severity Index [26]. Health-related quality of life was measured using the Short Form–12 [27], and health and disability were measured by the World Health Organization Disability Assessment Schedule [28]. The Suicidal Ideation Attributes Scale (SIDAS) [29] was included to validate its psychometric features.

Standard demographic information including sex, age, relationship status, education, and employment status were collected together with self-reported lifetime suicide attempts and adherence to program by website usage.

Safety Procedures

Given the vulnerable, at-risk population that this study targeted, safety procedures were designed in collaboration with the SCBS with the goal of protecting and assisting participants while enabling them to maintain anonymity within the trial and considering ethics and clinical obligations. The ability to remain autonomous in the decision to make contact with services as much as possible was also important, as this is consistent with the concept of self-help and patient empowerment.

The safety procedures required eligible participants to make contact with the SCBS during enrollment to obtain a unique identification code, so that codes rather than names could be used in all subsequent communication between the research team and SCBS. On each measurement occasion, the first 3 items of the intensity of suicidal ideation section of the C-SSRS were used to detect high risk. Scores above a specified cutoff (a score of 5 on any of these items) alerted the participant to contact the SCBS. Not doing this within 2 days triggered a reminder email to the participant, as well as a message to the SCBS asking them to contact the participant (if contact information was available, otherwise no further action was taken). The provision of contact information to the research team or to SCBS was a voluntary option at enrollment for the trial.

Conversations between participants and SCBS staff (counselors, social workers, and psychologists) were conducted according to SCBS protocols without input from the research team.

Sample Size

Power to detect change in suicidal thoughts on the C-SSRS was based on an effect size of 0.3 (Cohen d), as found in the original trial [13]. To detect this effect size with 80% power and alpha=.05, assuming r=.5 between the baseline and postintervention measures and allowing for up to 30% attrition (again informed by the previous trial), 285 participants per arm would be required to yield at least 200 completers. Therefore, the aim was to recruit 570 participants into the trial.

Randomization and Sequence Generation

Randomization to the active or control condition occurred on a 1:1 ratio using a block design (4 participants per block), stratified by sex and severity of suicidal thinking (high severity was defined as endorsing yes on the fifth item of the Suicidal Ideation subscale of the C-SSRS, which assesses active suicidal ideation, defined as having a specific plan and intent). The randomization procedure was incorporated into the website and was fully automated.


No research personnel were involved in the delivery of the interventions. Participants were not informed whether their assigned condition would receive the active or control program. However, it is likely that participants were able to discern their allocation based on the nature of the intervention they received, which increases risk of detection bias. All outcome measures were self-report and completed via an online portal. All research personnel (except those involved with the day-to-day management of the trial), remained blind to intervention allocation.


Ethical approval was obtained from the human research ethics committees of the University of New South Wales (HC13117) and the Australian National University (2012/471). The trial was registered at Australia New Zealand Clinical Trials (ACTRN12613000410752) and has a Universal Trial Number (U1111-1141-6595).

Following the screening process, eligible participants received instructions specifying that participation required making contact with the SCBS to obtain a unique identification code. Respondents provided consent, a valid email address, a name/nickname, and a telephone number (nonmandatory). Participants were then invited to complete baseline measures after which they were randomized.

Six weeks after randomization (after completing the program), participants were invited to complete the postintervention questionnaire. Follow-up assessments took place at 6- and 12-month follow-up. Participants who stopped using the program but who did not formally withdraw continued to be emailed follow-up questionnaires. Participants in the control group were given access to LwDT after the 12-month follow-up assessment.

Statistical Analysis

Primary analyses were performed on an intention-to-treat basis. All outcomes were tested using planned contrasts of mean change scores from pre- to postintervention via a mixed-model repeated measures (MMRM) analytic approach. An unstructured variance-covariance matrix was used to model within-individual dependencies. MMRM analysis uses all available data and yields estimates of effect under restricted maximum likelihood. The test of the efficacy of the intervention was based on the interaction between intervention condition and time. Supplementary analyses on the primary outcome were conducted for individuals who completed more than half of the program, as defined by completion of 4 or more of the available 6 modules. Using the whole sample, moderation of the effectiveness of the intervention by sex, age, baseline depression severity, history of suicide attempts (nil vs at least one), and chronicity of suicidal thinking (total number of months spent thinking about suicide) was examined. Moderation was tested using an identical MMRM approach with the addition of the moderating variable of interest as a factor into the model with 2- and 3-way interactions with group and time [30]. All analyses were performed using SPSS version 24 (IBM Corp).

Participant Characteristics

Participant flow is shown in Figure 1. The registration Web page received 12,474 visits during recruitment. Almost three-quarters (8829/12,474, 70.78%) of these visits were by respondents who failed to complete the screening questionnaire. Two-thirds (2394/3645, 65.68%) of those who completed screening were eligible to participate. Of these, 41.56% (995/2394) consented to participate but fewer than half (446/995, 44.8%) contacted the SCBS to obtain an identification code. Almost all (418/446, 93.7%) of those who obtained an identification code completed the baseline assessments and were randomized.

Sample characteristics are provided in Table 1. At baseline, the majority of participants were female (323/418, 77.3%), lived in a metropolitan area (253/418, 60.5%), and had completed secondary-school level education (316/418, 75.6%). A considerable proportion were married or in a de facto relationship (160/418, 38.3%). Mean age of the total sample was 40.6 (SD  11.9) years and the majority were employed (248/418, 59.3%). There were no differences at baseline between the 2 conditions in demographic characteristics (all P values were greater than .05).

On average, the severity of suicidal thinking fell in the very high range, with one-third of the sample reporting multiple past suicide attempts. Symptoms of psychopathology were elevated, including depression, hopelessness, anxiety, panic, and sleep disturbance. Compared to normative samples, health-related quality of life was lower and impairment was higher. There were no group differences on baseline clinical variables, with the exception of the intensity of suicidal thinking, which was higher in the intervention group relative to the control group, t416=2.71, P=.007.


Attrition was 45.9% (192/418) at postintervention, 65.3% (273/418) at 6 months, and 66.3% (277/418) at 12-month follow-up (see Figure 1). Chi-square tests showed that individuals who dropped out were similarly distributed across the control and intervention groups (postintervention, χ21=0.33, P=.57; 6 months, χ21=0.33, P=.56; 12 months, χ21=0.14, P=.71). Baseline characteristics of those who dropped out indicated that they were more depressed, F1,416=8.42, P=.004; more anxious, F1,416=6.53, P=.01; reported greater levels of thwarted belongingness, F1,416=6.98, P=.009; increased frequency of suicidal behaviors, F1,416=6.42, P=.01; and higher levels of disability, F1,416=6.39, P=.01.

In terms of adherence to the program, there were no significant between-group differences in the number of modules completed, χ26=9.26, P=.16. In the active intervention group, 8.2% (17/207) participants did not start the intervention (ie, did not access the first module), 91.8% (190/207) accessed at least 2 modules, 44.4% (92/207) accessed at least 3 modules, and 34.8% (72/207) accessed 4 or more modules. There were no significant between-group differences in baseline characteristics (all P values greater than .05), nor were there significant between-group differences in care received in a hospital setting, χ22=4.19, P=.12, or from a general practitioner, χ22=5.10, P=.08.

Safety Procedures

Participants who scored above the cutoff on the C-SSRS at any time during the study were telephoned by the suicide crisis help-line. More participants in the intervention condition (59/207) were called compared to those in the control condition (37/211), χ21=7.10, P=.008. Differences between groups in number of alerts per participant did not entirely explain overrepresentation of participants with alerts in the intervention group: 10 intervention versus 4 control participants had 3 or more alerts (Fisher exact test, P=.109). The breakdown of number of alerts per group is provided in Table 2.

Based on self-report data from the C-SSRS Suicidal Behavior subscale, 23 participants made a suicide attempt during the course of the study, with no differences between groups, χ21=.03, P=.87 (11 vs 12 attempts, respectively, for control and LwDT).

Intervention Effects on Primary Outcome: Severity of Suicidal Thinking

There was no overall group difference between the LwDT group and the control group on the primary outcome, severity of suicidal thinking at postintervention, t245.51=−1.20 (95% CI −1.84 to −0.44), P=.23; 6 months, t172.57=−0.88 (95% CI −2.17 to −0.84), P=.38; and 12 months, t163.89=−3.58 (95% CI −1.75 to −1.22), P=.72.

Figure 1. Participant flow diagram.
View this figure
Table 1. Sample characteristics of participants in the intervention (Living with Deadly Thoughts) and control (Living Well) groups.
CharacteristicIntervention (n=207)Control (n=211)P value
Gender (female), n (%)160 (77.3)163 (77.3).37
Age, years, mean (SD)39.53 (11.94)41.73 (11.86).06
Educational history (completed secondary school), n (%)158 (76.3)158 (74.9).42
Marital status (married or de facto), n (%)87 (42.0)73 (34.6).27
Employment (employed), n (%)121 (58.5)127 (60.2).47
Area of residence, n (%)

Metropolitan127 (61.4)126 (59.7).95

Regional, rural, or remote79 (38.2)84 (39.8).63
Lifetime history of suicide attempts, n (%)

Never90 (43.5)101 (47.9).37

Once46 (22.2)43 (20.4).65

More than once71 (34.3)67 (31.8).58
Adherence to program, n (%)

Accessed at least 4 modules71 (34.3)88 (41.7).14
Table 2. Alerts per group.
Number of alertsIntervention (n=207)Control (n=211)

However, both groups showed significant reductions in the severity of suicidal thinking relative to baseline at postintervention, t244.85=−4.55, P<.001 (95% CI −2.64 to −1.05), d=0.56; 6-month follow-up, t171.78=−5.46, P<.001 (95% CI −3.9 to −1.83), d=0.72; and 12-month follow-up, t163.93=−6.72, P<.001 (95% CI −4.55 to −2.48), d=0.77.

Participants who completed at least 4 of the 6 modules in the LwDT condition were compared to those who completed at least 4 modules of the control program. Analyses indicated that completers of the LwDT program experienced a reduction in severity of suicidal thinking relative to completers of the control program at posttest, t150.45=−2.16, P=.033 (95% CI –2.95 to –0.12), d= 0.60, but not at 6-month, t117.62=−1.40, P=.17, or 12-month follow-up, t108.02=.57, P=.57.

Moderation of Intervention Effects on Severity of Suicidal Thinking

Moderation of the effectiveness of the intervention by sex, age, baseline depressive symptoms, history of attempted suicide, and chronicity of suicidal thinking was investigated by examining 3-way interactions between group, time, condition, and the moderating variable of interest. Severity of suicidal thinking was not moderated by sex, F3,178.36=1.56, P=.20; age, F3,177.43=0.43, P=.73; baseline depression symptoms, F3,192.9=0.52, P=.70; or history of previous attempts, F3,182.21=0.31, P=.82. However, a moderation effect on the primary outcome was detected for chronicity of suicidal thinking, F3,187.37=3.13, P=.03, with evidence that the LwDT program was more effective at reducing the severity of suicidal thinking in participants who had spent less time (fewer months) thinking about suicide.

Intervention Effects on Secondary Outcomes

The LwDT program, compared with the LW program, had no significant effect on secondary outcomes except for anxiety (see Multimedia Appendix 2), which showed a greater decrease at 12 months (t185.55=−2.04, P=.04). This effect was not significant at posttest (P=.65) or 6 months (P=.17).

Across both groups (LwDT and Living Well) there was a significant reduction at all time points in the following: suicidal ideation (as measured by the C-SSRS and by the SIDAS), suicidal behavior, burdensomeness, depression, hopelessness, anxiety, panic, physical health, mental health, and physical functioning. There were also significant decreases in both groups for thwarted belongingness at 6- and 12-month follow-up, rumination at 6- and 12-month follow-up, and sleep difficulties at posttest and 12-month follow-up. Test statistics for these within-group comparisons are available from the authors upon request.

Variables that did not significantly improve over time were acquired capability for suicide, reasons for living, and alcohol use, although a group difference emerged at 12-month follow-up, with those in the intervention group having lower alcohol use scores than those in the control group, t145.59=–2.152, P=.03.

Principal Findings

Regardless of intervention allocation, participants’ level of suicidal thinking reduced over time, with no difference between the groups at postintervention or 6- or 12-month follow-up. Also, there was no evidence of between-group differences on most of the secondary variables.

These findings are discrepant from the original study of LwDT, where a significant difference was found for the intervention compared to a waitlist control group in suicidal thoughts and worry [13]. Several differences between these studies may account for this. First, the sample in the current trial was more severe than those in the original trial, both in terms of suicidality and depression. If the same criteria had been used in the original trial, 50% of those entering this trial would have been excluded. The findings from the moderation analysis might be interpreted to suggest that the intervention is indeed more suitable for those with less chronic suicidal thinking, as these participants had better outcomes. Severe levels of suicidality and depression are associated with poor motivation and impaired cognitive functioning, including poor concentration and attention [31]. However, baseline level of depression did not impact the effectiveness of the intervention, although the possibility remains that suicidal severity could interfere with program completion. It should also be noted here that the Dutch trial found more pronounced effects for severe suicidality [13,32], which contradicts the current findings. Another possibility relates to help-negation, which is the decreased propensity to engage in help-seeking behaviors as a consequence of more severe levels of suicidal ideation. Individuals who dropped out of the study after baseline had more severe levels of depression, anxiety, and suicidal behaviors, a finding that indicates that severe symptoms may interfere with completion of the program and that LwDT may be better suited to individuals with moderate symptom levels and less severe suicidality.

A second difference is that the original study involved a waitlist control condition, while the present trial had an attention-control condition. A number of features of the control intervention, including the fortnightly monitoring during the active phase, risk-triggered alerts, proactive follow-ups (if required) by the SCBS, and delivery of helpful lifestyle materials may have contributed to the reduction in suicidality, in addition to an expected standard placebo effect. The proactive nature of the intervention in the control group may have contributed to the improvement over time, obscuring any addition impact of the LwDT intervention. The monitoring of suicide ideation itself combined with the intervention by the call back service provides a safety protocol procedure that is known to have an effect [33].

A key procedural aim of this study was to provide LwDT without requiring participants to register with their doctors. Lack of anonymity poses an obstacle to help-seeking for many individuals [34]. Although the involvement of SCBS provided a solution to the issue of anonymity, it unfortunately created another challenge. Some participants attempted to call and, as is the case with many crisis services, were placed on hold and unable to register for the trial immediately. Some participants provided anecdotal reports of attempting to get through several times before giving up. Others indicated that they did not wish to contact SCBS for a range of reasons, including previous negative experiences with crisis support helpline services. Of the participants who provided consent, 55% did not go on to register with SCBS and were therefore unable to take part in the trial. LwDT, if delivered under real-world conditions outside the context of a research trial, would not require compulsory contact with a crisis support service such as SCBS. In the current context, it is a limitation that created a barrier to participation and may impact the generalizability of results.

A related issue was attrition and the role that general practitioners may have played in the original trial. In this study, attrition was 46% at postintervention, which is at the higher end of rates of attrition of online interventions [35,36]. However, these rates refer to depression and anxiety online treatment programs and not programs specifically for suicidality. For online treatments, predictors of dropout include severity and chronicity [35]. Although speculative, it is likely that the severely suicidal nature of the sample in this trial may have contributed to the relatively high level of dropout. The dropout rate in this study was also higher than that in the original trial (11%), which most likely arose as a product of 2 factors: the monitoring role played by the participants’ regular doctor and the exclusion of severely suicidal and depressed participants. Some online programs that are completed in combination with professional support report lower rates of attrition [37].

The difference in number of alerts in this trial between the groups was also notable, with significantly more alerts triggered in the intervention group. This difference was not observed in the Dutch trial. Reasons for this difference are speculative but may be due to an imbalance of high-need people between the groups (as intensity of suicidal ideation was higher at baseline in the intervention group). Alternatively, the high alert rate may indicate that the intervention has an effect on help-seeking from a telephone helpline—something that is actively encouraged in the LwDT program. As registration with a helpline was mandatory for this trial, this may have lowered the threshold for calling, a factor that did not apply in the Dutch trial.


The current trial had a number of other limitations. First, the target sample size for the trial was not met due to time constraints. The study was therefore underpowered and, given the high attrition rate, any smaller differences would not have been detected. Determination of any deaths by suicide was not possible within the context of the trial, given the lack of access to official records and anonymity of the participants. While this trial was not powered to detect group-level differences in attempted suicides or suicide deaths, future trials in this field recruiting larger numbers of participants would do well to incorporate an analysis of patient records to assess deaths by suicide over an extended period. Further, the incidence of suicide attempts could not be verified given the reliance on self-report rather than hospital and medical records.


The results of this study indicate that completing an online intervention is associated with reduced suicidal thinking and psychological symptoms over time, but this may be due to the exposure to a structured program, monitoring, and safety procedures. Further assessment with a waitlist control group would be required to confirm any advantage of the structured program above that of the safety procedures, and such a trial is unlikely to receive ethical approval.

This study has several clinical and research implications. Overall, there was no evidence that the LwDT program is harmful and, looking to the original Dutch trial, may be beneficial to those who have a less chronic history of suicidal thinking. This is consistent with clinical guidelines for the use of low-intensity interventions (ie, National Institute for Health and Care Excellence guidelines) for individuals who have low to moderate symptom levels. However, with the Dutch trial indicating more pronounced effects for people with a history of suicide attempt and this trial showing less effectiveness for those with a longer history of suicidal thinking, future research should investigate what target group might benefit most from online self-help, what adjustments might need to be made to the program to accommodate for various degrees of suicidality, and how the delivery of the program might improve outcomes at both ends of the spectrum. For example, incorporation in a stepped care model or tailoring of the program to individual needs might increase effectiveness across levels of severity.

Furthermore, the results that were achieved are of interest because they suggest that interventions are associated with a drop in symptoms. Research in support of crisis lines is also built on this type of outcome study and used to support their effectiveness. Also notable, with respect to helplines, is that even though it would make sense to implement programs such as LwDT in organizations that provide crisis support, less than half of eligible respondents enrolled with the SCBS, indicating that this could also be a deterrent. This should be taken into account when preparing such programs for use outside of a research context. Finally, the type of high-quality trial methodology—a randomized controlled trial—such as ours may not be the best methodology to observe outcomes, given the constraints outlined above.

We have shown that the provision of a self -help program via the internet is feasible but that further research is needed to better understand the types of interventions, both online and offline, that could assist people experiencing suicide ideation and the most useful settings in which to situate these interventions.


Sincere thanks to Anna Frayne and Kale Dyer, who provided support in the management of the trial. This study was supported by a grant from the Australian National Health and Medical Research Council (NHMRC; GNT1046317) and forms part of the program of research conducted by the NHMRC Centre of Research Excellence in Suicide Prevention (GNT1042580). The funder does not have any role or ultimate authority in the study design; collection, management, analysis, and interpretation of data; writing of the report; or the decision to submit the report for publication. AC is supported by NHMRC Early Career Fellowship 1122544. PB is supported by NHMRC Early Career Fellowship 1083311. HC is supported by NHMRC Fellowship 1056964.

Authors' Contributions

HC and BAJvS designed the study and oversaw trial implementation, data collection, and interpretation. BAJvS and AJFMK conducted the original study in the Netherlands on which the current trial was based. BAJvS, HC , PJP, AM, AJFMK, and JAG obtained study funding. AWS and DS managed the trial. AWS conducted statistical analyses that were overseen by the trial statisticians, PJP and AM. FS provided clinical support on the trial. AWS and HC wrote the manuscript. All authors have read and provided revisions of the final manuscript.

Conflicts of Interest

BAJvS and AJFMK are authors of the Dutch Web-based program described in this manuscript. BAJvS and AJFMK are also authors of and receive royalties from an adapted paper version of the self-help program published under the title Piekeren Over Zelfdoding [38]. BAJvS, AJFMK, and HC are authors of the English translation of the Web-based program described in this manuscript.

Multimedia Appendix 1

CONSORT‐EHEALTH checklist (V 1.6.1).

PDF File (Adobe PDF File), 253KB

Multimedia Appendix 2

Estimated marginal means from mixed-model repeated measures for primary and secondary outcomes at each time point for the intervention condition.

PDF File (Adobe PDF File), 39KB


  1. Nock MK, Borges G, Bromet EJ, Alonso J, Angermeyer M, Beautrais A, et al. Cross-national prevalence and risk factors for suicidal ideation, plans and attempts. Br J Psychiatry 2008 Feb;192(2):98-105 [FREE Full text] [CrossRef] [Medline]
  2. Mental health: suicide prevention. Geneva: World Health Organization; 2014.   URL: [accessed 2017-07-27] [WebCite Cache]
  3. Zalsman G, Hawton K, Wasserman D, van Heeringen K, Arensman E, Sarchiapone M. Suicide prevention strategies revisited: 10-year systematic review. Lancet Psychiatry 2016;3(7):10. [CrossRef]
  4. Brown GK, Jager-Hyman S. Evidence-based psychotherapies for suicide prevention: future directions. Am J Prev Med 2014 Sep;47(3 Suppl 2):S186-S194. [CrossRef] [Medline]
  5. Bruffaerts R, Demyttenaere K, Hwang I, Chiu W, Sampson N, Kessler RC, et al. Treatment of suicidal people around the world. Br J Psychiatry 2011 Jul;199(1):64-70 [FREE Full text] [CrossRef] [Medline]
  6. Calear AL, Batterham PJ, Christensen H. Predictors of help-seeking for suicidal ideation in the community: risks and opportunities for public suicide prevention campaigns. Psychiatry Res 2014 Nov 30;219(3):525-530. [CrossRef] [Medline]
  7. Johnston AK, Pirkis JE, Burgess PM. Suicidal thoughts and behaviours among Australian adults: findings from the 2007 National Survey of Mental Health and Wellbeing. Aust N Z J Psychiatry 2009 Jul;43(7):635-643. [CrossRef] [Medline]
  8. Rickwood DJ, Braithwaite VA. Social-psychological factors affecting help-seeking for emotional problems. Soc Sci Med 1994 Aug;39(4):563-572. [Medline]
  9. Hom MA, Stanley IH, Joiner TE. Evaluating factors and interventions that influence help-seeking and mental health service utilization among suicidal individuals: a review of the literature. Clin Psychol Rev 2015 Aug;40:28-39. [CrossRef] [Medline]
  10. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry 2014 Oct;13(3):288-295 [FREE Full text] [CrossRef] [Medline]
  11. Andrews G, Cuijpers P, Craske MG, McEvoy P, Titov N. Computer therapy for the anxiety and depressive disorders is effective, acceptable and practical health care: a meta-analysis. PLoS One 2010;5(10):e13196 [FREE Full text] [CrossRef] [Medline]
  12. Waller R, Gilbody S. Barriers to the uptake of computerized cognitive behavioural therapy: a systematic review of the quantitative and qualitative evidence. Psychol Med 2009 May;39(5):705-712. [CrossRef] [Medline]
  13. van Spijker BAJ, van Straten A, Kerkhof AJFM. Effectiveness of online self-help for suicidal thoughts: results of a randomised controlled trial. PLoS One 2014;9(2):e90118 [FREE Full text] [CrossRef] [Medline]
  14. van Spijker BAJ, van Straten A, Kerkhof AJFM. The effectiveness of a web-based self-help intervention to reduce suicidal thoughts: a randomized controlled trial. Trials 2010;11:25 [FREE Full text] [CrossRef] [Medline]
  15. van Spijker BAJ, Calear AL, Batterham PJ, Mackinnon AJ, Gosling JA, Kerkhof AJFM, et al. Reducing suicidal thoughts in the Australian general population through web-based self-help: study protocol for a randomized controlled trial. Trials 2015;16:62 [FREE Full text] [CrossRef] [Medline]
  16. Wenzel A, Brown G, Beck A. Cognitive Therapy for Suicidal Patients: Scientific and Clinical Applications. Arlington: American Psychological Association; 2009.
  17. Linehan M. Cognitive-Behavioral Treatment of Borderline Personality Disorder. New York: Guilford Press; 1993.
  18. Posner K, Brown GK, Stanley B, Brent DA, Yershova KV, Oquendo MA, et al. The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. Am J Psychiatry 2011 Dec;168(12):1266-1277 [FREE Full text] [CrossRef] [Medline]
  19. Osman A, Kopper BA, Barrios FX, Osman JR, Besett T, Linehan MM. The Brief Reasons for Living Inventory for Adolescents (BRFL-A). J Abnorm Child Psychol 1996 Aug;24(4):433-443. [Medline]
  20. Van Orden KA, Witte TK, Gordon KH, Bender TW, Joiner TE. Suicidal desire and the capability for suicide: tests of the interpersonal-psychological theory of suicidal behavior among adults. J Consult Clin Psychol 2008 Feb;76(1):72-83. [CrossRef] [Medline]
  21. Radloff LS. The CES-D scale: a self-report depression scale for research in the general population. Appl Psychol Meas 1977 Jun 01;1(3):385-401. [CrossRef]
  22. Spitzer RL, Kroenke K, Williams JBW, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
  23. Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. JAMA 1999 Nov 10;282(18):1737-1744. [Medline]
  24. Nolen-Hoeksema S, Morrow J. A prospective study of depression and posttraumatic stress symptoms after a natural disaster: the 1989 Loma Prieta Earthquake. J Pers Soc Psychol 1991 Jul;61(1):115-121. [Medline]
  25. Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA. The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Arch Intern Med 1998 ;158(16):1789-1795. [Medline]
  26. Morin CM, Belleville G, Bélanger L, Ivers H. The Insomnia Severity Index: psychometric indicators to detect insomnia cases and evaluate treatment response. Sleep 2011 May 01;34(5):601-608 [FREE Full text] [Medline]
  27. Ware JE, Kolinski M, Keller SD. How to Score the SF-12 Physical and Mental Health Summaries: A User’s Manual. Boston, MA: The Health Institute, New England Medical Centre; 1995.
  28. Ustün T, Kostanjsek N, Chatterji S, Rehm J. Measuring Health and Disability: Manual for WHO Disability Assessment Schedule (WHODAS 2.0). Geneva: World Health Organization; 2010.
  29. van Spijker BAJ, Batterham PJ, Calear AL, Farrer L, Christensen H, Reynolds J, et al. The suicidal ideation attributes scale (SIDAS): community-based validation study of a new scale for the measurement of suicidal ideation. Suicide Life Threat Behav 2014 Aug;44(4):408-419. [CrossRef] [Medline]
  30. Kraemer HC, Frank E, Kupfer DJ. Moderators of treatment outcomes: clinical, research, and policy importance. JAMA 2006 Sep 13;296(10):1286-1289. [CrossRef] [Medline]
  31. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders. 5th Edition. Arlington: American Psychiatric Association; 2013.
  32. Madsen T, van Spijker B, Karstoft K, Nordentoft M, Kerkhof AJ. Trajectories of suicidal ideation in people seeking Web-based help for suicidality: secondary analysis of a Dutch randomized controlled trial. J Med Internet Res 2016 Jun 30;18(6):e178 [FREE Full text] [CrossRef] [Medline]
  33. Stanley B, Brown GK. Safety planning intervention: a brief intervention to mitigate suicide risk. Cogn Behav Pract 2012 May;19(2):256-264. [CrossRef]
  34. Michelmore L, Hindley P. Help-seeking for suicidal thoughts and self-harm in young people: a systematic review. Suicide Life Threat Behav 2012 Oct;42(5):507-524. [CrossRef] [Medline]
  35. Christensen H, Griffiths KM, Farrer L. Adherence in internet interventions for anxiety and depression. J Med Internet Res 2009;11(2):e13 [FREE Full text] [CrossRef] [Medline]
  36. van Ballegooijen W, Cuijpers P, van Straten A, Karyotaki E, Andersson G, Smit JH, et al. Adherence to Internet-based and face-to-face cognitive behavioural therapy for depression: a meta-analysis. PLoS One 2014;9(7):e100674 [FREE Full text] [CrossRef] [Medline]
  37. Spek V, Cuijpers P, Nyklícek I, Riper H, Keyzer J, Pop V. Internet-based cognitive behaviour therapy for symptoms of depression and anxiety: a meta-analysis. Psychol Med 2007 Mar;37(3):319-328. [CrossRef] [Medline]
  38. van Spijken B, Kerkhof A. Piekeren Over Zelfdoding. Amsterdam: Boom; 2012.

C-SSRS: Columbia Suicide Severity Rating Scale
LwDT: Living with Deadly Thoughts
MMRM: mixed-model repeated measures
NHMRC: National Health and Medical Research Council
SCBS: Suicide Call Back Service
SIDAS: Suicidal Ideation Attributes Scale

Edited by G Eysenbach; submitted 30.07.17; peer-reviewed by S Hetrick, C Wilks; comments to author 24.08.17; revised version received 20.09.17; accepted 29.10.17; published 14.02.18


©Bregje AJ van Spijker, Aliza Werner-Seidler, Philip J Batterham, Andrew Mackinnon, Alison L Calear, John A Gosling, Julia Reynolds, Ad JFM Kerkhof, Daniela Solomon, Fiona Shand, Helen Christensen. Originally published in the Journal of Medical Internet Research (, 14.02.2018.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.