This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.
Background
Depression is a common and serious problem among adolescents, but few seek or have access to therapy. Internet-delivered cognitive behavioral therapies (ICBTs), developed to increase treatment access, show promise in reducing depression. The inclusion of coach support in treatment is desired and may be needed.
Objective
The aim of this study was to determine the efficacy of an ICBT protocol blended with weekly real-time therapist sessions via chat; blended treatment, for adolescent depression, including major depressive episode (MDE). The protocol has previously been evaluated in a controlled study.
Methods
In a two-arm randomized controlled trial, adolescents 15 to 19 years of age were recruited through a community setting at the national level in Sweden (n=70) and allocated to either 8 weeks of treatment or to minimal attention control. Depression was assessed at baseline, at posttreatment, and at 12 months following treatment (in the intervention group). The primary outcome was self-reported depression level as measured with the Beck Depression Inventory II at posttreatment. The intervention was offered without the need for parental consent.
Results
Over two weeks, 162 adolescents registered and completed the baseline screening. Eligible participants (n=70) were on average 17.5 years of age (SD 1.15), female (96%, 67/70), suffered from MDE (76%, 53/70), had no previous treatment experience (64%, 45/70), and reported guardian(s) to be aware about their depression state (71%, 50/70). The average intervention completion was 74% (11.8 of 16 modules and sessions). Following the treatment, ICBT participants demonstrated a significant decrease in depression symptoms compared with controls (P<.001), corresponding to a large between-group effect (intention-to-treat analysis: d=0.86, 95% CI 0.37-1.35; of completer analysis: d=0.99, 95% CI 0.48-1.51). A significant between-group effect was observed in the secondary depression outcome (P=.003); clinically significant improvement was found in 46% (16/35) of ICBT participants compared with 11% (4/35) in the control group (P=.001).
Conclusions
The results are in line with our previous study, further demonstrating that adolescents with depression can successfully be engaged in and experience significant improvement following ICBT blended with therapist chat sessions. Findings on participants’ age and baseline depression severity are of interest in relation to used study methods.
Unipolar depressive disorders are the leading cause of disability-adjusted life years among adolescents aged 15 to 19 years globally [1]. Early age of onset of depression is a risk factor for recurrent depression [2,3], is associated with poor academic achievement, unemployment, and impaired quality of life [2,4-6] and predicts additional and worsened mental and physical illness [7-9]. Despite the high level of disability, only a small fraction of young people in need have access to any kind of intervention [10,11].
Internet-Delivered Psychological Treatment
At this time, psychological treatment in the form of cognitive behavioral therapy (CBT) is considered one of the best empirically supported behavioral interventions to reduce depression [12-15]. The theoretical framework of CBT is rooted in the central assumption that depression is caused and maintained by unhelpful cognitions and behaviors, with treatment accordingly focused on improving function in these domains with the application of skill-based behavioral strategies [16,17]. Worldwide, adaptions of in-person psychotherapy protocols into Web-based formats, the majority involving CBT, are emerging to bring mental health interventions to individuals who for different reasons are not reached by regular services. In internet-delivered CBT, often referred to as ICBT, content in the form of text, video, or audio is arranged into weekly modules or sessions and delivered inside a Web-based treatment platform along with homework assignments [18]. Programs are offered as self-help or involve a clinician with the role of guiding the participant through the program and providing brief feedback on treatment progress. Clinician support is often provided asynchronously (eg, email), with the administration time typically not extending 20 min per participant and week [19].
The Role of Support in Internet-Delivered Cognitive Behavioral Therapy
Concerning ICBT and other computer and Web-based interventions for depression, one of the most consistent findings is that human support matters. The social element—having someone to talk to or just knowing that someone is there monitoring and listening, seems important in maintaining motivation to continue treatment and experiencing improvement from it. Although there are exceptions in the literature (eg [20]), coached programs are shown to be more effective than self-guided programs in the treatment of adult depression [21-23] with guided ICBT demonstrating effects similar to those found with in-person CBT [24,25]. In comparison, self-guided ICBTs produce small treatment effects that sometimes merely surpass the lower cut-off point for what is considered clinical relevance in the treatment of depression [26,27]. True self-help ICBTs, delivered freely to anyone and without any human interaction in connection to the intervention (eg, interview and administrative contact), show among the highest dropout rates and smallest effects in the field [28]. A study on patients’ perspectives on ICBT for depression points out the importance of guidance in making treatment work [29]. Existing ICBT programs produce benefits for youth depression, but there is considerable variation in populations, measures used, and outcomes [11,30-32]. The influence of support on outcomes in computer and Web-based intervention for youth depression and anxiety, however, was recently reported in a meta-analysis by Grist et al [33], in line with results for ICBT with adult populations. On the basis of 34 studies with 3113 children and adolescents, programs that included >90 min supportive contact yielded higher effect sizes (g=0.87) than purely self-help programs (g=0.24), although interventions based on theoretical frameworks other than CBT were included in the analyses. A review focusing on how Web-based depression programs for adolescents work, including ICBT programs, found that completion rates increased if the treatment was delivered with real-time guidance from a doctor, therapist, or teacher [34]. Even programs that included automated reminders, praise, or suggestions were only able to optimize adherence with real-time, in-person contact. On the individual study level, depression prevention studies with youth have found an almost 10-fold difference in program completion between ICBT when offered with teacher support or monitoring as opposed to self-help [35], and that adolescents report stopping intervention because of the need to talk to someone, rather than doing a program [36]. It is not necessarily a problem that unguided behavioral interventions offered to communities are associated with limited effects—no additional cost is associated with repeated use of the intervention, and despite, for example, high dropout rate, a large number of individuals will still potentially benefit from the interventions. However, for the treatment of clinical depression and in the treatment of youth—a particularly vulnerable population—the apparent ability of coach support to improve outcomes in ICBT warrants consideration of how support can be strengthened and provided to adolescents.
A Text-Based Blended Treatment Approach
To include a strong therapist interaction in the form of sessions is in line with aggregated findings that support is desired and boosts the effect of ICBT. Indeed, emerging blended treatment approaches [37,38] that integrate some in-person therapist sessions with mobile or internet sessions in the same protocol—with the rationale of providing a strong therapist interaction while keeping the advantage of reliable self-help components—show promise in outcomes [39,40] and acceptability [41,42] for adult depression. Among young people, the preference for real-time texting and instant messaging (chat) is well established [43,44]. In the United States, nearly 1 in 3 (32%) of adolescents and young adults with moderate to severe depressive symptoms report having used texting, Web-based messaging, an app, or video chat to connect with a health care provider [45]. To include strong therapist support in the form of sessions (ie, blended treatment), and moreover, doing so with real-time texting is consistent with adolescents’ media use preferences, while maintaining the combination of easy access and discretion offered in ICBT, which for young people may prove especially effective in overcoming barriers to behavioral intervention. The inclusion of strong therapist interaction could moreover extend ICBT to appropriately address clinical depression in youth. In light of full-threshold depressive episodes being commonly experienced in adolescence and young adulthood despite prevention effort [46], this is highly relevant.
Objective
This study investigated a treatment protocol consisting of ICBT modules blended with weekly therapist chat sessions for adolescent depression, including major depressive episode (MDE). We have previously evaluated the treatment in a controlled trial with promising results (d=0.71 against minimal attention control [47]). In line with participant feedback, the protocol was subsequently revised to include longer sessions while the conceptual model of delivery was kept intact. The main objective of this study was to further establish the effect of the treatment model, using comparable eligibility criteria and study methods, including allowing adolescents aged 15 to 17 years to participate without parental involvement. We hypothesized that the intervention would outperform the control condition in reducing depression, corresponding to at least moderate between-group effect.
MethodsStudy Design and Participants
In a 2-arm randomized controlled trial, adolescents were recruited in a community setting at the national level in Sweden and randomized (1:1 ratio) to ICBT (n=35) or to minimal attention control (n=35). Enrollment and baseline assessments took place between January 26 and February 10, treatments were conducted between February 13 and April 9, and posttreatment assessments (at 8 weeks) were conducted between April 10 and 16, 2017. Controls were given access to treatment following the posttreatment assessment (8 weeks), and ICBT participants were reassessed 12 months following treatment (April 2018). Eligible participants were 15 to 19 years, suffered depressive symptoms (≥14 points on the Beck Depression Inventory II; BDI-II [48]), and presented at least 4 symptoms including 1 core symptom, or fulfilled criteria for major depressive episode (MDE) according to The Mini-International Neuropsychiatric Interview (MINI 7.0 [49]). We excluded individuals who were receiving psychological therapy, were alcohol or drug dependent, showed severe suicidal ideation, or who had severe comorbid psychiatric conditions (eg, bipolar disorder or psychotic symptoms). Comorbid anxiety disorder(s) were allowed if depression was the principle concern. Medication for anxiety, depression, or Attention deficit hyperactivity disorder was accepted if the dose had been stable >1 month before the study. Minors aged 15 to 17 years were included in line with Swedish research legislation, which states that individuals aged 15 to 17 years can consent to research without parental involvement if possessing sufficient maturity to freely undertake study participation with awareness of possible adverse consequences.
Participants were recruited by social media posts from study staff including one guest post in a wide-reaching Instagram account focusing on coping with mental health issues. Posts described the opportunity to receive Web-based psychological treatment within a research study. Information was also distributed to schools, youth centers, and clinics across Sweden. Potential participants were directed to the study website and registered for the study by creating a user account, providing informed consent (checking a box), and completing a Web-based screen (demographics and self-reported outcome measures). An encrypted Web-based treatment platform, Iterapi, was used to collect screening data [50]. Individuals who showed initial eligibility were invited to a phone interview with study staff to confirm eligibility using the full MINI, to determine matureness to participate, to obtain verbal consent, and to confirm identity (name, address, and personal identity number). The principal investigator decided on final eligibility. Before the randomization, eligible participants were requested to sign a digital consent sheet (full name with digital date stamp) to confirm their willingness to participate in the study. After consent was agreed and baseline data collected, participants were stratified according to depression severity (fulfilling DSM-5 criteria for MDE or not), and thereafter randomized in a 1:1 ratio. A person not involved in the study executed the randomization procedure using a computer-generated sequence service. Treatment was given open label. The Research Ethics Board in Linköping, Sweden, gave approval for the study (Reg. no. 2014/427-31). The study was registered at ClinicalTrials.gov (NCT02363205). Participants were not offered financial compensation for treatment or assessment completion at any time.
Interventions: Internet-Delivered Cognitive Behavioral Therapy Program
The treatment included 8 ICBT modules, and 8 individual therapist sessions delivered via chat; the entire intervention lasted 8 weeks. Treatment took place within an encrypted Web-based treatment platform: Iterapi [50]. Modules comprised text material and videos, fictional storylines, reflection tasks and homework assignments, and entailed the behavioral and cognitive approach of CBT. Core techniques included behavioral activation: detecting unhelpful behavior, and reinstating and reinforcing behaviors that increase positive consequences, thus elevating mood [51,52], and cognitive restructuring: correcting maladaptive thinking patterns and inaccurate beliefs (negatively biased views of oneself, of the world in general, and of the future) to reduce depression [53]. Table 1 presents an overview of modules. Therapist chat sessions were coscheduled by participant and therapist each week and were conducted inside the treatment platform. Sessions dealt with the previous and current module and focused on process-related aspects of treatment: identifying problems, examining the patient’s cognitions, encouragement, answering questions, and assisting with homework assignments. Participants who agreed were sent reminders before sessions, those who missed a session were offered a new time on the basis of their therapists’ remaining availability for the week. In addition to sessions, therapists responded to homework assignments and questions within 24 h on weekdays. The treatment was to be completed on a preset pace of 8 weeks, thereafter participants had access to the program for 4 additional weeks without therapist support.
Compared with our previous study [47], the treatment protocol was revised according to participants feedback: sessions were prolonged from 30 to 45 min, texts in some modules were revised to present more clearly (eg, reworked sentences, a more clear description of the rationale for exposure), and information procedures given to participants about weekly themes and goals were standardized. The overall conceptual model of delivery was kept intact.
Controls were assigned to a therapist and received an introductory personal platform in-mail from their therapist, informing them that there would be weekly assessments and that their assessments were to be viewed by their therapist to monitor their mental health state. They were informed that their therapist might contact them to follow-up on their wellbeing. While being in the control group, participants were allowed to seek regular care, which in Sweden is for free for adolescents.
In total, 6 CBT therapists in training conducted study assessments and treated 5 to 6 ICBT participants and monitored 5 to 6 control participants each. Before assessments, therapists received training in clinician interview (½ day), ICBT (written material), and how to navigate the treatment platform (½ day, on demand). Therapists received 60 min of clinical supervision on a weekly basis from clinical psychologists with expertise in adolescent psychopathology and delivery of ICBT. Communication and records (eg, chat, platform messages, and study consent) were available for the participant and therapist to view at any time. A short version of the Mood and Feelings Questionnaire (MFQ-13) and the suicidal ideation item from the Patient Health Questionnaire were used for weekly monitoring of depression. Participants were instructed to immediately contact their therapist in the event of feeling worse and were informed that their therapist might contact them in case of noncompletion. Scores and messages were monitored on a daily basis. In cases of suicidal ideation or significant deterioration, participants were immediately followed up by email and phone. The study collected participants personal identity number and address, and informed participants that in the event of imminent crisis, the study would break confidentiality to pursue appropriate follow-up.
Outcomes
The primary outcome was self-reported depression severity at posttreatment, measured by the BDI-II [48]. Secondary outcomes included the MFQ [54]; the beck anxiety inventory (BAI) [55]; the social interaction anxiety scale (SIAS) [56]; the general self-efficacy scale (GSE) [57]; the credibility expectancy questionnaire [58]; the working alliance inventory (WAI-S) [59] and the Brunnsviken Brief Quality of life scale (BBQ) [60]; all self-report scales were completed over Web. The MINI was readministered over phone at posttreatment to assess depression diagnosis, assessors were not blinded to participant allocation at posttreatment.
Analyses
Our previous study [47] was used as a reference for power calculations. To detect a similar effect size (Cohen d=0.70) at posttreatment, with a 2-tailed 5% significance level and a power of 80%, a total sample size of 72 was required. A priori: Participants were included in statistical analyses according to the intention-to-treat (ITT) principle. Missing data were handled using multiple imputations. Differences in primary outcomes were evaluated pre- to posttreatment by analysis of covariance (ANCOVA) using baseline values as covariate at the P<.05 level. Effect sizes were calculated based on imputed values and observed standard deviations. Post hoc: Independent t tests and Pearson chi-square tests were used to detect possible baseline differences between groups and percentage decrease in symptoms, respectively. Little missing completely at random test was performed to test the assumption of data missing at random, Levene test was performed to test the assumption of equal variance between groups. Completers were included in complementary statistical analyses for the primary and secondary outcomes. Clinically significant change [61] was determined by investigating the number of participants falling 2 SD below the pretreatment mean for both conditions on the primary outcome, while fulfilling The reliable change index criteria [62], a psychometric criterion used to determine whether an individual change score between baseline and posttreatment assessment is significantly greater than a difference that could have occurred because of random measurement error. A criterion of 30% or more increase on the primary outcome from baseline to posttreatment was used to determine significant deterioration.
ResultsParticipant Flow
Figure 1 presents a Consolidated Standards of Reporting Trials diagram of the participant flow through the study. During 2 weeks of registration, 162 individuals completed the initial Web-based screening, out of whom, 12 identified as males. For included participants, the mean time from initial screening to the initiation of treatment or control was 12.7 days (range 4-17 days). No significant between-group differences were found at baseline regarding demographics or outcome measures. Table 2 presents the study sample baseline characteristics. During the treatment period, the average completion of the weekly assessment (both allocations) was 93% (range 84%-100%). Table 3 presents completion rates for primary and secondary outcomes at posttreatment. Post hoc analyses showed no differences between those lost to posttreatment and the rest of the sample on any outcome measures at baseline.
Participants’ flow through the study. MINI: Mini-International Neuropsychiatric Interview; ICBT: internet-delivered cognitive behavioral therapy; BDI-II: Beck Depression Inventory-II.
Baseline characteristics of participants.
Characteristics
ICBTa (n=35)
Control (n=35)
Female, n (%)
32 (91)
35 (100)
Age, mean (SD)
17.5 (1.1)
17.5 (1.2)
Occupation, n (%)
Studying full time
28 (80)
32 (91)
Hiatus/dropout
2 (6)
0 (0)
Working
5 (14)
3 (9)
Residence, n (%)
City
10 (29)
7 (20)
Small town/country side
25 (71)
28 (80)
Family, n (%)
Two-parent household
17 (49)
9 (26)
Other
18 (51)
26 (74)
Parent(s) country of birth other than Sweden
7 (20)
7 (20)
Major depressive episodeb, n (%)
27 (77)
26 (74)
18-19 years
14 (74)
16 (80)
15-17 years
13 (81)
10 (67)
Comorbid anxiety diagnosis, n (%)
Any
25 (71)
24 (69)
Generalized anxiety disorder
14 (40)
15 (43)
Social anxiety disorder
16 (46)
10 (29)
Panic disorder
11 (31)
11 (31)
Agoraphobia
4 (11)
7 (20)
Guardians informed about mental health state, n (%)
dBBQ: Brunnsviken Brief Quality of Life Inventory.
eMFQ: Mood and Feelings Questionnaire.
fBAI: Beck Anxiety Inventory.
gSIAS: Social Interaction Anxiety Scale.
hGSE: General Self-Efficacy scale.
Primary Outcome
Table 4 presents pre and posttreatment assessments including effect sizes, means, and standard deviations for both groups, at pre and posttreatment. For the primary outcome measure BDI-II, analyses with ANCOVA with baseline scores as covariate revealed a significant effect between groups (F1,67=22.23, P<.001) at posttreatment. The corresponding between-group effect size was d=0.86 (95% CI 0.37-1.35). A post hoc completer analysis (n=66) showed a similar result (d=0.99, 95% CI 0.48-1.51; P<.001). Figure 2 illustrates within-group improvements on the BDI-II. The ICBT group was reassessed 12 months following treatment. Analysis with paired t test from posttreatment to follow-up (ITT analysis) indicated that there was no difference in depression level from posttreatment assessment to the follow-up (BDI-II, P=.96).
Means (SD) and effect sizes (Cohen d) with 95% CI for continuous outcome variables, with missing data imputed.
gBBQ: Brunnsviken Brief Quality of Life Inventory.
hBAI: Beck Anxiety Inventory.
iSIAS: Social Interaction Anxiety Scale.
jGSE: General Self-Efficacy Scale.
Change over time in depression severity (95% CIs) at baseline, posttreatment, and 12-month follow-up. ICBT: internet-delivered cognitive behavioral therapy.
Response and Remission
We performed post hoc analyses to further investigate potential change in depression symptom level, with missing cases (ICBT n=4) categorized as not improved. At posttreatment, a higher proportion of ICBT participants (46%, 16/35) than controls (11%, 4/35) showed clinically significant improvement (χ21,70=10.1; P=.001), defined as scoring 2 SD below the pretreatment mean for both conditions on the BDI-II, while also fulfilling the reliable change index criteria [62]. In addition, the number of participants presenting a decrease of ≥30% in BDI-II score from baseline to posttreatment assessment, and BDI-II ≥13, and BDI-II ≥10 at postassessment was investigated as these measures have previously been used to define significant changes or cut-offs [48]. Significant differences between groups were found for all measures (P=.004, P=.004, P<.001). Participants were reassessed with the MINI at posttreatment. Of those participants that had fulfilled DSM-5 criteria for MDE at baseline (ICBT n=27; Control n=26), a higher proportion of ICBT participants (56%, 15/27) than controls (27%, 7/26) no longer met diagnostic criteria at posttreatment (χ21,53=2.0; P=.03); missing cases were categorized as not improved (ICBT n=7; Control n=4).
Secondary Outcomes
At posttreatment, a significant effect was found for the secondary depression outcome MFQ (F1,67=9.33; P=.003), corresponding to a medium between-group effect of d=0.58 (95% CI 0.10-1.06). A post hoc completer analysis (n=66) showed a similar result (d=0.67; 95% CI 0.18-1.17; P=.002). Analysis with paired t test from posttreatment to follow-up (ITT analysis) indicated that there was no difference in depression level from posttreatment assessment to the follow-up (MFQ, P=.25). The ANCOVA for posttreatment change in quality of life (BBQ) revealed a significant effect between groups (F1,67=8.73; P=.004). The ANCOVA for pre to posttreatment change in anxiety (BAI) showed no significant effect between groups (F1,67=3.95; P=.051), nor did the ANCOVAs for self-efficacy (GSE; P=.81) or social anxiety (SIAS, P=.86).
Program Use
ICBT participants logged into the treatment platform for a mean of 28.4 times (SD 14.6) and completed on average 78% of available modules (mean 6.2 of 8 modules, SD 2.28), and on average 71% of available therapist sessions (mean 5.7 of 8 sessions, SD 2.67). The average total completion was 74% of all 16 available sessions and modules (11.8/16, SD 4.82). In total, 17% participants (6/35) completed less than half of the available treatment modules. No relationship was found between the number of completed sessions and modules and treatment outcome (P=.10). Therapists spent on average 43.6 min (SD 19.4) on each participant every week (if only including recordings that included therapist sessions, mean 55.8 min on each participant every week). ICBT participants’ ratings of treatment credibility (C-scale) showed an average rating of 18.5 (SD 4.17) out of a maximum total of 27 (highest credibility). The average score on items of therapeutic alliance (WAI-S) was 4.95 (SD 0.63) out of a maximum of 7 (highest satisfaction).
Negative Outcomes
One participant in the ICBT group deteriorated significantly during the course of treatment and was directed to standard care services while being maintained in the study. Post hoc analyses showed that no participant deteriorated significantly following treatment, defined as an increase of 30% or more on the BDI-II from baseline to posttreatment. If those lost to posttreatment assessment were categorized as having deteriorated (n=4), the rate in the ICBT group would be 11%.
Discussion
We examined whether ICBT blended with weekly synchronous therapist chat sessions was effective in reducing depression when compared with minimal attention control. The intervention was evaluated with adolescents 15 to 19 years of age (mean 17.5 years) suffering from depressive symptoms, including but not restricted to, MDE. Our report demonstrates the efficacy of the intervention and highlights the potential of a Web, text-based CBT approach to reach and treat adolescents suffering depression.
Principal Findings
We found superiority for the intervention based on the primary outcome measure (BDI-II score at week 8), corresponding to a large between-group effect size (d=0.86). Significant effects on depression symptom level were also observed in the secondary self-reported depression outcome (MFQ, d=0.58), as well as in the number of cases in remission from a major depressive episode (determined using the MINI), further supporting that the intervention was effective. At the 12-month follow-up, depression levels in the treatment group were similar to those observed at posttreatment, follow-up data were not available for the control group. The results for the depression outcomes are in line with, and for the primary outcome surpass, the findings in our previous study that examined the intervention [47]. Although it is important to consider that we made changes to the protocol between studies—foremost, session time was prolonged—the overall conceptual model of delivery was kept intact, and we used comparable design, measures, and procedures across studies. We therefore consider that the findings in this study provide further support for the efficacy of ICBT modules blended with chat sessions to reduce adolescent depression.
Relation to Previous Research
Our protocol included more therapist support than typically found in ICBT. We learned in our previous study that therapist sessions were utilized (completion, mean 78%) but perceived short, and in line with participants’ feedback, we prolonged session time in this study. Sessions were completed at a similar degree in this study (mean 71%) with fewer comments on sessions length. Possibly, the extension in time resulted in chat sessions being perceived as sufficient. Modules and sessions were completed at a similar degree, and few participants completed less than half of the treatment. This may explain why we found no association between dose and depression outcomes. Our tentative conclusion, based on participant feedback, program completion, and findings with the therapist work-alliance (WAI-S), is that real-time therapist interaction is indeed desired when offered in tandem with ICBT material, and that completely text-based sessions seem to generate a meaningful therapeutic relationship for young individuals. We treated participants with high depression severity, and it may be that an ICBT format with strong therapist support, blended treatment, can better address clinical levels of depression than highly automated interventions do, because blended treatment can be tailored to suit individual needs, help with motivation, and provide more opportunity to monitor signs of improvement and deterioration, respectively [37,63]. In this context, Sethi et al have previously reported a blended approach, consisting of Web-based ICBT and in-person sessions, to be superior to stand-alone Web-based ICBT, and similar to in-person CBT in reducing depression in young adults (mean 19.5/20.1 years [64,65]). Chat sessions in group format to deliver ICBT with adolescents and young adults (mean 20.9 years) has previously been evaluated in a study by van der Zanden et al [66]. They too reported a large effect size on depressive symptoms against waitlist at posttreatment (d=0.94), and similar rate of clinically reliable change (56%) as in this study.
On a general level, the completion rate in this study compares favorably with what is reported for Web-based interventions [67], including for youth [33], and it should be considered that we did not offer any payment for completion or assessment. The depression reduction observed in this study is moreover in line with meta-analyses suggesting that computer and Web-based ICBT for youth depression produces effect [11,32], and more broadly, that coached Web-based interventions fare better than self-guided [33]. Existing studies, however, vary considerable in relation to the populations, delivery mode, and measures in focus, making comparison difficult. For example, our obtained effect size is in line with the larger effect size found for computer-based and Web-based CBT with adolescents aged >13 years against waitlist (g=0.95), as compared with children (g=0.51), reported in a meta-analysis subanalysis [11], but the authors did not report interventions for anxiety and depression programs separately or differentiated on level of coach support. Most of previous RCT’s that have focused on elevated depression in adolescents and young adults [68-78] have evaluated ICBT self-guided programs [68-72]; telephone calls could occur [69], or interventions that are not ICBT models, but rather computerized programs (eg, fantasy games) with support or oversight at education site, school, or at home [73-78]. To the best of our knowledge, no previous ICBT programs have involved individual therapist sessions with adolescents with current major depressive episode. Although our results are promising and could be associated with the level of therapist support, this was not established by the methods used, and we cannot rule out that other factors have played a role, for example, time to treatment, and initial depression severity. This should be addressed in future studies.
Clinical Implications
This study focused on efficacy, nevertheless findings may in several aspects have clinical implication. First, we used a recruitment strategy that is similar to the way in which some young individuals enroll for Web-based mental health intervention [79], thus giving ecological validity to this study and the population with which it is conducted. Second, our findings support that reducing adolescent depression, including major depressive episode, is possible using a genuinely Web-based CBT approach. Third, our results compare favorably with those reported in meta-analyses on in-person CBT with youth depression as compared with active and nonactive control conditions [80-82], and more broadly, with effects for in-person psychotherapies for youth depression (g=0.29) [83]. Fourth, observed diagnosis remission rates are in the lower range compared with studies that have reported remission for in-person CBT: 61% to 87% [84-86]. Participants in our study had high depression scores initially, with large reductions needed to reach the criteria for remission. It has been suggested that young people who access mental health resources over Web are likely to be in greater distress in comparison with those accessing in-person services (given more rapid access to Web, they are closer in time to their symptoms [87]), which point toward the relevance of Web-based behavioral interventions extending to address clinical depression. Fifth, there are concerns among stakeholders about the safety and effectiveness of internet interventions for depression, particularly regarding offering such interventions to youth [88,89], which is why this study reports on potential negative effects related to intervention. We found 1 participant deteriorating significantly during the course of treatment. In comparison, it has been reported that 14% to 24% of young people receiving psychotherapy in US outpatient mental health services experience significant deterioration following treatment [90]. Concerning ICBT, a review reports 5.8% of adult study participants experiencing significant deterioration following self-guided programs [91]; no review has investigated youth. Sixth, in contrast to clinical practice [92] and research in many places, this study did not require participants to visit a care facility or school counselor or inform their guardians to receive treatment. This was to acknowledge that some adolescents do not want to, or cannot involve, their parents in their difficulties [93], and that this reluctance may delay or impede evaluation and treatment [94]. We found the intervention to attract young individuals (mean 17.5 years), some reporting that they had not informed parent(s) about their mental state (29%). The findings on participants’ characteristics, as well as the other findings reported on here, are very similar to those in our previous study [47], and further contribute to reveal who may be reached and treated when similar interventions are offered. If the aim is to treat young individuals, at an early stage of the disorder, the conditions required to receive treatment may benefit from becoming more inclusive.
Strengths and Limitations
Strengths of the study include a rigorous design, use of a primary outcome with strong psychometric evidence, and adequate power with regards to detecting between-group differences in the included depression outcomes. In relation to the reproducibility challenges in psychology, it is positive that our results are in line with those in our previous studies on ICBT, although independent evaluations are necessary. We consider it a strength that the intervention was investigated with adolescents 15 to 19 years of age as opposed to a wider age range. It is indicated that the causes and constructs of depression may differ between children and adolescents [3], thus studies including both groups could possibly suffer from these differences interacting and interfering with treatment outcomes. A number of limitations should be considered: this study is one of the first on chat-supported ICBT, thus we believed that no evidence-based treatment control group would be appropriate. Nevertheless, it is a limitation that an active control intervention was not included. In line with discussions [21] regarding what is considered an intervention, we moreover labeled our control condition an attention control, as controls were thoroughly assessed and monitored and interacted with. The appropriateness of the label can be discussed. Treatment was open label and participants’ awareness of their allocation may have affected self-reported outcomes; similarly, the clinical interviews were not blinded at posttreatment, which calls for caution when interpreting remission rates. The reduction on anxiety ratings cannot be explained by the treatment as the control group also improved. As the intervention focused on depression, it is possible that it was not effective enough to result in major reductions in anxiety in the treatment group. Participants in the study were almost entirely female, so results cannot be generalized to males. Depression is more prevalent among women but gender distributions for Web-based interventions and support can be even more skewed [87,95-96]. There are differences in internet use patterns and preferences between adolescent girls and boys [43], and possibly these differences interact with Web-based interventions as they currently are offered. It has been discussed that young boys are more likely than girls to seek help as a consequence of being influenced by others, and this could explain their relatively low enrollment in Web-based interventions, given that such enrollment is often more dependent on self-motivation and in many cases self-referral [87]. Our study recruited via social media, and moreover via an account focusing on coping with mental health issues; this may have influenced gender uptake as well as attracted particularly motivated participants. Although ours and previous findings point to the need of alterations in recruitment and design so that similar Web-based intervention can reach boys, the positive findings with girls should not be undervalued and the intervention should be regarded complementary among others. Not limiting to gender, focused (tailored) approaches rather than broad and universal interventions may be more relevant to desired target groups, and thus possibly more successful. For example, using a narrow age span, in our experience, facilitates the creation of content that is developmentally appropriate. Finally, while our positive findings may relate to the novel features of the intervention, the study contributes limited information on how the effects were achieved, for example, on the specific impact of therapist support. Lacking information on what factors influence outcomes in ICBT with youth is a common study limitation [34].
Future Research
The next step is to extend focus to uncovering the effect of therapist interaction, and other theoretical and contextual treatment components in ICBT, to contribute to our understanding of what components positively affect treatment outcomes in psychotherapy with youth depression and how they do so. Multiphase optimization strategies that include factorial experimental designs pose as viable options [97]. Technology-based treatment enables new evaluation strategies and the current approach in particular produces vast amounts of data from patient-therapist correspondences that benefit from natural language processing to help understand and refine conversation [98,99]. Qualitative investigation will help to ensure that components perceived essential by young individuals are not lost but enhanced in further developments.
Conclusions
This study investigated treatment consisting of Web-based CBT self-help material and weekly therapist chat sessions, blended treatment, for adolescent depression. The intervention attracted adolescents in need of mental health assistance and demonstrated positive completion rates in combination with substantial improvement in depression symptoms. The results are similar to those in our previous study, further demonstrating the potential of a text-based blended model to deliver CBT in accordance with the urgent need for accessible behavioral intervention for youth.
CONSORT-EHEALTH checklist (V 1.6.1).
AbbreviationsANCOVA
analysis of covariance
BAI
Beck Anxiety Inventory
BBQ
Brunnsviken Brief Quality of Life Scale
BDI-II
Beck Depression Inventory II
CBT
cognitive behavioral therapy
DSM-5
Diagnostic and Statistical Manual of Mental Disorder criteria
GSE
General Self-Efficacy Scale
ICBT
internet-delivered cognitive behavior therapy
ITT
intention-to-treat
MFQ
Mood and Feelings Questionnaire
MINI
Mini-International Neuropsychiatric Interview
SIAS
Social Interaction Anxiety Scale
WAI-S
Working Alliance Inventory
NT was supported by Queen Silvia’s Jubilee Fund, The Sweden-America Foundation, The Swedish Society of Medicine, and The Swedish Psychotherapy Society in this research; the study received funding from The Swedish Central Bank (P16-0883:1). The funders had no role in the conduct of the research and were not involved in review or approval of the manuscript for publication. NT authored the manuscript; all authors reviewed and approved the manuscript for publication. We thank George Vlaescu for excellent Web-master services, and Dr C Barr Taylor, Stanford University and Center for m2Health, for comments on the manuscript. A special thanks to the adolescents who participated, and those who kindly distributed information about the study.
None declared.
GoreFMBloemPJPattonGCFergusonJJosephVCoffeyCSawyerSMMathersCDGlobal burden of disease in young people aged 10-24 years: a systematic analysis201106183779783209310210.1016/S0140-6736(11)60512-621652063S0140-6736(11)60512-6Kim-CohenJCaspiAMoffittTEHarringtonHMilneBJPoultonRPrior juvenile diagnoses in adults with mental disorder: developmental follow-back of a prospective-longitudinal cohort2003076077091710.1001/archpsyc.60.7.7091286077560/7/709ThaparACollishawSPineDSThaparAKDepression in adolescence20120317379982010566710.1016/S0140-6736(11)60871-422305766S0140-6736(11)60871-4PMC3488279KesslerRCThe costs of depression20120335111410.1016/j.psc.2011.11.00522370487S0193-953X(11)00113-4PMC3292769LewinsohnPMajor depressive disorder in older adolescents. Prevalence, risk factors, and clinical implications19981118776579410.1016/S0272-7358(98)00010-5FletcherJMAdolescent depression and educational attainment: results using sibling fixed effects2010071978557110.1002/hec.152619582699FergussonDMHorwoodLJRidderEMBeautraisALSubthreshold depression in adolescence and mental health outcomes in adulthood200501621667210.1001/archpsyc.62.1.661563007462/1/66BardoneAMMoffittTECaspiADicksonNStantonWRSilvaPAAdult physical health outcomes of adolescent girls with conduct disorder, depression, and anxiety19980637659460110.1097/00004583-199806000-000099628079S0890-8567(09)63069-0CopelandWEShanahanLCostelloEJAngoldAChildhood and adolescent psychiatric disorders as predictors of young adult disorders2009076677647210.1001/archgenpsychiatry.2009.851958156866/7/764PMC2891142ChisholmDSweenyKSheehanPRasmussenBSmitFCuijpersPSaxenaSScaling-up treatment of depression and anxiety: a global return on investment analysis201605354152410.1016/S2215-0366(16)30024-4PONE-D-14-33759PMC4364968EbertDDZarskiACChristensenHStikkelbroekYCuijpersPBerkingMRiperHInternet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials2015103e011989510.1371/journal.pone.011989525786025PONE-D-14-33759PMC4364968ButlerACChapmanJEFormanEMBeckATThe empirical status of cognitive-behavioral therapy: a review of meta-analyses200601261173110.1016/j.cpr.2005.07.00316199119S0272-7358(05)00100-5CristeaIAStefanSKaryotakiEDavidDHollonSDCuijpersPThe effects of cognitive behavioral therapy are not systematically falling: a revision of Johnsen and Friborg (2015)20170314333264010.1037/bul0000062282304132017-08301-003DriessenEHollonSDCognitive behavioral therapy for mood disorders: efficacy, moderators and mediators2010093335375510.1016/j.psc.2010.04.00520599132S0193-953X(10)00047-XPMC2933381DavidDCristeaIHofmannSGWhy cognitive behavioral therapy is the current gold standard of psychotherapy20189410.3389/fpsyt.2018.0000429434552PMC5797481WenzelABasic strategies of cognitive behavioral therapy20171240459760910.1016/j.psc.2017.07.00129080588S0193-953X(17)30067-9HofmannSG2011Oxford, UKWiley-BlackwellAnderssonGTitovNDearBFRozentalACarlbringPInternet-delivered psychological treatments: from innovation to implementation20190218120810.1002/wps.2061030600624PMC6313242HedmanELjótssonBLindeforsNCognitive behavior therapy via the internet: a systematic review of applications, clinical efficacy and cost-effectiveness2012121267456410.1586/erp.12.6723252357TitovNDearBFStaplesLGTeridesMDKarinESheehanJJohnstonLGandyMFogliatiVJWoottonBMMcEvoyPMDisorder-specific versus transdiagnostic and clinician-guided versus self-guided treatment for major depressive disorder and comorbid anxiety disorders: a randomized controlled trial201510358810210.1016/j.janxdis.2015.08.00226422822S0887-6185(15)30008-6BaumeisterHReichlerLMunzingerMLinJThe impact of guidance on internet-based mental health interventions — a systematic review201410142051510.1016/j.invent.2014.08.003S0272-7358(12)00027-XRichardsDRichardsonTComputer-based psychological treatments for depression: a systematic review and meta-analysis2012063243294210.1016/j.cpr.2012.02.00422466510S0272-7358(12)00027-XJohanssonRAnderssonGInternet-based psychological treatments for depression2012071278619; quiz 87010.1586/ern.12.6322853793AnderssonGTopoocoNHavikONordgreenTInternet-supported versus face-to-face cognitive behavior therapy for depression2016161556010.1586/14737175.2015.112578326610160CarlbringPAnderssonGCuijpersPRiperHHedman-LagerlöfEInternet-based vs face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis20180147111810.1080/16506073.2017.140111529215315EbertDDBaumeisterHInternet-based self-help interventions for depression in routine care2017081748852310.1001/jamapsychiatry.2017.1394286367172631888KaryotakiERiperHTwiskJHoogendoornAKleiboerAMiraAMackinnonAMeyerBBotellaCLittlewoodEAnderssonGChristensenHKleinJPSchröderJBretón-LópezJScheiderJGriffithsKFarrerLHuibersMJPhillipsRGilbodySMoritzSBergerTPopVSpekVCuijpersPEfficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data2017041744351910.1001/jamapsychiatry.2017.0044282411792604310BatterhamPJNeilALBennettKGriffithsKMChristensenHPredictors of adherence among community users of a cognitive behavior therapy website200802229710519920949PMC2770409HolstANejatiSBjörkelundCErikssonMCMHangeDKiviMWikbergCPeterssonELPatients' experiences of a computerised self-help program for treating depression - a qualitative study of Internet mediated cognitive behavioural therapy in primary care201703351465310.1080/02813432.2017.12888132827705562/1/66PMC5361419YeXBapujiSBWintersSEStruthersARaynardMMetgeCKreindlerSACharetteCJLemaireJ ASynyshynMSutherlandKEffectiveness of internet-based interventions for children, youth, and young adults with anxiety and/or depression: a systematic review and meta-analysis201407181413135310.1186/1472-6963-14-313250379511472-6963-14-313PMC4110069HollisCFalconerCJMartinJLWhittingtonCStocktonSGlazebrookCDaviesEBAnnual Research Review: Digital health interventions for children and young people with mental health problems - a systematic and meta-review2017041858447450310.1111/jcpp.12663279432851472-6963-14-313PMC4110069PennantMELoucasCEWhittingtonCCreswellCFonagyPFugglePKelvinRNaqviSStocktonSKendallTExpert Advisory GroupComputerised therapies for anxiety and depression in children and young people: a systematic review and meta-analysis2015046711810.1016/j.brat.2015.01.00925727678S0005-7967(15)00016-9GristRCrokerADenneMStallardPTechnology delivered interventions for depression and anxiety in children and adolescents: a systematic review and meta-analysis2019062221477110.1007/s10567-018-0271-83022934310.1007/s10567-018-0271-8PMC6479049WozneyLHuguetABennettKRadomskiADHartlingLDysonMMcGrathPJNewtonASHow do eHealth programs for adolescents with depression work? A realist review of persuasive system design components in internet-based psychological therapies2017089198e26610.2196/jmir.757328793983v19i8e266PMC5569246NeilALBatterhamPChristensenHBennettKGriffithsKMPredictors of adherence by adolescents to a cognitive behavior therapy website in school and community-based settings20090223111e610.2196/jmir.105019275982v11i1e6PMC2762770LillevollKRVangbergHCGriffithsKMWaterlooKEisemannMRUptake and adherence of a self-directed internet-based mental health intervention with tailored e-mail reminders in senior high schools in Norway20140121141410.1186/1471-244X-14-14244438201471-244X-14-14PMC3901754KleiboerASmitJBosmansJRuwaardJAnderssonGTopoocoNBergerTKriegerTBotellaCBañosRChevreulKArayaRCerga-PashojaACieślakRRogalaAVisCDraismaSvan SchaikAKemmerenLEbertDBerkingMFunkBCuijpersPRiperHEuropean comparative effectiveness research on blended depression treatment versus treatment-as-usual (E-COMPARED): study protocol for a randomized controlled, non-inferiority trial in eight European countries201608317138710.1186/s13063-016-1511-12748818110.1186/s13063-016-1511-1PMC4972947TopoocoN2018LinköpingLinköping University Electronic PressThaseMEWrightJHEellsTDBarrettMSWisniewskiSRBalasubramaniGMcCronePBrownGKImproving the efficiency of psychotherapy for depression: computer-assisted versus standard CBT201803117532425010.1176/appi.ajp.2017.1701008928969439PMC5848497LyKHTopoocoNCederlundHWallinABergströmJMolanderOCarlbringPAnderssonGSmartphone-supported versus full behavioural activation for depression: a randomised controlled trial2015105e012655910.1371/journal.pone.012655926010890PONE-D-14-40400PMC4444307TopoocoNRiperHArayaRBerkingMBrunnMChevreulKCieslakREbertDDEtchmendyEHerreroRKleiboerAKriegerTGarcía-PalaciosACerga-PashojaASmoktunowiczEUrechAVisCAnderssonGE-COMPARED ConsortiumAttitudes towards digital treatment for depression: a European stakeholder survey20170681910.1016/j.invent.2017.01.00130135823S2214-7829(16)30044-6PMC6096292SchusterRPokornyRBergerTTopoocoNLaireiterARThe advantages and disadvantages of online and blended therapy: survey study amongst licensed psychotherapists in Austria201812182012e1100710.2196/1100730563817v20i12e11007PMC6315274LenhartASmithAAndersonMDugganMPerrinA20152019-02-01Teens, Technology and Friendships https://www.pewinternet.org/2015/08/06/teens-technology-and-friendships/AndersonMJiangJ20182019-09-18Teens, Social Media & Technology 2018 https://www.pewinternet.org/2018/05/31/teens-social-media-technology-2018/RideoutVFoxS20182019-02-02Digital Health Practices, Social Media Use, and Mental Well-Being Among Teens and Young Adults in the US https://www.hopelab.org/reports/pdf/a-national-survey-by-hopelab-and-well-being-trust-2018.pdfDaveyCGMcGorryPDEarly intervention for depression in young people: a blind spot in mental health care201903632677210.1016/S2215-0366(18)30292-XPONE-D-14-40400PMC4444307TopoocoNBergMJohanssonSLiljethörnLRadvoginEVlaescuGNordgrenLBZetterqvistMAnderssonGChat- and internet-based cognitive-behavioural therapy in treatment of adolescent depression: randomised controlled trial2018074419920710.1192/bjo.2018.1829988969S2056472418000182PMC6034465BeckATSteerRABrownGK1996San Antonio, TexasPsychological CorporationSheehanDVLecrubierYSheehanKHAmorimPJanavsJWeillerEHerguetaTBakerRDunbarGCThe Mini-International Neuropsychiatric Interview (MINI): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10199859Suppl 202233;quiz 349881538VlaescuGAlasjöAMiloffACarlbringPAnderssonGFeatures and functionality of the Iterapi platform for internet-based psychological treatment20161161071410.1016/j.invent.2016.09.00630135819S2214-7829(16)30012-4PMC6096305DimidjianSBarreraMMartellCMuñozRFLewinsohnPMThe origins and current status of behavioral activation treatments for depression2011713810.1146/annurev-clinpsy-032210-10453521275642LewinsohnPMFriedmanRJKatzMMA behavioral approach to depression1974New YorkJohn Wiley & Sons Inc15785HofmannSGSmitsJAJThe evolution of cognitive behavioral therapy for anxiety and depression201712404xixii10.1016/j.psc.2017.08.01129080599S0193-953X(17)30079-5DavissWBBirmaherBMelhemNAAxelsonDAMichaelsSMBrentDACriterion validity of the mood and feelings questionnaire for depressive episodes in clinic and non-clinic subjects2006094799273410.1111/j.1469-7610.2006.01646.x16930387JCPP1646BeckAEpsteinNBrownGSteerRAAn inventory for measuring clinical anxiety: psychometric properties198812566893710.1037//0022-006x.56.6.8933204199MattickRPClarkeJCDevelopment and validation of measures of social phobia scrutiny fear and social interaction anxiety1998043644557010.1016/s0005-7967(97)10031-69670605S0005-7967(97)10031-6SchwarzerRJerusalemMWeinmanJWrightSJohnstonMGeneralized self-efficacy scale1995Windsor, UKNfer-Nelson357DevillyGJBorkovecTDPsychometric properties of the credibility/expectancy questionnaire200006312738610.1016/S0005-7916(00)00012-411132119S0005791600000124TraceyTJKokotovicAMFactor structure of the working alliance inventory198909132071010.1037/1040-3590.1.3.207S0005-7967(97)10031-6LindnerPFrykhedenOForsströmDAnderssonELjótssonBHedmanEAnderssonGCarlbringPThe Brunnsviken brief quality of life scale (BBQ): development and psychometric evaluation2016044531829510.1080/16506073.2016.114352626886248PMC4867878JacobsonNSTruaxPClinical significance: a statistical approach to defining meaningful change in psychotherapy research19910259112910.1037//0022-006x.59.1.122002127EvansCMargisonFBarkhamMThe contribution of reliable and clinically significant change methods to evidence-based mental health19980811370210.1136/ebmh.1.3.70ErbeDEichertHCRiperHEbertDDBlending face-to-face and internet-based interventions for the treatment of mental disorders in adults: systematic review20170915199e30610.2196/jmir.658828916506v19i9e306PMC5622288SethiSCampbellAJEllisLAThe use of computerized self-help packages to treat adolescent depression and anxiety201008312831446010.1080/15228835.2010.508317S1352465811000695SethiSTreating youth depression and anxiety: a randomised controlled trial examining the efficacy of computerised versus face-to-face cognitive behaviour therapy201302144842495710.1111/ap.12006bmjopen-2016-012834PMC5278287van der ZandenRKramerJGerritsRCuijpersPEffectiveness of an online group course for depression in adolescents and young adults: a randomized trial2012067143e8610.2196/jmir.203322677437v14i3e86PMC3414873EysenbachGThe law of attrition2005033171e1110.2196/jmir.7.1.e1115829473v7e11PMC1550631IpPChimDChanKLLiTMHoFKvan VoorheesBWTiwariATsangAChanCWHoMTsoWWongWHEffectiveness of a culturally attuned internet-based depression prevention program for Chinese adolescents: a randomized controlled trial201612331211233110.1002/da.2255427618799van VoorheesBWFogelJReineckeMAGladstoneTStuartSGollanJBradfordNDomanicoRFaganBRossRLarsonJWatsonNPauneskuDMelkonianSKuwabaraSHolperTShankNSanerDButlerAChandlerALouieTWeinsteinCCollinsSBaldwinMWasselAVanderplough-BoothKHumenskyJBellCRandomized clinical trial of an internet-based depression prevention program for adolescents (project CATCH-IT) in primary care: 12-week outcomes200902301233710.1097/DBP.0b013e3181966c2a19194326PMC6290998MakarushkaMM2019-09-18University of Oregon 2012 https://scholarsbank.uoregon.edu/xmlui/handle/1794/12091EllisLACampbellAJSethiSO'DeaBMComparative randomized trial of an online cognitive-behavioral therapy program and an online support group for depression and anxiety2011444617ClarkeGKelleherCHornbrookMDebarLDickersonJGullionCRandomized effectiveness trial of an internet, pure self-help, cognitive behavioral intervention for depressive symptoms in young adults20093842223410.1080/1650607080267535319440896911169469PMC2829099SmithPScottREshkevariEJattaFLeighEHarrisVRobinsonAAbelesPProudfootJVerduynCYuleWComputerised CBT for depressed adolescents: randomised controlled trial201510731041010.1016/j.brat.2015.07.00926301756S0005-7967(15)30016-4MerrySNStasiakKShepherdMFramptonCFlemingTLucassenMFThe effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial20120418344e259810.1136/bmj.e259822517917PMC3330131StasiakKHatcherSFramptonCMerrySNA pilot double blind randomized placebo controlled trial of a prototype computer-based cognitive behavioural therapy program for adolescents with symptoms of depression20140742438540110.1017/S135246581200108723253641S1352465812001087FlemingTDixonRFramptonCMerrySA pragmatic randomized controlled trial of computerized CBT (SPARX) for symptoms of depression among adolescents excluded from mainstream education2012104055294110.1017/S135246581100069522137185S1352465811000695WrightBTindallLLittlewoodEAllgarVAbelesPTrépelDAliSComputerised cognitive-behavioural therapy for depression in adolescents: feasibility results and 4-month outcomes of a UK randomised controlled trial2017012771e01283410.1136/bmjopen-2016-01283428132000bmjopen-2016-012834PMC5278287StallardPRichardsonTVellemanSAttwoodMComputerized CBT (Think, Feel, Do) for depression and anxiety in children and adolescents: outcomes and feedback from a pilot randomized controlled trial2011053932738410.1017/S135246581000086X21272393S135246581000086X2019-02-04Talkspace for Teens https://lp.talkspace.com/try/talkspace-for-teensKleinJBJacobsRHReineckeMACognitive-behavioral therapy for adolescent depression: a meta-analytic investigation of changes in effect-size estimates200711461114031310.1097/chi.0b013e3180592aaa18049290S0890-8567(09)62037-2PMC2270481WeiszJRMcCartyCAValeriSMEffects of psychotherapy for depression in children and adolescents: a meta-analysis20060113211324910.1037/0033-2909.132.1.132164359602006-00818-007PMC2150594YangLZhouXZhouCZhangYPuJLiuLGongXXiePEfficacy and acceptability of cognitive behavioral therapy for depression in children: a systematic review and meta-analysis201717191610.1016/j.acap.2016.08.00227989281S1876-2859(16)30405-3WeiszJRKuppensSNgMYEckshtainDUguetoAMVaughn-CoaxumRJensen-DossAHawleyKMMarchetteLSChuBCWeersingVRFordwoodSRWhat five decades of research tells us about the effects of youth psychological therapy: a multilevel meta-analysis and implications for science and practice20177227911710.1037/a0040360282210632017-07146-001VostanisPFeehanCGrattanEBickertonWLTreatment for children and adolescents with depression: lessons from a controlled trial201607261219921210.1177/135910459601200300004583-200612000-00002WeiszJRSoutham-GerowMAGordisEBConnor-SmithJKChuBCLangerDAMcLeodBDJensen-DossAUpdegraffAWeissBCognitive-behavioral therapy versus usual clinical care for youth depression: an initial test of transportability to community clinics and clinicians2009067733839610.1037/a0013877194855812009-08093-002PMC3010274KennardBSilvaSVitielloBCurryJKratochvilCSimonsAHughesJFeenyNWellerESweeneyMReineckeMPathakSGinsburgGEmslieGMarchJTADS TeamRemission and residual symptoms after short-term treatment in the Treatment of Adolescents with Depression Study (TADS)20061218451214041110.1097/01.chi.0000242228.75516.211713598500004583-200612000-00002PMC4110069RickwoodDWebbMKennedyVTelfordNWho are the young people choosing web-based mental health support? Findings from the implementation of Australia's national web-based youth mental health service, eheadspace2016082533e4010.2196/mental.598827562729v3i3e40PMC5016625van MeterACosgroveVEOverhauling technology-based interventions for young people with bipolar disorder: lessons learned from adults20190221186710.1111/bdi.1271630387928TorousJKossowskyJ20182019-01-22Digital Mental Health for Youth: New Evidence but Still Much Unknown https://www.psychiatrictimes.com/telepsychiatry/digital-mental-health-youth-new-evidence-still-much-unknownWarrenJSNelsonPLMondragonSABaldwinSABurlingameGMYouth psychotherapy change trajectories and outcomes in usual care: community mental health versus managed care settings2010047821445510.1037/a0018544203500262010-05835-002KaryotakiEKemmerenLRiperHTwiskJHoogendoornAKleiboerAMiraAMackinnonAMeyerBBotellaCLittlewoodEAnderssonGChristensenHKleinJPSchröderJBretón-LópezJScheiderJGriffithsKFarrerLHuibersMJPhillipsRGilbodySMoritzSBergerTPopVSpekVCuijpersPIs self-guided internet-based cognitive behavioural therapy (iCBT) harmful? An individual participant data meta-analysis201811481524566610.1017/S003329171800064829540243S0033291718000648PMC61900662016Stockholm CountyChild and Adolescent Mental Health ServicesWill parents always know? [Får föräldrar alltid veta?] http://www.bup.se/sv/Rad-och-fakta/Artiklar/Bra-att-veta-om-BUP/Far-foraldrar-alltid-veta/SantanaBMental Health Practitioners’ Understanding of Informed Consent with Adolescents2016 [accessed] 2019-09-18
20102019-07-20New CA Minor Consent Law Increases Teens’ Access to Mental Health Care https://youthlaw.org/publication/new-ca-minor-consent-law-increases-teens-access-to-mental-health-care/HanerDPeplerD'Live Chat' clients at kids help phone: individual characteristics and problem topics20162531384427924143PMC5130086FukkinkRGHermannsJMChildren's experiences with chat support and telephone support2009065067596610.1111/j.1469-7610.2008.02024.x19207634JCPP2024CollinsLM2018New YorkSpringerAlthoffTClarkKLeskovecJLarge-scale analysis of counseling conversations: an application of natural language processing to mental health201644637610.1162/tacl_a_0011128344978PMC5361062HoogendoornMFunkB2017SwitzerlandSpinger International Publishing