Background: Depressive disorders (DDs) are a public health problem. Face-to-face psychotherapeutic interventions are a first-line option for their treatment in adults. There is a growing interest in eHealth interventions to maximize accessibility for effective treatments. Thus, the number of randomized controlled trials (RCTs) of eHealth psychotherapeutic interventions has increased, and these interventions are being offered to patients. However, it is unknown whether patients with DDs differ in internet-based and face-to-face intervention trials. This information is essential to gain knowledge about eHealth trials’ external validity.
Objective: We aimed to compare the baseline characteristics of patients with DDs included in the RCTs of eHealth and face-to-face psychotherapeutic interventions with a cognitive component.
Methods: In this meta-epidemiological study, we searched 5 databases between 1990 and November 2017 (MEDLINE, Embase, PsycINFO, Google Scholar, and the database of Cuijpers et al). We included RCTs of psychotherapeutic interventions with a cognitive component (eg, cognitive therapy, cognitive behavioral therapy [CBT], or interpersonal therapy) delivered face-to-face or via the internet to adults with DDs. Each included study had a matching study for predefined criteria to allow a valid comparison of characteristics and was classified as a face-to-face (CBT) or eHealth (internet CBT) intervention trial. Two authors selected the studies, extracted data, and resolved disagreements by discussion. We tested whether predefined baseline characteristics differed in face-to-face and internet-based trials using a mixed-effects model and testing for differences with z tests (statistical significance set at .05). For continuous outcomes, we also estimated the difference in means between subgroups with 95% CI.
Results: We included 58 RCTs (29 matching pairs) with 3846 participants (female: n=2803, 72.9%) and mean ages ranging from 20-74 years. White participants were the most frequent (from 63.6% to 100%). Other socioeconomic characteristics were poorly described. The participants presented DDs of different severity measured with heterogeneous instruments. Internet CBT trials had a longer depression duration at baseline (7.19 years higher, CI 95% 2.53-11.84; 10.0 vs 2.8 years; P=.002), but the proportion of patients with previous depression treatment was lower (24.8% vs 42%; P=.04). Subgroup analyses found no evidence of differences for the remaining baseline characteristics: age, gender, education, living area, depression severity, history of depression, actual antidepressant medication, actual physical comorbidity, actual mental comorbidity, study dropout, quality of life, having children, family status, and employment. We could not compare proficiency with computers due to the insufficient number of studies.
Conclusions: The baseline characteristics of patients with DDs included in the RCTs of eHealth and face-to-face psychotherapeutic interventions are generally similar. However, patients in eHealth trials had a longer duration of depression, and a lower proportion had received previous depression treatment, which might indicate that eHealth trials attract patients who postpone earlier treatment attempts.
Trial Registration: PROSPERO CRD42019085880; https://tinyurl.com/4xufwcyr
Depressive disorders (DDs) affect more than 300 million people worldwide and have prevailed as a leading nonfatal health issue for almost 3 decades [, ]. Their incidence and burden are expected to rise in the future. At present, DDs cause 15% of the days lived with disability and is associated with suicide; a high burden in personal, family, social, and work life; and elevated health care costs [ , ]. Increasing the accessibility to effective interventions for DDs is an international priority [ , ].
Psychotherapeutic interventions aim to improve depressive symptoms by increasing self-efficacy, developing coping skills, and changing cognitions, emotions, and behaviors with exercises and sometimes homework between sessions. Examples include cognitive therapy, cognitive behavioral therapy (CBT), interpersonal therapy, and psychodynamic treatments. Face-to-face psychotherapeutic interventions are accepted as a first-line treatment for DDs [- ], and the different approaches have benefits from small to large magnitude compared to usual care (standardized mean differences [SMDs] ranging from –0.32 to –0.92) [ , ].
Internet-based (also known as eHealth) psychotherapeutic interventions, such as internet CBT (iCBT), treat psychological problems via digital platforms . The eHealth approach involves adapting standard face-to-face protocols into computerized self-help material delivered over a period either as a self-help program alone or combined with brief therapist support [ ]. Similar to face-to-face interventions, most randomized controlled trials (RCTs) in eHealth psychotherapy have evaluated interventions with CBT components [ ].
Available meta-analyses suggest that internet-based psychotherapeutic interventions are effective for DDs compared to a waiting list or attention control condition. Internet-based interventions improved depression severity in adults with major depression (SMD –0.90, 95% CI –1.07 to –0.73) . Self-guided iCBT was effective on depressive symptom severity (SMD 0.27) and treatment response (odds ratio 1.95, 95% CI 1.52-2.50) [ ]. Internet-based interventions could also be effective for treating subthreshold depression and preventing major depression [ ]. Recent meta-analyses of direct comparisons suggest similar effectiveness between internet-based and face-to-face psychotherapeutic interventions for treating DDs [ , , - ], which was the starting point of this project.
Although the previous data suggest that iCBT can be as effective as face-to-face CBT for treating DDs, the evidence is not conclusive. Other systematic reviews found that iCBT is more effective than face-to-face CBT at reducing symptom severity in depression (SMD –1.73, 95% CI –2.72 to –0.74) , but there was no evidence of an effect of iCBT compared to active treatments regarding depressive symptoms in adolescents and young adults [ ]. Conversely, heterogeneity between studies was substantial in the published meta-analyses, with I-squared (I2) up to 98%. In addition, no moderators of treatment effects were identified [ ] that explained this heterogeneity. Thus, the comparative effectiveness of eHealth and face-to-face interventions is unclear.
At present, using technology to maximize accessibility for depression treatments is an important next step . Digital interventions can increase access to evidence-based psychotherapeutic interventions, which explains the large-scale investments to integrate eHealth into regular health care services [ , , ]. This context requires understanding under what conditions eHealth interventions work, if they are effective for everyone, and in which groups the interventions might be more or less effective [ , ]. For example, there are barriers to using iCBT for patients, such as computer literacy, language, and disabilities, and patients’ attrition rates can differ between face-to-face and digital interventions [ ]. Additionally, psychologists must be trained to deliver eHealth interventions [ ]. Finally, recommendations for using iCBT should be underpinned by high-quality evidence from studies including complex presentations of depression—that is, patients with comorbidities, higher depression severity, or risk of suicide. In summary, the evidence on digital psychotherapeutic interventions should apply to everyday practice and all patient groups [ ].
The baseline characteristics of patients in the RCTs of eHealth interventions for DDs have received little consideration. Determining whether these characteristics differ among eHealth and face-to-face intervention trials is essential to gain knowledge about the external validity of eHealth trials. The aim of our study was to compare the baseline characteristics of patients with DDs included in the RCTs of eHealth and face-to-face psychotherapeutic interventions with a cognitive component.
This meta-epidemiological study was prospectively registered in PROSPERO (registration CRD42019085880).
We included RCTs published as an article in any language from 1990 to November 2017.
Participants included adults (aged ≥16 years) with a diagnosis of DD according to an established diagnostic procedure. Depression could be the only diagnosis or coexist with other conditions, but DD should be the leading psychological diagnosis. We excluded studies with patients who are hospitalized.
Psychotherapeutic interventions with at least 5 sessions and a cognitive component—that is, cognitive therapy, CBT, and interpersonal therapy—were eligible. We tried to reduce the heterogeneity among the included psychotherapeutic interventions by focusing on those with a cognitive component. From now on, we will label these interventions as CBT, since they share basic principles, such as that cognitions contribute to the maintenance of depression via their association with emotions and behaviors . We excluded supportive therapy, psychodynamic treatment, and interventions delivered at group level (group, family, or couple therapies).
As a comparator, the studies should have another psychotherapeutic intervention, a sham intervention, or an inactive control (such as a waiting list). To reduce heterogeneity among the included studies, we excluded pharmacological treatment or bibliotherapy as comparators, since the motivation to participate in these trials may differ. However, we admitted antidepressants with stable dosage as cointervention, as the combination of antidepressants and psychotherapeutic interventions reflects routine practice in managing DDs. We created 2 subgroups of studies based on the following criteria.
- eHealth CBT interventions (iCBT): This group included studies evaluating the effects of an eHealth CBT intervention (internet- or device-based self-help program delivered via computer or smartphone). The iCBT must be provided by a health professional with minimum or absent email support. We excluded studies with regular or direct web-based contact (eg, web-based session or chat) or using bibliotherapy on screen. We acknowledge that these can also be eHealth interventions, but we focused on interventions requiring patients working on their own.
- Face-to-face CBT interventions (CBT): This group included studies evaluating the effects of a CBT intervention delivered face-to-face—that is, the sessions require the patient and therapist being in the same room with direct contact. We excluded interventions delivered without visual contact—for example, communication via chat or phone exclusively.
We compared the patients’ characteristics at baseline, as shown in.
Primary and secondary outcomes.
- Age (years; mean, SD)
- Gender (proportion of women)
- Education (proportion of patients with higher education; ie, at least a high school degree)
- Living area (proportion of patients living in a metropolitan area)
- Depression score (mean, SD)
- Depression duration (years; mean, SD)
- History of depression (proportion of patients with at least one previous episode of depression)
- Previous depression treatment (proportion of patients who had received any kind of treatment for depression; ie, psychotherapy, antidepressants, or both)
- Actual antidepressant medication (proportion of patients receiving antidepressants at the start of [and during] the study)
- Actual physical comorbidity (proportion of patients having at least one physical comorbidity; eg, diabetes mellitus)
- Actual mental comorbidity (proportion of patients having at least one additional mental disorder; eg, Axis I diagnosis)
- Study dropout (proportion of patients who dropped out or did not finish the study)
- Quality of life (measured with a validated scale; mean, SD)
- Proficiency with computers (measured with a validated scale; mean, SD)
- Having children (proportion of patients having children)
- Family status (proportion of patients living alone; ie, single, divorced, or widowed)
- Employment (proportion of patients being employed)
Search Methods for the Identification of Studies
First, we searched the following sources for face-to-face CBT intervention studies: (1) the database of Cuijpers et al  (date consulted: November 11, 2017), which was created in 2009, contains the RCTs of psychological treatments for depression, and on the date of our search (November 11, 2017), consisted of a total of 351 records; and (2) the collection of articles at the Institute for Complementary and Integrative Medicine (University Hospital Zurich and University of Zurich, Switzerland).
Second, we searched the following electronic databases (from October 16 to December 31, 2017) for iCBT studies: (1) MEDLINE (via PubMed), (2) Embase, (3) PsycINFO, and (4) Google Scholar. The search strategies combined relevant search terms related to the main concepts of the search (depression, eHealth, and RCTs). We also screened the bibliographies of key publications (see).
Selection of Studies
In the first stage, 1 author (VA) screened the records (titles and abstracts) in the database of Cuijpers et al  to select potentially eligible face-to-face CBT studies. VA also screened the results of the electronic searches and the bibliographies of key publications for iCBT studies that could possibly be matched with the face-to-face CBT studies. If there was any uncertainty based on the information given in the title or abstract, VA asked another author (JB) for clarification. Subsequently, 2 authors assessed the eligibility of the retrieved full texts: VA assessed the eligibility of each full text, which was cross-checked by JB. Disagreements were resolved by discussion. In the second stage, 2 researchers (VA and Lena Kümmel) independently checked if the potentially eligible studies reported all the necessary data. VA and Lena Kümmel resolved disagreements by discussion, and if there was no consensus, JB reached a final decision.
To include a study in the analysis, it must have had a matching study (being either iCBT or face-to face CBT) for all the following factors (all of them predefined and implemented in this order): (1) the same depression measurement or scale (eg, Edinburgh Postnatal Depression Scale), (2) similar depression treatment (eg, CBT), (3) similar diagnosis, (4) similar age range, (5) similar recruitment timeframe (less than 5 years of difference), (6) similar publication dates (less than 5 years of difference), (7) similar country, and (8) similar race. VA implemented the matching, and JB checked the decisions.
Next, 2 researchers (Lena Kümmel and VA) independently used a Microsoft Excel form to extract data on participants, interventions, comparators, outcomes, and matching criteria. JLA cross-checked the extracted numerical data. Discrepancies were resolved by discussion. We did not assess the risk of bias or contact the study authors to clarify unclear information.
For each outcome, we extracted the total number of randomized participants, the number of participants with the characteristic (dichotomous data), and the mean and SD (continuous data). If different scales were used for the same construct, we standardized each study’s mean and SD to a 100-point scale. To standardize means, we applied the following formula: (mean – lowest scale value)× 100/scale range. To standardize the SDs, we multiplied the observed SD by 100 and divided it by the scale range. As this standardization method does not correct for differences in the direction of the scales, we checked that all the scales pointed in the same direction; for example, if higher values indicated a better health state. If different time units were used, we converted the time unit to years.
For missing SDs, we first tried to calculate them from the report using the Review Manager calculator (version 5.4.1; The Cochrane Collaboration) . We followed the method of Wan et al [ ] to estimate the mean and SD from the sample size, median, range, and IQR. If these procedures were not possible, we borrowed the SD from other studies in the same meta-analysis [ ]. If several candidate SDs were available, we used the largest SD.
We attempted to perform an “available-case analysis” of the randomized population: we took as denominators the randomized participants with a complete baseline measurement of the outcome. We considered the randomized population if the population measured at baseline was unclear. When authors presented the baseline information for those who completed the intervention and those lost to follow-up separately, we pooled the data with the Review Manager calculator (version 5.4.1; The Cochrane Collaboration) .
We used the Comprehensive Meta-Analysis software (version 3; Biostat)  to perform the analyses. We applied a DerSimonian and Laird random-effects meta-analysis [ ]. The logit transformation was used for meta-analyses of prevalence. We investigated statistical heterogeneity in the results by considering the chi-square P value and the I² statistic [ ]. When the relevant levels of heterogeneity were found, we still meta-analyzed the data.
To test whether each baseline characteristic differed in CBT and iCBT trials, we used a mixed-effects model. This model pools the studies within each subgroup using the random-effects model and tests for differences between the subgroups using a fixed-effects model . Due to the low number of studies (below 30 per subgroup), we used a common among-study variance (τ2) for each subgroup, which was computed by pooling the among-study variances of the 2 subgroups [ ]. We ran a z test to compare the 2 effect sizes directly. The threshold for statistical significance was .05. For continuous outcomes, we also estimated the difference in means between subgroups along with its 95% CI [ ]. We did not obtain a 95% CI for the difference in prevalence as there is no meaningful way to compute it [ ].
The search for iCBT studies generated 123 records, and the search for face-to-face studies found 351 records. Therefore, we screened 474 titles and abstracts and excluded 290. We examined 184 full-text reports, of which 68 were excluded. We further assessed 64 face-to-face and 52 internet-based full-text RCTs, from which we finally included 29 matching pairs (with a total of 58 included RCTs). More details are provided in.
Description of the Included Studies
and detail the characteristics of the 58 included studies, which were published between 1990 and 2017 (n=52, 90% of them after 2000). All studies were carried out in high-income countries: 50% (n=29) in Europe, 22% (n=13) in the United States, 17% (n=10) in Australia, and 10% (n=6) in other countries. There were no multinational studies.
The studies included a total of 3846 patients. The patients were adults (mean ages ranging from 20 to 74 years in the 57 studies reporting this information) and mostly female (n=2803, 72.9%). In the 29 studies reporting the patients’ race, White patients were the most frequently reported, representing from 63.6% to 100% of the samples. The participants’ socioeconomic status was poorly described in the 58 studies: 39 (67%) studies reported the participants’ education, ranging from college to doctoral degrees. There were 27 (47%) studies that reported the participants’ employment status: from 14% to 80% of the patients were employed (full- or part-time). There were 4 (7%) studies that reported the social class or income of the included participants: from 16% to 36% of the participants had a social class I/II or an income higher than US $30,000/year.
The included patients had different types of DDs: mild to moderate, major depression, postnatal depression, and others. Depression severity was measured with different tools, with the Beck Depression Index being the most common (n=20, 34%). The participants presented mental (eg, addictions) and physical (eg, diabetes mellitus or cardiac surgery) comorbidities that were matched in the study pairs.
All the included studies delivered psychotherapeutic interventions with a cognitive component. The duration of the interventions ranged from 6 to 20 weeks with daily, weekly, or fortnightly sessions that lasted from 10 to 90 minutes each. The cointerventions were poorly described.
Comparison of Baseline Characteristics of Participants in the Included iCBT and Face-to-Face CBT RCTs
The results are provided in. also details the results of the meta-analyses, including the iCBT and face-to-face CBT studies.
|Characteristic||Meta-analyses (random-effects model)|
|Estimate (95% CI)||Study, n||Participant, n||I2 (%)||Subgroup analysesa|
|Difference (95% CI)b||P value|
|Age (years)||–1.89 (–10.08 to 6.29)||.65|
|Face-to-face CBTd||41.81 (35.21-48.54)||28||1056||99.5|
|Gender, women, %||—e||.16|
|Face-to-face CBT||68.2 (62.2-73.7)||29||1271||71.1|
|Education, higher education, %||—||.38|
|Face-to-face CBT||79.2 (67.4-87.5)||15||789||85.2|
|Living area, metropolitan area, %||—||.38|
|Face-to-face CBT||98.1 (88-99.7)||2||52||<0.001|
|Depression scoref (standardized to a 0-100–point scale)||1.10 (–3.43 to 5.61)||.64|
|Face-to-face CBT||42.25 (38.09-42.41)||28||1020||96.5|
|Depression duration (years)||7.19 (2.53-11.84)||.002|
|Face-to-face CBT||2.8 (1.2-4.4)||5||155||89.2|
|History of depression, %||—||.42|
|Face-to-face CBT||65.1 (53.1-75.5)||10||342||73.3|
|Previous depression treatmentg, %||—||.04|
|Face-to-face CBT||42 (28.3-57.1)||7||303||80.9|
|Actual antidepressant medication, %||—||.11|
|Face-to-face CBT||14.8 (5-36.6)||13||423||85.3|
|Actual physical comorbidity, %||—||.33|
|Face-to-face CBT||98.5 (90-99.8)||2||66||0|
|Actual mental comorbidity, %||—||.77|
|Face-to-face CBT||66.9 (28.7-91.1)||5||196||89.7|
|Study dropout, %||—||.36|
|Face-to-face CBT||15.4 (10.1-22.7)||24||987||83.4|
|Quality of life (standardized to a 0-100–point scale)||14.50 (–12.54 to 41.53)||.29|
|Face-to-face CBT||33.61 (9.15-58.07)||2||90||98.5|
|Having children, %||—||.55|
|Face-to-face CBT||98.1 (91-99.6)||3||79||0|
|Family status, living alone, %||—||.37|
|Face-to-face CBT||44.2 (34.5-54.4)||20||768||83.3|
|Face-to-face CBT||53 (40.9-64.8)||13||519||80.9|
aDegrees of freedom=1.
b95% CI for the difference in prevalence was not calculated, as there is no meaningful way to compute it.
ciCBT: internet cognitive behavioral therapy.
dCBT: cognitive behavioral therapy.
fSubgroup analyses for depression measured with individual scores: Beck Depression Inventory (P≥.99); Depression, Anxiety and Stress Scale-21 (P=.04); Center for Epidemiologic Studies-Depression Scale (6 studies; P=.87), Edinburgh Postnatal Depression Scale (4 studies; P=.34), and Hamilton Depression Rating Scale (6 studies; P=.07).
gProportion of patients (%) having received any kind of treatment for depression (ie, psychotherapy, antidepressants, or both).
The mean depression duration was 7.19 years higher (CI 95% 2.53-11.84) in iCBT trials than in face-to-face CBT trials (10.0 vs 2.8 years; P=.002). However, the mean proportion of patients with previous depression treatment was lower in iCBT trials (24.8% vs 42% in face-to-face trials; P=.04). The subgroup analyses found no evidence of differences for the remaining primary outcomes: age, gender, education, living area, depression score, history of depression, actual antidepressant medication, actual physical comorbidity, actual mental comorbidity, and study dropout.
We found no evidence of differences between iCBT and face-to-face CBT studies for quality of life, having children, family status, and employment. Subgroup analysis for the proficiency with computers could not be performed due to insufficient studies.
To our knowledge, our study is the first to compare the baseline characteristics of patients with DDs included in the RCTs of eHealth and face-to-face CBT interventions. Overall, we found that the patients’ characteristics between eHealth and face-to-face RCTs were generally similar. This finding suggests that patients in both types of trials are comparable rather than different. However, patients in eHealth trials had a longer depression duration, and a lower proportion had received previous depression treatment.
eHealth psychological interventions have several advantages compared to face-to-face interventions. First, iCBT creates the opportunity to deliver psychological treatment to people without access to face-to-face therapy . Thus, iCBT can help patients avoid traveling to physical consultations and can mitigate the shortage of professionals [ , - ]. Second, guided iCBT probably represents the most economical option for the short-term treatment of adults with mild-to-moderate major depression [ ]. Third, eHealth interventions have become highly automated, which enhances fidelity with treatment protocols [ , ]. Fourth, digital interventions are becoming acceptable for patients and therapists, particularly since the COVID-19 pandemic [ , , ]. In fact, surveys suggest that iCBT guided by therapists could become a preferred option for patients over in-person CBT or medication [ ].
We assumed that the baseline characteristics of patients in eHealth and face-to-face psychotherapeutic intervention RCTs would differ. For example, we hypothesized that patients in eHealth RCTs would be younger due to their familiarity with computers and frequent use of social media . However, we did not find differences regarding the patients’ age, which is supported by recent literature that suggests that older adults are becoming more computer literate and that iCBT could therefore be a treatment opportunity [ ]. Conversely, available research suggests that younger people are more likely to drop out of iCBT, but the reason for that result remains unknown [ ]. Our study was not able to confirm this finding.
Our study found that patients in eHealth RCTs presented a longer depression duration but had received previous depression treatment in a lower number. The longer depression duration in eHealth RCTs could be explained by the fact that patients in eHealth trials perceive barriers concerning face-to-face treatments, and therefore, eHealth treatment might be more attractive to them. Conversely, we expected that patients in eHealth RCTs would present more severe depression since a lower proportion had received treatment for depression. However, our analyses did not support this assumption. Finally, our findings might indicate that eHealth trials attract patients who postpone earlier treatment attempts, but future research should be conducted to confirm this finding.
Our searches identified a high number of RCTs, which confirms the recent expansion of research into digital interventions [, ]. However, the baseline characteristics of the trial participants were poorly and heterogeneously reported. This finding represents a major limitation of the available research, as the role of these characteristics is essential to understand under what conditions eHealth psychotherapeutic interventions will work. For example, few studies reported the patients’ proficiency with computers, which is critical to explain the lack of effect of a digital intervention. Additionally, there is room for improvement in the reporting of socioeconomic characteristics, such as working conditions or family status, which are essential features to understand which type of patients benefit from eHealth interventions. Furthermore, it would be of interest to know about the comorbidities directing a patient to a certain treatment method as well as previous treatments against DDs.
This incomplete reporting highlights the need to agree to a consensus-based minimum set of baseline characteristics that should be measured and reported in all RCTs of eHealth psychotherapeutic interventions. Once the list is defined, consensus should be achieved on how to measure these characteristics, such as which measurement instruments should be selected to measure proficiency with computers. Finally, the reporting of these characteristics should be encouraged in future RCTs to allow the assessment of the applicability of the study findings.
Strengths and Limitations
Our study had several limitations, but we tried to overcome them by following rigorous methods .
First, our searches may have missed eligible studies. Particularly, we limited the searches from 1990 onward as no eligible study would have been published before. The restriction until 2017 was because the searches were executed that year, and we did not have the resources to update them. However, we did not attempt to perform a systematic review and, thus, include all the studies in this field. We consider that the 58 included RCTs probably give an unbiased view of the situation in this research field.
Second, our matching process by relevant characteristics may have minimized differences between subgroups. Moreover, otherwise eligible studies were excluded because we could not find their matching pair. However, we consider that the matching process minimized confounding in the subgroup analyses (see below).
Third, subgroup analysis is a technique with considerable pitfalls. Nevertheless, we followed established guidelines to overcome the main limitations. (1) We prevented post hoc analyses and undue emphasis on particular findings by choosing the analyses in advance with clear rationale [, ]. (2) We found a high number of studies for most outcomes, which increased the statistical power (which is usually low in subgroup analyses). For example, 6 analyses presented at least 20 studies per subgroup. (3) We did not simply compare the statistical significance of the results in each subgroup and performed formal significance tests [ , ]. Moreover, we estimated the difference in means between subgroups and its 95% CI for continuous outcomes, which allowed us to judge if the differences were clinically relevant [ ]. (4) We interpreted the results cautiously. We acknowledge that subgroup comparisons are exploratory analyses that are observational by nature [ , ]. As studies are not allocated randomly to each subgroup, we cannot assume that the subgroup populations were identical except for the intervention type (internet-based or face-to-face). Thus, the results from a subgroup analysis are prone to confounding by other study-level characteristics [ ]. Similarly, although we found differences in 2 characteristics between subgroups (depression duration and previous treatment for depression), we cannot conclude that they were due to the type of intervention delivery (eHealth or face-to-face).
Fourth, there is an increasing risk of type 2 error concurrent with the number of analyses, which was 16 in our case . Although we did not adjust the significance level to account for multiple analyses, we assessed the impact of this decision by sensitivity analysis. After setting a new .006 threshold for statistical significance according to the proposal by Jakobsen et al [ ], only the depression duration at baseline maintained its statistical significance. Thus, our general conclusion did not change; overall, patients in iCBT and face-to-face RCTs had similar sociodemographic and depression characteristics.
This is the first study comparing the baseline characteristics of patients with DDs included in the RCTs of eHealth and face-to-face psychotherapeutic interventions. Overall, our study did not find differences in the patients’ characteristics between eHealth and face-to-face RCTs. However, patients in eHealth trials had a longer depression duration, and a lower proportion had received previous depression treatment. This finding might indicate that eHealth trials attract patients who postpone earlier treatment attempts. Our findings highlight a need to improve the reporting of the baseline characteristics of patients included in the RCTs of eHealth psychotherapeutic interventions.
We thank Christopher James Rose (Norwegian Institute of Public Health) and Alfonso Muriel and Borja Manuel Felix (Hospital Universitario Ramón y Cajal) for their statistical support.
CMW, JB, and VA defined the research question. VA performed the searches. All authors discussed the inclusion and matching criteria. Lena Kümmel and VA selected the studies. VA matched the included studies. Lena Kümmel and VA independently extracted the outcome data. The data extraction was cross-checked by JLA. JLA and VA performed the analysis. JLA and VA wrote the manuscript under the supervision of JB. All authors approved the final manuscript.
Conflicts of Interest
CMW has active research grants to the University for digital health projects from the German health care Innovation Fund, and Newsense Lab GmbH. Board positions related to digital health for mind and body (nonpaid) are as follows: Co-Director of the Digital Society Initiative of the University of Zurich and President Fachverband Mind Body Medicine. All other authors do not have any conflict related to the content of the manuscript.
Key publications.DOCX File , 15 KB
Included studies.DOCX File , 89 KB
Summary of the included studies.DOCX File , 16 KB
Meta-analyses of baseline characteristics.DOCX File , 50 KB
- GBD 2016 Disease and Injury Incidence and Prevalence Collaborators. Global, regional, and national incidence, prevalence, and years lived with disability for 328 diseases and injuries for 195 countries, 1990-2016: a systematic analysis for the Global Burden of Disease Study 2016. Lancet 2017 Sep 16;390(10100):1211-1259 [FREE Full text] [CrossRef] [Medline]
- Depression and other common mental disorders: global health estimates. World Health Organization. 2017. URL: https://apps.who.int/iris/bitstream/handle/10665/254610/WHO-MSD-MER-2017.2-eng.pdf?sequence=1 [accessed 2022-12-14]
- Bock JO, Luppa M, Brettschneider C, Riedel-Heller S, Bickel H, Fuchs A, et al. Impact of depression on health care utilization and costs among multimorbid patients--from the MultiCare Cohort Study. PLoS One 2014;9(3):e91973 [FREE Full text] [CrossRef] [Medline]
- Topooco N, Riper H, Araya R, Berking M, Brunn M, Chevreul K, E-COMPARED consortium. Attitudes towards digital treatment for depression: a European stakeholder survey. Internet Interv 2017 Jun;8:1-9 [FREE Full text] [CrossRef] [Medline]
- Comprehensive Mental Health Action Plan 2013-2030. World Health Organization. 2021 Sep 21. URL: https://www.who.int/publications/i/item/9789240031029 [accessed 2022-08-10]
- Malhi GS, Bell E, Bassett D, Boyce P, Bryant R, Hazell P, et al. The 2020 Royal Australian and New Zealand College of Psychiatrists clinical practice guidelines for mood disorders. Aust N Z J Psychiatry 2021 Jan 22;55(1):7-117. [CrossRef] [Medline]
- NICE. Depression in adults: recognition and management. National Institute for Health and Care Excellence. 2009 Oct 28. URL: https://www.nice.org.uk/guidance/cg90 [accessed 2022-08-10]
- Swartz HA, Fournier J. Can network meta-analysis substitute for direct comparisons in psychotherapy trials? JAMA Psychiatry 2019 Jul 01;76(7):678-679. [CrossRef] [Medline]
- Cuijpers P, Noma H, Karyotaki E, Vinkers CH, Cipriani A, Furukawa TA. A network meta-analysis of the effects of psychotherapies, pharmacotherapies and their combination in the treatment of adult depression. World Psychiatry 2020 Feb 10;19(1):92-107 [FREE Full text] [CrossRef] [Medline]
- Cuijpers P, Quero S, Noma H, Ciharova M, Miguel C, Karyotaki E, et al. Psychotherapies for depression: a network meta-analysis covering efficacy, acceptability and long-term outcomes of all main treatment types. World Psychiatry 2021 Jun;20(2):283-293 [FREE Full text] [CrossRef] [Medline]
- Barth J, Munder T, Gerger H, Nüesch E, Trelle S, Znoj H, et al. Comparative efficacy of seven psychotherapeutic interventions for patients with depression: a network meta-analysis. PLoS Med 2013;10(5):e1001454 [FREE Full text] [CrossRef] [Medline]
- Molloy A, Ellis DM, Su L, Anderson PL. Improving acceptability and uptake behavior for internet-based cognitive-behavioral therapy. Front Digit Health 2021 Mar 25;3:653686 [FREE Full text] [CrossRef] [Medline]
- Königbauer J, Letsch J, Doebler P, Ebert D, Baumeister H. Internet- and mobile-based depression interventions for people with diagnosed depression: a systematic review and meta-analysis. J Affect Disord 2017 Dec 01;223:28-40. [CrossRef] [Medline]
- Karyotaki E, Riper H, Twisk J, Hoogendoorn A, Kleiboer A, Mira A, et al. Efficacy of self-guided internet-based cognitive behavioral therapy in the treatment of depressive symptoms: a meta-analysis of individual participant data. JAMA Psychiatry 2017 Apr 01;74(4):351-359. [CrossRef] [Medline]
- Reins JA, Buntrock C, Zimmermann J, Grund S, Harrer M, Lehr D, et al. Efficacy and moderators of internet-based interventions in adults with subthreshold depression: an individual participant data meta-analysis of randomized controlled trials. Psychother Psychosom 2021;90(2):94-106 [FREE Full text] [CrossRef] [Medline]
- Andersson G, Titov N, Dear BF, Rozental A, Carlbring P. Internet-delivered psychological treatments: from innovation to implementation. World Psychiatry 2019 Feb;18(1):20-28 [FREE Full text] [CrossRef] [Medline]
- Cuijpers P, Noma H, Karyotaki E, Cipriani A, Furukawa TA. Effectiveness and acceptability of cognitive behavior therapy delivery formats in adults with depression: a network meta-analysis. JAMA Psychiatry 2019 Jul 01;76(7):700-707 [FREE Full text] [CrossRef] [Medline]
- Carlbring P, Andersson G, Cuijpers P, Riper H, Hedman-Lagerlöf E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: an updated systematic review and meta-analysis. Cogn Behav Ther 2018 Jan;47(1):1-18. [CrossRef] [Medline]
- Luo C, Sanger N, Singhal N, Pattrick K, Shams I, Shahid H, et al. A comparison of electronically-delivered and face to face cognitive behavioural therapies in depressive disorders: a systematic review and meta-analysis. EClinicalMedicine 2020 Jul 27;24:100442 [FREE Full text] [CrossRef] [Medline]
- Christ C, Schouten MJ, Blankers M, van Schaik DJ, Beekman AT, Wisman MA, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in adolescents and young adults: systematic review and meta-analysis. J Med Internet Res 2020 Sep 25;22(9):e17831 [FREE Full text] [CrossRef] [Medline]
- Clark DM, Canvin L, Green J, Layard R, Pilling S, Janecka M. Transparency about the outcomes of mental health services (IAPT approach): an analysis of public data. Lancet 2018 Feb 17;391(10121):679-686 [FREE Full text] [CrossRef] [Medline]
- Lindner P, Nyström MB, Hassmén P, Andersson G, Carlbring P. Who seeks ICBT for depression and how do they get there? effects of recruitment source on patient demographics and clinical characteristics. Internet Interv 2015 May;2(2):221-225. [CrossRef]
- Andersson G. Using the Internet to provide cognitive behaviour therapy. Behav Res Ther 2009 Mar;47(3):175-180. [CrossRef] [Medline]
- Health Quality Ontario. Internet-delivered cognitive behavioural therapy for major depression and anxiety disorders: a health technology assessment. Ont Health Technol Assess Ser 2019;19(6):1-199 [FREE Full text] [Medline]
- Cuijpers P, van Straten A, Andersson G, van Oppen P. Psychotherapy for depression in adults: a meta-analysis of comparative outcome studies. J Consult Clin Psychol 2008 Dec;76(6):909-922. [CrossRef] [Medline]
- Cuijpers P, Karyotaki E, Ciharova M, Quero S, Pineda B, Munoz R, et al. A meta-analytic database of randomised trials on psychotherapies for depression. Open Science Framework. 2019 Jul 09. URL: https://doi.org/10.17605/OSF.IO/825C6 [accessed 2022-11-15]
- Review Manager (RevMan). Cochrane Training. Copenhagen: The Cochrane Collaboration URL: https://training.cochrane.org/online-learning/core-software/revman [accessed 2022-08-10]
- Wan X, Wang W, Liu J, Tong T. Estimating the sample mean and standard deviation from the sample size, median, range and/or interquartile range. BMC Med Res Methodol 2014 Dec 19;14:135 [FREE Full text] [CrossRef] [Medline]
- Furukawa TA, Barbui C, Cipriani A, Brambilla P, Watanabe N. Imputing missing standard deviations in meta-analyses can provide accurate results. J Clin Epidemiol 2006 Jan;59(1):7-10. [CrossRef] [Medline]
- Biostat. Comprehensive meta-analysis. URL: https://www.meta-analysis.com/ [accessed 2022-08-10]
- Deeks JJ, Higgins JPT, Altman DG. Chapter 10: analysing data and undertaking meta-analyses. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Page MJ, et al, editors. Cochrane Handbook for Systematic Reviews of Interventions. 2nd ed. Chichester, United Kingdom: John Wiley & Sons; 2021.
- Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ 2003 Sep 06;327(7414):557-560 [FREE Full text] [CrossRef] [Medline]
- Borenstein M. Common Mistakes in Meta-Analysis and How to Avoid Them. New Jersey, USA: Biostat, Inc; 2019.
- Hoeft TJ, Fortney JC, Patel V, Unützer J. Task-sharing approaches to improve mental health care in rural and other low-resource settings: a systematic review. J Rural Health 2018 Dec;34(1):48-62 [FREE Full text] [CrossRef] [Medline]
- Fu Z, Burger H, Arjadi R, Bockting CLH. Effectiveness of digital psychological interventions for mental health problems in low-income and middle-income countries: a systematic review and meta-analysis. Lancet Psychiatry 2020 Oct;7(10):851-864 [FREE Full text] [CrossRef] [Medline]
- Ebert DD, Cuijpers P, Muñoz RF, Baumeister H. Prevention of mental health disorders using internet- and mobile-based interventions: a narrative review and recommendations for future research. Front Psychiatry 2017;8:116 [FREE Full text] [CrossRef] [Medline]
- Wolitzky-Taylor K, Chung B, Bearman SK, Arch J, Grossman J, Fenwick K, et al. Stakeholder perceptions of the barriers to receiving and delivering exposure-based cognitive behavioral therapy for anxiety disorders in adult community mental health settings. Community Ment Health J 2019 Jan 5;55(1):83-99 [FREE Full text] [CrossRef] [Medline]
- Simon N, Robertson L, Lewis C, Roberts NP, Bethell A, Dawson S, et al. Internet-based cognitive and behavioural therapies for post-traumatic stress disorder (PTSD) in adults. Cochrane Database Syst Rev 2021 May 20;5:CD011710 [FREE Full text] [CrossRef] [Medline]
- Apolinário-Hagen J, Harrer M, Kählke F, Fritsche L, Salewski C, Ebert DD. Public attitudes toward guided internet-based therapies: web-based survey study. JMIR Ment Health 2018 May 15;5(2):e10735 [FREE Full text] [CrossRef] [Medline]
- Yonker LM, Zan S, Scirica CV, Jethwani K, Kinane TB. "Friending" teens: systematic review of social media in adolescent and young adult health care. J Med Internet Res 2015 Jan 05;17(1):e4 [FREE Full text] [CrossRef] [Medline]
- Silfvernagel K, Westlinder A, Andersson S, Bergman K, Diaz Hernandez R, Fallhagen L, et al. Individually tailored internet-based cognitive behaviour therapy for older adults with anxiety and depression: a randomised controlled trial. Cogn Behav Ther 2018 Jul;47(4):286-300. [CrossRef] [Medline]
- Edmonds M, Hadjistavropoulos HD, Schneider LH, Dear BF, Titov N. Who benefits most from therapist-assisted internet-delivered cognitive behaviour therapy in clinical practice? predictors of symptom change and dropout. J Anxiety Disord 2018 Mar;54:24-32 [FREE Full text] [CrossRef] [Medline]
- Torous J, Bucci S, Bell IH, Kessing LV, Faurholt-Jepsen M, Whelan P, et al. The growing field of digital psychiatry: current evidence and the future of apps, social media, chatbots, and virtual reality. World Psychiatry 2021 Oct;20(3):318-335 [FREE Full text] [CrossRef] [Medline]
- Sun X, Briel M, Walter SD, Guyatt GH. Is a subgroup effect believable? updating criteria to evaluate the credibility of subgroup analyses. BMJ 2010 Mar 30;340(mar30 3):c117. [CrossRef] [Medline]
- Paquette M, Alotaibi AM, Nieuwlaat R, Santesso N, Mbuagbaw L. A meta-epidemiological study of subgroup analyses in cochrane systematic reviews of atrial fibrillation. Syst Rev 2019 Oct 25;8(1):241 [FREE Full text] [CrossRef] [Medline]
- Gagnier JJ, Moher D, Boon H, Beyene J, Bombardier C. Investigating clinical heterogeneity in systematic reviews: a methodologic review of guidance in the literature. BMC Med Res Methodol 2012 Jul 30;12:111 [FREE Full text] [CrossRef] [Medline]
- Jakobsen JC, Wetterslev J, Winkel P, Lange T, Gluud C. Thresholds for statistical and clinical significance in systematic reviews with meta-analytic methods. BMC Med Res Methodol 2014 Nov 21;14:120 [FREE Full text] [CrossRef] [Medline]
|CBT: cognitive behavioral therapy|
|DD: depressive disorder|
|iCBT: internet cognitive behavioral therapy|
|RCT: randomized controlled trial|
|SMD: standardized mean difference|
Edited by G Eysenbach; submitted 02.02.22; peer-reviewed by E Smoktunowicz, C Salewski; comments to author 26.02.22; revised version received 16.05.22; accepted 28.07.22; published 14.09.22Copyright
©Vera Aemissegger, Jesus Lopez-Alcalde, Claudia M Witt, Jürgen Barth. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 14.09.2022.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.