Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?


Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 28.04.17 in Vol 19, No 4 (2017): April

Preprints (earlier versions) of this paper are available at, first published Sep 30, 2016.

This paper is in the following e-collection/theme issue:

    Original Paper

    Therapist-Supported Internet-Based Cognitive Behavior Therapy for Stress, Anxiety, and Depressive Symptoms Among Postpartum Women: A Systematic Review and Meta-Analysis

    1Alice Lee Centre for Nursing Studies, Yong Loo Lin School of Medicine, National University of Singapore, Singapore, Singapore

    2Medical Resource Team, National University of Singapore Libraries, Singapore, Singapore

    Corresponding Author:

    Ying Lau, RN, RM, B HealthSc, BN(Hons), MNurs, PhD

    Alice Lee Centre for Nursing Studies

    Yong Loo Lin School of Medicine

    National University of Singapore

    Level 2, Clinical Research Centre, Block MD11, 10 Medical Drive

    Singapore, 117597


    Phone: 65 66011603

    Fax:65 67767135



    Background: A growing number of meta-analyses have supported the application of therapist-supported Internet-based cognitive behavior therapy (iCBT) for psychological disorders across different populations, but relatively few meta-analyses have concentrated on postpartum women.

    Objective: This meta-analysis evaluated the efficacy of therapist-supported iCBT in improving stress, anxiety, and depressive symptoms among postpartum women.

    Methods: A total of 10 electronic databases were used to search for published and unpublished trials. Cochrane Collaboration tool for assessing risk of bias was utilized to measure methodological quality. Meta-analysis was performed using the RevMan software (Review Manager version 5.3 for Windows from the Nordic Cochrane Centre, the Cochrane Collaboration, 2014). Among the 789 studies identified, 8 randomized controlled trials were selected, involving 1523 participants across 6 countries.

    Results: More than half (65%) of the eligible studies had a low risk of bias with no heterogeneity. Results revealed that therapist-supported iCBT significantly improved stress (d=0.84, n=5), anxiety (d=0.36, n=6), and depressive symptoms (d=0.63, n=8) of the intervention group compared with those of the control group at post-intervention.

    Conclusions: This review revealed that therapist-supported iCBT significantly improves stress, anxiety, and depressive symptoms among postpartum women with small to large effects. Future effectiveness studies should establish the essential components, format, and approach of iCBT with optimal levels of human support to maximize a long-term effect.

    J Med Internet Res 2017;19(4):e138




    Cognitive behavior therapy (CBT) is a form of psychotherapy based on the assumption that all psychological disturbances are caused by dysfunctional thinking [1]. CBT aims to modify thoughts, beliefs, and perceptions, and change behavioral pattern [2]. Cognitive restructuring is a common psychotherapeutic process in CBT for identifying, evaluating, and changing negative, distorted thoughts and beliefs [3]. Cognitive restructuring is a useful technique to understand wrong automatic beliefs and it helps individuals to reframe their negative perception or distorted thinking in a more positive frame of mind [3]. Behavioral activation, which is a different form of CBT, is a functional analytical approach for engaging in enjoyable activities frequently to maintain or improve psychological well-being [4]. Behavioral activation is a development of activity scheduling that focuses on the use of avoided activities as a guide for activity scheduling and functional analysis of cognitive processes that involve avoidance [4]. Despite the well-established efficacy of CBT for treating and preventing psychological disorders [5], barriers to the administration of CBT exist, which may include insufficient therapists, stigmatization, geographical remoteness, long waiting times, and high costs [6]. CBT has been suggested suitable for remote delivery because of its structured content [7]. During the past 15 years, the development of Internet-based psychological intervention has progressed significantly [8], particularly in light of the rapid improvements in Internet technologies globally [9]. An innovative administration has been developed in the form of Internet-based CBT (iCBT) to minimize treatment barriers and increase access to care [8,10].

    The Internet makes CBT feasible and worth consideration. Implementation of iCBT is able to administer the full course of a CBT treatment using online self-help format, which might or might not be supported by a therapist [8]. A therapist can provide support through phone, email, text, or an interactive computer interface [10,11]. Therapist-supported iCBT is a therapy that is guided by an identified therapist who gives feedback and answers to questions, and which can include interactive features through the Internet to get access to psychological treatment [8]. Recent systematic reviews of therapist-supported iCBT for anxiety [10] and psychiatric and somatic disorder [12] produced equivalent effect compared with face-to-face CBT. Therapist-supported interventions involving higher levels of human support improve outcomes for depression, but do not significantly affect outcomes for stress [13] or anxiety [10]. An Internet-based intervention with instant feedback has achieved adherence and effectiveness similar to that of the same intervention with human support [14]. The potential benefits of therapist-supported iCBT are customizability, cost-effectiveness, time-effectiveness, geographic flexibility, time flexibility, consistency, high availability, and rapid dissemination [15,16].

    The postpartum period is a highly challenging time for women because of changes in physical, familial, financial, occupational, and other realms [17]. Changes may affect a woman’s psychosocial and physical resources, resulting in stress, anxiety, and depressive symptoms [17,18]. Reported prevalence rates suggest that 14.3% of women suffer from general stress [18], 1%-30% from post-traumatic stress symptoms [19], 24.9% from anxiety [20], and 13%-19% from depressive symptoms [21] during the postpartum period. In addition, evidence indicates that the coexistence of stress, anxiety, and depressive symptoms occur during the postpartum period [17]. Timely and efficacious intervention is important during the postpartum period, especially when considering the adverse short- and long-term maternal health outcomes and child development outcomes [22-24]. Strong evidence supports that CBT is effective for treatment and prevention during the postpartum period [25]. A review revealed that interventions initiated during the postpartum period were more effective than those initiated during the antenatal period and that the one-to-one therapy was more effective than the group therapy [25]. Notably, the Internet was found to be the preferred source of information among these women [20]. For example, 90% used the Internet to search for health-related information [20] and 69% used the Internet to seek formation about postpartum depression [26]. They expressed interest in use of Web-based resources and greater engagement in ehealth behaviors related to mental health [27]. An increasing number of randomized controlled trials (RCTs) found that iCBT is effective for stress [28,29], anxiety [30,31], and depressive symptoms [32,33] among postpartum women. Given the burgeoning development of iCBT for a broad range of conditions [8] paralleled by the rapid increase in access to instant cyber connectivity, what is the effect of therapist-supported iCBT in improving stress, anxiety, and depressive symptoms among postpartum women?

    Meta-analyses are applied in relation to a wide range of study designs; those that address trial designs are considered to represent the strongest evidence, and they have become increasingly prevalent over the years [34]. A growing number of meta-analyses have supported the application of therapist-supported iCBT for stress [13,35], anxiety [7,10], and/or depressive symptoms [36,37] across different populations, but relatively few meta-analyses of therapist-supported iCBT have concentrated on the postpartum population. We are aware of two recent systematic reviews [38,39] that investigate computer- or Web-based interventions for the prevention and treatment of perinatal mental health [38] or mood disorders [39]. The Two reviews suggest that computer- or Web-based intervention is effective for depressive symptoms [38,39], but mixed results were found for stress and anxiety symptoms [38]. However, the two reviews have been limited in using heterogeneous study designs [38,39], different therapeutic approaches [38], nonspecific outcomes [38,39], and a few eligible studies (n=4) [39]. Although one review [38] used a meta-analytical approach, their population was varied with antenatal, postpartum women, and their partners.

    Evidently, therapist-supported iCBT provides an efficacious, accessible, and economically sound intervention for a broad range of conditions [8] across different populations [7,13]. A systematic review of existing evidence is necessary to determine whether therapist-supported iCBT for postpartum women is efficacious for prevention and treatment of stress, anxiety, and depressive symptoms before therapist-supported iCBT is embedded in routine clinical practice [39]. Further exploration is recommended to address the gaps in the current literature. The findings of this review could guide future studies exploring the next steps of therapist-supported iCBT implementation among the postpartum population. By conducting a systematic review and meta-analysis, we synthesized the best available evidence. This review aimed to systematically assess studies that examined therapist-supported iCBT interventions for improving stress, anxiety, and depressive symptoms among postpartum women.


    This review was conducted according to the standards outlined in the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) statement [40]. The protocol is registered in the PROSPERO database (CRD42016039094).

    Eligibility Criteria

    Studies were selected for the meta-analysis if they fulfilled the PICOS (population, intervention, comparison, outcomes and study) criteria [19]:

    • Population: target women with age ≥ 18 years in the postpartum period (≤ 2 years postpartum) [41]
    • Intervention: Therapist-supported iCBT was delivered over the Internet through the use of websites, email, phone, or Skype. The iCBT must have included support of therapists through phone, email, text, and an interactive computer interface. The intervention comprised at least one of the elements of CBT, including cognitive restructuring, behavioral activation, or skills training
    • Comparison: attention control, waitlist, or treatment as usual (TAU)
    • Outcomes: stress, anxiety, and depressive symptoms at postintervention
    • Type of studies: RCTs

    We excluded studies on teenage pregnancy (< 18 years). We did not include studies that had no CBT component in the intervention group; had active treatment containing a CBT component in the control group; were clinical controlled trials, cross-sectional, cohort, one-group pre- and posttest, and qualitative designs; only had abstracts and were study protocols, reviews, or conference papers.

    Search Strategy

    Similar systematic review papers were searched from the Cochrane Databases of Systematic Reviews, Joanne Briggs Institute, Centre for Reviews and Dissemination, University of York, PubMed Clinical Queries, Google, and Google Scholar to verify that the papers had not been conducted recently. The search strategy aimed to find published or unpublished studies without time limitation to maximize the search. We did not restrict our search to studies reported in any particular language. However, we conducted searches in English.

    A 3-step search strategy was employed from inception until February 9, 2017. The first phase was a comprehensive search using identified keywords and index terms, searching the following 10 electronic databases: EMBASE, PubMed, Cumulative Index to Nursing and Allied Health Literature, Academic Search Completed, PsycINFO, PsycARTICLES, Cochrane Library, Web of Science, Scopus, and ProQuest Dissertations and Theses. Index and keyword terms were used (Multimedia Appendix 1). The index terms and keywords were combined and truncated according to the syntax rules of each database.

    The second phase involved searching, WHO International Clinical Trials Registry Platform, and International Standard Randomised Controlled Trial for unpublished trials relevant to the review. When eligible trials were found, unpublished data were requested.

    The third phase involved searching the reference lists of the included studies and checking previous reviews relevant to the topic for additional studies. The bibliographical software package EndNote program version X7 (Thomas Reuters) was used to import all the references and remove duplicates. The remaining studies were assessed independently against the inclusion and exclusion criteria by two authors (ie, LY and TP).

    Quality Assessment

    After identifying full-text articles that fulfilled the selection criteria, the studies were submitted for quality assessment and verified for eligibility. Cochrane Collaboration tool for assessing risk of bias was used by the two authors to independently evaluate the potential for bias in each study [42]. The following indicators of internal validity specific to the methodology were collected: (1) random sequences generation, (2) allocation concealment, (3) blinding of participants and personnel, (4) blinding of outcome assessment, (5) incomplete outcome data, and (6) selective reporting [42]. Assessment related to the risk of bias was assigned with a judgment of “low risk” of bias, “high risk” of bias, or “unclear risk” of bias. Any difference in opinion between the two authors was resolved by consensus.

    Data Extraction

    The characteristics of trials and elements of therapist-supported iCBT were extracted from each study through structured summaries. Items extracted for the characteristics of trials included authors, year, countries, design, sample with health condition, age, name of iCBT, control group, sample size, outcomes, attrition rate, follow-up, intention-to-Treat (ITT) analysis, and grant support. Items extracted for the descriptions of iCBT were: aim, numbers of sessions, components, therapy, support, provider, peer support, partner support, contact with therapist, communication, interactivity, activities, multimedia, and duration. The summary tables were thoroughly reviewed for accuracy and relevance by the two authors independently. Study authors were contacted for any missing or additional information.

    Data Analysis

    Data were synthesized using the RevMan software (Review Manager Version 5.3 for Windows from the Nordic Cochrane Centre, the Cochrane Collaboration, 2014). We used the generic inverse variance method in our meta-analysis to combine the continuous outcomes with means and standard deviations (SD) [42]. The weight given to each trial was chosen to be the inverse of the variance of the effect estimate (ie, one over the square of its standard error) [42]. With the inverse variance method, mean difference was used for the scores of stress, anxiety, and depressive symptoms. The standardized mean differences with their corresponding 95% CI were employed to combine studies that measured the same outcomes with different methods. The test of the overall effect was assessed using Z-statistics at P<.05. To quantify the efficacy of therapist-supported iCBT on stress, anxiety, and depressive symptoms, we calculated the effect sizes by subtracting the mean value of the iCBT group from the mean value of the control group at posttest and dividing the result by the pooled SD of the two groups. The effect sizes were expressed as Cohen d or standardized mean difference, which were interpreted as small (0.2< d<0.5), medium (0.5< d<0.8), and large (d ≥0.8) [43].

    Heterogeneity between studies was evaluated using the Cochrane Q (chi-square test) and I2 statistics in the RevMan software. The statistical significance for heterogeneity was set as P>.10, and estimates of the degree of heterogeneity using I2 were made by setting 0%–40% as might not be important, 30%–60% as moderate, 50%–90% as substantial, and 75%–100% as considerable [42]. We used fixed- and random-effects models in our meta-analysis according to heterogeneity between studies on different statistical assumptions [44]. The fixed-effects model was used to estimate one true effect in cases without significant heterogeneity (P<.10) because we assumed that the true effect size was the same in the eligible trials, whereas the random-effects model (tau-square) was employed to estimate the mean of a distribution of effects in cases with heterogeneity between studies (P>.10) and in those with I2 values of over 40% because we assumed that the true effect size varied from trial to trial [42]. Subgroup analysis was performed to (1) explore the source of heterogeneity and (2) evaluate the effect in a specific subgroup; performing a subgroup analysis provided information about essential elements for maximizing effectiveness of therapist-supported iCBT [45]. The predefined subgroups differed in health condition, control conditions, type of iCBT, number of sessions, and professional support. We planned to construct funnel plots to determine the possible influence of publication biases if the number of eligible trials was more than 10 [42].


    Study Selection

    The search and selection of articles is illustrated in Figure 1. Using the specified search terms, the searched 10 databases produced a total of 596 records. Among these studies, 200 article duplicates were removed. One additional record was identified from the reference list. On the basis of an analysis of the words in paper titles and abstracts, 332 records were excluded. Full-text articles of the remaining 65 articles were retrieved, reviewed, and selected on the basis of relevance and quality for eligibility. A total of 57 studies were excluded for reasons outlined in Figure 1. Finally, 8 RCTs were selected for meta-analysis.

    Figure 1. Preferred reporting items for systematic reviews and meta-analysis (PRISMA) diagram displaying procedure for trials selection.
    View this figure

    Risk of Bias in Included RCTs

    We summarized the findings for the risk of bias graph and summary in Figure 2 and Multimedia Appendix 2, respectively. In all, 8 studies (100%) had adequate sequence generation for randomization. All of them (100%) had adequate allocation concealment. Only one study (13%) had implemented the blinding of participants and personnel and outcome assessment. Whereas 6 trials (75%) were unclear for the blinding of outcome assessment, 1 trial (13%) was unclear to implement the blinding of participants and personnel. Of the 8 studies, 5 (63%) addressed low risk of bias concerning incomplete outcome data. All of the studies (100%) had low risk of bias for selective reporting. The two authors independently checked for risk of bias. The interrater agreement was 100% for global ratings, with two minor disagreements at the component level, but these disagreements were resolved through discussion. The number of trials (n<10) in this review was insufficient to make a meaningful funnel plot to determine publication bias because the test power was excessively low to distinguish chance from real funnel plot asymmetry [42].

    Figure 2. Risk of bias summary. These are authors’ judgments of each methodological quality item for each included study. Plus signs (+) indicate high methodological quality (low risk of bias); minus signs (-) indicate low methodological quality (high risk of bias); question marks (?) indicate unclear methodological quality (reported information about what happened in the study was insufficient).
    View this figure

    Characteristics of Included Studies

    This meta-analysis included 8 studies [28-33,46,47] with a total of 1523 participants conducted across 6 countries (Table 1), including Australia (13%, 1/8) [28], Canada (13%, 1/8) [31], Germany (25%, 2/8) [46,47], Sweden (13%, 1/8), the United Kingdom (25%, 2/8) [30,32], and the United States (13%, 1/8) [33]. All of the studies were conducted between 2011 [47] and 2016 [31], with 2016 having the highest number of publications (38%, 3/8) [28,29,31].

    The mean age of the participants in the studies ranged from 31 [33] to 35 years [29]. Participants were postpartum women with 3 different health conditions, namely, depressive symptoms (63%, 5/8) [28,30-33], post-traumatic stress symptoms (13%, 1/8) [29], and pregnancy loss (25%, 2/8) [46,47]. The sample sizes were between 43 [28] and 910 [32]. Comparators were waitlist treatment (50%, 4/8) [29,31,46,47], usual care (38%, 3/8) [28,30,32], and waitlist or usual care (13%, 1/8) [33]. Six of the studies (75%, 6/8) assessed more than one target outcome. Whereas the rest did not report any follow-up, 6 of the studies had a follow-up for 1 [31] to 12 months [46] after intervention. Attrition rates ranged from 3% [33] to 60.8% [32] and from 0% [33] to 63.8% [32] for the intervention and control groups, respectively. Of the all the selected articles, 5 (63%, 5/8) used ITT analysis, and majority of them (88%, 7/8) were supported by grants.

    Table 1. Characteristics of the eligible 8 randomized controlled trials.
    View this table

    Descriptions of Internet-Based Cognitive Behavior Therapy

    Detailed descriptions of iCBT are presented in Multimedia Appendices 3 and 4. All iCBTs were based on cognitive-behavioral strategies, including cognitive restructuring [29,46,47] and behavioral activation [30,33] with additional elements of psychoeducation [31], parenting preparation, or parenting focus [33]. The numbers of sessions ranged from 6 [47] to 12 [30]. All therapies used one-to-one setting. Therapists support all therapies and 3 of them incorporated a self-monitoring or self-help component [28,30,33]. All of the studies had human support coming from psychologists or clinical psychologists (75%, 6/8) [28,29,31,32,46,47], master’s or PhD psychology students (25%, 2/8) [29,31], CBT-trained mental health workers (25%, 2/8) [32,33], and a layperson (13%, 1/8) [33].

    Peer support using chat room discussion was used by 4 of the therapies [28,30,32,33], and only 1 trial used partner support using websites [28]. Majority of the therapies were asynchronous (88%, 7/8) [29-33,46,47] and 1 was synchronous [28] in terms of two-way feedback communication with therapists using websites (88%, 7/8) [28-30,32,33,46,47], phone calls (63%, 5/8) [28,30-33], emails (38%, 3/8) [30-32], and text messages (13%, 1/8) [30]. The delivery modes included multimedia and interactive formats, such as animation, video, audio, or photos [28,31]. The activities of the therapies included text-based reading (63%, 5/8) [28,29,31,46,47], assignment or homework (88%, 7/8) [28-32,46,47], interactive exercise (13%, 1/8) [30], expressive writing (38%, 3/8) [33,46,47], and online clinics or consultation (25%, 2/8) [32,33]. The duration of the therapies varied among the 8 studies, ranging from 5 [46,47] to 17 weeks [30].

    Efficacy of Therapist-Supported iCBT on Stress Symptoms

    By comparing the intervention and control groups using stress symptoms at post-intervention as a dependent variable, 5 studies [28,29,31,46,47] assessed the efficacy of therapist-supported iCBT among 451 women. Depression Anxiety Stress Scale-21 (DASS-21) [48], Impact of Event Scale (IES) [49] and IES-Revised [50] were used to measure stress symptoms. Figure 3 shows that therapist-supported iCBT interventions had a large effect size of .84 (95% CI 0.65-1.03) on eliminating stress symptoms. The overall effect (Z=8.52, P<.001) was significant, but I2 showed 0%, and the P value of chi-square was .86. A series of subgroup analyses was performed to explore more information about the therapist-supported iCBT intervention, as shown in Table 2. Subgroup differences were found insignificant for stress symptoms based on health condition, control condition, number of sessions, peer support, and professional support. Interestingly, we observed the therapist-supported iCBT with waitlist as comparator and exclusive therapist support were significant (d=0.88, Z=8.43, P<.001) on eliminating stress symptoms, whereas intervention using TAU as comparator and therapist support with self-help component did not (d=0.52, Z=1.66, P>.05). However, only 1 study in the subgroups had limited generalizability and thus further trials were warranted.

    Figure 3. Forest plot of standardized mean difference (95% CI) in change of stress symptoms scores for Internet-based cognitive behavior therapy intervention and control group.
    View this figure

    Efficacy of Therapist-Supported iCBT on Anxiety Symptoms

    Using anxiety symptoms at post-intervention as a dependent variable in 6 studies [28-31,46,47], the efficacy of therapist-supported iCBT was evaluated among 510 participants by comparing the intervention and control groups. Anxiety symptoms were measured through the Brief Symptom Inventory-Global Severity Index (BSI-GSI) [51], DASS-21 [48], Generalized Anxiety Disorder Scale [52], and Beck Anxiety Inventory [53]. Therapist-supported iCBT exerted a significant effect on improving anxiety symptoms (Z=4.07, P<.001) with small to medium effect size (d= 0.36), as shown in Figure 4. Meta-analysis on anxiety symptoms showed no heterogeneity (I2=0%). Significant subgroup differences were not found for anxiety symptoms based on health condition, control condition, type of iCBT, number of sessions, and professional support (Table 2).

    Figure 4. Forest plot of standardized mean difference (95% CI) in change of anxiety symptoms scores for Internet-based cognitive behavior therapy intervention and control group.
    View this figure

    Efficacy of Therapist-Supported iCBT on Depressive Symptoms

    A total of 8 studies [28-33,46,47] assessed the efficacy of therapist-supported iCBT interventions among 934 participants by comparing the intervention and control groups using depressive symptoms at post-intervention as dependent variable. Depressive symptoms were measured through the Beck Depression Inventory-II [54], Edinburgh Postnatal Depression Scale [55], and BSI-GSI [51]. iCBT interventions in this meta-analysis exerted a significant effect on improving depressive symptoms (Z=9.42, P<.001) with medium to large effect size of 0.63 (Figure 5). The meta-analysis of these 8 studies showed no heterogeneity (I2=0%). No significant subgroup differences were found for depressive symptoms according to health condition, control condition, type of iCBT, number of sessions, and professional support (Table 2).

    Figure 5. Forest plot of standardized mean difference (95% CI) in change of depressive symptoms scores for Internet-based cognitive behavior therapy intervention and control group.
    View this figure
    Table 2. Subgroup analyses of Internet-based cognitive behavioral therapy (iCBT) on stress, anxiety, and depressive symptoms.
    View this table


    In this meta-analysis, the efficacy of the therapist-supported iCBT on stress, anxiety, and depressive symptoms during the postpartum period was searched through 10 databases. This study included 8 RCTs involving 1523 postpartum women using iCBT across 6 countries. The results revealed that iCBT significantly improved stress (d= 0.84, n=5), anxiety (d= 0.36, n=6), and depressive symptoms (d= 0.63, n=8) of the intervention group compared with those of the control group at post-intervention.

    Quality of the Evidence and Potential Biases

    Data were independently extracted, checked, and entered. The methodological quality of the eligible studies was rated to assess the subjective bias. The overall methodological quality of the studies included in the review was mixed. All studies used methods that we judged to have low risk of bias to randomly assign participants to either the intervention or the control group. This result was due to the selection criteria for RCT. Thus, RCTs prevented selection bias and were insured against accidental bias. All studies achieved adequate allocation concealment. Therefore, participants were unlikely to have selection bias.

    A potentially important source of bias in this meta-analysis was that only 12.5% (1/8) of the studies achieved the blinding of participants and personnel. Concealing treatment conditions from participants was impossible because of the control conditions used (eg, waitlist). The results might be influenced by performance bias as concealing of treatment conditions was not possible. Only 12.5% (1/8) of the studies achieved effective blinding of outcome assessment, perhaps primarily owing to the characteristics of the interventions. Hence, a high risk of detection bias remained possible for outcomes relying on self-report or objective outcomes by outcome assessors who were not blinded to treatment allocation. The overall effect of the sample attrition had a low risk of bias in more than half of the studies (62.5%, 5/8), which could improve the generalizability of findings and reduce attrition bias. All studies reported outcomes in a pre-specified manner. Consequently, the eligible studies did not give misleading results because of the selective reporting of outcomes.

    In addition, the attrition rates for the intervention and control groups were widely ranged (0%-63.8%). Providing a reminder or tracking system at pre-specified times to intervention users may reduce attrition and ultimately enhance outcomes [29]. Website contact system [29] and phone call [33] may be employed to remind postpartum women to use the site, point to helpful resources, or provide a connection with the treatment team. More than half of the trials (62.5%, 5/8) used ITT analysis, which is an analysis method for solving non-compliance and missing outcomes [56]. Therefore, half of the trials avoided overoptimistic estimates of the efficacy of therapist-supported iCBT by analysing outcomes according to original treatment allocation rather than only for participants completing treatment [56].

    Therapist-Supported Internet-Based Cognitive Behavior Therapy

    Consistent with a previous review [25], our finding revealed that interventions initiated during the postpartum period were effective. The majority of therapist-supported iCBT was using cognitive restructuring as an essential element to identify, dispute, and correct irrational or maladaptive thoughts [3]. In our review, therapist-supported iCBT provides a feasible, efficacious, accessible, and economically sound intervention for postpartum women with depressive symptoms [28,30-33], post-traumatic stress symptoms [29], and pregnancy loss [46,47]. Therapist-supported iCBT may be particularly useful for postpartum depressive women who struggle with issues of stigma [30,32]. Therapist-supported iCBT helps women with child-related traumatic event to avoid their fearful impulses, thus helping them to decrease the level of fear experienced at a given moment, and eventually help to confront their fears [29]. In addition, therapist-supported iCBT evidently had great practical significance for women with painful memory of the pregnancy loss in order to improve stress, anxiety, and depressive symptoms [46,47].

    Our meta-analytic results found no significant difference on anxiety and depressive symptoms using behavioral activation [4] compared with other forms of CBT. This result suggested that scheduling activities could behaviorally activate women and help them to gain a sense of pleasure and improve anxiety and depressive symptoms [4]. Contrary to previous findings on the equivalent effect of support type for stress symptoms in a meta-analytic review [13], our finding showed that exclusive therapist support has a better effect than therapist support with self-care component in the subgroup analysis. A possible interpretation of this result is that the different attrition rates reached 2.9%–60.8% by therapist support with self-care components [28,32,33] compared with the 7.0%–31.3% rates by exclusive therapist support [29-31,46,47]. This finding supported the fact that exclusive therapist support was preferred to reduce stress symptoms, whether by phone, email, text, or interactive computer interface [10,11]. Our review highlighted that support via website reminder or tracking [28], website contact system [29], or phone calls [33] increased retention to therapist-supported iCBT.

    Efficacy of Therapist-Supported iCBT on Stress Symptoms

    The finding of this meta-analysis provided support for the efficacy of therapist-supported iCBT on improving stress symptoms with large effect size of 0.84. This finding is in line with a recent meta-analysis that demonstrated a medium to large effect of 0.72-0.82 of iCBT for post-traumatic stress [13]. Similar components and strategies of iCBT possibly exist among a homogenous dataset with comparable health care conditions in both reviews. However, our result was contradictory with another review [38] indicating inconsistent effects of −0.32 to 0.98. One possible explanation for this difference might be linked to the different target population and health conditions between our review (postpartum women with pregnancy loss, depression, and post-traumatic stress) and those in the previous review (antenatal, postpartum women, and partners with general mental health, grief, stress, post-traumatic stress) [38]. Subgroup analyses revealed a trend for the waitlist comparator to have higher effect sizes than the TAU comparator for improving stress symptoms. The observation echoed a previous review that different control conditions led to substantively different effect estimates and that waitlist comparator generated larger effect sizes estimate than TAU comparator [57]. This finding could be explained by the possibility of additional stress during waiting period because those among waitlist comparator could not access intervention promptly, whereas those assigned to TAU might actively seek additional support that could possibly improve stress symptoms [57].

    Efficacy of Therapist-Supported iCBT on Anxiety Symptoms

    Therapist-supported iCBT revealed significantly improved anxiety symptoms with small effect size (d= 0.36), which was different from the effect size of the three recent meta-analyses among children (d= 0.69) [7], adults with anxiety disorders (d=0.79) [10], perinatal women with mixed results indicating both positive effect (d=0.51) and negative effect (d=−0.61) [38]. The discrepancy might be due to the difference population with specific health conditions between our review (postpartum women) and those in the previous three reviews (childhood and adults with anxiety disorders [7,10] or combination of antenatal, postpartum women, and their partners [38]). Another possible explanation was the substantial heterogeneity in the previous meta-analysis (I2=80%) [10] compared with homogeneity in our review (I2=0%). One possible explanation for the differences could be high normative levels of anxiety during the postpartum period [20] because of the conspicuous changes to the roles, lifestyles, and responsibilities of the expecting mother [17]. Directly comparing the current findings was impossible because the evidence was based on different populations with different health condition. This result encourages future investigations.

    Efficacy of Therapist-Supported iCBT on Depressive Symptoms

    Therapist-supported iCBT revealed significantly improved depressive symptoms with medium effect size of 0.63 in this review, which was better than the small to medium effect size of 0.41 [36] and 0.56 [37] among adult depression in the other two reviews. This result was consistent with a previous meta-analysis [38] that demonstrated a medium (d=0.55) to large (d=1.03) effect of intervention for depressive symptoms. The case might be linked to the number of includable trials, types of samples, and variety of therapies in the current review compared with those in the three previous reviews [36-38]. Our review used 8 trials, whereas the previous meta-analytic reviews employed 19 [37] and 12 [36] trials. These two reviews included very heterogeneous therapeutic treatments and samples with substantial to considerable heterogeneity (I2= 57%–81%) [36,37] compared with homogeneity (I2= 0%) in our review. However, similar effect size between one previous meta-analysis [38] and our review might be explained by overlapping with 4 eligible studies [30,32,46,47] in both reviews. Since the previous review [38] did not report results of heterogeneity, it is hard to give a direct comparison. The number of includable trials is relatively few in the current review. Therefore, this aspect should be further explored in future meta-analytic reviews.

    The number of includable studies for the subgroup analysis was low in this review, limiting statistical power. The comparisons were unbalanced. We did not find a significant difference between other subgroups, which could be caused by power problems. Further investigations are required.


    Several limitations exist in this review. First, a possible sampling bias was evident because the majority of the participants were self-selected on the basis of media-recruited participants rather than clinical samples. Such recruitment methods often rely on the individual’s motivation levels, which potentially correspond to slightly different demographics from those participants who are recruited within community settings. Second, majority of the outcomes were self-reported. Studies typically relied on self-report measures and rarely included formal diagnostic procedures at either recruitment or assessment. As a result, the health conditions or outcomes might be overestimated or underestimated. Third, relatively few trials were included in this review. Therefore, we were underpowered to detect effects for certain contrasts in subgroup analyses. Fourth, different sessions of iCBT tended to report different effect sizes. Fifth, only the short-term benefits of iCBT were investigated on the basis of postintervention outcome measures. The maintenance of benefits in iCBT remains unclear. Wide range of health conditions (especially for stress symptoms, including general and post-traumatic stress), high attrition rate, and broadly defined range of interventions were also considered as limitations of this review. Finally, this review only included studies published in English, and all were conducted in developed regions. The results may not be applicable to marginalized groups in developing regions.

    Implications of Practice

    This meta-analytic review extends the evidence of efficacy of iCBT on stress, anxiety, and depressive symptoms among postpartum women. As society becomes increasingly comfortable with, and reliant upon, the use of the Internet for routine health care, opportunities to apply iCBT tend to grow continuously [8]. The iCBT features distinct behavioral advice and learnable skills according to one’s own pace without stigma, waiting times, or taking time off work [16]. Investigating differential predictors of outcomes for another therapeutic format is important. An enhanced understanding of the effective components is necessary to appropriately inform future evidence-based use of iCBT among postpartum women.

    Implications for Future Research

    Notably, the evidence of iCBT aims at preventive purpose that employs group-administrated method and exclusive self-help approach among postpartum women are entirely lacking. Future research is welcome. Further investigation is needed on the relationships between the effects of iCBT and different periods of intervention (ie, antenatal vs postpartum), health conditions, and age groups to inform potential iCBT procedures. Participant characteristics may be directly or indirectly associated with attrition rate through a variety of mechanisms, such as literacy, familiarity with technology, personal preferences, and engagement maintenance. This review revealed that different supportive types might affect the different stress symptoms. Ironically, the concept of support is not fully investigated in the literature [36], and we cannot exclude the possibility that some forms of support can be automated. The concepts of support must be further investigated. Although the effects are superior in exclusive therapist support, determining the optimal levels of support is the next issue. The roles of therapist factors, different types of professionals, and support of professionals or non-professionals require further examination. Further rigorous trials based on clinical populations using accurate diagnostic assessment are required before therapist-supported iCBT can be deemed effective for the postpartum population in accessing regular clinical practice for improving stress, anxiety, and depressive symptoms.


    This meta-analytic review supports the efficacy of therapist-supported iCBT for improving stress, anxiety, and depressive symptoms at post-treatment with small to large effects within a range between 0.36 and 0.84. A one-size-fits-all approach is unlikely to succeed considering the complexities and idiosyncrasies of specific health conditions. Future studies should establish the effective components, format, and approach of iCBT with optimal levels of human support. Adequate number of sessions and suitable duration during the postpartum period using appropriate functionality, interactivity, multimedia, and communication modes are important to maximize a long-term effect of iCBT among postpartum women.


    This work was supported by a start-up grant (Ref: NUHSRO/2013/147/SU/01, WBS No.: R545-000-055-133 and WBS No.: R545-000-055-750) and HSS Seed Fund (1/2016) from the National University of Singapore.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    Index and keyword terms for searching in ten databases.

    PDF File (Adobe PDF File), 42KB

    Multimedia Appendix 2

    Risk of bias graph.

    PDF File (Adobe PDF File), 34KB

    Multimedia Appendix 3

    Description of Internet-based cognitive behavioral therapy in 8 trials.

    PDF File (Adobe PDF File), 25KB

    Multimedia Appendix 4

    Interaction of Internet-based cognitive behavioral therapy in 8 trials.

    PDF File (Adobe PDF File), 26KB


    1. Beck J. Cognitive Behavior Therapy: Basics and Beyond. 2nd edition. New York, NY: The Guilford Press; 2011.
    2. Beck AT, Haigh EA. Advances in cognitive theory and therapy: the generic cognitive model. Annu Rev Clin Psychol 2014;10:1-24. [CrossRef] [Medline]
    3. Hope DA, Burns JA, Hayes SA, Herbert JD, Warner MD. Automatic thoughts and cognitive restructuring in cognitive behavioral group therapy for social anxiety disorder. Cogn Ther Res 2007 Jun 2;34(1):1-12. [CrossRef]
    4. Addis M, Martell C. Overcoming Depression One Step at a Time: The New Behavioral Activation Approach to Getting Your Life Back. New York: New Harbinger Press; 2004.
    5. Hofmann SG, Asnaani A, Vonk IJ, Sawyer AT, Fang A. The Efficacy of Cognitive Behavioral Therapy: A Review of Meta-analyses. Cognit Ther Res 2012 Oct 1;36(5):427-440 [FREE Full text] [CrossRef] [Medline]
    6. Paulson JF, Bazemore SD. Prenatal and postpartum depression in fathers and its association with maternal depression: a meta-analysis. JAMA 2010 May 19;303(19):1961-1969. [CrossRef] [Medline]
    7. Rooksby M, Elouafkaoui P, Humphris G, Clarkson J, Freeman R. Internet-assisted delivery of cognitive behavioural therapy (CBT) for childhood anxiety: systematic review and meta-analysis. J Anxiety Disord 2015 Jan;29:83-92. [CrossRef] [Medline]
    8. Andersson G. Internet-delivered psychological treatments. Annu Rev Clin Psychol 2016;12:157-179. [CrossRef] [Medline]
    9. ITU. ITU world telecommunication /ICT indicators databases: statistical highlights   URL: [WebCite Cache]
    10. Olthuis JV, Watt MC, Bailey K, Hayden JA, Stewart SH. Therapist-supported internet cognitive behavioural therapy for anxiety disorders in adults. Cochrane Database Syst Rev 2015(3):CD011565. [CrossRef] [Medline]
    11. Enander J, Andersson E, Mataix-Cols D, Lichtenstein L, Alström K, Andersson G, et al. Therapist guided internet based cognitive behavioural therapy for body dysmorphic disorder: single blind randomised controlled trial. BMJ 2016;352:i241 [FREE Full text] [Medline]
    12. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry 2014 Oct;13(3):288-295 [FREE Full text] [CrossRef] [Medline]
    13. Kuester A, Niemeyer H, Knaevelsrud C. Internet-based interventions for posttraumatic stress: a meta-analysis of randomized controlled trials. Clin Psychol Rev 2016 Feb;43:1-16. [CrossRef] [Medline]
    14. Kelders SM, Bohlmeijer ET, Pots WT, van Gemert-Pijnen JE. Comparing human and automated support for depression: fractional factorial randomized controlled trial. Behav Res Ther 2015 Sep;72:72-80. [CrossRef] [Medline]
    15. Hedman E, Andersson E, Ljótsson B, Axelsson E, Lekander M. Cost effectiveness of internet-based cognitive behaviour therapy and behavioural stress management for severe health anxiety. BMJ Open 2016;6(4):e009327 [FREE Full text] [CrossRef] [Medline]
    16. Musiat P, Tarrier N. Collateral outcomes in e-mental health: a systematic review of the evidence for added benefits of computerized cognitive behavior therapy interventions for mental health. Psychol Med 2014 Nov;44(15):3137-3150. [CrossRef] [Medline]
    17. Agius A, Xuereb RB, Carrick-Sen D, Sultana R, Rankin J. The co-existence of depression, anxiety and post-traumatic stress symptoms in the perinatal period: a systematic review. Midwifery 2016 May;36:70-79. [CrossRef] [Medline]
    18. Clout D, Brown R. Marital relationship and attachment predictors of postpartum stress, anxiety, and depression symptoms. J Soc Clin Psychol 2016 Apr;35(4):322-341. [CrossRef]
    19. Grekin R, O'Hara MW. Prevalence and risk factors of postpartum posttraumatic stress disorder: a meta-analysis. Clin Psychol Rev 2014 Jul;34(5):389-401. [CrossRef] [Medline]
    20. Osma J, Barrera AZ, Ramphos E. Are pregnant and postpartum women interested in health-related apps? implications for the prevention of perinatal depression. Cyberpsychol Behav Soc Netw 2016 Jun;19(6):412-415. [CrossRef] [Medline]
    21. O'Hara MW, McCabe JE. Postpartum depression: current status and future directions. Annu Rev Clin Psychol 2013;9:379-407. [CrossRef] [Medline]
    22. Sanger C, Iles JE, Andrew CS, Ramchandani PG. Associations between postnatal maternal depression and psychological outcomes in adolescent offspring: a systematic review. Arch Womens Ment Health 2015 Apr;18(2):147-162. [CrossRef] [Medline]
    23. Grace SL, Evindar A, Stewart DE. The effect of postpartum depression on child cognitive development and behavior: a review and critical analysis of the literature. Arch Womens Ment Health 2003 Nov;6(4):263-274. [CrossRef] [Medline]
    24. de Camps MD, Philipp D, Israel A, Vigod S. Maternal-infant mental health: postpartum group intervention. Arch Womens Ment Health 2016 Apr;19(2):243-251. [CrossRef] [Medline]
    25. Sockol LE. A systematic review of the efficacy of cognitive behavioral therapy for treating and preventing perinatal depression. J Affect Disord 2015 May 15;177:7-21. [CrossRef] [Medline]
    26. Maloni JA, Przeworski A, Damato EG. Web recruitment and internet use and preferences reported by women with postpartum depression after pregnancy complications. Arch Psychiatr Nurs 2013 Apr;27(2):90-95. [CrossRef] [Medline]
    27. Fonseca A, Gorayeb R, Canavarro M. Women's use of online resources and acceptance of e-mental health tools during the perinatal period. Int J Med Inform 2016 Oct;94:228-236. [CrossRef] [Medline]
    28. Milgrom J, Danaher BG, Gemmill AW, Holt C, Holt CJ, Seeley JR, et al. Internet cognitive behavioral therapy for women with postnatal depression: a randomized controlled trial of MumMoodBooster. J Med Internet Res 2016;18(3):e54 [FREE Full text] [CrossRef] [Medline]
    29. Nieminen K, Berg I, Frankenstein K, Viita L, Larsson K, Persson U, et al. Internet-provided cognitive behaviour therapy of posttraumatic stress symptoms following childbirth-a randomized controlled trial. Cogn Behav Ther 2016 Jun;45(4):287-306. [CrossRef] [Medline]
    30. O'Mahen HA, Richards DA, Woodford J, Wilkinson E, McGinley J, Taylor RS, et al. Netmums: a phase II randomized controlled trial of a guided Internet behavioural activation treatment for postpartum depression. Psychol Med 2014 Jun;44(8):1675-1689 [FREE Full text] [CrossRef] [Medline]
    31. Pugh NE, Hadjistavropoulos HD, Dirkse D. A randomised controlled trial of therapist-assisted, internet-delivered cognitive behavior therapy for women with maternal depression. PLoS One 2016;11(3):e0149186 [FREE Full text] [CrossRef] [Medline]
    32. O'Mahen HA, Woodford J, McGinley J, Warren FC, Richards DA, Lynch TR, et al. Internet-based behavioral activation--treatment for postnatal depression (Netmums): a randomized controlled trial. J Affect Disord 2013 Sep 25;150(3):814-822. [CrossRef] [Medline]
    33. Sheeber LB, Seeley JR, Feil EG, Davis B, Sorensen E, Kosty DB, et al. Development and pilot evaluation of an internet-facilitated cognitive-behavioral intervention for maternal depression. J Consult Clin Psychol 2012 Oct;80(5):739-749 [FREE Full text] [CrossRef] [Medline]
    34. Carolan-Olah M, Barry M. Antenatal stress: an Irish case study. Midwifery 2014 Mar;30(3):310-316. [CrossRef] [Medline]
    35. Amstadter AB, Broman-Fulks J, Zinzow H, Ruggiero KJ, Cercone J. Internet-based interventions for traumatic stress-related mental health problems: a review and suggestion for future research. Clin Psychol Rev 2009 Jul;29(5):410-420 [FREE Full text] [CrossRef] [Medline]
    36. Andersson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther 2009;38(4):196-205. [CrossRef] [Medline]
    37. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev 2012 Jun;32(4):329-342. [CrossRef] [Medline]
    38. Ashford MT, Olander EK, Ayers S. Computer- or web-based interventions for perinatal mental health: a systematic review. J Affect Disord 2016 Jun;197:134-146. [CrossRef] [Medline]
    39. Lee EW, Denison FC, Hor K, Reynolds RM. Web-based interventions for prevention and treatment of perinatal mood disorders: a systematic review. BMC Pregnancy Childbirth 2016;16:38 [FREE Full text] [CrossRef] [Medline]
    40. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. J Clin Epidemiol 2009 Oct;62(10):1006-1012. [CrossRef] [Medline]
    41. Neville CE, McKinley MC, Holmes VA, Spence D, Woodside JV. The effectiveness of weight management interventions in breastfeeding women--a systematic review and critical evaluation. Birth 2014 Sep;41(3):223-236. [CrossRef] [Medline]
    42. Higgins JP, Green S. Cochrane. Cochrane handbook for systematic reviews of interventions, Version 5.1.0   URL: [accessed 2017-03-01] [WebCite Cache]
    43. Meades R, Ayers S. Anxiety measures validated in perinatal populations: a systematic review. J Affect Disord 2011 Sep;133(1-2):1-15. [CrossRef] [Medline]
    44. Borenstein M, Hedges LV, Rothstein H. Introduction to Meta-Analysis. Oxford: Wiley; 2009.
    45. Sormani MP. Subgroup analysis in MS trials. Mult Scler 2017 Jan;23(1):34-35. [CrossRef] [Medline]
    46. Kersting A, Dölemeyer R, Steinig J, Walter F, Kroker K, Baust K, et al. Brief internet-based intervention reduces posttraumatic stress and prolonged grief in parents after the loss of a child during pregnancy: a randomized controlled trial. Psychother Psychosom 2013;82(6):372-381. [CrossRef] [Medline]
    47. Kersting A, Kroker K, Schlicht S, Baust K, Wagner B. Efficacy of cognitive behavioral internet-based therapy in parents after the loss of a child during pregnancy: pilot data from a randomized controlled trial. Arch Womens Ment Health 2011 Dec;14(6):465-477. [CrossRef] [Medline]
    48. Asselmann E, Wittchen H, Erler L, Martini J. Peripartum changes in social support among women with and without anxiety and depressive disorders prior to pregnancy: a prospective-longitudinal study. Arch Womens Ment Health 2016 Dec;19(6):943-952. [CrossRef] [Medline]
    49. Asselmann E, Wittchen H, Petzoldt J, Martini J. Peripartum changes in partnership quality among women with and without anxiety and depressive disorders prior to pregnancy: a prospective-longitudinal study. Arch Womens Ment Health 2016 Apr;19(2):281-290. [CrossRef] [Medline]
    50. Weiss DS. The impact of event scale-revised. In: Wilson JP, Tang CS, editors. Cross-Cultural Assessment of Psychological Trauma and PTSD. Boston, MA: Springer US; 2007:219-238.
    51. Martini J, Petzoldt J, Einsle F, Beesdo-Baum K, Höfler M, Wittchen H. Risk factors and course patterns of anxiety and depressive disorders during pregnancy and after delivery: a prospective-longitudinal study. J Affect Disord 2015 Apr 1;175:385-395. [CrossRef] [Medline]
    52. Spitzer RL, Kroenke K, Williams JB, Löwe B. A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch Intern Med 2006 May 22;166(10):1092-1097. [CrossRef] [Medline]
    53. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol 1988 Dec;56(6):893-897. [Medline]
    54. Winkel S, Einsle F, Pieper L, Höfler M, Wittchen H, Martini J. Associations of anxiety disorders, depressive disorders and body weight with hypertension during pregnancy. Arch Womens Ment Health 2015 Jun;18(3):473-483. [CrossRef] [Medline]
    55. Sutter-Dallay AL, Giaconne-Marcesche V, Glatigny-Dallay E, Verdoux H. Women with anxiety disorders during pregnancy are at increased risk of intense postnatal depressive symptoms: a prospective survey of the MATQUID cohort. Eur Psychiatry 2004 Dec;19(8):459-463. [CrossRef] [Medline]
    56. Alvarado R, Perucca E, Neves E, Rojas M, Monardes J, Olea E, et al. Depressive disorders during pregnancy and associated factors. Rev Chil Obstet Ginecol 1993;58(2):135-141. [Medline]
    57. Furukawa TA, Noma H, Caldwell DM, Honyashiki M, Shinohara K, Imai H, et al. Waiting list may be a nocebo condition in psychotherapy trials: a contribution from network meta-analysis. Acta Psychiatr Scand 2014 Sep;130(3):181-192. [CrossRef] [Medline]


    BSI: Brief Symptom Inventory
    CBT: Cognitive Behavior Therapy
    DASS: Depression Anxiety Stress Scale
    iCBT: Internet-Based Cognitive Behavior Therapy
    IES: Impact of Event Scale
    IES-R: Impact of Event Scale-revised
    ITT: Intention-to-Treat
    IV: inverse variance
    PICOS: Patient/Problem Intervention Comparison Outcome Setting
    PRISMA: Preferred Reporting Items for Systematic Reviews and Meta-analysis
    PSS: Perceived Stress Scale
    RCT: randomized controlled trial
    TAU: treatment as usual
    WHO: World Health Organization

    Edited by G Eysenbach; submitted 30.09.16; peer-reviewed by P Zelkowitz, M Ashford, TR Soron; comments to author 29.12.16; revised version received 26.01.17; accepted 13.02.17; published 28.04.17

    ©Ying Lau, Tha Pyai Htun, Suei Nee Wong, Wai San Wilson Tam, Piyanee Klainin-Yobas. Originally published in the Journal of Medical Internet Research (, 28.04.2017.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on, as well as this copyright and license information must be included.