Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Monday, March 11, 2019 at 4:00 PM to 4:30 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Advertisement

Citing this Article

Right click to copy or hit: ctrl+c (cmd+c on mac)

Published on 28.07.15 in Vol 17, No 7 (2015): July

Preprints (earlier versions) of this paper are available at http://preprints.jmir.org/preprint/4329, first published Feb 09, 2015.

This paper is in the following e-collection/theme issue:

    Original Paper

    A Web-Based Adolescent Positive Psychology Program in Schools: Randomized Controlled Trial

    1University of NSW and the Black Dog Institute, Randwick, Australia

    2National Institute for Mental Health Research, The Australian National University, Canberra, Australia

    3School of Psychology, University of Wollongong, Wollongong, Australia

    Corresponding Author:

    Rowan Burckhardt, MPsych(Clinical)

    University of NSW and the Black Dog Institute

    Black Dog Institute

    Hospital Rd

    Randwick, 2031

    Australia

    Phone: 61 293824530

    Fax: 61 293828501

    Email: r.burckhardt@unsw.edu.au


    ABSTRACT

    Background: Adolescent mental health is characterized by relatively high rates of psychiatric disorders and low levels of help-seeking behaviors. Existing mental health programs aimed at addressing these issues in adolescents have repeated inconsistent results. Such programs have generally been based on techniques derived from cognitive behavioral therapy, which may not be ideally suited to early intervention among adolescent samples. Positive psychology, which seeks to improve well-being rather than alleviate psychological symptoms, offers an alternative approach. A previous community study of adolescents found that informal engagement in an online positive psychology program for up to 6 weeks yielded significant improvements in both well-being and depression symptoms. However, this approach had not been trialed among adolescents in a structured format and within a school setting.

    Objective: This study examines the feasibility of an online school-based positive psychology program delivered in a structured format over a 6-week period utilizing a workbook to guide students through website content and interactive exercises.

    Methods: Students from four high schools were randomly allocated by classroom to either the positive psychology condition, "Bite Back", or the control condition. The Bite Back condition consisted of positive psychology exercises and information, while the control condition used a series of non-psychology entertainment websites. Both interventions were delivered online for 6 hours over a period of 4-6 weeks during class time. Symptom measures and measures of well-being/flourishing and life satisfaction were administered at baseline and post intervention.

    Results: Data were analyzed using multilevel linear modeling. Both conditions demonstrated reductions in depression, stress, and total symptom scores without any significant differences between the two conditions. Both the Bite Back and control conditions also demonstrated significant improvements in life satisfaction scores post intervention. However, only the control condition demonstrated significant increases in flourishing scores post intervention.

    Conclusions: Results suggest that a structured online positive psychology program administered within the school curriculum was not effective when compared to the control condition. The limitations of online program delivery in school settings including logistic considerations are also relevant to the contradictory findings of this study.

    Trial Registration: Australian New Zealand Clinical Trials Registry: ACTRN1261200057831; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=362489 (Archived by Webcite at http://www.webcitation.org/6NXmjwfAy).

    J Med Internet Res 2015;17(7):e187

    doi:10.2196/jmir.4329

    KEYWORDS



    Introduction

    Epidemiological data indicate that 1 in 4 young people in Australia between the ages of 16-24 years have experienced at least one mental disorder in the preceding year and that young people have the highest rates of mental disorders compared to any other age group [1]. It has been estimated that of those aged 16-24 years experiencing mental health issues, 77% did not access any medical or professional services in the preceding 12 months and that they account for almost 30% of the total mental health burden in Australia [2,3]. This is further aggravated by their relative lack of skills in dealing with life stresses and emotional distress compared to adults [4].

    A number of early intervention programs have been developed to address skills deficits and to build resilience in young people. Most of these programs have used cognitive behavioral therapy techniques with varying degress of success [5]. This suggests that researchers need to look further afield for effective prevention approaches to youth mental health such as the building of skills and strategies to enhance personal strengths [6].

    In this regard, positive psychology—the scientific study of happiness, well-being, and flourishing—may offer an alternative to conventional prevention programs for youth. Positive psychology can be conceptualized as a range of behavioral, cognitive, and emotional domains that are important for improving well-being. These include developing healthy social relationships, becoming more optimistic, finding “meaning”, and practicing mindfulness. Evaluations of non-school-based programs have reported on the benefits of engaging in positive psychology exercises. For example, interventions that increase hope have been shown to predict lower illicit substance use; lower levels of depression, anxiety, and hostility; fewer behavioral problems; and higher academic performance in adolescents [7,8].

    Manicavasagar et al conducted a feasibility study of a community-based online positive psychological program, “Bite Back”, for adolescents aged 12-18 years [9,10]. Bite Back consists of information and interactive activities relating to nine domains: gratitude, optimism, flow, meaning, hope, mindfulness, character strengths, healthy lifestyle, and positive relationships. Participants in both the Bite Back condition and a control condition were encouraged to regularly use their respective websites over a 6-week period. Symptom measures of depression, anxiety and stress, and well-being were compared within and between conditions and at baseline and post intervention. At the start of the intervention, participants reported low levels of psychopathology, as was expected in a non-clinical sample. Results demonstrated significant decreases in symptom scores and increased scores on well-being post intervention for the Bite Back relative to the control condition. It was reported that when participants with high levels of engagement were examined in isolation, the findings were even stronger suggesting that increased usage was related to greater benefits. Furthermore, qualitative analyses indicated that Bite Back was well received by participants allocated to this condition. It is notable that participants using this online positive psychology program could freely engage with the material at their own pace and in their own time. However, the open-access online format of this program meant that the researchers were unable to examine how participants navigated the website and whether they were exposed to the full range of material and information about positive psychology.

    A literature search did not uncover any previously evaluated computer-based school-delivered positive psychology interventions. However, group-format school-based positive psychology interventions, such as the Positive Psychology Program and Wellness-Promotion Intervention, consist of lesson-based modules pertaining to specific topics and skills delivered over the intervention period [11-16]. It was therefore deemed timely to evaluate Bite Back in a structured lesson-based format that was appropriate for delivery within a school environment. This study explores the feasibility of implementing a structured workbook-guided version of Bite Back in senior schools as part of the schools’ curriculum. It was expected that the benefits found in our previous study would be extended to this student population, specifically, that participants would improve on measures of well-being and report decreased symptoms scores following the intervention compared to a control condition.


    Methods

    Participants

    Four Australian high schools agreed to participate in the study: two Anglican girls’ schools (referred to as “Girls School A” and “Girls School B”), a Catholic boys’ school (referred to as “Boys School”), and a Jewish co-educational school (referred to as “Co-ed School”). The level of religiosity of students within these schools was not formally assessed although they are considered by reputation to be approximately equally based on conversations with staff in the educational system. Students were in Grades 7 through 12, which in the Australian educational system are the final 6 years before being eligible to go to university. These four schools were among the highest in terms of socioeconomic status compared to other schools in Australia. Students were included in the study only if they completed the relevant consent forms. This study was approved by the University of NSW Human Research Ethics Advisory Committee (Ethics Approval number 2011-7-35). See Multimedia Appendix 1 for the CONSORT-EHEALTH checklist [17].

    Interventions

    The Positive Psychology Condition (Bite Back)

    Bite Back was developed by the Black Dog Institute to improve the well-being and happiness of young Australians aged 12-18 years. Key objectives of this program are to encourage young people to work to their full potential, become more fully engaged in all aspects of their lives, and ultimately, to build resilience. The program consists of a range of interactive activities including making gratitude entries, mindfulness meditations, describing personal stories, and a mindfulness exercise involving taking photos. Figure 1 provides screenshots of the website to illustrate key components. Online interactive exercises are designed to encourage generalization of online activities to the “real world”, so that young people benefit from implementing the central tenets of positive psychology into their daily lives. Also included on the site is information about nine positive psychology domains and ways to engage with them outside of the website: Gratitude, Optimism, Flow, Meaning, Hope, Mindfulness, Character Strengths, Healthy Lifestyle, and Positive Relationships. The nine domains were based on research that suggested they were important in improving well-being [18]. Users are able to comment on activities (such as submitted photos or stories by other users) with their anonymous profile thereby enabling participation without fear of stigma or judgment. The website is pre-moderated by website staff to ensure that antisocial or concerning behavior is addressed prior to possible posting on the website. In the rare cases that a posting is either concerning from a mental health perspective or abusive, a senior clinical psychologist advised on how to handle it (eg, send an email suggesting they seek external assistance). Confidentiality of users was ensured by requiring new users to sign up using a pseudonym—no real names are permitted. Users can also choose to post content in private, where they are the only ones who can view it, or they can post it publicly. To ensure security of content and users, Bite Back uses password-protected accounts, encrypted password storage, encrypted login details, and secure external servers. For the purposes of the study, a workbook was developed to guide students through the positive psychology exercises on the website and to pose reflective questions about positive psychology. This ensured that participants had sufficient material to use during the course of the program and encouraged users to engage with several domains within the website. Participants were required to record all comments and answers to questions in their workbooks.

    The Control Condition

    Participants assigned to the control condition used a workbook that was structured in a similar format to that of the Bite Back workbook but with questions and links to non-psychology websites: Australian Broadcasting Corporation, Australian Youth Climate Coalition, the Natural Resource Defense Council, World Wildlife Fund, Wikipedia, Internet Movie Database, and World Youth News. Questions such as “Do you read online news websites in your own time? If yes, which ones?”, “Do you think the news makes a difference to how you live in your daily life? Why?”, and “Write a summary of what the article was about” were designed to encourage users to engage with these websites and record their comments and answers to questions in their workbooks.

    Figure 1. Screenshots from the Bite Back website.
    View this figure

    Procedure

    Between January and March 2012, 20 schools were invited to participate in this study, of which four agreed. The 20 schools were chosen based on two criteria: physical proximity to the research institute and being non-governmental. The proximity factor was to facilitate the practical running of the study given that trips to the school were necessary and the non-governmental requirement because access to these schools is less onerous and more timely than governmental institutions, which require permission from the state school department that takes over 6 months to obtain. Prior to start of the study, the lead author met with senior school staff and welfare officers to convey the requirements of the study and to instruct teachers in the study methodology. Parental and student self-consent were obtained for all participants under the age of 16 years, and student self-consent only was obtained for participants aged 16 years and over. The grade level designated to participate in the study was chosen by the school, and no exclusion criteria were applied.

    Teachers were instructed to explain to students that they were participating in a study designed to examine the way that websites affect how young people view the world. Teachers were also required to provide a 5-minute discussion on this topic prior to the beginning of the study and were asked not to mention that the study included a positive psychology intervention. Teachers were responsible for handing out workbooks, providing students with access to relevant websites, and managing students’ behavior during class time. Teachers were unaware of which classes had been allocated to the intervention or control conditions. Students had no face-to-face contact with any of the researchers prior to, during, or following the study.

    Students were randomized by blocks (classes) using an Excel random number generator to allocate them to either the Bite Back or control conditions by an independent researcher not associated with the data collection. Equivalent numbers of students were allocated to each condition across each grade level and for each school (eg, Grade 9 at the Boys School). In cases where there were uneven numbers of blocks, students were assigned to the Bite Back condition. Students completed an online battery of self-report questionnaires twice during class time: pre-intervention and post intervention.

    All schools were instructed to use the workbook over a 6-week period. However, two schools (the Boys School and the Co-ed School) completed the workbook over a 4-week period due to class-time constraints. Teachers were told that a total of 6 hours of face-to-face time was required from students over a period of 4-6 weeks. After each session, students in both the control and Bite Back conditions were asked to email completed sections of their workbooks to the researchers. This strategy was employed to encourage engagement and increase compliance. It also served as an indicator of student adherence to the research tasks. Students were advised that their teachers did not have access to their workbooks and completed questionnaires.

    Measures

    The Depression, Anxiety, and Stress Scale—Short form (DASS-21) consists of three symptom-based subscales [19]. Each subscale has 7 items that participants respond to on a 4-point Likert scale (0=“not at all” to 3=“most of the time”). Summed scores for each scale range from 0-42 following conversion of scores to match the DASS-42; more severe symptoms are indicated by higher scores. The DASS has also been demonstrated to correlate closely with the Diagnostic and Statistical Manual of Mental Disorders’ anxiety and depressive diagnoses [20]. Although the DASS-21 has been previously used on adolescent samples [21-23], we modified some of the wording to improve comprehension (eg, “I felt down-hearted and blue” was changed to “I felt down”). These changes were approved by the DASS-21 authors and the original meaning of the items remained unchanged. Cronbach alpha was calculated for the sample, which indicated that it was .91 for the depression scale, .79 for anxiety, .81 for stress, and .92 for the total score. The DASS-21 total score was analyzed in addition to subscale scores because of evidence that adolescent psychometrics may not support a three-factor model but rather a single factor [21,23].

    Student Life Satisfaction Scale (SLSS) comprises 5 items from the original 7-item SLSS, which are rated on a 7-point Likert scale (1=“strongly disagree” to 7=“strongly agree”) that measures quality of life (eg, “I have what I want in life”, “My life is going well”) [24]. Higher scores indicate a higher subjective satisfaction with life. Cronbach alpha in the current sample was .90.

    The Short Warwick-Edinburgh Mental Well-Being Scale (SWEMWBS) is a 7-item measure that assesses positive mental health (well-being) over the past 2 weeks rated on a 5-point scale (1=“none of the time” to 5=“all of the time”) [25]. Psychometric data of the measure on the original WEMWBS for adolescents indicated satisfactory to high internal consistency (r=.87), and the short version has acceptable test-retest reliability (r=.66, 95% CI 0.59-0.72) [25,26]. In our sample, Cronbach alpha was .82.

    Statistical Analysis

    Data were analyzed using SPSS version 22 [27]. Independent samples t tests were used to examine group differences at baseline. Multilevel linear modeling was used to examine the effectiveness of the intervention in reducing depression, anxiety and stress, and increasing life satisfaction and well-being. This type of model represents an intention-to-treat analysis under the missing-at-random assumption. Specifically, the effect of time (posttest vs pretest) was estimated using a repeated-measures mixed-effects model, which also accounted for clustering of students within schools using a random intercept for each school. An unstructured variance-covariance structure was assumed for both the repeated effect of time and the random effect of school. Degrees of freedom were estimated using Satterthwaite’s correction [28].


    Results

    Flow of Participants and Participant Characteristics

    Figure 2 demonstrates the flow of participants during the course of the study. Four schools provided a total of 572 students across grades 7-12, who were randomly allocated through classroom blocks to either the control or Bite Back conditions. Of those allocated, 338 students completed a battery of online questionnaires at baseline and were considered to be enrolled in the study. From the 234 students who did not complete the baseline questionnaire, 110 encountered technical difficulties that prevented them from being able to access the questionnaire successfully. The other 124 either chose not to fill out the questionnaire or were absent. Of the four schools that were enrolled, one withdrew from the study (Girls School B) and one ceased to participate because the teacher involved in its implementation went on extended leave (Co-ed School). Baseline characteristics of participants are presented in Table 1.

    A series of independent samples t tests examined baseline differences on questionnaire scores between the two conditions (control versus Bite Back groups across the entire sample). No significant differences were observed between the groups for the depression subscale, P=.40; the anxiety subscale, P=.60; the stress subscale, P=.11; the DASS-total score, P=.25; or the SLSS, P=.15. A significant difference was observed on the SWEMWBS (t332=-4.1, P<.001) indicating that the Bite Back group began the study with higher levels of well-being (mean 18.2) than the control group (mean 16.7). The size of the difference was moderate using the guidelines proposed by Cohen [29] (eta squared=0.05).

    Table 1. Baseline characteristics of participants in the school study.
    View this table
    Figure 2. CONSORT diagram of participants.
    View this figure

    Comparing Dropouts to Completers

    Participants who dropped out were compared to completers on a series of independent-groups t tests. No significant differences were observed on the scales of depression (P=.19), anxiety (P=.66), stress (P=.85), DASS-total (P=.59), or the SWEMWBS (P=.05). A small difference (eta squared=0.01) was observed on the SLSS (t321=-2.0, P=.04), with dropouts reporting significantly less satisfaction (mean 21.8) than completers (mean 23.1).

    The two schools that dropped out of the study provided reasons for ceasing to participate. The Anglican school B reported that the “overwhelming feedback from students had been negative” with the students finding both the control and Bite Back conditions “boring”. Students reported to their teachers that they did not seem to understand why they were doing this work, and more specifically, what benefits they would derive from their participation. They also reported that they found using the workbooks tedious and laborious. The Co-ed School ceased to participate in the study because the person in charge of implementing the study left 2 weeks after the study commenced and the other teachers did not continue with the research protocol.

    Adherence

    Adherence was defined as the frequency with which students returned their completed workbook sections (ranging from 0-6): of 336 participants, 27 (8.0%) did not return any of their workbook sections, 52 participants (15.5%) returned 1-2 workbooks, 70 participants (20.8%) returned 3-4 workbooks, and 187 (55.6%) returned 5-6 workbooks.

    Due to differences observed in the previous community Bite Back study on levels of engagement with the program, the current data were examined to determine if level of engagement affected outcomes. The sample was dichotomized according to the number of workbook sections completed. Participants who completed either 5 or 6 sections were considered “highly engaged”, while those who returned up to 4 completed sections of the workbook were categorized as “low engaged”. To ensure that this analysis was not affected by differential baseline scores, t tests were used to examine baseline differences on questionnaire scores between participants in the high versus low engagement groups. No significant differences between the groups were found.

    Universal Effects

    Overview

    To examine the effects of Bite Back on student well-being, an intent-to-treat analysis was completed using multilevel model analysis. Analyses of the universal effects were repeated with only the participants in the high engagement group.

    Depression

    Results indicated a non-significant interaction between time and condition for DASS-Depression scores: F1,199.9=.42, P=.52. The effect of time alone was significant, F1,309.1=8.10, P=.005, indicating a significant reduction of depression from baseline (mean 8.57) to post intervention (mean 6.93) for both conditions but no significant differences between the groups. Given that the baseline levels of psychopathology were low, the impact of the website on those reporting high levels of symptoms at the start of the program was also examined. The analysis was repeated among participants in the mild to extremely high categories of DASS depression baseline scores (n=226). No significant differences between the control and the Bite Back conditions were found. To examine if the level of engagement modified the results, the analysis was repeated to compare participants with low versus high engagement with the workbook sections. No significant differences were found between the groups.

    Anxiety

    There was no significant effect for DASS-Anxiety on the interaction of condition and time. The main effect for time was not significant. No significant interaction between condition and time was found among those with high baseline psychopathology scores, nor the highly engaged group.

    Stress

    The interaction between time and condition for DASS-Stress scores was not significant. However, the main effect for time was significant, F1,188.4=6.19, P=.01, suggesting a reduction in stress scores from baseline (mean 11.47) to post intervention (mean 10.37) for the entire sample. No significant time by condition interactions were observed among participants with high baseline scores. When the highly engaged participants were analyzed, a significant interaction of time and condition was observed: F1,127.9=5.56, P=.02. The highly engaged participants in the control group reported a reduction in stress from baseline (mean 12.44) to post intervention (mean 10.01), while the Bite Back participants reported a small increase from baseline (mean 9.49) to post intervention (mean 10.05).

    DASS-Total

    When total DASS scores were examined, the interaction between time and condition was not significant. However, there was a significant effect of time across both groups, F1,184.57=6.67, P=.01, with reductions in total DASS scores from baseline (mean 26.69) to post intervention (mean 23.65) for both conditions. When participants with high baseline scores were analyzed alone, this interaction was not significant: F1,57.75=.29, P=.60. For participants who were highly engaged, the interaction of condition and time was not significant: F1,126.47=3.11, P=.08.

    Life Satisfaction

    The interaction of time and condition for the SLSS was not significant. However, the main effect of time was significant, F1,247.0=17.35, P<.001, with participants reporting a reduction of life satisfaction from baseline (mean 22.56) to post intervention (mean 21.58). When highly engaged participants were analyzed, the time by condition interaction was significant: F1,153.22=6.57, P=.01. Highly engaged control participants reported little change in life satisfaction (mean 21.9 at baseline compared to mean 22.09 at post intervention), while the Bite Back participants reported a larger reduction from baseline (mean 23.99) to post intervention (mean 21.90).

    Flourishing

    The interaction between time and condition on the SWEMWBS was significant: F1,202.9=5.88, P=.02. Baseline scores of participants in the control condition (mean 16.68) increased at post intervention (mean 18.19), while the Bite Back group reported little change (mean 18.18 at baseline increasing to mean 18.37 at post intervention). A significant difference in the interaction of time and condition was also observed when the group with high engagement was analyzed separately: F1,150.4=4.15, P=.04.


    Discussion

    Principal Findings

    The aim of the current study was to evaluate the feasibility and effectiveness of the Bite Back program when delivered to adolescents in a classroom environment. Results indicated that Bite Back did not lead to any significant improvement in mental health outcomes compared to the control condition. For the flourishing scale, there was a significant difference between the control group and Bite Back across the two time points, favoring control. However, the control condition started the intervention with lower scores and returned to the same level as the Bite Back condition post intervention, so it is difficult to establish if this was a case of regression to the mean or if there was a more positive impact of the control condition compared to Bite Back. The principle conclusion that can be drawn from these results is that there was no significant benefit of participating in the Bite Back condition compared to the control condition.

    Previous findings from this team in a community sample of young people suggests that when Bite Back is delivered in an unstructured format and with freedom to choose engagement frequency, it led to reductions in mental health symptoms and improvements in well-being compared to the control condition [9,10]. The sample’s age was comparable to our study sample as well as the baseline levels of psychopathology and well-being. However, our findings indicate that when the same program is delivered in a structured method and participants are obliged to use the website at a prescribed frequency, there is no benefit from the Bite Back. A plausible explanation for the current findings is that it is the conversion of Bite Back into a structured school program that explains the observed results.

    There are several aspects of the conversion that may have contributed to this. In the current study, participants were required to use Bite Back several times each week. Some students may have resented the pressure to interact with the program on a regular basis. Previous research has found that the benefits of acts of kindness and expressing gratitude disappeared when participants were asked to complete them more than once per week [30]. The authors of this study suggested that dose may be important when the participants were not free to choose the specific activity [31]. Other research has found that in an online positive psychology intervention completing 2-4 exercises improved well-being but attempting to complete up to 6 exercises negated all benefits [32]. These authors concluded that participants should not be overwhelmed with activities. Our findings suggest that in addition to these factors, being forced to engage in positive psychology may also remove its beneficial effects.

    It has been previously found that individual factors such as motivation and effortful engagement are important in order to obtain benefits from positive psychology [33-35]. Level of engagement and choice of activity in the community study were up to participants, whereas in the current study, students were required to complete the exercises as part of their curricular activities at school. The greater level of motivation that can be expected when participants are completely free to choose their level of engagement in the program may have played a role in our findings.

    Finally, the differential usage of specific aspects of Bite Back may have affected these findings. While the Bite Back program involves several activities relating to numerous positive psychology domains, there have been mixed findings in relation to the effectiveness of domain-specific well-being programs. Mindfulness, for example, has a wealth of research supporting its effectiveness as an intervention strategy when used in isolation [36,37]. However, the domain of optimism when used in isolation has significantly fewer supporting studies to date. Participants in the community study with free access to Bite Back content may have engaged to a greater extent with more “active ingredients”, such as mindfulness or with activities that piqued their interest, while participants in this study were required to engage with each positive psychology domain regardless of their interest. This may have dampened the treatment effects for the current study.

    Our study highlights that the method of delivery of youth mental health programs may be equally important as content. Future research would also be warranted to clarify which delivery-specific factors may have been implicated in our study. While a number of such factors were considered in relation to these findings, only future research could determine whether these were indeed implicated and to what extent. It is possible that there were other delivery-specific factors not considered by us. Such research would benefit other school programs, which could then be tailored to accommodate these influences and also help transition programs from open-access to becoming more structured and school-based. In addition, while it appears plausible that delivery-specific factors account for our findings, it cannot be excluded that this study is a true reflection of the efficacy of Bite Back. Future trials to clarify this question would also be beneficial.

    Limitations

    The findings of this study should be interpreted in light of its limitations. The sample used in this study was a relatively heterogeneous sample with participants coming from schools that were both co-ed and single gender and that reflected different religious denominations and philosophies. There were relatively few checks on how the program was presented across the various schools and classrooms. This could be both a strength and limitation of the study, as it more closely replicated real-life applications of positive psychology in the school environment.

    The sample size was relatively small, although this is usual in feasibility type research as it provides data for further large-scale studies. The study was also limited by a lack of long-term follow-up data, although it is common for the strongest reduction in symptoms to be observed post intervention and so it is likely that significant differences would not have appeared at a later time point.

    Conclusion

    The application of the online positive psychology program, Bite Back, into a structured classroom intervention did not demonstrate significant benefits when compared to a control intervention. This may not be a true reflection of the efficacy of the program but rather a problem in the application of Bite Back to the school environment.

    Acknowledgments

    This study was conducted with the support of a research grant from the Department of Health and Ageing. This work was completed at the Black Dog Institute at the University of New South Wales. We are also grateful to Professor Felicia Huppert for advice on the methodology to this study and to Jacqui Wallace and Nic Newling for technical assistance in running this trial. PB is supported by National Health and Medical Research Council fellowship 1035262.

    Conflicts of Interest

    None declared.

    Multimedia Appendix 1

    CONSORT-EHEALTH checklist V1.6.2 [17].

    PDF File (Adobe PDF File), 1MB

    References

    1. Australian BO. National Survey of Mental Health and Wellbeing: Summary of Results. 2007.   URL: http://www.abs.gov.au/ausstats/abs@.nsf/mf/4326.0 [accessed 2015-07-07] [WebCite Cache]
    2. Begg S, Vos T, Barker B, Stevenson C, Stanley L, Lopez A. The Burden of Disease and Injury in Australia. Australia: Institute of Health and Welfare; 2007.   URL: http://www.aihw.gov.au/publication-detail/?id=6442467990 [accessed 2015-07-07] [WebCite Cache]
    3. Australian Bureau of Statistics. Mental Health of Young People. 2010.   URL: http://www.abs.gov.au/ausstats/abs@.nsf/mf/4840.0.55.001/ [accessed 2015-07-07] [WebCite Cache]
    4. Garnefski N, Legerstee J, Kraaij VV, Van Den Kommer T, Teerds J. Cognitive coping strategies and symptoms of depression and anxiety: a comparison between adolescents and adults. J Adolesc 2002 Dec;25(6):603-611. [Medline]
    5. Calear AL, Christensen H. Systematic review of school-based prevention and early intervention programs for depression. J Adolesc 2010 Jun;33(3):429-438. [CrossRef] [Medline]
    6. Meyers J, Meyers B. Bi-directional influences between positive psychology and primary prevention. School Psychol Quart 2003;18(2):222.
    7. Carvajal SC, Clair SD, Nash SG, Evans RI. Relating Optimism, Hope, and Self-Esteem to Social Influences in Deterring Substance Use in Adolescents. Journal of Social and Clinical Psychology 1998 Dec;17(4):443-465. [CrossRef]
    8. Ciarrochi J, Heaven PC, Davies F. The impact of hope, self-esteem, and attributional style on adolescents’ school grades and emotional well-being: A longitudinal study. Journal of Research in Personality 2007 Dec;41(6):1161-1178. [CrossRef]
    9. Bite Back.   URL: http://www.biteback.org.au/ [accessed 2014-02-21] [WebCite Cache]
    10. Manicavasagar V, Horswood D, Burckhardt R, Lum A, Hadzi-Pavlovic D, Parker G. Feasibility and effectiveness of a web-based positive psychology program for youth mental health: randomized controlled trial. J Med Internet Res 2014;16(6):e140 [FREE Full text] [CrossRef] [Medline]
    11. Gomes AR, Marques B. Life skills in educational contexts: testing the effects of an intervention programme. Educational Studies 2013 May;39(2):156-166. [CrossRef]
    12. Suldo SM, Savage JA, Mercer SH. Increasing Middle School Students’ Life Satisfaction: Efficacy of a Positive Psychology Group Intervention. J Happiness Stud 2013 Feb 1;15(1):19-42. [CrossRef]
    13. Froh JJ, Sefick WJ, Emmons RA. Counting blessings in early adolescents: an experimental study of gratitude and subjective well-being. J Sch Psychol 2008 Apr;46(2):213-233. [CrossRef] [Medline]
    14. Marques SC, Lopez SJ, Pais-Ribeiro JL. “Building Hope for the Future”: A Program to Foster Strengths in Middle-School Students. J Happiness Stud 2009 Dec 10;12(1):139-152. [CrossRef]
    15. Proctor C, Tsukayama E, Wood AM, Maltby J, Eades JF, Linley PA. Strengths Gym: The impact of a character strengths-based intervention on the life satisfaction and well-being of adolescents. The Journal of Positive Psychology 2011 Sep 14;6(5):377-388. [CrossRef]
    16. Shoshani A, Steinmetz S. Positive Psychology at School: A School-Based Intervention to Promote Adolescents’ Mental Health and Well-Being. J Happiness Stud 2013 Sep 24;15(6):1289-1311. [CrossRef]
    17. Eysenbach G, Consort-EHEALTH Group. CONSORT-EHEALTH: improving and standardizing evaluation reports of Web-based and mobile health interventions. J Med Internet Res 2011;13(4):e126 [FREE Full text] [CrossRef] [Medline]
    18. Lyubomirsky S. The How of Happiness: A New Approach to Getting the Life You Want. New York: Penguin; 2007.
    19. Lovibond S, Lovibond P. Manual for the Depression Anxiety Stress Scale. 2nd edition. Sydney: Psychology Foundation; 1995.
    20. Brown TA, Chorpita BF, Korotitsch W, Barlow DH. Psychometric properties of the Depression Anxiety Stress Scales (DASS) in clinical samples. Behav Res Ther 1997 Jan;35(1):79-89. [Medline]
    21. Patrick J, Dyck M, Bramston P. Depression Anxiety Stress Scale: is it valid for children and adolescents? J Clin Psychol 2010 Sep;66(9):996-1007. [CrossRef] [Medline]
    22. Willemsen J, Markey S, Declercq F, Vanheule S. Negative emotionality in a large community sample of adolescents: the factor structure and measurement invariance of the short version of the depression anxiety stress scales (DASS-21). Stress and Health 2010 Jul 12;27(3):e120-e128. [CrossRef]
    23. Szabó M. The short version of the Depression Anxiety Stress Scales (DASS-21): factor structure in a young adolescent sample. J Adolesc 2010 Feb;33(1):1-8. [CrossRef] [Medline]
    24. Huebner ES. Initial Development of the Student's Life Satisfaction Scale. School Psychology International 1991 Aug 01;12(3):231-240. [CrossRef]
    25. Stewart-Brown S, Tennant A, Tennant R, Platt S, Parkinson J, Weich S. Internal construct validity of the Warwick-Edinburgh Mental Well-being Scale (WEMWBS): a Rasch analysis using data from the Scottish Health Education Population Survey. Health Qual Life Outcomes 2009;7:15 [FREE Full text] [CrossRef] [Medline]
    26. Clarke A, Friede T, Putz R, Ashdown J, Martin S, Blake A, et al. Warwick-Edinburgh Mental Well-being Scale (WEMWBS): validated for teenage school students in England and Scotland. A mixed methods assessment. BMC Public Health 2011;11:487 [FREE Full text] [CrossRef] [Medline]
    27. IBM Corp. SPSS Statistics for Windows. Version 22. Armonk, NY: IBM Corp; 2013.
    28. Satterthwaite FE. An Approximate Distribution of Estimates of Variance Components. Biometrics Bulletin 1946 Dec;2(6):110. [CrossRef]
    29. Cohen J. Statistical power analysis for the behavioral sciences. Hillsdale, NJ: L. Erlbaum Associates; 1988.
    30. Lyubomirsky S, Sheldon KM, Schkade D. Pursuing happiness: The architecture of sustainable change. Review of General Psychology 2005;9(2):111-131. [CrossRef]
    31. Lyubomirsky S, Layous K. How Do Simple Positive Activities Increase Well-Being? Current Directions in Psychological Science 2013 Jan 22;22(1):57-62. [CrossRef]
    32. Schueller SM, Parks AC. Disseminating self-help: positive psychology exercises in an online trial. J Med Internet Res 2012;14(3):e63 [FREE Full text] [CrossRef] [Medline]
    33. Layous K, Lee H, Choi I, Lyubomirsky S. Culture Matters When Designing a Successful Happiness-Increasing Activity: A Comparison of the United States and South Korea. Journal of Cross-Cultural Psychology 2013 May 09;44(8):1294-1303. [CrossRef]
    34. Lyubomirsky S, Dickerhoof R, Boehm JK, Sheldon KM. Becoming happier takes both a will and a proper way: an experimental longitudinal intervention to boost well-being. Emotion 2011 Apr;11(2):391-402 [FREE Full text] [CrossRef] [Medline]
    35. Ryan RM, Deci EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol 2000 Jan;55(1):68-78. [Medline]
    36. Burke CA. Mindfulness-Based Approaches with Children and Adolescents: A Preliminary Review of Current Research in an Emergent Field. J Child Fam Stud 2009 Jun 27;19(2):133-144. [CrossRef]
    37. Keng S, Smoski MJ, Robins CJ. Effects of mindfulness on psychological health: a review of empirical studies. Clin Psychol Rev 2011 Aug;31(6):1041-1056 [FREE Full text] [CrossRef] [Medline]


    Abbreviations

    DASS-21: Depression, Anxiety, and Stress Scale—Short Form
    SWEMWBS: Short Warwick Edinburgh Mental Well-Being Scale
    SLSS: Student Life Satisfaction Scale


    Edited by G Eysenbach; submitted 09.02.15; peer-reviewed by S Green, M Zhang, S Orlowski, D de Beurs; comments to author 24.06.15; revised version received 30.06.15; accepted 03.07.15; published 28.07.15.

    ©Rowan Burckhardt, Vijaya Manicavasagar, Philip J Batterham, Leonie M Miller, Elizabeth Talbot, Alistair Lum. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 28.07.2015.

    This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.