Published on 25.06.12 in Vol 14, No 3 (2012): May-Jun
Self-monitoring Using Mobile Phones in the Early Stages of Adolescent Depression: Randomized Controlled Trial
Background: The stepped-care approach, where people with early symptoms of depression are stepped up from low-intensity interventions to higher-level interventions as needed, has the potential to assist many people with mild depressive symptoms. Self-monitoring techniques assist people to understand their mental health symptoms by increasing their emotional self-awareness (ESA) and can be easily distributed on mobile phones at low cost. Increasing ESA is an important first step in psychotherapy and has the potential to intervene before mild depressive symptoms progress to major depressive disorder. In this secondary analysis we examined a mobile phone self-monitoring tool used by young people experiencing mild or more depressive symptoms to investigate the relationships between self-monitoring, ESA, and depression.
Objectives: We tested two main hypotheses: (1) people who monitored their mood, stress, and coping strategies would have increased ESA from pretest to 6-week follow-up compared with an attention comparison group, and (2) an increase in ESA would predict a decrease in depressive symptoms.
Methods: We recruited patients aged 14 to 24 years from rural and metropolitan general practices. Eligible participants were identified as having mild or more mental health concerns by their general practitioner. Participants were randomly assigned to either the intervention group (where mood, stress, and daily activities were monitored) or the attention comparison group (where only daily activities were monitored), and both groups self-monitored for 2 to 4 weeks. Randomization was carried out electronically via random seed generation, by an in-house computer programmer; therefore, general practitioners, participants, and researchers were blinded to group allocation at randomization. Participants completed pretest, posttest, and 6-week follow-up measures of the Depression Anxiety Stress Scale and the ESA Scale. We estimated a parallel process latent growth curve model (LGCM) using Mplus to test the indirect effect of the intervention on depressive symptoms via the mediator ESA, and calculated 95% bias-corrected bootstrapping confidence intervals (CIs).
Results: Of the 163 participants assessed for eligibility, 118 were randomly assigned and 114 were included in analyses (68 in the intervention group and 46 in the comparison group). A parallel process LGCM estimated the indirect effect of the intervention on depressive symptoms via ESA and was shown to be statistically significant based on the 95% bias-corrected bootstrapping CIs not containing zero (–6.366 to –0.029). The proportion of the maximum possible indirect effect estimated was κ2 =.54 (95% CI .426–.640).
Conclusions: This study supported the hypothesis that self-monitoring increases ESA, which in turn decreases depressive symptoms for young people with mild or more depressive symptoms. Mobile phone self-monitoring programs are ideally suited to first-step intervention programs for depression in the stepped-care approach, particularly when ESA is targeted as a mediating factor.
Trial Registration: ClinicalTrials.gov NCT00794222; http://clinicaltrials.gov/ct2/show/NCT00794222 (Archived by WebCite at http://www.webcitation.org/65lldW34k)
J Med Internet Res 2012;14(3):e67)
- Mobile phone;
- early intervention;
- patient monitoring;
- randomized controlled trial;
- depressive disorder;
Depression is a common, recurrent disorder and contributes to a substantial burden of disease . Up to 25% of the population experience at least one episode of depression in their lifetime [ ] with more women affected by depression than men [ , ]. First episodes of depression generally begin during adolescence [ ] with up to 30% of young people experiencing mild subclinical depressive symptoms by 18 years of age [ , ] and many progressing to major depressive disorder [ ]. A meta-analysis of the depressive disorder point prevalence estimates for 13- to 18-year-olds reported that 5.7% of adolescents may have a depressive disorder diagnosed at any one point in time [ ]. The severity and longevity of depression are associated with substantial economic costs [ ], attributed to the early onset and recurrent nature of depression. The World Health Organization predicted that depression will be the second leading cause of disease burden worldwide by 2020 [ ], indicating the need for new methods to reduce the burden of depression. Current interventions are estimated to cover 66% of the burden of depression, with 33% of this burden unable to be averted by available treatments [ ]. The large number of people who experience mild depressive symptoms account for more burden of depression than those with major depressive disorder [ ], suggesting that new methods are needed and that they should focus on the early stages of depression.
The stepped-care approach, beginning with simple, inexpensive interventions (that are given before the onset of diagnosed major depressive disorder) with the ability to step up to higher-intensity programs as needed [- ], has the advantage of providing a low-intensity early intervention with reduced length and cost of the treatment to young people experiencing mild mental health symptoms [ , ]. Early interventions that focus on intensive computerized or school-based cognitive behavioral therapy-based programs may be best regarded as second-step interventions, as they are time consuming and have high attrition rates [ ]. Third-step interventions may include individualized face-to-face therapy, whereas a combination of face-to-face therapy and antidepressants should be considered only as a last resort for teenagers [ ]. Van Straten et al [ ] advocate the use of watchful waiting as a first step in the stepped-care model. The watchful waiting approach has two limitations. First, as general practitioners (GPs) are often the first point of contact for people with mild mental health symptoms, the onus of watchful waiting would be placed on GPs. GPs, however, are under pressure to treat many people within a day and to keep appointment times brief (the current average appointment time is 15 minutes) [ ]. Second, a young person’s lack of awareness of emotional distress may reduce the effectiveness of the watchful waiting approach, as GPs are more likely to identify mental health problems in young people who are aware of emotion distress [ ]. Short programs involving the completion of homework diaries have been shown to have larger effects on depressive symptoms than longer-duration programs do and offer a potential alternative first-step approach to watchful waiting [ ]. Such programs may be completed via mobile phones as a first-step early intervention with the opportunity to step up to more intensive treatment programs as needed.
Mobile Phone Self-monitoring Program
Methods for stepped-care interventions involving technology, such as computers, the Internet, or mobile phones, and simple methods such as self-monitoring techniques can engage young people and foster their involvement [- ]. Technology is particularly important when targeting young people, dubbed early adopters, as they are familiar with and rely on technology for much of their social interactions with peers and readily engage with electronic devices [ - ]. In particular, studies conducted using electronic self-monitoring devices with young people have demonstrated that young people readily engage with the technology [ - ] and have high compliance [ ].
We developed and piloted a mobile phone self-monitoring program, the mobiletype program (Mobile Tracking of Young People’s Experiences) [, , ], well suited as a first step in the stepped-care approach. In our pilot studies, young people were asked to monitor their mood, stress, and daily activities on a mobile phone application 4 times a day for 1 week. Results suggested that young people complied with self-monitoring of mental health symptoms for the purpose of reviewing these data with their GP and found it a simple, easy-to-use tool to track their daily experiences. Both GPs and patients found communicating information via the mobiletype program to be beneficial, and the program enabled GPs to better understand the young person’s mental health. The self-monitoring data can be uploaded to GPs and used to detect depressive symptoms and other mental health information to allow progression to further higher-intensity intervention if needed. Self-monitoring approaches are typically used in psychotherapy as an adjunct to cognitive behavioral therapy, with research demonstrating that self-monitoring increases the benefits of therapy more than therapy alone [ ]. Research focusing on momentary sampling techniques demonstrates that self-monitoring itself can lead to a change in behavior and that changes are generally made in a favorable direction [ - ].
Mechanism Underlying Self-monitoring
The contents of early intervention programs generally target a mechanism that predicts the outcome . For example, cognitive–behavioral-based universal programs focus on cognitive restructuring and problem-solving skills training [ ], which are predicted to reduce depressive symptoms. In this study, the intervention was based on emotional self-awareness (ESA), which is hypothesized to predict depressive symptomatology. Increasing awareness of emotions is an important therapeutic step in most psychotherapies for depression and other mental illnesses [ ] by preparing individuals for changing their cognitions, beliefs, and schemas [ ]. A recent case study using mobile phones [ ] showed that self-monitoring increased positive mood and coping strategies while decreasing negative mood in four adult employees with stress. Participants’ ESA increased, and they were able to internalize the questions and therapies used in the mobile program on completion of the study. Self-monitoring studies are promising; however, further research is needed to explore the possible mental health benefits of self-monitoring techniques with young people who have symptoms of depression.
ESA may also provide a suitable framework for first-step intervention programs by assisting young people to become aware of their emotions in preparation for learning more adaptive coping strategies. Adolescence is an ideal target for first-step intervention of mental health problems, as young people begin to develop the ability to independently cope with everyday stresses and negative emotions during their teen years . The current study focused on examining the relationship between self-monitoring and depressive symptoms through the mechanism of ESA, specifically focusing on (1) recognizing emotions [ , , ], (2) being able to identify emotions [ - ], (3) identifying contextual factors surrounding emotions [ , , ], (4) communicating emotional states and associated factors to others and internally [ - ], and (5) planning and making decisions about how to cope with an emotional state [ , , ]. Through self-monitoring, young people can learn to recognize emotional states, and to identify and differentiate various emotions within different contexts, leading to effective communication of emotions to others and productive decision making.
The overall aim of the current study was to investigate, in a randomized controlled trial, the utility of the mobiletype program as a first-step intervention program. The primary hypothesis was that young people who completed the mobiletype intervention program would have lower depressive symptoms than those who completed the attention comparison program. Using a mixed-methods model, we found that depressive symptoms significantly decreased over time for both intervention and attention comparison groups, and we found no significant difference in mental health symptoms between groups . We attributed the lack of difference between groups in mental health symptoms to the unanticipated effect of the training, resources, and support given to young people and GPs over the course of the study for both the intervention and the comparison groups. Interestingly, the intervention group was found to have a significant increase in ESA compared with the comparison group. As both groups were found to have significantly decreased mental health symptoms, there was reduced power to detect a difference between groups.
The goal of this secondary analysis was to further examine the effects of a mobile phone self-monitoring program on ESA among young people with mild or more depressive symptoms as a first-step treatment of depression. Specifically, we were interested in the effects of self-monitoring on ESA and the association between ESA and depressive symptoms. We hypothesized that self-monitoring mood, stress, and coping strategies would increase young people’s awareness of their emotions, which would lead to a decrease in their symptoms of depression. We tested the following hypotheses: (1) young people in the intervention group would have an increase in ESA from pretest to 6-week follow-up compared with the attention comparison group, and (2) the increase in ESA would predict a decrease in depressive symptoms. We estimated a parallel process latent growth curve model (LGCM) [, ] to investigate whether ESA would mediate the relationship between the intervention program and depressive symptoms. A secondary analysis compared the effects of the mobiletype intervention and comparison programs on rumination, with the hypothesis that the intervention group would have decreased rumination compared with the comparison group.
The data presented here were from the mobiletype randomized controlled trial conducted from 2009 to 2011. This was a multicenter, multiregional, stratified (according to region), single-blind, attention-controlled study with balanced (1:1) individual randomization into parallel groups. This study was conducted in Victoria, Australia adhering to the reporting recommendations from the CONSORT statement  as a guide.
All GPs in the Goulburn Valley Region and Albury-Wodonga Region were invited to participate in the study via the Regional Division of General Practice (support units that service clinical practices within a region). GPs in Melbourne were recruited via the local Divisions of General Practice. Clinics were targeted that listed an interest in adolescent health on the Melbourne General Practice Network (www.mgpn.com.au). Participating GPs were trained to use the mobiletype website and were provided with a study manual that included the study procedure, a variety of clinical supports (including referral details of adolescent-friendly allied health professionals and services), youth-friendly Internet, email, and phone support, and youth-focused psychoeducation handouts on a range of mental health problems (this information was also available on the mobiletype website), which were available for all participating GPs and patients. Continuing professional development quality assurance points were available to GPs for their participation in the study. Of the 103 GPs who agreed to participate, 35 actively participated in the study with at least one young person. These contributing GPs were from 26 different practices in the three recruitment areas: 12 in greater Melbourne, 7 in Albury-Wodonga, and 7 in the Goulburn Valley.
Young people meeting the following inclusion criteria were eligible to participate regardless of their reason for visiting the GPs. Participants were required to (1) be aged between 14 and 24 years, (2) speak proficient English, and (3) have a mild or more severe emotional or mental health issue as assessed by their GP or indicated by a score greater than 16 on the Kessler Psychological Distress Scale . Participants were excluded if their psychiatric or medical condition prevented them from complying with either the requirements of informed consent or the study protocol (ie, current psychosis or imminent hospitalization).
We used Version 4 of the mobiletype program as the intervention and attention comparison in this study, which was created in-house using Java Platform, Micro Edition by the Murdoch Childrens Research Institute. This program was written for use with multiple models of mobile phones and firmware. For this trial, participants were lent a study mobile phone with either the mobiletype intervention or a comparison program uploaded onto it. Data from the program was uploaded to a secure website constructed and hosted by the Murdoch Childrens Research Institute as well as encrypted and stored on the mobile phones.
Participants were prompted to complete a mobiletype entry by an auditory signal (beep) emitted from the mobile phone at random intervals in the blocks outlined in. If no report was completed the phone emitted one reminder signal after 5 minutes. Entries were time coded and saved. Participants were also able to complete the program any time and were able to complete an entry between 10 PM and 8 AM, although no trigger was sent at this time. Entries from 10 PM to 12 AM consisted of the evening questions and entries from 12 to 8 AM consisted of the same questions as the afternoon questions, as shown in . Each report took approximately 1–3 minutes to complete.
The intervention group monitored themselves using the complete mobiletype program, which assessed 8 areas of functioning as developed in previous mobiletype studies [, ], consisting of current activities, location, companions, mood, recent stressful events, responses to stressful events, alcohol use, cannabis use, quality and quantity of sleep, quantity and type of exercise, and diet. The time of day when each module assessing the eight areas was delivered varied as displayed in .
The attention comparison program was designed to provide a data collection process similar to that in the intervention group by controlling for the amount of time spent engaged in the program condition and the overall research methodology and the attention given to them by health care professionals and research staff . The comparison group monitored themselves using an abbreviated version of the mobiletype program, which assessed only current activities, location, companions, quality and quantity of sleep, quantity and type of exercise, and diet (meals, snacks, junk food, and soft drinks consumed). Importantly, we removed the modules pertaining to ESA and mental health as shown in (ie, mood, stress, alcohol and cannabis use).
Data collected by the mobiletype program (intervention and comparison groups) on the mobile phone was sent via short message service to a secure website, where it was automatically collated. Each area of assessment was displayed in graphs (eg, daily mood graphs) or in tables (eg, daily alcohol intake). An individualized summary report of the data was written following structured prescriptive guidelines by the second author (registered psychologist), or the first author under the supervision of the second author.
The pretest, posttest, and 6-week follow-up questionnaire packages included the Depression Anxiety Stress Scale (DASS)  and the ESA Scale. The DASS is a 21-item response form with subscales of depression, anxiety, and stress with scores ranging from 0 to 42. The DASS has Australian norms and clinically validated ranges. A high DASS score indicates greater levels of depression, anxiety, or stress symptoms. The ESA Scale was adapted from the 20-item Self-reflection and Insight Scale [ ], the 10-item Ruminative Response Scale [ ], and the 12-item Meta-Evaluation Scale [ ]. As there is no overall measure of ESA that covers the five areas of recognition, identification, communication, contextualization, and decision making, we adapted 33 items pertaining to these areas from the above scales (see ). These were then combined to create a total ESA scale with high internal consistency (Cronbach alpha = .83). The total ESA score ranged from 0 to 132, with higher scores indicating more ESA. Rumination was measured by the brooding subscale of the Ruminative Response Scale, which consisted of 5 items ranging from 0 to 4. A higher score indicates higher rumination.
We anticipated recruitment of 200 participants from 10 general practices. This sample size was based on Cohen’s  statistical testing for multiple regression with two independent variables (accounting for the mediating variable and the outcome) to detect a medium effect with 80% power and a probability of a type I error of .05. We selected a medium effect size, as we considered this to be clinically significant. Using Fritz and MacKinnon’s statistical tests [ ], a sample size of 71 participants inclusive should be sufficient to detect a medium mediation effect with 80% power with bias-corrected bootstrapping (see below). The anticipated sample size of 200 was not met due to delays in recruitment during school holidays and the H1N1 influenza pandemic [ ]. As a result, we set a deadline for stopping recruitment and recruited a total of 118 participants.
Participants were randomly assigned to either (1) the mobiletype monitoring intervention group or (2) the mobiletype attention comparison group; both groups also received medical care as usual. A database was set up by an in-house computer programmer with identification numbers for 100 Melbourne, 50 Goulburn Valley, and 50 Albury-Wodonga participants. Each number was attached to a link that downloaded either the intervention or comparison program directly to the mobile phone. This process was blinded; the intervention and comparison program could not be differentiated when downloading the program. The programmer used a random seed generator to allocate each program to the 200 identification numbers at the individual level and stratified according to area (Melbourne, Goulburn Valley, and Albury-Wodonga). This programmer was not involved in any data collection or analysis. A research assistant downloaded each program by selecting the next consecutive link for the next study mobile phone and was blinded to the allocation, as he knew only the identification number and area to load onto study mobile phones (eg, Melbourne01, Melbourne02). Mobile phones and identification numbers were allocated to consecutively recruited participants. The researchers, participants, and GPs were blinded to randomization pretest. GPs and participants became aware of the group allocation at the posttest when the summary reports were reviewed. This study had approval from the Human Research Ethics Committee of the Royal Children’s Hospital, Melbourne (RCH HREC: 28113), and was registered in ClinicalTrials.gov (Reference: NCT00794222).
In addition to providing treatment as usual, GPs screened their patients for eligibility to the study; organized an appointment for willing participants with a research assistant using an online booking form or a faxed referral form, or by phone; and completed a pretest questionnaire for each participant. Participants then met with a mobiletype research assistant, generally within 5 days of referral, to learn the study process, complete consent forms and the pretest questionnaire package, familiarize themselves with the mobiletype program and the other features of the phone, and complete a practice entry of the mobiletype program. Participants were provided with a study manual that described the research procedure and offered trouble-shooting tips.
Mobile Phone Monitoring Period
All participants borrowed a Sony Ericsson 7501i (Sony Limited Australia, North Ryde, NSW, Australia) mobile phone containing the mobiletype program for the study period. Information regarding the development and testing of the mobiletype program has been previously published . Participants were requested to complete at least two mobiletype entries a day until they returned for their medical review in 2 to 4 weeks. Participants and GPs were advised that 2 to 4 weeks’ monitoring was the ideal monitoring period. Participants were given a subscriber identity module (SIM) card containing A$30 in credit as partial reimbursement for their time and phone credit used.
On completing the monitoring period, participants reviewed the self-monitoring data with their GP on the mobiletype website. Young people completed a posttest assessment immediately following this appointment, and again at 6 weeks and 6 months after this review (6-month posttests not included in the current analysis). GPs completed a posttest questionnaire immediately after the appointment. Questionnaires were completed online, over the phone with a researcher, or via a mailed hardcopy questionnaire. Participants were given a A$20 gift card for each posttest questionnaire completed (maximum of A$60 for all questionnaires completed).
We conducted all analyses on an intention-to-treat basis using all available data from participants included at randomization. Data were assumed to be missing at random , and maximum likelihood estimation was used with missing data accounted for by the missing routines in the statistical program used.
Parallel Process Latent Growth Curve Model
Recently, structural equation modeling has modernized Baron and Kenny’s well-known mediation model [, ]. LGCM is a structural equation modeling technique that allows for examination of inter- and intrapersonal changes and, importantly, parallel process LGCM accommodates longitudinal data for situations in which both the mediator and outcome change over time [ ]. Baron and Kenny’s requirement of a statistically significant pathway between the independent variable and the outcome [ ] is no longer recommended, as detecting a total effect between the independent variable and outcome reduces power, therefore reducing the likelihood that a mediated effect can be detected [ , ]. Parallel process LGCM based on Cheong et al [ ] was used to test the hypothesis that the mobiletype program would increase ESA and that the change in ESA over time would change (decrease) depressive symptoms, by using the software program Mplus Version 6.11 (Muthén & Muthén, Los Angeles, CA, USA). The model estimates two latent variables, the intercept (estimated starting point) and the slope (estimated growth curve), using repeated measures for the mediator (ESA) and the outcome (depression) across the three time points. The latent intercept for both ESA and depression had factor loadings set to 1 to represent the starting point of the growth trajectory, and the factor loadings of the latent linear slope were fixed to 0, 3, and 9 to represent the time between tests: pretest (week 0), posttest (week 2–4), and 6-week follow-up (week 8–10), respectively. Group was defined as 0 for the comparison group and 1 for the intervention group. A combination of at least three of the following cut-off values was used to determine goodness of fit of the model as recommended [ , ]: comparative fit index > .95, Tucker-Lewis Index > .95, standardized root mean square residual < .08, and root mean square error of approximation and root mean square error of approximation < .05. Another statistic considered was chi-square divided by degrees of freedom, with values less than 2 indicating a good fit and values up to 3 indicating an acceptable fit [ ]. When specifying the model, we allowed the variances of the observed variables to covary at each time point and calculated all regression pathways. Indirect effects of group on the slope of depression via the intercept and the slope of ESA were also specified. As recommended [ , , ], we used bootstrapping with resampling at 5000, with bias-corrected confidence intervals reported for the indirect pathway [ ]. Resampling provides more accurate results with fewer assumptions about the data (such as normal distributions) [ ].
Indirect Effect Sizes
A recent development in statistical analysis has led to the capacity of estimating effect sizes for mediation models . Using R for Mac OS X GUI 1.40-devel, an open-source language and environment for statistical analysis (http://www.r-project.org/), we calculated effect sizes of the indirect pathways using the mediation function in the MBESS (http://cran.r-project.org/web/packages/mediation/mediation.pdf) in R. Bootstrapping was used to calculate 95% confidence intervals. As recommended [ , ], both the unstandardized indirect effect size and the proportion of the maximum possible indirect effect (κ2) are reported and described in the results. Other estimates of effect size obtained in this analysis are listed in .
We conducted a secondary analysis to determine whether the intervention group had a decrease in rumination compared with the comparison group. A mixed model analysis was conducted over time and between groups using SPSS Version 17.0.0 (IBM Corporation, Somers, NY, USA) with the MIXED procedure. As with the LGCM, survey time was entered as a continuous variable in weeks (0, 3, and 9). The mixed model employed the more conservative restricted maximum likelihood estimation and unstructured covariance matrix.
We collected data collection between April 16, 2009 and January 28, 2011. As seen in, 137 young people accepted the invitation to join the study, of whom 118 began the recruitment process. We excluded 4 participants after randomization (2 became too unwell to participate, 1 was incarcerated, and 1 gave invalid responses to all pretest measures), resulting in a final sample of 114 young people, which was sufficient to detect the primary aim of a medium-sized indirect effect [ ]. Due to a failure to recruit the expected sample of 200 participants, there is a different number of participants in the comparison and intervention groups; however, a test of the binomial distribution indicated that this difference was not significant with 69 of 118 participants randomly allocated to the intervention group (P = .08). The total number of participants assessed for eligibility was difficult to establish, as the GPs rarely recorded information about patients who met the inclusion criteria and were either not approached to participate or declined when invited to participate. Therefore, the number of patients assessed for eligibility presented in is likely to be underrepresented.
In total, 67% of participants (76/114) completed all questionnaires and 85% of participants (97/114) completed questionnaires at two or more time points. We conducted t tests and chi-square tests and found no significant differences between participants who completed all questionnaires and those who missed questionnaires. Therefore, we included all 114 participants (68 in the intervention group and 46 in the comparison group) in analyses using the routines for missing data in the maximum likelihood estimation. Of 114 participants, 2 (2%) did not complete the pretest questionnaire but went on to complete the mobiletype entries and posttests. We could not contact 27 participants (24%) for the posttest questionnaire but they went on to complete the 6-week follow-up questionnaire.
We found no statistically significant differences in demographic characteristics between the intervention and comparison groups on any pretest measures listed in, except that the intervention group reported significantly higher stress than the comparison group with a mean difference of 3.4 (t109 = 2.06, P = .04).
Participants in the intervention group completed an average of 3.3 (SD 1.42, range 1–8) mobiletype entries each day and completed the program from 1 to 34 days with a mean of 17.7 (SD 6.69) days completed. In the comparison group, participants completed an average of 4 (SD 1.77, range 1–12) mobiletype entries per day, and completed the program for 8 to 25 days with a mean of 16.8 (SD 4.03) days completed. The minimum dose of the program was completion of at least two mobiletype entries a day for at least 14 days. Asshows, 64 (56%) participants in intervention group and 36 (52.9%) in comparison received a minimum dose. Means, standard deviations and 95% confidence intervals are presented in using the observed scores.
Parallel Process Latent Growth Curve Model
The path diagram inshows the parallel process LGCM used to test the indirect pathway of the mobiletype program used on depressive symptoms via ESA. The fit indices for suggest that the model is a good fit for the data (χ26 = 11.3, P = .08, comparative fit index = .958, Tucker-Lewis Index = .854, root mean square error of approximation = .088, P = .18, standardized root mean square residual = .040).
All possible pathways were calculated between group and the four latent variables as illustrated in. The first step to testing mediation was conducted by regressing the slope of ESA onto group. The positive coefficient indicates that there was a greater increase in ESA across time in the intervention group than in the comparison group. This coefficient was statistically significant, as the 95% bias-corrected bootstrap CIs of group on ESA did not contain zero (see ). The second step to testing mediation was conducted by regressing the slope of ESA onto the slope of depression. The negative coefficient here indicates that an increase in ESA led to a decrease in depressive symptoms. This pathway was also statistically significant as indicated by the 95% bias-corrected bootstrap CIs not containing zero (see ). All other pathways illustrated in were tested and were not statistically significant.
The indirect effect of group on the slope of depression via the slope of ESA reported inis statistically significant (95% bootstrap CI did not contain zero) with an unstandardized estimate of –0.608, indicating that participants in the intervention group had a decrease in depressive symptoms via the slope of ESA when compared with the comparison group. There was no significant direct effect from group to depressive symptoms based on the 95% bootstrap CI, indicating that the intervention did not directly decrease depressive symptoms.
presents the relationship between the change in depressive symptoms and the change in ESA for both the intervention and comparison groups.
There was a negative relationship between changes in ESA and changes in depressive symptoms for both groups; accordingly, an increase in ESA was associated with a decrease in depressive symptoms as seen in. The intervention group had larger increases in ESA than did the comparison group, which was associated with a greater decrease in depressive symptoms.
Indirect Effect Sizes
The unstandardized indirect effect size can be interpreted on the DASS depression subscale (on a scale from 0 to 42), indicating that the intervention group is estimated to have a linear decrease in depressive symptoms of .688 per week (95% CI –.962 to –.487) indirectly through mediation of the linear slope of ESA when compared with the comparison group. The proportion of the maximum possible indirect effect has similar properties to, and can be interpreted on a similar scale to, Cohen's r2 ; therefore, the estimated κ2 of .54 (95% CI .426–.640) indicates a large size of indirect effect.
We conducted a secondary analysis to determine whether rumination decreased over time between groups. The mixed model analysis of the Ruminative Response Scale brooding subscale showed a significant main effect of time (β = –0.16, P =.02), indicating an overall decrease in rumination over time for both groups. There was no significant main difference between groups (β = 1.01, P =.11), nor was the interaction between group and time significant (β = –0.07, P =.39).
The current study examined the use of a mobile phone self-monitoring program on ESA with young people who had mild or more depressive symptoms, and supported the hypothesis that self-monitoring mood, stress, and coping strategies increases awareness of emotions. The second hypothesis that an increase in ESA would predict a decrease in depressive symptoms was also supported. Based on Preacher and Kelley’s proportion of the maximum possible indirect effect , there was a large effect of the intervention program on depressive symptoms indirectly via ESA.
This study supports previous research suggesting that simple self-monitoring techniques effectively increase self-awareness, in this case, awareness of one’s own emotions [, ]. Metacognitions, such as self-awareness, are developed during early adolescence [ ], and interventions can be developed that target young people’s ability to recognize emotions, identify emotional states, understand the contextualization of emotions, communicate this emotional knowledge, and plan and make constructive decisions about emotions. Increasing ESA is a core process in the early stages of therapy [ ]. The current study demonstrates the potential for targeting ESA in first-step intervention strategies for young people with mild or more depressive symptoms. This randomized controlled trial was conducted with a view of representing a wide variety of young people who visit GPs with a range of medical and psychological problems and severity of problems. Therefore, the results of this study are applicable to this age group in general.
Self-monitoring techniques may provide an alternative to watchful waiting as a first-step intervention in the stepped-care approach. Mobile phones are ideally suited to this purpose, as the mobiletype program can be downloaded to patients’ own mobile phones to help young people understand and manage mild depressive symptoms. Detailed information about patients’ mental health in recent weeks is then uploaded to GPs in an easy-to-read format, saving time in appointments and allowing progression to more intensive second-step interventions when needed. Young people often do not recognize mental health problems  and instead attend GP clinics for somatic complaints rather than mental health symptoms [ ]. Using self-monitoring techniques with young people who present with underlying somatic complaints may increase their ESA and help young people initiate treatment for depression.
Our secondary hypothesis that the intervention program participants would have a decrease in rumination when compared with those in the comparison program was not supported. Further research is needed to determine whether there is an inverse relationship between rumination and ESA. Nevertheless, rumination decreased over time as did depressive symptoms , further supporting the positive relationship between depression and rumination.
Primary care is a particularly difficult setting in which to conduct randomized controlled studies [, ]. In this study, recruitment was delayed and ceased before the anticipated sample size was recruited due to the H1N1 influenza pandemic, first detected in Melbourne on May 9, 2009 [ ], and during school holidays. These delays resulted in uneven numbers in the two groups. We strongly recommend allocating extra time for recruitment in primary care compared with other settings, particularly in youth-focused studies. The intervention program had no direct effect on depressive symptoms. One interpretation of these results is that there was reduced power for a direct effect given that depressive symptoms decreased significantly over time in both groups. It is possible that both groups had a decrease in depressive symptoms due to the resources, training, and support given to the GPs; however, a larger sample size, or a wait-list control group, would be needed to determine whether depressive symptoms differed between the groups [ , ]. Finally, Reid et al [ ] detail other limitations: a cluster randomized controlled trial, in which GPs rather than patients are randomly allocated, may have been more appropriate but was rejected during the study design due to the difficulty in blinding GPs and participants to the randomization procedure; and participant heterogeneity in illness type, severity, and familiarity with their GP due to broad inclusion criteria needed in an effectiveness trial is likely to have reduced the overall power of the study.
To our knowledge, this is the first randomized controlled trial examining the use of a mobile phone self-monitoring program as an intervention tool for young people with depressive symptoms. Self-monitoring was shown to effectively decrease depression via the mechanism of ESA, suggesting that self-monitoring programs that focus on increasing ESA may provide a useful framework for first-step care in depression. The program provided GPs with information about a young person’s daily activities and can be used to detect early signs of mental health problems, such as elevated negative mood, stress and causes of stress, maladaptive coping strategies, isolation from peers, diet, and exercise, as well as other risk and protective factors. The mobile phone self-monitoring program has the advantage of being low cost, quick, and easy to use.
In summary, mobile phones are well suited to first-step interventions, providing an alternative to watchful waiting and allowing young people to provide accurate information to their GPs about their mood and stress , as well as shortening the length of time it would take to relay this information to GPs in a usual appointment. Mobile phone self-monitoring programs should be considered as a first-step low-cost intervention with young people who are at risk of mental health problems. Self-monitoring has the advantages of helping young people increase their ESA while gaining more information about their mental health symptoms in order to direct them to the best intervention.
This study was supported by research grants from the Telstra Foundation and The Shepherd Foundation, and the Victorian Government’s Operational Infrastructure Support Program supported infrastructure. Sylvia Kauer received an Ian Scott PhD scholarship funded by Australian Rotary Health. Be.Interactive provided telecommunication support. Telstra Corporation provided prepaid SIM cards and telecommunication support. Sony Ericsson provided 40 mobile phones for use in this study. The Statistical Mediation and Moderation Analysis discussion forum on Facebook, led by Kristopher J Preacher and Andrew F Hayes, provided support for the mediation analyses conducted.
Conflicts of Interest
Multimedia Appendix 1
Emotional self-awareness scale.PDF File (Adobe PDF File), 26KB
Multimedia Appendix 2
Indirect effect size estimates of the the parallel process latent growth curve model for group on depressive symptoms via the pathway of emotional self-awareness.PDF File (Adobe PDF File), 42KB
- Murray CJ, Lopez AD. Alternative projections of mortality and disability by cause 1990-2020: Global Burden of Disease Study. Lancet 1997 May 24;349(9064):1498-1504. [CrossRef] [Medline]
- Kessler RC, Avenevoli S, Ries Merikangas K. Mood disorders in children and adolescents: an epidemiologic perspective. Biol Psychiatry 2001 Jun 15;49(12):1002-1014. [Medline]
- Blazer DG, Kessler RC, McGonagle KA, Swartz MS. The prevalence and distribution of major depression in a national community sample: the National Comorbidity Survey. Am J Psychiatry 1994 Jul;151(7):979-986. [Medline]
- Andrews G, Szabo M, Burns J. Preventing major depression in young people. Br J Psychiatry 2002 Dec;181:460-462 [FREE Full text] [Medline]
- Lewinsohn PM, Hops H, Roberts RE, Seeley JR, Andrews JA. Adolescent psychopathology: I. Prevalence and incidence of depression and other DSM-III-R disorders in high school students. J Abnorm Psychol 1993 Feb;102(1):133-144. [Medline]
- Rushton JL, Forcier M, Schectman RM. Epidemiology of depressive symptoms in the National Longitudinal Study of Adolescent Health. J Am Acad Child Adolesc Psychiatry 2002 Feb;41(2):199-205. [CrossRef] [Medline]
- Jane Costello E, Erkanli A, Angold A. Is there an epidemic of child or adolescent depression? J Child Psychol Psychiatry 2006 Dec;47(12):1263-1271. [CrossRef] [Medline]
- Andrews G, Sanderson K, Corry J, Lapsley HM. Using epidemiological data to model efficiency in reducing the burden of depression. J Ment Health Policy Econ 2000 Dec 1;3(4):175-186. [Medline]
- Jorm AF, Griffiths KM. Population promotion of informal self-help strategies for early intervention against depression and anxiety. Psychol Med 2006 Jan;36(1):3-6. [CrossRef] [Medline]
- Geisner IM. Alternative brief interventions for mild depression. Psychiatr Times 2006;23(11).
- van Straten A, Seekles W, van 't Veer-Tazelaar NJ, Beekman AT, Cuijpers P. Stepped care for depression in primary care: what should be offered and how? Med J Aust 2010 Jun 7;192(11 Suppl):S36-S39. [Medline]
- Lynch FL, Hornbrook M, Clarke GN, Perrin N, Polen MR, O'Connor E, et al. Cost-effectiveness of an intervention to prevent depression in at-risk teens. Arch Gen Psychiatry 2005 Nov;62(11):1241-1248 [FREE Full text] [CrossRef] [Medline]
- Spence S, Burns J, Boucher S, Glover S, Graetz B, Kay D, et al. The beyondblue Schools Research Initiative: conceptual framework and intervention. Australas Psychiatry 2005 Jun;13(2):159-164. [CrossRef] [Medline]
- Spence SH, Sheffield JK, Donovan CL. Preventing adolescent depression: an evaluation of the problem solving for life program. J Consult Clin Psychol 2003 Feb;71(1):3-13. [Medline]
- Britt H, Valenti L, Miller G. Time for care. Length of general practice consultations in Australia. Aust Fam Physician 2002 Sep;31(9):876-880. [Medline]
- Haller DM, Sanci LA, Sawyer SM, Patton GC. The identification of young people's emotional distress: a study in primary care. Br J Gen Pract 2009 Mar;59(560):e61-e70. [CrossRef] [Medline]
- Stice E, Shaw H, Bohon C, Marti CN, Rohde P. A meta-analytic review of depression prevention programs for children and adolescents: factors that predict magnitude of intervention effects. J Consult Clin Psychol 2009 Jun;77(3):486-503. [CrossRef] [Medline]
- Walsh SP, White KM, Young RM. Over-connected? A qualitative exploration of the relationship between Australian youth and their mobile phones. J Adolesc 2008 Feb;31(1):77-92. [CrossRef] [Medline]
- Zhao S, Grasmuck S, Martin J. Identity construction on Facebook: digital empowerment in anchored relationships. Comput Hum Behav 2008;24:1816-1836. [CrossRef]
- Hollon SD, Muñoz RF, Barlow DH, Beardslee WR, Bell CC, Bernal G, et al. Psychosocial intervention development for the prevention and treatment of depression: promoting innovation and increasing access. Biol Psychiatry 2002 Sep 15;52(6):610-630. [Medline]
- Reid SC, Kauer SD, Dudgeon P, Sanci LA, Shrier LA, Patton GC. A mobile phone program to track young people's experiences of mood, stress and coping. Development and testing of the mobiletype program. Soc Psychiatry Psychiatr Epidemiol 2009 Jun;44(6):501-507. [CrossRef] [Medline]
- Silk JS, Steinberg L, Morris AS. Adolescents' emotion regulation in daily life: links to depressive symptoms and problem behavior. Child Dev 2003;74(6):1869-1880. [Medline]
- Kauer SD, Reid SC, Sanci L, Patton GC. Investigating the utility of mobile phones for collecting data about adolescent alcohol use and related mood, stress and coping behaviours: lessons and recommendations. Drug Alcohol Rev 2009 Jan;28(1):25-30. [CrossRef] [Medline]
- Stone AA, Shiffman S, Atienza AA, Nebeling L. Historical roots and rationale of ecological momentary assessment (EMA). In: Stone AA, Shiffman S, Atienza AA, Nebeling L, editors. The Science of Real-Time Data Capture: Self-reports in Health Research. New York, NY: Oxford University Press; 2007:3-10.
- Kauer S, Reid S, Jackson H, Jorm T. The phenomenon of insight and preliminary findings for preventing depression: self-monitoring via mobile phones. Aust N Z J Psychiatry 2007;41(s2):A469. [CrossRef]
- Kazantzis N. Power to detect homework effects in psychotherapy outcome research. J Consult Clin Psychol 2000 Feb;68(1):166-170. [Medline]
- Abueg FR, Colletti G, Kopel SA. A study of reactivity: the effects of increased relevance and saliency of self-monitored smoking through enhanced carbon monoxide feedback. Cogn Ther Res 1985;9:321-333. [CrossRef]
- Ewart CK. Self-observation in natural enviroments: reactive effects of behavior desirability and goal-setting. Cogn Ther Res 1978;2:39-56. [CrossRef]
- Kazdin AE. Reactive self-monitoring: the effects of response desirability, goal setting, and feedback. J Consult Clin Psychol 1974 Oct;42(5):704-716. [Medline]
- Cheong J, Mackinnon DP, Khoo ST. Investigation of mediational proceses using parallel process latent growth curve modeling. Struct Equ Modeling 2003 Apr 1;10(2):238-262. [CrossRef] [Medline]
- Sheffield JK, Spence SH, Rapee RM, Kowalenko N, Wignall A, Davis A, et al. Evaluation of universal, indicated, and combined cognitive-behavioral approaches to the prevention of depression among adolescents. J Consult Clin Psychol 2006 Feb;74(1):66-79. [CrossRef] [Medline]
- Prochaska JO, Diclemente CC. Transtheoretical therapy: towards a more integrative model of change. Psychotherapy (Chic) 1982;19(3):276-288. [CrossRef]
- Beck AT. The past and future of cognitive therapy. J Psychother Pract Res 1997;6(4):276-284 [FREE Full text] [Medline]
- Morris ME, Kathawala Q, Leen TK, Gorenstein EE, Guilak F, Labhard M, et al. Mobile therapy: case study evaluations of a cell phone application for emotional self-awareness. J Med Internet Res 2010;12(2):e10 [FREE Full text] [CrossRef] [Medline]
- Saari C. Emotional competence and self-regulation in childhood. In: Salovey P, Sluyter DJ, editors. Emotional Development and Emotional Intelligence: Educational Implications. New York, NY: Basic Books; 1997:35-66.
- Brown KW, Ryan RM. The benefits of being present: mindfulness and its role in psychological well-being. J Pers Soc Psychol 2003 Apr;84(4):822-848. [Medline]
- Chambers R, Lo BCY, Allen NB. The impact of intensive mindfulness training on attentional control, cognitive style, and affect. Cognit Ther Res 2008;32:303-322. [CrossRef]
- Beitman BD, Soth AM. Activation of self-observation: a core process among the psychotherapies. J Psychother Integr 2006;16:383-397. [CrossRef]
- Lane RD, Schwartz GE. Levels of emotional awareness: a cognitive-developmental theory and its application to psychopathology. Am J Psychiatry 1987 Feb;144(2):133-143. [Medline]
- Swinkels A, Giuliano TA. The measurement and conceptualisation of mood awareness: monitoring and labeling one' mood states. Pers Soc Psychol Bull 1995;21:934-949. [CrossRef]
- Watkins ER. Constructive and unconstructive repetitive thought. Psychol Bull 2008 Mar;134(2):163-206. [CrossRef] [Medline]
- Epstein S. Integration of the cognitive and the psychodynamic unconscious. Am Psychol 1994 Aug;49(8):709-724. [Medline]
- Lyke JA. Insight, but not self-reflection, is related to subjective well-being. Pers Individ Diff 2009;46:66-70. [CrossRef]
- Segerstrom SC, Stanton AL, Alden LE, Shortridge BE. A multidimensional structure for repetitive thought: what's on your mind, and how, and how much? J Pers Soc Psychol 2003 Nov;85(5):909-921. [CrossRef] [Medline]
- Grosse Holtforth M, Casonguay LG, Boswell JF, Wilson LA, Kakouros AA, Borkovec TD. Insight in cognitive-behavioral therapy. In: Castonguay LG, Hill CE, editors. Castonguay LG, Hill CE, editors. Insight in Psychotherapy. Washington, DC: American Psychological Association; 2007:57-80.
- Mayer JD, Stevens AA. An emerging understanding of the reflective (meta-) experience of mood. J Res Pers 1994;28:351-373. [CrossRef]
- Reid SC, Kauer SD, Hearps SJ, Crooke AH, Khor AS, Sanci LA, et al. A mobile phone application for the assessment and management of youth mental health problems in primary care: a randomised controlled trial. BMC Fam Pract 2011;12:131 [FREE Full text] [CrossRef] [Medline]
- von Soest T, Hagtvet K. Mediation analysis in a latent growth curve modeling framework. Struct Equ Modeling 2011;18(2):289-314. [CrossRef]
- Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. BMC Med 2010;8:18-27 [FREE Full text] [CrossRef] [Medline]
- Andrews G, Slade T. Interpreting scores on the Kessler Psychological Distress Scale (K10). Aust N Z J Public Health 2001 Dec;25(6):494-497. [Medline]
- Lindquist R, Wyman JF, Talley KM, Findorff MJ, Gross CR. Design of control-group conditions in clinical trials of behavioral interventions. J Nurs Scholarsh 2007;39(3):214-221. [CrossRef] [Medline]
- Lovibond PF, Lovibond SH. The structure of negative emotional states: comparison of the Depression Anxiety Stress Scales (DASS) with the Beck Depression and Anxiety Inventories. Behav Res Ther 1995 Mar;33(3):335-343. [Medline]
- Grant AM, Franklin J, Langford P. The Self-Reflection and Insight Scale: a new measure of private self-consciousness. Soc Behav Pers 2002;30(8):821-836. [CrossRef]
- Treynor W, Gonzalez R, Nolen-Hoeksema S. Rumination reconsidered: a psychometric analysis. Cogn Ther Res 2003;27:247-259. [CrossRef]
- Cohen J. A power primer. Psychol Bull 1992 Jul;112(1):155-159. [Medline]
- Fritz MS, Mackinnon DP. Required sample size to detect the mediated effect. Psychol Sci 2007 Mar;18(3):233-239. [CrossRef] [Medline]
- Denholm JT, Gordon CL, Johnson PD, Hewagama SS, Stuart RL, Aboltins C, et al. Hospitalised adult patients with pandemic (H1N1) 2009 influenza in Melbourne, Australia. Med J Aust 2010 Jan 18;192(2):84-86. [Medline]
- Hedeker D, Gibbons RD. Application of random-effects pattern-mixture models for missing data in longitudinal studies. Psychol Methods 1997;2(1):64-78.
- Baron RM, Kenny DA. The moderator-mediator variable distinction in social psychological research: conceptual, strategic, and statistical considerations. J Pers Soc Psychol 1986 Dec;51(6):1173-1182. [Medline]
- MacKinnon DP, Fairchild AJ, Fritz MS. Mediation analysis. Annu Rev Psychol 2007;58:593-614. [CrossRef] [Medline]
- Selig JP, Preacher KJ. Mediation models for longitudinal data in developmental research. Res Hum Dev 2009;6(2-3):144-164. [CrossRef]
- Hayes AF. Beyond Baron and Kenny: statistical mediation analysis in the new milennium. Commun Monogr 2009;76(4):408-420. [CrossRef]
- Jackson DL, Gillaspy JA, Purc-Stephenson R. Reporting practices in confirmatory factor analysis: an overview and some recommendations. Psychol Methods 2009 Mar;14(1):6-23. [CrossRef] [Medline]
- Schermelleh-Engel K, Moosbrugger H, Muller H. Evaluating the fit of structural equation models: Tests of significance and descriptive goodness-of-fit measures. Methods Psychol Res Online 2003;8(2):23-74.
- Preacher KJ, Hayes AF. Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behav Res Methods 2008 Aug;40(3):879-891. [Medline]
- Taylor AB, MacKinnon DP, Tein JY. Test of the three-path mediated effect. Organ Res Methods 2008;11(2):241-269. [CrossRef]
- Preacher KJ, Kelley K. Effect size measures for mediation models: quantitative strategies for communicating indirect effects. Psychol Methods 2011 Jun;16(2):93-115. [CrossRef] [Medline]
- Pennebaker JW, Zech E, Rime B. Disclosing and sharing emotion: psychological, social and health consquences. In: Stroebe MS, Stroebe W, Hansson RO, Schut H, editors. Handbook of Bereavement Research: Consequences, Coping and Care. Washington, DC: American Psychological Association; 2001:517-539.
- Rickwood D, Cavanagh S, Curtis L, Sakrouge R. Educating young people about mental health and mental illness: evaluating a school-based programme. Int J Ment Health Promot 2004;6(4):23-32.
- Tylee A, Haller DM, Graham T, Churchill R, Sanci LA. Youth-friendly primary-care services: how are we doing and what more needs to be done? Lancet 2007 May 5;369(9572):1565-1573. [CrossRef] [Medline]
- Page MJ, French SD, McKenzie JE, O'Connor DA, Green SE. Recruitment difficulties in a primary care cluster randomised trial: investigating factors contributing to general practitioners' recruitment of patients. BMC Med Res Methodol 2011;11:35 [FREE Full text] [CrossRef] [Medline]
- Williamson MK, Pirkis J, Pfaff JJ, Tyson O, Sim M, Kerse N, et al. Recruiting and retaining GPs and patients in intervention studies: the DEPS-GP project as a case study. BMC Med Res Methodol 2007;7:42 [FREE Full text] [CrossRef] [Medline]
|DASS: Depression Anxiety Stress Scale|
|ESA: emotional self-awareness|
|GP: general practitioner|
|LGCM: latent growth curve model|
Edited by D Mohr, A Calear, H Christensen; submitted 08.06.11; peer-reviewed by G Andrews, G Clarke; comments to author 06.07.11; revised version received 18.08.11; accepted 23.08.11; published 25.06.12
©Sylvia Deidre Kauer, Sophie Caroline Reid, Alexander Hew Dale Crooke, Angela Khor, Stephen John Charles Hearps, Anthony Francis Jorm, Lena Sanci, George Patton. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 25.06.2012.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on http://www.jmir.org/, as well as this copyright and license information must be included.